ollama/README.md

67 lines
890 B
Markdown
Raw Normal View History

2023-06-25 17:08:03 +00:00
# proto
2023-06-22 16:45:31 +00:00
2023-06-25 17:08:03 +00:00
🙊
## Running
Install dependencies:
2023-06-22 16:45:31 +00:00
```
2023-06-25 17:08:03 +00:00
pip install -r requirements.txt
2023-06-22 16:45:31 +00:00
```
2023-06-25 17:08:03 +00:00
Put your model in `models/` and run:
```
python proto.py
```
To run the app:
```
cd desktop
npm install
npm start
```
## Building
If using Apple silicon, you need a Python version that supports arm64:
```bash
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
bash Miniforge3-MacOSX-arm64.sh
```
Get the dependencies:
```bash
pip install -r requirements.txt
```
2023-06-25 17:10:15 +00:00
Then build a binary for your current platform:
2023-06-25 17:08:03 +00:00
```bash
python3 build.py
```
2023-06-25 17:10:15 +00:00
### Building the app
2023-06-25 17:08:03 +00:00
```
cd desktop
npm run package
```
## API
2023-06-25 18:29:26 +00:00
### `GET /models`
Returns a list of available models
2023-06-25 17:08:03 +00:00
### `POST /generate`
2023-06-25 18:29:26 +00:00
Generates completions as a series of JSON objects
2023-06-25 17:08:03 +00:00
model: `string` - The name of the model to use in the `models` folder.
prompt: `string` - The prompt to use.