66 lines
897 B
Markdown
66 lines
897 B
Markdown
# proto
|
|
|
|
🙊
|
|
|
|
## Running
|
|
|
|
Install dependencies:
|
|
|
|
```
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
Put your model in `models/` and run:
|
|
|
|
```
|
|
python3 proto.py serve
|
|
```
|
|
|
|
To run the app:
|
|
|
|
```
|
|
cd desktop
|
|
npm install
|
|
npm start
|
|
```
|
|
|
|
## Building
|
|
|
|
If using Apple silicon, you need a Python version that supports arm64:
|
|
|
|
```bash
|
|
wget https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-MacOSX-arm64.sh
|
|
bash Miniforge3-MacOSX-arm64.sh
|
|
```
|
|
|
|
Get the dependencies:
|
|
|
|
```bash
|
|
pip install -r requirements.txt
|
|
```
|
|
|
|
Then build a binary for your current platform:
|
|
|
|
```bash
|
|
python3 build.py
|
|
```
|
|
|
|
### Building the app
|
|
|
|
```
|
|
cd desktop
|
|
npm run package
|
|
```
|
|
|
|
## API
|
|
|
|
### `GET /models`
|
|
|
|
Returns a list of available models
|
|
|
|
### `POST /generate`
|
|
|
|
Generates completions as a series of JSON objects
|
|
|
|
model: `string` - The name of the model to use in the `models` folder.
|
|
prompt: `string` - The prompt to use.
|