55 lines
2.1 KiB
Markdown
55 lines
2.1 KiB
Markdown
|
# Simple Bespoke-Minicheck Example
|
|||
|
|
|
|||
|
|
`bespoke-minicheck` is a model for checking if a claim is supported by a document. It is used through the **generate** endpoint, which is called in this example with a `prompt` that includes the expected formatting of the user input.
|
|||
|
|
|
|||
|
|
## Running the Example
|
|||
|
|
|
|||
|
|
1. Ensure you have the `bespoke-minicheck` model installed:
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
ollama pull bespoke-minicheck
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
2. Install the dependencies:
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
pip install -r requirements.txt
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
3. Run the program:
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
python main.py
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
4. Enter a document and a claim when prompted:
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
Enter a document: Roses are red.
|
|||
|
|
|
|||
|
|
Enter a claim: Roses are blue.
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
The claim and document are then given to the `bespoke-minicheck` as inputs, which then generates a response (Yes or No) on whether the claim is supported by the document.
|
|||
|
|
|
|||
|
|
```bash
|
|||
|
|
Is the claim supported by the document according to bespoke-minicheck? No
|
|||
|
|
```
|
|||
|
|
|
|||
|
|
## More Examples
|
|||
|
|
|
|||
|
|
Document ([source](https://en.wikipedia.org/wiki/Apple_I)):
|
|||
|
|
> The Apple Computer 1 (Apple-1[a]), later known predominantly as the Apple I(written with a Roman numeral),[b] is an 8-bit motherboard-only personal computer designed by Steve Wozniak[5][6] and released by the Apple Computer Company (now Apple Inc.) in 1976. The company was initially formed to sell the Apple I – its first product – and would later become the world's largest technology company.[7] The idea of starting a company and selling the computer came from Wozniak's friend and Apple co-founder Steve Jobs.[8][9] One of the main innovations of the Apple I was that it included video display terminal circuitry on its circuit board, allowing it to connect to a low-cost composite video monitor or television, instead of an expensive computer terminal, compared to most existing computers at the time.
|
|||
|
|
|
|||
|
|
Claim:
|
|||
|
|
>The Apple I is a 16-bit computer.
|
|||
|
|
|
|||
|
|
Expected output:
|
|||
|
|
>Is the claim supported by the document according to bespoke-minicheck? **No**
|
|||
|
|
|
|||
|
|
Claim:
|
|||
|
|
>Apple was originally called the Apple Computer Company.
|
|||
|
|
|
|||
|
|
Expected output:
|
|||
|
|
>Is the claim supported by the document according to bespoke-minicheck? **Yes**
|