ollama/llm/ext_server/README.md
2024-01-04 12:12:05 -08:00

193 B

Extern C Server

This directory contains a thin facade we layer on top of the Llama.cpp server to expose extern C interfaces to access the functionality through direct API calls in-process