ollama/llm/ext_server/README.md
2024-01-04 12:12:05 -08:00

4 lines
193 B
Markdown

# Extern C Server
This directory contains a thin facade we layer on top of the Llama.cpp server
to expose `extern C` interfaces to access the functionality through direct API calls in-process