llama.cpp/docs/index.md
Andrei Betlen df15caa877 Add mkdocs
2023-03-24 18:57:59 -04:00

535 B

🦙 Python Bindings for llama.cpp

Simple Python bindings for @ggerganov's llama.cpp library. This package provides:

  • Low-level access to C API via ctypes interface.
  • High-level Python API for text completion
    • OpenAI-like API
    • LangChain compatibility

API Reference

::: llama_cpp.Llama options: members: - init - call show_root_heading: true

::: llama_cpp.llama_cpp options: show_if_no_docstring: true