Python Bindings for llama.cpp ( github.com )
Simple Python bindings for @ggerganov's llama.cpp library. This package provides:
Low-level access to C API via ctypes interface.
High-level Python API for text completion
OpenAI-like API
LangChain compatibility
LlamaIndex compatibility
OpenAI compatible web server
Local Copilot replacement
Function Calling support
Vision API support
Multiple Models
Documentation is available at https://llama-cpp-python.readthedocs.io/en/latest.
![](https://mbin.grits.dev/media/cache/resolve/entry_thumb/4e/22/4e22c6bae16e87e4641a8b0590af9b0617b8174d27d2d424258c6168963de15e.png)