Pulse
0
Velocity
Stars
0
Rust bindings for `llama.cpp` for efficient local LLM inference.
High-performance Rust bindings to run LLMs locally using llama.cpp.
Run powerful LLMs locally in Rust applications with minimal overhead.
Why Trending
Offers efficient LLM inference within the Rust ecosystem.
Target Audience
Rust developers integrating local LLMs.
Similar Projects