Pulse
0
Velocity
Stars
0
A fork or derivative of `llama.cpp` for local LLM inference.
Runs large language models locally on your hardware using C/C++ inference.
Run large language models efficiently on local CPUs with C/C++ inference.
Why Trending
Makes powerful LLMs accessible locally on commodity hardware, not just expensive GPUs.
Target Audience
AI developers, researchers.
Similar Projects