Pulse
0
Velocity
Stars
0
Open-source LLM inference engine for running large models on limited hardware.
Inference engine for running LLMs efficiently on devices with limited memory.
Runs large language models locally on your machine by intelligently managing memory.
Why Trending
Enables running large LLMs on consumer hardware by optimizing memory usage.
Target Audience
Developers running LLMs on consumer hardware.
Similar Projects