LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
Pulse
86
Velocity
+133%
Stars
13,706
LLM inference server for Apple Silicon, controllable from macOS menu bar.
LLM inference server optimized for Apple Silicon with convenient macOS integration.
Run powerful LLMs locally on your Mac with continuous batching and SSD caching.
Why Trending
Optimized LLM inference for Apple Silicon with a user-friendly macOS interface.
Target Audience
macOS users running LLMs locally on Apple Silicon hardware.
Similar Projects