Pulse
0
Velocity
Stars
0
Local SSD inference server for LLMs with optional RAG.
Inferssd provides a fast local SSD inference server for LLMs, with RAG support.
Run LLMs locally at high speed using SSD optimization and RAG.
Why Trending
Optimized for local SSD performance in LLM inference and RAG.
Target Audience
Developers needing efficient local LLM inference and RAG.
Similar Projects