DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Pulse
99
Velocity
+454%
Stars
18,964
High-performance inference framework for DeepSeek's large-scale AI models.
Powers DeepSeek's production services with an optimized, large-scale AI model inference framework.
Run DeepSeek's powerful LLMs at scale with a high-performance, production-ready inference framework.
Why Trending
Optimized for DeepSeek's large models, enabling efficient offline inference at scale.
Target Audience
AI researchers and developers deploying large language models.
Similar Projects