Pulse
72
Velocity
+819%
Stars
185
Compresses LLM data to speed up AI model inference.
High-speed KV cache compression for LLM inference on NVIDIA GPUs.
Why Trending
Offers significant KV cache compression for faster LLM inference.
Target Audience
AI researchers and developers optimizing LLM inference.
Similar Projects