Back to RepoInsider
Signal dossier

sybil-solutions/glm-flash-lite

AI Tools

Pulse

0

Velocity

Stars

0

Fast LLM inference using FlashAttention for reduced memory.

Optimized LLM inference with FlashAttention for efficient memory usage.

Achieve faster LLM inference and significantly lower memory usage with FlashAttention.

Why Trending

FlashAttention implementation for faster, less memory-intensive LLM inference.

Target Audience

ML engineers deploying LLMs

Similar Projects

vLLMText Generation Inference
RepoInsider · Spot breakout GitHub repos early