Pulse
0
Velocity
Stars
0
Efficiently prune context for large language models on Raspberry Pi.
Reduces context window size for LLMs, enabling them to run on limited hardware.
Run large language models efficiently on a Raspberry Pi.
Why Trending
Enables powerful LLMs to run on low-power devices, democratizing AI.
Target Audience
Developers running LLMs on resource-constrained devices like Raspberry Pi.
Similar Projects