Back to RepoInsider
Signal dossier

sgl-project/mini-sglang

AI Tools

Pulse

0

Velocity

Stars

0

Run large language models locally with a conversational interface.

Mini-sglang enables local execution of large language models for conversational AI applications.

Run sophisticated LLMs locally for AI development and experimentation.

Why Trending

Provides a lightweight way to run LLMs and experiment with them.

Target Audience

AI researchers and developers testing LLMs locally.

Similar Projects

text-generation-webuillama.cpp
RepoInsider · Spot breakout GitHub repos early