reference impl with llama.cpp compiled to distributed inference across machines, with real end to end demo
Pulse
64
Velocity
1.3x
Stars
521