Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Pulse
72
Velocity
+145%
Stars
46,366
AI Gateway to OpenAI and 100+ LLMs, with cost tracking and guardrails.
Unified SDK for 100+ LLM APIs in OpenAI format, with cost tracking.
Call 100+ LLMs, including Azure and Bedrock, using the OpenAI API format.
Why Trending
Simplifies calling diverse LLMs through a single, familiar API format.
Target Audience
Developers integrating multiple LLMs into their applications.
Similar Projects