| |
Litelm: LiteLLM Without the Bloat
Litelm is a lightweight alternative to LiteLLM that provides core LLM routing and message translation functionality in approximately 2,900 lines of code with only two dependencies, stripping away the proxy servers, caching layers, and advanced features of the full library. It maintains API compatibility with LiteLLM while supporting 19 providers including OpenAI, Anthropic, Groq, and Mistral, with features for streaming, tool use, and embeddings but without router load balancing, caching, or token counting capabilities.
Read Full Article →
← More Tech news