LiteLLM allows developers to integrate a diverse range of LLM models as if they were calling OpenAI’s API, with support for fallbacks, budgets, rate limits, and real-time monitoring of API calls. The ...

近日，开源AI API网关LiteLLM遭遇供应链投毒事件，引发全球开发者社区高度关注。作为支撑数千家企业AI架构的核心工具，该平台每月安装量高达9500万次，支持通过统一接口调用OpenAI、Anthropic等100余家服务商的API服务。此次攻击导致两个恶意版本（1.82.7和1.82.8）在PyPI官方仓库短暂发布，现已被紧急撤下。

Navigating the ever-expanding world of large language models (LLMs) can feel like juggling too many pieces of a puzzle. Each provider has its own quirks—unique APIs, syntax variations, and specific ...