One interface, every model.

Connect to any model provider through the same AI TOOLKIT primitives — first-party, OpenAI-compatible, community, framework adapters, and observability tooling.

AI TOOLKIT PROVIDERS

First-party providers.

Model providers maintained by the AI TOOLKIT team. Connect to OpenAI, Anthropic, Google, Amazon Bedrock, and more with a single consistent interface.

32 providers

OPENAI-COMPATIBLE PROVIDERS

Drop-in OpenAI-compatible providers.

Wire any OpenAI-compatible endpoint into the AI TOOLKIT — self-hosted, managed, and everything in between.

5 providers

COMMUNITY PROVIDERS

Providers built by the community.

Community-maintained providers for models and platforms beyond the first-party set, all through the same primitives.

48 providers

FRAMEWORK ADAPTERS

Use your favorite frameworks.

Adapters that bridge LangChain and LlamaIndex to the AI TOOLKIT so you can combine ecosystems in one app.

2 providers

OBSERVABILITY

Trace, monitor, and evaluate.

Instrument every generation with tracing, logging, evals, and analytics from the tools your team already uses.

14 providers