OPENAI-COMPATIBLE PROVIDERS
Drop-in OpenAI-compatible providers.
Wire any OpenAI-compatible endpoint into the AI TOOLKIT — self-hosted, managed, and everything in between.
5 providers
Writing a Custom Provider
Create a custom provider package for an OpenAI-compatible provider leveraging the AI TOOLKIT OpenAI Compatible package.
custom-providers
LM Studio
Use the LM Studio OpenAI compatible API with the AI TOOLKIT.
lmstudio
NVIDIA NIM
Use NVIDIA NIM OpenAI compatible API with the AI TOOLKIT.
nim
Clarifai
Use Clarifai OpenAI compatible API with the AI TOOLKIT.
clarifai
Heroku
Use a Heroku OpenAI compatible API with the AI TOOLKIT.
heroku