AI Gateway vs Other APIs

Last updated July 24, 2026

AI Gateway is an API for working directly with language models without going through AI agents.

Unlike the OpenAI compatible API and the native API, AI Gateway doesn't provide agent level capabilities such as:

  • RAG
  • MCP
  • System level configuration (system prompt, temperature, response length limits)

AI Gateway is the right choice when you need to work with models directly, without any agent logic. For example:

  • You're building your own logic on top of models (custom RAG, MCP integrations)
  • You need a single access point for multiple models
  • You're already using the OpenAI SDK and want to switch between models without changing your code

AI Gateway vs the OpenAI Compatible API

 

OpenAI Compatible API

AI Gateway

Operates on

An agent

A model

RAG / MCP

Supported

Not supported

System level settings

Configured in the agent's dashboard

Passed with each request

Model selection

The agent's assigned model

Any available model

We recommend using the OpenAI SDK to work with the API, it abstracts away the differences and simplifies integration.

Supported methods and capabilities depend on the model you're using. For example, the responses endpoint is only available for models that support reasoning.

AI Gateway does not support:

  • Files API for uploading and managing files
  • Fine-tuning for training and customizing models
  • Video API for working with video