For the complete documentation index, see llms.txt. This page is also available as Markdown.

AI Gateway

An intelligent connection gateway for AI services

AI Gateway is a centralized gateway that lets you integrate AI models from multiple providers (OpenAI, Google, Deepseek, and more) through a single endpoint — reducing the complexity of switching models, centralizing monitoring, optimizing cost, and protecting your data.


Overview

Capability
Description

Multi-LLM support

Flexibly integrate multiple LLMs from multiple providers through one gateway

Monitoring

Track performance and activity through metrics and logs, including detailed latency breakdowns

Access control

Manage Authentication Tokens and set rate limits by request count or token count

Cost optimization

Caching reduces the number of requests sent to the model, saving cost and improving response time


Getting Started

I want to...
Go to

Understand what AI Gateway is and what it solves

Initialize a gateway, send my first request, and monitor activity

Add, edit, or remove providers and models on the gateway

Create and manage Authentication Tokens

Reduce cost and latency with caching

Limit requests or tokens within a time window

Learn how AI Gateway protects sensitive information

See the pricing policy for the service

Last updated