Connect to AI Gateway

To connect to AI Gateway, go to the AI Services → AI Gateway section.

Getting Connection Details

Copy link

You can find the connection details in the Connection tab.

1. Go to AI Services → AI Gateway.
2. Open the Connection tab.
3. Select a model and a programming language. The interface will show the input and output token pricing for the selected model. To compare model specifications before choosing, see Comparing Models.
4. Copy the code sample for connecting and the command for installing the OpenAI library.

Comparing Models

Copy link

The Models tab lists all available models along with their type, context window size, maximum response length, and input/output token pricing.

To find a specific model:

1. Go to AI Services → AI Gateway.
2. Open the Models tab.
3. Filter the list by type or provider, or enter a model name in the search field.

To compare models:

1. Go to AI Services → AI Gateway.
2. Open the Models tab.
3. Click Compare models.
4. Select the models you want to compare.

Managing API Keys

Copy link

Creating an API Key

Copy link

AI Gateway uses separate keys that aren't linked to your account level API keys.

To create a key:

1. Go to AI Services → AI Gateway.
2. Click Create Key.
3. Enter a name for the key and select the validity period.
4. (Optional) Add a description that will show in the dashboard.
5. (Optional) Select the project.
6. Click Create.
7. Copy the generated key and store it locally.

Viewing Key Usage

Copy link

Each API key has its own dashboard showing incoming and outgoing token counts, token usage, and number of requests. You can filter this data by period and model.

To view key usage:

1. Go to AI Services → AI Gateway.

2. Open the API Keys tab.

3. Click the key you want to view.

4. Check token usage and number of requests on the Dashboard tab.

5. (Optional) Filter the statistics by period or model.

Setting a Token Limit

Copy link

To set a token usage limit for a key:

1. Go to AI Services → AI Gateway.

2. Open the API Keys tab.

3. Click the key you want to configure.

4. On the Management tab, click Set limits.

5. To set an overall limit:

   • Enable Common consumption limit.

   • Enter the number of tokens (input + output) allowed per day.

6. To set a limit per model:

   • Enable Per-model consumption limit.

   • Click Select models.

   • Choose the models to limit.

   • Enter the number of tokens (input + output) allowed per day for each.

   • (Optional) Click Add limit to set another limit.

7. Click Save.

Regenerating an API Key

Copy link

To regenerate an existing API key:

1. Go to AI Services → AI Gateway.
2. Open the API Keys tab.
3. Click the three dot menu next to the key you want to remove.
4. Click Regenerate.
5. Confirm the action.

Deleting an API Key

Copy link

If you no longer need an API key, you can delete it:

1. Go to AI Services → AI Gateway.
2. Open the API Keys tab.
3. Click the three dot menu next to the key you want to remove.
4. Click Delete.
5. Confirm the action.