Manage providers
AI Gateway uses provider resources to identify and manage model service providers. This topic describes how to view, create, edit, and delete providers in an AI Gateway instance.
Provider overview
A provider is an AI Gateway resource that identifies the large language model provider to which a model or service belongs. AI Gateway supports preset providers and lets you create custom providers:
Preset provider: built in to the system. It cannot be edited or deleted, and it can be referenced by models and services.
Custom provider: created by you. You can edit its name or delete it when it has no references.
Models and services in an AI Gateway instance reference providers. In the provider list, the Associated Models column shows the models associated with each provider.
Prerequisites
- In addition to this prerequisite, managing providers requires no additional RAM permissions and has no instance specification or region restrictions.
View the provider list
Log on to the AI Gateway console. On the gateway list page, select the region where the instance that you want to manage is located, and then click the instance ID.
In the left-side navigation pane, click Model Metadata Management to go to the model management page.
Click the Provider tab to view the provider list for the current instance.
The provider list contains the following columns:
| Column | Description |
| Name | The display name of the provider. |
| Identifier | The unique identifier that the system automatically generates. |
| Associated Models | The number of models associated with the provider. |
| Updated At | The time when the provider was last updated. |
| Actions | View, Edit, and Delete. |
Before you delete a provider, you can check the Associated Models column to determine whether models are still associated with the provider.
Create a provider
On the provider list, click Create Provider.
In the Create Provider panel, configure the following parameters:
Parameter Description Name Required. The display name of the provider. Duplicate names are supported. Identifier Required. Automatically generated by the system. The identifier cannot be edited after creation, and this field is disabled in the Create Provider panel. Click OK.
The new provider appears in the provider list.
To reference the new provider in a service, see Next steps.
Edit a provider
Preset providers cannot be edited. When you edit a custom provider, you can change only the name. The identifier cannot be changed.
On the provider list, find the custom provider that you want to edit.
Click Edit in the Actions column and change the provider name.
Click OK to save.
The provider list displays the updated name.
Delete a provider
Preset providers cannot be deleted. A provider cannot be deleted if it is referenced by a model or service.
On the provider list, find the custom provider that you want to delete.
Click Delete in the Actions column, and then click OK in the confirmation dialog box.
The provider is removed from the provider list.
If you attempt to delete a provider that is referenced by a model or service, the dialog box displays a list of the associated models or services. Go to the applicable page to remove the references before you delete the provider.
Next steps
When you create or edit a service in an AI Gateway instance, you can associate a provider in Advanced Settings.
For details, see Create a service.
The Provider field in Advanced Settings and a service's Provider Configuration Template are independent concepts that do not affect one another. They do not filter one another or inherit each other's configurations.