Manage providers

Provider overview

A provider is a resource in AI Gateway that identifies the large model vendor to which a model or service belongs. The system supports built-in providers, and you can also create custom providers.

• Built-in provider: Built into the system. It cannot be edited or deleted, but can be referenced by models and services.

• Custom provider: Created by you. The name can be edited, and it can be deleted when it is not referenced.

A provider is an independent concept from the provider configuration template of a service. The two do not affect each other.

Prerequisites

• You have created an AI Gateway instance.

Apart from the preceding requirement, managing providers does not require additional RAM permissions, instance specifications, or region restrictions.

View the provider list

1. Log on to the API Gateway console. On the gateway list page, select the region where the instance is located, and then click the ID of the target instance.

2. In the navigation pane on the left, click Model Metadata Management to go to the model management page.

3. Click the Providers tab to view the providers in the current instance.

The provider list contains the following columns:

Create a provider

1. In the provider list, click Create Provider.

2. In the creation panel, configure the following parameters:

   Parameter	Description
   Name	Required. The display name of the provider. Duplicate names are supported.
   Identifier	Required. Automatically generated by the system. It cannot be edited after the provider is created. This field is displayed as disabled on the page.

3. Click OK. The new provider appears in the provider list.

Edit a provider

1. In the provider list, find the target custom provider. Built-in providers cannot be edited.

2. Click Edit in the Actions column to modify the name. The identifier cannot be modified.

3. Click OK to save. After the page prompts that the save is successful, the updated name is displayed in the provider list.

Delete a provider

1. In the provider list, find the target custom provider. Built-in providers cannot be deleted.

2. Click Delete in the Actions column, and then click OK in the confirmation dialog box.

Result: The provider is removed from the list.

If a provider is referenced by a model or service, it cannot be deleted. The dialog box displays the list of related models or services. Go to the corresponding page to remove the references before you delete the provider.

Provider references in services

When you create or edit a service, you can associate a provider in Advanced Settings.

For specific steps, see Manage services.

The Provider field in Advanced Settings and the provider configuration template are two independent concepts. They do not filter or inherit configurations from each other.