Integrate Cloud-native AI Gateway

更新时间:
复制 MD 格式

Integrate an Alibaba Cloud Cloud-native AI Gateway instance with Cloud Monitor 2.0 to collect and analyze gateway metrics and detailed request logs. After integration, you can monitor gateway performance, traffic, latency, and error rates in real time, configure alerts, and use logs for troubleshooting and business analysis.

Prerequisites

Billing

Procedure

  1. Log on to the Cloud Monitor 2.0 console and select your target workspace. In the left-side navigation pane, click Integration Center, and then click Cloud-Native AI Gateway.

  2. Create or select a Policy name, and then select an entity scope.

  3. Select the observability data to integrate and click OK.

    Observability data

    Description

    Integration name

    Optional. A name for the integration.

    Cloud-native AI Gateway metrics

    Monitors gateway performance. You can view and configure key gateway metrics such as queries per second (QPS), latency, error rate, and CPU/memory utilization.

    Cloud-native AI Gateway logs

    Collects detailed request logs for auditing and troubleshooting. Logs include request time, source IP address, request path, response status code, model call statistics, model token statistics, and model request risk statistics.

  4. After the integration is complete, you can view the integrated entities and their observability data in Entity Explorer or AI Application Observability.

Storage policy

After integration, Cloud Monitor automatically creates a Simple Log Service (SLS) Logstore and a Managed Service for Prometheus instance to store observability data.

Type

Default storage

Notes

Metrics

Prometheus instance: RegionShare:{{workspaceName}}:{{regionId}}

None

Gateway access logs

SLS Project: aliyun-product-data-{{userId}}-{{regionId}}

SLS Logstore: apig-access-log

None

Uninstall or modify integration

To uninstall or modify an integration, go to the Integration Center > Integration Management page, find the policy, and click Edit or Delete.