Data ingestion

更新时间:
复制 MD 格式

The Integration Center is the unified data ingestion center for full-stack observability. It provides out-of-the-box observability for most monitoring targets on the cloud, including infrastructure, server-side applications, frontend applications, databases, middleware, artificial intelligence (AI), and big data products. The Integration Center is the starting point for using Application Real-Time Monitoring Service (ARMS). Its plug-and-play and flexible design helps you build a full-stack observability platform quickly and easily.

Terms

Environment

Data collection pipelines are categorized into the following three environments based on their characteristics:

  • Container environment: A container cluster usually generates a large amount of data. Therefore, a single container cluster is treated as an independent container environment. For these environments, Prometheus provides automated monitoring pipelines. This helps you install collection probes and process data more intelligently.

  • ECS (VPC) environment: To collect various types of data from ECS hosts, data is usually pulled over the network. Therefore, configure a separate environment for each VPC. ARMS prioritizes network-based data collection to minimize the number of probes installed on ECS instances.

  • Cloud service environment: For cloud service data collection, environments are typically divided by region. A separate cloud service environment is created for each region.

By default, each environment is associated with a Prometheus instance to store metric data. For components such as application monitoring and Tracing Analysis, the data storage location is independent of the metric data storage partitions.

Component

Each option in the Integration Center is a component. Each component typically monitors a specific type of infrastructure or service and provides monitoring features such as metric collection, visualization, and alerting rules.

Go to the Integration Center

Log on to the Managed Service for Prometheus console. In the left-side navigation pane, click Integration Center.

The following sections list all components that can be integrated with Managed Service for Prometheus.

Infrastructure

Component

References

Supported environment types

Container service environment

ECS (VPC)

Cloud service

Cloud Service Monitoring (Batch Integration)

Integrate cloud service monitoring in batches

-

-

Yes

Container Cluster Monitoring

Container observability

Yes

-

-

GPU Monitoring

Use Alibaba Cloud Prometheus to monitor GPU resources of a cluster

Yes

Yes

-

Host Monitoring

Use Prometheus to monitor ECS hosts

-

Yes

-

SysOM System Observability

SysOM kernel-layer container monitoring

Yes

-

-

Custom Metric Collection

Custom data ingestion

Yes

Yes

-

Health Check

Health check integration

Yes

-

-

Container Event Monitoring

Container event monitoring integration

Yes

-

-

Edge Node Service (ENS)

Cloud service observability

-

-

Yes

ACK One Fleet Monitoring

Configure alerts for ACK One ArgoCD

Yes

-

-

ACK One Workflow Cluster Monitoring

How to use Prometheus Service in a workflow cluster

Yes

-

-

Alibaba Cloud Site Monitoring

Cloud service observability

-

-

Yes

Alibaba Cloud ECS

Use Prometheus to monitor ECS hosts

-

-

Yes

Alibaba Cloud EIP

Cloud service observability

-

-

Yes

Alibaba Cloud VPC Peering Connection

Cloud service observability

-

-

Yes

Alibaba Cloud VPN Gateway

Cloud service observability

-

-

Yes

Alibaba Cloud Internet Shared Bandwidth (EBWP)

Cloud service observability

-

-

Yes

Alibaba Cloud Dedicated Block Storage Cluster

Cloud service observability

-

-

Yes

Alibaba Cloud Dedicated Host

Cloud service observability

-

-

Yes

Express Connect-Virtual Border Router

Cloud service observability

-

-

Yes

Wuying Cloud Desktop

Cloud service observability

-

-

Yes

E-HPC Elastic High Performance Computing Platform

Cloud service observability

-

-

Yes

ACK AHPA

ACK AHPA integration

Yes

-

-

Docker Standalone Container Monitoring

Docker standalone container monitoring integration

-

Yes

-

Windows

How to use Prometheus to monitor Windows

-

Yes

-

Server-side applications

The Server-side applications section contains two tables: one for Tracing Analysis and one for other server-side applications.

About Tracing Analysis

Component

References

Supported environment types

OpenTelemetry

SkyWalking

Zipkin

Jaeger

Java Tracing Analysis

Start monitoring Java applications

Yes

Yes

Yes

Yes

Go Tracing Analysis

Start monitoring Go applications

Yes

Yes

Yes

Yes

DashScope Tracing Analysis

Integration guide

Yes

-

-

-

LangChain Tracing Analysis

Integration guide

Yes

-

-

-

LlamaIndex Tracing Analysis

Integration guide

Yes

-

-

-

OpenAI Tracing Analysis

Integration guide

Yes

-

-

-

Python Tracing Analysis

Start monitoring Python applications

Yes

Yes

-

Yes

PHP Tracing Analysis

Start monitoring PHP applications

Yes

-

-

-

Node.js Tracing Analysis

Start monitoring Node.js applications

Yes

Yes

-

Yes

C++ Tracing Analysis

Start monitoring C++ applications

Yes

-

-

Yes

.NET Tracing Analysis

Start monitoring .NET applications

Yes

Yes

-

-

Rust Tracing Analysis

Start monitoring Rust applications

-

Yes

-

-

Ruby Tracing Analysis

Start monitoring Ruby applications

Yes

-

-

-

OpenTelemetry

Integration guide

Yes

-

-

-

SkyWalking

Integration guide

-

Yes

-

-

Jaeger

Integration guide

-

-

-

Yes

Zipkin

Integration guide

-

-

Yes

-

Other server-side applications

Component

References

Supported environment types

Container service environment

ECS (VPC)

Cloud service

Java Application Monitoring

Start monitoring Java applications

Container service environment + manual installation

-

-

Application Monitoring eBPF Edition

Manually integrate applications into Application Monitoring eBPF Edition

Yes

-

-

Frontend applications

Component

References

Android

Integrate Android applications

iOS

Integrate iOS applications

Web & H5

Integrate Web & H5 applications

Mini Program

Integrate mini program applications

Databases

Component

References

Supported environment types

Container service environment

ECS (VPC)

Cloud service

MySQL

MySQL integration

Yes

Yes

Yes

Alibaba Cloud ADB

Cloud service observability

-

-

Yes

Alibaba Cloud AnalyticDB for PostgreSQL

PostgreSQL integration

-

-

Yes

Alibaba Cloud ClickHouse

Cloud service observability

-

-

Yes

Alibaba Cloud DTS

Cloud service observability

-

-

Yes

Alibaba Cloud Graph Database (GDB)

Cloud service observability

-

-

Yes

Alibaba Cloud Lindorm

Cloud service observability

-

-

Yes

Alibaba Cloud OceanBase

Cloud service observability

-

-

Yes

Alibaba Cloud PolarDB

Cloud service observability

-

-

Yes

Alibaba Cloud PolarDB-X

Cloud service observability

-

-

Yes

Alibaba Cloud RDS for PostgreSQL

PostgreSQL integration

-

-

Yes

Alibaba Cloud RDS for SQL Server

SQL Server integration

-

-

Yes

Alibaba Cloud Redis

Redis integration

-

-

Yes

Alibaba Cloud SelectDB

Cloud service observability

-

-

Yes

Alibaba Cloud ApsaraDB RDS (Cluster Edition)

Cloud service observability

-

-

Yes

Alibaba Cloud ApsaraDB for MongoDB (Legacy)

Cloud service observability

-

-

Yes

Alibaba Cloud InfluxDB

Integrate Prometheus with Alibaba Cloud TSDB for InfluxDB®️

-

-

Yes

ApsaraDB for Memcache

ApsaraDB for Memcache integration

-

-

Yes

ApsaraDB for MongoDB - Standalone Instance

Cloud service observability

-

-

Yes

ApsaraDB for MongoDB - Sharded Cluster

Cloud service observability

-

-

Yes

ApsaraDB for MongoDB - ReplicaSet

Cloud service observability

-

-

Yes

Alibaba Cloud ApsaraDB RDS

MySQL integration

-

-

Yes

Cassandra

How to use Prometheus to monitor Cassandra

Yes

Yes

-

MongoDB

MongoDB integration

Yes

Yes

-

PostgreSQL

PostgreSQL integration

Yes

Yes

-

Redis

Redis integration

Yes

Yes

-

SQLServer

SQL Server integration

Yes

Yes

-

TIDB

How to use Prometheus to monitor TiDB

Yes

Yes

-

Middleware

Component

References

Supported environment types

Container service environment

ECS (VPC)

Cloud service

Kafka

Kafka integration

Yes

Yes

-

Alibaba Cloud Global Accelerator (GA)

Cloud service observability

-

-

Yes

Alibaba Cloud ALB

Integrate ALB with Prometheus monitoring

-

-

Yes

Alibaba Cloud API Gateway

Cloud service observability

-

-

Yes

Alibaba Cloud CDN

Cloud service observability

-

-

Yes

Alibaba Cloud CEN

Cloud service observability

-

-

Yes

Alibaba Cloud NAT Gateway

Cloud service observability

-

-

Yes

Alibaba Cloud DCDN

Cloud service observability

-

-

Yes

Alibaba Cloud Anti-DDoS Premium (International)

Cloud service observability

-

-

Yes

Alibaba Cloud Anti-DDoS Pro (New BGP)

Cloud service observability

-

-

Yes

Alibaba Cloud Anti-DDoS Origin

Cloud service observability

-

-

Yes

Alibaba Cloud Grafana Service

Cloud service observability

-

-

Yes

Alibaba Cloud Message Queue for Kafka

Kafka integration

-

-

Yes

Alibaba Cloud MSE Service - Cloud-native Gateway

Cloud service observability

-

-

Yes

Alibaba Cloud MSE Service - Registry & Configuration Center

Cloud service observability

-

-

Yes

Alibaba Cloud NLB

Cloud service observability

-

-

Yes

Alibaba Cloud OSS

Cloud service observability

-

-

Yes

Alibaba Cloud RabbitMQ

RabbitMQ integration

-

-

Yes

Alibaba Cloud RabbitMQ Enterprise Edition

RabbitMQ integration

-

-

Yes

Alibaba Cloud RocketMQ 4.0 Service

RocketMQ integration

-

-

Yes

Alibaba Cloud RocketMQ 5.0 Service

RocketMQ integration

-

-

Yes

Alibaba Cloud SAE Service

Cloud service observability

-

-

Yes

Alibaba Cloud Serverless Workflow

Cloud service observability

-

-

Yes

Alibaba Cloud SLB

Cloud service observability

-

-

Yes

Alibaba Cloud SLS

Cloud service observability

-

-

Yes

Alibaba Cloud WAF

Cloud service observability

-

-

Yes

Alibaba Cloud Edge Network Acceleration (ENA)

Cloud service observability

-

-

Yes

Alibaba Cloud Key Management Service

Cloud service observability

-

-

Yes

Alibaba Cloud ApsaraVideo Live

Cloud service observability

-

-

Yes

Alibaba Cloud Apsara File Storage NAS

Cloud service observability

-

-

Yes

Alibaba Cloud ASM

Alibaba Cloud Service Mesh (ASM) integration

Yes

-

-

Managed CoreDNS Monitoring

CoreDNS performance monitoring component integration

Yes

-

-

Clickhouse

ClickHouse integration

Yes

Yes

-

Elasticsearch

Elasticsearch integration

Yes

Yes

-

Istio

How to integrate Managed Service for Prometheus with third-party systems such as Grafana, Istio, and HPA?

Yes

-

-

Jenkins

Jenkins integration

Yes

-

-

Knative

Knative integration

Yes

-

-

Micrometer

Use Prometheus to monitor Micrometer-based Java applications

Yes

Yes

-

Nginx

Nginx integration

Yes

Yes

-

Nginx Ingress Controller

Container observability

Yes

-

-

RabbitMQ

RabbitMQ integration

Yes

Yes

-

RocketMQ

RocketMQ integration

Yes

Yes

-

TIDB

How to use Prometheus to monitor TiDB

Yes

Yes

-

ZooKeeper

ZooKeeper integration

Yes

Yes

-

Artificial intelligence

Component

References

Supported environment types

Container service environment

ECS (VPC)

Cloud service

GPU Monitoring

Use Alibaba Cloud Prometheus to monitor GPU resources of a cluster

Yes

Yes

-

Alibaba Cloud Function Compute (FC)

Cloud service observability

-

-

Yes

Alibaba Cloud PAI-EAS Online Prediction Service

Cloud service observability

-

-

Yes

Alibaba Cloud PAI-Interactive Modelling (DSW)

Cloud service observability

-

-

Yes

Alibaba Cloud PAI-Resource Quota Service

Cloud service observability

-

-

Yes

Alibaba Cloud PAI-DLC Distributed Training Service

Cloud service observability

-

-

Yes

Alibaba Cloud PAI-EAS Dedicated Resource Group

Cloud service observability

-

-

Yes

Alibaba Cloud Intelligent Computing LINGJUN

Cloud service observability

-

-

Yes

Ray

One-click integration in Integration Center

Yes

-

-

Fluid

Enable monitoring for the Fluid component

Yes

-

-

Big data

Component

References

Supported environment types

Container service environment

ECS (VPC)

Cloud service

Alibaba Cloud E-MapReduce

Cloud service observability

-

-

Yes

Alibaba Cloud Elasticsearch

Elasticsearch integration

-

-

Yes

Alibaba Cloud HBase

Cloud service observability

-

-

Yes

Alibaba Cloud Hologres (Legacy)

Cloud service observability

-

-

Yes

Alibaba Cloud Logstash

Cloud service observability

-

-

Yes

Alibaba Cloud MaxCompute Service

Cloud service observability

-

-

Yes

Alibaba Cloud Hologres (Follower Instance)

Cloud service observability

-

-

Yes

Alibaba Cloud Hologres (Lakehouse Acceleration)

Cloud service observability

-

-

Yes

Alibaba Cloud Hologres (Compute Group)

Cloud service observability

-

-

Yes

Alibaba Cloud Hologres (General-purpose)

Cloud service observability

-

-

Yes

Fluid

Enable monitoring for the Fluid component

Yes

-

-