创建E-MapReduce集群时,不同类型集群的实例节点上会部署不同的服务角色。例如,Hadoop HDFS中的NameNode部署在主实例节点中。本文为您介绍如何查看E-MapReduce集群中服务组件在各节点的部署信息。

前提条件

已创建集群,详情请参见创建集群

操作步骤

  1. 进入详情页面。
    1. 登录阿里云E-MapReduce控制台
    2. 在顶部菜单栏处,根据实际情况选择地域和资源组
    3. 单击上方的集群管理页签。
    4. 集群管理页面,单击待查看集群所在行的详情
  2. 在左侧导航栏中,单击集群服务,选择待查看的集群服务。
  3. 在服务页面,单击上方部署拓扑页签。
    您可以根据您创建的集群类型,查看服务组件的具体部署信息:

Hadoop集群

以EMR-3.29.0版本为例,Hadoop集群服务组件的具体部署信息如下。
  • 必选服务
    服务名 主实例节点 核心实例节点
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Hive
    • Hive MetaStore
    • HiveServer2
    • Hive Client
    Hive Client
    Spark
    • Spark Client
    • SparkHistory
    • ThriftServer
    Spark Client
    Knox Knox
    Tez
    • Tomcat
    • Tez Client
    Tez Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    Sqoop Sqoop Client Sqoop Client
    Bigboot
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    OpenLDAP OpenLDAP
    Hue Hue
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
  • 可选服务
    服务名 主实例节点 核心实例节点
    LIVY Livy
    Superset Superset
    Flink
    • FlinkHistoryServer
    • Flink Client
    Flink Client
    RANGER
    • RangerPlugin
    • RangerAdmin
    • RangerUserSync
    • Solr
    RangerPlugin
    Storm
    • Storm Client
    • UI
    • Nimbus
    • Logviewer
    • Storm Client
    • Supervisor
    • Logviewer
    Phoenix Phoenix Client Phoenix Client
    Kudu
    • Kudu Master
    • Kudu Client
    • Kudu Tserver
    • Kudu Master
    • Kudu Client
    HBase
    • HMaster
    • HBase Client
    • ThriftServer
    • HBase Client
    • HRegionServer
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper follower
    • ZooKeeper leader
    • ZooKeeper Client
    Oozie Oozie
    Presto
    • Presto Client
    • PrestoMaster
    • Presto Client
    • PrestoWorker
    Impala
    • Impala Runtime and Shell
    • Impala Catalog Server
    • Impala StateStore Server
    • Impala Runtime and Shell
    • Impala Daemon Server
    Pig Pig Client Pig Client
    Zeppelin Zeppelin
    FLUME
    • Flume Agent
    • Flume Client
    • Flume Agent
    • Flume Client

Druid集群

以EMR-3.29.0版本为例,Druid集群服务组件的具体部署信息如下。
  • 必选服务
    服务名 主实例节点 核心实例节点
    Druid
    • Druid Client
    • Coordinator
    • Overlord
    • Broker
    • Router
    • MiddleManager
    • Historical
    • Druid Client
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    OpenLDAP OpenLDAP
    Bigboot
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
  • 可选服务
    服务名 主实例节点 核心实例节点
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Superset Superset

Dataflow-Kafka集群

以EMR-3.29.0版本为例,Dataflow-Kafka集群服务组件的具体部署信息如下。
  • 必选服务
    服务名 主实例节点 核心实例节点
    Kafka-Manager Kafka Manager
    Kafka
    • Kafka Client
    • KafkaMetadataMonitor
    • Kafka Rest Proxy
    • Kafka Broker broker
    • Kafka Schema Registry
    • Kafka Broker broker
    • Kafka Client
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    • ZooKeeper Client
    OpenLDAP OpenLDAP
  • 可选服务
    服务名 主实例节点 核心实例节点
    RANGER
    • RangerPlugin
    • RangerUserSync
    • RangerAdmin
    • Solr
    RangerPlugin
    Knox Knox

Flink集群

以EMR-3.30.0版本为例,Flink集群服务组件的具体部署信息如下。
  • 必选服务
    服务名 主实例节点 核心实例节点
    HDFS
    • KMS
    • SecondaryNameNode
    • HttpFS
    • HDFS Client
    • NameNode
    • DataNode
    • HDFS Client
    YARN
    • ResourceManager
    • App Timeline Server
    • JobHistory
    • WebAppProxyServer
    • Yarn Client
    • Yarn Client
    • NodeManager
    Ganglia
    • Gmond
    • Httpd
    • Gmetad
    • Ganglia Client
    • Gmond
    • Ganglia Client
    ZooKeeper
    • ZooKeeper
    • ZooKeeper Client
    • ZooKeeper
    • ZooKeeper Client
    Knox Knox
    Flink-Vvp Flink-Vvp
    OpenLDAP OpenLDAP
  • 可选服务
    服务名 主实例节点 核心实例节点
    PAI-Alink Alink

ZooKeeper集群

以EMR-3.29.0版本为例,ZooKeeper集群服务组件的具体部署信息如下。
服务名 主实例节点 核心实例节点
Ganglia
  • Gmond
  • Httpd
  • Gmetad
  • Ganglia Client
ZooKeeper
  • ZooKeeper leader
  • ZooKeeper Client
  • ZooKeeper follower

Data Science集群

以EMR-3.29.1版本为例,Data Science集群服务组件的具体部署信息如下。
  • 必选服务
    服务名 主实例节点 核心实例节点
    HDFS
    • HDFS Client
    • KMS
    • HttpFS
    • NameNode
    • SecondaryNameNode
    • HDFS Client
    • DataNode
    YARN
    • WebAppProxyServer
    • JobHistory
    • App Timeline Server
    • ResourceManager
    • Yarn Client
    • NodeManager
    • Yarn Client
    ZooKeeper
    • ZooKeeper Client
    • ZooKeeper follower
    • ZooKeeper Client
    • ZooKeeper leader
    • ZooKeeper follower
    Knox Knox
    Tensorflow on YARN
    • TensorFlow-On-YARN-Gateway
    • TensorFlow-On-YARN-History-Server
    • TensorFlow-On-YARN
    • TensorFlow-On-YARN-Client
    • TensorFlow-On-YARN-Gateway
    SmartData
    • Jindo Namespace Service
    • Jindo Storage Service
    • Jindo Client
    • Jindo Storage Service
    • Jindo Client
    Bigoot
    • Bigboot Monitor
    • Bigboot Client
    • Bigboot Monitor
    • Bigboot Client
    PAI-EASYREC Easyrec Easyrec
    PAI-EAS PAIEAS PAIEAS
    PAI-Faiss Faiss Faiss
    PAI-Redis Redis Redis
    PAI-Alink Alink
    Flink-Vvp Flink-Vvp
    OpenLDAP OpenLDAP
    Jindo SDK Jindo SDK Jindo SDK
  • 可选服务
    服务名 主实例节点 核心实例节点
    Zeppelin Zeppelin
    PAI-REC Rec
    AUTOML AUTOML AUTOML
    TensorFlow TensorFlow TensorFlow

ClickHouse集群

以EMR-3.35.0版本为例,ClickHouse集群服务组件的具体部署信息如下。
服务名 主实例节点 核心实例节点
Ganglia
  • Gmond
  • Httpd
  • Gmetad
  • Ganglia Client
  • Gmond
  • Ganglia Client
ZooKeeper
  • ZooKeeper Client
  • ZooKeeper follower
  • ZooKeeper Client
  • ZooKeeper leader
  • ZooKeeper follower
ClickHouse
  • ClickHouse Server
  • ClickHouse Client
  • ClickHouse Server
  • ClickHouse Client

EMR Studio集群

以EMR-3.33.111版本为例,EMR Studio集群服务组件的具体部署信息如下。
服务名 主实例节点 核心实例节点
Ganglia
  • Gmetad
  • Gmond
  • Httpd
  • Ganglia Client
  • Gmond
  • Ganglia Client
Zeppelin Zeppelin Master Zeppelin Worker
Knox Knox
JupyterHub JupyterHub
OpenLDAP OpenLDAP
RabbitMQ RabbitMQ
Mysql MySQL
Airflow
  • Airflow Scheduler
  • Airflow Client
  • Airflow WebServer
  • Airflow Client
  • Airflow Worker
Studio Workspace Studio Workspace