一、命名空间
Namespace = QCE/TXMR_SPARK
二、监控指标
| 指标英文名 | 指标中文名 | 说明 | 单位 | 维度 | 统计规则 [period, statType] |
| SparkShGcUtilGcCountFgc | GC次数_FGC | GC次数_FGC | Count | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilGcCountYgc | GC次数_YGC | GC次数_YGC | Count | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilGcTimeFgct | GC时间_FGCT | GC时间_FGCT | s | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilGcTimeGct | GC时间_GCT | GC时间_GCT | s | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilGcTimeYgct | GC时间_YGCT | GC时间_YGCT | s | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilMemoryCcs | 内存区域占比_CCS | 内存区域占比_CCS | % | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilMemoryE | 内存区域占比_E | 内存区域占比_E | % | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilMemoryM | 内存区域占比_M | 内存区域占比_M | % | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilMemoryO | 内存区域占比_O | 内存区域占比_O | % | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilMemoryS0 | 内存区域占比_S0 | 内存区域占比_S0 | % | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShGcUtilMemoryS1 | 内存区域占比_S1 | 内存区域占比_S1 | % | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShOsFdCountMaxfiledescriptorcount | 文件描述符数_MaxFileDescriptorCount | 文件描述符数_MaxFileDescriptorCount | Count | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
| SparkShOsFdCountOpenfiledescriptorcount | 文件描述符数_OpenFileDescriptorCount | 文件描述符数_OpenFileDescriptorCount | Count | id4sparksparkjobhistoryserver host4sparksparkjobhistoryserver |
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ] |
三、各维度对应参数总览
| 参数名称 | 维度名称 | 维度解释 | 格式 |
| Instances.N.Dimensions.0.Name | id4sparksparkjobhistoryserver | EMR 实例 ID 的维度名称 | 输入 String 类型维度名称:id4sparksparkjobhistoryserver |
| Instances.N.Dimensions.0.Value | id4sparksparkjobhistoryserver | EMR 实例具体 ID | 输入 EMR 具体实例 ID,例如:emr-mm8bs222 |
| Instances.N.Dimensions.1.Name | host4sparksparkjobhistoryserver | EMR 实例中节点 IP 的维度名称 | 输入 String 类型维度名称:host4sparksparkjobhistoryserver |
| Instances.N.Dimensions.1.Value | host4sparksparkjobhistoryserver | EMR 实例中具体节点 IP | 输入具体节点 IP ,可从控制台获取,登录 腾讯云 MapReduce 控制台 > 单击实例 > 集群资源 > 资源管理 > 节点内网 IP,也可通过 查询节点信息 API 获取。 |
四、入参说明
查询弹性 MapReduce(SPARK)监控数据,入参取值如下:
&Namespace=QCE/TXMR_SPARK
&Instances.N.Dimensions.0.Name=id4sparksparkjobhistoryserver
&Instances.N.Dimensions.0.Value=EMR 实例具体 ID
&Instances.N.Dimensions.1.Name=host4sparksparkjobhistoryserver
&Instances.N.Dimensions.1.Value=EMR 实例中具体节点 IP