一、命名空间
Namespace = QCE/DTS
二、监控指标
| 指标英文名 | 指标中文名 | 说明 | 单位 | 维度 | 统计规则 [period, statType] |
| DtsReplicationLag | 数据同步延迟时间 | 数据同步延迟时间 | s | replicationjobid | [ 60s, last ] [ 300s, last ] |
| DtsReplicationLagData | 数据同步延迟数据量 | 数据同步延迟数据量 | MBytes | replicationjobid | [ 60s, last ] [ 300s, last ] |
| MigrateCaptureRps | 源实例数据抽取RPS | 源实例数据抽取RPS | Count/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migratedumperbps | 源实例全量导出BPS | 源实例全量导出BPS | MBytes/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migratedumpernetworklag | DTS全量导出时与源实例网络延迟 | DTS全量导出时与源实例网络延迟 | ms | migratejob_id | [ 60s, last ] [ 300s, last ] |
| Migratedumperrps | 源实例全量导出RPS | 源实例全量导出RPS | Count/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| MigrateLag | 数据迁移延迟时间 | 数据迁移延迟时间 | s | migratejob_id | [ 60s, last ] [ 300s, last ] |
| MigrateLagData | 数据迁移延迟数据量 | 数据迁移延迟数据量 | MBytes | migratejob_id | [ 60s, last ] [ 300s, last ] |
| Migrateloaderbps | 目标实例全量导入BPS | 目标实例全量导入BPS | MBytes/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migrateloadernetworklag | DTS全量导入时与目标实例网络延迟 | DTS全量导入时与目标实例网络延迟 | ms | migratejob_id | [ 60s, last ] [ 300s, last ] |
| Migrateloaderrps | 目标实例全量导入RPS | 目标实例全量导入RPS | Count/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| MigrateLoadRps | 目标数据装载RPS | 目标数据装载RPS | Count/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migrateriverbps | 源实例增量导出BPS | 源实例增量导出BPS | MBytes/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migraterivernetworklag | DTS增量导出时与源实例网络延迟 | DTS增量导出时与源实例网络延迟 | ms | migratejob_id | [ 60s, last ] [ 300s, last ] |
| Migrateriverrps | 源实例增量导出RPS | 源实例增量导出RPS | Count/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migratesinkerbps | 目标实例增量导入BPS | 目标实例增量导入BPS | MBytes/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migratesinkernetworklag | DTS增量导入时与目标实例网络延迟 | DTS增量导入时与目标实例网络延迟 | ms | migratejob_id | [ 60s, last ] [ 300s, last ] |
| Migratesinkerrps | 目标实例增量导入RPS | 目标实例增量导入RPS | Count/s | migratejob_id | [ 60s, max ] [ 300s, max ] |
| Migratesinkerrpsusage | 目标实例增量导入RPS使用率 | RPS 使用率 = 实时RPS/RPS上限 当链路配置为最大规格时,RPS无上限限制,所以 RPS 使用率可能超过100% | % | migratejob_id | [ 60s, last ] [ 300s, max ] |
| ProducerLag | 订阅服务与源库的GTID差距个数 | 订阅服务当前正在解析的binlog与源库最新产生的binlog之间的gtid差距个数 | Count | SubscribeId | [ 60s, last ] [ 300s, last ] |
| ProducerLsnLag | 订阅服务与源库的LSN差距 | 订阅服务与源库的LSN差距 | MBytes | SubscribeId | [ 60s, last ] [ 300s, last ] |
| ProducerTps | 订阅服务每秒解析事务数 | 订阅服务每秒解析事务数 | Count/s | SubscribeId | [ 60s, last ] [ 300s, last ] |
| ReplicationCaptureRps | 源实例数据抽取RPS | 源实例数据抽取RPS | Count/s | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationdumperbps | 源实例全量导出BPS | 源实例全量导出BPS | MBytes/s | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationdumpernetworklag | DTS全量导出时与源实例网络延迟 | DTS全量导出时与源实例网络延迟 | ms | replicationjobid | [ 60s, last ] [ 300s, last ] |
| Replicationdumperrps | 源实例全量导出RPS | 源实例全量导出RPS | Count | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationloaderbps | 目标实例全量导入BPS | 目标实例全量导入BPS | MBytes/s | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationloadernetworklag | DTS全量导入时与目标实例网络延迟 | DTS全量导入时与目标实例网络延迟 | ms | replicationjobid | [ 60s, last ] [ 300s, last ] |
| Replicationloaderrps | 目标实例全量导入RPS | 目标实例全量导入RPS | Count | replicationjobid | [ 60s, max ] [ 300s, max ] |
| ReplicationLoadRps | 目标数据装载RPS | 目标数据装载RPS | Count/s | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationriverbps | 源实例增量导出BPS | 源实例增量导出BPS | MBytes/s | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationrivernetworklag | DTS增量导出时与源实例网络延迟 | DTS增量导出时与源实例网络延迟 | ms | replicationjobid | [ 60s, last ] [ 300s, last ] |
| Replicationriverrps | 源实例增量导出RPS | 源实例增量导出RPS | Count | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationsinkerbps | 目标实例增量导入BPS | 目标实例增量导入BPS | MBytes/s | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationsinkernetworklag | DTS增量导入时与目标实例网络延迟 | DTS增量导入时与目标实例网络延迟 | ms | replicationjobid | [ 60s, last ] [ 300s, last ] |
| Replicationsinkerrps | 目标实例增量导入RPS | 目标实例增量导入RPS | Count | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Replicationsinkerrpsusage | 目标实例增量导入RPS使用率 | RPS 使用率 = 实时RPS/RPS上限 当链路配置为最大规格时,RPS无上限限制,所以 RPS 使用率可能超过100% | % | replicationjobid | [ 60s, max ] [ 300s, max ] |
| Subscribeconsumepartitionlatency | 订阅消费分区消费延迟时间 | 订阅消费分区消费延迟时间 | s | ConsumerGroup PartitionNo SubscribeId TopicName |
[ 60s, last ] [ 300s, max ] |
| Subscribeconsumepartitionunconsume | 订阅消费分区未消费记录数 | 订阅消费分区未消费记录数 | Count | ConsumerGroup PartitionNo SubscribeId TopicName |
[ 60s, last ] [ 300s, max ] |
| Subscriberiverbps | 源实例增量导出BPS | 源实例增量导出BPS | MBytes/s | SubscribeId | [ 60s, max ] [ 300s, max ] |
| Subscribesinkerbps | Kafka增量导入BPS | Kafka增量导入BPS | MBytes/s | SubscribeId | [ 60s, max ] [ 300s, max ] |
三、各维度对应参数总览
| 参数名称 | 维度名称 | 维度解释 | 格式 |
| Instances.N.Dimensions.0.Name | replicationjobid | 数据同步实例 ID 的维度名称 | 输入 String 类型维度名称:replicationjobid |
| Instances.N.Dimensions.0.Value | replicationjobid | 数据同步实例 ID | 输入数据同步实例 ID,为 DescribeSyncJobs 接口中返回值的 JobId 字段 |
| Instances.N.Dimensions.0.Name | migratejob_id | 迁移任务 ID 的维度名称 | 输入 String 类型维度名称:migratejob_id |
| Instances.N.Dimensions.0.Value | migratejob_id | 迁移任务 ID | 输入数据同步实例 ID,为 DescribeMigrationJobs 接口中返回值的 JobId 字段 |
| Instances.N.Dimensions.0.Name | Subscribeid | 订阅实例 ID 的维度名称 | 输入 String 类型维度名称:Subscribeid |
| Instances.N.Dimensions.0.Value | Subscribeid | 订阅实例 ID | 输入数据同步实例 ID,为 DescribeSubscribes 接口中返回值的 SubscribeId 字段 |
| Instances.N.Dimensions.0.Name | ConsumerGroup | 订阅任务 Kafka 消费组维度 | String 类型维度名称:ConsumerGroup |
| Instances.N.Dimensions.0.Value | ConsumerGroup | 订阅任务 Kafka 消费组 | 具体消费组名称:如 consumer-grp-subs-xxx |
| Instances.N.Dimensions.0.Name | PartitionNo | 订阅任务 Kafka 分区维度 | String 类型维度名称:PartitionNo |
| Instances.N.Dimensions.0.Value | PartitionNo | 订阅任务 Kafka 分区号 | 具体单个分区编码:如 1 |
| Instances.N.Dimensions.0.Name | TopicName | 订阅任务 Kafka Topic 维度 | String 类型维度名称:TopicName |
| Instances.N.Dimensions.0.Value | TopicName | 订阅任务 Kafka Topic | 具体的 Topic 名称:如 topic-subs-f8z0bviylm-xxx |
四、入参说明
查询数据订阅监控数据,入参取值如下:
&Namespace=QCE/DTS
&Instances.N.Dimensions.0.Name=Subscribeid
&Instances.N.Dimensions.0.Value=订阅实例 ID
查询数据迁移监控数据,入参取值如下:
&Namespace=QCE/DTS
&Instances.N.Dimensions.0.Name=migratejob_id
&Instances.N.Dimensions.0.Value=迁移任务 ID