腾讯云可观测平台弹性 MapReduce（Clickhouse ）

4天前 • 腾讯云产品

这里说明了腾讯云弹性 MapReduce（Clickhouse）监控数据的查询方法及相关参数。首先说明了命名空间，接着阐述了监控指标及各维度对应参数总览，最后详细说明了查询的入参。命名空间: 明确了为 QCE/TXMR_CLICKHOUSE 。入参说明: 详细列举了查询弹性 MapReduce（Clickhouse）监控数据时的入参取值，包括 Namespace 以及 Instances 相关维度的名称和值的具体。

相关产品

腾讯云可观测平台

腾讯云可观测平台产品页，含版本规格、价格与购买入口。

查看产品与优惠

一、命名空间

Namespace = QCE/TXMR_CLICKHOUSE

二、监控指标

指标英文名	指标中文名	说明	单位	维度	统计规则 [period, statType]
ClickhouseBackgroundPoolTaskBackgroundpooltask	BackgroundProcessingPool中的活跃任务数	BackgroundProcessingPool中的活跃任务数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBackgroundPoolTaskBackgroundschedulepooltask	BackgroundSchedulePool中的活跃任务数	BackgroundSchedulePool中的活跃任务数	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorBytesRead	来自文件描述器的读字节数	来自文件描述器的读字节数	MBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorBytesWrite	写入文件描述器的字节数	写入文件描述器的字节数	MBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorCountRead	来自文件描述器的读个数	来自文件描述器的读个数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorCountWrite	来自文件描述器的写个数	来自文件描述器的写个数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseConnectionCountHttp	HTTP服务器的连接数	HTTP服务器的连接数	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseConnectionCountTcp	TCP服务器的连接数	TCP服务器的连接数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDatabaseCountDatabasecount	数据库数量	数据库数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDelayedInsertCountDelayedinserts	被抑制的Insert查询数	被抑制的Insert查询数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDictCacheRequestCountDictcacherequests	cache类型字典的数据源中的请求数	cache类型字典的数据源中的请求数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDiskElapsedMicrosecondsRead	等待读系统调用的总时间	等待读系统调用的总时间	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDiskElapsedMicrosecondsWrite	等待写系统调用的总时间	等待写系统调用的总时间	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDistributedFilesToinsertCountDistributedsend	pending的异步插入到分布式表的文件数	pending的异步插入到分布式表的文件数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseExcuteQueryCountInsert	可能执行的Insert查询数	可能执行的Insert查询数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseExcuteQueryCountSelect	可能执行的Select查询数	可能执行的Select查询数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseExcuteQueryCountTotal	可能执行的查询总数	可能执行的查询总数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseFileOpenCountFileopen	已打开的文件数	已打开的文件数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseInsertBytesInsertedbytes	被插入到所有表中的字节数	被插入到所有表中的字节数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseInsertRowsInsertedrows	被插入到所有表中的行数	被插入到所有表中的行数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseLeaderElectionCountLeaderelection	参与leader选举的副本数量	参与leader选举的副本数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMarkCacheBytesMarkcachebytes	StorageMergeTree的marks的缓存大小	StorageMergeTree的marks的缓存大小	MBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMarkCacheFilesMarkcachefiles	StorageMergeTree的marks的缓存文件数	StorageMergeTree的marks的缓存文件数	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMaxPartPartitionMaxpartcountforpartition	partitions中最大的活跃数据块的数量	partitions中最大的活跃数据块的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedBackgroundprocessingpool	后台处理池中分配的内存总量	后台处理池中分配的内存总量	GBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedBackgroundschedulepool	后台调度池中所分配的内存总量	后台调度池中所分配的内存总量	GBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedMemorytracking	当前执行的查询中所分配的内存总量	当前执行的查询中所分配的内存总量	GBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedMemorytrackingformerges	后台merges所分配的内存总量	后台merges所分配的内存总量	GBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMergeCountMerge	正在后台执行的merge数量	正在后台执行的merge数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseOpenFileCountRead	打开的可读文件的数量	打开的可读文件的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseOpenFileCountWrite	打开的可写文件的数量	打开的可写文件的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhousePartMutationCountPartmutation	表变更的次数	表变更的次数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseProcessThreadTimeRealtime	处理线程花费的总时间	处理线程花费的总时间	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseProcessThreadTimeSystem	在操作系统内核空间下处理线程在执行CPU指令花费的总时间	在操作系统内核空间下处理线程在执行CPU指令花费的总时间	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseProcessThreadTimeUser	在用户空间下处理线程在执行CPU指令花费的总时间	在用户空间下处理线程在执行CPU指令花费的总时间	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseQueryPreemptedCountQuerypreempted	停止或等待的查询数量	停止或等待的查询数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseQueryThreadCountQuerythread	查询处理的线程数量	查询处理的线程数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRegexpCreatedCountRegexpcreated	编译的正则表达式数	编译的正则表达式数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaCountLeaderreplica	属于leader的Replicated table的数量	属于leader的Replicated table的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaCountReadonlyreplica	处于只读状态的Replicated table的数量	处于只读状态的Replicated table的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaDataPartCountCheck	检查一致性的数据块数量	检查一致性的数据块数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaDataPartCountFetch	从副本收集的数据块数量	从副本收集的数据块数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaDataPartCountSend	发送到副本的数量块数量	发送到副本的数量块数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasInQueueInsert	需要完成的数据块insert数	需要完成的数据块insert数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasInQueueMerge	待完成的merge数	待完成的merge数	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasMaxDelayAbsolute	最大的replica队列时延	最大的replica队列时延	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasMaxDelayRelative	来自其他块的绝对时延的差异的最大值	来自其他块的绝对时延的差异的最大值	us	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRevisionRevision	server的修改	server的修改	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountActiveread	在一个表的读写锁中持有读锁的线程数	在一个表的读写锁中持有读锁的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountActivewrite	在一个表的读写锁中持有写锁的线程数	在一个表的读写锁中持有写锁的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountWaitingread	等待读表的读写锁的线程数量	等待读表的读写锁的线程数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountWaitingwrite	等待写表的读写锁的线程数量	等待写表的读写锁的线程数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseStorageBufferBytesStoragebufferbytes	Buffer tables中的字节数	Buffer tables中的字节数	MBytes	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseStorageBufferRowsStoragebufferrows	Buffer tables中的行数	Buffer tables中的行数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseSyscallCountRead	读系统调用的数量	读系统调用的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseSyscallCountWrite	写系统调用的数量	写系统调用的数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseTableCountTablecount	数据表数量	数据表数量	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadContextLockWaitCountContextlockwait	在Context中等待锁的线程数	在Context中等待锁的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountGlobal	全局线程池中的线程数	全局线程池中的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountGlobalactive	全局线程池中活跃的线程数	全局线程池中活跃的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountLocal	本地线程池中的线程数	本地线程池中的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountLocalactive	本地线程池中活跃的线程数	本地线程池中活跃的线程数	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseVersionVersion	版本号	版本号	Count	host4clickhouseserver id4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseZkEphemeralNodeCountEphemeralnode	ZooKeeper中保存的临时节点数	ZooKeeper中保存的临时节点数	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseZkWatchesCountWatches	ZK事件订阅数	ZK事件订阅数	Count	id4clickhouseserver host4clickhouseserver	[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]

三、各维度对应参数总览

参数名称	维度名称	维度解释	格式
Instances.N.Dimensions.0.Name	host4clickhouseserver	EMR 实例中节点 IP 的维度名称	输入 String 类型维度名称：host4clickhouseserver
Instances.N.Dimensions.0.Value	host4clickhouseserver	EMR 实例中具体节点 IP	输入具体节点 IP，可从控制台获取，登录腾讯云 MapReduce 控制台，单击实例 > 集群资源 > 资源管理 > 节点内网 IP。也可通过查询节点信息 API 获取。
Instances.N.Dimensions.0.Name	id4clickhouseserver	EMR 实例 ID 的维度名称	输入 String 类型维度名称：id4clickhouseserver
Instances.N.Dimensions.0.Value	id4clickhouseserver	EMR 实例具体 ID	输入 EMR 具体实例 ID，例如：emr-mm8bs222

四、入参说明

查询弹性 MapReduce（Clickhouse）监控数据，入参取值如下：

Namespace=QCE/TXMR_CLICKHOUSE
&Instances.N.Dimensions.0.Name=host4clickhouseserver
&Instances.N.Dimensions.0.Value=EMR 实例中具体节点 IP
&Instances.N.Dimensions.1.Name=id4clickhouseserver
&Instances.N.Dimensions.1.Value=EMR 实例具体 ID

腾讯云可观测平台

赞 (0)

腾讯云可观测平台弹性 MapReduce（Alluxio）

上一篇 4天前

腾讯云可观测平台弹性 MapReduce（Cosranger）

下一篇 4天前