PMM MySQL 巡检日报 2026-10-29
- 数据源:PMM (192.168.8.52:8443) VictoriaMetrics 秒级采样,经 MCP (192.168.8.75:8200) 直连获取(pmm_status)
- 生成时间:2026-10-29 10:00(本地),快照时间 2026-10-29 02:00:12 UTC
- 概览:实例总数 22 / up 22 / 告警 1(critical 1,warning 0)
Critical
| 实例 | 问题 | 详情 |
|---|
| t591-dealhub | 复制中断 (replication_stopped) | IO=False, SQL=True —— IO 线程已停止,未在拉取主库日志;SQL 线程仍在运行。需人工介入检查 STOP SLAVE 原因 / 网络与账号权限 |
Warning
- 复制延迟 >60s:无(mcdb-slave 延迟 10s,未达阈值,持续观察)
- 连接使用率 ≥80%:无(最高 100-master / mcdb-master 约 1.2%)
- 慢查询 ≥1/s:无(mcdb-slave 0.01/s,可忽略)
- sql_delay>0 延迟从库:无(tw591-slave-lag 当前延迟 0s)
- 延迟从库(设计如此):tw591-slave-lag(staging/tw591-slave2,当前延迟 0s)
全实例明细
| service_name | up | uptime(天) | 连接 used/max(pct%) | threads_running | qps | slow_qps | BP命中率% | 复制延迟s | matched_alias |
|---|
| 100-master | 1 | 91.0 | 70/8192 (0.9) | 7 | 18.81 | 0.0 | 100.0 | 0 | staging/100 |
| 8891-master | 1 | 566.9 | 20/2000 (1.0) | 3 | 30.19 | 0.0 | 100.0 | - | staging/8891 |
| 8891-slave | 1 | 443.8 | 4/2000 (0.2) | 2 | 4.34 | 0.0 | 100.0 | 0 | staging/8891-slave |
| TD-slave | 1 | 467.9 | 4/2048 (0.2) | 3 | 4.32 | 0.0 | 99.9 | 0 | staging/TD-slave2 |
| TD-slave-51 | 1 | 467.9 | 4/2048 (0.2) | 3 | 4.38 | 0.0 | 99.8 | 0 | staging/TD-slave |
| addcn-bee | 1 | 77.8 | 3/2048 (0.1) | 2 | 5.46 | 0.0 | 100.0 | - | staging/addcn-bee |
| hk8591 | 1 | 224.6 | 8/15000 (0.1) | 5 | 11.18 | 0.0 | 100.0 | 0 | staging/hk8591 |
| hk8591-slave | 1 | 448.7 | 5/15000 (0.0) | 4 | 4.47 | 0.0 | 100.0 | 0 | staging/hk8591-slave |
| hongyan | 1 | 58.8 | 7/2048 (0.3) | 3 | 5.3 | 0.0 | 99.9 | - | staging/hongyan |
| mcdb-master | 1 | 142.4 | 51/4096 (1.2) | 5 | 32.67 | 0.0 | 100.0 | 0 | staging/mcdb |
| mcdb-slave | 1 | 233.8 | 5/4096 (0.1) | 4 | 4.57 | 0.01 | 100.0 | 10 | staging/mcdb-slave |
| t1_mysql | 1 | 91.0 | 13/9190 (0.1) | 5 | 5.07 | 0.0 | 99.7 | 0 | staging/100-slave |
| t5-ai | 1 | 77.8 | 9/2048 (0.4) | 3 | 4.79 | 0.0 | 100.0 | - | staging/t5-ai |
| t5-gateway | 1 | 77.8 | 4/2048 (0.2) | 2 | 4.55 | 0.0 | 100.0 | - | staging/t5-gateway |
| t591-dealhub | 1 | 77.8 | 4/2048 (0.2) | 2 | 4.79 | 0.0 | 100.0 | 0 | staging/t591-dealhub |
| t8-ai | 1 | 77.8 | 3/2048 (0.1) | 3 | 4.77 | 0.0 | 100.0 | - | staging/t8-ai |
| t8-antifraud | 1 | 21.0 | 47/2048 (2.3) | 4 | 4.68 | 0.0 | 93.3 | - | staging/t8-antifraud |
| t8_mysql | 1 | 110.6 | 243/15000 (1.6) | 18 | 121.63 | 0.0 | 100.0 | 0 | staging/tw8591 |
| td_master | 1 | 718.9 | 67/2048 (3.3) | 5 | 144.91 | 0.0 | 100.0 | - | staging/TD |
| tw591-slave | 1 | 467.9 | 4/2048 (0.2) | 2 | 4.04 | 0.0 | 100.0 | - | staging/tw591-slave |
| tw591-slave-lag | 1 | 21.0 | 3/2048 (0.1) | 2 | 4.4 | 0.0 | 99.9 | 0 | staging/tw591-slave2 |
| tw8591-slave | 1 | 448.9 | 5/15000 (0.0) | 3 | 4.4 | 0.0 | 99.7 | 0 | staging/tw8591-slave |
QPS Top 3
- td_master (staging/TD):144.91 qps
- t8_mysql (staging/tw8591):121.63 qps
- mcdb-master (staging/mcdb):32.67 qps
其他观察:t8-antifraud BP 命中率 93.3%(其余实例均 ≥99.7%),且上线仅 21 天,建议观察;t591-dealhub 复制中断见 Critical。alert_count=1 之外按阈值复核(延迟>60s / 连接≥80% / 慢查询≥1/s)无新增。
数据源 PMM(192.168.8.52:8443),经 MCP(8.75:8200) 直连获取,下轮明日 09:50。