PMM MySQL 巡检日报 2026-09-29
- 数据源:PMM (192.168.8.52:8443) VictoriaMetrics 秒级采样,经 MCP addcn (192.168.8.75:8200) 直连获取
- 数据快照时间:2026-09-29 02:00:09(PMM generated_at)
- 报告生成时间:2026-09-29 10:00:16
概览
| 指标 | 值 |
|---|
| 实例总数 | 23 |
| up 数 | 23 |
| 告警数 | 1(critical 1 / warning 0) |
Critical(实例 down / 复制中断)
| 实例 | 问题 | 详情 |
|---|
| t591-dealhub | replication_stopped | IO=False, SQL=True(IO 线程停止,复制中断,建议人工排查 SHOW REPLICA STATUS 与错误日志) |
Warning(阈值扫描:延迟>60s / 连接使用率≥80% / 慢查询≥1/s)
- 复制延迟 >60s:tw591-slave-lag 延迟 3601s(sql_delay=3600)——延迟从库(设计如此),非异常。
- 连接使用率 ≥80%:无(最高 t5_master 12.6%)。
- 慢查询 ≥1/s:无(全部实例 slow_qps = 0)。
全实例明细
| service_name | up | uptime(天) | 连接 used/max(pct%) | threads_running | qps | slow_qps | BP命中率% | 复制延迟s | matched_alias |
|---|
| 100-master | ✅ | 60.9 | 18/8192 (0.2%) | 7 | 9.09 | 0 | 100.0 | 0 | staging/100 |
| 8891-master | ✅ | 536.9 | 16/2000 (0.8%) | 2 | 5.49 | 0 | 100.0 | - | staging/8891 |
| 8891-slave | ✅ | 413.8 | 4/2000 (0.2%) | 2 | 4.30 | 0 | 100.0 | 0 | staging/8891-slave |
| TD-slave | ✅ | 437.9 | 4/2048 (0.2%) | 2 | 4.32 | 0 | 99.8 | 0 | staging/TD-slave2 |
| TD-slave-51 | ✅ | 437.9 | 4/2048 (0.2%) | 2 | 4.39 | 0 | 99.8 | 0 | staging/TD-slave |
| addcn-bee | ✅ | 47.8 | 2/2048 (0.1%) | 2 | 5.57 | 0 | 100.0 | - | (无匹配) |
| hk8591 | ✅ | 194.6 | 8/15000 (0.1%) | 5 | 12.24 | 0 | 100.0 | 0 | staging/tw8591, staging/hk8591 |
| hk8591-slave | ✅ | 418.7 | 5/15000 (0.0%) | 4 | 4.47 | 0 | 100.0 | 0 | staging/tw8591-slave, staging/hk8591-slave |
| hongyan | ✅ | 28.8 | 4/2048 (0.2%) | 3 | 4.60 | 0 | 100.0 | - | (无匹配) |
| mcdb-master | ✅ | 112.4 | 24/4096 (0.6%) | 4 | 5.58 | 0 | 100.0 | 0 | staging/mcdb |
| mcdb-slave | ✅ | 203.8 | 5/4096 (0.1%) | 4 | 4.27 | 0 | 100.0 | 0 | staging/tw591-slave, staging/mcdb-slave |
| t1_mysql | ✅ | 60.9 | 10/9190 (0.1%) | 4 | 4.96 | 0 | 99.8 | 0 | staging/100-slave |
| t5-ai | ✅ | 47.8 | 9/2048 (0.4%) | 3 | 4.79 | 0 | 100.0 | - | (无匹配) |
| t5-gateway | ✅ | 47.8 | 4/2048 (0.2%) | 2 | 4.55 | 0 | 100.0 | - | (无匹配) |
| t591-dealhub | ⚠️ | 47.8 | 4/2048 (0.2%) | 2 | 4.77 | 0 | 100.0 | IO=False | (无匹配) |
| t5_master | ✅ | 1.0 | 518/4096 (12.6%) | 12 | 2578.92 | 0 | 100.0 | - | (无匹配) |
| t8-ai | ✅ | 47.8 | 4/2048 (0.2%) | 3 | 4.77 | 0 | 100.0 | - | (无匹配) |
| t8-antifraud | ✅ | 28.8 | 46/2048 (2.2%) | 3 | 4.61 | 0 | 100.0 | - | (无匹配) |
| t8_mysql | ✅ | 80.6 | 102/15000 (0.7%) | 16 | 41.02 | 0 | 100.0 | 0 | staging/tw8591, staging/hk8591 |
| td_master | ✅ | 688.7 | 72/2048 (3.5%) | 5 | 154.88 | 0 | 100.0 | - | staging/TD |
| tw591-slave | ✅ | 437.9 | 4/2048 (0.2%) | 3 | 4.23 | 0 | 100.0 | 0 | staging/tw591-slave, staging/mcdb-slave |
| tw591-slave-lag | ✅ | 294.8 | 4/2048 (0.2%) | 2 | 4.31 | 0 | 99.8 | 3601(延迟从库,设计如此) | staging/tw591-slave2 |
| tw8591-slave | ✅ | 418.9 | 5/15000 (0.0%) | 2 | 4.42 | 0 | 100.0 | 1 | staging/tw8591-slave, staging/hk8591-slave |
注:复制延迟为 - 表示非从库(无复制);t591-dealhub 标注 IO=False 即复制 IO 线程停止。
QPS Top 3
- t5_master — 2578.92 qps(threads_running=12,连接使用率 12.6%,今日 09:02 左右重启过,uptime 仅 1 天)
- td_master — 154.88 qps
- t8_mysql — 41.02 qps
数据源 PMM(192.168.8.52:8443),经 MCP(8.75:8200) 直连获取,下轮明日 09:50。