Related A brief introduction about GC ● What is STW(stop the world) exactly? ● What happen when collector can not catch up allocation rate? ● How the garbage recycle interrupt the user program? ○ STW takes trace information Observation： A query is blocked by GC sweep Investigation ● The garbage collector can stop individual goroutines, even without STW ○ eg. A goroutine that needs to allocate memory

• Fast marshalling and unmarshalling • Fields without pointers cause less time in the garbage collector. • Used by etcd/docker/k8s/tidb • Benchmark Monitor the Memory Usage • Monitor the memory usage

Blackbox_exporter 通信端口，用于 TiDB 集群端口监控 Grafana 3000 Web 监控服务对外服务和客户端(浏览器)访问端口 Grafana 8686 grafana_collector 通信端口，用于将 Dashboard 导出为 PDF 格式 Kafka_exporter 9308 Kafka_exporter 通信端口，用于监控 binlog kafka 集群 TiDB TiDB 集群端口监控 Grafana grafana_port 3000 Web 监控服务对外服务和客户端(浏览 器)访问端口 Grafana grafana_collector_port 8686 grafana_collector 通信端口，用 于将 Dashboard 导出为 PDF 格式 Kafka_exporter kafka_exporter_port 9308 Kafka_exporter

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] ----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ key}&secret-access-key=${secret-access-key}"' Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] ----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ key}&secret-access-key=${secret-access-key}"' 927 Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] ----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ key}&secret-access-key=${secret-access-key}"' Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] -----------------------------------> �→ 100.00% 884 [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ key}&secret-access-key=${secret-access-key}"' Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] ----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ access-key}&secret-access-key=${secret-access-key}"' Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] ----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ key}&secret-access-key=${secret-access-key}"' Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03

----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.132 +08:00] [INFO] [collector.go:69] ["Full Restore �→ success summary"] [total-ranges=12] [ranges-succeed=xxx] [ranges- �→ failed=0] ----------------------------------------> �→ 100.00% [2022/05/29 18:15:39.325 +08:00] [INFO] [collector.go:69] ["restore log �→ success summary"] [total-take=xxx.xx] [restore-from={TS}] [restore-to �→ access-key}&secret-access-key=${secret-access-key}' Expected output: [2022/07/25 23:02:57.236 +08:00] [INFO] [collector.go:69] ["log metadata"] [ �→ log-min-ts=434582449885806593] [log-min-date="2022-07-14 20:08:03