Go runtime related problems in TiDB production environment About me ● Arthur Mao(毛康力), Senior Engineer@PingCAP ● TiDB core developer (top3 contributor) ● GitBook about golang internals (@tiancaiamao) not exhausted, but where is the bottleneck? Description ● The table is wide in the customer environment ○ CPU usage is higher with less columns ● The deployment does not consider NUMA ○ CPU usage is

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.11 New configuration and environment management . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.12 Multi-revision cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 678 8.7 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 706 n/034-new_lockfiles.md • Tutorial about versioning and lockfiles 2.11 New configuration and environment management The new configuration system called [conf] in profiles and command line, and introduced

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.11 New configuration and environment management . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.12 Multi-revision cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 675 8.7 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 702 n/034-new_lockfiles.md • Tutorial about versioning and lockfiles 2.11 New configuration and environment management The new configuration system called [conf] in profiles and command line, and introduced

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.11 New configuration and environment management . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.12 Multi-revision cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 673 8.7 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 700 n/034-new_lockfiles.md • Tutorial about versioning and lockfiles 2.11 New configuration and environment management The new configuration system called [conf] in profiles and command line, and introduced

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.11 New configuration and environment management . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.12 Multi-revision cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 689 8.7 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 718 n/034-new_lockfiles.md • Tutorial about versioning and lockfiles 2.11 New configuration and environment management The new configuration system called [conf] in profiles and command line, and introduced

. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.11 New configuration and environment management . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2.12 Multi-revision cache . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 687 8.7 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716 n/034-new_lockfiles.md • Tutorial about versioning and lockfiles 2.11 New configuration and environment management The new configuration system called [conf] in profiles and command line, and introduced

. . . . . . . . . . . . . . . 389 29 Handling Operating System Variation 392CONTENTS vi 30 Environment Variables 393 30.1 File locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1420 74 Future 1422 75 Interactive Utilities 1423 76 Julia Syntax Highlighting 1434 76.1 Functions . . . . . . . . . . . . . . Testing log events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1657 82.4 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1657 82.5 Examples

. . . . . . . . . . . . . . . 388 29 Handling Operating System Variation 391CONTENTS vi 30 Environment Variables 392 30.1 File locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1411 73 Future 1413 74 Interactive Utilities 1414 75 Julia Syntax Highlighting 1425 75.1 Functions . . . . . . . . . . . . . . Testing log events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1647 81.4 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1647 81.5 Examples

. . . . . . . . . . . . . . . 388 29 Handling Operating System Variation 391CONTENTS vi 30 Environment Variables 392 30.1 File locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1419 74 Future 1421 75 Interactive Utilities 1422 76 Julia Syntax Highlighting 1433 76.1 Functions . . . . . . . . . . . . . . Testing log events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1656 82.4 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1656 82.5 Examples

. . . . . . . . . . . . . . . 388 29 Handling Operating System Variation 391CONTENTS vi 30 Environment Variables 392 30.1 File locations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1419 74 Future 1421 75 Interactive Utilities 1422 76 Julia Syntax Highlighting 1433 76.1 Functions . . . . . . . . . . . . . . Testing log events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1656 82.4 Environment variables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1656 82.5 Examples