Pepabo, Inc. 2019.07.25 GopherCon 2019 Optimization for number of goroutines using feedback control Principal engineer Yusuke MIYAKE @monochromegane Pepabo R&D Institute, GMO Pepabo, Inc. https://blog Issues to solve for the realization �27 1. Selection of performance metrics 2. Finding how to control rapidly and continuously Performance metrics Performance metrics �29 • Independent resource type number of goroutines based on the metrics • Continuously • Rapidly • Accurately • Feedback control meets these conditions. • Tracking a given set-point using errors from the set-point. • Applying

Steps Using Celery in your Application Calling Tasks Canvas: Designing Work-flows Routing Remote Control Timezone Optimization What to do now? Resources Getting Help Bug tracker Wiki Contributing License “canvas”, including grouping, chaining, chunking, and more. Read more…. Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more…. User Components Each worker component can be customized, and additional components

Steps Using Celery in your Application Calling Tasks Canvas: Designing Work-flows Routing Remote Control Timezone Optimization What to do now? Resources Getting Help Bug tracker Wiki Contributing License “canvas”, including grouping, chaining, chunking, and more. Read more…. Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more…. User Components Each worker component can be customized, and additional components

Steps Using Celery in your Application Calling Tasks Canvas: Designing Work-flows Routing Remote Control Timezone Optimization What to do now? Resources Getting Help Bug tracker Wiki Contributing License “canvas”, including grouping, chaining, chunking, and more. Read more…. Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more…. User Components Each worker component can be customized, and additional components

Steps Using Celery in your Application Calling Tasks Canvas: Designing Work-flows Routing Remote Control Timezone Optimization What to do now? Resources Getting Help Bug tracker Wiki Contributing License “canvas”, including grouping, chaining, chunking, and more. Read more…. Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more…. User Components Each worker component can be customized, and additional components

including grouping, chaining, chunking, and more. Read more... . • Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more... . • User Components Each worker component can be customized, and additional components by the user. The worker is built up using “bootsteps” — a dependency graph enabling fine grained control of the worker’s internals. Framework Integration Celery is easy to integrate with web frameworks

including grouping, chaining, chunking, and more. Read more... . • Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more... . • User Components Each worker component can be customized, and additional components by the user. The worker is built up using “bootsteps” — a dependency graph enabling fine grained control of the worker’s internals. Framework Integration Celery is easy to integrate with web frameworks

including grouping, chaining, chunking, and more. Read more... . • Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more... . • User Components Each worker component can be customized, and additional components by the user. The worker is built up using “bootsteps” — a dependency graph enabling fine grained control of the worker’s internals. Framework Integration Celery is easy to integrate with web frameworks

including grouping, chaining, chunking, and more. Read more... . • Time & Rate Limits You can control how many tasks can be executed per second/minute/hour, or how long a task can be allowed to run, used for user tasks leaking resources, like memory or file descriptors, that are simply out of your control. Read more... . • User Components Each worker component can be customized, and additional components by the user. The worker is built up using “bootsteps” — a dependency graph enabling fine grained control of the worker’s internals. Framework Integration Celery is easy to integrate with web frameworks