reserved. March 2017. 1 ©Rancher Labs 2017. All rights Reserved. 2 DEPLOYING AND SCALING KUBERNETES WITH RANCHER Contents Introduction ............................................ ........................................................... 6 1.3.5 Container Management and Scaling ......................................................................... 6 1.3.6 Service Registry ........................32 ©Rancher Labs 2017. All rights Reserved. 3 DEPLOYING AND SCALING KUBERNETES WITH RANCHER 3.6 Secrets .........................................................

and system performance • Identify bottleneck operators, straggler workers, skew • Enumerate scaling actions, predict their effects, and decide which and when to apply • Allocate new resources, spawn ? Vasiliki Kalavri | Boston University 2020 Automatic Scaling Control 4 ??? Vasiliki Kalavri | Boston University 2020 The automatic scaling problem 5 Given a logical dataflow with sources S1, S2 Boston University 2020 Automatic scaling overview 6 scaling controller detect symptoms decide whether to scale decide how much to scale metrics policy scaling action ??? Vasiliki Kalavri |

and system performance • Identify bottleneck operators, straggler workers, skew • Enumerate scaling actions, predict their effects, and decide which and when to apply • Allocate new resources, spawn and system performance • Identify bottleneck operators, straggler workers, skew • Enumerate scaling actions, predict their effects, and decide which and when to apply • Allocate new resources, spawn and system performance • Identify bottleneck operators, straggler workers, skew • Enumerate scaling actions, predict their effects, and decide which and when to apply • Allocate new resources, spawn

@ritazzhang OpenAI Scaling Kubernetes to 2,500 Nodes https://blog.openai.com/scaling-kubernetes-to-2500-nodes/ OpenAI Scaling Kubernetes to 2,500 Nodes https://blog.openai.com/scaling-kubernetes-to-2500-nodes/ Azure Container Registry, gcr, ECR etc.) • Container orchestration • Automating deployment, scaling, and management of containerized applications • Declarative • Can be a mix of GPU or CPU nodes

RocketMQ scalers. Motivation - Implement RocketMQ scalers with KEDA Intuition - KEDA supports scaling Event driven application, built int scalers for vendors : Azure, AWS, Kafka, GCP, MySQL, RocketMQ now. So we need to create PR in KEDA repo for new support for RocketMQ - KEDA has event-driven scaling which means it scales based on events instead of RAM or CPU usage, also can be combined with other back down to zero. - Benchmark the ScaledObject will be deployed when there is change in the scaling as the number of message increases pollingInterval: 30 # Optional. Default: 30 seconds cooldownPeriod:

28, 2021 7 / 82 Margin (Contd.) Geometric margin γ(i) = y(i) �� ω ∥ω∥ �T x(i) + b ∥ω∥ � Scaling (ω, b) does not change γ(i) !" !" !"# + % = 0 ! !(#) !(#) = & # ' ⋅ ) ' ⋅ ) * +(#) + ' ⋅ December 28, 2021 8 / 82 Margin (Contd.) Geometric margin γ(i) = y(i) � (ω/∥ω∥)T x(i) + b/∥ω∥ � Scaling (ω, b) does not change γ(i) With respect to the whole training set, the margin is written as γ ! !"# + % = −( ! Feng Li (SDU) SVM December 28, 2021 12 / 82 Maximizing The Margin (Contd.) Scaling (ω, b) such that mini{y(i)(ωTx(i) + b)} = 1, γ = min i � y(i) �� ω ∥ω∥ �T x(i) + b ∥ω∥ ��

对于无服务器应用程序，Deployment 选项不会显示，因为 Knative 配置资源为您的部署维护所需的状 态，而不是由 DeploymentConfig 资源来维护。 扩 扩展 展 点击 Scaling 链接，以定义您要初始部署的应用程序的 pod 数或实例数。 如果要创建无服务器部署，也可以配置以下设置： 最小 最小 Pod 决定 Knative 服务在任意给定时间运行的 pod 数量较低限制。这也被称为 this deployment 复选框。 通过暂停推出部署，您可以在不触发推出部署的情况下对应用程序进行更改。您可以随时恢 复推出部署。 b. 可选：通过修改 Replicas 的数量，点 Scaling 以更改您的镜像实例数量。 4. 点击 Save。 $ oc expose svc/deployment-example $ oc scale dc/deployment-example --replicas=3 this deployment 复选框。 通过暂停推出部署，您可以在不触发推出部署的情况下对应用程序进行更改。您可以随时恢 复推出部署。 b. 可选：通过修改 Replicas 的数量，点 Scaling 以更改您的镜像实例数量。 4. 点击 Save。 8.3.3.2. 使用 使用 Developer 视 视角 角启动 启动重新 重新创 创建的部署 建的部署 您可以使用 web 控制台中的

breed-technologies Right tool for the right job Easy prototyping with php - good performance with GoLang Scaling and orchestration Containerized development and production environment Cloud orchestration with nscd ELB RDS IOPS Pods HPA Evaluation & conclusions Evaluation Kubernetes and docker for fast scaling Low price tag on operations No bottlenecks throughout the season 17% Record breaking Second Second screen interaction 62% Conclusion ● Documentation and procedures ● Prometheus ● Scaling ● Best practice ● Locust Thank you for the attention Any questions? Thomas Hector th@peytz.dk

对于无服务器应用程序，Deployment 选项不会显示，因为 Knative 配置资源为您的部署维护所需的状 态，而不是由 DeploymentConfig 资源来维护。 扩展 点击 Scaling 链接，以定义您要初始部署的应用程序的 pod 数或实例数。 如果要创建无服务器部署，也可以配置以下设置： 最小 Pod 决定 Knative 服务在任意给定时间运行的 pod 数量较低限制。这也被称为 Started deployment #2 --> Scaling up custom-deployment-2 from 0 to 2, scaling down custom-deployment-1 from 2 to 0 (keep 2 pods available, don't exceed 3 pods) Scaling custom-deployment-2 up to 1 there --> Scaling up custom-deployment-2 from 1 to 2, scaling down custom-deployment-1 from 2 to 0 (keep 2 pods available, don't exceed 3 pods) Scaling custom-deployment-1 down to 1 Scaling custom-deployment-2

management system ● Automation ○ Scheduling ○ Deployment ○ Healing ○ Discovery/load balancing ○ Scaling Scheduling Scheduler Scheduler Scheduling Scheduler Scheduling color=yellow Discovery Select Kubernetes! Kubernetes Architecture Operating Kubernetes ● Installation ● Upgrade ● Healing ● Scaling ● Security ● Monitoring ● ... Installation - SSH - Install kubelet - $pkgmanager install kubelet Kubernetes? ● Operational expertise around app management in k8s extends to k8s itself ○ E.g. scaling ● Bootstrapping simplified ● Simply cluster life cycle management ○ E.g. updates ● Upstream improvements