I hate to OPERATE Kubernetes! Kubernetes Architecture Operating Kubernetes ● Installation ● Upgrade ● Healing ● Scaling ● Security ● Monitoring ● ... Installation - SSH - Install kubelet - $pkgmanager node1 node2 node3 Upgrade - SSH - Upgrade container runtime - Upgrade Kubelet Upgrade - master - SSH - Upgrade master components Upgrade - etcd - SSH - Upgrade etcd Upgrade kops AWS, GCP API should be v1.4.5 ● Scheduler should be v1.4.5 How to get there ● Upgrade all API servers Daemons to v1.4.5 safely one-by-one ● Upgrade all Scheduler Deployments to v1.4.5 ● Update status to v1.4.5 The

time • Upgrade Master & Node Components reliably • Canary Rollout • Master & Node Component Versions Management Motivation: Work Order Deployment Worker Order • Upgrade Nodes Versions • Upgrade Node Node 10.10.10.1 • Upgrade docker • Upgrade kubelet • Upgrade Node 10.10.10.2 • Upgrade docker • Upgrade kubelet …. Motivation: Work Order Deployment Disadvantages • Inconsistency • Non-failure-aware post Node state to kube- apiserver. Node-Operator: Scale Nodes Node-Operator Node-Operator: Upgrade Nodes Node-Operator Node-Operator: Grayscale Publish Node-Operator Kube-on-Kube-Operator: Overview

Step 3. Relax and have a cup of coffee What if salt master down? Upgrade Kubernetes core components Upgrade addons How to upgrade a cluster? ● Kubernetes is amazing on its simple architecture ● Model

InPlaceUpdate Ø Support HPA, CronHPA, VWA (Vertical Workload Autoscaler) Ø Keep share memory during Pod upgrade Ø Scaled Up with LGV (Last Good Version) Ø Per Pod Per PV Ø Per Workload Per PV Ø Pod Auto Migrate �������������������������������� StatefulSetPlus Operator Ø Keep share memory during Pod upgrade Ø Upgrade jitter (a few ms) for keep-alive services Flexible and dynamic resource management Dynamic

make job successful or failed approval timeout volumes CI/CD Examples - Continuous Deployment Upgrade an existing service Deploy using helm template environment variables • Image with kubectl or call webhook Job Kubernetes Cluster Kubernetes Cluster Pod Pod Pod Pod - Rolling Upgrade / Recreate - Deploy / Upgrade using helm，rollback if unready pods - Check tracing data, rollback if get unexpected

• Operator reconciles configuration and updates to it with the status of the managed resources Upgrade of the managed workload • Operand can be upgraded in the process of upgrading the Operator, or changing the CR • Operator understands how to upgrade older versions of the Operand, managed previously by an older version of the Operator Upgrade of the Operator • Operator can be upgraded seamlessly

jinja2 --upgrade 如果执⾏ pip2 install jinja2 --upgrade 出现类似如下的提示： You are using pip version 9.0.1, however version 18.0 is available. You should consider upgrading via the 'pip install --upgrade pip' command command. 则执⾏ pip install --upgrade pip 升级pip，再执⾏ pip2 install jinja2 --upgrade 03-使⽤Kubespray部署⽣产可⽤的Kubernetes集群（1.11.2） 11 安装Python 3.6 ~]# sudo yum install python36 –y 在ansible-client机器上配置免密登录

k8s ����! Kubernetes Operator ��! • �������(TPR/CRD)! • �� k8s controller�����������! • ������upgrade, scale, failover, backup! • ��������! ����������������! ������ Kubernetes ����������! Kubernetes

— so start using Helm and stop the copy- and-paste madness. • Help you define, install, and upgrade even the most complex Kubernetes application. • Official community： https://helm.sh/ Core concepts

• 不同检测点动态定制检测策略 Report cluster.version > 1.16.1 and cluster.type = Edge and report.type = upgrade Policy cluster.addon.terway.version > 1.0.9.14 Checkpoint terway.version terway.status Ver