Kubernetes Native DevOps Practice — 王磊磊 @TenxCloud Agenda • Our DevOps Expectations • Kubernetes Capabilities/Advantages to Build DevOps Solution • Architecture and Features • CRD and operator design DevOps under micro-service architecture • Consolidate the consistent events and data, and create k8s native ChatOps tool • Contribute to open source community Automation Collaboration Integration Quantification

程占用的内存减少10%。 11 国内首发Windows容器服务：帮助企业实现海量Windows应用轻松容器 化上云 根据第三方咨询公司统计，大约有80%以上的企业现有系统仍是通 过Windows Server部署运维在服务器上，统计显示Windows Server在x86伺服器中的市占率高达6成。 CCE推出基于Kubernetes的Windows Server容器管理服务 • 完美兼容Kub 完美兼容Kubernetes能力，支持容器CPU/内存资源编排，无状态/ 有状态应用模型等能力； • 可纳管最新的Windows 1709系统，支持启动Windows Native容 器。 12 CCE支持GPU异构计算能力，帮助企业高效灵活应用深度学习服务 • 将旧的加速计算应用程序容器化，并部署 在较新的系统或者云环境中。 • 将特定的 GPU 资源分配给容器，以获得 更好的隔离效果和性能。 提高手机软件开发和测试效率，大幅缩短测 试时间（6K用例测试时间由9小时降低到56 分钟） TCO降低50% ARM服 务器 裸金属容 器 Taishan server VNC Server CPU GPU 容器 容器 容器 容器 Taishan server CPU GPU 外设模拟 内测版本仓库 ReleaseMan 版本发布仓库 ReleaseMan 手机APP自动化测试 TestBird

安装Kubernetes（单机） 对于Mac/Windows 10 前提：保持⽹络畅通 系统版本满⾜要求 对于macOS或者Windows 10，Docker已经原⽣⽀持了Kubernetes。你所要做的只是启⽤Kubernetes即可，如下图： Minikube ⼀些场景下，安装Minikube是个不错的选择。该⽅式适⽤于Windows 10、Linux、macOS 官⽅安装说明⽂档：https://github 官⽅安装说明⽂档：https://github.com/kubernetes/minikube 如何在Windows 10上运⾏Docker和Kubernetes？：http://dockone.io/article/8136 启⽤Kubernetes Dashboard 执⾏： kubectl proxy 02-安装单机版Kubernetes 8 访问： http://localhost:80 Master通常会部署在⼀个独⽴的服务器或虚拟机上，它是整个集群的⾸脑，如果Master宕机或不可⽤，那么我们所有的 控制命令都将会失效。 Master节点上运⾏着如下的关键进程： API Server：K8s⾥所有资源增删改查等操作的对外⼊⼝，也是集群控制的⼊⼝进程，它提供了HTTP RESTful API 接⼝给客户端以及其他组件调⽤。 Controller Manager：Controller

•Self-service portal Developer Sandbox • New application development • 12-factor apps, PCF Cloud Native •Simplify app maintenance •Improve developer workflow Application Repackaging The need for containers Provisioning PKS deploys Kubernetes clusters on-demand on vSphere or GCP Container Service for Cloud-Native Apps Rapidly deliver and operationalize next generation apps End User Experience • Installation Kubernetes Master etcd API-Server Scheduler NSX Container Plugin (NCP) NSX Infra NSX Manager API Client Kubernetes Adapter Kubernetes Master etcd API-Server Scheduler Architecture • NSX-T

Serverless Kubernetes: Container in Cloud Native Way 阿里云容器服务团队 张维 KUBECON CHINA 2018 应用部署演化： Going native with cloud Virtual Machine/Bare Metal Increasing focus on business logic Decreasing Provider 虚拟节点 • 无限弹性，敏捷扩容 • 支持pod之间互联互通 无需管理服务器 Without managing servers 用户只需关注容器应用 • Zero server ops • Focus on application • 容量规划：节点数量选择和扩容 • 规格实例选择、配置安全组 • 配置复杂的管理工具 • 配置网络 • 操作系统选择 ServiceAccount • Logs, Exec, Attach, Top • Scaling, HPA • Helm 面向Cloud Scale的架构设计 Etcd K8S API Server Viking 侦听 Pod, Service, Ingress等资源变化 ECI SLB DNS 双向同步 IaaS资源状态 K8S资源 CRUD K8S

platform@Hotmail.com) Huawei CloudBU Principal Engineer 王雷博 Principal Software Engineer • Huawei(Now) - Cloud Native batch system (Volcano) development • IBM spectrum computing - Cluster resource and workload scheduling com/apache-spark-on-k8s/spark l The goal is to bring native support for Spark to use Kubernetes as a cluster manager like YARN, or Mesos. l Spark 2.3 added native support for Kubernetes. l Spark 2.4 added support Resource reservation p Binpack p Task topology p Zone aware scheduling p … Volcano: A Kubernetes native batch system Gaps for spark Architecture Gaps for spark Architecture 1. Kubectl creates a JobEx

kubelet Installation - master - SSH - Install scheduler - Install controller manager - Install API server - Config them correctly - Start them Installation - etcd - SSH - Install etcd - Config them correctly self-hosted Kubernetes? ● Kubernetes manages own core components ● Core components deployed as native API objects Self-hosted k8s Architecture Why Self-host Kubernetes? ● Operational expertise around etcd Kubelet Bootkube API Server Scheduler Controller Manager etcd Kubelet Bootkube API Server Scheduler Controller Manager etcd Kubelet Bootkube API Server Scheduler Controller Manager

#容器化 / #分散式 / #微服務 #混合雲 / #新世代開發監控工具 # Cloud Native 使命 Meet customers where they are and partner with them in their transformation to cloud native Rigid Manual Expensive Infrastructure / IaaS IaaS Public Cloud “Serverless”/ FaaS On-premise Middleware / PaaS ● ● Cloud Native Hybrid ● ● ● Up Agile Portable Elastic Transform Efficient Secure Pay for use Out ● ● Migrate Move up, Google Cloud Console On-Prem/Public Cloud Provider Any K8s Cluster GCP Connection Proxy K8s API Server Connection Agent End-User Single-Pane of Glass Market- place & Service- Catalog Container

Copilot 57. Insomnia 58. IntelliJ HTTP 客户端插件 59. KEDA 60. Kubeconform 61. mob 62. MobSF 63. Mocks Server 64. Prisma 运行时防护 65. Terratest 66. Thanos 67. Yalc 评估 68. ChatGPT 69. Codeium 70. GitHub 合并队列 71 Copilot 57. Insomnia 58. IntelliJ HTTP 客户端插件 59. KEDA 60. Kubeconform 61. mob 62. MobSF 63. Mocks Server 64. Prisma 运行时防护 65. Terratest 66. Thanos 67. Yalc 评估 68. ChatGPT 69. Codeium 70. GitHub 合并队列 71 您尝试使用它来满足您对移动应用程序安全测 试需求。 工具 © Thoughtworks, Inc. All Rights Reserved. 31 63. Mocks Server 试验 Mocks Server 是一个基于 Node.js 的 API Mock 工具，它能够复制复杂的 API 响应、响应头和状态码，因此受 到了我们团队的重视。它的动态响应生成支持模拟多种场景，允许对

Background: K8s Secrets • Encryption Keys stored on API Server • Secrets encrypted prior to storage in etcd • Secrets decrypted on API Server prior to use • Encryption keys stored in a remote KMS write • LivenessProbe for health check • Configurations • kms-plugin • apiserver • Caching • API server • Set up Encrypted(DEK) => DEK mapping • KMS plugin • Set up SecretKeyName:SecretKeyVersion => SecretKeyData /storage-transform-disable= • Emergency management • High Availability guarantee • KMS • API server & kms-plugin • Cron job backup for KEKs (from KMS) • Static key configuration support in kms-plugin