A Day in the Life of a Data Scientist Conquer Machine Learning Lifecycle on Kubernetes Brian Redmond • Cloud Architect @ Microsoft (18 years) • Azure Global Black Belt Team • Live in Pittsburgh, PA idle • Parallel training instead of sequential: huge time saver for large trainings Kubeflow • Machine Learning Toolkit for Kubernetes • To make ML workflows on Kubernetes simple, portable, and scalable

offline Nodes through posting Machine CRs. • Node-Operator: difference Machine and Node state, manage Node softwares and configure files. • Machine: the instance of Machine CRD with node basic information

instructions ! I have only a local machine You need an easy way ! Local-machine Solutions local-up-cluster kubeadm Minikube microk8s kubeadm-dind-cluster Local-machine Solutions https://github.com/kubernetes/minikube https://microk8s.io/ local-up-cluster Minikube Kubeadm kubeadm-dind-cluster microk8s My machine can't run Kubernetes... Oops ! Online playgrounds ! https://labs.play-with-k8s.com/ Online playgrounds

implements Linux by way of Linux ü another approach to enhance container isolation gVisor is special Machine-level virtualization Rule-based execution gVisor Technology landscape DEMO

sudo chown -R $(whoami) /usr/local/lib/pkgconfig ## VM 驱动程序 VirtualBox brew install docker-machine-driver-hyperkit ~/.kube/config ⽂件中查看所有可⽤的环境 启动 # 可添加参数 # --vm-driver=hyperkit minikube start

Cloud Native Way 阿里云容器服务团队 张维 KUBECON CHINA 2018 应用部署演化： Going native with cloud Virtual Machine/Bare Metal Increasing focus on business logic Decreasing concern (and control) on infrastructure

Platform (ACP)，包括：DevOps、Service Framework、Service Alauda Kubernetes 白皮书 灵雀云 5 Mesh，Machine Learning 等，构成完整的产品闭环，可以根据企业定制化的使用场景，选 择使用不同的产品。 5. 客户价值 使用 Alauda Kubernetes，有助于：

log Event The unhealthy node Monitoring Isolation Recover Degrade Data Analysis Failures/Machine Failures/Reason Report Lifecycle of Pod Failure Reason Target Kubelet Apiserver Scheduler

Communication Management Container Orchestration Data Processing Pipelines Data Flow Graphs for Machine Intelligence Kubernetes Contributors opensource.google.com A strong community with corporate

kubelet SyncLoop kubelet SyncLoop proxy proxy 4.1 Detected bind operation 4.2 Start Pod on this machine etcd scheduler api-server Pattern 1: Controller • Control everything by Controller • Level