 Kubernetes & YARN: a hybrid container cloud
��� �����  �������� ����� ����� ������� ��������� ������� �������� �� ���� Online service Batch jobs Category Online shopping web apps, payment service MR, spark, flink Latency Sensitive Insensitive contention ���� ������ ���������� - Online workload low 1:00am – 6:00am - Offline jobs scale up while online workload remains idle - Offline jobs scale down while online workload comes back ������ ��� ��� NODE Online service Console Offline jobs L&W L&W GRPC RPC: VTRON RPC: VTRON RPC Resource management VTRON: Virtual Total Resources Of Node cgroup �������� ������� Kubernetes YARN Online service0 码力 | 42 页 | 25.48 MB | 1 年前3 Kubernetes & YARN: a hybrid container cloud
��� �����  �������� ����� ����� ������� ��������� ������� �������� �� ���� Online service Batch jobs Category Online shopping web apps, payment service MR, spark, flink Latency Sensitive Insensitive contention ���� ������ ���������� - Online workload low 1:00am – 6:00am - Offline jobs scale up while online workload remains idle - Offline jobs scale down while online workload comes back ������ ��� ��� NODE Online service Console Offline jobs L&W L&W GRPC RPC: VTRON RPC: VTRON RPC Resource management VTRON: Virtual Total Resources Of Node cgroup �������� ������� Kubernetes YARN Online service0 码力 | 42 页 | 25.48 MB | 1 年前3
 KubeCon2020/腾讯会议大规模使用Kubernetes的技术实践Optimize the isolation of resources, and improve resource utilization using hybrid deployment of online and offline services. • Support Service Mesh. • Large-scale and high-performance autoscaling Kubernetes Service) TKE (Tencent Kubernetes Engine) TKEx AI Training Jobs Big Data Jobs Online Services NodeProblemDetector Dynamic Scheduler DynamicQuotaManager MultiClusterManager De-Scheduler self-agent self-agent Patch Node Condition �������������������������� TKEx Web Job Queue Manager Online & Offline Task OfflineTask DynamicQuota Rebalance Worker TKEx-API Message Queue Dynamic0 码力 | 19 页 | 10.94 MB | 1 年前3 KubeCon2020/腾讯会议大规模使用Kubernetes的技术实践Optimize the isolation of resources, and improve resource utilization using hybrid deployment of online and offline services. • Support Service Mesh. • Large-scale and high-performance autoscaling Kubernetes Service) TKE (Tencent Kubernetes Engine) TKEx AI Training Jobs Big Data Jobs Online Services NodeProblemDetector Dynamic Scheduler DynamicQuotaManager MultiClusterManager De-Scheduler self-agent self-agent Patch Node Condition �������������������������� TKEx Web Job Queue Manager Online & Offline Task OfflineTask DynamicQuota Rebalance Worker TKEx-API Message Queue Dynamic0 码力 | 19 页 | 10.94 MB | 1 年前3
 Kubernetes Use it, Contribute to it, and Enjoy it!s Docs/blog Course Video Playground Learning platform https://kubernetes.io/docs/tutorials/online-training/overview/ More: Agenda 1. The community 2. How to contribute 3. Versioning 4. The easy kubeadm-dind-cluster microk8s My machine can't run Kubernetes... Oops ! Online playgrounds ! https://labs.play-with-k8s.com/ Online playgrounds ! https://www.katacoda.com/courses/kubernetes Agenda 10 码力 | 45 页 | 3.11 MB | 1 年前3 Kubernetes Use it, Contribute to it, and Enjoy it!s Docs/blog Course Video Playground Learning platform https://kubernetes.io/docs/tutorials/online-training/overview/ More: Agenda 1. The community 2. How to contribute 3. Versioning 4. The easy kubeadm-dind-cluster microk8s My machine can't run Kubernetes... Oops ! Online playgrounds ! https://labs.play-with-k8s.com/ Online playgrounds ! https://www.katacoda.com/courses/kubernetes Agenda 10 码力 | 45 页 | 3.11 MB | 1 年前3
 KubeCon2020/大型Kubernetes集群的资源编排优化Quota Control Cluster1 Offline pool(30%) Online pool(70%) Product1 Quota Online Pod Offline Pod Cannot exceed quota of Product1 Product2 Quota Online Pod Offline Pod Cannot exceed Offline Quota0 码力 | 27 页 | 3.91 MB | 1 年前3 KubeCon2020/大型Kubernetes集群的资源编排优化Quota Control Cluster1 Offline pool(30%) Online pool(70%) Product1 Quota Online Pod Offline Pod Cannot exceed quota of Product1 Product2 Quota Online Pod Offline Pod Cannot exceed Offline Quota0 码力 | 27 页 | 3.91 MB | 1 年前3
 全球架构师峰会2019北京/大数据/Kubernetes 运行大数据工作负载的探索和实践&mdashto support for data-intensive and stateful apps. Benefit: l Autoscaling in Cloud l Consolidate online service and offline analysis l Ecosystem( Monitor, logging etc) l Fine grained resource isolation0 码力 | 25 页 | 3.84 MB | 1 年前3 全球架构师峰会2019北京/大数据/Kubernetes 运行大数据工作负载的探索和实践&mdashto support for data-intensive and stateful apps. Benefit: l Autoscaling in Cloud l Consolidate online service and offline analysis l Ecosystem( Monitor, logging etc) l Fine grained resource isolation0 码力 | 25 页 | 3.84 MB | 1 年前3
 多雲一體就是現在:
GOOGLE CLOUD 的
KUBERNETES
混合雲戰略Single Pane of Glass across GCP & On-Prem ● vSphere 6.5 for Alpha ● Simple CLI installation ● Online and Offline installation ● Private container registry support ● Latest 3 versions of k8s ● High-availability0 码力 | 32 页 | 2.77 MB | 1 年前3 多雲一體就是現在:
GOOGLE CLOUD 的
KUBERNETES
混合雲戰略Single Pane of Glass across GCP & On-Prem ● vSphere 6.5 for Alpha ● Simple CLI installation ● Online and Offline installation ● Private container registry support ● Latest 3 versions of k8s ● High-availability0 码力 | 32 页 | 2.77 MB | 1 年前3
 逐灵&木苏-阿里巴巴 K8S 超大规模实践经验application operations.阿里巴巴的 k8s 集群规模 • 数十个集群 • 数十万的节点 • 单集群规模 10,000 节点 • • 数万个应用 • 超百万的容器 Online Service AI Job FaaS Middleware Resource management, Scheduling, Automated operation, etc. Workloads0 码力 | 33 页 | 8.67 MB | 6 月前3 逐灵&木苏-阿里巴巴 K8S 超大规模实践经验application operations.阿里巴巴的 k8s 集群规模 • 数十个集群 • 数十万的节点 • 单集群规模 10,000 节点 • • 数万个应用 • 超百万的容器 Online Service AI Job FaaS Middleware Resource management, Scheduling, Automated operation, etc. Workloads0 码力 | 33 页 | 8.67 MB | 6 月前3
共 7 条
- 1













