GPU Resource Management On JDOS 梁永清 liangyongqing1@jd.com 提供的服务 1. 用于实验的 GPU 容器 2.基于 Kubeflow 的机器学习训练服务 3.模型管理和模型 Serving 服务 Experiment Training Serving 均基于容器，不对业务方直接提供 GPU 物理机 GPU 实验 JDOS 常规的容器服务

Secrets Management at Scale with Vault & Rancher 24. June Robert de Bock Senior DevOps Engineer Adfinis robert.debock@adfinis.com Kapil Arora Senior Solution Engineer HashiCorp kapil@hashicorp.com Infrastructure Management (Run & Manage) GitOps Continuous Delivery Cluster Templates & Config Enforcement K8s Version Management Node Pool Management Cluster Provisioning & Lifecycle Management Platform Amazon EKS Azure AKS Google GKE Cloud Datacenter Edge Branch Dev Secret Management in Kubernetes 16 17 18 Secret Management Challenges ● Secrets sprawl ● Secrets rotation ● X.509 certificates, SSH

KubeEdge Demo Session Jun Du Huawei Cloud Cloud To Edge Low Latency • AR/VR: ms level • Industrial Control: us level High Availability • Availability: > 99.999% • Response Time: Predictable • Result: manage K8S clusters running in remote edge locations. KubeEdge A Kubernetes Native Edge Computing Management Framework. Mission: Let Cloud manages edge nodes and devices EASILY. • Built on K8S, 100% Compatible Intelligent Video Analytics KubeEdge （Cloud Part） KubeEdge (Edge Part) SWR Algorithms Management Job Management DIS Face Recognition System Face Extraction Face Recognition face picture, metadata…

Node Operator: Kubernetes Node Management Made Simple 陈俊(Joe), Ant Financial Agenda • Background and Motivation • Introduction of Operators • Node-Operator • Advanced Topic: • Upgrade Master & Node Components reliably • Canary Rollout • Master & Node Component Versions Management Motivation: Work Order Deployment Worker Order • Upgrade Nodes Versions • Upgrade Node 10.10 Complicated architecture Work order deployment system can not meet the requirements of resource management. Operator Observe Action Analyze • Observe: watch desired resource and actual resource

Processing and Analytics Vasiliki (Vasia) Kalavri
 vkalavri@bu.edu Spring 2020 2/25: State Management Vasiliki Kalavri | Boston University 2020 Logic State <#Brexit, 520> <#WorldCup, 480> key of the current record so that all records with the same key access the same state State management in Apache Flink 5 Vasiliki Kalavri | Boston University 2020 Operator state Keyed state State state is stored, accessed, and maintained. State backends are responsible for: • local state management • checkpointing state to remote and persistent storage, e.g. a distributed filesystem or a database

interface over a JDBC-to-ODBC bridge to communicate with Kyuubi. RESTful APIs It provides system management APIs, including engines, sessions, operations, and miscellaneous ones. It provides methods that kyuubi as the startup script. conf: all the defaults used by Kyuubi Server itself or creating a session with engines. externals - engines: contains all kinds of SQL engines that we support licenses: ones you’ve got in the step of server startup for the following JDBC URL. The case below open a session for user named apache. $ bin/beeline -u 'jdbc:hive2://localhost:10009/' -n apache Note Use –help

Deploying Kyuubi Basics Configurations Security 1. Authentication 2. Kinit Auxiliary Service 3. ACL Management Guide Client Documentation 1. Access Kyuubi with Hive JDBC and ODBC Drivers Integrations 1 kyuubi as the startup script. conf: all the defaults used by Kyuubi Server itself or creating a session with Spark applications. externals engines: contains all kinds of SQL engines that we support, e 64-Bit Server VM (build 25.251-b08, mixed mode) Or, export JAVA_HOME=/path/to/java in the local os session. export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk- 11.0.5.jdk/Contents/Home java -version

Deploying Kyuubi Basics Configurations Security 1. Authentication 2. Kinit Auxiliary Service 3. ACL Management Guide Client Documentation 1. Access Kyuubi with Hive JDBC and ODBC Drivers Integrations 1 kyuubi as the startup script. conf: all the defaults used by Kyuubi Server itself or creating a session with Spark applications. externals engines: contains all kinds of SQL engines that we support, e 64-Bit Server VM (build 25.251-b08, mixed mode) Or, export JAVA_HOME=/path/to/java in the local os session. export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk- 11.0.5.jdk/Contents/Home java -version

Engines Security 1. Authentication 2. Kinit Auxiliary Service 3. Hadoop Credentials Manager 4. ACL Management Guide Client Documentation 1. Access Kyuubi with Hive JDBC and ODBC Drivers Integrations 1 kyuubi as the startup script. conf: all the defaults used by Kyuubi Server itself or creating a session with Spark applications. externals engines: contains all kinds of SQL engines that we support, e 64-Bit Server VM (build 25.251-b08, mixed mode) Or, export JAVA_HOME=/path/to/java in the local os session. export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk- 11.0.5.jdk/Contents/Home java -version

Engines Security 1. Authentication 2. Kinit Auxiliary Service 3. Hadoop Credentials Manager 4. ACL Management Guide Client Documentation 1. Access Kyuubi with Hive JDBC and ODBC Drivers Integrations 1 kyuubi as the startup script. conf: all the defaults used by Kyuubi Server itself or creating a session with Spark applications. externals engines: contains all kinds of SQL engines that we support, e 64-Bit Server VM (build 25.251-b08, mixed mode) Or, export JAVA_HOME=/path/to/java in the local os session. export JAVA_HOME=/Library/Java/JavaVirtualMachines/jdk- 11.0.5.jdk/Contents/Home java -version