Inc. All rights Reserved. Kubernetes Operator for Massively Parallel Postgres Goutam Tadi (@goutamtadi) Senior Software Engineer, Pivotal Software Inc Email: gp-kubernetes@pivotal.io PGConf India 2019 2019 Agenda ● Intro to Greenplum ● Kubernetes 101 ● Greenplum for Kubernetes ○ Components ■ Greenplum Operator ■ Greenplum Cluster ● Demo Massively Parallel Postgres Greenplum Greenplum Data Managed Clouds 5 Container Orchestration System Kubernetes Greenplum on Kubernetes 101 Kubernetes Master Greenplum on Kubernetes 101 Kubernetes Master kubelet kube-proxy docker Node kubelet kube-proxy

Greenplum on Kubernetes 容器化MPP数据库 AGENDA 云数据库背景 云数据库实现方案 Greenplum on Kubernetes Greenplum Operator 总结 云数据库背景 云数据库背景 ● 资源变化 ○ 本地资源 → 云 ○ 静态资源 → 弹性需求 ● 数据变化 ○ 内部数据 → 多数据源 ○ 数据规模 → 不易预测 ○ 数据格式 ○ Vertica Eon Mode ● 容器化数据库+Kubernetes ○ Apache Spark ○ CockroachDB ○ Apache HAWQ 云数据库存储方案 ● 块存储 ○ 文件系统接口 ● 对象存储 ○ 成本低 ○ 扩展性强 ○ 访问延迟高 Greenplum on Kubernetes Network Interconnect Standby 容器化Greenplum存储管理 ○ 容器本地存储易失性 ○ 容器外部存储关联性 Kubernetes 容器网络管理 容器资源管理 容器镜像管理 容器调度 容器监控及自 定义操作 容器存储管理 Kubernetes 101 Kubernetes 101 Master组件 Node组件 Kubernetes存储资源 PV ● PersistentVolume ○ 表示一种存储资源，独立容器生命周期

MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu availability and correctness in the event of a hardware failure. Kubernetes enables quick recovery from both pod and host failures, and Kubernetes storage services provide a high level of availability for the mirroring solutions. For these reasons, mirrorless deployments are fully supported with Greenplum for Kubernetes. Other deployment environments are generally not supported for production use unless both Greenplum

MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu availability and correctness in the event of a hardware failure. Kubernetes enables quick recovery from both pod and host failures, and Kubernetes storage services provide a high level of availability for the mirroring solutions. For these reasons, mirrorless deployments are fully supported with Greenplum for Kubernetes. Other deployment environments are generally not supported for production use unless both Greenplum

MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu availability and correctness in the event of a hardware failure. Kubernetes enables quick recovery from both pod and host failures, and Kubernetes storage services provide a high level of availability for the mirroring solutions. For these reasons, mirrorless deployments are fully supported with Greenplum for Kubernetes. Other deployment environments are generally not supported for production use unless both Greenplum

MADlib, GPText, and PostGIS are not yet provided for installation on Ubuntu systems. Greenplum for Kubernetes is not yet provided with this release. The following table lists key known issues in VMware Tanzu availability and correctness in the event of a hardware failure. Kubernetes enables quick recovery from both pod and host failures, and Kubernetes storage services provide a high level of availability for the fully supported with Greenplum VMware Tanzu Greenplum v6.20 Documentation VMware, Inc. 244 for Kubernetes. Other deployment environments are generally not supported for production use unless both Greenplum

maximum amount of CPU resources the resource group can use. - CPU_WEIGHT, which configures the scheduling priority of the resource group. - MIN_COST, which configures the minimum amount a query’s query maximum percentage of CPU resources the group can use. [1 - 100] -1 (not set) CPU_WEI GHT The scheduling priority of the resource group. [1 - 500] 100 CPUSET The specific CPU logical core (or logical 40% of the CPU resources available to Greenplum. You set the parameter CPU_WEIGHT to assign the scheduling priority of the current group. The default value is 100, and the range of values is 1 to 500.

ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals VMware Greenplum 6 Documentation VMware, Inc 1198 Configuring Resource Management Resource scheduling is enabled by default when you install Greenplum Database, and is required for all roles. The

ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals Tanzu Greenplum 6 Documentation VMware, Inc 375 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals resource queues. See Checking Resource Queue Status. Configuring Resource Management Resource scheduling is enabled by default when you install Greenplum Database, and is required for all roles. The

ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals Configuring Resource Management VMware Tanzu Greenplum 6 Documentation VMware, Inc. 1155 Resource scheduling is enabled by default when you install Greenplum Database, and is required for all roles. The