Inc. All rights Reserved. Kubernetes Operator for Massively Parallel Postgres Goutam Tadi (@goutamtadi) Senior Software Engineer, Pivotal Software Inc Email: gp-kubernetes@pivotal.io PGConf India 2019 2019 Agenda ● Intro to Greenplum ● Kubernetes 101 ● Greenplum for Kubernetes ○ Components ■ Greenplum Operator ■ Greenplum Cluster ● Demo Massively Parallel Postgres Greenplum Greenplum Data Managed Clouds 5 Container Orchestration System Kubernetes Greenplum on Kubernetes 101 Kubernetes Master Greenplum on Kubernetes 101 Kubernetes Master kubelet kube-proxy docker Node kubelet kube-proxy

Greenplum on Kubernetes 容器化MPP数据库 AGENDA 云数据库背景 云数据库实现方案 Greenplum on Kubernetes Greenplum Operator 总结 云数据库背景 云数据库背景 ● 资源变化 ○ 本地资源 → 云 ○ 静态资源 → 弹性需求 ● 数据变化 ○ 内部数据 → 多数据源 ○ 数据规模 → 不易预测 ○ 数据格式 ○ Vertica Eon Mode ● 容器化数据库+Kubernetes ○ Apache Spark ○ CockroachDB ○ Apache HAWQ 云数据库存储方案 ● 块存储 ○ 文件系统接口 ● 对象存储 ○ 成本低 ○ 扩展性强 ○ 访问延迟高 Greenplum on Kubernetes Network Interconnect Standby 容器化Greenplum存储管理 ○ 容器本地存储易失性 ○ 容器外部存储关联性 Kubernetes 容器网络管理 容器资源管理 容器镜像管理 容器调度 容器监控及自 定义操作 容器存储管理 Kubernetes 101 Kubernetes 101 Master组件 Node组件 Kubernetes存储资源 PV ● PersistentVolume ○ 表示一种存储资源，独立容器生命周期

Extension Package 484 Uninstall R (Ubuntu) 484 Examples 484 Example 1: Using PL/R for single row operators 484 Example 2: Returning PL/R data.frames in Tabular Form 485 Example 3: Hierarchical Regression and Operators 901 Using Functions and Operators 0 Using Functions in Greenplum Database 901 Function Volatility and Plan Caching 903 User-Defined Functions 903 Built-in Functions and Operators 904 Indexes on jsonb Data 917 Btree and Hash Indexes on jsonb Data 919 JSON Functions and Operators 919 JSON Operators 920 JSON Creation Functions 921 JSON Aggregate Functions 922 JSON Processing Functions

Extension Package 474 Uninstall R (Ubuntu) 475 Examples 475 Example 1: Using PL/R for single row operators 475 Example 2: Returning PL/R data.frames in Tabular Form 475 Example 3: Hierarchical Regression and Operators 892 Using Functions and Operators 0 Using Functions in Greenplum Database 892 Function Volatility and Plan Caching 894 User-Defined Functions 894 Built-in Functions and Operators 895 Indexes on jsonb Data 908 Btree and Hash Indexes on jsonb Data 910 JSON Functions and Operators 910 JSON Operators 911 JSON Creation Functions 912 JSON Aggregate Functions 913 JSON Processing Functions

Extension Package 409 Uninstall R (Ubuntu) 410 Examples 410 Example 1: Using PL/R for single row operators 410 Example 2: Returning PL/R data.frames in Tabular Form 410 Example 3: Hierarchical Regression and Operators 824 Using Functions and Operators 0 Using Functions in Greenplum Database 824 Function Volatility and Plan Caching 826 User-Defined Functions 826 Built-in Functions and Operators 827 Indexes on jsonb Data 840 Btree and Hash Indexes on jsonb Data 842 JSON Functions and Operators 842 JSON Operators 843 JSON Creation Functions 844 JSON Aggregate Functions 845 JSON Processing Functions

Extension Package 478 Uninstall R (Ubuntu) 478 Examples 478 Example 1: Using PL/R for single row operators 478 Example 2: Returning PL/R data.frames in Tabular Form 479 Example 3: Hierarchical Regression Using Functions and Operators 893 Using Functions in Greenplum Database 894 Function Volatility and Plan Caching 895 User-Defined Functions 895 Built-in Functions and Operators 896 Window Functions Indexes on jsonb Data 909 Btree and Hash Indexes on jsonb Data 910 JSON Functions and Operators 911 JSON Operators 911 JSON Creation Functions 913 JSON Aggregate Functions 914 JSON Processing Functions

Functions and Operators 609 Using Functions in Greenplum Database 609 Function Volatility and Plan Caching 611 User-Defined Functions 611 User-Defined Procedures 612 Built-in Functions and Operators 612 Window Extension Package 804 Uninstall R (Ubuntu) 805 Examples 805 Example 1: Using PL/R for single row operators 805 Example 2: Returning PL/R data.frames in Tabular Form 805 Example 3: Hierarchical Regression Database Function Types 1578 Built-in Functions and Operators 1579 JSON Functions and Operators 1584 Processing and Creating JSON Data 1584 JSON Operators 1584 JSON Creation Functions 1586 JSON Aggregate

SELECT in a WITH Clause 799 Data-Modifying Statements in a WITH clause 802 Using Functions and Operators 803 Using Functions in Greenplum Database 804 VMware Greenplum 6 Documentation VMware, Inc 34 34 Function Volatility and Plan Caching 805 User-Defined Functions 806 Built-in Functions and Operators 806 Window Functions 810 Advanced Aggregate Functions 812 Working with JSON Data 813 About JSON Indexes on jsonb Data 819 Btree and Hash Indexes on jsonb Data 821 JSON Functions and Operators 821 JSON Operators 822 JSON Creation Functions 823 JSON Aggregate Functions 824 JSON Processing Functions

Using Functions and Operators 776 Using Functions in Greenplum Database 776 Function Volatility and Plan Caching 777 User-Defined Functions 778 Built-in Functions and Operators 778 Window Functions Indexes on jsonb Data 790 Btree and Hash Indexes on jsonb Data 792 JSON Functions and Operators 793 JSON Operators 793 JSON Creation Functions 795 JSON Aggregate Functions 796 VMware Tanzu Greenplum multiple values in this way can improve performance over extracting them separately with per-key operators. JSON keys are matched to identical column names in the target row type. JSON type coercion for

Using Functions and Operators 812 Using Functions in Greenplum Database 812 Function Volatility and Plan Caching 814 User-Defined Functions 814 Built-in Functions and Operators 815 Window Functions Indexes on jsonb Data 828 Btree and Hash Indexes on jsonb Data 830 JSON Functions and Operators 830 JSON Operators 831 JSON Creation Functions 832 JSON Aggregate Functions 833 JSON Processing Functions Extension Package 1014 Uninstall R (Ubuntu) 1015 Examples 1015 Example 1: Using PL/R for single row operators 1015 Example 2: Returning PL/R data.frames in Tabular Form 1015 Example 3: Hierarchical Regression