198 198 198 200 201 201 202 202 202 203 203 203 203 203 204 205 206 访问 Hive 访问 HBase 使⽤ 使⽤ pg_dump 迁移数据 迁移数据 安装 greenplum-db-clients 使⽤ pg_dump 导出数据 使⽤ psql 重建数据 利⽤ 利⽤ hdfs 外部表迁移数据 UCloud 优刻得 189/206 PXF 扩展 扩展 在 5.17 及以上版本的 Udw 集群中默认安装了 PXF 扩展服务，Udw 集群可以通过 PXF 服务访问 HDFS, Hive, HBase 等外部数据，具体使⽤可以查询对应版本的 GreenPlum PXF 官 ⽅⽂档。 使⽤ PXF 服务访问外部数据时，需要进⾏⼀些有关外部数据的配置，我们在控制台提供了配置上传的功能。如果需要访问 core- site.xml, hdfs-site.xml, mapred-site.xml, yarn-site.xml 配置⽂件，如果还需要额外访问 Hive 或者 HBase 数据，则需要上传 hive-site.xml 或者 hbase-site.xml 配置⽂件。 因为配置⽂件中⼀般以域名/主机名表⽰各节点的访问地址，所以还需要额外上传包含 Hadoop 集群各节点的域名/主机名与 IP 对应关系的

来的迁移代价，而开发、运维人员无需要学 习新的数据库处理技术，人力成本也能够大大降低。 ● 处理和分析各种数据源的数据的平台：支持各种数据源，包括 Kafka、Hadoop、HIVE、 HBase、S3、Gemfire、各种数据库和文件等，不需要移动数据，避免了数据加载的复杂 性，和其带来的数据不一致的问题。 ● 支持各种数据格式的平台：不管是结构化、半结构化（XML、JSON、KV）还是非结构化，

再进一步看，Master-Slave 架构在业界的大数据分布式计算和云计 算体系中被广泛应用，大家可以看到，现在主流分布式系统都是采 用 Master-Slave 架 构， 包 括：Hadoop FS、Hbase、MapReduce、 Storm、Mesos...... 无一例外都是 Master-Slave 架构。相反，采用 MultipleActive Master 的软件系统，需要消耗更多资源和机制来保证

libraries: Table 4. PXF Hadoop Supported Platforms PXF Version Hadoop Version Hive Server Version HBase Server Version 5.15.0, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3.2 5 of data extensions. Greenplum supports Apache Kafka integration, extensions for HDFS, Hive, and HBase as well as reading/writing data from/to cloud storage, including Amazon S3 objects. Review the capabilities object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol.

libraries: Table 4. PXF Hadoop Supported Platforms PXF Version Hadoop Version Hive Server Version HBase Server Version 6.x, 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3 of data extensions. Greenplum supports Apache Kafka integration, extensions for HDFS, Hive, and HBase as well as reading/writing data from/to cloud storage, including Amazon S3 objects. Review the capabilities object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol.

libraries: Table 4. PXF Hadoop Supported Platforms PXF Version Hadoop Version Hive Server Version HBase Server Version 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3.2 5 of data extensions. Greenplum supports Apache Kafka integration, extensions for HDFS, Hive, and HBase as well as reading/writing data from/to cloud storage, including Amazon S3 objects. Review the capabilities object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol.

depends, including the following Hadoop libraries: PXF Version Hadoop Version Hive Server Version HBase Server Version 6.x, 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3.2 multitude of data extensions. Greenplum supports Apache Kafka integration, extensions for HDFS, Hive, and HBase as well as reading/writing data from/to cloud VMware Tanzu Greenplum v6.20 Documentation VMware object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol.

depends, including the following Hadoop libraries: PXF Version Hadoop Version Hive Server Version HBase Server Version 6.x, 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3.2 object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol. object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases. s3:// Protocol The s3 protocol is used in a URL that specifies the location

depends, including the following Hadoop libraries: PXF Version Hadoop Version Hive Server Version HBase Server Version 6.x, 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3.2 object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol. object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases. s3:// Protocol The s3 protocol is used in a URL that specifies the location

depends, including the following Hadoop libraries: PXF Version Hadoop Version Hive Server Version HBase Server Version 6.x, 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1.x, 2.x, 3.1+ 1.3.2 object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases using the Greenplum Platform Extension Framework (PXF). See pxf:// Protocol. object store systems (Azure, Google Cloud Storage, Minio, S3), external Hadoop systems (HDFS, Hive, HBase), and SQL databases. s3:// Protocol The s3 protocol is used in a URL that specifies the location