194 196 198 198 198 200 201 201 202 202 202 203 203 203 203 203 204 205 206 访问 Hive 访问 HBase 使⽤ 使⽤ pg_dump 迁移数据 迁移数据 安装 greenplum-db-clients 使⽤ pg_dump 导出数据 使⽤ psql 重建数据 利⽤ 利⽤ hdfs pxf 可读表 4. 从 hdfs 外部表中读取数据并写⼊⽬的 greenplum 集群 FAQs 创建好数据仓库之后怎么连接到UDW？ UDW⽀持从mysql导⼊数据吗？ HDFS/Hive与UDW之间可以导⼊导出数据吗？ UDW中怎么kill掉正在执⾏的SQL语句？ 如何通过外⽹访问UDW？ 节点扩容时数量有没有什么限制？ 数据仓库价格 数据仓库价格 ⽬录 Greenplum数据仓库 w 从 从hdfs加载数据 加载数据 为了⽅便udw和hdfs之间的数据导⼊和导出，我们提供个两种⽅案： 1. ⽤sqoop实现hdfs和udw直接的数据导⼊导出，使⽤⽅法请参考：hdfs和hive中数据导⼊导出到udw 2. 创建hdfs外部表，使⽤⽅法请参考：创建hdfs外部表 从 从mysql中导⼊数据 中导⼊数据 为了⽅便mysql数据导⼊到udw，我们提供了mysql导⼊数据

SMART，效率更高；在客户现场的测试对比中，Mapreduce 对 于单表的计算尚可，但对于复杂查询，如多表关联等，性能很差，性 能甚至只有 MPP 数据库的几十分之一甚至几百分之一，下图是基于 MapReduce 的 Hive 和 Greenplum MPP 在 TPCH 22 个 SQL 测试性 能比较：（相同硬件环 境下） 某国内知名电商在其 数据分析平台上做过 验证：同样的硬件条 件下，MPP 数据库比 Hadoop 不仅业务分析人员无法使用，甚至技术人员也难以学习和操控。为 了解决易用性的问题，近年来 SQL-0N-HADOOP 技术大量涌现 出来，几乎成为当前 Hadoop 开发使用的一个技术热点趋势。 这 些 技 术 包 括：Hive、Pivotal HAWQ、SPARK SQL、Impala、 Prest、Drill、Tajo 等等很多，这些技术有些是在 Mapreduce 上做 了优化。例如 Spark 采用内存中的 Mapreduce 2003 OLAPWINDOW 函数，几乎都不支持。以 TPC-DS 测试（用于评测决策支持系统（大数据或数据仓库）的标准 SQL 测试集 ,99 个 SQL）为例，包括 SPARK、Impala、Hive，只能支 持其中的 1/3 左右。 Big Date2.indd 15 16-11-22 下午3:38 16 由于 HADOOP 本身 Append-only 的特性，SQL-On-Hadoop

PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces reads Parquet files that contain data in timestamp format. PXF adds column projection support for the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based 30602 - PXF PXF did not correctly read a partitioned Hive table when the external table specified a Hive* profile and the external table and Hive table had a differing number of columns. This issue is

PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces reads Parquet files that contain data in timestamp format. PXF adds column projection support for the Hive and HiveRC profiles by changing the VMware Tanzu Greenplum 6 Documentation VMware, Inc 183 implementation rather than column index-based, mapping. Note: If you have existing PXF external tables that specify a Hive* profile, you may be required to perform upgrade actions as described in Upgrading PXF. Resolved

PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces reads Parquet files that contain data in timestamp format. PXF adds column projection support for the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based PXF did not correctly read a partitioned Hive table when the external table specified a Hive* Note If you have existing PXF external tables that specify a Hive* profile, you may be required to perform

PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based, mapping. Note: If you have existing PXF external tables that specify a Hive* profile 30602 - PXF PXF did not correctly read a partitioned Hive table when the external table specified a Hive* profile and the external table and Hive table had a differing number of columns. This issue is

PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based, mapping. Note: If you have existing PXF external tables that specify a Hive* profile 30602 - PXF PXF did not correctly read a partitioned Hive table when the external table specified a Hive* profile and the external table and Hive table had a differing number of columns. This issue is

PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces Server. VMware Greenplum 6 Documentation VMware, Inc. 230 PXF adds column projection support for the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based 30602 - PXF PXF did not correctly read a partitioned Hive table when the external table specified a Hive* profile and the external table and Hive table had a differing number of columns. This issue is

following Hadoop libraries: Table 4. PXF Hadoop Supported Platforms PXF Version Hadoop Version Hive Server Version HBase Server Version 5.15.0, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3.1+ 1 PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based, mapping. Note: If you have existing PXF external tables that specify a Hive* profile

following Hadoop libraries: Table 4. PXF Hadoop Supported Platforms PXF Version Hadoop Version Hive Server Version HBase Server Version 6.x, 5.15.x, 5.14.0, 5.13.0, 5.12.0, 5.11.1, 5.10.1 2.x, 3 PXF bundles newer hive, jackson-databind, and supporting internal libraries. A PXF server running on Java 11 can now read from Hive using an external table that specifies a Hive* profile. PXF introduces the Hive and HiveRC profiles by changing the implementation to use column name-based, rather than column index-based, mapping. Note: If you have existing PXF external tables that specify a Hive* profile