Services built for S3 – Object store workloads IMPALA + OZONE Featuring FSO Buckets 30 © 2022 Cloudera, Inc. All rights reserved. IMPALA + OZONE • Impala: SQL engine built to run in Hadoop clusters will store Impala’s data in Ozone instead of HDFS 31 © 2022 Cloudera, Inc. All rights reserved. IMPALA-9400: IMPALA OZONE SUPPORT Jira Description IMPALA-10212 ofs support in Impala IMPALA-9448 Test encryption IMPALA-10213 Support data locality of Impala daemons on Ozone IMPALA-10214 Support file handle cache for Ozone 32 © 2022 Cloudera, Inc. All rights reserved. CHOOSING BUCKET TYPE • Impala has native

Ozone and how it scales • Why NVME is important for Ozone for scaling • Benefits of using NVME • Impala performance results from NVME clusters • Write path improvements results from NVME clusters • Summary measure network saturation when using S3 • Impala TPCDS benchmark • Ratis streaming performance tests How much does disk read cost with NVME? Impala TPCDS Why Impala and Ozone? • Data Warehouse is the most most common use case. ($$$) • Impala historically optimized on HDFS -> what will it do on Ozone Software under test CDP Private Cloud Base 7.1.8 + • IMPALA-11457 Fix regression with unknown disk

Ozone – 使⽤场景 #1 HDFS (300M FILES) AI/ML HIVE/IMPALA/SPARK KAFKA / FLINK 计算 OZONE (2 BILLION Objects) AI/ML HIVE/IMPALA/SPARK KAFKA / FLINK 计算 OTHER WORKLOADS OTHER WORKLOADS 业务价值 • 集约化的⼀套存储来⾯向不同的业务负载 • 更易于运维的控制⾯ • 只需要⼀个运维团队⽽不是多个 运维价值 OZONE STORAGE AI/ML HIVE/IMPALA/ SPARK KAFKA / Flink 计算 数据科学 数据仓库 S3 应⽤ S3 API OTHER WORKLOADS ⽬录 • Apache Hadoop HDFS⾯临的问题