Ozone on NVMe Wei-Chiu Chuang (jojochuang) Ritesh Shukla (kerneltime) Agenda • Overview of how Ozone and how it scales • Why NVME is important for Ozone for scaling • Benefits of using NVME • Impala Impala performance results from NVME clusters • Write path improvements results from NVME clusters • Summary • Questions Ozone Architecture Why does Ozone Scale? Separation of concerns Ozone Manager limitations, working set can be cached in memory and unused data can be destaged to disk • OM uses NVME to store RocksDBs • Future projects such as Snapshots leverage RocksDB to preserve simplicity of

via RocksDB • No block report load: Background processing is separated from foreground. • NVME: OM uses NVME to store RocksDBs • Simplicity: Written with simplicity in mind – Example: Snapshots leverage rights reserved. HARDWARE TRENDS All NVME clusters are increasingly common • Ozone’s metadata is stored on SATA SSD or NVME • Increasing number of customers using all NVME clusters (metadata and data) – – High density nodes with Ozone – High performance workloads – Effectively lower TCO for all NVME clusters. COST OF DESTAGING DATA 65 © 2022 Cloudera, Inc. All rights reserved. IMPALA + OZONE •