Performance of Apache Ozone on NVMe Wei-Chiu Chuang (jojochuang) Ritesh Shukla (kerneltime) Agenda • Overview of how Ozone and how it scales • Why NVME is important for Ozone for scaling • Benefits improvements results from NVME clusters • Summary • Questions Ozone Architecture Why does Ozone Scale? Separation of concerns Ozone Manager Ozone Client Datanode Storage Container Manager Recon Foreground Background No background load Datanode Datanode Datanode hadoop-hdds hadoop-ozone Scale out No foreground load Why does Ozone Scale? Aggregation via containers Chunks Chunks Chunks Blocks User Chunks

Apache Ozone Erasure Coding(EC) The Modern Big Data Object Store with More Than 50% Storage Space Savings Uma Maheswara Rao Gangumalla Sr. Engineering Manager, Cloudera Inc Stephen O’Donnell Sr. Staff Committee(PMC) Member ❏ Apache Ozone PMC Member ❏ Apache Incubator PMC ❏ Mentored several projects at Incubator ❏ ApacheCon Big Data track chair - 2021, 2022 What is Ozone? ➢ Apache Ozone is a distributed, scalable store ➢ Ozone is designed and optimized for Big Data workloads. ➢ Ozone can scale up to billions of objects and work effectively in containerized environments like Yarn or Kubernetes. ➢ Ozone is strongly

big is the universe? 15 Millions Lines of C/C/Objective-C 670,000 Lines Product Code ● Ozone ● RX ● Neutron ● Nectar ● etc. 1.33 Million Lines Shared Code ● iZBase ● iZDSPBase ● Glass

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color

1 clear day atmosphere 5 city like atmosphere 10 hazy day Ozone Density of ozone molecules; useful to make the sky appear bluer. 0 no ozone 1 clear day atmosphere 2 city like atmosphere Outputs Color