Apache Ozone Erasure Coding(EC) The Modern Big Data Object Store with More Than 50% Storage Space Savings Uma Maheswara Rao Gangumalla Sr. Engineering Manager, Cloudera Inc Stephen O’Donnell Sr. Staff using OFS protocol Ozone Client Apache Ozone Architecture Quick Overview of Non EC Flow Erasure Coding Requirements ❏ Phase - I ❏ Enable EC at Cluster/Bucket Level ❏ Should be able to Write files

 纠错码(Erasure Coding)  多个Standby Namenode  Datanode内部balance工具  云计算平台的支持 • YARN • MapReduce HDFS纠错码(Erasure Coding) • 一个简单的例子 1备份: 1,0 需要额外的2位 XOR编码: 1,0 需要额外的1位 HDFS纠错码(Erasure Coding) • Reed-Solomon task能 带来30%的性能提升。 Hadoop 的未来 HDFS的未来 • 对象存储 - HDFS-7240 • 更高性能的Namenode：更高效的内存使用，锁的改进等 • Erasure Coding的完善 YARN的未来 • 更大规模的集群支持 • 更好的资源调度，隔离和多租户 • 支持更多的应用，包括long running的service 谢谢 Q&A

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also possible (but that uses --erased-cubical, but names defined using Cubical Agda can only be used if the option --erasure is used. In that case the names are treated as if they had been marked as erased, with an exception be visible. 3.37 Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also possible (but that uses --erased-cubical, but names defined using Cubical Agda can only be used if the option --erasure is used. In that case the names are treated as if they had been marked as erased, with an exception be visible. 3.37 Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also possible (but that uses --erased-cubical, but names defined using Cubical Agda can only be used if the option --erasure is used. In that case the names are treated as if they had been marked as erased, with an exception be visible. 3.37 Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also possible (but that uses --erased-cubical, but names defined using Cubical Agda can only be used if the option --erasure is used. In that case the names are treated as if they had been marked as erased, with an exception be visible. 3.37 Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also should be visible. Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker Marking it erased explictly, however, ensures that it is erased without relying on the analysis. Erasure annotations can also appear in function arguments (both first-order and higher-order). For instance

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also should be visible. Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker Marking it erased explictly, however, ensures that it is erased without relying on the analysis. Erasure annotations can also appear in function arguments (both first-order and higher-order). For instance

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also should be visible. Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker Marking it erased explictly, however, ensures that it is erased without relying on the analysis. Erasure annotations can also appear in function arguments (both first-order and higher-order). For instance

Emacs mode. As an alternative you can copy the following text to your .emacs file: (load-file (let ((coding-system-for-read 'utf-8)) (shell-command-to-string "agda-mode locate"))) It is also should be visible. Run-time Irrelevance From version 2.6.1 Agda supports run-time irrelevance (or erasure) annotations. Values marked as erased are not present at run time, and consequently the type checker Marking it erased explictly, however, ensures that it is erased without relying on the analysis. Erasure annotations can also appear in function arguments (both first-order and higher-order). For instance