predict the window of opportunity for screening) National Cancer Institute – What is Cancer 3A computational model for cancer initiation 4 A single cell • Consider a bunch of ‘pseudo’ cells. • Cells have a stochastic process (Markov process). Birth event Mutation event Random Time 𝑢12 𝜆1A computational model for cancer initiation 4 A single cell • Consider a bunch of ‘pseudo’ cells. • Cells have rnd_generator; std::exponential_distribution<> exp{rate}; double time = exp(rnd_generator); 𝑢12 𝜆1A computational model for cancer initiation 5 Healthy cell Cell that harbors a neutral mutation Cancerous

[tile] DB libraries, and large-scale graph analytics. Open-source software projects resulting from his work include the Matrix Template Library, the Boost Graph Library and Open MPI. 。Phil Ratzloff *。Distinguished relationships between elements of a data set *，Without regard to what the data set actually is *。 Graph theoretical (abstract) results can be applied to many different practical (concrete) problems -theory cvMuNKCATIOWS 有二有 灿瑟必帮 和一是/第 手太则光大 A，训四 昱 站 -本| 厅 是，主 半一司、|全之体 ~ 对 /人-看 奋才全 和 全原 和 刁曾 The Future ls Big Graph: on meetalThngs soneaiadman MD] Basic Principles *。The C++ standard library (nee STL) provides

Scott, Principal Engineer at CMU SEI Graph/ML/AI algorithms for large- and small- scale parallel systems. Working on GBTL, a linear algebra-based C++ library for graph analytics.[DISTRIBUTION STATEMENT GraphBLAS community, C API Overview of our draft C++ API How might this interoperate with standard C++, graph library proposal? 4[DISTRIBUTION STATEMENT A] This material has been approved for public release GraphBLAS community, C API Overview of our draft C++ API How might this interoperate with standard C++, graph library proposal? 5[DISTRIBUTION STATEMENT A] This material has been approved for public release

top-down task graph What is Task Graph-based Programming System (TGPS) Code 4• TGPS encapsulates function calls and their dependencies in a top-down task graph What is Task Graph-based Programming task graph What is Task Graph-based Programming System (TGPS) Code A B C D B A C D 6• TGPS encapsulates function calls and their dependencies in a top-down task graph What is Task Graph-based precede(task_d); 19 20 sched.schedule(); 21 sched.wait(); B A C D 1. Easy to write and express a task graph 2. Allow to implement irregular parallel decomposition strategies 8Existing TGPSs on Heterogenous

All rights reserved. Amazon Trademark Deploy GluonCV Models GluonCV Models MXNet Computational Graph Json Acyclic Graph Export As-is Optimize with TVM© 2019, Amazon Web Services, Inc. or its Affiliates its Affiliates. All rights reserved. Amazon Trademark Like GluonCV? Go build! https://gluon-cv.mxnet.io https://github.com/dmlc/gluon-cv© 2019, Amazon Web Services, Inc. or its Affiliates. All rights

ingests a FP32 graph and a small dataset • Finds suitable quantization scale • Produces a quantized graph • Compiling Pre-quantized models – QNN Dialect • TVM ingests a pre-quantized graph in TFLite or or MxNet • Use high-level wrapper ops of QNN dialect© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. TVM Overview Framework Graph Mxnet TF …. parsers Relay Graph Target-independent Target-independent Relay passes Target-optimized graph Target-dependent Relay passes Intel x86 ARM CPU Nvidia GPU ARM GPU Schedule templates written in TVM Tensor IR .. More targets AutoTVM – Tuning

can run any models Your compiler (TVM) supports multiple frontends (e.g., TensorFlow, PyTorch, MXNet) Non Maximum Suppression ResNet-50 Dense Your Chip Your Chip© 2019, Amazon Web Services, Inc System Overview Relay IR Graph Annotation with Your Annotator Graph Partitioning Your Codegen LLVM, CUDA, Metal, VTA Serialized Subgraph Library Relay Runtime (VM, Graph Runtime, Interpreter) Mark supported operators or subgraphs 1. Implement an operator-level annotator, OR 2. Implement a graph-level annotator© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Option 1:

Inference Flow >> 5 MxNet CPU Layers FPGA Layers Runtime Image Model Weights Calibration Set Quantizer Compiler Tensor Graph Optimization Framework Tensor Graph to Xilinx Tensor Graph Frontend Deep https://github.com/xilinx© Copyright 2018 Xilinx TVM as Unified ML Front End >> 6 Relay (and NNVM) Graph Parser XIR Compiler Quantizer Partitioner @relay.transform.module_pass(opt_level=4) class AccelModule:© supported/not supported, pattern matching graph colorization - Choices how to partition especially for multi-branch networks (i.e. YOLOv3, SSD)© Copyright 2018 Xilinx TVM Graph Partitioning/Fusion >> 8 Subgraph

dependent: arange, nms, etc. ○ Control flow: concatenate within a while loop Limitation of TVM/graph runtime ● Cannot compile and run dynamic models© 2019, Amazon Web Services, Inc. or its Affiliates new runtime for Relay ● Dynamic codegen (WIP) ○ Kernel dispatch for a single op ○ Graph dispatch for a (sub-)graph In collaboration with Jared Roesch, Zhi Chen, Wei Chen© 2019, Amazon Web Services, implement© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Dispatch a Whole Graph Resnet Data -> (Any, 3, 224, 224) Dispatch Tree Resnet_copy0 Resnet_copy1 ... 1 <= bs < 17 17

Hexagon DSP 人NiOS ! 驱动万物知 Tensorflow deploy.so / deploy.json / deploy.bin | NNVM / Relay 让 Graph Optimization 站 站 Compile | libtvm_hexagon_runtime.so Alios TVM @ Hexagon DSP 。 Compute Kernel 6 4 2.353 2. ， 曾硬证 0 Mobilenet 1.0 densenet121 量TVM (with Auto Tuning) 目MXNet+ TensorRT 目TVM +TensorRT AiiOS ! 驱动万物智能 THANKS9 Ali0S ! 驱动万物智能