ChatGPT hit the world stage all at once, growing in most global regions simultaneously. Meanwhile, platform incumbents and emerging challengers are racing to build and deploy the next layers of AI infrastructure: zero users in 2/24. Source: Yum!, ‘Introducing Byte by Yum! , an AI-driven restaurant technology platform powering customer and team member experiences worldwide’(2/25) Yum! Brands Byte by Yum! – 2/24-2/25 technology capabilities with advantaged economics made possible by the scale of Yum!. The Byte by Yum! platform includes online and mobile app ordering, point of sale, kitchen and delivery optimization, menu

Compute Library has been integrated by: ○ MATLAB Coder ○ ONNX RuntimeArm platform support in TVM upstream IPs Target Hardware/Model Options Codegen CPU arm_cpu pixel2 (snapdragon 835), mate10/mate10pro runtime plugins? ○ Integrate TVM codegen into Arm NN? ● CI and benchmark testing for TVM on member hardware platforms ○ Shall we maintain a list of Arm platforms supported by TVM? More details from our

network, but also get a good performance gain by autotuning 3. TVM can support many kinds of hardware platform: Intel/arm CPU, Nividia/arm GPU, VTA…5 �������������� 1. Get a .log file from the autotvm

ChenCurrent Deep Learning Landscape Frameworks and Inference engines DL Compilers Kenrel Libraries Hardware CuDNN NNPack MKL-DNN Hand optimized Open source, automated end-to- end optimization framework Optimization AutoTVM Device FleetExisting Deep Learning Frameworks High-level data flow graph Hardware Primitive Tensor operators such as Conv2D eg. cuDNN Offload to heavily optimized DNN operator graph and optimizations Directly generate optimized program for new operator workloads and hardware Hardware FrameworksWhy Automation is the Future Clear winner on emerging models in product Competitive

INTERNATIONAL INDUSTRIES, INCORPORATED 8 Hardware Configure Chisel VTA for DE10-Nano DEPLOY VTA ON INTEL FPGA©2019 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED 9 Hardware Datapath of Chisel VTA DEPLOY VTA VTA ON INTEL FPGA©2019 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED 10 Hardware DEPLOY VTA ON INTEL FPGA©2019 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED 11 Getting Started DEPLOY VTA ON INTEL FPGA vta/config/de10nano_config.json to vta_config.json Step 9: Go to vta/hardware/intel and run make command Step 10: Get the generated .sof file programmed into hardware Step 11: Evaluate the unit test script test_vta_insn

relay.vm.compile Relay Object (hardware independent) Code segment VM Func 0 VM Func 1 ... VM Func N Data segment Const 0 Const 1 ... Const K Kernel lib (hardware dependent) Packed Func 0 Packed

@ Intel GPU /NiiOS ! 驱动万物智能 8000% 7000% 6000% 5000% 4000% 3000% 2000% 1000% 0o0% GEMM Hardware Efficiency @ Intel Apollo Lake GPU 60.39% 512,512,512 国OpenVINO 国TVM 68.89% 1024 1024, 1024

计算平台事业部 COMPUTING PLATFORM TensorCore AutocCodeGen and Mixed-Precision Training/Inference PAI (Platform of AD Alibaba Cloud Intelligence Outline in TVM “。FP16 Mixed-Precision Training on PAI 。INT8 Inference on PAI-Blade 计算平台事业部 COMPUTING PLATFORM TensorCore AutoCodeGen Background 计算平台事业 。TensorCore 。A revolutionary 人ple/ints 人52/int32 Matrlix Identification 计算平台事业部 COMPUTING PLATFORM *。Tofigure out whether an input matrix is matrix_aor matrix_b, row_major or col_moajor. 。 Visit

organization benefits from compounding improvements. Klarna, a global payments network and shopping platform, introduced a new AI assistant to streamline customer service. Within a few months, the assistant America’s largest ecommerce and fintech company, partnered with 
 OpenAI to build a development platform layer to solve that. It’s called Verdi, and it’s powered 
 by GPT-4o and GPT-4o mini. Today, it builds. Verdi integrates language models, Python nodes, and APIs to create a scalable, consistent platform that uses natural language as a central interface. Developers now build consistently 
 high-quality

Chain of Thought Prompting. Available at: https://arxiv.org/pdf/2201.11903.pdf. 10. Google Cloud Platform, 2023, Chain of Thought and React. Available at: https://github.com/ GoogleCloudPlatform/gener Acting in Language Models. Available at: https://arxiv.org/pdf/2210.03629.pdf. 14. Google Cloud Platform, 2023, Advance Prompting: Chain of Thought and React. Available at: https://github.com/GoogleC