INDUSTRIES, INCORPORATED ACCELERATED VISUAL PERCEPTION LIANGFU CHEN 11/16/2019 DEPLOY VTA ON INTEL FPGA©2019 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED 2 Moore’s Law is Slowing Down MOTIVATION©2019 Terasic DE10-Nano DEPLOY VTA ON INTEL FPGA©2019 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED 5 Software - CMA Contiguous Memory Allocation – Linux Kernel DEPLOY VTA ON INTEL FPGA https://pynq.readthedocs INCORPORATED 6 Software - CMA Contiguous Memory Allocation – Linux Kernel Module DEPLOY VTA ON INTEL FPGA Setup Environment Variables Navigate to 3rdparty/cma and build kernel module Copy kernel module

Target-independent Relay passes Target-optimized graph Target-dependent Relay passes Intel x86 ARM CPU Nvidia GPU ARM GPU Schedule templates written in TVM Tensor IR .. More targets AutoTVM – Tuning Target-independent Relay passes Target-optimized Int8 Relay Graph Intel x86 schedule ARM CPU schedule Nvidia GPU schedule ARM GPU schedule Relay Int8 Graph Target-dependent Relay layout opt© 2019 its Affiliates. All rights reserved. Outline • QNN Dialect • Design • Operators • Results on Intel Cascade Lake© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Quantized Operators

人 人 e 人 e@ TVM Q@ AliOs Overview TVM @ AliOs ARM CPU TVM @ AliOos Hexagon DSP TVM @ Alios Intel GPU Misc /NiiOS ! 驱动万物智能 PART ONE TVM Q@ AliOs Overview AiOS 1驱动万物智能 AliOs overview 。 AliOs (www AN 2X MobilenetV2 TFLite 1.34X MobilenetV2 QNNPACK AliOs @ Roewe RX5 MAX OpenVINO @ Intel GPU AliDS AR-Nav Product @ SUV Release and adopt TVM (Apollo Lake Gold) Model 1.6X Intel AliOs TVM Arch Model 。 Facelandmark Pedestrian & Vehicle Detection Voice-GUI Gesture Lanenet NLU DMS FacelD Multimodal Interection CPU (ARM、Intel) 1驱动万物智能 Accelerated

Nodes Color Management Freestyle Layers & Passes Render Output Compositing Introduction Sidebar GPU Compositor Node Types Motion Tracking & Masking Introduction Motion Tracking Masking Video Editing to the GE, and over 400 bug fixes. 2.72 – October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun for AMD on linux. 3.1 – March 2022 Major point clouds improvements, Cycles Apple Metal GPU support, Subdivision GPU support, image editor handles larger images, Major performance gains for geometry nodes

Lights Materials Shader Nodes Color Management Freestyle Layers & Passes Render Output 合成 介紹 Sidebar GPU Compositor 節點類型 Motion Tracking & Masking 介紹 Motion Tracking Masking Video Editing 介紹 Setup Your the GE, and over 400 bug fixes. 2.72 -- October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun AMD on linux. 3.1 -- March 2022 Major point clouds improvements, Cycles Apple Metal GPU support, Subdivision GPU support, image editor handles larger images, Major performance gains for geometry nodes

the GE, and over 400 bug fixes. 2.72 -- October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun Automatic Automatically use GLSL which runs on the GPU for performance but falls back to the CPU for large images which might be slow when loaded with the GPU. 2D Texture Uses CPU for display transform and images. Cycles can use either the CPU or certain GPUs to render images, for more information see the GPU Rendering page. None When set to None or when the only option is None: the CPU will be used as the

to the GE, and over 400 bug fixes. 2.72 – October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun Automatic Automatically use GLSL which runs on the GPU for performance but falls back to the CPU for large images which might be slow when loaded with the GPU. 2D Texture Uses CPU for display transform and images. Cycles can use either the CPU or certain GPUs to render images, for more information see the GPU Rendering page. None When set to None or when the only option is None: the CPU will be used as the

the GE, and over 400 bug fixes. 2.72 -- October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun supported: Automatically use GLSL which runs on the GPU for performance but falls back to the CPU for large images which might be slow when loaded with the GPU. Uses CPU for display transform and render images images. Cycles can use either the CPU or certain GPUs to render images, for more information see the GPU Rendering page. 無 When set to None or when the only option is None: the CPU will be used as the computing

to the GE, and over 400 bug fixes. 2.72 – October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun supported: Automatically use GLSL which runs on the GPU for performance but falls back to the CPU for large images which might be slow when loaded with the GPU. Uses CPU for display transform and render images images. Cycles can use either the CPU or certain GPUs to render images, for more information see the GPU Rendering page. None When set to None or when the only option is None: the CPU will be used as the

Nodes Color Management Freestyle Layers & Passes Render Output Compositing Introduction Sidebar GPU Compositor Node Types Motion Tracking & Masking Introduction Motion Tracking Masking Video Editing to the GE, and over 400 bug fixes. 2.72 – October 2014: Cycles gets volume and SSS support on the GPU, pie menus are added and tooltips greatly improved, the Intersection modeling tool is added, new Sun for AMD on linux. 3.1 – March 2022 Major point clouds improvements, Cycles Apple Metal GPU support, Subdivision GPU support, image editor handles larger images, Major performance gains for geometry nodes