Science Dynamic Model in TVM AWS AI© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Models with dynamism ● Control flow (if, loop, etc) ● Dynamic shapes ○ Dynamic inputs: Limitation of TVM/graph runtime ● Cannot compile and run dynamic models© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Support dynamic model in TVM ● Support Any-dim in typing ● Use Use shape function to compute the type at runtime ● Virtual machine as a new runtime for Relay ● Dynamic codegen (WIP) ○ Kernel dispatch for a single op ○ Graph dispatch for a (sub-)graph In collaboration

. . . . . . . . . . . . . . 1437 77 Lazy Artifacts 1440 78 LibCURL 1441 79 LibGit2 1442 80 Dynamic Linker 1490 81 Linear Algebra 1494 81.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1729 90.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1733 90.5 Hooking into the Random experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer 2CHAPTER 1. JULIA 1.13-DEV DOCUMENTATION 3 dynamic languages for these applications

. . . . . . . . . . . . . . 1435 77 Lazy Artifacts 1438 78 LibCURL 1439 79 LibGit2 1440 80 Dynamic Linker 1488 81 Linear Algebra 1492 81.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1727 90.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1731 90.5 Hooking into the Random experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer 2CHAPTER 1. JULIA 1.12-RC1 DOCUMENTATION 3 dynamic languages for these applications

. . . . . . . . . . . . . . 1434 77 Lazy Artifacts 1437 78 LibCURL 1438 79 LibGit2 1439 80 Dynamic Linker 1487 81 Linear Algebra 1491 81.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1726 90.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1730 90.5 Hooking into the Random experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer 2CHAPTER 1. JULIA 1.12-BETA4 DOCUMENTATION 3 dynamic languages for these applications

. . . . . . . . . . . . . . 1434 77 Lazy Artifacts 1437 78 LibCURL 1438 79 LibGit2 1439 80 Dynamic Linker 1487 81 Linear Algebra 1491 81.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1726 90.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1730 90.5 Hooking into the Random experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer 2CHAPTER 1. JULIA 1.12-BETA3 DOCUMENTATION 3 dynamic languages for these applications

1368 74 Interactive Utilities 1369 75 Lazy Artifacts 1379 76 LibCURL 1380 77 LibGit2 1381 78 Dynamic Linker 1429 79 Linear Algebra 1433 79.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1665 88.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1669 88.5 Hooking into the Random performance, yet domain experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer dynamic languages for these applications, and we do not expect

1368 74 Interactive Utilities 1369 75 Lazy Artifacts 1379 76 LibCURL 1380 77 LibGit2 1381 78 Dynamic Linker 1429 79 Linear Algebra 1433 79.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1665 88.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1669 88.5 Hooking into the Random performance, yet domain experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer dynamic languages for these applications, and we do not expect

1368 74 Interactive Utilities 1369 75 Lazy Artifacts 1379 76 LibCURL 1380 77 LibGit2 1381 78 Dynamic Linker 1429 79 Linear Algebra 1433 79.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1665 88.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1669 88.5 Hooking into the Random performance, yet domain experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer dynamic languages for these applications, and we do not expect

. . . . . . . . . . . . . . 1426 76 Lazy Artifacts 1429 77 LibCURL 1430 78 LibGit2 1431 79 Dynamic Linker 1479 80 Linear Algebra 1483 80.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1717 89.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1721 89.5 Hooking into the Random experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer 2CHAPTER 1. JULIA 1.12-BETA1 DOCUMENTATION 3 dynamic languages for these applications

1172 72 Interactive Utilities 1173 73 Lazy Artifacts 1181 74 LibCURL 1182 75 LibGit2 1183 76 Dynamic Linker 1224 77 Linear Algebra 1227 77.1 Special matrices . . . . . . . . . . . . . . . . . . . Subsequences, permutations and shuffling . . . . . . . . . . . . . . . . . . . . . . 1425 86.4 Generators (creation and seeding) . . . . . . . . . . . . . . . . . . . . . . . . . . . 1428 86.5 Hooking into the Random performance, yet domain experts have largely moved to slower dynamic languages for daily work. We believe there are many good reasons to prefer dynamic languages for these applications, and we do not expect