Science Dynamic Model in TVM AWS AI© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Models with dynamism ● Control flow (if, loop, etc) ● Dynamic shapes ○ Dynamic inputs: Limitation of TVM/graph runtime ● Cannot compile and run dynamic models© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Support dynamic model in TVM ● Support Any-dim in typing ● Use Use shape function to compute the type at runtime ● Virtual machine as a new runtime for Relay ● Dynamic codegen (WIP) ○ Kernel dispatch for a single op ○ Graph dispatch for a (sub-)graph In collaboration

we are thankful for the hard work so many are doing to illustrate trending during this uniquely dynamic time. Our goal is to add to the discussion.• Seem Like Change Happening Faster Than Ever? Yes, DeepMind, Elon Musk (5/2/25), Fox News There’s three places where [GenAI is]…helping us: data creation…creating new features that were just not possible… efficiencies everywhere in the company… …I broader historical pattern in technology. Just as the early 2000s saw static websites give way to dynamic web applications – where tools like Gmail and Google Maps transformed the internet from a collection

Infrastructure Improvements to TVM o_uTVM: support for microcontrollers in TVM o_ Virtual Machine and dynamic NNs support (w/ AWS folks) o_ Improved NLP support, with focus on transformers QQ octoML Core Infrastructure towards production quality. o _VM compiler VM runtime VM serialization Dynamic Shape Support Dynamic Shape Allocation o Dynamic Shape Code generation ee Looking for more contributions in this part of ncubator-tvm/pull/3560 了 e， Enables future optimizations fn emain() -，Tensor[tk,)，f32] { and end-to-end dynamic Tet tl 引 -。 Let t2 3 memory planning,， storage

func(remote_a, remote_b)Virtual Machine: Supporting Dynamic Workload Dynamic shape workloads More runtime objects: Arrays, Tuples, Trees, ADTs Minimum runtime for dynamic models Credit: Jared Roesch, Haichen Shen

and edges (deterministic or dynamic handoffs). While beneficial for visual clarity, this approach can quickly become cumbersome and challenging as workflows grow more dynamic and complex, often necessitating familiar programming constructs without needing to 
 pre-define the entire graph upfront, enabling more dynamic and adaptable agent orchestration. 20 A practical guide to building agents Decentralized pattern

information to guide the response. It’s highly specific to the current task or input, which is dynamic. • Role prompt: Frames the model’s output style and voice. It adds a layer of specificity and personality quantum physics in a tweet length message." Use variables in prompts To reuse prompts and make it more dynamic use variables in the prompt, which can be changed for different inputs. E.g. as shown in Table 20

Existing fusion infrastructure fairly limited (CUDA-only, injective-only) - Kernel synthesis - Dynamic shapes, stride specialization - Impedance mismatch with PyTorch JIT IR and Relay IR - Watch this

product descriptions and tagging. But it also requires an understanding 
 of how shoppers search, a dynamic that changes across product categories. That’s where 
 fine-tuning comes in. By fine-tuning OpenAI