Multi-GPU, multi-CPU systems require partitioning data - Users must manually split up data amongst GPUs / nodes - High-level mechanisms for data distribution / execution necessary. CPU NIC GPU 1 Tile 0 GPU Tile 1 Tile 0 Xe LinkProject Goals - Offer high-level, standard C++ distributed data structures - Support distributed algorithms - Achieve high performance for both multi-GPU, NUMA Background (Ranges, Parallelism, Distributed Data Structures) - Distributed Ranges (Concepts) - Implementation (Algorithms and views) - Complex Data Structures (Dense and sparse matrices)

rights reserved. Presenter: Haichen Shen, Yao Wang Amazon SageMaker Neo, Deep Engine Science Dynamic Model in TVM AWS AI© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Models with shapes ○ Dynamic inputs: batch size, image size, sequence length, etc. ○ Output shape of some ops are data dependent: arange, nms, etc. ○ Control flow: concatenate within a while loop Limitation of TVM/graph models© 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Support dynamic model in TVM ● Support Any-dim in typing ● Use shape function to compute the type at runtime ● Virtual

Model and Operate Datacenter by Kubernetes at eBay 辛肖刚, Cloud Engineering Manager, ebay 梅岑恺, Senior Operation Manager, ebay Agenda About ebay Our fleet Kubernetes makes magic at ebay Model + Controller Controller How we model our datacenter Operation in large scale Q&A About ebay 177M Active buyers worldwide $22.7B Amount of eBay Inc. GMV $2.6B Reported revenue 62% International revenue 1.1B 1B Live listings 81% Sold are new 88% Fixed price $11B Mobile Our fleet 15 3 US Data Centers POPs 200K+ Managed Vms 4K 100K Managed BMs Applications 4.5PB Managed Storage All of us know

The Future of Cloud Native Applications with Open Application Model (OAM) and Dapr @markrussinovich Application models Describes the topology of your application and its components The way developers their application to interact with other services and data stores Programming models Distributed Application Runtime (Dapr) Open Application Model (OAM) https://oam.dev State of Cloud Native Application of concerns Application focused Application focused Container infrastructure Open Application Model Service Job Namespace Secret Volume Endpoint ConfigMap VolumeAttach CronJob Deployment

Memory Model C++11 – C++23About Me: alex.dathskovsky@speedata.io www.linkedin.com/in/alexdathskovsky https://www.cppnext.comAlex Dathskovsky | alex.dathskovsky@speedata.io | www.linkedin.com/in/a value • It's better to call get_pivot once and call the value from register again and again • data[p] has the same value, it will be stored in a registerAlex Dathskovsky | alex.dathskovsky@speedata alex.dathskovsky@speedata.io | www.linkedin.com/in/alexdathskovsky Dynamic Scheduling • Check for data hazards • an instruction can be executed when its operands have been calculated or loaded from

Efficient Mixture-of-Experts Language Model DeepSeek-AI research@deepseek.com Abstract We present DeepSeek-V2, a strong Mixture-of-Experts (MoE) language model characterized by economical training and DeepSeek-V2 and its chat versions still achieve top-tier performance among open-source models. The model checkpoints are available at h t t p s : / / g i t h u b . c o m / d e e p s e e k - a i / D e e p Experimental Setups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 3.1.1 Data Construction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 3.1.2 Hyper-Parameters

poloclub.github.io/#cse6242
 CSE6242/CX4242: Data & Visual Analytics
 Simple Data Storage; SQLite Duen Horng (Polo) Chau
 Associate Professor, College of Computing
 Associate Director, MS Analytics
 Faloutsos How to store the data?
 What’s the easiest way? Easiest Way to Store Data As comma-separated files (CSV) But may not be easy to parse. Why? 3 Easiest Way to Store Data 4 https://en.wikipedia org/famous.html
 iPhone (iOS), Android, Chrome (browsers), Mac, etc. Self-contained: one file contains data + schema Serverless: database right on your computer Zero-configuration: no need to set up! See

Red Hat OpenShift Data Foundation 4.12 更新 OpenShift Data Foundation 针对集群和存储管理员的有关升级的说明 Last Updated: 2023-09-19 Red Hat OpenShift Data Foundation 4.12 更新 OpenShift Data Foundation 针对集群和存储管理员的有关升级的说明 other trademarks are the property of their respective owners. 摘要 摘要 本文档解释了如何更新以前的 Red Hat OpenShift Data Foundation 版本。 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 对红帽文档提供反 帽文档提供反馈 馈 第 第 1 章 章 OPENSHIFT DATA FOUNDATION 更新 更新过 过程概述 程概述 第 第 2 章 章 OPENSHIFT DATA FOUNDATION 升 升级频 级频道和 道和发 发行版本 行版本 第 第 3 章 章 将 将 RED HAT OPENSHIFT DATA FOUNDATION 4.11 更新至 更新至 4.12 第 第 4

Data is all you need for fusion N 1int x = 4; callee(x); // do work } #include #include #include "benchmark.h" #include "matrix_lib.h" int main(..){ std::vector a; a.reserve(100); reserve(100); // Initialize other data // data-structures. cblas_sgemm(a.data()...); cblas_sgemm(....); return 0; } High Performance code is about Hardware Matrix Multiply 2int x = 4; callee(x); // "matrix_lib.h" int main(..){ std::vector a; a.reserve(100); // Initialize other data // data-structures. cblas_sgemm(a.data()...); cblas_sgemm(....); return 0; } High Performance code is about Hardware

Back to Basics: Algebraic Data Types I also do C++ training! arthur.j.odwyer@gmail.com Arthur O’Dwyer 2020-09-16Outline ● Why the name “algebraic data types”? [3–18] ○ Memory layout diagrams. Why Questions? 2What do I mean by algebraic types? pair C++98. The original algebraic data type. tuple C++11. optional C++17. variant C++17, with minor tweaks to its constructors The memory layout of pair or tuple is going to be pretty much the same as the layout of a plain old data struct. pair tuple 6 A The compiler will do some padding for alignment, and may