Being Friendly to Your Hardware Performance Engineering A gentle introduction to hardware for software engineers 2Where does C++ run? 3On an abstract C++ machine 4On an abstract C++ machine? specialty instructions, on-core and off- core accelerators • Data layout: both software and hardware characteristics 84 src dst • Alignment: source and destination • Size • Direction • LinearityExample

64-bit guests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 3.2 Emulated hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44 3.3 General settings . . . 68 4.4 Hardware-accelerated graphics . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 4.4.1 Hardware 3D acceleration (OpenGL and Direct3D 8/9) . . . . . . . . . 68 4.4.2 Hardware 2D video acceleration . . . . . . . . . . . . . . . . . . . . . . . 87 6 Virtual networking 88 6.1 Virtual networking hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 88 6.2 Introduction to networking modes

faster, especially if they are compiled into a form that is directly executable on the underlying hardware. Static compilation can also devote an arbitrary amount of time to program analysis and optimization faster, especially if they are compiled into a form that is directly executable on the underlying hardware. Static compilation can also devote an arbitrary amount of time to program analysis and optimization faster, especially if they are compiled into a form that is directly executable on the underlying hardware. Static compilation can also devote an arbitrary amount of time to program analysis and optimization

64-bit guests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 3.2 Emulated hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 3.3 General settings . . . 71 4.4 Hardware-accelerated graphics . . . . . . . . . . . . . . . . . . . . . . . . . . . 71 4.4.1 Hardware 3D acceleration (OpenGL and Direct3D 8/9) . . . . . . . . . 71 4.4.2 Hardware 2D video acceleration . . . . . . . . . . . . . . . . . . . . . . . 90 6 Virtual networking 91 6.1 Virtual networking hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 6.2 Introduction to networking modes

64-bit guests . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 46 3.2 Emulated hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 47 3.3 General settings . . . 72 4.4 Hardware-accelerated graphics . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 4.4.1 Hardware 3D acceleration (OpenGL and Direct3D 8/9) . . . . . . . . . 73 4.4.2 Hardware 2D video acceleration . . . . . . . . . . . . . . . . . . . . . . . 91 6 Virtual networking 92 6.1 Virtual networking hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92 6.2 Introduction to networking modes

Unattended guest installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 3.3 Emulated hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 3.4 General settings . . . 76 4.5 Hardware-accelerated graphics . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 4.5.1 Hardware 3D acceleration (OpenGL and Direct3D 8/9) . . . . . . . . . 76 4.5.2 Hardware 2D video acceleration . . . . . . . . . . . . . . . . . . . . . . . 95 6 Virtual networking 96 6.1 Virtual networking hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96 6.2 Introduction to networking modes

Unattended guest installation . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 3.3 Emulated hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 3.4 General settings . . . 76 4.5 Hardware-accelerated graphics . . . . . . . . . . . . . . . . . . . . . . . . . . . 76 4.5.1 Hardware 3D acceleration (OpenGL and Direct3D 8/9) . . . . . . . . . 76 4.5.2 Hardware 2D video acceleration . . . . . . . . . . . . . . . . . . . . . . . 95 6 Virtual networking 96 6.1 Virtual networking hardware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 96 6.2 Introduction to networking modes

layer from the hardware layerSeparate the logic layer from the hardware layer Application Layer Drivers handling LayerProcesses & Logics Separate the logic layer from the hardware layer Application Application Layer Drivers handling LayerProcesses & Logics Hardware Handling Separate the logic layer from the hardware layer Application Layer Drivers handling LayerHow are we going to test it?Probably GetNextTrafficLightLogic SetTrafficLightLogic Hardware SetTrafficLightA unit testUnit tests encourage us to keep the code simpler (Try to mock as little as possible)How Hardware tests should look like Init Write

for process data handling ▶ Provides calls for interrupt control ▶ Calls interface on interrupts ▶ Hardware concrete to the abstraction Michael Caisse Using C libraries in your Modern C++ Embedded Project libraries in your Modern C++ Embedded Project ciere.com Some Goals ▶ Testability ▶ Simulation ▶ Hardware agnostic Michael Caisse Using C libraries in your Modern C++ Embedded Project ciere.com Layered Caisse Using C libraries in your Modern C++ Embedded Project main things slushie_apphardware::hardware> app; extern "C" { void process_app(TOBJ7000 *pdo_in, TOBJ6000 *pdo_out) { auto config = t

but as a reachable threshold. If / when achieved, AGI would redefine what software (and related hardware) can do. Rather than executing pre-programmed tasks, AGI systems would understand goals, generate storage, but for real-time inference and model training workloads that require dense, high-power hardware. As AI moves from experimental to essential, so too do data centers. Per NVIDIA Co-Founder and the same time, the cost of applying/using these models – known as inference – is falling quickly. Hardware is improving – for example, NVIDIA’s 2024 Blackwell GPU consumes 105,000x less energy per token