from? ◇ 3 years ago: started writing a tensor library in Nim. ◇ 2 threading APIs at the time: OpenMP and simple threadpool ◇ 1 year ago: complete refactoring of the internals 3 Agenda ◇ Understanding - Userland, lightweight context switches - Cannot use hardware threads Preemptive: - PThreads (OpenMP, TBB, Cilk, …) - Scheduled by the OS, heavier context switches - Need synchronization primitives: bus, caches, ... 14 Data parallelism Parallel for loop - Same instructions on multiple data - OpenMP - Use-cases - Vectors, matrices, multi-dimensional arrays and tensors - Challenges: - Nested

and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced And finally, when we use the C compiler backend, we may also use the parallel construct of the OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads,

and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced And finally, when we use the C compiler backend, we may also use the parallel construct of the OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads,

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel con­ 414 struct of the OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel construct of the 411 OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel con­ 414 struct of the OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel construct of the 411 OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel construct of the 411 OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel construct of the 411 OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or

task, and most modern programming languages support it. For older languages like C, extensions like OpenMP for threading support have been developed. The various forms of asynchronous operation were introduced finally, when we use the C compiler backend, we may also use the parallel construct of the 411 OpenMP C library. Some other programming languages like Lua or Go offer also virtual (green) threads, or