1Michael Wong Distinguished Engineer ● Chair of SYCL Heterogeneous Programming Language ● ISO C++ Directions Group past Chair ● Past CEO OpenMP ● ISOCPP.org Director, VP http://isocpp.org/wiki/ leading team developing HIP & CUDA backends for DPC++ Background in C++ programming models for heterogeneous systems Worked on ComputeCpp (SYCL) since its inception Contributor to the Khronos SYCL standard AI/Tensor HW Other BackendsSYCL 2020 is here! Open Standard for Single Source C++ Parallel Heterogeneous Programming SYCL 2020 is released after 3 years of intense work Significant adoption in Embedded

FPGAs AMD GPUs Any CPU SYCL enables Khronos to influence ISO C++ to (eventually) support heterogeneous compute SYCL, OpenCL and SPIR-V, as open industry standards, enable flexible integration and more) Any CPU Experimental SYCL enables Khronos to influence ISO C++ to (eventually) support heterogeneous compute SYCL, OpenCL and SPIR-V, as open industry standards, enable flexible integration and MobileyeSYCL IR ON COMPILER EXPLORERhttps://godbolt.org/z/jdhKr7e5rExpressiveness and simplicity for heterogeneous programming in modern C++ New Features Unified Shared Memory | Parallel Reductions | Subgroup

Threadpools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 301 24.3 Communication and synchronization . . . . . . . . . . . . . . . . . . . . . . . . . . 302 24.4 The @threads they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

Threadpools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 301 24.3 Communication and synchronization . . . . . . . . . . . . . . . . . . . . . . . . . . 302 24.4 The @threads they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

@threads Macro . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 321 25.4 Communication and data-races between threads . . . . . . . . . . . . . . . . . . . 323 25.5 Side effects and they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

@threads Macro . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 321 25.4 Communication and data-races between threads . . . . . . . . . . . . . . . . . . . 323 25.5 Side effects and they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

@threads Macro . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 321 25.4 Communication and data-races between threads . . . . . . . . . . . . . . . . . . . 323 25.5 Side effects and they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

Threadpools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 300 24.3 Communication and synchronization . . . . . . . . . . . . . . . . . . . . . . . . . . 301 24.4 The @threads they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

@threads Macro . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320 25.4 Communication and data-races between threads . . . . . . . . . . . . . . . . . . . 322 25.5 Side effects and they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type

@threads Macro . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320 25.4 Communication and data-races between threads . . . . . . . . . . . . . . . . . . . 322 25.5 Side effects and they get converted to that type using convert and that type is the array's eltype. Otherwise, a heterogeneous array that can hold anything — a Vector{Any} — is constructed; this includes the literal [] where type T, initialized to contain elements A, B, C, etc. For example, Any[x, y, z] constructs a heterogeneous array that can contain any values. Concatenation syntax can similarly be prefixed with a type