/Miniconda3-latest-Linux-x86_64.sh • After Miniconda is installed: conda install pytorch -c pytorch Writing code • Up to you; feel free to use emacs, vim, PyCharm, etc. if you want. • Our recommendations: • Install: 1234:localhost:1234 __@__.cs.princeton.edu • First blank is username, second is hostname Jupyter Notebook VS Code • Install the Python extension. • ???????????? Install the Remote Development extension. • Python Jupyter notebooks by delimiting cells/sections with #%% • Debugging PyTorch code is just like debugging any other Python code: see Piazza @108 for info. Also try Jupyter Lab! Why talk about libraries

Continuous vs. micro-batch processing ▶ Record-at-a-Time vs. declarative APIs 3 / 79 Outline ▶ Spark streaming ▶ Flink 4 / 79 Spark Streaming 5 / 79 Contribution ▶ Design issues • Continuous vs. micro-batch micro-batch processing • Record-at-a-Time vs. declarative APIs 6 / 79 Spark Streaming ▶ Run a streaming computation as a series of very small, deterministic batch jobs. • Chops up the live stream into function is executed in the driver process. 31 / 79 Output Operations (2/4) ▶ What’s wrong with this code? ▶ This requires the connection object to be serialized and sent from the driver to the worker.

181 10.1 VirtualBox executables and components . . . . . . . . . . . . . . . . . . 181 10.2 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . 183 10.3 Details about software virtualization sys- tem (DOS, Windows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating hardware where these features are not present. More details can be found in chapter 10.2, Hardware vs. software virtualization, page 183. • Guest Additions: shared folders, seamless windows, 3D virtualization

VirtualBox executables and components . . . . . . . . . . . . . . . . . . . . . . 150 10.3 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . . . . . 152 10.4 Details about software system (DOS, Win- dows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating where these features are not present. The technical details are explained in chapter 10.3, Hardware vs. software virtualization, page 152. • Guest Additions: shared folders, seamless windows, 3D virtualization

VirtualBox executables and components . . . . . . . . . . . . . . . . . . . . . . 155 10.3 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . . . . . 157 10.4 Details about software system (DOS, Win- dows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating where these features are not present. The technical details are explained in chapter 10.3, Hardware vs. software virtualization, page 157. • Guest Additions: shared folders, seamless windows, 3D virtualization

VirtualBox executables and components . . . . . . . . . . . . . . . . . . . . . . 154 10.3 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . . . . . 156 10.4 Details about software system (DOS, Win- dows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating where these features are not present. The technical details are explained in chapter 10.3, Hardware vs. software virtualization, page 156. • Guest Additions: shared folders, seamless windows, 3D virtualization

VirtualBox executables and components . . . . . . . . . . . . . . . . . . . . . . 153 10.3 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . . . . . 155 10.4 Details about software system (DOS, Win- dows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating where these features are not present. The technical details are explained in chapter 10.3, Hardware vs. software virtualization, page 155. • Guest Additions: shared folders, seamless windows, 3D virtualization

architectures and an automatic mixed precision-like API that can be used seamlessly with your PyTorch code. ‣ A preview of Torch-TensorRT (1.4.0dev0) is now included. Torch-TRT is the TensorRT integration architectures and an automatic mixed precision-like API that can be used seamlessly with your PyTorch code. PyTorch Release 23.06 PyTorch RN-08516-001_v23.07 | 15 ‣ A preview of Torch-TensorRT (1.4 architectures and an automatic mixed precision-like API that can be used seamlessly with your PyTorch code. ‣ NVIDIA Deep Learning Profiler (DLProf) v1.8, which was included in the 21.12 container, was the

VirtualBox executables and components . . . . . . . . . . . . . . . . . . . . . . 167 10.3 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . . . . . 169 10.4 Details about software system (DOS, Win- dows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating where these features are not present. The technical details are explained in chapter 10.3, Hardware vs. software virtualization, page 169. • Guest Additions: shared folders, seamless windows, 3D virtualization

VirtualBox executables and components . . . . . . . . . . . . . . . . . . . . . . 163 10.3 Hardware vs. software virtualization . . . . . . . . . . . . . . . . . . . . . . . . 165 10.4 Details about software system (DOS, Win- dows, OS/2, FreeBSD, OpenBSD), but to achieve near-native performance of the guest code on your machine, we had to go through a lot of optimizations that are specific to certain operating where these features are not present. The technical details are explained in chapter 10.3, Hardware vs. software virtualization, page 165. • Guest Additions: shared folders, seamless windows, 3D virtualization