Reading & Writing Streams with Spark Structured Streaming
The video below goes into the syntax of reading and writing streams with Spark Structured Streaming.
I highly recommend watching the video using the ‘full’ Panopto player. There is a ‘pop out’ button in the bottom right of the video to enter this viewer.
The notebook used in the video is available here. You’ll need to download this .ipynb file and upload it to your JupyterHub environment. Make sure that the kernel used to run the notebook is a pyspark kernel!
Remember, if you are off campus you should log in to the VPN and then you can access our JupyterHub.
Notes
Use the table of contents on the left or the arrows at the bottom of this page to navigate to the next learning material!