DataTool
Large-scale processing with Spark
Processing data that doesn't fit on one machine, with DataFrames that look a lot like pandas.
About 20 hours of study.
Where to learn it
Read
Spark quick start
Apache Software Foundation
Quick start, then the SQL and DataFrames guide
Section not checked yet
Watch
Practise
No practice set picked yet.
Suggest oneWrong chapter, dead link, or know something better? Tell us on GitHub.
Which roles ask for it
- Data engineer to get hired
- Machine learning engineer good to have
- MLOps engineer good to have
- Analytics engineer good to have
- Data scientist good to have
Before and after
Learn first
Large-scale processing with Spark
Opens up
Nothing else on the map yet.