Tools / Spreadsheets, BI and data engineering
Pipelines and scheduling
Running data jobs in the right order, on a schedule, with retries when they fail.
About 10 hours of study. It builds on Programming in Python.
Where to learn it
Apache Software Foundation
Fundamental concepts, then Working with TaskFlow
Section not checked yet
No practice set picked yet.
Suggest oneWrong chapter, dead link, or know something better? Tell us on GitHub.
Your route to Pipelines and scheduling
Pick where you’re starting from. Anything your background already covers is left out, and the rest is put in order.
2 stops to go, about 50 hours of study.
Open a stop to see the book, the video course and the practice for it. Tick its circle when you've finished.
- 40 h
Programming. Ready to start.
- Tool10 h
Data. After Programming in Python.
That's the whole route to Pipelines and scheduling.
Which roles ask for it
- Data engineer in the first year
- MLOps engineer in the first year
- Analytics engineer in the first year
What it needs and what it leads to: Pipelines and scheduling on the map.