18
Why can’t I pass context between tasks in Airflow/Dagster?
Post Flair (click to view more posts with a particular flair)
Post Body
The biggest blockade to me learning an orchestration framework is the aversion that they have to “statefulness.”
I’m not asking HOW do pass “state” between tasks (I know that it’s XComs in Airflow and IOManagers in Dagster), but WHY does it force us to do it in a roundabout way?
Most everything that I’ve ever coded has been written in a pretty stateful, object-oriented manner, so switching to this roundabout, functional approach has been difficult to grasp. What’s the intuition behind this design pattern?
Author
Account Strength
100%
Account Age
7 years
Verified Email
Yes
Verified Flair
No
Total Karma
42,675
Link Karma
23,655
Comment Karma
18,693
Profile updated: 2 days ago
Posts updated: 6 months ago
Subreddit
Post Details
We try to extract some basic information from the post title. This is not
always successful or accurate, please use your best judgement and compare
these values to the post title and body for confirmation.
- Posted
- 9 months ago
- Reddit URL
- View post on reddit.com
- External URL
- reddit.com/r/dataenginee...