Low Code Airflow


A branch component lets you select the next component based on any logic in python code. This can be used for defining a pipeline based on the fabric for example. You might say that if it’s the prod fabric, then run a heavy component, but if it’s a test/dev fabric, then run a dummy component. Although if you do that, you need to be careful with trigger_rule for when you join the branches. The default trigger rule all_success won’t work, because if you fork into one of the branches and then at the joining node all upstream branches won’t have run. one_success or none_failed would work better for the joining node.