Low Code Airflow

Monitor Schedules

After you have deployed some schedules, you can monitor it right from Prophecy. You need to switch to the deployment management screen.

Since schedules are deployed on fabrics, the monitoring is done on a fabric level. We provide a top level fabric dropdown on the right side, which can be used for monitoring deployed schedules on other fabrics.

All Deployments

This tab shows all the deployed schedules for the selected fabric.

Here you can pause/unpause the schedule by clicking on the Enabled toggle.

You can click on the Airflow icon to open the DAG in airflow UI.

All Dag-Runs

The execution time in Airflow is not the actual run time, but rather the start timestamp of its schedule period. For example, the execution time of the first DAG run is 2021-05-17 00:00, but it actually starts on 2021-05-18 00:00.

Airflow is built with an ETL mindset where you process the data belonging to a day at the end of that day. As an example if you have a job which summarizes the logs/events of the day into a single dataset, you can do that only after you stop getting the logs/events of that day, which happens when one interval has passed after the execution date.

You can see logs of a run by clicking on a run id (last column in the picture above)