How to Save Money using Airflow’s asynchronous Azure operators

Recorded On February 21, 2023

Kenten Danas Senior Manager, Developer Relations Astronomer
Viraj Parekh Co-Founder, VP of Sales Engineering Astronomer

This “Live with Astronomer” session shows how to implement the asynchronous Azure operators from the Astronomer Providers package to orchestrate a pipeline with long-running Azure Databricks and Azure Data Factory jobs. Using asynchronous Azure operators brings cost savings and better scalability when compared to traditional operators.

Questions covered in this session include:

What is the Astronomer Providers package and how do I install it?
How can I implement asynchronous operators in my existing DAGs?
How do asynchronous operators help when orchestrating Azure Databricks and Azure Data Factory tasks?

Learn more about the Astronomer Providers and asynchronous Azure operators and access example DAGs on the Astronomer Registry.