Best Ways to Build & Manage Airflow DAGs with Astro SDK and Astro Cloud
Sponsored by Astronomer.io and hosted by Improving MN (1515 Central Ave NE #100, Minneapolis, MN 55413).
Come join us at the next Twin Cities Data Engineering Meetup where Astronomer, the commercial developer and steward of the OSS Apache Airflow and OpenLineage projects, aims to democratize modern data orchestration for the data practitioner, from individual developers to enterprise-wide platform owners.
Remote option may be available and will be sent to attendees before event.
6:15 PM => Food (provided), networking
7:00 PM => Announcements / Who’s Hiring?
7:05 PM => Main presentation
8:00 PM => Networking
Authoring DAGS has come a long way from the days of Airflow 1 with the introduction of the TaskFlow API in Airflow 2.0, new types of Operators and the release of the Astro SDK. We’ll demonstrate the evolution of an Airflow data pipeline orchestrating a Snowflake DWH from traditional DAG writing practices to incorporate newer Airflow features that simplify DAG authoring and enable repeatable patterns. For those new to Airflow, we’ll also build the same pipeline using the Astro Cloud IDE, which incorporates the design and testing of SQL/Python business logic into the DAG creation process without all the Airflow scaffolding.
SPEAKER BIO (COMING SOON)