Rephonic
Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Astronomer
Airflow
Apache Airflow
Data Engineering
Machine Learning
Astronomer
DBT
Kubernetes
Dataops
Data Pipelines
Data Analytics
Artificial Intelligence
Big Data
Airflow 3
Data Quality
Snowflake
Medallion Architecture
Data Governance
Texas Rangers
Airflow 3.0
Large Language Models

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-... more

PublishesWeeklyEpisodes100Founded8 years ago
Number of ListenersCategory
Technology

Listen to this Podcast

Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Latest Episodes

In this episode, we take a step back from implementation-specific topics to explore what it actually takes to build a career in data engineering — and how AI is reshaping that path.

Shrividya Hegde,  a data and AI engineer and an Airflow champion in... more

YouTube

We explore how a third-party logistics platform built its entire data orchestration layer on Airflow, and what that makes possible for developer teams and merchant-facing products alike.

Filip Kunčar, Platform Director at ShipMonk Product Developmen... more

YouTube

Buğra Öztürk, Senior Data Engineer at Mollie and Committer and PMC member on the Apache Airflow project, joins us to walk through Airflow CTL — what it is, how it differs from the existing Airflow CLI and where it is headed under AIP-94.

Key Takeawa... more

YouTube

In this episode, we explore the newly released Apache Airflow common AI provider — what problem it solves, how it was built and what's coming next.

Kaxil Naik, Senior Director of Engineering at Astronomer and Apache Airflow PMC member, and Pavan Kum... more

YouTube

Key Facts

Accepts Guests
Accepts Sponsors
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

Talk Python To Me
Talk Python To MeMichael Kennedy
The Enterprise AI Show
The Enterprise AI ShowMassive Studios
Hard Fork
Hard ForkThe New York Times
Practical AI
Practical AIPractical AI LLC

Recent Guests

Shri Hegde
Data and AI engineer and Airflow champion
Astronomer Champions program
Episode: Getting Into Data Engineering with Shrividya Hegde, Data and AI Engineer
Filip Kunčar
Platform Director at ShipMonk
ShipMonk
Episode: Orchestrating DBT With Cosmos and Airflow with Filip Kunčar at ShipMonk Product Development
Buğra Öztürk
Senior Data Engineer at Mollie, Committer and PMC member on the Apache Airflow project
Mollie
Episode: Building Airflow CTL with Buğra Öztürk at Mollie
Kaxil Naik
PMC member for Apache Airflow; Senior Director of Engineering at Astronomer
Astronomer
Episode: Introducing Airflow’s Common AI Provider with Pavan Kumar Gopidesu and Kaxil Naik
Pavan Gopidesu
Lead Data Engineer at Experian; PMC member for Apache Airflow
Experian
Episode: Introducing Airflow’s Common AI Provider with Pavan Kumar Gopidesu and Kaxil Naik
Samantha Blaney Cuevas
Software engineer at Jeppesen ForeFlight
Jeppesen ForeFlight
Episode: Building AI Debugging Agents Into Airflow DAGs at Jeppesen ForeFlight with Samantha Blaney Cuevas
Ben Rogojan
Data consultant and owner of Seattle Data Guy
Seattle Data Guy
Episode: Reflections on a Decade of Data Engineering at Seattle Data Guy
Ashir Alam
Senior Data Engineer at Credit Karma
Credit Karma
Episode: Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Christos Bisias
Open-source software engineer at G-Research
G-Research
Episode: Open Source Airflow Contributions and Performance Improvements at G-Research with Christos Bisias

Host

Kenton Danis
Co-host and primary presenter focused on Airflow strategy, architecture, and ecosystem trends.

Reviews

4.9 out of 5 stars from 41 ratings
  • Great way to learn about what data teams are doing in 2024

    [disclaimer: review from former podcast host that has since been replaced by much better voices!]

    If you’re wondering why a data platform and team is important to everyone - from the World Series champion Texas Rangers to worldwide casinos like Wynn to financial services companies - look no further. The techniques

    Apple Podcasts
    5
    Pqdthorne
    United States2 years ago
  • Amazing!

    Loved the show, it helped me wrap my head around most of Airflow’s concepts and how to use different constructs correctly.

    The people invited were top quality and very involved in Airflow development and usage.

    Apple Podcasts
    5
    JeanPieroHM
    Germany7 years ago
  • Helped me a lot as I began exploring Airflow

    I had kept hearing folks talk about airflow, and stumbled across the astronomer podcast as I began trying to learn more. I’ve been quite impressed so far, and am hoping to add airflow to my toolkit

    Apple Podcasts
    5
    ascloyd
    United States8 years ago
  • Use cases

    Very helpful to hear how industry leaders are using Airflow!

    Apple Podcasts
    5
    Wrecklessshiv
    United States8 years ago
  • Great primer for Data Engineering

    If you're new to the field and want to learn techniques, tools, and best practices, this is a great place to start.

    Apple Podcasts
    5
    Appmagnet
    United States8 years ago

Listeners Say

Key themes from listener reviews, highlighting what works and what could be improved about the show.

Great for learning how industry leaders apply Airflow in real-world setups.
Strong, practical deep dives into Airflow and data pipelines.
Clear, beginner-friendly primers for new listeners too.
High-quality guests with hands-on experience and pragmatic insights.

Chart Rankings

How this podcast ranks in the Apple Podcasts, Spotify and YouTube charts.

Apple Podcasts
#66
New Zealand/Technology

Talking Points

Recent interactions between the hosts and their guests.

Reflections on a Decade of Data Engineering at Seattle Data Guy
Q: When do you typically recommend Airflow as the orchestrator for a company?
Airflow is most suitable when workflows become more complex and there are multiple teams that need to build, manage, and maintain pipelines. In earlier, smaller setups, the overhead may not be justified.
Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Q: What are some pain points or improvements you'd like to see in DAG Factory or Airflow?
Improvements around error visibility and YAML validation to catch issues early, plus better handling for thousands of DAGs to reduce scheduling and propagation risks as the system scales.
Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Q: Why did you choose Airflow over other tools for managing data quality?
Airflow offered easy adoption due to Python syntax, the ability to handle both ETL and quality checks in one pipeline, and the flexibility to extend with custom operators, which fit well with our need to enforce data quality before downstream usage.
Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Q: Where does Airflow fit in to your tech stack and everything your team does?
Airflow serves as the central orchestrator for ETL pipelines, coordinating data ingestion into BigQuery, applying transformations, and enforcing data quality checks before data is released downstream. It replaces ad-hoc scripting with a unified, auditable workflow layer.
Open Source Airflow Contributions and Performance Improvements at G-Research with Christos Bisias
Q: What future directions or improvements are you hoping to see from Airflow?
Interest in a language-agnostic Task SDK, potential for DAG and task execution separation, and broader integration possibilities, including the idea of using the SDK in other projects, with Python not being a hard requirement.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About This Podcast

What is This Podcast about and what kind of topics does it cover?

The show centers on practical Apache Airflow implementations at scale, featuring engineers and data leaders who share real-world experiences building, running, and evolving data pipelines. Episodes cover plugin development, UI-code synchronization, migrating to Airflow 3, and scaling to thousands of DAGs across teams and regions, often with a focus on governance, observability, and cost-conscious optimizations. Notable threads include event-driven scheduling, AI-assisted tooling in workflows, and integrating Airflow with dbt, clouds, and data platforms in fintech, media, retail, and healthcare. The format tends to pair deep technical dives with scalable patterns, making it a strong resource for practitioners (and sponsors) aiming to reach d... more

Where can I find podcast stats for this podcast?

Rephonic provides a wide range of podcast stats for this podcast. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to this podcast and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does this podcast get?

Rephonic provides a full set of podcast information for three million podcasts, including the number of listeners. View further listenership figures for this podcast, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for this podcast?

Rephonic provides comprehensive predictive audience data for this podcast, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does this podcast have?

To see how many followers or subscribers this podcast has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to this podcast?

These podcasts share a similar audience with this podcast:

1. Talk Python To Me
2. The Enterprise AI Show
3. Hard Fork
4. The AI Daily Brief: Artificial Intelligence News and Analysis
5. Practical AI

How many episodes of this podcast are there?

this podcast launched 8 years ago and published 100 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact this podcast?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for this podcast?

Rephonic pulls ratings and reviews for this podcast from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for this podcast?

Rephonic provides full transcripts for episodes of this podcast. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on this podcast?

Recent guests on this podcast include:

1. Shri Hegde
2. Filip Kunčar
3. Buğra Öztürk
4. Kaxil Naik
5. Pavan Gopidesu
6. Samantha Blaney Cuevas
7. Ben Rogojan
8. Ashir Alam

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days