Rephonic
Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Astronomer
Airflow
Data Engineering
Apache Airflow
Machine Learning
Big Data
Data Analytics
Texas Rangers
AI and Machine Learning
Baseball Performance Metrics
Data Quality
Data Processing
Large Language Models
Defensive Positioning
Player Biomechanics
Generative AI
DBT
Dataops
Wynn Las Vegas
Vibrant Planet
AI Automation

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-... more

PublishesWeeklyEpisodes91Founded8 years ago
Number of ListenersCategory
Technology

Listen to this Podcast

Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Latest Episodes

In this episode, Karan Alang, Principal Software Engineer at Versa Networks, joins the conversation to discuss how Airflow can be used to automate threat intelligence in modern cybersecurity environments. He explains the growing scale of cloud comput... more

YouTube

In this episode, we explore how teams scale Apache Airflow in complex environments and what it takes to make orchestration work across many stakeholders. We look at real-world challenges around visibility, ownership and predictability as data platfor... more

YouTube

Modern data orchestration at scale demands reliability, speed and thoughtful adoption of new tooling. As organizations grow, keeping pipelines efficient while supporting more teams becomes a critical challenge.

In this episode, we’re joined by Ethan... more

YouTube

Strong data orchestration is as much about culture and visibility as it is about technology. As data platforms scale, teams need systems that reduce cognitive load while increasing reliability and observability.

In this episode, Carlos Daniel Puerto... more

YouTube

Key Facts

Accepts Guests
Accepts Sponsors
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

Software Engineering Daily
Software Engineering DailySoftware Engineering Daily

Recent Guests

Egor Tarasenko
Data and AI Engineer at Ponder Labs
Ponder Labs
Episode: Using Plugins To Customize Airflow at Ponder Labs with Egor Tarasenko
Ethan Shalev
Data Engineer at Wix
Wix
Episode: Scaling Airflow at Wix for Analytics and AI with Ethan Shalev
Jaime Oliveira
Lead Data Engineer at Uphold
Uphold
Episode: Uphold’s Approach to Orchestrating Modern Data Workflows with Jaime Oliveira
Han Zhang
Senior Software Engineer at Conviva
Conviva
Episode: Inside Conviva’s Decision To Power Its Data Platform With Airflow with Han Zhang
András Gombosi
Lead for Data Infrastructure and Analytics Engineering at Intercom, expert in data solutions
Intercom
Episode: Scaling Airflow to 11,000 DAGs Across Three Regions at Intercom with András Gombosi and Paul Vickers
Paul Vickers
Lead for Data Infrastructure and Analytics Engineering at Intercom, focused on Airflow deployment
Intercom
Episode: Scaling Airflow to 11,000 DAGs Across Three Regions at Intercom with András Gombosi and Paul Vickers
Anja Mackenzie
Expert for Chemical Informatics at Covestro
Covestro
Episode: How Covestro Turns Airflow Into a Simulation Toolbox with Anja Mackenzie
Shankar Mahindar
Senior Data Engineer at Redica
Redica
Episode: How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar
Naseem Shah
Head of engineering at Xena Intelligence
Xena Intelligence
Episode: Transforming Data Pipelines at XENA Intelligence with Naseem Shah

Host

Kenton Danis
Co-host and primary presenter focused on Airflow strategy, architecture, and ecosystem trends.

Reviews

4.9 out of 5 stars from 41 ratings
  • Great way to learn about what data teams are doing in 2024

    [disclaimer: review from former podcast host that has since been replaced by much better voices!]

    If you’re wondering why a data platform and team is important to everyone - from the World Series champion Texas Rangers to worldwide casinos like Wynn to financial services companies - look no further. The techniques

    Apple Podcasts
    5
    Pqdthorne
    United States2 years ago
  • Amazing!

    Loved the show, it helped me wrap my head around most of Airflow’s concepts and how to use different constructs correctly.

    The people invited were top quality and very involved in Airflow development and usage.

    Apple Podcasts
    5
    JeanPieroHM
    Germany6 years ago
  • Helped me a lot as I began exploring Airflow

    I had kept hearing folks talk about airflow, and stumbled across the astronomer podcast as I began trying to learn more. I’ve been quite impressed so far, and am hoping to add airflow to my toolkit

    Apple Podcasts
    5
    ascloyd
    United States7 years ago
  • Use cases

    Very helpful to hear how industry leaders are using Airflow!

    Apple Podcasts
    5
    Wrecklessshiv
    United States8 years ago
  • Great primer for Data Engineering

    If you're new to the field and want to learn techniques, tools, and best practices, this is a great place to start.

    Apple Podcasts
    5
    Appmagnet
    United States8 years ago

Listeners Say

Key themes from listener reviews, highlighting what works and what could be improved about the show.

Great for learning how industry leaders apply Airflow in real-world setups.
Strong, practical deep dives into Airflow and data pipelines.
Clear, beginner-friendly primers for new listeners too.
High-quality guests with hands-on experience and pragmatic insights.

Top Technology Podcasts

Acquired
AcquiredBen Gilbert and David Rosenthal
Tomorrow, Today
Tomorrow, TodayShekhar Natarajan
Technology Now
Technology NowHewlett Packard Enterprise
Hard Fork
Hard ForkThe New York Times
Building AI Boston
Building AI BostonBuilding AI Boston
Dwarkesh Podcast
Dwarkesh PodcastDwarkesh Patel

Talking Points

Recent interactions between the hosts and their guests.

Using Plugins To Customize Airflow at Ponder Labs with Egor Tarasenko
Q: Tell us about the plugins you've built and what they do.
We built Schedule Insights to map, visualize, and predict the next run times of DAGs across both scheduled and event-triggered scenarios, and Airflow Chat to let project managers query the system via a UI, understand who owns what, and inspect cross-DAG dependencies. We also created UI-based permissions management for data warehouses and tooling to manage different ECS task definitions across environments, all aimed at reducing operational friction for multi-client deployments.
Scaling Airflow at Wix for Analytics and AI with Ethan Shalev
Q: What would you most like to see from the Airflow project in the near future?
Shalev mentions the need for focus on multi-tenancy and improving the UI for separate groups to help engineers manage their DAGs more efficiently.
Scaling Airflow at Wix for Analytics and AI with Ethan Shalev
Q: Tell me about the process of migrating from Airflow 2 to Airflow 3 and how it's going.
Shalev explains that it has been a multi-month process that began after Airflow 3 was released, discussing the challenges and achievements along the way, including the management of nearly 8,000 DAGs across three clusters.
Using Airflow To Orchestrate Billions of Events at Addi with Carlos Daniel Puerto Niño
Q: How do you think that airflow helps you manage this complexity more broadly?
Airflow allows us to manage data orchestration and monitor complex tasks effectively amidst the data we process.
Using Airflow To Orchestrate Billions of Events at Addi with Carlos Daniel Puerto Niño
Q: What would you most like to see from the airflow project in the near future?
I would love to have the capability to access the data that airflow produces in a more scalable way.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About This Podcast

What is This Podcast about and what kind of topics does it cover?

The show centers on practical Apache Airflow implementations at scale, featuring engineers and data leaders who share real-world experiences building, running, and evolving data pipelines. Episodes cover plugin development, UI-code synchronization, migrating to Airflow 3, and scaling to thousands of DAGs across teams and regions, often with a focus on governance, observability, and cost-conscious optimizations. Notable threads include event-driven scheduling, AI-assisted tooling in workflows, and integrating Airflow with dbt, clouds, and data platforms in fintech, media, retail, and healthcare. The format tends to pair deep technical dives with scalable patterns, making it a strong resource for practitioners (and sponsors) aiming to reach d... more

Where can I find podcast stats for this podcast?

Rephonic provides a wide range of podcast stats for this podcast. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to this podcast and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does this podcast get?

Rephonic provides a full set of podcast information for three million podcasts, including the number of listeners. View further listenership figures for this podcast, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for this podcast?

Rephonic provides comprehensive predictive audience data for this podcast, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does this podcast have?

To see how many followers or subscribers this podcast has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to this podcast?

These podcasts share a similar audience with this podcast:

1. Data Engineering Podcast
2. The Pragmatic Engineer
3. Software Engineering Daily

How many episodes of this podcast are there?

this podcast launched 8 years ago and published 91 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact this podcast?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for this podcast?

Rephonic pulls ratings and reviews for this podcast from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for this podcast?

Rephonic provides full transcripts for episodes of this podcast. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on this podcast?

Recent guests on this podcast include:

1. Egor Tarasenko
2. Ethan Shalev
3. Jaime Oliveira
4. Han Zhang
5. András Gombosi
6. Paul Vickers
7. Anja Mackenzie
8. Shankar Mahindar

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days