Rephonic
Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Astronomer
Airflow
Apache Airflow
Data Engineering
Machine Learning
Kubernetes
Dataops
DBT
Astronomer
Data Pipelines
Data Analytics
Big Data
Airflow 3
Data Quality
Snowflake
Medallion Architecture
Data Governance
Texas Rangers
Airflow 3.0
Large Language Models
Data Processing

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-... more

PublishesWeeklyEpisodes96Founded8 years ago
Number of ListenersCategory
Technology

Listen to this Podcast

Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Latest Episodes

Aviation data pipelines run on strict 28-day publication cycles, and the margin for error is zero. In this episode, we're joined by Samantha Blaney Cuevas, Software Engineer at Jeppesen ForeFlight, to explore how her team orchestrates a complex, time... more

YouTube

We introduce Airflow 3.2 and its updates for teams that build and operate data pipelines.

Astronomer’s Head of Customer Education, Marc Lamberti, and Senior Manager of Developer Relations, Kenten Danas, break down what’s new, from asset partitioning... more

YouTube

Lessons from the past decade of data engineering reveal how much the ecosystem has changed and what has stayed surprisingly consistent.

In this episode, Benjamin Rogojan, Owner and Data Consultant at Seattle Data Guy, joins us to reflect on how the ... more

YouTube

Data quality is not optional when you manage credit data at scale.

In this episode, Ashir Alam, Senior Data Engineer at Credit Karma, joins us to share how his team acts as the gatekeeper for credit data ingestion, how they standardize data quality ... more

YouTube

Key Facts

Accepts Guests
Accepts Sponsors
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

The Reasoning Show
The Reasoning ShowMassive Studios
Big Technology Podcast
Big Technology PodcastAlex Kantrowitz
Talk Python To Me
Talk Python To MeMichael Kennedy
Radiolab
RadiolabWNYC Studios

Recent Guests

Samantha Blaney Cuevas
Software engineer at Jeppesen ForeFlight
Jeppesen ForeFlight
Episode: Building AI Debugging Agents Into Airflow DAGs at Jeppesen ForeFlight with Samantha Blaney Cuevas
Ben Rogojan
Data consultant and owner of Seattle Data Guy
Seattle Data Guy
Episode: Reflections on a Decade of Data Engineering at Seattle Data Guy
Ashir Alam
Senior Data Engineer at Credit Karma
Credit Karma
Episode: Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Christos Bisias
Open-source software engineer at G-Research
G-Research
Episode: Open Source Airflow Contributions and Performance Improvements at G-Research with Christos Bisias
Karan Alang
Principal Software Engineer at Versa Networks
Versa Networks
Episode: Automating Threat Intelligence Using Airflow with Karan Alang
Egor Tarasenko
Data and AI Engineer at Ponder Labs
Ponder Labs
Episode: Using Plugins To Customize Airflow at Ponder Labs with Egor Tarasenko
Ethan Shalev
Data Engineer at Wix
Wix
Episode: Scaling Airflow at Wix for Analytics and AI with Ethan Shalev
Jaime Oliveira
Lead Data Engineer at Uphold
Uphold
Episode: Uphold’s Approach to Orchestrating Modern Data Workflows with Jaime Oliveira
Han Zhang
Senior Software Engineer at Conviva
Conviva
Episode: Inside Conviva’s Decision To Power Its Data Platform With Airflow with Han Zhang

Host

Kenton Danis
Co-host and primary presenter focused on Airflow strategy, architecture, and ecosystem trends.

Reviews

4.9 out of 5 stars from 41 ratings
  • Great way to learn about what data teams are doing in 2024

    [disclaimer: review from former podcast host that has since been replaced by much better voices!]

    If you’re wondering why a data platform and team is important to everyone - from the World Series champion Texas Rangers to worldwide casinos like Wynn to financial services companies - look no further. The techniques

    Apple Podcasts
    5
    Pqdthorne
    United States2 years ago
  • Amazing!

    Loved the show, it helped me wrap my head around most of Airflow’s concepts and how to use different constructs correctly.

    The people invited were top quality and very involved in Airflow development and usage.

    Apple Podcasts
    5
    JeanPieroHM
    Germany7 years ago
  • Helped me a lot as I began exploring Airflow

    I had kept hearing folks talk about airflow, and stumbled across the astronomer podcast as I began trying to learn more. I’ve been quite impressed so far, and am hoping to add airflow to my toolkit

    Apple Podcasts
    5
    ascloyd
    United States7 years ago
  • Use cases

    Very helpful to hear how industry leaders are using Airflow!

    Apple Podcasts
    5
    Wrecklessshiv
    United States8 years ago
  • Great primer for Data Engineering

    If you're new to the field and want to learn techniques, tools, and best practices, this is a great place to start.

    Apple Podcasts
    5
    Appmagnet
    United States8 years ago

Listeners Say

Key themes from listener reviews, highlighting what works and what could be improved about the show.

Great for learning how industry leaders apply Airflow in real-world setups.
Strong, practical deep dives into Airflow and data pipelines.
Clear, beginner-friendly primers for new listeners too.
High-quality guests with hands-on experience and pragmatic insights.

Chart Rankings

How this podcast ranks in the Apple Podcasts, Spotify and YouTube charts.

Apple Podcasts
#203
Sweden/Technology
Apple Podcasts
#249
Israel/Technology

Talking Points

Recent interactions between the hosts and their guests.

Reflections on a Decade of Data Engineering at Seattle Data Guy
Q: When do you typically recommend Airflow as the orchestrator for a company?
Airflow is most suitable when workflows become more complex and there are multiple teams that need to build, manage, and maintain pipelines. In earlier, smaller setups, the overhead may not be justified.
Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Q: What are some pain points or improvements you'd like to see in DAG Factory or Airflow?
Improvements around error visibility and YAML validation to catch issues early, plus better handling for thousands of DAGs to reduce scheduling and propagation risks as the system scales.
Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Q: Why did you choose Airflow over other tools for managing data quality?
Airflow offered easy adoption due to Python syntax, the ability to handle both ETL and quality checks in one pipeline, and the flexibility to extend with custom operators, which fit well with our need to enforce data quality before downstream usage.
Managing Data Quality and Governance With Airflow at Credit Karma with Ashir Alam
Q: Where does Airflow fit in to your tech stack and everything your team does?
Airflow serves as the central orchestrator for ETL pipelines, coordinating data ingestion into BigQuery, applying transformations, and enforcing data quality checks before data is released downstream. It replaces ad-hoc scripting with a unified, auditable workflow layer.
Open Source Airflow Contributions and Performance Improvements at G-Research with Christos Bisias
Q: What future directions or improvements are you hoping to see from Airflow?
Interest in a language-agnostic Task SDK, potential for DAG and task execution separation, and broader integration possibilities, including the idea of using the SDK in other projects, with Python not being a hard requirement.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About This Podcast

What is This Podcast about and what kind of topics does it cover?

The show centers on practical Apache Airflow implementations at scale, featuring engineers and data leaders who share real-world experiences building, running, and evolving data pipelines. Episodes cover plugin development, UI-code synchronization, migrating to Airflow 3, and scaling to thousands of DAGs across teams and regions, often with a focus on governance, observability, and cost-conscious optimizations. Notable threads include event-driven scheduling, AI-assisted tooling in workflows, and integrating Airflow with dbt, clouds, and data platforms in fintech, media, retail, and healthcare. The format tends to pair deep technical dives with scalable patterns, making it a strong resource for practitioners (and sponsors) aiming to reach d... more

Where can I find podcast stats for this podcast?

Rephonic provides a wide range of podcast stats for this podcast. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to this podcast and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does this podcast get?

Rephonic provides a full set of podcast information for three million podcasts, including the number of listeners. View further listenership figures for this podcast, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for this podcast?

Rephonic provides comprehensive predictive audience data for this podcast, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does this podcast have?

To see how many followers or subscribers this podcast has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to this podcast?

These podcasts share a similar audience with this podcast:

1. The Reasoning Show
2. Big Technology Podcast
3. Talk Python To Me
4. The Real Python Podcast
5. Radiolab

How many episodes of this podcast are there?

this podcast launched 8 years ago and published 96 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact this podcast?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for this podcast?

Rephonic pulls ratings and reviews for this podcast from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for this podcast?

Rephonic provides full transcripts for episodes of this podcast. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on this podcast?

Recent guests on this podcast include:

1. Samantha Blaney Cuevas
2. Ben Rogojan
3. Ashir Alam
4. Christos Bisias
5. Karan Alang
6. Egor Tarasenko
7. Ethan Shalev
8. Jaime Oliveira

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days