Rephonic
Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Astronomer
Airflow
Apache Airflow
Data Engineering
Machine Learning
Astronomer
DBT
Airflow 3
Kubernetes
Dataops
Data Pipelines
Artificial Intelligence
Snowflake
Data Analytics
Big Data
Data Quality
Medallion Architecture
Data Governance
Texas Rangers
Airflow 3.0
Large Language Models

Welcome to The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI— the podcast where we keep you up to date with insights and ideas propelling the Airflow community forward. Join us each week, as we explore the current state, future and potential of Airflow with leading thinkers in the community, and discover how best to leverage this workflow management system to meet the ever-... more

PublishesWeeklyEpisodes121Founded9 years ago
Number of ListenersCategory
Technology

Listen to this Podcast

Artwork for The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI

Latest Episodes

At Lyft, a small data engineering team supports dozens of scientists and analysts who tune driver pay configurations on demand, all under SOX controls. In this episode, Ken Obata, Senior Software Engineer at Lyft, joins Kenten Danas to walk through h... more

YouTube

Running Airflow with a one-person data engineering team means every decision about cost, tooling, and best practices has to earn its keep. In this episode, Kenten sits down with Aniruddha Sengupta, Staff Data Engineer at Insignis, to talk through how... more

YouTube

Scaling Airflow to over 1,000 active DAGs on a team of 3-4 engineers takes structure. In this episode, Kenten Danas talks with Matt Stavinga, Data Engineer at Idelic (now part of Descartes), about how his team standardized DAG creation and logging, b... more

YouTube

Running LLMs over sensitive data means external APIs are off the table, but open-weight models still need reproducibility, validation, and a paper trail before downstream systems can depend on their output. In this episode, Kenten is joined by Chhaya... more

YouTube

Key Facts

Accepts Guests
Accepts Sponsors
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

Talk Python To Me
Talk Python To MeMichael Kennedy
The a16z Show
The a16z ShowAndreessen Horowitz
Darknet Diaries
Darknet DiariesJack Rhysider

Recent Guests

Aniruddha Sengupta
Staff Data Engineer at Insignis
Insignis
Episode: Orchestrating cost-efficient data pipelines at Insignis
Matt Stavinga
Data engineer at Idelic
Idelic (part of Descartes)
Episode: Scaling to 1,000+ Airflow Dags at Descartes / Idelic
Chayank Jain
Senior ML Engineer at Visa
Visa
Episode: Orchestrating local LLMs for sensitive data with Airflow
Anish Giri
Senior software engineer and active contributor to Apache Airflow focused on security
Apache Airflow community / Astronomer
Episode: Improving security in Airflow 3
Lucas Trubiano
Data engineer at ITTI, part of Grupo Vázquez
ITTI / Grupo Vázquez
Episode: Orchestrating data across 30 companies at itti
Kumuda Sreenivasa
Senior Data Architect at ATC Drivetrain
ATC Drivetrain
Episode: Building self-healing Airflow pipelines at ATC Drivetrain
Ivana Isailovic
Senior Big Data Engineer at Synechron
Synechron
Episode: Orchestrating strictly sequential ETL pipelines at Synechron
Antonello Benedetto
Staff Analytics Engineer at Wise
Wise
Episode: Managing financial datasets with Airflow at Wise
Meni Shmili
Co-founder and CEO at DataFlint
DataFlint
Episode: How Airflow orchestration decisions impact Spark performance

Host

Kenton Danis
Host of The Data Flowcast; active across episodes focusing on Airflow, data engineering, and related tooling

Reviews

4.9 out of 5 stars from 43 ratings
  • Great way to learn about what data teams are doing in 2024

    [disclaimer: review from former podcast host that has since been replaced by much better voices!]

    If you’re wondering why a data platform and team is important to everyone - from the World Series champion Texas Rangers to worldwide casinos like Wynn to financial services companies - look no further. The techniques

    Apple Podcasts
    5
    Pqdthorne
    United States2 years ago
  • Amazing!

    Loved the show, it helped me wrap my head around most of Airflow’s concepts and how to use different constructs correctly.

    The people invited were top quality and very involved in Airflow development and usage.

    Apple Podcasts
    5
    JeanPieroHM
    Germany7 years ago
  • Helped me a lot as I began exploring Airflow

    I had kept hearing folks talk about airflow, and stumbled across the astronomer podcast as I began trying to learn more. I’ve been quite impressed so far, and am hoping to add airflow to my toolkit

    Apple Podcasts
    5
    ascloyd
    United States8 years ago
  • Use cases

    Very helpful to hear how industry leaders are using Airflow!

    Apple Podcasts
    5
    Wrecklessshiv
    United States8 years ago
  • Great primer for Data Engineering

    If you're new to the field and want to learn techniques, tools, and best practices, this is a great place to start.

    Apple Podcasts
    5
    Appmagnet
    United States9 years ago

Listeners Say

Key themes from listener reviews, highlighting what works and what could be improved about the show.

Guests are described as high-quality and deeply involved in Airflow development and usage.
The show is viewed as a strong primer and a practical resource for data engineers exploring Airflow and AI workflows.
Listeners praise accessible, practitioner-focused content that clearly translates Airflow concepts into production practice.

Chart Rankings

How this podcast ranks in the Apple Podcasts, Spotify and YouTube charts.

Apple Podcasts
#110
Russia/Technology

Talking Points

Recent interactions between the hosts and their guests.

Orchestrating cost-efficient data pipelines at Insignis
Q: I'm curious, what sort of use cases are you looking at implementing there?
He describes using AI and MLOps to identify patterns in client money movements and improve customer journeys, and sees potential for AI-assisted diagnosis and self-healing pipelines.
Orchestrating cost-efficient data pipelines at Insignis
Q: Tell me about how you have gone about implementing this, maybe anything else about the importance of doing it, and I guess what advice you would give to other small teams who are trying to use Airflow, but need to be very conscious of cost and things like that, regardless of where or how they're running it.
Sengupta recommends making independent observability part of the definition of done, automating time-consuming work, and using managed Airflow to reduce the operational burden on a small team.
Orchestrating local LLMs for sensitive data with Airflow
Q: Tell me about yourself and how you got into ML engineering and what you do with Airflow and data pipelines.
Chayank describes his path from NLP in pharma to risk modeling and finally to building end-to-end ML pipelines, highlighting that while modeling sparked his interest, the pipeline and orchestration work—especially with Airflow—felt like the turning point that tied everything together.
Orchestrating data across 30 companies at itti
Q: How does ITTI expose Airflow to non-technical users and ensure governance?
ITTI uses Airflow as a service for infrastructure management and provides a custom YAML-based framework that allows non-technical users to configure DAGs. A CI/CD pipeline converts YAML configurations into functional DAGs, with guardrails and validation to reduce misconfigurations and maintain reliability.
Orchestrating data across 30 companies at itti
Q: Tell me about ITTI and, more broadly, Grupo Vázquez.
Lucas describes ITTI as the technology arm within Grupo Vázquez, a large Paraguayan holding with over 30 companies spanning financial and digital ecosystems. ITTI leads data engineering with the goal of a 360-degree customer view, exploring streaming analytics and unstructured data, while standardizing and scaling solutions across the organization.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About This Podcast

What is This Podcast about and what kind of topics does it cover?

The show centers on practical, real-world use of Apache Airflow in data engineering and AI contexts, with episodes ranging from migrations of legacy schedulers to large-scale enterprise data platforms, to building AI-powered workflows and governance around data assets. Guests and topics frequently emphasize orchestration strategies, observability, security, and cost management, often highlighting how managed services and integrations (e.g., Astronomer/Astro, DBT, Cosmos) enable scalable, production-ready pipelines. A standout trait is the heavy focus on concrete, actionable patterns—like DAG design, event-driven scheduling, and AI-enabled tooling—while maintaining a strong sense of community through community-driven updates and open-source ... more

Where can I find podcast stats for this podcast?

Rephonic provides a wide range of podcast stats for this podcast. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to this podcast and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does this podcast get?

Rephonic provides a full set of podcast information for four million podcasts, including the number of listeners. View further listenership figures for this podcast, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for this podcast?

Rephonic provides comprehensive predictive audience data for this podcast, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does this podcast have?

To see how many followers or subscribers this podcast has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to this podcast?

These podcasts share a similar audience with this podcast:

1. Talk Python To Me
2. The a16z Show
3. The Real Python Podcast
4. The Pragmatic Engineer
5. Darknet Diaries

How many episodes of this podcast are there?

this podcast launched 9 years ago and published 121 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact this podcast?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for this podcast?

Rephonic pulls ratings and reviews for this podcast from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for this podcast?

Rephonic provides full transcripts for episodes of this podcast. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on this podcast?

Recent guests on this podcast include:

1. Aniruddha Sengupta
2. Matt Stavinga
3. Chayank Jain
4. Anish Giri
5. Lucas Trubiano
6. Kumuda Sreenivasa
7. Ivana Isailovic
8. Antonello Benedetto

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days