Rephonic
Artwork for The Information Bottleneck

The Information Bottleneck

Ravid Shwartz-Ziv & Allen Roush
Machine Learning
Artificial Intelligence
Openai
Large Language Models
AI Research
Generative AI
Data Curation
Language Models
Reinforcement Learning
Textai
Gpt-5
AI Coding
Joint Embedding Predictive Architectures
Natural Language Processing
Nvidia
Local-First AI
Semantic Search
Artificial General Intelligence
Copyright
Representation Learning

Two AI Researchers - Ravid Shwartz Ziv, and Allen Roush, discuss the latest trends, news, and research within Generative AI, LLMs, GPUs, and Cloud Systems.

PublishesTwice weeklyEpisodes34Founded8 months ago
Number of ListenersCategories
TechnologyScience

Listen to this Podcast

Artwork for The Information Bottleneck

Latest Episodes

We talked with Sasha Rush, researcher at Cursor and professor at Cornell, about what it actually feels like to we in the heart of the AI revolution and build coding agents right now. Sasha shared how these systems are changing day-to-day work and how... more

YouTube

How Denoising Secretly Powers Everything in AI

Peyman Milanfar is a Distinguished Scientist at Google, leading its Computational Imaging team. He's a member of the National Academy of Engineering, an IEEE Fellow, and one of the key people behind the... more

YouTube

In this episode, we sit down with Peyman Milanfar, Distinguished Scientist at Google, where he leads the Computational Imaging team. Peyman is a member of the National Academy of Engineering, an IEEE Fellow, and one of the key minds behind the imagin... more

Yaroslav Bulatov helped build the AI era from the inside, as one of the earliest researchers at both OpenAI and Google Brain. Now he wants to tear it all down and start over. Modern deep learning, he argues, is up to 100x more wasteful than it needs ... more

YouTube

Key Facts

Accepts Guests
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

Recent Guests

Yaroslav Bulatov
AI researcher, early researcher at OpenAI and Google Brain
OpenAI, Google Brain
Episode: Reinventing AI From Scratch with Yaroslav Bulatov
Kyunghyun Cho
Glendy, various professor of health statistics and computer science at New York University
New York University
Episode: Why Healthcare Is AI's Hardest and Most Important Problem with Kyunghyun Cho (NYU)
Stefano Ermon
Professor at Stanford; CEO of Inception AI
Stanford University; Inception AI
Episode: Diffusion LLM & Why the Future of AI Won't Be Autoregressive - Stefano Ermon (Stanford /Inception)
Naomi Saphra
Kempner Research Fellow at Harvard and incoming Assistant Professor at Boston University
Harvard University, Boston University
Episode: Training Is Nothing Like Learning with Naomi Saphra (Harvard)
Stefano Soatto
Professor at UCLA, VP for AI at AWS
University of California, Los Angeles; Amazon Web Services
Episode: EP28: How to Control a Stochastic Agent with Stefano Soatto (VP AWS/ Pro. UCLA)
Tanishq Abraham
CEO and co-founder of Sophont.AI
Sophont.AI
Episode: EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)
Fred Sala
Assistant Professor at UW-Madison and Chief Scientist at Snorkel AI
Snorkel AI
Episode: EP25: Personalization, Data, and the Chaos of Fine-Tuning with Fred Sala (UW-Madison / Snorkel AI)
Bayan Bruss
VP at Applied AI at Capital One
Capital One
Episode: EP24: Can AI Learn to Think About Money? - with Bayan Bruss (Capital One)
David Mezzetti
Founder of TextAI, AI researcher focused on local-first AI and semantic search.
NewML
Episode: EP23: Building Open Source AI Frameworks: David Mezzetti on TxtAI and Local-First AI

Hosts

Ravid Shwartz Ziv
Co-host of The Information Bottleneck; host of The Information Bottleneck Podcast
Allen Roush
Co-host of The Information Bottleneck; host of The Information Bottleneck Podcast

Chart Rankings

How this podcast ranks in the Apple Podcasts, Spotify and YouTube charts.

Apple Podcasts
#211
United Kingdom/Technology
Apple Podcasts
#249
France/Technology
Apple Podcasts
#88
Singapore/Technology
Apple Podcasts
#221
Taiwan/Technology

Talking Points

Recent interactions between the hosts and their guests.

Reinventing AI From Scratch with Yaroslav Bulatov
Q: What is your approach to building better models while addressing energy efficiency and memory constraints?
Start from energy-aware toy tasks, design with a clear energy budget in mind, and progressively scale while measuring energy per unit of useful capability. Consider architecture shifts (like local hierarchical message passing) and embrace open, iterative experimentation rather than chasing a single benchmark.
Reinventing AI From Scratch with Yaroslav Bulatov
Q: Do you think AI coding agents will replace software engineers or researchers, or will they augment human labor?
They will augment, increasing what engineers and researchers can accomplish, but not replace them entirely. The trend is toward integrating agents into workflows to amplify productivity, with humans providing direction, evaluation, and creative problem-solving.
Reinventing AI From Scratch with Yaroslav Bulatov
Q: What is your view on AGI and why is the term so contested today?
AGI is not a single, well-defined target; there are multiple interpretations (a sudden, almost religious milestone; a marketable insurance-like construct; or a subjective feeling of capability). This ambiguity leads to divergent expectations, timelines, and risk-taking by companies and researchers alike.
EP27: Medical Foundation Models - with Tanishq Abraham (Sophont.AI)
Q: What does Sophont specifically do in medical AI?
Sophont builds foundation models tailored for medicine with a emphasis on multimodality, integrating neuroimaging, pathology, and clinical text, and plans to merge domain encoders into a single, unified model to aid clinical decision-making.
EP26: Measuring Intelligence in the Wild - Arena and the Future of AI Evaluation
Q: What does Arena do and why is it needed?
Arena focuses on measuring AI intelligence by analyzing real-world user interactions, providing actionable insights rather than relying on static benchmarks.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About The Information Bottleneck

What is The Information Bottleneck about and what kind of topics does it cover?

A spotlight on cutting-edge AI research, practical deployment insights, and the evolving landscape of generative models, LLMs, and AI infrastructure. Discussions frequently center on evaluation methodologies, real-world performance, data quality, and privacy, with episodes ranging from open-source frameworks and data curation for LLMs to AI applications in finance and robotics. The tone blends deep technical exploration with thoughtful consideration of ethics, governance, and the societal impact of rapid AI advancement, making it a strong fit for listeners who want rigorous, practitioner-oriented conversations about how AI technologies actually perform and scale in real-world contexts. Noteworthy traits include a steady emphasis on evaluati... more

Where can I find podcast stats for The Information Bottleneck?

Rephonic provides a wide range of podcast stats for The Information Bottleneck. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to The Information Bottleneck and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does The Information Bottleneck get?

Rephonic provides a full set of podcast information for three million podcasts, including the number of listeners. View further listenership figures for The Information Bottleneck, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for The Information Bottleneck?

Rephonic provides comprehensive predictive audience data for The Information Bottleneck, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does The Information Bottleneck have?

To see how many followers or subscribers The Information Bottleneck has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to The Information Bottleneck?

These podcasts share a similar audience with The Information Bottleneck:

1. Machine Learning Street Talk (MLST)
2. Latent Space: The AI Engineer Podcast
3. Training Data
4. The MAD Podcast with Matt Turck
5. OpenAI Podcast

How many episodes of The Information Bottleneck are there?

The Information Bottleneck launched 8 months ago and published 34 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact The Information Bottleneck?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for The Information Bottleneck?

Rephonic pulls ratings and reviews for The Information Bottleneck from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for The Information Bottleneck?

Rephonic provides full transcripts for episodes of The Information Bottleneck. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on The Information Bottleneck?

Recent guests on The Information Bottleneck include:

1. Yaroslav Bulatov
2. Kyunghyun Cho
3. Stefano Ermon
4. Naomi Saphra
5. Stefano Soatto
6. Tanishq Abraham
7. Fred Sala
8. Bayan Bruss

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days