Rephonic
Artwork for The Experimentation Edge

The Experimentation Edge

Growthbook
A/B Testing
Experimentation
Artificial Intelligence
Growthbook
AI In Experimentation
Fin
E-Commerce
Expedia
Stitch Fix
Microsoft
Linkedin
North Star Metrics
Disney
Jpmorgan Chase
Home Depot
Dart Framework
Twitch
UPS
Moxie Pest Control
Typeform

How do product teams decide what to build and what not to? The Experimentation Edge is the podcast where product, growth, and engineering leaders share how A/B testing, feature flags, and experimentation drive real business outcomes — backed by named companies and real numbers. From DoorDash's 12,000 A/B tests a year to Atlassian's experimentation-led product win to UPS's $500M experimentation tea... more

PublishesTwice weeklyEpisodes50Founded8 months ago
Number of ListenersCategories
BusinessTechnology

Listen to this Podcast

Artwork for The Experimentation Edge

Latest Episodes

Summary

Sapna Kashyap, CRO Lead at VidaXL, runs the experimentation program for an e-commerce company operating in more than 30 countries, where product, development and business teams all validate their decisions with an A/B test first. She explains... more

YouTube

Summary

Michael Mathews, Director of Data and AI Product at FanDuel, runs the teams behind the auto researcher, an agent that takes a data set, an objective function and the production model, then proposes, writes and scores about 300 strategies in a... more

YouTube

Summary

Grubhub does not run much classic A/B testing. Michal Lenik, Associate Director of Product Design at Grubhub, explains what the company does instead to make sure its big product bets win before they reach millions of users.

She joins Ashley ... more

YouTube

Summary

Dorothy Crepin runs the A/B testing program at MilliporeSigma, the life sciences business of Merck KGaA, where one global catalog has to serve three very different visitors: scientists hunting for a specific instrument, procurement buyers wor... more

YouTube

Summary

Gaurav Sethi joins Ashley Stirrup on The Experimentation Edge to explain how PayPal's experimentation program went from 700 to 800 tests a year with four week readouts to 2,587 experiments a year and roughly $180 million in measured impact. G... more

YouTube

Summary

ServiceNow runs its own platform on itself. Ashraf Karim, Senior Vice President, Connected Customer Experience, owns everything that happens after a customer buys, and her team is Customer Zero, testing every product and capability internally... more

YouTube

Summary

Wanli Lau spent eleven years at Expedia Group, most recently running consumer product analytics on a program that shipped more than 1,500 A/B tests a year. Five months ago she moved to Twilio to lead global R&D analytics. In this episode she ... more

YouTube

Will Guyeskey is Director of Digital Product at GoPro, where his team owns the e-commerce side of gopro.com. Before GoPro he ran personalization at Gap and cut his teeth at Brooks Bell, testing for brands like Barnes & Noble, Under Armour and Ralph L... more

YouTube

Key Facts

Accepts Guests
Accepts Sponsors
Contact Information
Podcast Host
Number of Listeners
Find out how many people listen to this podcast per episode and each month.

Similar Podcasts

People also subscribe to these shows.

Recent Guests

Michal Lenik
Associate Director, Product Design at Grubhub
Grubhub
Episode: What Grubhub tests for big product bets before they ship
Dorothy Crepin
Senior AB Testing Analyst at MilliporeSigma
MilliporeSigma
Episode: How MilliporeSigma lifted add to cart with a smarter search
Gaurav Sethi
Experienced data/experimentation leader who spent over eight years at PayPal
PayPal
Episode: PayPal's $180 million experimentation win
Ashraf Karim
Senior Vice President, Connected Customer Experiences and Technology
ServiceNow
Episode: ServiceNow's Customer Zero approach to AI experimentation
Wanli Lau
Senior Director, Data Science and Analytics at Twilio
Twilio
Episode: Why Twilio ships on signals instead of significance
Will Guyeskey
Director of Digital Product at GoPro
GoPro
Episode: Why GoPro stopped judging A/B tests by win rate
Anuradha Tempe
Lead Product Manager, Samsung Electronics America
Samsung Electronics America
Episode: What Samsung learned bringing B2C rigor to B2B
Joe Yevoli
Director of Growth at Charlie Health
Charlie Health
Episode: Even a loss is a win: Charlie Health's approach to experiments
Whitney Perez
Director of Product Management at Realtor.com
Realtor.com
Episode: Realtor.com on using your AI as a junior data scientist

Host

Ashley Stirrup
Host of The Experimentation Edge

Talking Points

Recent interactions between the hosts and their guests.

ServiceNow's Customer Zero approach to AI experimentation
Q: How do you measure the impact of AI and experimentation in your customer service platform?
They use a mix of customer-centric and operational metrics, including CES (customer effort score), completion rates, CSAT, and business outcomes like revenue impact and time savings, while acknowledging the difficulty of identifying primary metrics in complex, multi-component systems.
ServiceNow's Customer Zero approach to AI experimentation
Q: What kinds of experiments or AI initiatives have you run that produced meaningful learnings?
He describes building agentic skills that process large data sets to diagnose issues, the need to balance automation with human oversight, and how latency and user expectations shape the success of AI-driven workflows.
ServiceNow's Customer Zero approach to AI experimentation
Q: Can you tell us a little bit about your role at ServiceNow and what your team focuses on?
Ashraf explains that his team handles post-sale experience, focusing on powering ServiceNow on ServiceNow to deliver effortless and compelling outcomes for customers, including developing the agentic workforce and post-sale support experience.
Learneo on testing the opposite of every hypothesis
Q: What is the value of testing the opposite hypothesis, and how did it affect decision-making?
Testing the opposite helped reveal the true direction of impact and whether a change was genuinely beneficial, leading to better prioritization and more robust learning.
Learneo on testing the opposite of every hypothesis
Q: Can you walk us through how you turned a broad business goal into a concrete testing program?
We translated the goal of reaching one million subscribers into a plan to execute hundreds of A/B tests, embedding testing into culture so every new hire has a stake in experimentation and a clear path to contribute.

Audience Metrics

Listeners, social reach, demographics and more for this podcast.

Listeners per Episode
Gender Skew
Location
Interests
Professions
Age Range
Household Income
Social Media Reach

Frequently Asked Questions About The Experimentation Edge

What is The Experimentation Edge about and what kind of topics does it cover?

The show focuses on how product, growth, and engineering leaders design and run experimentation programs at scale, using real-world case studies and numbers. Episodes frequently cover governance, data quality, and the cultural shifts required to democratize testing while maintaining rigor. Guests range from banks and marketplaces to retailers and media giants, sharing practical lessons on A/B testing, feature flags, AI-driven experimentation, and the organizational structures that support rapid, trustworthy decision-making. The format tends to spotlight concrete experiments, metrics that moved the needle, and the firehose of learnings that come from running tests across highly complex, multi-stakeholder environments. A notable strength is t... more

Where can I find podcast stats for The Experimentation Edge?

Rephonic provides a wide range of podcast stats for The Experimentation Edge. We scanned the web and collated all of the information that we could find in our comprehensive podcast database. See how many people listen to The Experimentation Edge and access YouTube viewership numbers, download stats, audience demographics, chart rankings, ratings, reviews and more.

How many listeners does The Experimentation Edge get?

Rephonic provides a full set of podcast information for four million podcasts, including the number of listeners. View further listenership figures for The Experimentation Edge, including podcast download numbers and subscriber numbers, so you can make better decisions about which podcasts to sponsor or be a guest on. You will need to upgrade your account to access this premium data.

What are the audience demographics for The Experimentation Edge?

Rephonic provides comprehensive predictive audience data for The Experimentation Edge, including gender skew, age, country, political leaning, income, professions, education level, and interests. You can access these listener demographics by upgrading your account.

How many subscribers and views does The Experimentation Edge have?

To see how many followers or subscribers The Experimentation Edge has on Spotify and other platforms such as Castbox and Podcast Addict, simply upgrade your account. You'll also find viewership figures for their YouTube channel if they have one.

Which podcasts are similar to The Experimentation Edge?

These podcasts share a similar audience with The Experimentation Edge:

1. Lenny's Podcast: Product | Career | Growth
2. A Bit of Optimism
3. Humans of Martech
4. The Initial

How many episodes of The Experimentation Edge are there?

The Experimentation Edge launched 8 months ago and published 50 episodes to date. You can find more information about this podcast including rankings, audience demographics and engagement in our podcast database.

How do I contact The Experimentation Edge?

Our systems regularly scour the web to find email addresses and social media links for this podcast. We scanned the web and collated all of the contact information that we could find in our podcast database. But in the unlikely event that you can't find what you're looking for, our concierge service lets you request our research team to source better contacts for you.

Where can I see ratings and reviews for The Experimentation Edge?

Rephonic pulls ratings and reviews for The Experimentation Edge from multiple sources, including Spotify, Apple Podcasts, Castbox, and Podcast Addict.

View all the reviews in one place instead of visiting each platform individually and use this information to decide if a show is worth pitching or not.

How do I access podcast episode transcripts for The Experimentation Edge?

Rephonic provides full transcripts for episodes of The Experimentation Edge. Search within each transcript for your keywords, whether they be topics, brands or people, and figure out if it's worth pitching as a guest or sponsor. You can even set-up alerts to get notified when your keywords are mentioned.

What guests have appeared on The Experimentation Edge?

Recent guests on The Experimentation Edge include:

1. Michal Lenik
2. Dorothy Crepin
3. Gaurav Sethi
4. Ashraf Karim
5. Wanli Lau
6. Will Guyeskey
7. Anuradha Tempe
8. Joe Yevoli

To view more recent guests and their details, simply upgrade your Rephonic account. You'll also get access to a typical guest profile to help you decide if the show is worth pitching.

Find and pitch the right podcasts

We help savvy brands, marketers and PR professionals to find the right podcasts for any topic or niche. Get the data and contacts you need to pitch podcasts at scale and turn listeners into customers.
Try it free for 7 days