Recent Presentations, EVents & Interviews

Ask a CRO

Koalatative’s Gerda Thomas and Experiment Nation’s Rommil Santiago answer questions from the community in a new YouTube series.

Conferences

2025

Topics include: AI, and Career Advice

2024

Topics include: Working with HiPPOs, AI and PLG

2023

Topics include: Politics, Personalization and Low-Traffic

EVENTS

Trends that have to stop

Product Experimentation

Interviews

See our recent episodes below or watch them all on YouTube.

Season 5

Season 4

Season 3

Recent Episodes

Some episodes from the last couple of years

Speero's Experimentation Maturity Audit with Edgar Spongolts

Speero's Director of CX Optimization, Edgar Spongolts, dives deep into the influential agency's Experimentation Maturity Audit and why maturity matters. Learn about the four pillars of a successful experimentation program and what it takes to reach the highest levels of maturity. Take the audit yourself here: https://speero.link/ExperimentNation

Read More

Specsavers’ Steph Le Prevost on growing a top UK CRO program

Steph walks us through the challenges of growing Specsavers’ CRO team and how she overcame them, her experimentation red flags, and her take on if CRO certifications are really worth it. Plus: A comparison of the CRO job market between Canada vs. the UK, including how well you can expect to be paid as an optimizer.

Read More

Microsoft Digital Stores’ Tim Mehta on strategies for low and high maturity experimentation programs

Tim shares his tips for running low and high maturity experimentation programs, what it’s like to optimize in-house vs. agency, when it is (and is not) ok to make compromises, and to how make your program’s results actually drive action. Plus: Tim’s take on those controversial UI polls on LinkedIn.

Read More

Shopify’s Shanelle Mullin on tough buy-in conversations and how we can empower future optimizers

Tracy Laranjo chats with Shopify’s Experimentation & Analysis Lead, Shanelle Mullin, about tough buy-in conversations, her take on the “I don’t dream of labour” trend, making experimentation more representative of diverse voices, and how we can empower the next generation of optimizers.

Read More

YouTube Video Index

We have so many Videos, I asked ChatGPT to sort them by topic. To be honest, I think it got it wrong. But it’s better than nothing.

Analytics

Topic Subtopic Summary Related Videos
Anomaly & Quality Data QA & alerts Catching anomalies and maintaining trust in data.
Cohorts & Retention Time-based cohorts Measuring retention and cohort behaviors.
Dashboards & Viz Reporting & storytelling Turning analysis into decisions and action.
Event Tracking Schema & governance Clean, governed event tracking for analysis.
Experiment Readouts Narrative & action Telling a crisp story and driving action from results.
Funnel & Pathing Drop-offs & sequences Analyzing user paths and funnel drop-offs.

CRO

Topic Subtopic Summary Related Videos
A/B & Multivariate Testing Test design Designing and running controlled experiments (A/B and MVT).
Accessibility Inclusive UX Ensuring accessible experiences that also convert.
Analytics Foundations Attribution & tracking Ensuring reliable measurement and attribution.
Checkout & Payments Payments UX Improving cart and payment success rates.
Experiment Operations Testing workflow How teams plan, QA, and ship tests consistently.
Forms & Inputs Error states & validation Reducing form friction with better validation and UX.
Funnel Optimization Friction & drop-off Finding and fixing funnel leaks to lift conversion.
Landing Pages & Copy Messaging & layout Optimizing landing page hierarchy, copy, and CTAs.
Micro-Interactions UI polish Small UI cues that clarify and motivate action.
Mobile UX App & responsive Optimizing mobile and app conversion patterns.
Performance Core Web Vitals Improving speed and stability for higher CVR.
Personalization Segmentation & targeting Tailoring experiences to segments to lift CVR.
Survey Analysis Voice of customer Turning survey data into testable hypotheses.

Experimentation

Topic Subtopic Summary Related Videos
Analysis & Debugging Outliers & sanity checks Post-test analysis and debugging wins/losses.
Hypotheses & Design Hypothesis frameworks Crafting hypotheses and prioritizing experiments.
MVT & Factorials Interactions & DOE Designing tests to learn interactions efficiently.
Metrics & Guardrails North-star & safety Balancing primary metrics with guardrails.
Multi-armed Bandits Adaptive allocation Adaptive allocation strategies vs classical A/B.
Power & Sizing Sample size & MDE Planning power and MDE before launch.
Program & Governance Process & ethics Operating a scalable, ethical program.
Sequential Testing Peeking & alpha spending Controlling error while monitoring experiments.

Growth/PLG

Topic Subtopic Summary Related Videos
Freemium & Trials Upgrade mechanics Designing freemium/trial flows that convert.
Lifecycle Messaging Email & in-product Targeted messaging to move users forward.
Monetization Pricing & packaging Optimizing pricing models and packaging.
Onboarding Guides & checklists Designing onboarding that accelerates activation.
Paid Acquisition CAC & ROAS Scaling paid channels while maintaining unit economics.
Retention Habit loops & churn Strengthening product habits and reducing churn.
SEO & Content Acquisition via content Compounding organic acquisition via content.
Self-Serve Checkout & procurement Optimizing self-serve purchase experiences.
Usage Funnels DAU/WAU & feature use Measuring and improving product usage funnels.
Virality & Referrals Loops & incentives Building referral loops and share incentives.