Recent Presentations, EVents & Interviews

Ask a CRO

Koalatative’s Gerda Thomas and Experiment Nation’s Rommil Santiago answer questions from the community in a new YouTube series.

Conferences

2025

Topics include: AI, and Career Advice

2024

Topics include: Working with HiPPOs, AI and PLG

2023

Topics include: Politics, Personalization and Low-Traffic

EVENTS

Trends that have to stop

Product Experimentation

Interviews

See our recent episodes below or watch them all on YouTube.

Season 5

Season 4

Season 3

Recent Episodes

Some episodes from the last couple of years

Learn from Mistakes: What Eddie Aguilar learned from accidentally taking down InVision

Eddie Aguilar, a developer and CRO specialist, shares his experience with experimentation and optimization. He discusses how he started as a developer at a young age and eventually shifted to optimization. He recounts a specific incident while working with Envision App, where he made a global change to the website that caused a significant error, resulting in a spike in error logs. Eddie emphasizes the importance of communication and collaboration in such situations. Despite the error, the test yielded impressive results, with a 227% revenue lift and 70% LTV lift.

Read More

Make Personalization Personal with Care and Competence with David Mannheim

David Mannheim, author and expert on personalization, discusses the importance of personalization in marketing. He emphasizes the need for brands to focus on building relationships with customers based on trust and care. Mannheim distinguishes personalization from segmentation, highlighting personalization as a communication principle rather than just a marketing tactic. He also mentions the challenges faced in implementing personalization, such as the pressure for immediate returns and the balance of metrics.

Read More

Customer Value Optimization Explained with Defiant's Jason Chappel

We sat down with Jason Chappel, founder of Defiant, a specialist Customer Value Optimization agency, to discuss what sets CVO apart from CRO. Jason shares his insight on the importance of understanding and optimizing the entire customer journey, from acquisition to retention, and how CVO can help businesses increase customer lifetime value and drive sustainable growth in your business strategy.

Read More

Do 3-column layouts increase orders? with Nicoleta Danile?

Optimizing forms during checkout is crucial for a seamless user experience. By simplifying and streamlining the process, businesses reduce cart abandonment rates and increase conversions. Shortening form length, utilizing autofill options, and providing clear instructions enhance efficiency, minimize user frustration, and ultimately boost customer satisfaction, loyalty, and revenue.Nicoleta walks us through a case-study where she explores a 1 column form vs a 3 column form in checkout.

Read More

Build or buy your Google Optimize replacement with Kenneth Kutyn

Are you looking to replace Google Optimize? On Experiment Nation's recent podcast, Charlotte April Bomford chats with Kenneth Kutyn about replacing Google Optimize, how to select a new vendor, and whether it's worth building your own Experimentation Platform (spoiler alert: the answer is usually no).

Read More

Sharing insights, AI and the future of CRO with Tim Thijsse

Tim Thijsse, a senior CRO (Conversion Rate Optimization) consultant at Orange Valley, discusses AI and the future of CRO, and the importance of incorporating qualitative research into company-wide processes. He emphasizes the challenge of linking user behavior and mindset to knowledge and information. Tim shares his background, starting as an interaction designer and later transitioning to UX design and CRO. He highlights the evolution of CRO, the need for a culture of experimentation, and the role of qualitative insights in optimization strategies. Tim also discusses the challenges companies face in adopting an experimentation mindset, such as aligning strategy, operations, and technical aspects, and the importance of having a common metric and collaboration among teams.

Read More

Get Executive buy-in for your CRO program with Jonny Longden

Let's face it, experimentation is completely misunderstood. The power and the benefit and potential of it is to innovate and develop a business. And when you think about it, that's what experimentation has always been in relation to the scientific method. If you think about spaceflight, medicine, anything great that's happened in the history of modern civilization, this has all happened as a result of the careful application of the scientific method.

Read More

Client Relationship Tips from a CRO Agency Founder with Andra Baragan

In this presentation, Andra Baragan, the Founder of ONTRACK DIGITAL will walk you through what you need to know to build a strong, successful relationship with your clients and with your team.You will learn:- how to set expectations with your client from Day 1- how to leverage operating procedures and automate your work- how to communicate with clients and get stakeholder buy-in every time

Read More

Optimize Customer Lifetime Value - NOT Conversion Rates with Valentin Radu

After decades of acquisition marketing, companies are waking up to the fact that optimising the entire lifecycle of the customer is the way to go. That happens due to rising acquisition costs, cookie deprecation, siloes, company mentalities, etc.In this session, Valentin will share insights from his 12 years of experience transitioning from CRO - website optimization to increase the conversion rate to CVO - experimenting towards improving the CLV.

Read More

Improve conversions with the Message-market Fit framework With Daphne Tideman

Message-Market fit is the idea that a message, whether it be a product, service or idea, needs to resonate with a specific target market in order to be successful. It involves finding the right message that effectively communicates the value proposition of a product or service to a particular audience, in a way that resonates with them.

Read More

Avoid AB Testing Statistics Mistakes with Max LI

A/B testing plays a critical role in decision-making - but so does AB Testing Statistics Mistakes. In data-driven companies, A/B tests not only prove positive impacts of product features (treatments) but also provide evidence to safely roll out neutral features that are not expected to move business metrics. When rolling out a neutral feature, we need to test if the treatment is non-inferior to control, and conventional A/B testing is not suitable in this case.

Read More

YouTube Video Index

We have so many Videos, I asked ChatGPT to sort them by topic. To be honest, I think it got it wrong. But it’s better than nothing.

Analytics

Topic Subtopic Summary Related Videos
Anomaly & Quality Data QA & alerts Catching anomalies and maintaining trust in data.
Cohorts & Retention Time-based cohorts Measuring retention and cohort behaviors.
Dashboards & Viz Reporting & storytelling Turning analysis into decisions and action.
Event Tracking Schema & governance Clean, governed event tracking for analysis.
Experiment Readouts Narrative & action Telling a crisp story and driving action from results.
Funnel & Pathing Drop-offs & sequences Analyzing user paths and funnel drop-offs.

CRO

Topic Subtopic Summary Related Videos
A/B & Multivariate Testing Test design Designing and running controlled experiments (A/B and MVT).
Accessibility Inclusive UX Ensuring accessible experiences that also convert.
Analytics Foundations Attribution & tracking Ensuring reliable measurement and attribution.
Checkout & Payments Payments UX Improving cart and payment success rates.
Experiment Operations Testing workflow How teams plan, QA, and ship tests consistently.
Forms & Inputs Error states & validation Reducing form friction with better validation and UX.
Funnel Optimization Friction & drop-off Finding and fixing funnel leaks to lift conversion.
Landing Pages & Copy Messaging & layout Optimizing landing page hierarchy, copy, and CTAs.
Micro-Interactions UI polish Small UI cues that clarify and motivate action.
Mobile UX App & responsive Optimizing mobile and app conversion patterns.
Performance Core Web Vitals Improving speed and stability for higher CVR.
Personalization Segmentation & targeting Tailoring experiences to segments to lift CVR.
Survey Analysis Voice of customer Turning survey data into testable hypotheses.

Experimentation

Topic Subtopic Summary Related Videos
Analysis & Debugging Outliers & sanity checks Post-test analysis and debugging wins/losses.
Hypotheses & Design Hypothesis frameworks Crafting hypotheses and prioritizing experiments.
MVT & Factorials Interactions & DOE Designing tests to learn interactions efficiently.
Metrics & Guardrails North-star & safety Balancing primary metrics with guardrails.
Multi-armed Bandits Adaptive allocation Adaptive allocation strategies vs classical A/B.
Power & Sizing Sample size & MDE Planning power and MDE before launch.
Program & Governance Process & ethics Operating a scalable, ethical program.
Sequential Testing Peeking & alpha spending Controlling error while monitoring experiments.

Growth/PLG

Topic Subtopic Summary Related Videos
Freemium & Trials Upgrade mechanics Designing freemium/trial flows that convert.
Lifecycle Messaging Email & in-product Targeted messaging to move users forward.
Monetization Pricing & packaging Optimizing pricing models and packaging.
Onboarding Guides & checklists Designing onboarding that accelerates activation.
Paid Acquisition CAC & ROAS Scaling paid channels while maintaining unit economics.
Retention Habit loops & churn Strengthening product habits and reducing churn.
SEO & Content Acquisition via content Compounding organic acquisition via content.
Self-Serve Checkout & procurement Optimizing self-serve purchase experiences.
Usage Funnels DAU/WAU & feature use Measuring and improving product usage funnels.
Virality & Referrals Loops & incentives Building referral loops and share incentives.