Recent Presentations, EVents & Interviews

Ask a CRO

Koalatative’s Gerda Thomas and Experiment Nation’s Rommil Santiago answer questions from the community in a new YouTube series.

Conferences

2025

Topics include: AI, and Career Advice

2024

Topics include: Working with HiPPOs, AI and PLG

2023

Topics include: Politics, Personalization and Low-Traffic

EVENTS

Trends that have to stop

Product Experimentation

Interviews

See our recent episodes below or watch them all on YouTube.

Season 5

Season 4

Season 3

Recent Episodes

Some episodes from the last couple of years

How to get Stakeholder Buy-in for all your Experiments featuring André Morys

Learn from André Morys, CEO of KonversionsKRAFT, on gaining crucial stakeholder buy-in for experiments. André highlights the challenges faced by optimizers and advocates for understanding team dynamics through stakeholder mapping. He emphasizes approaching stakeholders, using empathy to build relationships, and overcoming objections. André shares practical insights on conflict management, including a stakeholder map with color-coded power dynamics. Discover the significance of regular check-ins, fostering trust, and achieving tangible results in experimentation. Master the art of securing support for your experiments effectively.

Read More

Will Laurenson: From Startups to CRO Mastery

Will Laurenson shares his journey from startup to becoming a CRO (Conversion Rate Optimization) expert. Will discusses the significance of usability, anxiety, and motivation in CRO, drawing from his extensive experience in running tests and optimizing various businesses. Will's approach to CRO involves deep insights into user behavior and a focus on aligning products with customer needs, challenging the common pitfalls of assuming product-market fit based solely on initial traction or advertising success.

Read More

The CRO Statistical concepts all CROs should know featuring Ishan Goel

In this insightful video, Ishan Goel, transitioning from a software engineer to a researcher, delves into crucial CRO statistical concepts. He sheds light on statistical significance in experimentation, explores A/B testing intricacies, emphasizes the efficiency of sequential testing, and discusses challenges in stopping tests prematurely. The talk concludes by highlighting the intersection of experimentation and statistics in the realm of Conversion Rate Optimization.

Read More

Ad Optimization: Your Ads Aren’t Working and Here’s Why ft. Joe Fitzpatrick

So much is spent on ads that it's a no-brainer to invest in ad optimization. Embracing experimentation and learning from failures is essential for long-term success in performance marketing. Experiment Nation's Tracy Laranjo spoke with Joe Fitzpatrick about reasons why your ads aren't working and what you can do about it.

Read More

Maximizing Results: A Comprehensive Guide to Ad Network Experimentation ft. João Marcelo Rodrigues

Maximizing results in ad network optimization requires a systematic approach. Start with A/B testing on Google Ads and gradually introduce more complex campaigns, balancing technical and creative aspects. Analyze your channel's performance, ensuring sufficient impressions and conversions for statistically significant results. Shape your product to align with the ad network's requirements and consider user experience. Prioritize velocity in testing initially, gradually enhancing quality, and encourage collaboration across different platforms for valuable insights in the quest for optimization.

Read More

The top CRO Myths that experimenters have to bust ft. Lucas Vos

Lucas, a senior conversion specialist, shares his journey in the media industry, emphasizing the transformative impact of A/B testing. He discusses myths about experimentation - debunking them along the way as well as highlights the importance of validation, integration into essential projects, and showcasing negative results. Lucas encourages testing the obvious and unexpected, questioning assumptions, and showing the value of experimentation to reduce risk and aid decision-making, making it an asset for senior managers and specialists.

Read More

Personalization timing matters - Avoid these common mistakes ft. Eric Melchor

Eric Melchor, an evangelist at Optimonk, emphasizes the importance of focusing on the product page for effective conversion rate optimization (CRO). He suggests treating website visitors as individuals and creating a personalized and enjoyable customer experience in real-time. Melchor also discusses the significance of capturing visitor interest early on and leveraging smart CRO tactics and personalization timing throughout the customer journey. Additionally, he mentions the value of optimizing the product page, as it can yield significant returns on investment.

Read More

CRO Organizational Structure- Centralized Team vs Process: with Oliver Paton

We explore various angles of CRO Organizational Structure. We discussed primarily the differences between centralized CRO teams vs a company-wide experimentation culture, and how this is best looked at as a continuum. Companies starting out might benefit from a centralized CRO team whereas more mature optimization programs can benefit more from working experimentation into all facets of the company. How can a company who does 0 experimentation introduce and adopt an experimentation process/culture? We also chatted about experimentation at the customer level, what this means, and how it could be the future of optimization.

Read More

What CROs need to know about Heatmaps with Deborah O'Malley

Heatmaps to the rescue! Creating an impactful website hero section above the fold is vital for user engagement. Clear value propositions and compelling calls to action are essential, as users often don't scroll past this section. Heat mapping, combined with other techniques like exit polls and A/B testing, provides a comprehensive understanding of user behavior. While urgency and scarcity tactics can be effective, users have become more skeptical of overused strategies like countdown timers. Understand your audience through analytics data and tailor your optimization strategies accordingly, whether it's for B2C, B2B, or other sectors. Mobile interactions may have imprecise heat map data, so use it alongside other sources for a well-rounded view.

Read More

Getting start-ups to adopt a culture of experimentation with Simon Girardin

To ensure the success of CRO projects, it's vital to involve all stakeholders, including executives and directors, right from the start. This inclusive approach not only helps them understand the intricacies of the CRO process but also demonstrates the depth of strategic thinking behind it. Even skeptical executives can be won over by involving them in CRO calls, showcasing the complexity that goes beyond mere marketing tactics. Such transparency and involvement lead to a more informed and supportive team, fostering successful CRO initiatives.

Read More

How to Maximize Hypotheses Testing ft. Eduardo Marconi Pinheiro Lima

In the world of Conversion Rate Optimization (CRO), Eduardo, a seasoned practitioner, shares his journey and the evolving landscape of CRO in Brazil. He underscores the importance of maintaining a problem-solution mindset and learning from mistakes to drive meaningful impact. One core principle he highlights is the need to focus on hypotheses that yield significant results, comparing them to squeezing fruit for juice. This strategy involves exploring promising hypotheses further and discarding those with neutral or unimpressive outcomes, a practice essential for effective experimentation, whether in-house or at an agency. The key takeaway is to persevere with ideas, akin to squeezing every drop of insight from hypotheses, and leveraging comprehensive data for a deeper understanding, a competitive edge held by in-house roles in the experimentation field.

Read More

What you need to know about Landing pages with Claire More

Integrating landing pages is crucial for tailored user experiences. Without it, visitors are directed to generic pages lacking personalized messaging. Landing pages are designed to enhance conversion rates and ROI. E-commerce companies benefit by using various types of landing pages, like the classic hero for focused products, listicle hero for storytelling, collection hero for multiple items, and content advertorials for top-funnel content. Mistakes include using one-size-fits-all pages and lacking customer-oriented content. Improve by collaborating with ads teams, using customer voices, and continuous experimentation. Claire More from Splitbase shared insights on optimizing landing pages for effective campaigns.

Read More

Don't test everything with Oliver Palmer

Don't test everything. Experimentation isn't about proving how clever you are. Mistakes in testing ideas from your own head are common; personal bias clouds results. High-performing experimentation needs executive buy-in and integrated roles. Successful teams engage diverse players with vested interest, ensuring hypotheses formation and metric selection are comprehensive. Valuable experimentation saves time by testing what not to do. Rather than just chasing conversion lifts, recognize when improvements won't make a difference. Cultural shifts, humility, and prioritizing efficient use of time are key components of effective experimentation programs. Test what makes sense.

Read More

The truth about building an Experimentation Culture with Mark Eltsefon

In this podcast episode, Mark Eltsefon, a senior data scientist and experimentation evangelist, discusses building an experimentation culture in different companies. He shares his journey from starting as a software developer to becoming passionate about data science and experimentation. He contrasts the experimentation culture at TikTok, where data-driven decisions were central and democratization was encouraged, with his current role at an e-commerce company specializing in print-on-demand. He emphasizes the importance of educating stakeholders about data-driven decision-making, and he highlights the need for strong experimentation infrastructure and high-quality hypothesis testing. He believes that while democratization is valuable, it's important to balance it with maintaining the quality of ideas and statistical rigor.

Read More

How to get Personalization Right with Juliana Amorim

Juliana Amorim emphasizes that personalization is not a silver bullet and recommends its use when aligned with strong hypotheses and business goals. She co-founded Croct, a personalization experimentation platform, focusing on adapting user journeys to context. Examples include tailoring websites for diverse buyer personas within B2B companies and customizing content for users at different stages, like newcomers or existing customers. AI-based personalization and rule-based personalization can coexist. Brands should prioritize personalizing their websites and consider first-party data support.

Read More

Stop limiting yourself - build your CRO brand today with Carlos Trujillo

Building a personal brand as a conversion rate optimizer is crucial in today's competitive digital landscape. Your personal brand serves as a powerful tool to establish credibility, showcase expertise, and attract new opportunities. By cultivating a strong brand identity, you position yourself as an authority in the field, gaining trust from potential clients or employers. A well-developed personal brand helps differentiate you from others, highlighting your unique approach and methodologies. It opens doors to collaborations, speaking engagements, and thought leadership opportunities. Additionally, a strong personal brand creates a lasting impression, leading to increased visibility, a larger professional network, and ultimately, a steady stream of clients or job offers.

Read More

Building a CRO Culture & Ideation Strategies with Lucia van den Brink

By implementing ideation strategies and fostering a culture of experimentation, companies can drive innovation and stay ahead of the curve. Building an experimentation culture is crucial for companies that want to innovate and stay ahead of the competition. It starts with creating an environment where experimentation is encouraged and failure is seen as an opportunity to learn and improve. Teams should be given the freedom to try new ideas and test them quickly using small-scale experiments. It's important to collect and analyze data from these experiments to make informed decisions about what works and what doesn't. Lucas Vos interviews Lucia van den Brink in this great AMA session.

Read More

YouTube Video Index

We have so many Videos, I asked ChatGPT to sort them by topic. To be honest, I think it got it wrong. But it’s better than nothing.

Analytics

Topic Subtopic Summary Related Videos
Anomaly & Quality Data QA & alerts Catching anomalies and maintaining trust in data.
Cohorts & Retention Time-based cohorts Measuring retention and cohort behaviors.
Dashboards & Viz Reporting & storytelling Turning analysis into decisions and action.
Event Tracking Schema & governance Clean, governed event tracking for analysis.
Experiment Readouts Narrative & action Telling a crisp story and driving action from results.
Funnel & Pathing Drop-offs & sequences Analyzing user paths and funnel drop-offs.

CRO

Topic Subtopic Summary Related Videos
A/B & Multivariate Testing Test design Designing and running controlled experiments (A/B and MVT).
Accessibility Inclusive UX Ensuring accessible experiences that also convert.
Analytics Foundations Attribution & tracking Ensuring reliable measurement and attribution.
Checkout & Payments Payments UX Improving cart and payment success rates.
Experiment Operations Testing workflow How teams plan, QA, and ship tests consistently.
Forms & Inputs Error states & validation Reducing form friction with better validation and UX.
Funnel Optimization Friction & drop-off Finding and fixing funnel leaks to lift conversion.
Landing Pages & Copy Messaging & layout Optimizing landing page hierarchy, copy, and CTAs.
Micro-Interactions UI polish Small UI cues that clarify and motivate action.
Mobile UX App & responsive Optimizing mobile and app conversion patterns.
Performance Core Web Vitals Improving speed and stability for higher CVR.
Personalization Segmentation & targeting Tailoring experiences to segments to lift CVR.
Survey Analysis Voice of customer Turning survey data into testable hypotheses.

Experimentation

Topic Subtopic Summary Related Videos
Analysis & Debugging Outliers & sanity checks Post-test analysis and debugging wins/losses.
Hypotheses & Design Hypothesis frameworks Crafting hypotheses and prioritizing experiments.
MVT & Factorials Interactions & DOE Designing tests to learn interactions efficiently.
Metrics & Guardrails North-star & safety Balancing primary metrics with guardrails.
Multi-armed Bandits Adaptive allocation Adaptive allocation strategies vs classical A/B.
Power & Sizing Sample size & MDE Planning power and MDE before launch.
Program & Governance Process & ethics Operating a scalable, ethical program.
Sequential Testing Peeking & alpha spending Controlling error while monitoring experiments.

Growth/PLG

Topic Subtopic Summary Related Videos
Freemium & Trials Upgrade mechanics Designing freemium/trial flows that convert.
Lifecycle Messaging Email & in-product Targeted messaging to move users forward.
Monetization Pricing & packaging Optimizing pricing models and packaging.
Onboarding Guides & checklists Designing onboarding that accelerates activation.
Paid Acquisition CAC & ROAS Scaling paid channels while maintaining unit economics.
Retention Habit loops & churn Strengthening product habits and reducing churn.
SEO & Content Acquisition via content Compounding organic acquisition via content.
Self-Serve Checkout & procurement Optimizing self-serve purchase experiences.
Usage Funnels DAU/WAU & feature use Measuring and improving product usage funnels.
Virality & Referrals Loops & incentives Building referral loops and share incentives.