<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:googleplay="http://www.google.com/schemas/play-podcasts/1.0"><channel><title><![CDATA[Experimentation Labs]]></title><description><![CDATA[A newsletter about A/B testing, product growth and practical application of AI, written to make the complex stuff feel simple and the boring stuff a little more fun. Irreverent, practical, and based on years of doing this work in the wild.]]></description><link>https://newsletter.experimentationlabs.com</link><image><url>https://substackcdn.com/image/fetch/$s_!dNb6!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe460551e-706e-45cd-9929-895be6d139a3_938x938.png</url><title>Experimentation Labs</title><link>https://newsletter.experimentationlabs.com</link></image><generator>Substack</generator><lastBuildDate>Sun, 10 May 2026 10:39:35 GMT</lastBuildDate><atom:link href="https://newsletter.experimentationlabs.com/feed" rel="self" type="application/rss+xml"/><copyright><![CDATA[Dan Martin]]></copyright><language><![CDATA[en]]></language><webMaster><![CDATA[experimentationlabs@substack.com]]></webMaster><itunes:owner><itunes:email><![CDATA[experimentationlabs@substack.com]]></itunes:email><itunes:name><![CDATA[Dan Martin]]></itunes:name></itunes:owner><itunes:author><![CDATA[Dan Martin]]></itunes:author><googleplay:owner><![CDATA[experimentationlabs@substack.com]]></googleplay:owner><googleplay:email><![CDATA[experimentationlabs@substack.com]]></googleplay:email><googleplay:author><![CDATA[Dan Martin]]></googleplay:author><itunes:block><![CDATA[Yes]]></itunes:block><item><title><![CDATA[AI + Healthcare]]></title><description><![CDATA[Do you trust it?]]></description><link>https://newsletter.experimentationlabs.com/p/ai-healthcare</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/ai-healthcare</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Wed, 14 Jan 2026 01:32:22 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!OmNx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!OmNx!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!OmNx!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!OmNx!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!OmNx!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!OmNx!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!OmNx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2668902,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/184485980?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!OmNx!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!OmNx!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!OmNx!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!OmNx!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff99173f1-4684-48cc-a4d5-3eba95645743_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p><strong>Two AI Giants, Two Very Different Healthcare Bets</strong></p><p>Last week, OpenAI and Anthropic both announced major healthcare integrations within days of each other. On the surface, they look pretty similar. Both let you connect medical records to an AI chatbot, both promise HIPAA compliance.</p><p>But look closer and you see something more interesting: these companies are making fundamentally different bets about where AI actually creates value in healthcare.</p><h2>The Two Strategies</h2><p><strong>OpenAI&#8217;s bet: become your health assistant.</strong> They&#8217;re building on their massive consumer base (230 million people already ask ChatGPT health questions weekly). Now you can upload lab results and get research-backed explanations with citations. They&#8217;re also rolling out enterprise tools for hospitals like Cedars-Sinai. The strategy? Own both ends of the market.</p><p><strong>Anthropic&#8217;s bet: solve hospital paperwork.</strong> Prior authorization. Insurance appeals. Medical coding. They&#8217;re plugging Claude directly into the filing systems hospitals already use (CMS databases, ICD-10 codes, provider registries). It&#8217;s about speed and operational efficiency, not research synthesis.</p><h2>Why I Think OpenAI&#8217;s Approach Matters More</h2><p>So here&#8217;s the thing. Anthropic is doing valuable work, but it&#8217;s kinda incremental optimization of an existing broken system. OpenAI is addressing something more fundamental: broad access to healthcare information. In the US, that information exists online but requires sophistication to access and understand. Better accessibility is a crucial first step.</p><h2>The Real Vision: AI as Your Health Documentation Partner</h2><p>But the real vision isn&#8217;t just ChatGPT answering health questions. It&#8217;s AI becoming a documentation partner. Think of it like having a nurse following you around all day, logging symptoms, tracking patterns through your phone and smartwatch data.</p><p>Think about what doctor visits actually are right now: mostly information gathering. You describing symptoms, forgetting details, trying to remember when things started. With AI documentation, those visits shift to strategy and game planning. That&#8217;s genuinely powerful.</p><h2>What Version Two Looks Like</h2><p>And version two isn&#8217;t far off. Continuous monitoring detecting anomalies, active communication asking for context. AI notices elevated heart rate and asks what you were doing. You provide context. That full history goes to your doctor with pattern analysis already done.</p><h2>The Access Question</h2><p>Will there be liability issues? Sure. Access inequality concerns? Probably at first. But technology always starts expensive and concentrated, then gets subsidized and distributed broadly. Internet. Smartphones. Solar panels. Wealthy people willing to pay for the first version fund the innovation that eventually makes it cheap for everyone.</p><p>You have to start somewhere.</p><h2>The Bottom Line</h2><p>The current healthcare system can&#8217;t stay as is. Something has to break or change. This technology could be the catalyst that forces innovation across the entire ecosystem.</p><p>Neither company&#8217;s strategy is obviously wrong. The hospital of the future might use both. But I&#8217;m betting on the approach that reimagines the relationship between patients and their health information, not the one that makes existing paperwork slightly less painful.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Weekly Update 1/12/26]]></title><description><![CDATA[Dude Claude Code is giving me crazy super powers.]]></description><link>https://newsletter.experimentationlabs.com/p/weekly-update-11226</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/weekly-update-11226</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 12 Jan 2026 22:30:12 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!URwA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!URwA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!URwA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!URwA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!URwA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!URwA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!URwA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2272865,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/184368004?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!URwA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!URwA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!URwA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!URwA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F040349b9-71f2-40d0-8039-229a00542d63_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p>Hello and welcome to week 2. Last week was busy and Claude Code has opened up a whole new world for me as far as building apps goes. Here&#8217;s what I got up to last week: </p><h2>Progress updates</h2><h3>Current projects</h3><h4>Nova Music</h4><p>Nova got a ton of love this week. The big addition was converting the student portal to a family-based system. Now families log in once and see all their kids&#8217; schedules, assignments, and practice logs in one place with color-coded events. I also built out a full billing portal where families can view and pay invoices through Stripe, complete with payment confirmation emails.</p><p>Other additions include an assignment checklist system for tracking practice goals, a teacher resources page with drag-and-drop file uploads and in-page previews, and magic link emails for easy family onboarding. </p><h4>Experimentation Labs Site</h4><p>I ended up splitting out the newsletter.experimentationlabs.com and root experimentationlabs.com websites so that I can use the root one as more of a portfolio website. I added two new tools to the site: a Test Plan Generator with AI-powered suggestions and an A/B Test Analyzer with statistical significance calculations. Also revamped the navigation with a megamenu and added SEO basics (robots.txt, sitemap, Open Graph tags). </p><h4>Onewheel Utah</h4><p>Bringing an old project back to life! Years ago I ran a small Onewheel website I built with WordPress, but life got busy and it&#8217;s been hard to want to keep managing or paying to manage this. So this week with Claude I built a full custom WordPress theme with Tailwind and DaisyUI for a revamped website and marketplace. So that&#8217;s back to some of it&#8217;s former glory, but with a whole new architecture. I don&#8217;t know how much love this one will get going forward, but its a fun side project. I&#8217;d love to build some AI Agents to automate content management and stuff like that, so we&#8217;ll see what time permits. </p><div><hr></div><h2>What&#8217;s coming up</h2><p>I&#8217;m going to be out of town for most of this week, so I doubt there will be too much that gets done here, my major focus is on building a GTM plan for Nova so that I can start to onboard beta testers and be ready for launch at the end of Q1, so probably not too many visible updates.</p><ul><li><p><strong>Upcoming posts</strong></p><ul><li><p>Tech News Tuesday - OpenAI and Anthropic step into healthcare</p></li><li><p>AI Wednesday - Vibe code to live guide </p></li><li><p>Growth Thursday - When is friction in your product a good thing?</p></li><li><p>Fail Friday - The losing loop of carnival games</p></li></ul></li></ul><div><hr></div><h2>Last week&#8217;s posts</h2><ul><li><p><a href="https://newsletter.experimentationlabs.com/p/using-claude-opus-45-to-build-nova">Using Claude Opus 4.5 to build Nova Music</a></p></li><li><p><a href="https://newsletter.experimentationlabs.com/p/a-difficult-tech-job-market-2026">A Difficult Tech Job Market + 2026 Predictions</a></p></li><li><p><a href="https://newsletter.experimentationlabs.com/p/how-im-using-cursor-and-granola-to">How I&#8217;m Using Cursor and Granola to Get Better at Interviewing</a></p></li><li><p><a href="https://newsletter.experimentationlabs.com/p/friday-fail-on-sale-now">Friday Fail: On Sale Now!</a></p></li></ul><div><hr></div><p>If you&#8217;re building a product and experimenting with AI as a force multiplier, follow along. I&#8217;ll keep sharing concrete, real examples.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Friday Fail: On Sale Now!]]></title><description><![CDATA[Now $0.99, down from $1!]]></description><link>https://newsletter.experimentationlabs.com/p/friday-fail-on-sale-now</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/friday-fail-on-sale-now</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Sat, 10 Jan 2026 01:21:00 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!dNb6!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe460551e-706e-45cd-9929-895be6d139a3_938x938.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Over the break my 7 year old son and I went in to visit a Gamestop and take a look at what was in stock. </p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p></p><p>He ran over and found a bunch of individual Pokemon cards. He looked up and saw the sign that said &#8220;on sale $0.99&#8221;. Right below that he saw a sign that said &#8220;Used to be $1&#8221;. </p><p>He laughed and said &#8220;Dad that&#8217;s not a sale, it&#8217;s only $0.01 cheaper!&#8221;</p><p>Sorry Gamestop, even my 7 year old didn&#8217;t fall for it. </p><p>In other news&#8230;</p><div class="captioned-image-container"><figure><a class="image-link image2" target="_blank" href="https://substackcdn.com/image/fetch/$s_!o6eA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!o6eA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 424w, https://substackcdn.com/image/fetch/$s_!o6eA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 848w, https://substackcdn.com/image/fetch/$s_!o6eA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 1272w, https://substackcdn.com/image/fetch/$s_!o6eA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!o6eA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png" width="1335" height="298" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/dc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:298,&quot;width&quot;:1335,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:70554,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/184085751?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!o6eA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 424w, https://substackcdn.com/image/fetch/$s_!o6eA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 848w, https://substackcdn.com/image/fetch/$s_!o6eA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 1272w, https://substackcdn.com/image/fetch/$s_!o6eA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fdc3c1380-6259-4c18-bcd4-3a21910e177e_1335x298.png 1456w" sizes="100vw" fetchpriority="high"></picture><div></div></div></a></figure></div><p>Happy Friday! </p>]]></content:encoded></item><item><title><![CDATA[How I’m Using Cursor and Granola to Get Better at Interviewing]]></title><description><![CDATA[No one tells you if you&#8217;re bad at interviewing.]]></description><link>https://newsletter.experimentationlabs.com/p/how-im-using-cursor-and-granola-to</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/how-im-using-cursor-and-granola-to</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Thu, 08 Jan 2026 22:28:55 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Qk5x!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Qk5x!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Qk5x!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Qk5x!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Qk5x!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Qk5x!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Qk5x!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2665281,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/183962664?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Qk5x!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!Qk5x!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!Qk5x!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!Qk5x!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F1aba44f8-359d-440a-a6ac-35261ef99a23_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p>No one tells you if you&#8217;re bad at interviewing.</p><p>The recruiter won&#8217;t call back and say, &#8220;Hey, you bombed that one.&#8221; The hiring manager won&#8217;t explain what they were looking for or whether you had it. You&#8217;re left guessing. And that&#8217;s a problem, because I might have the skills but not know how to talk about them.</p><p>So I built a system to get feedback despite that.</p><h2>The Setup</h2><p>I use two tools: Granola and Cursor.</p><p>Granola records and transcribes my interviews. Once I have the transcript, I bring it into Cursor along with a bunch of other context: my resume, the job description, notes on the company, and something I call my <strong>Career Source of Truth</strong>.</p><p>Why Cursor? </p><p>Because it lets me give Claude Code all the context it needs. The job. The company. The interviewer. My full career history. The actual conversation. With all of that in one place, Claude can give me real feedback on how the interview went.</p><h2>The Career Source of Truth</h2><p>Here&#8217;s the thing about my career: it hasn&#8217;t always been pretty.</p><ul><li><p>I&#8217;ve had bosses I liked and bosses I hated</p></li><li><p>I&#8217;ve had roles I loved and roles I tolerated</p></li><li><p>I&#8217;ve worked at companies I&#8217;m proud of and companies I&#8217;m not</p></li></ul><p>All of that matters. But I&#8217;m not going to say it in an interview. In an interview, I&#8217;m the product. I&#8217;m selling myself as the solution to their problem. I don&#8217;t lead with the flaws. Nobody selling a phone tells you about the bad battery life. I focus on the highlights. There&#8217;s nothing wrong with that.</p><p>Here&#8217;s how I built my Career Source of Truth:</p><ol><li><p>I talk through my whole career out loud using a tool like Wispr Flow. Every job. Every boss. Every win and every failure.</p></li><li><p>I dump all of that into an LLM and ask it to ask me more questions until we have a full picture.</p></li><li><p>I save that document and upload it to Cursor.</p></li></ol><p>I&#8217;ve also added sections with prepared stories for common interview questions. I know what types of questions I&#8217;ll get for product and growth roles. Having those stories ready makes a huge difference.</p><h2>The File Structure</h2><p>Here&#8217;s the folder structure I use. Copy it and make it your own:</p><pre><code><code>&#128193; job-search/
&#9500;&#9472;&#9472; &#128193; .claude/                     # Claude Code settings (optional)
&#9500;&#9472;&#9472; &#128193; interview-transcripts/
&#9474;   &#9500;&#9472;&#9472; &#128193; company-a/
&#9474;   &#9474;   &#9500;&#9472;&#9472; job-description.txt
&#9474;   &#9474;   &#9500;&#9472;&#9472; company-research.txt
&#9474;   &#9474;   &#9500;&#9472;&#9472; interviewer-profile.txt
&#9474;   &#9474;   &#9500;&#9472;&#9472; recruiter-screen.txt
&#9474;   &#9474;   &#9500;&#9472;&#9472; hiring-manager-interview.txt
&#9474;   &#9474;   &#9492;&#9472;&#9472; technical-interview.txt
&#9474;   &#9500;&#9472;&#9472; &#128193; company-b/
&#9474;   &#9474;   &#9492;&#9472;&#9472; ...
&#9474;   &#9492;&#9472;&#9472; &#128193; company-c/
&#9474;       &#9492;&#9472;&#9472; ...
&#9500;&#9472;&#9472; &#128193; resumes/
&#9474;   &#9500;&#9472;&#9472; base-resume.txt
&#9474;   &#9500;&#9472;&#9472; growth-pm-version.txt
&#9474;   &#9500;&#9472;&#9472; core-pm-version.txt
&#9474;   &#9492;&#9472;&#9472; hybrid-version.txt
&#9500;&#9472;&#9472; career-source-of-truth.txt
&#9500;&#9472;&#9472; drivers-and-drainers.txt
&#9492;&#9472;&#9472; personality-assessments.pdf      # CliftonStrengths, MBTI, etc.</code></code></pre><p><strong>What goes where:</strong></p><ul><li><p><strong>interview-transcripts/</strong> : One subfolder per company. Job descriptions, research, interviewer profiles, and transcripts from each conversation.</p></li><li><p><strong>resumes/</strong> : Different versions of your resume for different role types.</p></li><li><p><strong>career-source-of-truth.txt</strong> : Your full career history, including the stuff you wouldn&#8217;t say out loud.</p></li><li><p><strong>drivers-and-drainers.txt</strong> : What gives you energy vs. what drains you.</p></li><li><p><strong>personality-assessments.pdf</strong> : Optional, but useful for feedback on role fit.</p></li></ul><h2>Career Source of Truth Template</h2><p>Here&#8217;s a template you can copy. The goal is to create an honest record of your career that you can pull from when prepping.</p><p>markdown</p><pre><code><code>CAREER SOURCE OF TRUTH
======================
Last updated: [Date]

Purpose: Unbiased record of career history, accomplishments, and context.
Use this to pull details for resumes, cover letters, and interview prep.

========================================================================
[COMPANY NAME] ([Start Date] - [End Date])
========================================================================

COMPANY CONTEXT
- What does the company do?
- Stage/size (Series A, public, etc.)
- Approximate headcount
- How did you leave? (quit, laid off, etc.)

REPORTING STRUCTURE
- Who did you report to? (title and name)
- What was the relationship like? (good, bad, micromanager, hands-off)

TEAM
- Direct reports? How many?
- Cross-functional collaborators?
- What functions did you work with most?

TOOLS
- Analytics, experimentation, product tools
- Other relevant tech

KEY PROJECTS

[Project Name]:
- Problem: What was broken or missing?
- Solution: What did you do?
- Your role: What did YOU own?
- Result: Quantified outcome (%, $, time saved, etc.)

KEY METRICS
- List your most impressive numbers
- Tie them to business outcomes where possible

STAKEHOLDER CHALLENGES
- Any notable conflicts or alignment issues?
- How did you resolve them?

WHY YOU LEFT
- Be honest, this is for your reference

HOW YOU FELT ABOUT THE ROLE
- What did you like? What did you hate? Would you go back?

========================================================================
[REPEAT FOR EACH ROLE]
========================================================================

========================================================================
EDUCATION &amp; CERTIFICATIONS
========================================================================
- School, degree, dates
- Relevant coursework or skills learned
- Online courses, bootcamps, certifications

========================================================================
SKILLS &amp; TOOLS
========================================================================
- Technical (languages, platforms)
- Analytics tools
- Product tools
- AI/prototyping tools

========================================================================
PERSONAL CONTEXT
========================================================================
- Location, relocation preferences
- Family context relevant to career decisions
- Interests and side projects that demonstrate skills

========================================================================
CAREER NARRATIVE THEMES
========================================================================

Use this section to identify patterns across your career:

PATTERN: [Theme name]
- Evidence from Role 1
- Evidence from Role 2
- Why this matters

Examples of patterns to look for:
- Promoted fast
- Self-directed learner
- Types of work you gravitate toward vs. avoid
- Recurring strengths and challenges

========================================================================
INTERVIEW Q&amp;A - PREPARED ANSWERS
========================================================================

TOP STORIES (have 5-6 ready):
1. [Story name] &gt; [Key metric] ([Category])
2. [Story name] &gt; [Key metric] ([Category])
3. [Story name] &gt; [Key metric] ([Category])

WORDS/PHRASES TO STOP SAYING:
- [Filler words you overuse]
- [Weak phrases]

WORDS/PHRASES TO START SAYING:
- "I owned..."
- "I drove..."
- "The result was..."

========================================================================
COMMON QUESTIONS CHEAT SHEET
========================================================================

Q: Tell me about yourself
&gt; [Your 30-second pitch]

Q: Why this role?
&gt; [Your answer]

Q: Tell me about a project you led
&gt; [Your go-to story]

Q: Tell me about a failure
&gt; [Your story, own it, show learning]

[Add more questions specific to your field]

========================================================================
STORIES BY THEME - QUICK REFERENCE
========================================================================

[THEME 1: e.g., Cross-functional collaboration]:
&gt; [Story + key metric]

[THEME 2: e.g., Data-driven decisions]:
&gt; [Story + key metric]

[YOUR WEAK SPOT, have stories ready]:
&gt; [Story that addresses the gap]

========================================================================
THINGS TO AVOID SAYING
========================================================================
- [Topics or phrases that don't land well]
- [Anything that raises red flags]</code></code></pre><h2>How I Use It</h2><p>Once I have all this context in place, I ask Claude: <em>&#8220;Here&#8217;s my most recent interview. Based on the job description, company info, interviewer background, my resume, and my Career Source of Truth: how did this go? What went well? What didn&#8217;t land?&#8221;</em></p><p>Claude gives me real feedback. What I did well. What fell flat. Moments where I could have said something different.</p><h2>Where This Shines</h2><p>This works for single interviews. But it gets powerful when I stack up multiple interviews, either multiple rounds at one company or similar roles across different companies.</p><p>Claude can:</p><ul><li><p>Spot trends across interviews (&#8221;When you say X, people respond well. When you say Y, it falls flat.&#8221;)</p></li><li><p>Help me prepare for likely questions based on patterns</p></li><li><p>Dig into my Career Source of Truth and say, &#8220;Someone asked you this question and you didn&#8217;t have a good answer. But you have a perfect story for it. Here&#8217;s how to frame it.&#8221;</p></li></ul><p>I&#8217;ve also uploaded my CliftonStrengths assessment. Claude can read it and tell me my top strengths and blind spots. I have a separate doc with my drivers and drainers: what gives me energy and what depletes it. With all that context, Claude can tell me which roles I&#8217;ll thrive in and which ones will drain me.</p><h2>Evaluating <em>Them</em>, Not Just Selling Yourself</h2><p>Here&#8217;s an underrated benefit: Claude helps me evaluate companies, not just pitch myself.</p><p>It might say, &#8220;Company X looks great on paper, but there are red flags in these transcripts. In your next interview, dig into this topic that seems unresolved.&#8221;</p><p>That&#8217;s huge. It helps me ask better questions. It helps me judge whether a company is a good fit for me, not just whether I can convince them I&#8217;m a fit for them.</p><h2>Bringing It Home</h2><p>This system has been a game changer: a file structure with all my context, an LLM that can analyze multiple interviews, and feedback that&#8217;s (hopefully) unbiased.</p><p>This matters to me because I get imposter syndrome. I think, &#8220;I can do this job. But I don&#8217;t know if I speak the language. I don&#8217;t know if I can sell myself for this role, even though I have the experience.&#8221;</p><p>This system helps me frame my skills the right way. I know what I&#8217;ve done. Claude helps me shape it for the person I&#8217;m talking to. Because I have to tell different stories to different people. Design, marketing, product, engineering, executives: they all want to hear the same story, but with the right angle. Good PMs are persuasive. You tell the same story in a way that lands with each audience.</p><p>I&#8217;m not pushing fraud or deception. But in interviews, I often have the experience. I just don&#8217;t know how to talk about it in a way that clicks with the person across the table.</p><p>This system fixes that.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[A Difficult Tech Job Market + 2026 Predictions]]></title><description><![CDATA[2025 really kicked us out the door from a tech job market perspective.]]></description><link>https://newsletter.experimentationlabs.com/p/a-difficult-tech-job-market-2026</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/a-difficult-tech-job-market-2026</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Wed, 07 Jan 2026 15:03:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pPid!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pPid!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pPid!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!pPid!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!pPid!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!pPid!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pPid!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2333603,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/183690511?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pPid!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!pPid!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!pPid!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!pPid!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F968f7f61-7c84-47fb-a440-62bdb57b6b70_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p>Between really quick advancements in AI, a very strange economy and tech companies doubling down on profits and AI Agents, being a tech worker kind of sucked for the last few months.</p><p>So where does that leave tech workers coming in to 2026?</p><p>Here are my predictions:</p><h3>The tech market will bounce back, at least a little.</h3><p>Companies doubled down hard on AI last year and used &#8220;AI&#8221; as a way to lay people off, but end of year lay offs have been happening in tech for many many years, AI was just the flavor of the quarter in 2025. And I should point out, I&#8217;m a big believer in AI, it&#8217;s changing a lot about how I work in some really cool ways, but I think lots of founders had big visions of how it would allow them to automate everything and that just didn&#8217;t happen, at least not last year.</p><p>So I think tech will hire more, but probably not as much as in previous years.</p><h3>AI isn&#8217;t taking your job, but someone fluent with AI might take it</h3><p>While I do think there will be more hiring in 2026, I think teams are trending towards flatter and leaner empowered by AI to do more. And I get it, as a product manager I can use AI to write code, query databases, research and more. It doesn&#8217;t solve all my problems right now, but it does allow me to operate faster across a wider breadth than ever before, so while I think companies will hire, I think AI is a requirement, in fact in every single interview I&#8217;ve had recently hiring managers and teams are asking me how I&#8217;m using AI in my work. Thankfully I have good answers, but I can imagine that if someone walked in and said they don&#8217;t like AI or aren&#8217;t on the hype train, that person might struggle to land a gig.</p><h3>The product management career will have a serious change in scope</h3><p>I can really only speak to the product and growth sides of things, but from what I can see, engineering and design are not the bottlenecks anymore, thanks to AI, good ideas and planning are. I think we&#8217;ll see a switch from 1 PM and 2-10 Eng per squad to 0.5 PMs to 1-2 Eng. I think there will need to be a change to a business focus, more of a general manager mentality. Products and features being built can happen in record time, so the thinking and ensuring user experience is the real bottleneck.</p><h3>Engineering roles will change dramatically</h3><p>Though I&#8217;m not an engineer, if I were a new or junior software engineer just getting into the game, I would start to feel nervous and would want to ramp up quick. AI is changing engineering in some serious ways that can&#8217;t be denied anymore. With Opus 4.5 I&#8217;m building fast a full web app that I plan to launch this year. Writing code isn&#8217;t the crucial skill anymore, but understanding how to architect systems and build for security are things that I still need. I imagine engineers will change their work to write less code, review a lot more AI written code and have to master a new abstraction layer that doesn&#8217;t require writing everything yourself, but requires understanding systems and integrations and security in a new deeper way.</p><p>What are your thoughts? What are your predictions for 2026? Is AI taking all our jobs? Or just a passing fad?</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Using Claude Opus 4.5 to build Nova Music]]></title><description><![CDATA[AI isn&#8217;t the bottleneck anymore]]></description><link>https://newsletter.experimentationlabs.com/p/using-claude-opus-45-to-build-nova</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/using-claude-opus-45-to-build-nova</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Tue, 06 Jan 2026 16:08:30 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!HvxZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!HvxZ!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!HvxZ!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!HvxZ!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!HvxZ!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!HvxZ!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!HvxZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/f0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3484034,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/183596182?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!HvxZ!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!HvxZ!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!HvxZ!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!HvxZ!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ff0529fe9-e1ef-4404-8bef-de495e26b60b_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p>I&#8217;ve had this idea since my wife started teaching piano when we moved to California. An app to help her with admin tasks, primarily billing, scheduling and lesson management.</p><p>I started by looking at competitors, there are a few, and trying to understand what the solutions to this problem looked like for them. Then I tried for months with various LLM coding models and vibe coding tools to build a version of this that works.</p><p>I began building with Bolt and Lovable, and with Sonnet 4.5 and Codex was able to make decent progress, but always bumped into a few of the same issues, namely creating a semi-separate system for student login that kept them connected to the teacher, basically relatively complicated database relationships, and then other small little features or bugs, usually inconsistent. But always present.</p><p>So I spent months in Bolt and Lovable trying different iterations of prompting to get around the problems, but could never get the LLMs to cross the finish line.</p><p>Enter Opus 4.5 + Bolt. Once Bolt had these enhanced capabilities, there were absolutely 0 problems. Tough database structure? No problem. Change the CSS from Tailwind to Shadcn? Barely 30 minutes of work. Want a Stripe integration? Easy, I&#8217;m the biggest bottleneck, not the AI.</p><p>It opened a whole new world of code to me.</p><p>So in about a week I went from this idea that I knew well, I knew the problem, the solution, what I wanted it to look like, how I wanted it to feel and work, and finally I could bring it all to life with minimal effort and cost.</p><p>The alpha is live now at <a href="http://trynovamusic.com/">trynovamusic.com</a> if you&#8217;re interested and want to take a look, I&#8217;d love your feedback.</p><p>There are still plenty of features, bugs and integrations that need clean up and fixing, but I feel pretty comfortable launching this as an alpha.</p><p>Big takeaways:</p><ol><li><p>Code isn&#8217;t the bottleneck anymore, I am.</p></li><li><p>Ideas are becoming more valuable than execution very quickly, execution is still a bottleneck, but it&#8217;s mostly about what I know or don&#8217;t know, AI can solve most of the problems I throw at it from a code perspective.</p></li><li><p>The barrier to entry for digital products is getting lower and lower, I&#8217;m not sure what that means going forward, but its great for someone like me who has lots of ideas on what I&#8217;d like to build. It&#8217;s also a bit of a forcing function, now that I can build anything, what should I actually build?</p></li></ol><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[Weekly Update 1/5/26]]></title><description><![CDATA[Hello and welcome to my first weekly update of 2026!]]></description><link>https://newsletter.experimentationlabs.com/p/weekly-update-1526</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/weekly-update-1526</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 05 Jan 2026 17:01:35 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!dNb6!,w_256,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe460551e-706e-45cd-9929-895be6d139a3_938x938.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<h2>Intro</h2><p>Hello and welcome to my first weekly update of 2026!</p><p>One of my goals for 2026 is to write, publish and build more in public and posting a weekly update is one of the ways I plan to hold myself accountable to those goals.</p><p>I&#8217;m pulling some inspiration from one of my favorite authors, Brandon Sanderson, who posts a weekly update regularly that I end up watching mostly every week and I really enjoy.</p><p>In my weekly updates you can expect to get updates on projects I&#8217;m working on, upcoming projects, posts, etc for the coming week, a brief report on what I did last week and occasionally other updates. Should be short and sweet and the plan is for it to come out every Monday.</p><p>Expect a lot more posts from me this year.</p><h2>Progress updates</h2><p>As far as updates go on projects, there are 2 that I am currently working on:</p><ol><li><p>Nova Music</p></li><li><p>Experimentation Labs</p></li></ol><p>Nova Music is a music instructor CRM and studio management tool that I&#8217;ve been working on for my wife who teaches Piano. It started as a fun way to play with AI and vibe coding tools and has turned into something real that I&#8217;m very excited about.</p><p>It&#8217;s still currently in Alpha, but I&#8217;m excited that the core functionality of the product itself is working! There are still a few bugs to clean up and lots of feature enhancements I want to make, but it&#8217;s in a place where my wife is going to start using it in her lessons starting next week.</p><p>I expect she&#8217;ll have lots of valuable feedback that I&#8217;ll incorporate as quickly as I can.</p><p>My goal is to get Nova to some Beta users in February and to try to go to market by March.</p><p>There&#8217;s still plenty to do before we get there, but I think it&#8217;s doable.</p><p>Experimentation Labs is my Substack newsletter.</p><p>I&#8217;ve written on and off for a few years, it&#8217;s something I enjoy and a skill I want to improve, but it&#8217;s tough to be consistent, so one of my goals for 2026 is to post more often.</p><p>I&#8217;m hoping to post quite a bit more. My posts will include Weekly Updates, AI news and my takes on AI tools, breakdowns of growth strategies, go to market strategies and interesting products.</p><p>I don&#8217;t want to over commit to specific topics yet, those are still up in the air, but I plan to try several things and we&#8217;ll see what sticks with the audience and what gets me excited to study and write about.</p><p>I&#8217;m excited about this goal, I hope it will stretch me in some uncomfortable ways.</p><h2>What&#8217;s coming up</h2><p>This week I&#8217;m excited to write about :</p><ol><li><p>How I&#8217;m using Claude Code Opus 4.5 to build Nova</p></li><li><p>How I&#8217;m using Cursor and Granola to improve my job interview performance</p></li><li><p>A difficult tech job market</p></li><li><p>Vibe code to live quick guide</p></li></ol><h2>Happy New Year</h2><p>Here&#8217;s to a happy new year and doing our best to stick to our goals!</p>]]></content:encoded></item><item><title><![CDATA[4 Ways I'm Using AI To Fuel My Job Search]]></title><description><![CDATA[You wouldn't believe how powerful AI for job searching can be.]]></description><link>https://newsletter.experimentationlabs.com/p/4-ways-im-using-ai-to-fuel-my-job</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/4-ways-im-using-ai-to-fuel-my-job</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 20 Oct 2025 17:23:25 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!xVG3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!xVG3!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!xVG3!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!xVG3!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!xVG3!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!xVG3!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!xVG3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3188065,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/176175638?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!xVG3!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!xVG3!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!xVG3!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!xVG3!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F00b98b6e-65b4-45d3-a70e-e120a8235c8f_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>As someone who&#8217;s been working in tech for about a decade, I&#8217;ve seen my fair share of layoffs and as a result I&#8217;ve developed a pretty unique skill of landing jobs at some of the most competitive companies in the world. </p><p>Today I want to share 4 ways that I&#8217;m using AI to help me land new roles: </p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><h2>Use ChatGPT Agent to develop a company profile</h2><p>Before I start working at any company I want to try to get a read on how the company is doing financially, who&#8217;s running the show and if there are any other red flags, or green flags, I should be aware of. So I run a prompt like this and read the report.</p><ol><li><p>Prompt: </p><ol><li><p>I&#8217;m interviewing with a company called [company name] today, I&#8217;m chatting with a person named [name of person] for a [name of role] role. Can you do some prep for me? I want to know about the company, the products, the job description and expectations, the funding, the valuation, the revenue, the Glassdoor employee reviews, the company trajectory, any recent changes in employee headcount, any notable former employees who were only there for a few months or other red or green flags. I want a critical but fair review of their everything (include sources) because I want to know if this is a place I want to work and if I can succeed there. </p></li></ol></li></ol><h2>Create a ChatGPT project, upload relevant info then have it run a report</h2><p>One of my favorite ChatGPT features is the ability to create a project. You can give the project custom prompt instructions and files for it to reference, you can even contain it&#8217;s memory to the project, which is super helpful. Give this a try:</p><ol><li><p>Create a project, add the job description, the hiring manager info, the recruiter info and my resume and then get ChatGPT agent to research them</p></li><li><p>Prompt:</p><ol><li><p>Your task is to learn everything you can about [person name] and compile it into a prep doc for me. I&#8217;ll be interviewing with them for a [role] at [company] and want to be well informed. Help me understand how they think, write, communicate and the kinds of questions they&#8217;re likely to ask me in the interview so I can prepare. Here&#8217;s their LinkedIn [linkedin link]</p></li></ol></li></ol><h2>Interview ChatGPT voice mode</h2><p>Once I have all these reports on the company and the individuals I&#8217;m interviewing with, I upload those to my project and then have a voice conversation with it. It&#8217;s helpful to do this from 2 perspectives, me as the interviewee and as the interviewer, I think both help me wrap my head around how the conversation is going to go. Try this:</p><ol><li><p>Prompt (I read this explicitly to make sure I get it right): </p><ol><li><p>For this conversation, assume the role of [person name], [job title] at [company]. You&#8217;re screening me for the role. Ask me exactly five questions to determine my fit for the position based on [company]&#8217;s needs. I want you to then, after you ask these five questions, pause the conversation and provide [person name]&#8217;s perspective, highlighting clearly what went well in my responses, what was acceptable but could be sharper, and what specifically needs improvement to best position me as a competent [role] at [company]. Do not factor conciseness into your feedback. Focus solely on the clarity of competence, role alignment, and suitability for the [role] at [company].</p><ol><li><p>I add the note about conciseness because every time I&#8217;ve tried this it tells me I talk too much, and I find that ridiculous. I think it thinks my answers should be like 1 sentence, but I find that doesn&#8217;t allow me to actually articulate what I need to, but who knows, maybe I talk to much and AI is right. </p></li></ol></li></ol></li></ol><h2>Record the conversation and review it</h2><p>I try to record the conversation if possible, but worst case scenario, I just record my side of the conversation and ask it to fill in the gaps, I can help if it needs. Once I have that it&#8217;s really helpful to debrief and see how I did in the real interview. Try this: </p><ol><li><p>Prompt: </p><ol><li><p>&lt;upload the transcript of the conversation&gt; Just finished my interview with [company], this was with [person and role], how did I do? Give me a critical but fair opinion on what went well, what was ok and what I totally failed on.</p></li></ol></li></ol><h2>AI Powered Interviewing Is Awesome</h2><p>I find leveraging AI to help me prep and debrief interviews to be incredibly helpful. It&#8217;s really helpful to understand both perspectives, and to get specific feedback on what I can be doing better and how to improve. </p><p>Let me know if you give these a try and tell me what you think! </p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p></p>]]></content:encoded></item><item><title><![CDATA[We Built a Lending Marketplace in 30 Days. Here’s Why We Shut It Down.]]></title><description><![CDATA[A story about turning impossible constraints into breakthrough innovations and knowing when even breakthrough isn&#8217;t enough]]></description><link>https://newsletter.experimentationlabs.com/p/we-built-a-lending-marketplace-in</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/we-built-a-lending-marketplace-in</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Tue, 14 Oct 2025 20:04:48 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!ivs0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!ivs0!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!ivs0!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ivs0!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ivs0!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ivs0!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!ivs0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2953348,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/176163769?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!ivs0!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!ivs0!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!ivs0!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!ivs0!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd58b8828-0c22-455e-8519-e5c21567fca2_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><p>Every Product Manager has built something that should have worked. The spreadsheet math was bulletproof. The execution was flawless. You shipped innovation after innovation.</p><p>But sometimes great metrics hide a dying business model.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><h2>Day 1: The Impossible Brief</h2><p>June 24, 2025. My first day at my new job. Most people get a laptop and a buddy. I got a 0-1 project with a 90-day deadline to generate $1M in revenue.</p><p>&#8220;We&#8217;re building a lending marketplace for SMBs,&#8221; my new boss explained. &#8220;You start today.&#8221;</p><p>No onboarding. No ramp time. Just immediate ownership of what would become one of our most ambitious experiments.</p><p>The vision was compelling: Small businesses waste weeks on loan applications, getting rejected by banks, starting over. We&#8217;d build an intelligent marketplace that compressed weeks into minutes, matching businesses with the right lender instantly.</p><p>The constraints were... interesting:</p><p>- Small growth pod (including me, still learning everyone&#8217;s names)</p><p>- Targeting 90 days to revenue </p><p>- 1 confirmed lending partner</p><p>Day 1. Full ownership. Impossible timeline. Perfect.</p><h2>Week 1-2: From 0 to Launch</h2><p>While most teams would spend months researching, we had a different philosophy: ship immediately, learn from reality. In 14 days, we went from whiteboard to production.</p><p>The MVP was deliberately minimal, but the infrastructure wasn&#8217;t. </p><p>We built the whole analytics stack (Segment &#8594; Amplitude), comprehensive error tracking that let us watch sessions like reality TV (thanks for the T-shirt LogRocket), a hilariously simple but effective attribution system we called &#8216;caveman attribution&#8217;, just different landing pages for different platforms and even integrated with business registries because nobody should have to type their business address in 2025.</p><p>The early data was a masterclass in humility. </p><p>Of every 100 people who hit our landing page, 3 started the application. Of those brave souls, 75% rage quit when we asked them to connect their bank account. </p><p>The ones who did complete it? They were filling out loan applications squinting at our desktop optimized form on their phones (because of course 78% were on mobile). </p><p>That insight changed everything. These weren&#8217;t calm business decisions, they were desperate searches for capital when anxiety peaks. We weren&#8217;t building B2B software; we were offering SMBs a cashflow lifeline.</p><h2>Week 3: The Strategic Pivot</h2><p>With 1% conversion, I made a tough decision: complete redesign mid-flight. Not iteration, reconstruction.</p><p>The new architecture I proposed was radically different:</p><ul><li><p>Progressive application: 1 question per screen with auto-advance</p></li><li><p>Mobile-first design: Optimized for thumbs, not desktop pointers</p></li><li><p>Smart sequencing: Pre-qualification by the end of the 4th question, scary stuff (bank connection) later in the app, after we&#8217;ve built some trust</p></li><li><p>Reduced cognitive load: 27 questions &#8594; 16, all multiple choice where possible</p></li></ul><p>Results within 72 hours of launch:</p><ul><li><p>Landing page &#8594; application start: 39% &#8594; 65% (67% relative improvement)</p></li><li><p>Application completion rate: 30% &#8594; 50%</p></li><li><p>End-to-end conversion: 1% &#8594; 4% (4x improvement)</p></li><li><p>Cost per signup: $60 &#8594; $43 (28% reduction)</p></li></ul><p>The form completion rate of 50% wasn&#8217;t just good, it was industry-leading. Most financial applications struggle to break 30%.</p><h2>Week 4-5: The Innovation Sprint</h2><p>This is where we built something the company had never tried before, a lead scoring system:</p><h3>The Lead Scoring Innovation:</h3><ul><li><p>Real-time qualification tiers: S, A, B, C and D (auto-decline) based on self reported revenue, credit score, and time in business</p></li><li><p>Meta Conversion API integration: a feedback loop sending lead quality data back to Meta</p></li><li><p>Automated routing: S-tier leads got white-glove treatment, D-tier were auto rejected (lending partners wouldn&#8217;t approve any D under any circumstances)</p></li><li><p>Self-improving acquisition: Each scored lead taught Meta what &#8220;good&#8221; looked like and the targeting improved</p></li></ul><h3>The technical implementation was complex but elegant:</h3><ul><li><p>Tier S: $50k-$100K+ revenue, 720+ credit, 12+ months &#8594; Priority queue</p></li><li><p>Tier A: $25-$50k revenue, 680-719 credit &#8594; Standard queue</p></li><li><p>Tier B: $25k-$50k revenue, 600-649 credit &#8594; Secondary partners</p></li><li><p>Tier C: $10-25k+ revenue, 550-559 credit, 12+ months &#8594; Priority queue</p></li><li><p>Tier D: &lt;$10k revenue OR &lt;6 months OR &lt;550 credit &#8594; Helpful resources</p></li></ul><p>I actual built a simple prototype to help visualize it: </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://zippy-clafoutis-f2aaa0.netlify.app/" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!0Jj4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 424w, https://substackcdn.com/image/fetch/$s_!0Jj4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 848w, https://substackcdn.com/image/fetch/$s_!0Jj4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 1272w, https://substackcdn.com/image/fetch/$s_!0Jj4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!0Jj4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png" width="1038" height="950" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:950,&quot;width&quot;:1038,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:118015,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:&quot;https://zippy-clafoutis-f2aaa0.netlify.app/&quot;,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/176163769?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!0Jj4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 424w, https://substackcdn.com/image/fetch/$s_!0Jj4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 848w, https://substackcdn.com/image/fetch/$s_!0Jj4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 1272w, https://substackcdn.com/image/fetch/$s_!0Jj4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc7239d7d-4927-46fe-aafe-270fdcd54518_1038x950.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p><a href="https://zippy-clafoutis-f2aaa0.netlify.app/">https://zippy-clafoutis-f2aaa0.netlify.app/</a></p><p>This wasn&#8217;t just lead scoring, it was building a self-optimizing marketplace. Our CAC started dropping as the system learned, eventually reaching $181 per qualified lead (down from $400+).</p><h2>Marketing Innovation &amp; Attribution Mastery</h2><p>Working with limited marketing channels (Meta&#8217;s financial services restrictions), I pioneered several approaches:</p><h3>Attribution Innovation:</h3><ul><li><p>Created platform-specific landing pages for simplified tracking</p></li><li><p>Implemented &#8220;caveman attribution&#8221; that solved the attribution problem</p></li><li><p>Built custom conversion events that taught Meta about lead quality, not just volume</p></li></ul><h3>Messaging Breakthroughs:</h3><ul><li><p>&#8220;Approved before your bank calls you back&#8221; - our top performer</p></li><li><p>Mobile-first creative strategy (vertical video outperformed static by 3x)</p></li><li><p>Speed-focused positioning that resonated with anxious SMB owners</p></li></ul><p>The result: marketing efficiency improved weekly, with cost per qualified lead dropping from $400+ to $181 while maintaining quality.</p><h2>Week 6: The Hard Truth</h2><p>By week 6, we&#8217;d achieved something remarkable, and remarkably challenging. </p><p>Our metrics were genuinely exceptional: applications up more than 50%, a 50% completion rate that made other fintechs jealous, and our customer acquisition cost had dropped by over 60%. </p><p>But funded deals, the metric that really mattered? </p><p>Basically zero. </p><p>Revenue? </p><p>A rounding error. </p><p>The unit economics exercise took 6 minutes and reset expectations from 6 weeks of intense effort. </p><p>Simple math: we&#8217;d need to spend nearly $2 on acquisition for every $1 in revenue. </p><p>And that was with our already-optimized funnel. I modeled every scenario.</p><p>Cut CAC in half again? Still losing money. </p><p>Double approval rates? Still underwater. </p><p>Triple both? Congrats, you&#8217;re at negative margins. There was no combination of improvements that made this work.</p><h2>Decision Time</h2><p>Six weeks in, I became the messenger for inconvenient math. The project I&#8217;d been hired to run on day one was improving every week but would probably never work. </p><p>My role wasn&#8217;t to decide its fate, but to ensure leadership had crystal-clear visibility into reality. I presented the unit economics and proposed options for how we could keep pushing with some timeline updates. </p><p>Eventually it was decided that we would reallocate resources and frame this not as failure but as strategic reallocation. We weren&#8217;t ending a project, we were reallocating resources strategically, to apply the learnings to our core application. </p><p>Leadership made the call, but they made it with conviction because the data was undeniable. That&#8217;s the real job of a PM: ensuring the right decision gets made.</p><h2>The Platform We Actually Built</h2><p>While the project only drove a small amount of direct revenue, we built lasting infrastructure:</p><h3>Technical Assets:</h3><ul><li><p>Analytics infrastructure: Became company standard for all new products</p></li><li><p>Lead scoring engine: Adapted across entire product application experience</p></li><li><p>Conversion API integration: Now standard practice</p></li></ul><h3>Strategic Insights:</h3><ul><li><p>Discovered exact CAC thresholds for profitability</p></li><li><p>Mapped SMB lending landscape</p></li><li><p>Built relationships with 4+ lending partners</p></li><li><p>Created playbook for rapid marketplace development</p></li></ul><h2>Five Principles for 0-1 Products</h2><h3>1. Day 1 Ownership Beats Long Onboarding</h3><p>Starting with full ownership on day 1 forced rapid learning and decisive action. No time for analysis paralysis.</p><h3>2. Ship to Learn, Don&#8217;t Learn to Ship</h3><p>Our ugly MVP taught us more in 2 weeks than 6 months of research would have. Real users with real money make real decisions.</p><h3>3. Build Systems, Not Just Products</h3><p>Every component was built for reusability. The product died; the infrastructure lives on.</p><h3>4. Innovation Comes From Constraints</h3><p>Limited time and resources forced creative solutions like the lead scoring system.</p><h3>5. Strategic Courage Beats Stubborn Persistence</h3><p>Killing a project with improving metrics takes courage. But recognizing fundamental flaws early saves resources for winning bets.</p><p>So that&#8217;s how 6 weeks into a new job, I proved to myself and the company that I could take ownership, drive innovation, and make hard decisions based on data, not ego.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p></p>]]></content:encoded></item><item><title><![CDATA[Transform Your Ad-Hoc Tests into a Structured Growth Engine]]></title><description><![CDATA[Let me show you exactly how the best product teams run A/B tests to consistently achieve meaningful, measurable results.]]></description><link>https://newsletter.experimentationlabs.com/p/transform-your-ad-hoc-tests-into</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/transform-your-ad-hoc-tests-into</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Sat, 04 Oct 2025 00:12:48 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!r38L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!r38L!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!r38L!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!r38L!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!r38L!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!r38L!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!r38L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png" width="1024" height="1024" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1024,&quot;width&quot;:1024,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1634572,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/175239691?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!r38L!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 424w, https://substackcdn.com/image/fetch/$s_!r38L!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 848w, https://substackcdn.com/image/fetch/$s_!r38L!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!r38L!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe033135d-6fbb-4390-83f6-ff86f6c2dd08_1024x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p>Most A/B testing is broken and you&#8217;ve probably felt it. Teams run test after test, chase promising metrics, and still end up with inconclusive results or worse: decisions based on noise rather than signal. The solution isn&#8217;t more testing; it&#8217;s better testing. Let me show you exactly how the best product teams run A/B tests to consistently achieve meaningful, measurable results.</p><h2>Start With the Right Foundation</h2><p>Your testing platform isn&#8217;t just another tool in your stack; it&#8217;s the backbone of every experiment you&#8217;ll run. </p><p>You need something that makes test setup straightforward, provides clear and reliable data, and highlights statistical significance without leaving you guessing. </p><p>The wrong platform will create friction at every step. The right one becomes invisible, letting you focus on insights rather than infrastructure.</p><h2>Define Your Metrics Before You Start</h2><p>Here&#8217;s where most teams stumble: they launch tests without clearly defining what success looks like. By the time results come in, they&#8217;re left interpreting ambiguous data and debating what actually matters. Set your standards upfront and save yourself the headache.</p><p>Start with confidence levels, aim for at least 95% confidence, which translates to a p-value of 0.05. This means you&#8217;re accepting only a 5% chance that your results are due to random variation. </p><p>Then establish your Minimum Detectable Effect, typically targeting a 10-20% improvement depending on your market dynamics, traffic volume, and the importance of what you&#8217;re testing. </p><p>Finally, set your statistical power around 80% to ensure your tests can reliably detect real changes when they exist.</p><h2>Calculate Your Timeline and Commit to It</h2><p>One of the most common mistakes in A/B testing is leaving experiments open-ended, checking them periodically, and calling them &#8220;done&#8221; whenever results look favorable. This is a recipe for false positives and wasted effort.</p><p>Instead, calculate your timeline based on historical data. At Keep, we&#8217;d pull a 90-day average of the action we were testing (say, button clicks), break it down to a weekly average, and target approximately 1,000 conversions per variant. </p><p>This gave us a clear endpoint before we even launched. </p><p>If a test didn&#8217;t achieve statistical significance by that timeline, we documented it clearly, concluded the test, made a decision and moved forward. Sometimes that meant adjusting our approach and planning a retest with a longer timeline or different design.</p><h2>Choose One North Star Metric</h2><p>When you track everything, you understand nothing. </p><p>Too many metrics create confusion and make it nearly impossible to make clean decisions. The solution is ruthlessly simple: choose one primary metric as your Overall Evaluation Criterion (OEC).</p><p>Airbnb does this brilliantly. Their primary OEC is the number of nights booked. </p><p>Not clicks, not searches, not wishlist additions. Just nights booked. </p><p>This single metric simplifies every experimental decision across the entire company. You can supplement this with two or three secondary metrics for additional context, but your primary metric should be sacred. Everything else is just commentary.</p><h2>Establish Guardrails Before Launch</h2><p>The best teams prepare for both success and failure before they launch a single test. </p><p>Start by clearly articulating your hypothesis in a simple if-then statement: &#8220;If we change X, we expect Y result because of Z reasoning.&#8221; This forces clarity and prevents retroactive justification of random results.</p><p>Then set up guardrails that will pause your test if something goes wrong. If your core conversion metric drops by 10-20%, you want the test stopped immediately, not discovered days later when you finally check the dashboard. These guardrails protect your business while you&#8217;re experimenting. This is also something that I monitor manually when possible. </p><p>As testing programs scale, it gets harder to do that, but it&#8217;s advisable to automate this process. </p><h2>Run Your Tests With Discipline</h2><p>Once your test is live, monitor it carefully but resist the urge to make decisions based on early results. You should be checking your metrics regularly to ensure nothing is going catastrophically wrong, but checking to see if you&#8217;re winning is different from checking to make sure you&#8217;re not breaking things.</p><p>This is the trap of what we call &#8220;p-value peeking.&#8221; When you see your variant pulling ahead early, it&#8217;s incredibly tempting to call it a winner and ship it. But premature analysis based on incomplete data dramatically increases your chance of false positives. Early patterns often don&#8217;t hold as more data comes in.</p><p>So watch your test, absolutely. Set guardrails that will alert you if key metrics drop significantly. If your core conversion metric declines by 10-20%, pause the test immediately to investigate. You can always restart a test, but you can&#8217;t undo real damage to your business.</p><p>But don&#8217;t make positive decisions early. Set your timeline and trust it. Let the test run its full course before you declare a winner.</p><p>While you&#8217;re waiting, complement your quantitative data with qualitative feedback. Run user interviews, watch session recordings, gather context that numbers alone can&#8217;t provide. When your test concludes and you have results, this qualitative insight helps you understand not just what happened, but why it happened and what the actual user experience was like.</p><p>And if your results seem too good to be true, they probably are. Use Twyman&#8217;s Law as your gut check: any figure that looks interesting or different is usually wrong. When something seems unrealistic, run a replication test before you roll it out company-wide.</p><h2>Document Everything</h2><p>Yes, documentation feels tedious. Yes, it&#8217;s time consuming. And yes, it&#8217;s absolutely crucial. Record exactly what you tested, which metrics you tracked, what the outcomes were, and what decisions you made based on those outcomes.</p><p>This documentation becomes your team&#8217;s institutional memory. At Lendio, we maintained a central repository of experiments that anyone in the company could access. New team members could quickly learn from past tests. Product managers could avoid redundant experiments. Executives could understand the empirical foundation behind major product decisions. Without documentation, you&#8217;re doomed to repeat the same experiments over and over, learning nothing.</p><h2>Communicate Constantly</h2><p>The best testing programs aren&#8217;t run in isolation, they&#8217;re transparent and collaborative. Establish a clear communication cadence: pre-launch updates, launch announcements, kill updates when you pause tests, and results summaries when experiments conclude.</p><p>At Keep, Lendio and Forge we used dedicated Slack channels for experiments, ensuring stakeholders always knew what was running, why we were running it, and what we were learning. This transparency builds trust, prevents surprises, and helps everyone understand that good testing includes both wins and losses.</p><div><hr></div><p>Structured A/B testing isn&#8217;t just another process to follow, it&#8217;s your strongest tool for confident decision-making and measurable growth. When you move from ad-hoc experimentation to a disciplined testing framework, you transform uncertainty into actionable insights.</p><p>Stop spinning your wheels. Start making real, measurable progress today.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div>]]></content:encoded></item><item><title><![CDATA[How Ryan Trahan Turned 50 States into 200 Million Views]]></title><description><![CDATA[Ryan Trahan&#8217;s Airbnb series is quietly reshaping the way brands approach content marketing, and the math behind it is fascinating.]]></description><link>https://newsletter.experimentationlabs.com/p/how-ryan-trahan-turned-50-states</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/how-ryan-trahan-turned-50-states</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Fri, 18 Jul 2025 13:02:57 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!CzL4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!CzL4!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!CzL4!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!CzL4!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!CzL4!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!CzL4!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!CzL4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d85ea74a-1413-4463-892c-76045327a035_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3024156,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/168612025?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!CzL4!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!CzL4!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!CzL4!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!CzL4!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd85ea74a-1413-4463-892c-76045327a035_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><p>Ryan is currently 35 days into a challenge to visit all 50 states in 50 days, posting daily videos and raising millions for St. Jude Children's Research Hospital. To date, he's generated over 100 million views and raised more than $6.1 million in donations. Here's why that matters for brands and creators:</p><h2>Brands Spending Smarter</h2><p>Brands traditionally allocate large budgets to marketing campaigns with uncertain returns. Ryan&#8217;s series offers an engaging and cost-effective alternative. For instance, if Lectric Bikes spends $600,000 sponsoring Ryan&#8217;s series and achieves 200 million impressions, their cost per impression would be approximately $0.003 (a CPM of $3). Compared to the industry standard CPM of around $7, this represents exceptional value and highlights how engaging content partnerships can efficiently reach large audiences.</p><h2>Joyride and St. Jude: Creating Meaningful Impact</h2><p>Ryan smartly integrated his candy brand, Joyride, with the charitable cause of St. Jude Children's Research Hospital. This thoughtful integration allows Joyride to build lasting emotional connections with viewers. If just 5% of viewers (around 200,000 people) try Joyride, that is significant exposure. With an average spend of $4 per customer and an estimated four repeat purchases, just 10,000 loyal customers would translate into roughly $160,000 in customer lifetime value (LTV). Not bad for quick napkin math; the actual outcomes could be even stronger.</p><h2>Spotlighting Local Airbnbs</h2><p>Ryan&#8217;s journey across America naturally highlights local Airbnbs, showcasing unique stays in ways traditional advertising rarely matches. Each Airbnb featured receives organic exposure, and the winning location earns additional publicity, creating tangible value for hosts.</p><h2>Ryan&#8217;s Financial Reality (Quick Math)</h2><p>Beyond donations and brand partnerships, Ryan&#8217;s series also generates significant YouTube ad revenue. With a conservative CPM estimate of $7, each view generates around $0.007. At 200 million total views, Ryan&#8217;s series is projected to generate approximately $1.4 million from ads alone.</p><p>Sheesh.</p><h2>Who&#8217;s Winning from This Series?</h2><p>Ryan&#8217;s YouTube Channel: Enjoying substantial growth, increased views, and ad revenue.</p><p>Joyride (Ryan&#8217;s Candy Brand): Achieving meaningful brand exposure and measurable customer lifetime value.</p><p>Donors and Viewers: Engaging with a compelling cause and feeling part of something impactful.</p><p>Brands and Sponsors: Benefiting from authentic goodwill and positive visibility at a highly competitive cost per impression. Talk about bang for your buck.</p><p>St. Jude Children&#8217;s Research Hospital: Receiving essential financial support and increased public awareness.</p><p>Local Airbnbs: Gaining valuable organic visibility and enhanced recognition.</p><p>Ryan&#8217;s success stems from creating an interactive, authentic experience that genuinely engages communities. It goes beyond mere entertainment, showcasing marketing's true potential to drive meaningful impact.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div>]]></content:encoded></item><item><title><![CDATA[I Love Hustle Culture. It Just Doesn’t Love Me Back.]]></title><description><![CDATA[I&#8217;m up at 2:33am cleaning up someone else&#8217;s barf (which, if you think about it, technically makes me more productive than the 5am crew) and making sure it doesn&#8217;t fall onto another kid's face.]]></description><link>https://newsletter.experimentationlabs.com/p/i-love-hustle-culture-it-just-doesnt</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/i-love-hustle-culture-it-just-doesnt</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 02 Jun 2025 13:02:52 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!1KFp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!1KFp!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!1KFp!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!1KFp!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!1KFp!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!1KFp!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!1KFp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3002844,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/164023674?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!1KFp!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!1KFp!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!1KFp!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!1KFp!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F135ceebf-96c1-4455-b6d4-855cfab24b7f_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I&#8217;m a sucker for productivity advice.</p><p>Show me a YouTube guy in a fitted tee talking about cold plunges and 5am sprints, and I&#8217;m in. I&#8217;ll even take notes. </p><p>But there&#8217;s a problem.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>If you don&#8217;t share this, I&#8217;ll assume you have a perfectly optimized life and no children. Must be nice.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>Those guys? They don&#8217;t live the same life I do.</p><p>They&#8217;re single. No kids. Living in a high-rise with no furniture. Their biggest morning obstacle is whether to drink mushroom coffee or butter coffee.</p><p>Meanwhile, I&#8217;m up at 2:33am cleaning up someone else&#8217;s barf (which, if you think about it, technically makes me more productive than the 5am crew) and making sure it doesn&#8217;t fall onto another kid's face in the bottom bunk. </p><p>I&#8217;m in the ultra-elite, toddler-induced pre-dawn grind set. </p><p>Honestly, I should probably sell a course about it or start a podcast called 'Barf &amp; Brilliance&#8217; or &#8216;Diaper Deadlifts&#8217;. </p><p>Whatever, you get the point.</p><p>By 7:30am, I&#8217;m not journaling, I&#8217;m negotiating a ceasefire over frozen waffles or making sure the insurgents don&#8217;t burn the house to the ground with toast cooked at the toaster&#8217;s 9 setting. Then I get to fight over why you can&#8217;t wear your doggy shirt for the 4th day in a row.</p><p>Bonus points if I manage to make my own breakfast without stepping on a Lego or accidentally backing into a kid. Oh, and also you or your significant other woke up sick, again, for the 3rd time this month. Thanks Kindergarten. </p><p>By 9am, the Hustle Bro has crushed his deep work session, posted twice on LinkedIn, answered emails, and is halfway through a kettlebell workout. I&#8217;ve survived breakfast combat, refereed an argument about keeping oatmeal in your bowls, and maybe put on pants.</p><p>They say to &#8220;grind in the evenings&#8221; too. Which is hilarious. </p><p>Evenings in my house are less &#8220;grind&#8221; and more &#8220;boss level.&#8221; You ever try to get three overtired kids to brush their teeth at the same time? </p><p>I&#8217;d rather launch a startup. </p><p>At least in a startup, no one cries because their toothpaste is the wrong color or doesn&#8217;t have a picture of a Pok&#233;mon on it.</p><p>Working out? I want to work out. I really do. </p><p>Some mornings I sneak in a workout with my three tiny training partners climbing on me like I&#8217;m a jungle gym. I do squats, they do pull-ups on my thighs. I do pushups, they climb dad hurdles.</p><p>This is the part hustle culture doesn&#8217;t account for. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!YyT1!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!YyT1!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!YyT1!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!YyT1!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!YyT1!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!YyT1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3007208,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/164023674?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!YyT1!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!YyT1!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!YyT1!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!YyT1!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe0b72982-6cd5-4982-9d9a-0ccd25807230_1536x1024.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>The variable of real life. </p><p>The part where optimizing your calendar doesn&#8217;t help when someone throws up on it. </p><p>Where the 5am club is involuntary, and includes a toddler demanding &#8220;tucky in.&#8221;</p><p>Look, I admire the hustle. I genuinely do. I love the idea of pushing yourself. </p><p>This isn&#8217;t some passive-aggressive excuse for not trying hard, it&#8217;s just a different kind of hard. It&#8217;s not a lack of ambition, it&#8217;s a redistribution of energy. And sometimes that energy goes to wiping a nose or managing a meltdown instead of launching a SaaS product. </p><p>But let&#8217;s be honest: the hustle bro's life is an edge case. Optimized to the point of unreality. It&#8217;s like trying to benchmark your daily routine against a robot that doesn&#8217;t eat, sleep, or ever forget where they put their keys. </p><p>It&#8217;s what happens when you remove friction: no kids, no community obligations, no commute, no birthday parties at trampoline parks.</p><p>And that's fine. But it&#8217;s not replicable for the majority of us. Not if you&#8217;re trying to raise actual humans. Or show up for your neighborhood. Or just be the kind of person who remembers to take the trash out before the truck comes.</p><p>I&#8217;ve seen the posts. &#8220;Work 12 hours a day for 10 years so you never have to work again.&#8221; </p><p>Cool. </p><p>But also: who&#8217;s making dinner? </p><p>Who&#8217;s coaching little league? </p><p>Who&#8217;s helping their neighbor move a couch?</p><p>Because here&#8217;s the part you don&#8217;t hear on those podcasts: </p><p>Sometimes the highest-leverage thing you can do is sit on the floor and play Legos with a four-year-old. </p><p>Not because it scales. </p><p>But because it doesn&#8217;t. </p><p>Harvard Business Review never ran that case study.</p><p>And I get it, those things don&#8217;t make great LinkedIn content. </p><p>&#8220;Skipped deep work today to clean crayon off the walls. Again.&#8221; </p><p>But that&#8217;s the work, too. It&#8217;s just quieter. Stickier. Occasionally smells like feet.</p><p>So yeah, I&#8217;m envious of the hustle bros sometimes. </p><p>Their lives look clean. </p><p>Efficient. </p><p>Bathed in morning light. </p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!SLFd!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!SLFd!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!SLFd!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!SLFd!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!SLFd!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!SLFd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3327788,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/164023674?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!SLFd!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!SLFd!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!SLFd!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!SLFd!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3638e645-bcc3-4a94-9427-c94c7e4a49de_1536x1024.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p></p><p>But I also wonder: </p><p>What&#8217;s all that optimization for? </p><p>What&#8217;s the endgame? </p><p>Are you building something people can be part of&#8212;or just something people can look at?</p><p>Maybe the real flex isn&#8217;t getting up at 5am. </p><p>Maybe it&#8217;s showing up, again and again, for the stuff that doesn&#8217;t scale. </p><p>And let&#8217;s be clear, that doesn&#8217;t mean it&#8217;s easier. </p><p>It means it&#8217;s messier. Less efficient. More emotionally exhausting. </p><p>It&#8217;s not opting out of hard work, it&#8217;s choosing the version with more crying, more cleaning, and way fewer Instagrammable moments.</p><p>And if you&#8217;re doing that, if you&#8217;re juggling a job, a family, a community, and still finding moments to chase your ambition, congrats. </p><p>You&#8217;re not behind. </p><p>You&#8217;re playing a different game entirely.</p><p>One where the prize isn&#8217;t productivity. </p><p>It&#8217;s people and a life that&#8217;s lived in, not looked at. </p><p>And yeah, it&#8217;s exhausting. </p><p>It&#8217;s demanding in ways that don&#8217;t show up on charts or dashboards. </p><p>But that doesn&#8217;t make it any less of a grind, just a different one.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/p/i-love-hustle-culture-it-just-doesnt?utm_source=substack&utm_medium=email&utm_content=share&action=share&quot;,&quot;text&quot;:&quot;Share&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/p/i-love-hustle-culture-it-just-doesnt?utm_source=substack&utm_medium=email&utm_content=share&action=share"><span>Share</span></a></p><p></p>]]></content:encoded></item><item><title><![CDATA[The Lab Report: Growth PMs vs. CROs - What Is The Actual Difference? ]]></title><description><![CDATA[Why do so many companies conflate the two when the work, the scope, and the outcomes couldn&#8217;t be more different?]]></description><link>https://newsletter.experimentationlabs.com/p/the-lab-report-growth-pms-vs-cros</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/the-lab-report-growth-pms-vs-cros</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 26 May 2025 13:01:11 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!kfym!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!kfym!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!kfym!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!kfym!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!kfym!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!kfym!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!kfym!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3197526,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162633050?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!kfym!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!kfym!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!kfym!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!kfym!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F2311f123-2c18-4798-a3b7-8abb29049457_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Welcome to a new series I&#8217;m calling &#8220;The Lab Report&#8221;. The Lab Report is a deep dive into an interesting topic, so if you have some ideas shoot them my way!</p><p>This weeks post is focused on comparing CRO to Growth Product Management roles, something I&#8217;ve been thinking a lot lately. Enjoy and please leave any feedback! </p><p>Without further adieu&#8230;</p><h1>Growth PMs vs. CROs - What Is The Actual Difference?</h1><p>What&#8217;s the actual difference between a CRO and a Growth PM and why do so many companies conflate the two when the work, the scope, and the outcomes couldn&#8217;t be more different?</p><p>They both run experiments. They both chase conversion metrics. They both speak fluent A/B.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>You could subscribe. Or you could wait until this shows up in a Slack thread with no context. Totally your call.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>But beneath the surface, these roles operate on very different levels. One is focused on squeezing value out of existing traffic. The other is designing systems that fundamentally change how the product grows. And yes, that difference shows up in the org chart, the scope of influence, and ultimately, the paycheck.</p><p>Studying compensation for CROs and Growth PMs led me down a rabbit hole that turned into this post. If you saw my earlier breakdown on <a href="https://newsletter.experimentationlabs.com/p/conversion-rate-optimization-vs-growth">Conversion Rate Optimization vs. Growth</a>, that was the overview. This one zooms in on the roles and the org charts.</p><div><hr></div><h2>Day-to-Day Work: Zoomed-In vs. Zoomed-Out Optimization</h2><p>Let&#8217;s just say this: if your job feels like interior decorating for landing pages, you&#8217;re probably doing CRO. If it feels like you&#8217;re quietly rearranging how the entire company thinks about user retention, that&#8217;s more Growth PM energy.</p><p>CROs typically operate in the marketing department, where they are responsible for squeezing performance improvements out of existing touch points. This can include optimizing landing pages, tweaking form designs, running headline tests, and analyzing bounce rates. The work is tactical and often campaign-driven, focused on how to turn a specific ad click or site visit into a measurable action like a sign up or purchase. Success is usually tracked on a short-term basis: Did this test improve conversion by 3%? If yes, implement. If not, move on.</p><p>In contrast, Growth PMs work within the product team, where their mandate spans the full user lifecycle from acquisition and activation to retention and monetization. They own growth at a systems level. That means they&#8217;re responsible not just for whether someone signs up, but whether that person sticks around, finds value, and contributes to long-term business outcomes. Their work might include rethinking onboarding, launching in-product referrals, designing monetization features, or identifying drop-offs in the activation flow. The time horizon is longer, and the stakes are higher.</p><div><hr></div><h2>Experimentation Approaches: Surface Tweaks vs. Infrastructure Changes</h2><p>CROs live in the world of fast wins and faster tests. It&#8217;s the digital equivalent of, &#8220;Let&#8217;s see if people click more when it&#8217;s blue.&#8221; Growth PMs, on the other hand, are the ones asking, &#8220;What if the whole onboarding flow is the problem?&#8221; One runs sprint drills. The other is playing a long game with a whiteboard and way too many sticky notes.</p><p>Both CROs and Growth PMs rely heavily on experimentation. But the experiments they run, and the implications of those experiments, differ significantly.</p><p>CROs tend to focus on rapid testing cycles. These are experiments with low implementation cost and minimal downstream risk like comparing different CTA styles, button placements, or hero images. The tools used (Google Optimize, Optimizely, etc.) are generally plug-and-play and designed for fast, visual iteration. CROs look for statistical significance on relatively high-traffic pages and aim for steady, incremental gains.</p><p>Growth PMs, meanwhile, often lead experiments that require code changes and coordination across engineering, design, and analytics. These aren&#8217;t just visual tweaks they&#8217;re infrastructure-level bets. A Growth PM might redesign a mobile onboarding sequence, test different pricing models behind a feature flag, or roll out a new retention mechanism. The feedback loops are longer, and the interpretation of results often requires a more nuanced understanding of behavioral data over time.</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!hL8r!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!hL8r!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!hL8r!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!hL8r!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!hL8r!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!hL8r!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3443656,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162633050?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!hL8r!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!hL8r!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!hL8r!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!hL8r!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F8b1f0926-f109-4c77-a9e9-a04e97b872ff_1536x1024.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div><hr></div><h2>Metrics and Measurement: Snapshot KPIs vs. Lifecycle Health</h2><p>You can tell what someone cares about by what they measure. CROs are watching the front door like hawks. Growth PMs are the ones pacing the hallway, wondering why guests came, stayed for five minutes, and left without saying goodbye.</p><p>CROs track metrics like:</p><ul><li><p>Page-level conversion rate</p></li><li><p>Bounce rate and exit rate</p></li><li><p>CTRs and cost-per-conversion</p></li><li><p>Funnel drop-off at specific marketing stages</p></li></ul><p>Their success is often defined by how effectively they can convert traffic into leads or customers, using a known set of acquisition levers.</p><p>Growth PMs, on the other hand, are held accountable for:</p><ul><li><p>Activation rates (e.g., % of users reaching first value)</p></li><li><p>Retention cohorts and churn curves</p></li><li><p>Revenue per user or LTV</p></li><li><p>Overall growth model performance (e.g., virality, monetization lift)</p></li></ul><p>Their job is to make sure users don&#8217;t just show up but stick around and generate value over time. They&#8217;re optimizing for compound growth, not campaign ROI.</p><div><hr></div><h2>Org Design and Influence</h2><p>CROs often report to marketing leadership and collaborate most closely with performance marketers, content writers, and designers. Their work tends to align with campaign timelines and short-term goals. When site changes require engineering support, they often have to lobby for prioritization or workaround using third-party tools.</p><p>Growth PMs typically sit in a cross-functional product pod and have dedicated engineering and design support. They report into product leadership (sometimes directly into the CPO) and are expected to contribute to strategic planning. Because they touch revenue, retention, and scalability, they often present directly to the executive team and are expected to show impact at a business level.</p><p>In mature orgs, Growth PMs help define how the product grows. CROs help ensure that the acquisition efforts are converting as efficiently as possible.</p><div><hr></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!yiwF!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!yiwF!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!yiwF!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!yiwF!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!yiwF!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!yiwF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3694b215-db3a-45f2-939b-01731004b966_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3188429,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162633050?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!yiwF!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!yiwF!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!yiwF!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!yiwF!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3694b215-db3a-45f2-939b-01731004b966_1536x1024.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Compensation Disparities: Scope, Strategy, Scarcity</h2><p>The reason Growth PMs generally get paid more comes down to scope and leverage. Growth PMs are expected to:</p><ul><li><p>Think across time horizons</p></li><li><p>Make decisions that affect product and business strategy</p></li><li><p>Orchestrate large, cross-functional initiatives</p></li></ul><p>CROs, while critical to performance marketing, tend to operate within narrower boundaries. Their experiments are more reversible, and the impact is typically constrained to top-of-funnel outcomes.</p><p>U.S. salary ranges:</p><ul><li><p>CRO Specialist or Manager: $70K&#8211;$130K</p></li><li><p>Growth Product Manager: $130K&#8211;$200K+</p></li><li><p>Head of Growth: $180K&#8211;$250K+ (plus equity, depending on company stage)</p></li></ul><div><hr></div><h2>Context Matters: Startup vs. Enterprise</h2><p>At a startup, job titles are more like rough guesses based on whoever last edited the job posting. One day you&#8217;re optimizing landing pages, the next you&#8217;re trying to convince the CEO that a 10-minute onboarding is maybe not the move. In an enterprise, things get a little more orderly or at least the chaos is hidden behind a few layers of process.</p><p>In startups, roles tend to be fluid. A Growth PM might be running Facebook ads one day and scoping onboarding UX the next. A CRO expert might find themselves owning the entire growth stack until the team matures. Titles are often misleading; execution trumps specialization.</p><p>In enterprises, the roles are more clearly defined:</p><ul><li><p>CROs focus on conversion optimization across digital campaigns and site assets</p></li><li><p>Growth PMs work within product to increase engagement, retention, and LTV</p></li></ul><p>Some companies spin up centralized growth teams with full-stack support. Others embed Growth PMs across squads. But the general trend is toward product-led growth owning retention and revenue, while marketing continues to drive top-of-funnel acquisition.</p><div><hr></div><h2>Summary: Different Roles, Shared Goals</h2><p>If you're still not sure which role is which, just ask: is this person rearranging traffic or rethinking systems? One tunes the engine. The other rebuilds it in traffic with a Slack thread blowing up.</p><p>CROs and Growth PMs both operate within an experimentation culture but the nature of what they optimize and how they drive growth is fundamentally different. CROs maximize the performance of the systems that already exist. Growth PMs design and iterate on the systems themselves.</p><p>If your site traffic is healthy but conversions are weak, hire a CRO. If users sign up but don&#8217;t stick around, hire a Growth PM. And if you&#8217;re early stage and trying to decide which role to prioritize? Start with someone who can think like a PM but execute like a marketer until the complexity demands you split the role.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><div><hr></div><h2>Sources and References</h2><ol><li><p>Glassdoor &#8211; Conversion Rate Optimization Specialist salary: <a href="https://www.glassdoor.com/Salaries/conversion-rate-optimization-specialist-salary-SRCH_KO0%2C39.htm">https://www.glassdoor.com/Salaries/conversion-rate-optimization-specialist-salary-SRCH_KO0%2C39.htm</a></p></li><li><p>ZipRecruiter &#8211; CRO Specialist salary: <a href="https://www.ziprecruiter.com/Salaries/Conversion-Rate-Optimization-Specialist-Salary">https://www.ziprecruiter.com/Salaries/Conversion-Rate-Optimization-Specialist-Salary</a></p></li><li><p>Built In &#8211; CRO Manager (Prodege LLC): <a href="https://builtin.com/job/conversion-rate-optimization-manager/2428372">https://builtin.com/job/conversion-rate-optimization-manager/2428372</a></p></li><li><p>Chime &#8211; CRO Manager, Web: <a href="https://careers.chime.com/en/jobs/7958856002/conversion-rate-optimization-manager-web/">https://careers.chime.com/en/jobs/7958856002/conversion-rate-optimization-manager-web/</a></p></li><li><p>Greenhouse &#8211; Growth PM (Robinhood): <a href="https://job-boards.greenhouse.io/robinhood/jobs/6566145">https://job-boards.greenhouse.io/robinhood/jobs/6566145</a></p></li><li><p>Medium &#8211; Growth PM vs Marketing vs Manager (Omamuzo Samson): <a href="https://oma1da.medium.com/growth-product-manager-vs-growth-marketing-manager-vs-growth-manager-whats-the-difference-b78fd6a60676">https://oma1da.medium.com/growth-product-manager-vs-growth-marketing-manager-vs-growth-manager-whats-the-difference-b78fd6a60676</a></p></li><li><p>Productboard Blog &#8211; Core vs Growth PM: <a href="https://www.productboard.com/blog/what-core-and-growth-product-managers-can-teach-each-other/">https://www.productboard.com/blog/what-core-and-growth-product-managers-can-teach-each-other/</a></p></li><li><p>Lenny&#8217;s Newsletter &#8211; Hiring for Growth (Elena Verna): </p></li></ol><div class="embedded-post-wrap" data-attrs="{&quot;id&quot;:43620057,&quot;url&quot;:&quot;https://www.lennysnewsletter.com/p/hiring-growth&quot;,&quot;publication_id&quot;:10845,&quot;publication_name&quot;:&quot;Lenny's Newsletter&quot;,&quot;publication_logo_url&quot;:&quot;https://substackcdn.com/image/fetch/f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F441213db-4824-4e48-9d28-a3a18952cbfc_592x592.png&quot;,&quot;title&quot;:&quot;Six rules of hiring for growth&quot;,&quot;truncated_body_text&quot;:&quot;&#128075; Hey, Lenny here! Welcome to the monthly &#10024; free edition &#10024; of my weekly newsletter. If you&#8217;re not a subscriber, here&#8217;s what you missed this month:&quot;,&quot;date&quot;:&quot;2021-11-09T16:25:35.411Z&quot;,&quot;like_count&quot;:75,&quot;comment_count&quot;:2,&quot;bylines&quot;:[{&quot;id&quot;:3478323,&quot;name&quot;:&quot;Elena Verna&quot;,&quot;handle&quot;:&quot;plgrowth&quot;,&quot;previous_name&quot;:null,&quot;photo_url&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/6eeab89f-c508-46ec-91a1-9e8e3ce3021a_1926x2892.jpeg&quot;,&quot;bio&quot;:&quot;Always be learning. \nCurrently doing growth at dropbox. Previously surveymonkey, miro, amplitude, netlify. Advised mongodb, clockwise, sanity.io, krisp, and many more. &quot;,&quot;profile_set_up_at&quot;:&quot;2021-11-10T19:00:26.905Z&quot;,&quot;reader_installed_at&quot;:&quot;2023-02-24T20:44:47.139Z&quot;,&quot;twitter_screen_name&quot;:&quot;ElenaVerna&quot;,&quot;is_guest&quot;:true,&quot;bestseller_tier&quot;:100,&quot;primaryPublicationId&quot;:1435249,&quot;primaryPublicationName&quot;:&quot;Elena's Growth Scoop&quot;,&quot;primaryPublicationUrl&quot;:&quot;https://www.elenaverna.com&quot;,&quot;primaryPublicationSubscribeUrl&quot;:&quot;https://www.elenaverna.com/subscribe?&quot;}],&quot;utm_campaign&quot;:null,&quot;belowTheFold&quot;:true,&quot;type&quot;:&quot;newsletter&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="EmbeddedPostToDOM"><a class="embedded-post" native="true" href="https://www.lennysnewsletter.com/p/hiring-growth?utm_source=substack&amp;utm_campaign=post_embed&amp;utm_medium=web"><div class="embedded-post-header"><img class="embedded-post-publication-logo" src="https://substackcdn.com/image/fetch/$s_!8MSN!,w_56,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F441213db-4824-4e48-9d28-a3a18952cbfc_592x592.png" loading="lazy"><span class="embedded-post-publication-name">Lenny's Newsletter</span></div><div class="embedded-post-title-wrapper"><div class="embedded-post-title">Six rules of hiring for growth</div></div><div class="embedded-post-body">&#128075; Hey, Lenny here! Welcome to the monthly &#10024; free edition &#10024; of my weekly newsletter. If you&#8217;re not a subscriber, here&#8217;s what you missed this month&#8230;</div><div class="embedded-post-cta-wrapper"><span class="embedded-post-cta">Read more</span></div><div class="embedded-post-meta">4 years ago &#183; 75 likes &#183; 2 comments &#183; Elena Verna</div></a></div><ol><li><p>Reddit &#8211; WTF is a Growth PM: <a href="https://www.reddit.com/r/ProductManagement/comments/su0izr/wtf_is_a_growth_pm/">https://www.reddit.com/r/ProductManagement/comments/su0izr/wtf_is_a_growth_pm/</a></p></li><li><p>Medium &#8211; Growth vs Marketing (Daphne Tideman): <a href="https://medium.com/better-marketing/growth-isnt-marketing-f0bf614ec0ce">https://medium.com/better-marketing/growth-isnt-marketing-f0bf614ec0ce</a></p></li><li><p>Built In &#8211; Senior Growth PM (ActiveCampaign): <a href="https://builtin.com/job/senior-growth-product-manager/3872503">https://builtin.com/job/senior-growth-product-manager/3872503</a></p></li><li><p>Built In &#8211; Product Growth Manager (LiveFlow): <a href="https://builtin.com/job/product-growth-manager/4774653">https://builtin.com/job/product-growth-manager/4774653</a></p></li><li><p>Built In &#8211; Growth PM, Experimentation (Quince): <a href="https://builtin.com/job/conversion-rate-optimization-cro-manager/2299070">https://builtin.com/job/conversion-rate-optimization-cro-manager/2299070</a></p></li><li><p>BlueSteps &#8211; CRO Manager (search): <a href="https://www.bluesteps.com/Opportunity/SearchResults?keywords=Conversion%20Rate%20Optimization%20Manager">https://www.bluesteps.com/Opportunity/SearchResults?keywords=Conversion%20Rate%20Optimization%20Manager</a></p></li><li><p>VWO &#8211; How to Master eCommerce CRO: <a href="https://vwo.com/blog/how-to-master-ecommerce-cro-interview-with-tomasz-mazur/">https://vwo.com/blog/how-to-master-ecommerce-cro-interview-with-tomasz-mazur/</a></p></li><li><p>PayScale &#8211; CRO Skill Salary: https://www.payscale.com/research/US/Skill=Conversion_Rate_Optimization_(CRO)/Salary</p></li><li><p>Omniconvert &#8211; Guide to Hiring a CRO Specialist: <a href="https://www.omniconvert.com/guide-to-hiring-a-cro-specialist/">https://www.omniconvert.com/guide-to-hiring-a-cro-specialist/</a></p></li><li><p>SmartWorkersHome &#8211; Sr. Growth PM (Cro Metrics): <a href="https://smartworkershome.com/jobs/senior-growth-product-manager-cro-metrics">https://smartworkershome.com/jobs/senior-growth-product-manager-cro-metrics</a></p></li></ol>]]></content:encoded></item><item><title><![CDATA[Which Vibe Coding Tool Should You Use: A Practical Comparison of v0, Bolt, Lovable, and Replit]]></title><description><![CDATA[I wanted to figure out which of the main vibe coding tools, v0, Bolt, Lovable, and Replit, work best in different scenarios.]]></description><link>https://newsletter.experimentationlabs.com/p/which-vibe-coding-tool-should-you</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/which-vibe-coding-tool-should-you</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 19 May 2025 13:02:33 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!2c-S!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!2c-S!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!2c-S!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!2c-S!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!2c-S!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!2c-S!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!2c-S!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3024443,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/161908191?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!2c-S!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!2c-S!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!2c-S!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!2c-S!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5fb01872-c7cd-40e1-86c4-6b6b237add1c_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>I wanted to figure out which of the main vibe coding tools, v0, Bolt, Lovable, and Replit, work best in different scenarios. To find out, I ran a test.</p><p>I gave each tool the same prompt: Build a web app that allows me to input a URL or upload a screenshot and then make variations to it for an A/B test.</p><p>After that initial prompt, I tailored follow up instructions based on each tool&#8217;s output to see how far you can get with targeted prompting and a little familiarity with how each tool behaves.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>Subscribe if you like watching me argue with AI until something kind of works.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><h2>The Task</h2><p>The prototype I wanted was simple in concept:</p><ul><li><p>Paste a URL or upload a screenshot</p></li><li><p>Visually select elements (like buttons or headlines)</p></li><li><p>Change styles or text</p></li><li><p>Save those variations for testing</p></li></ul><p>The goal was to streamline internal experimentation with a lightweight A/B testing editor.</p><h2>How Each Tool Performed</h2><h3>v0</h3><ul><li><p>It finished first, producing a barebones design quickly. But the app didn't work.</p></li><li><p>It removed the URL feature entirely and focused on image upload, which also didn't work.</p></li><li><p>When prompted about the broken functionality, it responded with a six-month roadmap, which didn't help fix the immediate issues.</p></li><li><p>Eventually, it got stuck trying to write code and couldn&#8217;t recover without additional direction.</p></li></ul><p><strong>Takeaway:</strong> It's good for quick UI sketches or mockups, but it tends to stall when the task requires thinking beyond the screen.</p><h3>Bolt</h3><ul><li><p>The first version had a well-structured, multi-screen interface, and the UI looked polished.</p></li><li><p>Neither the URL nor image uploader worked, and both attempts led to a broken screen.</p></li><li><p>In later prompts using the &#8220;Discuss&#8221; feature instead of &#8220;Build,&#8221; it came closer to understanding what was needed.</p></li><li><p>It appeared confident, but ultimately built the wrong things and couldn't get past the dummy image. It did better after restarting with more detailed instructions.</p></li></ul><p><strong>Takeaway:</strong> It's solid for prototyping user flows, but it needs more direction to deliver working features.</p><h3>Lovable</h3><ul><li><p>It broke early in the build, but eventually fixed itself and continued working.</p></li><li><p>It didn&#8217;t build a working version, but got close after two prompts. The app remained mostly a shell with no real functionality.</p></li><li><p>Despite that, it correctly inferred the need for a CORS solution and even asked to be prompted for refactoring, which showed a surprising level of self awareness.</p></li><li><p>After two hours of testing, the visual editor still wasn&#8217;t working, but Lovable had tackled more technical nuance than the others.</p></li></ul><p><strong>Takeaway:</strong> It's more intuitive than the others and shows potential when paired with clearer prompts and more iteration.</p><h3>Replit</h3><ul><li><p>Neither the URL input nor image upload worked initially.</p></li><li><p>When prompted to explain what was wrong, it offered a clear explanation of what needed to change and how to move forward.</p></li><li><p>It got to a working version fairly quickly after that, successfully pulling in the page with an iframe.</p></li><li><p>It still didn&#8217;t create variations, but the iframe integration and editor loading were functional and stable.</p></li></ul><p><strong>Takeaway:</strong> It's slower but more thorough, with stronger technical grounding. It's especially useful if you can write or interpret specs.</p><h2>Observations</h2><h3>Prompting Strategy Matters</h3><p>The tools worked better when:</p><ul><li><p>Prompts included clear technical details</p></li><li><p>Instructions were step by step</p></li></ul><h2>Using ChatGPT as a Senior Dev</h2><p>One approach that worked especially well was treating the AI&#8217;s output like it came from a junior developer, and then using ChatGPT as the senior engineer in the room.</p><p>After getting a partial or broken response from an editor, I&#8217;d summarize what it was trying to do, then give those notes to ChatGPT with this prompt:</p><p>"Assume these are notes from a junior dev. Act like a senior dev and write instructions back to them."</p><p>ChatGPT would respond with more structured, technically grounded directions. This process helped clarify the architecture, identify missing pieces, and improve the quality of my next prompt to the editor. It also helped me catch when I was being too vague or assuming the tool would fill in the gaps. In short, it created a loop where I could use one AI to upgrade the output of another.</p><p>ChatGPT was useful for translating fuzzy goals into specific tech specs, which made a big difference, until the details overwhelmed the editors.</p><h2>Quick Comparison</h2><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!JCZA!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!JCZA!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 424w, https://substackcdn.com/image/fetch/$s_!JCZA!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 848w, https://substackcdn.com/image/fetch/$s_!JCZA!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 1272w, https://substackcdn.com/image/fetch/$s_!JCZA!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!JCZA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png" width="1456" height="387" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:387,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:77544,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/161908191?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!JCZA!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 424w, https://substackcdn.com/image/fetch/$s_!JCZA!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 848w, https://substackcdn.com/image/fetch/$s_!JCZA!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 1272w, https://substackcdn.com/image/fetch/$s_!JCZA!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F26b98bc1-d752-4b99-9841-772702a2c760_1574x418.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Final Notes</h2><p>None of these tools just work. But they're each useful in the right context. What matters is how well you can guide them, and how well you understand the problem you're trying to solve.</p><p>If your task is well structured and you're clear with your inputs, these editors can accelerate your workflow and save time on early stage builds. They're not a replacement for engineering yet, but they're a great extension of your thinking process.</p><p>If you're experimenting with vibe coding tools, or want to build internal prototypes without spinning up a full dev team, this kind of testing can help you figure out where each tool fits.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p></p>]]></content:encoded></item><item><title><![CDATA[Conversion Rate Optimization vs. Growth Product Manager Salaries: A Straight-Up Comparison]]></title><description><![CDATA[There's a giant gap between CRO roles in marketing and Growth Product Manager roles in product.]]></description><link>https://newsletter.experimentationlabs.com/p/conversion-rate-optimization-vs-growth</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/conversion-rate-optimization-vs-growth</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 12 May 2025 13:00:59 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!Wumn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p>Let&#8217;s talk about salary bands. Specifically, the giant, awkward gap between CRO roles in marketing and Growth Product Manager roles in product.</p><p>This isn&#8217;t one of those posts where I tell you to quit your job and go become a PM. But I do want to talk about what most people don&#8217;t realize: there&#8217;s a serious pay gap between two roles that look really similar on the surface.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>You could subscribe. Or you could wait until someone forwards you this stuff three weeks late. Your call.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>I pulled some salary data. It isn't perfect, but I do think it tracks with what I&#8217;ve seen in the wild and what a lot of other folks have seen too.</p><p>Here's a side-by-side comparison of median base salaries across levels:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!Wumn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!Wumn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 424w, https://substackcdn.com/image/fetch/$s_!Wumn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 848w, https://substackcdn.com/image/fetch/$s_!Wumn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 1272w, https://substackcdn.com/image/fetch/$s_!Wumn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!Wumn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png" width="1456" height="868" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:868,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:188085,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!Wumn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 424w, https://substackcdn.com/image/fetch/$s_!Wumn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 848w, https://substackcdn.com/image/fetch/$s_!Wumn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 1272w, https://substackcdn.com/image/fetch/$s_!Wumn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F48cd81c6-cae2-45a1-ae19-a0fea7c24c08_1979x1180.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Bar chart comparing CRO and Growth PM median base salaries across levels</figcaption></figure></div><p>But before we get too far, let&#8217;s answer the obvious question:</p><h3>Is it fair to compare these roles?</h3><p>Kind of.</p><p>CRO and Growth Product Manager roles do share real overlap: Both are obsessed with user behavior and performance. Both rely on experimentation, iteration, and testing. Both require analytical chops and an eye for user experience.</p><p>But they also diverge in meaningful ways: Product roles tend to have broader ownership, roadmaps, cross functional alignment, long term feature development. CRO roles can be more focused, often tied closely to marketing campaigns or specific site flows.</p><p>So no, they&#8217;re not the same job. But they <em>are</em> close enough that the salary difference is worth noticing, especially when the work and mindset can look so similar on the ground.</p><p>Quick note: we&#8217;re focusing on CRO and Growth PMs here, but there are other experiment heavy paths worth mentioning, like data science. Plenty of data scientists live in the world of A/B tests and behavioral insights too. That&#8217;s a separate (and fascinating) rabbit hole, and we&#8217;ll save that comparison for another time.</p><p>Now, here&#8217;s what jumped out:</p><h3>A Real-World Example: Same Vibes, Very Different Salaries</h3><p>It&#8217;s one thing to look at charts. It&#8217;s another to see the gap in actual job postings.</p><p>Take this CRO Manager role at Chime:</p><ul><li><p><a href="https://careers.chime.com/en/jobs/7958856002/conversion-rate-optimization-manager-web/">Chime CRO Job Posting</a></p></li><li><p>Salary listed: $103,680 to $144,000</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!v7Vu!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!v7Vu!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 424w, https://substackcdn.com/image/fetch/$s_!v7Vu!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 848w, https://substackcdn.com/image/fetch/$s_!v7Vu!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 1272w, https://substackcdn.com/image/fetch/$s_!v7Vu!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!v7Vu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png" width="1456" height="1287" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/e4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1287,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:554130,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!v7Vu!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 424w, https://substackcdn.com/image/fetch/$s_!v7Vu!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 848w, https://substackcdn.com/image/fetch/$s_!v7Vu!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 1272w, https://substackcdn.com/image/fetch/$s_!v7Vu!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fe4c9162e-b5b9-4d63-b4c4-8d944fdcfe20_1692x1496.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!vT9n!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!vT9n!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 424w, https://substackcdn.com/image/fetch/$s_!vT9n!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 848w, https://substackcdn.com/image/fetch/$s_!vT9n!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 1272w, https://substackcdn.com/image/fetch/$s_!vT9n!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!vT9n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png" width="1456" height="808" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:808,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:331529,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!vT9n!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 424w, https://substackcdn.com/image/fetch/$s_!vT9n!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 848w, https://substackcdn.com/image/fetch/$s_!vT9n!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 1272w, https://substackcdn.com/image/fetch/$s_!vT9n!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F14a83f54-90aa-44a7-bc47-4863534de419_1672x928.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Now compare that to this Growth Product Manager role at Turno:</p><ul><li><p><a href="https://www.linkedin.com/jobs/view/growth-product-manager-at-turno-4210712337/">Turno GPM Job Posting</a></p></li><li><p>Salary listed: $135,000 to $165,000</p></li></ul><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!jntl!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!jntl!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 424w, https://substackcdn.com/image/fetch/$s_!jntl!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 848w, https://substackcdn.com/image/fetch/$s_!jntl!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 1272w, https://substackcdn.com/image/fetch/$s_!jntl!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!jntl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png" width="1380" height="1758" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/c5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1758,&quot;width&quot;:1380,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:423467,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!jntl!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 424w, https://substackcdn.com/image/fetch/$s_!jntl!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 848w, https://substackcdn.com/image/fetch/$s_!jntl!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 1272w, https://substackcdn.com/image/fetch/$s_!jntl!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fc5606bd5-3a1d-4391-abc6-8b07e97e214e_1380x1758.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Side note: this Turno role was even <a href="https://www.elenaverna.com/p/good-and-bad-growth-job-descriptions">highlighted by Elena Verna as a strong example of a well-defined growth position</a>, so this isn&#8217;t some weird outlier. </p><p>Same experimentation mindset. Very different compensation. Worth keeping in mind if you're navigating your next move.</p><p>CRO and Growth PM roles both live in the test and learn world. Behavior driven. Conversion obsessed. Iterative. But one of those roles tends to pay a lot more. Like, tens of thousands more.</p><p>You don&#8217;t have to be in love with money to find that interesting. It&#8217;s not just about the paycheck. It&#8217;s about responsibility, cognitive overhead, and what you&#8217;re signing up for.</p><p>And just to drive it home, here&#8217;s the percentage difference in pay by level:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!svwe!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!svwe!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 424w, https://substackcdn.com/image/fetch/$s_!svwe!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 848w, https://substackcdn.com/image/fetch/$s_!svwe!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 1272w, https://substackcdn.com/image/fetch/$s_!svwe!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!svwe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png" width="1204" height="979" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:979,&quot;width&quot;:1204,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:101398,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!svwe!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 424w, https://substackcdn.com/image/fetch/$s_!svwe!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 848w, https://substackcdn.com/image/fetch/$s_!svwe!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 1272w, https://substackcdn.com/image/fetch/$s_!svwe!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F11a7c367-638b-4e94-a854-a75915eb4984_1204x979.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Heatmap showing percent salary difference between CRO and Growth PM roles by level</figcaption></figure></div><p>Because here&#8217;s the thing:</p><p>Product roles usually ask more of you. Higher stakes. Broader business knowledge. Tighter engineering collaboration. There&#8217;s no tidy entry path into product from most universities, so getting in is more about who you know and what you&#8217;ve done. </p><p>Marketing is a little more glamorized (thanks, Don Draper). Product is more specialized. And structurally, product roles go higher. Ever heard of a VP of CRO? Yea me either.</p><p>If you want to see how it plays out over time, here&#8217;s how salary growth compares by experience:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!lgZM!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!lgZM!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 424w, https://substackcdn.com/image/fetch/$s_!lgZM!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 848w, https://substackcdn.com/image/fetch/$s_!lgZM!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 1272w, https://substackcdn.com/image/fetch/$s_!lgZM!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!lgZM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png" width="1180" height="980" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:980,&quot;width&quot;:1180,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:133115,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!lgZM!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 424w, https://substackcdn.com/image/fetch/$s_!lgZM!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 848w, https://substackcdn.com/image/fetch/$s_!lgZM!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 1272w, https://substackcdn.com/image/fetch/$s_!lgZM!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F71059f45-d2e6-4d86-b2d7-6d9a6890841b_1180x980.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Line graph showing salary vs. years of experience for CRO and Growth PM roles</figcaption></figure></div><p>And if you're wondering where this all comes from, here's the raw data side-by-side:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!66l7!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!66l7!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 424w, https://substackcdn.com/image/fetch/$s_!66l7!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 848w, https://substackcdn.com/image/fetch/$s_!66l7!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 1272w, https://substackcdn.com/image/fetch/$s_!66l7!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!66l7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png" width="1456" height="1225" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1225,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:245478,&quot;alt&quot;:&quot;&quot;,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/162067879?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" title="" srcset="https://substackcdn.com/image/fetch/$s_!66l7!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 424w, https://substackcdn.com/image/fetch/$s_!66l7!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 848w, https://substackcdn.com/image/fetch/$s_!66l7!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 1272w, https://substackcdn.com/image/fetch/$s_!66l7!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F5d29f62a-eaa8-4b0e-b3d0-2688b4e87380_1666x1402.png 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a><figcaption class="image-caption">Table screenshot showing raw salary data side-by-side for CRO and Growth PM roles</figcaption></figure></div><p>None of this means you should bail on marketing. If you love it, stay. Seriously. Some people just have the instinct for it. And that&#8217;s not nothing.</p><p>But if you&#8217;ve been deep in CRO, if you love testing and building better experiences, it might be worth asking: what hill are you climbing?</p><p>It's also worth noting that titles can vary wildly from company to company, especially on marketing teams. A 'Manager' at one org might be a 'Senior' at another. These aren&#8217;t perfect, standardized ladders, they&#8217;re messy approximations. So take all this as directional, not gospel.</p><p>That said, if you are looking to move toward product, here&#8217;s the good news: You&#8217;re not starting from zero. Experience running experiments, understanding user behavior, and optimizing flows is highly transferable. With a little coaching or mentorship, you can start to pick up the product-specific parts like managing a roadmap or working closely with engineering. Some roles (like Growth PMs or Product Analysts) can be great stepping stones.</p><p>So no, you don&#8217;t need to pivot your whole career overnight. But you might be closer to product than you think.</p><p>And if you&#8217;re thinking about making the leap&#8230; well, you&#8217;re not alone.</p><p>(Just don&#8217;t expect a VP of CRO role to be waiting for you.)</p><h3>Sources and Credits</h3><p>A big thanks to the folks and platforms that provided this data that made this comparison possible:</p><ul><li><p><a href="https://www.experimentnation.com/salaries">Experiment Nation</a> for collecting and publishing CRO salary data.</p></li><li><p><a href="https://www.lennysnewsletter.com/p/how-much-product-managers-make-in">Lenny Rachitsky</a> for the breakdown of Product Manager compensation.</p></li><li><p><a href="https://www.payscale.com">Payscale</a>, <a href="https://www.salary.com">Salary.com</a>, and <a href="https://builtin.com">Built In</a> for additional benchmarks and ranges.</p></li><li><p><a href="https://www.elenaverna.com/p/good-and-bad-growth-job-descriptions">Elena Verna</a> for her insight on quality growth job descriptions and for spotlighting the Turno posting.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p></p></li></ul>]]></content:encoded></item><item><title><![CDATA[Drowning in Bad Leads? Here’s An Experiment That Fixed It For Me]]></title><description><![CDATA[But probably won't for you.]]></description><link>https://newsletter.experimentationlabs.com/p/drowning-in-bad-leads-heres-an-experiment</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/drowning-in-bad-leads-heres-an-experiment</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 05 May 2025 13:01:37 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!qfDa!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<p></p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!qfDa!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!qfDa!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!qfDa!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!qfDa!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!qfDa!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!qfDa!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/861a052b-79b8-4eac-b835-a66562692146_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3439721,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/161645793?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!qfDa!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!qfDa!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!qfDa!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!qfDa!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F861a052b-79b8-4eac-b835-a66562692146_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Want to watch/listen on YouTube?</p><div id="youtube2-0vl1ww4W2K0" class="youtube-wrap" data-attrs="{&quot;videoId&quot;:&quot;0vl1ww4W2K0&quot;,&quot;startTime&quot;:null,&quot;endTime&quot;:null}" data-component-name="Youtube2ToDOM"><div class="youtube-inner"><iframe src="https://www.youtube-nocookie.com/embed/0vl1ww4W2K0?rel=0&amp;autoplay=0&amp;showinfo=0&amp;enablejsapi=0" frameborder="0" loading="lazy" gesture="media" allow="autoplay; fullscreen" allowautoplay="true" allowfullscreen="true" width="728" height="409"></iframe></div></div><h2><strong>Diagnosing the Funnel Breakdown</strong></h2><p>I&#8217;ve been thinking a lot about intent lately specifically, what happens when the signals I think I'm getting turn out to be noise. </p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Subscribe, or don&#8217;t. (I hope you do though).</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>One example that sticks with me is from my time at Route, where a surprisingly high volume of consumers were submitting the merchant demo request form.</p><p>The form was built for prospective merchants interested in my B2B offering. </p><p>But week after week, the sales team was buried in low-quality leads. </p><p>Meanwhile, actual consumers people trying to track packages or resolve issues were hitting a wall. No one was winning. Not the sales team. Not the user.</p><p>I needed a fix. But more than that, I needed to understand what was really happening at that critical moment of intent.</p><h2><strong>The Experiment</strong></h2><p>So, I put together a scrappy landing page. Instead of letting users go straight to the demo form, I added a simple decision point: &#8220;Are you a merchant or a consumer?&#8221;</p><ul><li><p>If they said merchant, they got the original form.</p></li><li><p>If they said consumer, I showed them four clear options: track a package, download the app, file a claim, or read the FAQ.</p></li></ul><p>The build was quick and intentionally rough. The goal wasn&#8217;t polish, it was clarity.</p><h2><strong>What I Expected</strong></h2><p>I figured a majority of these form submissions weren&#8217;t real leads. </p><p>They were people confused about where to go or what the form was for. </p><p>If I could route them correctly, I could reduce noise in the pipeline and improve the experience for consumers.</p><h2><strong>What Happened</strong></h2><p>The experiment ran for just a few days. Here&#8217;s what I saw:</p><ul><li><p>11% drop in consumer submissions</p></li><li><p>18% increase in merchant submissions</p></li></ul><p><strong>Before:</strong> 143 total submissions, 89 from consumers (62%)<br><strong>After:</strong> 101 total submissions, 56 from consumers (55%)</p><p>Cleaner data. Better intent match. And for the first time in months, the sales team could focus on the right leads. Admittedly not the biggest sample size, but I had to move fast and leading indicators was enough to take action. </p><h3><strong>Consumer Click Behavior:</strong></h3><ul><li><p>46% &#8220;Track a package&#8221;</p></li><li><p>32% &#8220;Download the app&#8221;</p></li><li><p>10% &#8220;File a claim&#8221;</p></li><li><p>3% &#8220;FAQ&#8221;</p></li><li><p>7% &#8220;Other&#8221; (spam)</p></li></ul><p>It was clear with these results, these users weren't trying to talk to sales. They just didn&#8217;t know where else to go.</p><h2><strong>A Second Lens: Brand Ad Traffic</strong></h2><p>I ran the same flow on brand campaign traffic. That gave me a fresh look at ad intent:</p><ul><li><p>82% clicked &#8220;Track a package&#8221;</p></li><li><p>7% clicked &#8220;File a claim&#8221;</p></li><li><p>10% clicked &#8220;Merchant demo&#8221;</p></li></ul><p>This told me two things:</p><ol><li><p>I was attracting the wrong audience.</p></li><li><p>Even when people clicked a demo ad, many of them were just confused consumers.</p></li></ol><h2><strong>Where I Took It From There</strong></h2><p>Armed with these insights, I made three key moves:</p><ul><li><p>Working with our Paid team, we adjusted targeting and messaging to filter better-qualified traffic.</p></li><li><p>I partnered with the Consumer Marketing team to start building the resources consumers were actually looking for.</p></li><li><p>I rolled out a permanent experience that asked users if they were merchants or consumers, effectively implementing the winning version of the test.</p></li></ul><h2><strong>Why It Mattered</strong></h2><p>This test didn&#8217;t just clean up a form. It revealed a deeper truth about intent misalignment. Sales was wasting time. Consumers were getting ignored. And both issues stemmed from the same problema lack of clarity at the top of the funnel.</p><p>What worked wasn&#8217;t fancy. Just a quick page, a clear question, and a willingness to follow the data.</p><p>If you&#8217;re seeing conversion but not quality, check intent. That&#8217;s where the story usually starts.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p>Dan</p>]]></content:encoded></item><item><title><![CDATA[Ok, so like, what even is vibe coding?]]></title><description><![CDATA[Is it really a vibe?]]></description><link>https://newsletter.experimentationlabs.com/p/ok-so-like-what-even-is-vibe-coding</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/ok-so-like-what-even-is-vibe-coding</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 28 Apr 2025 13:01:13 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!pBjy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!pBjy!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!pBjy!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!pBjy!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!pBjy!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!pBjy!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!pBjy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2885469,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/161644341?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!pBjy!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!pBjy!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!pBjy!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!pBjy!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F03cdb742-8868-4f6f-8c8a-31b01d0cf412_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Maybe you&#8217;ve heard people talk about tools like Bolt, Cursor, or v0. Or you&#8217;ve seen someone spin up an app in five minutes flat and thought, "Wait, how did they do that?"</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Thanks for reading Experimentation Labs! Subscribe for free to receive new posts and support my work.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>That&#8217;s vibe coding. The term, as far as I know, was coined by Andrej Karpathy. It kind of perfectly captures what it feels like to build this way.</p><p>It's this strange, kind of magical experience where you open up a tool like Bolt, v0, Cursor, Replit, Lovable, or Windsurf and instead of writing code, you just start typing. Natural language. Prompts. Descriptions. Whatever comes to mind.</p><p>Then suddenly you&#8217;ve got an app. It&#8217;s not always perfect, but it works. And it&#8217;s fast. Way faster than opening up VS Code, setting up a repo, building a UI from scratch, debugging, and all the other stuff that used to feel like step zero.</p><h2>I Built Some Stuff Too</h2><p>I&#8217;ve been deep in it lately. Just over the past few weeks, I&#8217;ve built:</p><ul><li><p><a href="https://pokemon.experimentationlabs.com/">a Pok&#233;mon of the Day app</a></p></li><li><p><a href="https://analyze.experimentationlabs.com/">an A/B Test Analyzer</a></p></li><li><p><a href="https://prompts.experimentationlabs.com/">a Prompt Library</a></p></li><li><p><a href="https://planner.experimentationlabs.com/">a Test Plan Generator</a></p></li><li><p><a href="https://emoji.experimentationlabs.com/">an Emoji GIF Maker</a></p></li><li><p><a href="https://v0-memory-game-4x8ftpbso36-fymwzbjyk.vercel.app/">a memory game for my kids</a></p></li><li><p><a href="https://v0-toad-and-kirby-825taq2krqs-f5fqzlvy4.vercel.app/">a weird side scroller called "Toad and Kirby" that my 6 year old made up (Nintendo, please don&#8217;t sue)</a></p></li><li><p><a href="https://kennamartin.com/">A piano website for my wife</a></p></li><li><p><a href="https://luminous-wisp-ca123c.netlify.app/">and a RICE calculator</a></p></li></ul><p>Some of these took more than a day. Some were done in under an hour. The point isn&#8217;t that they&#8217;re polished, they&#8217;re not. The point is that they exist. And more importantly, they solve a problem or make someone laugh or let a 6 year old build something just by telling his dad what he wants.</p><p>This isn&#8217;t just no code. It&#8217;s <em>barely code</em>. And I think it&#8217;s how a lot of MVPs are going to get built going forward.</p><p>You don&#8217;t need to be an engineer to build something anymore. You just need a decent idea, a little patience, and the willingness to let the vibes take the wheel.</p><h2>How I'm using vibe coding as a Growth PM</h2><p>As a Growth Product Manager, this approach has been a game changer. Going from idea to prototype in an afternoon isn't just fun,  it's productive. I've been using vibe coding to spin up rough MVPs, test tools and interactive ideas before involving engineering. It's an incredibly empowering way to explore what's possible without needing to scope tickets or wait for sprint cycles.</p><p>Being able to go from natural language to a working prototype (or even a simple live app) helps me get feedback earlier, validate faster, and stay in the creative zone longer.</p><h2>The future of AI in product work</h2><p>As these tools get better, they're going to reshape how product teams operate. I don&#8217;t think it means fewer jobs  but I do think it means leaner teams, faster cycles, and a lot more output per head. That&#8217;s exciting.</p><p>This kind of shift can feel scary  big tech changes always do. But history shows we adapt. Jobs evolve, roles change, new industries appear. The key is to stay adaptable. Stay curious. Keep experimenting.</p><p>Right now I&#8217;m spending a lot of my time reading, studying, and actually <em>using</em> these tools. I want to be on the bleeding edge of this stuff. I want to know what they can do, and be the one pushing their boundaries.</p><p>Want to talk more about vibe coding or learn how to do it? Hit me up. </p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p>Dan</p>]]></content:encoded></item><item><title><![CDATA[I Built an AI Powered Test Plan Generator]]></title><description><![CDATA[And It Mostly Works (Most Of The Time)!]]></description><link>https://newsletter.experimentationlabs.com/p/i-built-an-ai-powered-test-plan-generator</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/i-built-an-ai-powered-test-plan-generator</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 21 Apr 2025 13:02:32 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!A-XU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!A-XU!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!A-XU!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!A-XU!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!A-XU!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!A-XU!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!A-XU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/d8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:2768200,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/157835942?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!A-XU!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!A-XU!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!A-XU!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!A-XU!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fd8bbc295-18b9-4fdc-8d43-df1e45840a91_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><h2>Why Test Plans Matter (Even If They Can Be a Pain)</h2><p>Writing test plans is important, but also kinda sucks. </p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption">Subscribe to my newsletter or don&#8217;t, cause ignoring solid experimentation advice is a great strategy too.</p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>Good Growth PMs and Experimenters need them to keep everyone aligned, ensure clear goals and help nail down the necessary stats like sample size, test duration, minimum detectable effect (MDE), and conversion rates (CVR). </p><p>So I spent the past couple of months building a tool to make writing test plans less tedious, vibe coding with Bolt.new and the OpenAI API. </p><p>It took a few iterations and a new feature roll out from Bolt but, I got it working (mostly) eventually.</p><p>Try it here: </p><p><a href="https://planner.experimentationlabs.com/">https://planner.experimentationlabs.com/</a></p><h2>Introducing the AI Powered Test Plan Generator</h2><p>The tool guides you through setting up your experiment: context, hypothesis, expected impact, experiment setup, success metrics, and variants. </p><p>Each section has an "Enhance with AI" button that taps GPT 4o to improve your draft, making your plan clearer and more professional, like having an experimentation expert edit your inputs and flesh them out.</p><h2>Highlights and Favorite Features:</h2><ul><li><p>Test duration calculator: Enter your traffic and statistical targets to instantly see how long your test should run. This attempts to cut out all the guesswork. Mostly all you need is data about your channel/source, current CVR and ideal testing stats (confidence, MDE, power, etc.)</p></li><li><p>AI Enhance feature that makes fleshes out your inputs like context, hypothesis. Makes it easier to sound like you know what you're talking about. Also occasionally brings in something I hadn't considered, some good reason to do the thing.</p></li></ul><h2>Stuff I Learned Along The Way</h2><ul><li><p>I'm still pretty new to databases . Connecting everything together proved tricky, but working through the problems gave me a deeper understanding of databases in general. I'm still not an expert, but I'm understanding it a lot more, thanks Supabase. </p></li><li><p>I ran into some initial problems integrating the OpenAI API. A timely Bolt update simplified the deployment process significantly. It's probably not bulletproof from a security standpoint yet, but good enough for personal and internal use.</p></li><li><p>Throughout this project, I realized the value of clearly phrasing questions to GPT models. Asking for explanations in simple terms was key to solving the unexpected issues that popped up.</p></li><li><p>The tool is built with React, TypeScript, and Tailwind (the Bolt stack) and allows you to export your completed test plans directly to PDF or PowerPoint, making sharing and presenting straightforward. There are some things I'd like to update in the future with the export feature, but I'm honestly not sure what's even possible there, TBD. </p></li></ul><h2>Results in Real Life</h2><p>I've used this for several recent test plans, here are a few examples of the AI enhanced output: </p><h3>Context</h3><p>We want to test which type of imagery works best for paid landing pages targeting the buyer audience. We plan to test 3 different versions, but in an unorthodox way. We will roll out a new version as a control and then launch 2 different versions, so control vs variant a vs variant b. </p><h4>Notes</h4><p>This was actually a pretty good output, I basically just brain dumped an unorthodox test idea into the input and it was able to take it and make sense of it, output wasn't bad.</p><h3>Context</h3><p>We're running an A/B test on the homepage hero section, comparing the current header with the wave design against the same copy paired with product imagery inspired by the new design direction. The goal is to assess which version drives better engagement and conversions.</p><h4>Notes</h4><p>The input here was pretty loose, in fact I just copy and pasted a request from a stakeholder, then it took it and turned it into something usable. I was pretty happy with that. </p><h2>Next Steps (And a Question for You)</h2><p>I plan to write more about this process soon, but I'd really like your input:</p><ul><li><p>What frustrates you most about test planning?</p></li><li><p>Are you currently using AI tools in your workflow?</p></li><li><p>What insights would you find valuable about building similar AI driven tools?</p></li></ul><p>Shoot me a message, I'd love to hear from you.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p>Dan</p>]]></content:encoded></item><item><title><![CDATA[I used AI to figure out how I work best. You can too.]]></title><description><![CDATA[Why do some tasks feel effortless, while others drain you before lunch?]]></description><link>https://newsletter.experimentationlabs.com/p/i-used-ai-to-figure-out-how-i-work</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/i-used-ai-to-figure-out-how-i-work</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Mon, 14 Apr 2025 13:02:57 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!IjNn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!IjNn!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!IjNn!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!IjNn!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!IjNn!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!IjNn!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!IjNn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png" width="1456" height="971" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:971,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:3971904,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/png&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/160799217?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!IjNn!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 424w, https://substackcdn.com/image/fetch/$s_!IjNn!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 848w, https://substackcdn.com/image/fetch/$s_!IjNn!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 1272w, https://substackcdn.com/image/fetch/$s_!IjNn!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2F3068cc5d-fd46-4798-bfc6-5ec380dd49da_1536x1024.png 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>That&#8217;s not just preference. It&#8217;s a pattern. And the sooner you figure out how you actually like to work, the better your choices get.</p><p>I wanted to see what my own patterns looked like, so I used AI to help me find them.</p><p>Here&#8217;s what I did and what it showed me.</p><p class="button-wrapper" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe now&quot;,&quot;action&quot;:null,&quot;class&quot;:null}" data-component-name="ButtonCreateButton"><a class="button primary" href="https://newsletter.experimentationlabs.com/subscribe?"><span>Subscribe now</span></a></p><h3>Step 1: Ask better questions</h3><p>There&#8217;s a book called <em>Job Moves</em> by Ethan Bernstein, Michael B. Horn, and Bob Moesta. It&#8217;s full of questions designed to help you get clear on how you work. Not what looks good on a resume. What actually feels good to do.</p><p>I picked a few and answered them honestly. Then I asked ChatGPT to answer the same questions about me, based on what it&#8217;s picked up from our past conversations.</p><p>Not "pretend to be me." Just this:</p><p><strong>"You&#8217;ve seen how I think. How would you answer these questions about me?"</strong></p><p>Here&#8217;s what I asked:</p><ul><li><p>What kinds of tasks give me energy</p></li><li><p>What kinds of tasks drain me</p></li><li><p>When have I felt the most fulfilled doing something</p></li><li><p>What exactly about micromanagement bothers me</p></li><li><p>Why do I prefer autonomy</p></li><li><p>What problems do I like solving, and how do I approach them</p></li><li><p>How do I respond to unclear expectations</p></li><li><p>When am I most productive, and why</p></li><li><p>When do I feel most engaged</p></li></ul><h3>Step 2: Let AI reflect it back</h3><p>I dropped in my answers. Then I added ChatGPT&#8217;s version. Finally, I asked:</p><p><strong>"What patterns do you notice?"</strong></p><p>It came back with something surprisingly structured. It didn&#8217;t just spit out vague traits or personality types. It mapped out how I work best, what shuts me down, and what actually matters.</p><p>Here&#8217;s what it gave me.</p><h2>Energy Drivers (What I Need Most)</h2><ol><li><p>I thrive when I have autonomy to choose how I work. This looks like being given outcomes and trust to find the best path. This should not look like someone assigning detailed steps or watching over my shoulder.</p></li><li><p>I need to work on problems that are interesting and meaningful to me. This looks like projects that challenge my thinking and have real impact. This should not look like repetitive tasks or vague assignments with no clear value.</p></li><li><p>I do my best work when I have deep, focused time to build, research, or think. This looks like large blocks of uninterrupted time and protection from Slack chaos. This should not look like constant meetings, pings, or shifting priorities.</p></li><li><p>I feel most engaged when there is clarity about what matters and why. This looks like strong leadership, clear roadmaps, and well communicated goals. This should not look like vague direction, unclear priorities, or daily pivots.</p></li><li><p>I&#8217;m energized by building things that help people or generate real value. This looks like working on tools, experiments, or insights that solve real problems. This should not look like busywork or optics focused tasks that don&#8217;t matter.</p></li><li><p>I enjoy working with a small team of smart, curious people. This looks like 2&#8211;4 thoughtful collaborators who challenge and support each other. This should not look like large, political teams or low-trust group work.</p></li><li><p>I need to be trusted and not micromanaged. This looks like being given ownership, not oversight. This should not look like needing to justify every decision or follow rigid processes.</p></li><li><p>I&#8217;m motivated when I&#8217;m learning something new, like systems, tools, or methods. This looks like solving new problems or exploring new tech with real purpose. This should not look like being forced to learn tools that don&#8217;t interest me or aren&#8217;t useful.</p></li><li><p>I appreciate being recognized for good judgment and smart work. This looks like people acknowledging when my thinking led to a smart outcome. This should not look like shallow praise or my contributions being overlooked.</p></li><li><p>I work best when I can follow a personal rhythm, like slow mornings and a thoughtful pace. This looks like flexible hours, async work, and trust in how I manage my day. This should not look like performative hustle culture or rigid 9-to-5 expectations.</p></li></ol><h3>What matters most</h3><p><strong>Must-haves</strong><br>If these are missing, I shut down.</p><ol><li><p>Autonomy to choose how I work</p></li><li><p>Problems that are interesting and meaningful</p></li><li><p>Deep, focused time</p></li><li><p>Clarity about priorities and goals</p></li><li><p>Being trusted, not managed</p></li></ol><p><strong>Nice-to-haves</strong><br>These make the experience better, but I can flex if the core stuff&#8217;s there.</p><ol><li><p>Building things that help people</p></li><li><p>Small teams with smart collaborators</p></li><li><p>Freedom to work at my own rhythm</p></li><li><p>Recognition for thoughtful work</p></li></ol><p><strong>Lower priority</strong><br>Still nice, but not dealbreakers.</p><ol><li><p>Learning new tools or methods, as long as they&#8217;re useful</p></li></ol><div><hr></div><h3>Why this works</h3><p>I didn&#8217;t just get a list of tasks I like. I got clarity on why they matter and what happens when they&#8217;re missing. It&#8217;s not about avoiding bad jobs. It&#8217;s about understanding what helps me do my best work in the first place.</p><p>That kind of insight changes everything. Most people never pause to get it. They just react.</p><p>This gave me language to make better decisions. That&#8217;s the real win.</p><div><hr></div><h3>Try it for yourself</h3><ol><li><p>Copy the questions above</p></li><li><p>Answer them honestly</p></li><li><p>Ask ChatGPT to answer them too, based on your previous chats</p></li><li><p>Then ask, "What patterns do you notice"</p></li></ol><p>You don&#8217;t need a special prompt. Just a little curiosity.</p><p>Worst case, you reflect for 20 minutes<br>Best case, you rethink your whole approach to work</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div><p></p>]]></content:encoded></item><item><title><![CDATA[Stop Counting Passes. Start Scoring Goals.]]></title><description><![CDATA[You&#8217;re measuring the wrong thing.]]></description><link>https://newsletter.experimentationlabs.com/p/stop-counting-passes-start-scoring</link><guid isPermaLink="false">https://newsletter.experimentationlabs.com/p/stop-counting-passes-start-scoring</guid><dc:creator><![CDATA[Dan Martin]]></dc:creator><pubDate>Thu, 10 Apr 2025 13:00:45 GMT</pubDate><enclosure url="https://substackcdn.com/image/fetch/$s_!E6Hk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp" length="0" type="image/jpeg"/><content:encoded><![CDATA[<div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!E6Hk!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!E6Hk!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 424w, https://substackcdn.com/image/fetch/$s_!E6Hk!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 848w, https://substackcdn.com/image/fetch/$s_!E6Hk!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 1272w, https://substackcdn.com/image/fetch/$s_!E6Hk!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!E6Hk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp" width="1456" height="832" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/ed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:832,&quot;width&quot;:1456,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:739904,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/webp&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:false,&quot;topImage&quot;:true,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/157483073?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!E6Hk!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 424w, https://substackcdn.com/image/fetch/$s_!E6Hk!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 848w, https://substackcdn.com/image/fetch/$s_!E6Hk!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 1272w, https://substackcdn.com/image/fetch/$s_!E6Hk!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Fed09d9fd-bb72-4851-9f8a-96baa9655192_1792x1024.webp 1456w" sizes="100vw" fetchpriority="high"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><p>Imagine a soccer team obsessed with pass completion. Crisp footwork, great team work, looks impressive. But what if they never score? Feels ridiculous.</p><div class="subscription-widget-wrap-editor" data-attrs="{&quot;url&quot;:&quot;https://newsletter.experimentationlabs.com/subscribe?&quot;,&quot;text&quot;:&quot;Subscribe&quot;,&quot;language&quot;:&quot;en&quot;}" data-component-name="SubscribeWidgetToDOM"><div class="subscription-widget show-subscribe"><div class="preamble"><p class="cta-caption"><em>Subscribe. Or don&#8217;t. I&#8217;m not in charge.</em></p></div><form class="subscription-widget-subscribe"><input type="email" class="email-input" name="email" placeholder="Type your email&#8230;" tabindex="-1"><input type="submit" class="button primary" value="Subscribe"><div class="fake-input-wrapper"><div class="fake-input"></div><div class="fake-button"></div></div></form></div></div><p>That&#8217;s exactly how most product, growth, and small business teams operate. They track tasks, close tickets, ship features, and celebrate output. Meanwhile, impact? Nowhere to be found.</p><p><a href="https://www.linkedin.com/in/johnpcutler/">John Cutler</a> calls this the &#8220;feels like progress&#8221; trap. More work doesn&#8217;t mean more results. And &#8220;getting things done&#8221; is pointless if those things don&#8217;t move the needle. Here&#8217;s how to stop playing the wrong game:</p><div><hr></div><h3>1. Stop Measuring the Work. Start Measuring the Win.</h3><p>Your success metric isn&#8217;t:<br>&#128683; Features shipped<br>&#128683; A/B tests run<br>&#128683; Jira tickets closed</p><p>Your success metric is:<br>&#9989; Revenue<br>&#9989; Retention<br>&#9989; Customers who actually care</p><p>Everything else? Just passing the ball around.</p><div><hr></div><h3>2. Kill Fake Productivity.</h3><p>John Cutler&#8217;s visual says it best:</p><div class="captioned-image-container"><figure><a class="image-link image2 is-viewable-img" target="_blank" href="https://substackcdn.com/image/fetch/$s_!NNqG!,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg" data-component-name="Image2ToDOM"><div class="image2-inset"><picture><source type="image/webp" srcset="https://substackcdn.com/image/fetch/$s_!NNqG!,w_424,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NNqG!,w_848,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NNqG!,w_1272,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NNqG!,w_1456,c_limit,f_webp,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 1456w" sizes="100vw"><img src="https://substackcdn.com/image/fetch/$s_!NNqG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg" width="1206" height="1430" data-attrs="{&quot;src&quot;:&quot;https://substack-post-media.s3.amazonaws.com/public/images/fe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg&quot;,&quot;srcNoWatermark&quot;:null,&quot;fullscreen&quot;:null,&quot;imageSize&quot;:null,&quot;height&quot;:1430,&quot;width&quot;:1206,&quot;resizeWidth&quot;:null,&quot;bytes&quot;:1115199,&quot;alt&quot;:null,&quot;title&quot;:null,&quot;type&quot;:&quot;image/jpeg&quot;,&quot;href&quot;:null,&quot;belowTheFold&quot;:true,&quot;topImage&quot;:false,&quot;internalRedirect&quot;:&quot;https://newsletter.experimentationlabs.com/i/157483073?img=https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg&quot;,&quot;isProcessing&quot;:false,&quot;align&quot;:null,&quot;offset&quot;:false}" class="sizing-normal" alt="" srcset="https://substackcdn.com/image/fetch/$s_!NNqG!,w_424,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 424w, https://substackcdn.com/image/fetch/$s_!NNqG!,w_848,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 848w, https://substackcdn.com/image/fetch/$s_!NNqG!,w_1272,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 1272w, https://substackcdn.com/image/fetch/$s_!NNqG!,w_1456,c_limit,f_auto,q_auto:good,fl_progressive:steep/https%3A%2F%2Fsubstack-post-media.s3.amazonaws.com%2Fpublic%2Fimages%2Ffe410d6d-878f-4fc5-855a-19e69abe3b5e_1206x1430.jpeg 1456w" sizes="100vw" loading="lazy"></picture><div class="image-link-expand"><div class="pencraft pc-display-flex pc-gap-8 pc-reset"><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container restack-image"><svg role="img" width="20" height="20" viewBox="0 0 20 20" fill="none" stroke-width="1.5" stroke="var(--color-fg-primary)" stroke-linecap="round" stroke-linejoin="round" xmlns="http://www.w3.org/2000/svg"><g><title></title><path d="M2.53001 7.81595C3.49179 4.73911 6.43281 2.5 9.91173 2.5C13.1684 2.5 15.9537 4.46214 17.0852 7.23684L17.6179 8.67647M17.6179 8.67647L18.5002 4.26471M17.6179 8.67647L13.6473 6.91176M17.4995 12.1841C16.5378 15.2609 13.5967 17.5 10.1178 17.5C6.86118 17.5 4.07589 15.5379 2.94432 12.7632L2.41165 11.3235M2.41165 11.3235L1.5293 15.7353M2.41165 11.3235L6.38224 13.0882"></path></g></svg></button><button tabindex="0" type="button" class="pencraft pc-reset pencraft icon-container view-image"><svg xmlns="http://www.w3.org/2000/svg" width="20" height="20" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round" class="lucide lucide-maximize2 lucide-maximize-2"><polyline points="15 3 21 3 21 9"></polyline><polyline points="9 21 3 21 3 15"></polyline><line x1="21" x2="14" y1="3" y2="10"></line><line x1="3" x2="10" y1="21" y2="14"></line></svg></button></div></div></div></a></figure></div><ul><li><p>Starting feels productive. Finishing is productive.</p></li><li><p>Doing more things at once feels fast. Focusing on fewer things gets results.</p></li><li><p>Individual effort looks efficient. Working together creates impact.</p></li></ul><p>Busy &#8800; effective. Let&#8217;s move on.</p><div><hr></div><h3>3. Shift from Work to Outcomes.</h3><p>Your team isn&#8217;t here to check boxes. They&#8217;re here to win. That means:</p><ul><li><p><strong>Impact &gt; Activity.</strong> Ten features that change nothing are worse than one that does.</p></li><li><p><strong>Speed = Faster Learning.</strong> Not doing more. Figuring out what works, sooner.</p></li><li><p><strong>Deep Work Matters.</strong> The best break throughs happen when you give them room.</p></li></ul><div><hr></div><h3>4. Measure What Matters.</h3><p>Running hard in the wrong direction doesn&#8217;t get you bonus points. Stop tracking internal vanity metrics (tasks completed, hours logged). Shift to external ones (customer conversion, retention, expansion). If it doesn&#8217;t tie back to business goals, it&#8217;s just noise.</p><div><hr></div><h3>5. Fix Problems, Not Just Backlogs.</h3><p>When your team hits a problem, don&#8217;t just go around it, fix it. Solving blockers means pulling the right people together to remove obstacles <em>now</em>, instead of pretending they don&#8217;t exist for weeks.</p><div><hr></div><h3>You Don&#8217;t Need to Do More. You Need to Win More.</h3><p>Your team&#8217;s success isn&#8217;t measured by how busy they look. It&#8217;s measured by outcomes. Stop celebrating passes. Start scoring goals.</p><p>Want to talk more about this? Message me.</p><div class="directMessage button" data-attrs="{&quot;userId&quot;:131117012,&quot;userName&quot;:&quot;Dan Martin&quot;,&quot;canDm&quot;:null,&quot;dmUpgradeOptions&quot;:null,&quot;isEditorNode&quot;:true}" data-component-name="DirectMessageToDOM"></div>]]></content:encoded></item></channel></rss>