GrowthBook

Thanks for joining our exclusive live broadcast. Feel free to share your questions and interact with other participants in the chat.

AI isn’t magic—it’s momentum. Just like scaling a startup, the value of AI compounds only if you rigorously measure, learn, and adapt. Lately, we've been talking with teams deploying AI, and a pattern stands out: the most impactful companies treat AI like a product, not a silver bullet. They don’t assume their models will “just work.” Instead, they A/B test relentlessly. Why? Because every tweak, prompt, or data shift could unlock 10x gains—or quietly erode trust. Here’s why A/B testing AI matters: 1️⃣ “Offline metrics lie”: A/B tests expose how it actually behaves in production 2️⃣ Measure what the business cares about 3️⃣ Stop model decay in its tracks: Continuous A/B testing catches degradation before customers notice (and churn). But scaling this rigor is tricky. Start simple—run experiments manually, track key signals. As complexity grows, invest in tools that automate testing, centralize insights, and push learnings across teams (shameless plug: GrowthBook’s guide breaks this down). Move too slow? Your AI stagnates while competitors iterate. Move too fast? You’ll drown in noise, not knowledge. If your AI isn’t being A/B tested, you’re flying blind. Check out the blog below to start building momentum—one experiment at a time. 🔗 How to A/B Test AI: A Practical Guide (in the comments)

🚀 Announcing GrowthBook 3.5! We're excited to share our latest release, focusing on user experience and productivity enhancements: 🛠️ Revamped DevTools Extension: Now supporting Firefox, featuring a complete design overhaul (including dark mode), event logs, SDK health checks, user archetype synchronization, and a new popup entry point. 📊 Power Calculator: Utilize your historical data to accurately estimate experiment run times and minimum detectable effects, enabling more precise experiment planning. 🧭 Experiment Decision Framework: Receive real-time, data-driven recommendations on experiment progression, helping you decide when to ship or roll back with confidence. 🔧 SDK Upgrades: Support for pre-requisite features and sticky bucketing is now available across multiple SDKs, including JavaScript (Node, React, Edge), Swift (iOS), Kotlin (Android), Flutter, Java, C#, Python, Ruby, and Go (with sticky bucketing coming soon). Open Feature support has also been extended to Web (JavaScript, React), Node.js, Java, and Python. 🎨 Design System Updates: Experience a more cohesive and polished design system with improvements to dark mode, feature and experiment pages, and overall UI consistency across the entire app. Watch our demo to see these features in action and get your questions answered. https://lnkd.in/gF_EuYWB Read the full blog post for more details.

Our Dev Tools has undergone a complete transformation, making it more user-friendly for debugging and testing feature flags and experiments. With the new update, it's simpler to understand why a user is assigned to a specific variation. The enhanced tool is now available for both Chrome and Firefox! 🛠️

It’s always exciting to be at the beginning of something big. Experimentation Island 2025 (#Ei2025) set a new bar for experimentation conferences—intimate, insight-packed, and filled with convos that didn’t stop when the talks did. Huge shoutout to Kelly Wortham, MC Ton Wesseling, and the entire crew for pulling off one of the best-run conferences we’ve attended. Special thanks to Shannon Wortham for making sure everything seamless for sponsors, and to Josh Silverbauer👨🎤 🧙♂️ for adding an unforgettable musical touch to the event. Here are our 2 key takeaways: 💡Experimentation isn’t just about tech—it’s about culture. 🚀 Experimentation is evolving—fast A special thank you to Merritt Aho, who walked us through how Breeze Airways is scaling experimentation—featuring GrowthBook in action. Seeing real-world wins from our users is always a highlight. Congratulations to our A/B testing and pirate trivia winners: Matt Policastro, Heather Clarke, and Surender singh 🥇 Even as teams move faster, experimentation still slows them down. If this sounds familiar, let’s talk. Shoot us a message—we’d love to share how GrowthBook helps companies move faster and test smarter. #Ei2025 set a high bar, and we’re already excited for what’s next. Until then, let’s keep the conversation going—what’s the one insight from #Ei2025 that stuck with you the most? PS. If you didn’t get a chance to stop by our booth, dm us, and we'll be happy to send you a coupon for some free swag from our store.

We are at Experimentation Island 🏝️ Come visit to chat testing and do our treasure hunt! #Ei2025

In the past few months, I’ve talked to dozens of teams about their experimentation efforts. A pattern keeps coming up: They launch with momentum, but it inevitably hits a snag. Maybe you’ve seen it too—it gets too complex, teams have different processes or different tools, or results that don’t translate to real impact. It’s frustrating, but it’s not a you problem. It’s a how problem. That’s why we’re hosting a chat next week. We've asked Rudger de Groot to draw up a roadmap on how to deal with these challenges. Bring your questions. If you’re feeling stuck in "experiment purgatory,” you’re not alone. Let’s figure this out together. https://lnkd.in/g6b-Z6vy

Why build your own experimentation platform when you can customize ours? 🎯 Introducing Custom Fields: Build your perfect experiment workflow without building from scratch. → Design your own pre-launch checklists → Create custom approval flows → Define mandatory experiment metadata → Add team-specific requirements → Map to your existing tools and processes (Jira, Linear, GitHub) All the power of a bespoke platform, none of the maintenance overhead: https://lnkd.in/g7GmjCbu

Because experimentation should feel empowering, not exhausting. GrowthBook 3.4 just dropped, and it's packed with features to make your life way easier—like cloning environments with a click, sharing experiment results in seconds, and even simulating feature flags before they go live. Curious? Swipe to see what’s new. 👇

If we made a @hallmark movie