Making Experimentation More Intuitive and Powerful: ABsmartly September Features Update

This autumn, we’re excited to introduce several powerful improvements to help make your experimentation workflow smoother, more intuitive, and even more effective. At ABsmartly, we’re constantly refining our platform so your team can focus on what matters—running effective experiments and making revenue-impacting decisions.

Improving Our Unique Group Sequential Testing (GST) Engine

We’ve worked hard to make Group Sequential Testing (GST) faster, more flexible, and applicable to more use cases than ever before. Now, GST is the default method for all new experiments, though you can still select a fixed-horizon analysis if needed. Find out more information about the different analysis types here. 

Previously, GST was only available for cases where an increase in a primary metric was expected. But we know that sometimes your hypotheses aim to reduce KPIs, such as cutting down on cancellations, lowering support tickets, or minimising returns. When you asked, we answered we’ve now made key updates that will allow you to use GST when a decrease in a metric is expected. This allows your team to test and validate a broader range of hypotheses with the same precision and flexibility as before.

Decreasing Time to Decision by Simplifying GST Checkpoints

We understand that setting up checkpoints in GST experiments hasn’t always been intuitive—it can be difficult to accurately pre-plan your checkpoints, especially when you're new to experimentation. To make the experimentation process easier, we’ve introduced a new, simpler way to define how often you want to evaluate results. Instead of specifying the number of checkpoints, experimenters can choose the minimum frequency between the checkpoints that best suits their need—whether it’s once a day, once a week, or another interval that works for your use cases and your metrics.  This change can help you get the most out of Group Sequential Testing

Estimating Participants More Accurately

One of the trickier aspects of experimentation has always been estimating how many participants will be eligible and, as a direct consequence, how long the experiment will run. This gets even more difficult when using complex targeting audiences To solve this, we’ve added a new feature that leverages historical data to give you an estimate of the maximum number of participants who will likely qualify for your experiment based on platform, tracking, and audience criteria. While it’s important to remember these numbers are only an estimate, they should help give you a better sense of how long your experiment will need to run and if it’s even worth running it.

Slack Integration for Seamless Collaboration

We’re all about making team collaboration easier, which is why we’re happy to introduce Slack integration to ABsmartly. You’ll now get real-time notifications directly in your team’s Slack channels whenever something important happens with your experiments or when special attention is required. The integration ensures your team stays in the loop and can react quickly to experiment updates.

Introducing Experiment Snapshots

The value of experimentation lies in making informed decisions today and building a repository of insights for the future. With our new Experiment Snapshots feature, a snapshot of the exact dataset used to make the decisions is saved. This makes it easier to review and understand past decisions to review past decisions, making it easier to understand what worked, what didn’t, and why specific experimentation decisions were made.

What’s Next?

ABsmartly’s latest updates are designed to simplify your experimentation process, making it simpler, more intuitive, and more flexible. From enhanced Group Sequential Testing to accurately estimating the number of eligible participants, ABsmartly helps you get faster, more accurate insights.

We’re continually making exciting upgrades and introducing new features, so make sure you follow us on LinkedIn, or subscribe on to our blog and on youtube, so you see the each release as soon as it’s available. If there’s a feature you would like to see in ABsmartly, let us know!

👉 book a demo to see how our sophisticated experimentation platform can help accelerate your growth.