Better Consistency, Reliability and Planning in Experimentation - June Feature Release Blog

Published on Jul 11, 2024

by Cal Courtney

This summer, ABsmartly is excited to share a lighter but equally impactful update with our June feature release. We’re bringing you some exciting new capabilities: improved template management, the ability to schedule experiments, and feature flags for future activation. 

Every month, we give you an overview of what we’ve been working on behind the scenes to improve the ABsmartly user experience and enable experimentation culture. We strive to be super-responsive to our clients’ feedback; we aim to be proactive and flexible in coming up with creative solutions that make it simpler than ever to help your team experiment successfully. 

We are also working on a few other significant enhancements, including faster experiment execution through Group Sequential Testing improvements, variance reduction techniques like CUPED, and the forthcoming Executive Dashboard to collaborate broadly within the organisation and effectively communicate with leadership the value experimentation brings to growth.

Improving Template Creation and Management

Last month you saw we implemented experimentation templates. This month we’ve enhanced how templates are created and managed, providing more granular control over permissions and workflows. Now, you can define who is allowed to create and use templates, ensuring greater security, speed, and consistency in your experimentation process. 

The most useful thing about adding permissions to the template management dashboard is that you have the ability to define who is allowed to create templates and, equally as important, who is not allowed to create templates! We have also refined the template permission process so that you can choose who can create an experiment from templates. This means that you could decide internally that your business allows the more advanced experimenters to create templates and for everybody else to use those templates instead of starting experiments from scratch. 

Why are we so excited about this? Because using these permissions means that you’re improving your experimentation workflow, making it faster and of greater quality. The streamlined workflow simplifies template creation and management, making it more user-friendly and efficient. 

This new feature is described here in the Knowledge Base, where you can explore the detailed documentation.

Experiment and Feature Flag Scheduler for Better Planning

Planning experiments just got easier with our new scheduler feature. You can now schedule experiments and feature flags to start in the future, allowing you to prepare and plan your experimentation activities more proactively. 

This flexibility means you can set up experiments on a Friday and have them start over the weekend without needing to log in, or you can quickly and easily plan out and schedule a full month of experiments so you have a bird’s eye view of your experimentation plans. This feature is designed to enhance your planning capabilities and provide a more seamless, proactive experimentation process.

Who uses ABsmartly for More Reliable Experimentation? 

Effective planning and consistent execution are crucial for successful experimentation. With all of our new features, ABsmartly continues to support your efforts in achieving more reliable and efficient experiment outcomes. Sometimes tool providers are tempted to have the most features, an exhaustive list of everything but the kitchen sink thrown in. Our approach is a little different: We focus on features that product teams really need to facilitate the experimentation lifecycle and an experimentation culture.  

We often get asked what kind of businesses use ABsmartly, and in the main, our clients are in travel and airlines, finance and bitcoin, retail, marketplaces and auctions. Our clients are already running 10’s, sometimes 100’s of experiments, with at least 500,000 users or visitors per month. Our customers hit a wall with other tools, they cannot scale experimentation across the organisation because they lack features to share and collaborate, or costs have become prohibitive because of adding users. Often, our clients have considered building an internal experimentation platform themselves, but they’re not exactly sure whether they should invest such time, money, resources and energies into that sort of project. We designed ABsmartly to be easy to integrate, with the features that product teams need. Our approach has the end goal of supporting experimentation culture. 

What’s Next?

We’re working on many other exciting features in the background so stay tuned. Make sure you follow us on LinkedIn, or subscribe on absmartly.com/blog, so you see the next blog as soon as it’s available. If there’s a feature you would like to see in ABsmartly, let us know!

If you are ready to book a demo to see how our sophisticated experimentation platform can help accelerate your growth, click the link and schedule some time with us to tell us about your needs and vision.