LIVE EXPERIMENTS

With over seventy active experiments, we’re still adding more!
Check back often for updated results and new experiments.

TECHNOLOGY

Optimization of the checkout funnel is a highly complex and technical task that requires the use of advanced data analytics and smart optimization algorithms.

null

Standardized Experiments

Magento platform-specific optimization templates were built on the foundation of recommended best practices, simplifying experiment setup and enabling cross-merchant data roll-ups.
null

Parallel Experiments

This initiative allows for many experiments running parallel to broaden the scope of the data and uncover the best ensembles, which are groups of treatments that play well together.
null

Adaptive Algorithms

Self-learning algorithms minimize the risk of experimentation through dynamic allocation of more traffic to winning treatments in real time.
null

Embedded Analytics

Optimization experiment-specific tracking of rich activity data is pre-embedded on the Magento platform, enabling analysis across a wide range of visitor attributes without the need for tagging.
null

Cross-Merchant Insights

The use of standardized experiment templates enables roll-out of data at both the micro and macro levels — from individual participant results to industry-wide metrics.

METHODOLOGY

Standardized Experience Optimization for Shared Insights

null

STANDARDIZE THE EXPERIMENTS

STANDARDIZE THE EXPERIMENTS

Based on frequently-recommended best practices, repeatable experiment templates are available for testing.

null

APPLY TO MANY MERCHANT SITES

APPLY TO MANY MERCHANT SITES

System integrators recommend and implement 3-5 experiments per merchant site.

null

ROLL UP ANONYMIZED DATA AND LEARN

ROLL UP ANONYMIZED DATA AND LEARN

Standardized experiment classifications enable cross-merchant data roll-up and analysis.

null

CONTINUOUSLY INNOVATE TO IMPROVE RESULTS

CONTINUOUSLY INNOVATE TO IMPROVE RESULTS

With the experiment templates as a starting point, merchants apply industry-wide insights to innovate and produce better results.

There are no best practices — what works for one set of merchants may not work for all. What makes our process unique is the adaptive nature of the experiments, the collaboration between merchants and systems integration agencies and the ongoing experiments tested across a diverse array of merchant sites.

INSIGHTS

Our goal is to continuously dig deep into the complexities and realities facing the mobile shopper and how these realities shape their buying journey.

Nothing happens In isolation

Shopping on mobile devices is quite often a completely different experience from shopping on desktop and tablet. The experiments that we run can have both a positive and negative effect on sites depending on the site environment and user preferences. Nothing happens in isolation; every situation can be different from site to site.

There are unintended and unexpected results

Some experiments go more or less as predicted with the only variable being whether the impact or lift of the experiment is narrow or wide. However, some experiments can go in the complete opposite direction of what we predict. We’re finding out that you can’t always predict human behavior and that there can be intended (negative) consequences even despite the best intentions.

AN INITIATIVE SUPPORTED BY

Magento An Adobe Company | hiConversion | PayPal

*Funding for this initiative is provided by PayPal. HiConversion and Magento Business Intelligence provide both expertise and licensing for their respective products. All tests and results are conducted independently by the community of participants.