Experiments - Mobile eCommerce Optimization Initiative

LIVE EXPERIMENTS

With over seventy active experiments, we’re still adding more!
Check back often for updated results and new experiments.

COUPON COLLAPSE

This experiment reduces distractions during checkout by collapsing the coupon and promo code field. It has shown an increase in revenue across all devices.

99.8% Success Rate

FLOATING CHECKOUT BUTTON

Adding a floating Checkout CTA that is always visible so the shopper can easily move forward during checkout should increase conversions, right?

0.15% avg CR lift

SIMPLIFIED CART HEADER

Removing elements from the cart header reduces distractions during checkout and increases the likelihood of shoppers completing their purchase— driving more revenue across all devices.

6% avg RPV lift

AUTO CART UPDATE

Adding this optimization reduces the manual steps shoppers need to take during checkout and has been shown to boost revenue, especially significant on Desktop.

3.4% avg RPV lift

ZIP CODE AUTOFILL

Visitors don’t like filling out form fields in general. Typing errors are frequent and inevitable.

6.99% avg RPV lift

CREDIT CARD AUTO DETECT

Automatically detecting credit cart type based on numbers typed should reduce the number of form selections by the user and reduce friction.

66.7% success rate

PAYPAL EXPRESS CHECKOUT

Add PayPal Express / Credit to multiple locations at the top of the checkout funnel.

8.72% avg RPV lift

CHECKOUT CTA SECURITY LOCK

Add a security lock to the checkout CTA to make the user feel more secure when checking out.

17.4% avg RPV lift

MINI CART CHECKOUT CTA

Eliminate unnecessary steps between shopping and checkout by allowing visitors to go to checkout from any page in their journey.

In Progress

MOBILE PHONE INPUT

Tailoring your site’s input types and attributes to be more user-friendly to your visitors will make the information input process as frictionless as possible, resulting in better conversion performance.

In Progress

START YOUR MOBILE EXPERIMENTS TODAY

TECHNOLOGY

Optimization of the checkout funnel is a highly complex and technical task that requires the use of advanced data analytics and smart optimization algorithms.

Standardized Experiments

Magento platform-specific optimization templates were built on the foundation of recommended best practices, simplifying experiment setup and enabling cross-merchant data roll-ups.

Parallel Experiments

This initiative allows for many experiments running parallel to broaden the scope of the data and uncover the best ensembles, which are groups of treatments that play well together.

Adaptive Algorithms

Self-learning algorithms minimize the risk of experimentation through dynamic allocation of more traffic to winning treatments in real time.

Embedded Analytics

Optimization experiment-specific tracking of rich activity data is pre-embedded on the Magento platform, enabling analysis across a wide range of visitor attributes without the need for tagging.

Cross-Merchant Insights

The use of standardized experiment templates enables roll-out of data at both the micro and macro levels — from individual participant results to industry-wide metrics.

LEARN MORE ABOUT THE INITIATIVE

METHODOLOGY

Standardized Experience Optimization for Shared Insights

STANDARDIZE THE EXPERIMENTS

Based on frequently-recommended best practices, repeatable experiment templates are available for testing.

APPLY TO MANY MERCHANT SITES

System integrators recommend and implement 3-5 experiments per merchant site.

ROLL UP ANONYMIZED DATA AND LEARN

Standardized experiment classifications enable cross-merchant data roll-up and analysis.

CONTINUOUSLY INNOVATE TO IMPROVE RESULTS

With the experiment templates as a starting point, merchants apply industry-wide insights to innovate and produce better results.

There are no best practices — what works for one set of merchants may not work for all. What makes our process unique is the adaptive nature of the experiments, the collaboration between merchants and systems integration agencies and the ongoing experiments tested across a diverse array of merchant sites.

START YOUR MOBILE EXPERIMENTS TODAY

INSIGHTS

Our goal is to continuously dig deep into the complexities and realities facing the mobile shopper and how these realities shape their buying journey.

Nothing happens In isolation

Shopping on mobile devices is quite often a completely different experience from shopping on desktop and tablet. The experiments that we run can have both a positive and negative effect on sites depending on the site environment and user preferences. Nothing happens in isolation; every situation can be different from site to site.

There are unintended and unexpected results

Some experiments go more or less as predicted with the only variable being whether the impact or lift of the experiment is narrow or wide. However, some experiments can go in the complete opposite direction of what we predict. We’re finding out that you can’t always predict human behavior and that there can be intended (negative) consequences even despite the best intentions.

START EXPERIMENTING TODAY

AN INITIATIVE SUPPORTED BY

*Funding for this initiative is provided by PayPal. HiConversion and Magento Business Intelligence provide both expertise and licensing for their respective products. All tests and results are conducted independently by the community of participants.