MEET OUR SI PARTNERS

Creatuity

Lima

Wagento

Web2Market

Gene

Your Magento eCommerce Specialists

ROLE IN STUDY

Can you tell us a bit about your company? What services do you specialize in? How do you differentiate yourself?

GENE is a specialist Magento eCommerce agency. We are primarily involved in helping our clients grow their online businesses through strategy, design, development, integrations and support. Alongside this, we also develop software for the Magento ecosystem and are responsible for the Braintree extensions for Magento including Apple Pay and Google Pagee and also the Content Management System BlueFootCMS that was acquired by Magento. We have a particular interest in addressing the challenge faced by merchants on mobile conversion and are actively looking at ways and techniques of solving this whether that be technology, speed, performance or user experience.

Tell us about the merchants (or types of) you worked with in this study. What made them want to get involved?

All the clients we spoke to were actively seeking ways to improve their mobile conversion. Of the clients that engaged the majority were experiencing over 60% of their website traffic on mobile devices and had a commercial need to ensure the were maximising the opportunities on mobile. On particular client within the automotive parts and spare business recognised that many of their customers were mechanics out in workshops without access all the time to a desktop – providing a more optimised solution on a mobile made sense.

What are some of the challenges you/ your clients have encountered with respect to mobile visitors? How are mobile visits and revenue trending for your clients?

Mobile visitors are on the increase, without exception all of our clients experience website traffic that is now over 50% on a mobile device, some clients it is as much as 80%. The trends indicate that this is only going to increase. The challenge is that mobile conversion is significantly lower than that on a desktop. Whilst we see the online revenue on mobile increase it is not keeping pace with the rate of change of visitor numbers.

What were three of the most interesting findings and why?

I’m always surprised at how much the tiny and perceived insignificant changes can have for instance adding a security lock icon to the checkout or removing the header links from the checkout. This demonstrates that rarely is there a silver bullet solution but more that lots of small changes can have a big impact.

Were there any tests that didn’t work that surprised you?

Not really, some provided more of an uplift than others and we saw different results for different customers which proved that not everyone is the same and merchants need to adapt to their own customer behaviour.

Why should merchants invest in data driven testing and optimization?

The industry moves at such a pace from user behaviour to technology. The whole industry is learning and merchants need to be basing decisions on what is currently happening and adapting to that change. The best way to track and respond to this is using the vast amounts of data that exist, but also choosing tools that allow them to understand and interpret that data.

What are some of the advanced things you want to test next?

There has always been an ongoing discussion in the industry around 1-page checkout vs multi-step checkouts I’d be interested to see a wide-ranging study on this. Also with the increased adoption of mobile payment wallets such as Apple Pay and Google Pay I’m interested in seeing the impact of those on mobile conversion.

What were some assumptions or reservations you/your clients had going into the study?

The main reservation our clients had was, will the tests have a negative impact on our conversion and will the analytics software conflict with our site. This was not the case, there were no instances of conflict and clients only experienced positive outcomes.

Going into the study, what kind of expectations did you/your clients have from the tests?

Few had any expectations other than an excitement to see what if anything they were missing. Sometimes there is a hope that a study like this will provide one obvious answer but more times than most it is making small optimisation recommendations.

To date, have the results exceeded/met/not met your clients’ expectation?

For some it has reinforced strategies and ideas and has accelerated the need to implement them. PayPal Express placement has also encouraged merchants to realize the need to have this further up the buying steps.

How should a merchant define success for optimization? Conversion rate, AOV, RPV?

For us on a purely optimisation basis in the checkout we would look at conversion rate impact.

We have seen merchants jump in with basic split A/B testing in the past without a clear idea of what specifically they are testing. Our recommendations are also to keep the tests simple and precise and ensure that enough data over a long enough period.

How should a merchant adopt a data-driven testing strategy? Did you try any other strategies before this project?

iCube

Your Magento Omnichannel Experts

ROLE IN STUDY

Type of merchants they serve:

Start-ups through to large B2B and B2C retail companies

Why they’re involved in the study:

Like many eCommerce teams, we continue to see the majority of purchases still being made on the desktop. As a service provider working with teams across Indonesia and globally, we’ve also witnessed interesting regional patterns in the way customers use mobile. Which is why we joined the study. We’re interested in finding ways to help improve the mobile eCommerce experience across every region we work in.

Thoughts on the findings so far:

Changes are not universally successful. We’ve been finding it very interesting that the treatments don’t work the same for each of our clients. The simplified header treatment, for example, has worked well for some teams, but not that dramatically for others. The auto fill zip code treatment is another that has been presenting a wide range of results that are particularly variable from one country to another. In Indonesia, for example, many customers don’t use a zip code for shipping so the treatment isn’t that useful. In Australia, we’ve been finding that the treatment isn’t presenting the most accurate results, so again it isn’t that useful yet.

How should merchants define their success for optimization?

In our opinion, optimization success should be defined by a combination of metrics — like conversion rate, average order value, and revenue per visitor. No single metric can reveal it all. Combining multiple metrics is the best way to gain a complete picture of how efforts, like those in this study, are really performing.

Achieve The Sales of Your Dreams

ROLE IN STUDY

Type of merchants they serve:

Small to mid-range enterprise companies working within the retail space

How they have been involved in the study:

We’ve had two of our clients participate in the study so far — one from a luxury jewelry line and the other from a women’s lifestyle and clothing line. Both clients were really eager to test out new ways to increase their mobile sales.

Why they’re involved in the study:

We pride ourselves on serving our clients with solutions that provide fully optimized and easy-to-use eCommerce solutions. We were interested in joining this study to gain a deeper understanding of the mobile obstacles facing our clients and hopefully walk away with new solutions to help them overcome those obstacles.

Thoughts on the findings so far:

  • Conversion rates aren’t necessarily what they appear. The fine grain analysis of the study gave us a much deeper understanding of the true nature of our clients’ conversion rates. One of our clients, for example, had an extremely positive overall conversion rate of around 5% (far above the industry average of 1%). However, the study revealed that on a device-specific level, this average was not consistent. In fact, we saw that mobile conversions were much lower and averaged around 1%.
  • Revealed the need for more data-driven user experience testing. The study has also shown us that intuition can’t be trusted in mobile eCommerce. There were several tests we ran where we expected to see a certain outcome but experienced quite the opposite for both of our clients. The study has really emphasized the need for more data-driven testing to help accelerate mobile eCommerce.

How should merchants define their success for optimization?

We really believe that success needs to be defined at a granular client-specific level, rather than overarching industry goals. Conversion rates, average order value, and revenue per visitor, are important metrics are of course important. However, given that every client is unique and has unique goals that will evolve over time, we believe success needs to be defined on a client-to-client basis.

A Magento Enterprise Solution Partner

ROLE IN STUDY

Can you tell us a bit about your company? What services do you specialize in? How do you differentiate yourself?

JH specialise in delivering Magento eCommerce sites for their clients, that through strategy and unrivalled expertise in development and design, drive the results that transform a business’s story.

Cultivating powerful and long-term relationships with their clients, JH is present at every step of the eCommerce journey. From determining KPIs and building a strategy to making sure stores sit and stay amongst the top of their verticals.

From the outset, they get to know the business goals and objectives of their clients, and roadmap strategically using their knowledge of this ever-evolving industry, current best practice, and what the eCommerce future is going to look like. With experience across all verticals, the team become experts, whatever the industry their client is in.

With a hat-trick of Magento Imagine Awards for Excellence in Mobile Experience, JH can say with confidence that they’re amongst the leaders in building and designing responsive sites, and have been for some time, always devising and pushing technologies to achieve the best results.

Tell us about the merchants (or types of) you worked with in this study. What made them want to get involved?

  • Neom Organics – As Neom Organics won ‘Best Mobile Experience’ at Magento Imagine this year, in the Magento
  • Imagine Awards, the ease of use across all devices and seamless UX design made them a perfect candidate for this initiative to discover what works best for their valued customers.
  • Simmi London- A ‘Fast Fashion’ brand, whose customers are just as speedy to spend on their stiletto shoes, we knew they would be an ideal partner to trial this study to find new ways to increase conversion.

What are some of the challenges you/ your clients have encountered with respect to mobile visitors? How are mobile visits and revenue trending for your clients?

  • Could not implement on Simmi due to multi-store/currency functionality
  • Neom Organics have been optimising their checkout and have included Multi-Currency to their offering, since then we’ve come across some conflicts with the Hi-Conversion scripts, where PayPal Express has been intermittently disappearing on the frontend.

What were three of the most interesting findings and why?

  • Paypal on the mini basket definitely attracted a quicker order flow
  • Great confidence in using a known/familiar gateway for a faster check out

Lima

Conversion Rate Optimization Specialists

ROLE IN STUDY

Can you tell us a bit about your company? What services do you specialize in? How do you differentiate yourself?

Lima Consulting Group’s mission is to help organizations transform their digital futures through the development, deployment, and optimization of sustainable, competitive advantages.

Started in 2004, we’ve helped over a thousand companies in their pursuit of providing exceptional digital experiences.

We specialize in working with the Adobe Marketing Cloud and all of the solutions within it, including the recently acquired Magento. We’re a Specialized Adobe Analytics and Adobe Media Optimizer partner and were the first globally to earn that combination of specializations.

We do quite a bit of work on e-commerce platforms from the common technology providers, including Magento, and have a lot of experience in helping organizations advance along their digital maturity path towards digital transformation. Our Digital Transformation Maturity Model (DTMM), a solution that we’ve developed for over a decade, helps organizations advance their People, Processes, Platforms and Financial Performance along a 3-year roadmap.

We focus on the science of marketing and are data-driven. We’ve also made significant investments in Dynamic Creative Optimization (DCO) solutions that create content at scale using machine learning and artificial intelligence. This works extremely well for digital experiences that can benefit from personalization and that can leverage a clients’ customer data. But all of these approaches require trustworthy data from the ground up. That’s why we normally begin our engagements with a thorough review of the digital analytics implementation.

Tell us about the merchants (or types of) you worked with in this study. What made them want to get involved?

Everyone is under pressure to do more with less. While there are a lot of software providers in the Conversion Rate Optimization (CRO) space, many merchants don’t have the in-house expertise or the scale to benefit from a sustained testing effort. And even when the organization have the aspiration, many of the technical pitfalls to deploy tests and to come up with the testing concepts make it difficult to justify the investment.

This program is free to get started, it’s using “ready-made” tests, and is easy to implement.

Given the shift towards mobile and the tremendous opportunity to see higher conversions through mobile devices, the merchants we’ve brought to the study said it was a “no-brainer”.

What are some of the challenges you/ your clients have encountered with respect to mobile visitors? How are mobile visits and revenue trending for your clients?

Digital Marketers are under fire to justify their contribution to sales. The Return on Ad Spend (RoAS) for mobile has always largely underperformed compared to desktop. But with over 60% of traffic coming from mobile devices, marketers and experience managers are embracing the need to better understand how to serve this large and growing segment.

For those users that are late in the sales funnel, or are looking for a specific product, it’s critical to reduce the friction and promote one-click purchases. The HiConversion solution can offer tremendous insights into customer behavior. And if that’s not enough, the 19 out of the box tests can be deployed in minutes.

What was one of the most interesting findings and why?

My favorite HiConversion test was being able to drop the one-click Paypal button on product level pages. The fact that the “lock” performed better than the image of the “shopping cart” really helped us understand that customers are more sensitive to security as they pass through that gate.

Why should merchants invest in data-driven testing and optimization?

To get smart and to get return…

To get smart: Through CRO merchants will gain consumer insights. And who doesn’t want to understand their customers better?

Through the heat maps of HiConversion and web analytics tool, merchants will understand how each link is performing and can even segment these visitors by profile types if known. For example, how does an authenticated user convert compared to a user with category affinity = electronics vs a non-authenticated user with no category affinity? How about a user that has previously purchased? Or any other combination of your 1st party data combined with the behavioral data we’re capturing with HiConversion?

To get return: With the consumer insights gained above, what would you do differently to monetize your understanding of your customers’ needs?

We would recommend personalizing the product recommendations towards that category, putting that user in a marketing automation journey, using retargeting to win-back shopping cart abandons and capturing the data we can about the user within a Data Management Platform (DMP). There are so many paths towards delighting a customer online.

But ultimately nothing compares with the secret sauce of your digital experience, you might find ways to improve the buying journey based on each segments needs.

Companies that are using these technologies outperform those that don’t.

What are some of the advanced things you want to test next?

We have a large customer that wants to test content @ scale using dynamic creative optimization. Combined with a world-class mobile experience powered by HiConversion and Magento and the use of Adobe Analytics and Adobe Media Optimizer, we see a significant path towards reducing their cost to acquire customers and towards increasing their conversion rates on mobile visits.

We’ve been using some very innovative DCO platforms to build content @ Scale for 2 of our larger customers and have had at least a 60% ROI in both cases.

Empowering Merchants to Succeed Online

ROLE IN STUDY

Type of merchants they serve:

Small to medium-sized businesses

Why they’re involved in the study:

Many of our merchants have been experiencing a steady growth in mobile-driven traffic and revenue and are keen to learn new ways to increase both even further. By participating in this study, our merchants were able to accurately see how different treatments impacted (for good or bad) their mobile performance.

What have been your most interesting findings so far (positive or negative)?

  • The Zip Code Autofill Treatment lost for several of our merchants. Surprisingly, this treatment didn’t do well for several of our participants. In fact, the process of typing in the city followed by the autofill actually reduced checkout conversion in several instances.
  • We tested PayPal Checkout on the product detail page for the first time for our primarily B2B customers. While the rest of the checkout showed a positive RPV for all merchants, when we added PayPal Checkout to the product detail page we saw an increase in conversion, but enough of a decrease in AOV to reduce overall revenue per visitor. We’ll be experimenting with some design changes to see how this impacts our B2B customers going forward.
  • The HiConversion tool is fantastic. This was entirely new for our merchants and they loved them. Our merchants found the tool allowed for the easy implementation of the treatments and provided quick results reporting. Razoyo had used other testing strategies prior to this project. We employed tools like FullStory, Optimizly, Crazy Egg, Google Analytics A/B testing, etc. These tools all worked to a varying degree, but in our opinion, HiConversion covers just about everything.

Thoughts on data driven testing and optimization:

Data-driven testing and optimization is crucial for any growing business and takes the guesswork out of “what works”. Big Data is what is driving the future and with tools like Hi Conversion, any growing merchant can have the ability to test and optimize just like their larger competitors. Big increases in conversion are usually the result of a lot of small increases in conversion. The Hi Conversion tool allows merchants to isolate changes and prove out their effectiveness.

We believe all merchants should view these tools as investments in their business.

Outcomes from the study so far:

For most of our merchants, the results exceeded their expectations. Being able to target and identify trends specific to mobile visitors has been a big win for our clients, as are the tools they’ve used to test and optimize the treatments.

How should a merchant adopt a data-driven testing strategy? Did you try any other strategies before this project?

Razoyo had used other testing strategies prior to this project. We employed tools like FullStory, Optimizly, Crazy Egg, Google Analytics A/B testing, etc. These tools all worked to a varying degree, but in our opinion, HiConversion coupled with MBI covers just about everything.

Redstage

Redefining Modern Commerce

ROLE IN STUDY

Type of merchants they serve:

Mid-Market & Enterprise Clients in B2B or B2C for Magento, BigCommerce & Shopify.

Why they’re involved in the study:

Throughout our 10+ years of experience as e-commerce experts, Redstage has seen mobile-first turn from prediction into reality. We’re now at the point where more than half of our clients’ visitors are using a mobile device. At the same time, we’re seeing typical conversion rates on mobile devices of roughly half of what we’re seeing from desktop visitors. Redstage sees this as a massive opportunity to increase revenue by making the mobile shopping experience better than what people have come to expect.

As thought leaders in the industry, the Redstage team is dedicated to helping eCommerce companies learn and hone the latest mobile conversion strategies. At our core, we’re system integrators, but in our hearts, we’re scientists. The ever-accelerating development of new technology and customer preference necessitates an unceasing pursuit of innovation, and we’re here to use what we’ve learned to help eCommerce companies thrive in the next age of eCommerce. Let’s work together to take your store to the next level!

What have been your most interesting findings so far (positive or negative)?

The “Zip-Code First” Autofill At Checkout
On almost every site, the checkout form is the same, always starting with the customer’s first name. Sure, the name, phone, and email address areas might auto-fill based on browser settings, but location information isn’t always part of the one-click equation. Working with one of our clients, we found that a simple re-stacking of the typical model can cause checkout disruption to the tune of a 4.6% conversion rate lift (across all devices). Placing the zip-code first triggers browsers to auto-populate the country, city, and state data, making your checkout faster. In our report, we found that this simple change can yield conversion increases of 1.48% for desktop, 8.14% for smartphones, and a whopping 18% increase for tablets.

The Card-Detecting Checkout
Different credit cards have their numbers, expiration dates, and even security codes in different areas, making the typical credit card form a little lacking in the CX department. As the second test in our first study, Redstage’s developers created a credit card checkout form that automatically detects the type of card entered based on the first 4 card numbers. Our smart bit of code automatically matches the form to the card in-hand, making it easier to fill out. Remember, the less friction, the better. It might seem like a negligible change at first, but for phones and tablets, this smart checkout option drove a 3.7% and 6.1% conversion rate lift, respectively. The test didn’t add so much for traditional online checkout, only increasing desktop conversions by 0.4%… but every little bit counts right? How much extra joy would these numbers add to your holiday return?

The Simplified Header
Once a customer has added a product to the checkout, looked at their cart, and proceeded to checkout, they’ve given us a clear signal that they’re ready to make a purchase. Once they’ve made it this far, what would happen if we removed anything that might distract them from finishing their checkout? That’s the question we wanted to answer with our third test. What we did here was, once on the checkout page, hide all the top navigation elements on the header. The idea here is to keep the checkout process going. It’s the approach taken by Amazon, so it surely works for them. What works for some doesn’t work for all, though – we found this to be one of our more controversial tests. The header simplification performed well on some sites and negatively on others. Different visitor segments also showed significantly different responses to this change. It just goes to show the importance of making decisions based on your own data.

The Big One: PayPal-First
For the fourth and final portion of our 3-step study, Redstage analyzed what happens when we place a “PayPal Express Checkout” button above the traditional “proceed to checkout” button on the product page… The results were astonishing. This change led to a 10.3% decrease in checkout abandonment across devices. That’s right. Simply putting the PayPal checkout option first on the page led to an 8.7% decrease in abandons on desktop, 11.2% less abandonment on smartphones, and shockingly, a 30.7% decrease in abandonment on tablets.

How should a merchant adopt a data-driven testing strategy? Did you try any other strategies before this project?

The most important thing to remember when developing a data-driven approach to optimization is to actually trust the data. It’s easy to make decisions about the user experience based on our intuition, past experiences, or personal preference. It’s often the case that our best guesses are wrong, or lessons learned in the past are not applicable. Using actual visitor data, both for identifying areas needing improvement and for validating results, is the only way to be sure we are making progress toward a better performing website.

An Interactive Agency

ROLE IN STUDY

Can you tell us a bit about your company? What services do you specialize in? How do you differentiate yourself?

Something Digital is an interactive agency headquartered in NYC with additional offices in West Palm Beach, Los Angeles, and Seattle. We are a full-service agency so we do everything from discovery, design, development, deployment, and ongoing maintenance with eCommerce sites. We also specialize in digital and email marketing. We differentiate ourselves with creativity, business acumen, and a keen awareness of eCommerce best practices. Furthermore, we pride ourselves in delivering and maintaining outstanding sites with unique brand identities and simplified user experiences.

Tell us about the merchants (or types of) you worked with in this study. What made them want to get involved?

We worked with B2C Merchants on this study, who were interested in optimizing conversion, specifically for mobile devices and throughout the checkout process.

What are some of the challenges you/ your clients have encountered with respect to mobile visitors? How are mobile visits and revenue trending for your clients?

We, like many others, are generally seeing high ratios of mobile vs. desktop traffic, with significantly lower conversion rates. While this is to be expected, capitalizing on the high mobile traffic can result in significant positive revenue impact.

What were the most interesting findings and why?

  • The obvious winner is not always the winner
  • Zip Code auto filling is not a winner

Were there any tests that didn’t work that surprised you?

In some instances, the PayPal buttons performed poorly.

Why should merchants invest in data driven testing and optimization?

With a tool like HiConversion, a merchant can test different user experiences to make data-driven decisions before investing in costly development and implementation.

Merchants can go into development with the foreknowledge that their implementations will likely be effective and have the desired results, eliminating the risk of discovering failures only after they are deployed.

What are some of the advanced things you want to test next?

We are looking to test birthday input fields to increase customer engagement and to collect more information about our customers – the question would be, what is the best way to ask a user for their birth date to optimize engagement?

What were some assumptions or reservations you/your clients had going into the study?

We were concerned that we wouldn’t have enough data to get a true result. Clients don’t always have a good understanding of how much traffic is usable in order to draw conclusions and take action.

The technology behind HiConversion was also new to most. Most people assumed that iterating on the treatments would require much more disruption and code deployments, but that is not the case.

Going into the study, what kind of expectations did you/your clients have from the tests?

I think the expectation was that most tests were “no-brainer” winners. Since they all weren’t, it really proved the point that you can’t make any assumptions until you actually test them.

To date, have the results exceeded/met/not met your clients’ expectation?

To date, I think the client expectations have been met – they were excited about participating and I think they are still excited about using this process more into the future.

How should a merchant adopt a data-driven testing strategy? Did you try any other strategies before this project?

Every merchant defines success differently. At the end of the day it’s about revenue and growth, so all pieces (conversion, AOV, and RPV) all need to be performing strongly.

How should a merchant define success for optimization? Conversion rate, AOV, RPV?

I think a good approach is to have a really agile testing strategy that doesn’t require a huge upfront investment. The investment should come later once the merchant has a reasonable expectation of results.

Connecting People, Platforms and Products

ROLE IN STUDY

Can you tell us a bit about your company? What services do you specialize in? How do you differentiate yourself?

Wagento connects people, platforms and products to make your omnichannel experience truly seamless. With offices in 4 countries and two continents we can solve even the most complex problems and help to deliver results that bring maximum ROI across all your platforms. Our extreme customer service approach and high communication rate during each part of the process ensures that you will have a stable product delivered in a timely manner without hassle or delays.

What do you do?

  • Magento Cloud Starter and Pro Implementations
  • Magento Order Management
  • Integrator.io (For additional connections of services)
  • Magento Training (For MagentoU)

Why Are You Different?

  • 4 MagentoU trainers on staff
  • 24 hour service and support at no additional charge
  • Full Spanish and English Speaking staff
  • 3x Magento Master on staff
  • Fun name

Tell us about the merchants (or types of) you worked with in this study. What made them want to get involved?

We are working with different commerce retailers who want to improve their mobile experience.

What are some of the challenges you/ your clients have encountered with respect to mobile visitors? How are mobile visits and revenue trending for your clients?

The biggest challenge we have had on mobile is speed and especially speed issues on 2g/3g. Many of our clients are in emerging markets and mobile speeds are always not as good as the US.

What were three of the most interesting findings and why?

Sometimes the client needs to plan from the beginning and issues are in taxonomy or their catalog layout. We found that starting with a well design product catalog can lead to higher conversions. Once that is done it is much easier to find better ways to convert on mobile at checkout.

Why should merchants invest in data driven testing and optimization?

Without data everything is subjective. Using data-driven testing you can definitively measure the differences and determine what is best. You can then overlay this data to other campaigns to ensure that you have a unified way to constantly improve. If you don’t draw a line on which to improve from how do you know you are improving?

What are some of the advanced things you want to test next?

Adding additional items in the checkout flow in different ways to see if people will add them.

What were some assumptions or reservations you/your clients had going into the study?

How much will it cost [after]. It would be good to have clients with lower revenue but higher volume. Also to look for clients with high ticket item counts.

Going into the study, what kind of expectations did you/your clients have from the tests?

This has been a fantastic experience and clients are happy. They need some encouragement to do it.

To date, have the results exceeded/met/not met your clients’expectation?

EXCEEDED!

Web2Market

Your Magento Design & Development Team

ROLE IN STUDY

Type of merchants they serve:

Small to medium sized businesses

Why they’re involved in the study:

Like most players in eCommerce, we’ve witnessed a poor performance in conversion rates from mobile as compared to desktop. Given the growth of mobile use, we’re looking for ways to improve the mobile experience in general and help our merchants achieve higher mobile conversions in the process.

Thoughts on the findings so far:

  • Small changes CAN make a big difference. Several of the treatments we’ve implemented are relatively simple, yet they’ve had a significant impact on mobile conversions.
  • What works for one site doesn’t always work for another. We’ve found it interesting that many of the treatments we applied didn’t work universally across each of the sites we applied them to. Or, that what worked on a device for one site, performed poorly on the same device for another site.

Thoughts on data driven optimization testing:

We see data driven optimization testing as a great way to see in real-time how the changes we’re making on a site are actually performing. It takes the guesswork out of performance and gives hardcore stats on what’s actually working and what isn’t.

Outcomes from the study so far:

The study has definitely exceeded our expectations. For most of our clients, we’ve seen substantial improvements since implementing the treatments. One client, in particular, has nearly doubled their conversion rate on mobile phones since we introduced the study’s treatments.