During a split test, you split incoming website traffic between the original (control) page and different variations of the page. You then look for improvements in the goals you’re measuring (such as leads, sales, or engagement) to emerge so that you can determine which version performed best. You use split testing to test areas where you might be able to improve a measurable goal, such as your online checkout process. The test helps you try to determine what factors increase conversions, what factors deter conversions, and what can lead to an increase in orders.
Obtain the tools you need to run split tests
To run split tests, you need effective tools. This section tells you about the technology you need to run split tests so that you can optimize your campaign for maximum results.An analytics suite
To choose the right pages to test on your website, you rely heavily on your website analytics tool. This chapter focuses on Google Analytics, a website analytics solution made available by search engine giant Google. This tool measures website, app, digital, and offline data to gain customer insights. Google Analytics has two pricing tiers: free and premium. For most small and medium-sized businesses, the standard, free version of Google Analytics is more than sufficient.Testing tech
Split tests require the technology that enables you to edit variations, split test variations, and track conversions. You can choose from among several services, including:- Visual Website Optimizer: An easy-to-use split testing tool. It allows you to run A/B and multivariate testing to optimize your website for increased conversion rates and sales. This paid tool has several pricing packages to choose from for individuals to large agencies.
- Unbounce: Gives marketers the power to build, publish, and optimize and test landing pages. It has several pricing tiers to choose from for entrepreneurs and enterprise-level businesses alike.
- Optimizely: One of the world’s leading experimentation platforms for websites, mobile apps, and connected devices. Optimizely makes customer-experience optimization software for companies, which gives businesses the capability to conduct A/B and multivariate testing. The company offers three pricing tiers.
Make sure to integrate your testing tech tool with Google Analytics so that your Google Analytics reports reflect accurate data.
Test duration calculator
A test duration calculator is a simple calculator that determines how long you need to run your split test to get a reliable test result. You input data such as the existing conversion rate, the number of variations in the test, the amount of traffic your site gets, and more. The calculator then determines how many days to run this test to get a reliable result. The following figure shows the free test duration calculator offered by Visual Website Optimizer.
Source: https://vwo.com/tools/ab-test-duration-calculator/A test duration calculator from Visual Website Optimizer.
Not every page on your website needs to be tested or requires optimization. In the next section, we discuss the ways for you to isolate the pages to test so you can maximize your return on investment (ROI).
Follow the split test guidelines
When you’re looking for pages to split test, use the following guidelines to determine how worthy a page is to test. First, here’s what not to test:- Your worst-performing pages (this sounds counter intuitive, but we explain why).
- Pages that don’t impact your longer-term business goals, for example, your 404 page.
- Pages that don’t get enough traffic to run a split test.
Further, your worst-performing pages don’t need a testing campaign; rather, they need an overhaul. The ship is sinking, and you don’t have time to hypothesize over what to do next; you need to make a drastic change that likely doesn’t need to be tested. Remember, in such a case, don’t test; implement!
For the same reason that you don’t want to test the worst-performing pages, you also don’t need to test your nonconversion-oriented pages. These nonconverting pages include your About Us page or your “dead end” 404 page.
However, optimizing 404 pages has proven to be useful in marketing. Even on that page, you should include an offer, a call to action, or some additional steps to keep the user engaged. You don’t need to test adding these elements to the page, however; just add content that meets your goals and then move on to more important pages that impact conversion. Amazon’s 404 page, shown in the following figure, directs people to the Amazon home page or suggests continuing to search.
Source: https://www.amazon.com/pizza404 pages, like Amazon’s, should offer users a next step but they don’t need to be split tested.
The final guideline you should follow when determining whether to split test a page is the page’s traffic. Look at the number of visits and of conversions that your page gets over the potential test period. Notice where traffic falls off considerably.
You can easily identify your pages and their traffic numbers using Google Analytics. Examine the number of Unique Pageviews for pages under consideration for split testing. The best report to employ for this job in Google Analytics is in the Behavior suite. In Google Analytics, navigate to the Reporting section and then select the following: Behavior →Site Content→All Pages. The All Pages report loads. From there, use the filter tool in Google Analytics to search for the specific pages you’re considering for a split test. This figure shows an example of what an All Pages Report looks like from DigitalMarketer.
Source: https://analytics.google.com/analytics/web/An All Pages Report from DigitalMarketer’s Google Analytics.
After you gather the data from the All Pages report, you should contextualize the pages. You’ll always see a massive drop-off in page views (the total number of pages viewed by a user; repeated views of a single page are counted) after your home page. However, your home page is so far away from your main converting action that it doesn’t make sense to test. Now, if you see a massive drop from a product page to the checkout page, you know that something is wrong with your product page and that you need to optimize it, and that merits a split test.
By following the guidelines in this section, you can hone in on pages worthy of your time and resources for testing. When you find a page that you consider to be test worthy based on the guidelines, make sure to ask these four questions:
- Does the page get enough unique visitors?
- Does the page get enough raw conversions?
- Does this page directly impact my goals? If indirect, how far away from the primary conversion action is the page?
- What’s the potential impact on your goal, such as for sales or leads?
- Qualifies that the page is worth using resources to test.
- Gives you an idea of whether testing will actually be useful.