Create and run page tests

Last updated Monday, February 6, 2017 in Sitecore Experience Platform for Content Author, Marketer
Keywords: Optimization, Testing

Page tests are different from content tests: a page test tests a complete page against another page. The pages in the test can be different versions of the same page, or they can be completely different pages.

You normally start page tests from the Experience Optimization application, although it is also possible to start a page test from the Experience Editor.

In order to create and run a page test, you must:

After the test, you can:

Select pages to test

To select the pages to test:

  1. Open the Sitecore Launch Pad, click Experience Optimization, and then click Create Page Test.
  2. Select the original page to test. You can navigate to a page, or you can search for it.
  3. Click the plus icon to select pages to test against:

    pages-to-test-against

    In the Add page dialog, select one of the following options:

    • use existing: select an existing page to test against.
    • previous page version: select the previous version of the current page (if one exists).
    • new page version: create a new version of the current page. You can edit the new version when you review the test.

    Picture 17

  4. Click the plus icon again to select more pages until you have selected all the pages that you want to test.

Review selected pages

When you have selected the pages that you want to test, you can review the test. Sitecore displays information about the test, and you can adjust a number of parameters for the test.

Sitecore displays previews of the pages that you have selected, with one variation selected and the other variations in the carousel under the selected variation. To select a different one, click any variation in the carousel.

You can see the following information:

  • An information bar that tells you how long the test is expected to need to run before it can declare a winner

    Picture 13

  • Information about the currently selected variation
  • A test summary

You can adjust the following parameters:

  • My expected effect of changes: make a guess about the change in engagement value of the changes you have made.
  • Percentage of visitors exposed to test: Specify the percentage of visitors that you want exposed to the test.

    For example, if you set the percentage at 40%, 40% of visitors will see one of the variations that you have created. The original variation is part of these. The remaining visitors – 60% in this example – will see the original variation.

    Sitecore calculates test results based on the visitors it exposes to the test.

  • Statistics: Select the statistical confidence level that the test needs to reach before it can declare a winner. You select one of 90%, 95%, or 99%. The higher the level, the longer the test needs to run.
  • Test objective: Select a test objective. You select either one of the goals specified in the Marketing Control Center, or you select Trailing Value/Visit (the engagement value based on page views occurring after the visitors encountered the page being tested, divided by the number of site visits).
  • Select how to pick a winner: Select how you want the winner picked:
    • Automatically select a winner based on the test objective
    • Automatically select a winner based on the test objective, unless it significantly decreases engagement value
    • Manually select winner
  • Duration: Specify the minimum and maximum time for the test to run:
    • Minimum: select 3, 7, or 14 days.
    • Maximum: select 14, 30, or 00 days.

Start the test

When you are done reviewing and adjusting, start the test:

  • Click Start test.

View test reports

When the test has found a winner, you can view the test results in Reports. You can see the test summary as well as:

  • An overview that shows the best page effect, the statistical confidence level, and the score gained.
  • A bar chart that shows the engagement value for the different pages in the test.
  • The conversion rate based on the goal that you select.

Send feedback about the documentation to docsite@sitecore.net.