Skip to main content

A/B Testing: How to create a Result Modification A/B test

Lee Wells
  • Updated

    This is a step-by-step guide on how to create a result modification A/B test in the Fredhopper Merchandising Studio

     

    Prerequisites

    • You have attended initial implementation training or
    • You have read 'Getting started with Fredhopper'
    • Fredhopper's Merchandising Studio is integrated successfully for your business.
    • You need to have permission in Fredhopper's Merchandising studio to create any rules which are applied to a scope.
    • A/B testing must have been integrated into your solution by an Attraqt Technical consultant.

    Steps 

    To set up an A/B Test using Result Modifications in the Merchandising Studio, you will need to perform the following steps:

    •  
      •  Login to the Merchandising studio.
         
      • Select A/B test Menu.
        AB_Test_2.png
         
      • From the A/B test screen, Click New to create a new test
        AB_Test_3.png
         
      • The New test screen appears
        AB_Test_4.png
         
      • Select the A/B test type using the drop-down as 'Result Modification' 
        AB_Test_5.png
        Once selected, click the select scope button
         
      • From the scope screen, select the relevant scope for the test. (here we will be using 'en_GB')
        AB_Test_6.png
        Then click the select button to confirm.
         
      • Now select the trigger type to be used 
        AB_Test_7.png
         
      • Select the trigger for the A/B test. (For this example 'user location' will be used)
          
      • Now the trigger is selected, click 'add location' button 
        AB_Test_9.png
         
      • The modification screen opens to allow the location to be set

         
      • In this example, we will use the 'clothing' category by selecting it from the category facet. 

         
      • Once the location has been set, click the 'select location' button to return to the previous screen.

         
      • The 'User location' can be adjusted if required for contains, equals, ends_with etc.., 
        AB_Test_13.png
        Scroll down to the first case 'Case A' to continue setting up the test.
         
      • Select if case A will use the underlying page ranking or not.
        AB_Test_14.png
         
      • In this example, we will select 'use modifications' from the drop-down.
        AB_Test_15.png
         
      • Click 'Configure modifications'.
        AB_Test_16.png
         
      • This will open the modifications screen.
        AB_Test_17.png
         
      • Click to create a new group,  (This example will group buying_season 'SS22')
        AB_Test_18.png
         
      • Select "Create group":
        AB_Test_19.png
         
      • You can now add 'Rank by' filters if required and select the number of items for the modification. (In this example we will set it for 10 items to be included).
        AB_Test_20_B.png
         
      • Click the 'Apply' button.
        AB_Test_20.png
         
      • A new window opens, and the group is now shown and highlighted.
        AB_Test_22.png
         
      • Select the AB_Test_23b.png icon to see the group settings.
        AB_Test_23_24.png
         
      • Select what you wish to do with the group (In this example we will move the group to the bottom of the page). 
         
      • The screen will refresh. Select >> to be taken to the bottom of the page.
        AB_Test_25.png
         
      • Here we can see the group has been moved to the bottom, click back one page to see the remainder of the group.
        AB_Test_26.png

         
      • Once happy with the position, Click Finish to confirm.
        AB_Test_27.png
         
      • You will be returned to the A/B test screen.
        AB_Test_28.png
        You can now add more modifications to 'Case A' if required (we will not for this example). 
        Also, the traffic allocation split can be adjusted here (50% is the default) we will leave it as is.
         
      • We can now edit the settings for 'Case B' 
        AB_Test_29.png
      • Click the 'Configure modifications' button 'Case B' to open the modifications screen.
      • The location 'clothing' will already be set based on the A/B test trigger we set earlier.  AB_Test_31.png
         
      • Click on the group,  (For 'Case B' we will also group 'buying_season 'SS22' )
        AB_Test_32.png
         
      • Select to create the group
        AB_Test_33.png
         
      • You can now add 'Rank by' filters if required.
        AB_Test_34.png
         
      • Set the number of items for the modification to 10 items.
        AB_Test_35.png
      • Click the 'Apply' button.
         
      • The result modification screen opens and the group is now shown and highlighted.
        AB_Test_37.png
         
      • Select the AB_Test_23b.png icon to see the group settings.
        AB_Test_38.png
      • For 'Case B' we will move the group to position 1 by pressing the 'Apply' button.
         
      • The group's position will remain the same as it is already at the top of the 'clothing' section, Click Finish to confirm.
        AB_Test_40.png
         
      • You will be returned to the A/B test setup page.
        AB_Test_41.png
      • Further test cases can then be added to make the test an A/B/C test. (This example will stick with A/B).
        AB_Test_42.png
      • Once happy with the test cases, click to save the test.
        AB_Test_43.png
         
      • Now you can 'send for publication'
         
      • You can now see the test listed on the A/B test page.
        AB_Test_45.png
         

     

     

    Related articles

    Comments

    0 comments

    Article is closed for comments.