A/B Split Test Campaigns are used for testing subject lines. RiMANGGIS will send two different versions of campaign emails to small portion of your customers and track campaign performance to decide the winning version which will be sent to all remaining subscribers.
Users can define two versions of subject lines, and set the proportion of sample customers for test. RiMANGGIS will execute the test according to the preset parameters by users and automatically analyze the open rate of each version and determine the winning version.
Example:
A user sets following parameters for A/B split test campaign.
- Subject lines: Version A, Version B.
- Recipient range: all customers in database.
- Percentage of sample customers: 18%
- Start A/B Test Schedule: 2014‐12‐10 8:00
- End A/B Test Schedule: 2014‐12‐11 8:00
- Winning Version Schedule: Right after execution of the A/B Test
The total number of customer is 15; the calculated value of 18% is 2.7. RiMANGGIS will round down the value 2.7 as 2. When the campaign is prepared, RiMANGGIS will randomly send the Version A campaign to 2 customers and Version B campaign to other 2 customers on specified test schedule. During test time, RiMANGGIS will automatically collect the two campaigns’ customer behavior data (open) and decide the winning version, the rest 11 customers will receive the winning version.