You will learn
Learn how you can A/B test SMS messages in flows as well as what to test.
Because Klaviyo does not pick a winner for flows, you'll need to monitor performance over a set amount of time to gather the data you need to determine a clear winner. The amount of time that you run your test will depend on your sending frequency. For example, if you send SMS messages twice a month maximum, you will need to run the A/B test longer than if you send six times a month.
A/B testing helps you make data-driven marketing decisions to optimize your messages for your specific audience. By A/B testing your SMS, you can analyze the timing, the content, the number of messages, and whether an email or SMS converts better and choose the cadence that is the most engaging to your customers.
Branching for SMS
Before you build out the below tests, you’ll need to split your flow so that your SMS subscribers go down a different path than customers who have not opted-in to your SMS messages.
Adding a conditional split
To split off customers who have consented to receive SMS from those who haven’t, drag in a conditional split and add the condition that someone has consented to receive SMS at least once. You would use this option if you want email-only profiles in the same flow as your SMS A/B test.
Random sample conditional splits for testing
To build out any of the following ideas, you should create a random sample conditional split in your flow where you want to test your SMS messages.
To start, drag in a conditional split and add in a random sample split of greater than 10% of your customers going through the flow.
Timing of messages
Because it’s important to contact customers at a time when they are most likely to convert, you can play with the timing of your flow sends.
In the case of an abandoned cart flow, for instance, you can build out a split where you test a 1-hour and a 4-hour delay (or any time iteration that makes sense for your business).
Your SMS message content may also impact your conversion rates. Test out using personalization, a discount, or the first word of your SMS, and see if it leads to a lift in your click rates.
Number of messages
You can test to find the number of SMS messages that receive optimal engagement. Try adding an additional message to your current SMS sending strategy and see how it performs.
SMS vs. email message
Lastly, you can see if your SMS or email performs better at a certain point within the customer cycle. This could be especially useful in your welcome series and abandoned cart flows. Split your flow with a random sample and see if sending an email or SMS leads to higher revenue.