Subject lines are a good place to start for Hollow Creek Soap. Before I plan the tests, I need a few things. I will not guess them, because the split math and the calendar depend on them.
- platform: Which email platform sends your newsletter? My saved sources cover Klaviyo campaigns only. On any other platform, the test settings are not confirmed in the sources, so I would ask you about them.
- audience_size: You said the list is about 5k people. How many recipients actually get each campaign (deliverable recipients, not total contacts)? I need an exact number to work out how many people get each version and how many get the winner.
- send_calendar: The newsletter send dates for the quarter. I place one test on each send date.
- test_ideas: You said "maybe subject lines". Is that the only idea, or are there others, such as preview text, sender name or email content? I keep each test to one change, and the idea decides how the winner is judged.
Optional, with the default I use if you skip it:
- blackout_dates: Dates you do not want tests on. Default: none. Holiday weekends are worth listing.
- apple_mail_share: Share of your opens from Apple Mail. Default: unknown, so open rate results get a caution, since Apple Mail can inflate opens.
- placed_order_metric: Does your account track a Placed Order metric? Default: no, so I will not use placed order rate.
- test size: Default 40% of the audience, split evenly between 2 versions, unless you set another.
Nothing gets scheduled or sent until you approve the calendar.