How should I run cold‑email tests? What sending volume should I aim for each week, how many mailboxes do I need, and which metric should I use to judge the results?
For a weekly test of one variable, aim for about 2,000 emails per week – roughly 300 per day. That means you’ll need the capacity to send 600‑900 emails daily, which translates to 20‑30 mailboxes. Test on reply rate rather than positive‑reply rate because you’ll get more data points; positive replies are too rare to be reliable at typical volumes. Ideally you want a reply‑rate multiplier of 2‑3× to feel confident. I usually wait until the end of the week before declaring a winner. The highest‑leverage variables to test are subject line, preview text, and icebreaker – those are the top‑ROI elements you see in Gmail’s layout. Optimising those first gives you the biggest impact.