A/B Testing Cold Email: What to Change First

A/B testing cold email, properly

Published 22 July 2026 · 5 min read · By Ripe Leads

The short answer

Change one variable at a time, start with whichever number is weakest, and run enough volume that the result is not noise. Testing five things at once produces a better campaign and no idea why.

"We changed the email and replies went up" is a nice sentence that teaches you nothing if you changed five things.

Fix the weakest number first

There is no point testing copy if nobody opens the email. Let the metrics point you at the problem:

Test in order: subject, opening line, offer, call to action

One change at a time

This is the rule people break most. If you change the subject, the opening and the ask together and replies improve, you have no idea which one did it, so you cannot repeat it.

Changing one variable per test is slower and it is the only way the result means anything.

Volume decides whether it is real

A test on forty emails is a coin flip. One or two random replies swing the percentage completely, and you draw a confident conclusion from noise.

Meaningful tests need real volume behind each variant, which is another reason sending capacity matters beyond raw reach.

Measure the number the change should move

A subject test is judged on opens. A copy test is judged on replies. A call to action test is judged on how many replies turn into real conversations. Watching the wrong metric is how teams talk themselves into a change that did nothing.

It never really finishes

Audiences adapt and what worked last quarter fades. Testing is a habit rather than a project, and small, disciplined changes compound into a campaign that keeps improving instead of slowly decaying.

Frequently asked

What should I A/B test first in a cold email campaign?

Start with whichever metric is weakest. If opens are low, test the subject line. If opens are healthy but replies are not, test the opening line and the offer. If you get replies that never progress, test the call to action. Testing in that order fixes the actual bottleneck.

Why should I only change one thing per test?

Because changing several variables at once makes the result uninterpretable. If replies improve after you altered the subject, the body and the ask together, you cannot tell which change caused it, so you cannot repeat or build on it.

How much volume does a cold email test need?

Enough that one or two random replies cannot swing the outcome, which usually means several hundred emails per variant. Small tests produce confident-looking percentages built on noise, and acting on them tends to make campaigns worse rather than better.

Rather not build this yourself?

We run the targeting, data, copy and follow-up as a done-for-you service, and send the interested replies straight to your inbox. You bring the close.

Book a strategy call