Open 25 email agency monthly reports and you will find the same six metrics: sends, opens, CTR, CTOR, unsubscribes, and “revenue attributed”. Five of those six are either corrupted by provider behaviour or constructed to be the biggest-looking number defensible. The sixth is revenue, attributed with last-touch last-email-click, which over-credits the email channel by an embarrassing multiple.
The agency business model rewards demonstrable activity, not incremental revenue. Until you demand placement, reply rate, and pipeline, you will keep getting opens and clicks. The providers are complicit: their dashboards are built for the same audience.
The business model makes vanity inevitable
An agency charges monthly retainer. Retainer renews when the client feels they are getting value. Value is demonstrated at a QBR. The easiest thing to demonstrate is a number that went up. Opens go up when you run an email. Clicks go up when you add a CTA. Revenue attributed goes up when you widen the attribution window. Incremental revenue — what you would have lost by stopping — is hard to measure, frequently lower than the retainer, and therefore never reported.
No individual agency is doing anything malicious. The incentive structure rewards the path of least measurable resistance, and the industry arrived at it collectively.
The five corrupted metrics
- Open rate. Broken since Apple MPP in September 2021. No interpretation in 2027 is honest.
- Click rate. Inflated by Microsoft Defender, Proofpoint, Mimecast Safe Links pre-clicking URLs. 20–40% of “unique clicks” on B2B lists are security scanners.
- CTOR. Click-to-Open ratio. Both numerator and denominator corrupted. The ratio is “more reliable” than either input only in the sense that two wrongs cancel.
- Unsubscribe rate. Not corrupted but meaningless without denominator context. “0.08% unsubscribes” on a campaign that went to 40% spam is not a win.
- Attributed revenue. Last-touch, last-click, widest possible window. Overstates email's contribution by 2–5x on most setups.
The one honest diagnostic nobody reports
Inbox placement. A simple percentage — how many of the messages we sent to each provider landed in a folder the recipient actually reads — that every agency could report and almost none do. Why? Because it is usually worse than the “delivered” number the ESP displays, and introducing a worse-looking metric into the monthly report is career-damaging for a client-side marketer.
Next QBR, ask your agency for per-provider inbox placement. If they can't produce it, run a free placement test yourself. It takes under three minutes and it will reframe every subsequent conversation.
What a good agency actually looks like
- Reports placement per provider, every month
- Segments reply rate from open rate; treats them as different quality tiers
- Attributes pipeline, not revenue, for B2B — with a stated model (W-shaped, time-decay, etc.)
- Runs a periodic “hold-out” test to measure incremental lift, and reports the result honestly
- Proactively flags list-quality problems, even when it means less volume billed
These agencies exist. They are rare. They charge more. They are worth it.
The ESP is not your friend
Every mainstream ESP dashboard defaults to opens, clicks, and “delivered”. Placement is not shown because the ESP does not know it — and they have not built it because knowing it would expose failures they cannot fix. The ESP's job is to transmit bytes. Placement is Gmail's decision.
This is why seed testing is a separate tool category. Your ESP will never credibly tell you how well their transmission is landing. It would be a conflict of interest.
What to demand starting Monday
- Per-provider placement in the monthly report. Specifically: Gmail (Primary / Promotions / Spam), Outlook, Yahoo, Mail.ru, Apple Mail.
- Reply rate, segmented from open rate, as a quality tier.
- Pipeline attribution (not revenue attribution) for B2B, with a stated model.
- A quarterly hold-out experiment. Suppress 10% of your list for 30 days. Measure incremental.
- DMARC aggregate data summarised monthly. Auth health is not optional.
If the agency cannot produce these, you have learned something. If they can, they were probably already giving them to you and you were not asking.
This is not an anti-agency piece
Good email agencies are force multipliers. Bad ones are expense centres dressed up as growth. The difference is in the metrics they will show you without being pushed. Push.