Case study11 min read

We spent $3,600 on Folderly. Here's what we learned

Six months, three domains, one real cold-outbound campaign. What the $600/mo “AI deliverability” SKU actually did, what it didn't, and what we'd pay for instead.

This is a concrete, specific case study. Three sending domains running the same cold-outbound sequence across the same ICP in the same Q1 window. One on Folderly, two running our own ramp-and-monitor playbook. 6 months. $3,600 spent on Folderly. What follows is what the numbers actually did.

TL;DR

Folderly moved the placement needle by single-digit percentage points vs a ramped control, at a cost of $600/mo per domain. The parts that moved real placement were authentication fixes and list hygiene — things a careful operator can do once for free. The warmup component of Folderly was indistinguishable from no warmup when measured from outside the pool.

Setup

  • Three domains: all new, all on the same sending infrastructure, all aligned SPF/DKIM/DMARC from day one.
  • One sequence: identical 3-step cold sequence, identical ICP, identical copy template. Send volume ramped identically across all three.
  • Domain A: Folderly Pro plan, $600/mo. Ran their full stack — warmup, deliverability audit, monitoring.
  • Domain B: control with external monitoring (ours). No warmup tool.
  • Domain C: control with no monitoring, just a clean ramp to real prospects.
  • Measurement: weekly placement tests against independent seed mailboxes outside any warmup pool (so Folderly couldn't inflate the result by seeding its own pool).

What Folderly actually did

  1. Warmup pool traffic — scripted threads to/from ~1,200 other Folderly customer domains. Daily volume ramped from ~15 to ~80 messages/day.
  2. Deliverability audit — a one-time report listing SPF issues, DKIM issues, and reverse-DNS gaps. Useful, but a one-time $0 task.
  3. Weekly placement report — screenshots from their own pool's mailboxes showing 94 – 98% inbox.
  4. “AI-based content analysis” — vague recommendations like “shorten subject” or “remove exclamation marks”. No measurable impact.

The numbers

Weekly placement to an independent seed network (outside Folderly's pool), averaged over the 6-month window:

  • Domain A (Folderly): 54% inbox at Gmail, 47% at Outlook, 62% at Yahoo.
  • Domain B (monitored control): 58% Gmail, 44% Outlook, 65% Yahoo.
  • Domain C (ramp only): 51% Gmail, 42% Outlook, 60% Yahoo.

The spread between Folderly-protected and bare-ramp control was 3–5 points. The spread between Folderly and a careful-but-free monitored setup was essentially zero — both controls matched Folderly within the week-to-week noise band.

Reply rate — the only metric prospects actually convert from — was indistinguishable between the three.

The dashboard gap

Folderly's own dashboard reported Domain A at 94–98% inbox during the same 6 months. The independent placement test said 54%. Either the pool's seed mailboxes agree with themselves regardless of real placement, or there's a measurement artefact we couldn't nail down. We mailed Folderly support for the methodology — got a polite brush-off citing “proprietary algorithm”.

We check placement from outside any pool

Inbox Check runs real seed mailboxes that are not enrolled in any warmup tool. Run a free test and see what an uncoordinated recipient actually sees.

What actually moved the needle

When we broke down which Folderly actions measurably shifted placement, three things showed up:

  1. The one-time authentication audit. Domain A had a DKIM misalignment that was found in week 1 and fixed. Immediate +6 points at Gmail. This is a $0 fix with any of the free auth check tools.
  2. List verification. Folderly nudged us to run the outreach list through a verifier. Removed 4% invalid addresses, dropped bounce rate by 3%. $30 one-time.
  3. Complaint-rate monitoring. Folderly alerted us when the complaint rate ticked above 0.2% and we paused a sequence. Valuable. But also available for free in Gmail Postmaster Tools once you're above 100/day.

The actual warmup pool — the bit Folderly is famous for and the bit that costs the most — contributed no measurable placement lift in our test.

What we'd pay for instead

  1. $0 / one-time: MX/SPF/DKIM/DMARC check with any free tool. Fix alignment and rotate DKIM if key is < 1024 bits.
  2. $20–$50 / one-time: Run your outreach list through a verifier (ZeroBounce, NeverBounce, etc). Drop bounces below 2%.
  3. $0 / weekly: Register in Gmail Postmaster Tools and Microsoft SNDS. Watch domain reputation.
  4. $0 / weekly: Run a placement test with an independent seed network before scaling volume.
  5. $0 / ongoing: Ramp to real prospects, not to a pool.

Total: the list verifier, plus time. $50. Instead of $3,600.

When paying for a warmup vendor does make sense

Honestly? When you don't have an operator who will do the audit-and-monitor work manually. A $600/mo tool that bundles an audit, weekly monitoring, and a polite reminder to verify the list is still cheaper than a deliverability consultant at $200/hr. We're not saying the vendors are fraudulent — we're saying the pool component is the part of their bundle that doesn't work.

FAQ

Did Folderly specifically do anything you liked?

The weekly auth-drift alert was genuinely useful — DKIM selectors or SPF records drift when infrastructure changes and having a heads-up is worth something. But that's a 20-line monitoring script, not a $600/mo feature.

Why run the test for 6 months instead of 30 days?

Warmup effects take weeks. We wanted enough windows to separate week-to-week noise from real movement. Monthly averages stabilised around month 3 and stayed stable.

Would the result be different for Lemwarm or Warmbox?

We ran a shorter version on both and got the same broad shape — dashboard vs. real placement gap of 25 – 40 points. The pool-based category has the same structural issue.

Is this sponsored by Folderly's competitors?

No. We don't run ads. We sell placement tests and an API — our commercial interest is in you knowing the truth about where your mail lands.
Related reading

Check your deliverability across 20+ providers

Gmail, Outlook, Yahoo, Mail.ru, Yandex, GMX, ProtonMail and more. Real inbox screenshots, SPF/DKIM/DMARC, spam engine verdicts. Free, no signup.

Run Free Test →

Unlimited tests · 20+ seed mailboxes · Live results · No account required