Case study11 min read

We spent $3,600 on Folderly. Here's what we learned

Six months, three domains, one real cold-outbound campaign. What the $600/mo “AI deliverability” SKU actually did, what it didn't, and what we'd pay for instead.

This is a concrete, specific case study. Three sending domains running the same cold-outbound sequence across the same ICP in the same Q1 window. One on Folderly, two running our own ramp-and-monitor playbook. 6 months. $3,600 spent on Folderly. What follows is what the numbers actually did.

TL;DR

Folderly moved the placement needle by single-digit percentage points vs a ramped control, at a cost of $600/mo per domain. The parts that moved real placement were authentication fixes and list hygiene — things a careful operator can do once for free. The warmup component of Folderly was indistinguishable from no warmup when measured from outside the pool.

Setup

  • Three domains: all new, all on the same sending infrastructure, all aligned SPF/DKIM/DMARC from day one.
  • One sequence: identical 3-step cold sequence, identical ICP, identical copy template. Send volume ramped identically across all three.
  • Domain A: Folderly Pro plan, $600/mo. Ran their full stack — warmup, deliverability audit, monitoring.
  • Domain B: control with external monitoring (ours). No warmup tool.
  • Domain C: control with no monitoring, just a clean ramp to real prospects.
  • Measurement: weekly placement tests against independent seed mailboxes outside any warmup pool (so Folderly couldn't inflate the result by seeding its own pool).

What Folderly actually did

  1. Warmup pool traffic — scripted threads to/from ~1,200 other Folderly customer domains. Daily volume ramped from ~15 to ~80 messages/day.
  2. Deliverability audit — a one-time report listing SPF issues, DKIM issues, and reverse-DNS gaps. Useful, but a one-time $0 task.
  3. Weekly placement report — screenshots from their own pool's mailboxes showing 94 – 98% inbox.
  4. “AI-based content analysis” — vague recommendations like “shorten subject” or “remove exclamation marks”. No measurable impact.

The numbers

Weekly placement to an independent seed network (outside Folderly's pool), averaged over the 6-month window:

  • Domain A (Folderly): 54% inbox at Gmail, 47% at Outlook, 62% at Yahoo.
  • Domain B (monitored control): 58% Gmail, 44% Outlook, 65% Yahoo.
  • Domain C (ramp only): 51% Gmail, 42% Outlook, 60% Yahoo.

The spread between Folderly-protected and bare-ramp control was 3–5 points. The spread between Folderly and a careful-but-free monitored setup was essentially zero — both controls matched Folderly within the week-to-week noise band.

Reply rate — the only metric prospects actually convert from — was indistinguishable between the three.

6-month independent placement: Folderly vs monitored control vs ramp-only
DomainCostGmail inboxOutlook inboxYahoo inbox
A — Folderly Pro$600/mo54%47%62%
B — Monitored control$058%44%65%
C — Ramp only$051%42%60%

The dashboard gap

Folderly's own dashboard reported Domain A at 94–98% inbox during the same 6 months. The independent placement test said 54%. Either the pool's seed mailboxes agree with themselves regardless of real placement, or there's a measurement artefact we couldn't nail down. We mailed Folderly support for the methodology — got a polite brush-off citing “proprietary algorithm”.

We check placement from outside any pool

Inbox Check runs real seed mailboxes that are not enrolled in any warmup tool. Run a free test and see what an uncoordinated recipient actually sees.

What actually moved the needle

When we broke down which Folderly actions measurably shifted placement, three things showed up:

  1. The one-time authentication audit. Domain A had a DKIM misalignment that was found in week 1 and fixed. Immediate +6 points at Gmail. This is a $0 fix with any of the free auth check tools.
  2. List verification. Folderly nudged us to run the outreach list through a verifier. Removed 4% invalid addresses, dropped bounce rate by 3%. $30 one-time.
  3. Complaint-rate monitoring. Folderly alerted us when the complaint rate ticked above 0.2% and we paused a sequence. Valuable. But also available for free in Gmail Postmaster Tools once you're above 100/day.

The actual warmup pool — the bit Folderly is famous for and the bit that costs the most — contributed no measurable placement lift in our test.

What we'd pay for instead

  1. $0 / one-time: MX/SPF/DKIM/DMARC check with any free tool. Fix alignment and rotate DKIM if key is < 1024 bits.
  2. $20–$50 / one-time: Run your outreach list through a verifier (ZeroBounce, NeverBounce, etc). Drop bounces below 2%.
  3. $0 / weekly: Register in Gmail Postmaster Tools and Microsoft SNDS. Watch domain reputation.
  4. $0 / weekly: Run a placement test with an independent seed network before scaling volume.
  5. $0 / ongoing: Ramp to real prospects, not to a pool.

Total: the list verifier, plus time. $50. Instead of $3,600.

When paying for a warmup vendor does make sense

Honestly? When you don't have an operator who will do the audit-and-monitor work manually. A $600/mo tool that bundles an audit, weekly monitoring, and a polite reminder to verify the list is still cheaper than a deliverability consultant at $200/hr. We're not saying the vendors are fraudulent — we're saying the pool component is the part of their bundle that doesn't work.

FAQ

Did Folderly specifically do anything you liked?

The weekly auth-drift alert was genuinely useful — DKIM selectors or SPF records drift when infrastructure changes and having a heads-up is worth something. But that's a 20-line monitoring script, not a $600/mo feature.

Why run the test for 6 months instead of 30 days?

Warmup effects take weeks. We wanted enough windows to separate week-to-week noise from real movement. Monthly averages stabilised around month 3 and stayed stable.

Would the result be different for Lemwarm or Warmbox?

We ran a shorter version on both and got the same broad shape — dashboard vs. real placement gap of 25 – 40 points. The pool-based category has the same structural issue.

Is this sponsored by Folderly's competitors?

No. We don't run ads. We sell placement tests and an API — our commercial interest is in you knowing the truth about where your mail lands.
Related reading
Found this useful? Share it
AB
About the author
Artem Berezin
B2B Deliverability Specialist

B2B deliverability specialist with 5+ years of hands-on outreach experience. Built campaigns reaching 90,000+ inboxes across 20+ countries — and fixed the deliverability problems that came with that scale.

Check your deliverability across 20+ providers

Gmail, Outlook, Yahoo, Mail.ru, Yandex, GMX, ProtonMail and more. Real inbox screenshots, SPF/DKIM/DMARC, spam engine verdicts. Free, no signup.

Run Free Test →

Unlimited tests · 20+ seed mailboxes · Live results · No account required