Most agency evaluations happen at the wrong altitude — case studies, a polished pitch, a client logo wall. Six months later, leadership can't clearly explain what's being done or who's accountable for the number that matters. Here's the framework that actually predicts performance.
Most agency evaluations happen at the wrong altitude. Leadership teams review case studies, sit through a polished pitch, check a client logo wall, and sign. Six months later, they can't clearly explain what's being done, why rankings haven't moved, or who's actually accountable for the number that matters. The evaluation criteria that predict long-term performance are different from the ones that win a pitch meeting.
Why the Pitch Deck Is the Wrong Evaluation Tool
A strong pitch deck demonstrates presentation skill, not delivery discipline. The questions that actually predict whether a partner will perform over 12 months rarely come up in the sales conversation, because they're less flattering to ask and less flattering to answer.
What Actually Predicts Performance
Defined reporting cadence, tied to outcomes, not activity. "We published 8 blog posts this month" is an activity report. "Organic traffic to the target page cluster grew X%, and here's what drove it" is an outcome report. If the standard reporting format leans on activity metrics, that's usually because the outcome metrics aren't moving yet.
Clear ownership of specific metrics. Ask directly: who owns organic ranking movement, who owns paid campaign ROI, who owns lead quality versus lead volume? A partner who can answer specifically is running a structured program. A partner who answers in generalities is running a service, not a strategy.
Transparency into who does the actual work. Some agencies subcontract execution to freelancers or third-party vendors without disclosing it. That's not automatically disqualifying, but it should be disclosed, because it affects quality consistency and accountability when something goes wrong.
A documented strategy phase before execution starts. A partner who starts publishing content or launching campaigns in week one, without a discovery phase covering audience, competitive positioning, and keyword strategy, is optimizing for a fast start over a sound one.
Realistic timelines. SEO in particular has a floor on how fast it moves — meaningful organic growth for a properly optimized content program typically takes 3–6 months, longer for competitive keyword categories. Any partner promising first-page rankings within weeks for a competitive term is either inexperienced or not being straight with you.
The Red Flags Worth Taking Seriously
- Guaranteed rankings or guaranteed traffic numbers. No legitimate partner controls search engine algorithms closely enough to guarantee outcomes.
- Vague answers about which channels and tactics will be used. A credible strategy can be explained in plain language; a vague answer often means there isn't one yet.
- No single accountable point of contact. Marketing programs that rotate account managers or lack a named strategist tend to lose institutional context every time someone changes.
- Reporting that would be hard to defend to your own leadership. If a report wouldn't hold up when you present it upward, it won't hold up as a performance signal either.
Why Coordination Between Marketing and Technology Matters
A significant share of marketing recommendations — landing page changes, site speed fixes, schema markup, conversion flow adjustments — require technical implementation, not just content or campaign work. When marketing and technology delivery sit with separate, uncoordinated vendors, these recommendations sit in a queue waiting for a second vendor relationship to prioritize them.
This doesn't mean marketing and technology must come from the same partner in every case. It means the coordination gap should be explicitly planned for — either through a single accountable partner spanning both, or through a clearly defined handoff process between separate vendors, agreed before the engagement starts.
A Practical Evaluation Checklist
Before signing, ask a prospective partner to answer these directly:
- What does your discovery and strategy phase actually produce, and how long does it take?
- Who is the named point of contact accountable for results, and how often do we meet?
- What's the reporting format, and can you show a sample report from an existing client?
- Is any of the execution subcontracted, and if so, what's disclosed?
- What's a realistic timeline for the specific outcome we care about — not a generic industry average?
- How do you handle work that requires technical or website changes outside your direct control?
A partner who answers all six specifically, without hedging, is worth a serious conversation. A partner who answers in generalities is a bigger risk than the pitch deck suggested.
The Bottom Line
Choosing a digital marketing partner is a governance decision, not a creative one. The organizations that get consistent results aren't the ones that picked the flashiest pitch — they're the ones that asked for reporting structure, named accountability, and realistic timelines before signing, and coordinated the marketing-to-technology handoff instead of leaving it to chance.
This is the same accountability standard behind our own Digital Marketing & Growth practice — paired with the engineering delivery to actually implement what the strategy recommends, so there's no second vendor relationship in the way.