Escalation scorecard
The service prison: automate the answer, never the way out
Over the past months I read through thousands of customer reviews. One sentence kept coming back, in dozens of phrasings: "just try getting a human on the line." That's not an AI problem. That's a design flaw.
6 min read · Customer Experience & AI ·
The business case for AI in customer service was clear: fewer tickets, lower cost, faster answers. And it holds up — for part of your questions.
Something got lost in translation, though. Deflection became the goal instead of the means. And the moment "don't transfer" is your KPI, you systematically build a door without a handle.
That's the service prison. Your customer walks in, gets an answer to a question they never asked, and stays stuck until you let them out.
What customers actually write
We don't read customer reviews as sentiment, but as evidence. Tagged per touchpoint, from more than a hundred e-commerce customer journey scans. Three things stand out.
The friction sits on returns and service. Exactly the two moments where the customer is already irritated. So that's where you put your least experienced conversation partner.
The complaint is rarely about the quality of the answer. It's about the absence of a human. Customers accept a bot that doesn't know something. They don't accept a bot guarding the only exit.
And it costs you money. A wrong bot answer about a status doesn't save a ticket, it doubles it. First the bot, then the human, plus anger as a surcharge.
Four ways the door gets locked
Walk through them and tick what you recognise.
- 1
No escape hatch. There is no visible, unconditional path to a human. It only appears after three failed attempts, if it appears at all.
- 2
The bot doesn't know the status. It answers “where is my parcel?” without a live connection. A wrong answer is worse than no answer.
- 3
The bot as a barrier. A menu structure in which the customer's case simply doesn't exist.
- 4
Broken brand promise. If service is your proposition, going bot-first costs you more than it costs the competitor who promised nothing.
The second pattern: the silence after the action
There's a second failure pattern that comes back just as often, and it has nothing to do with bots.
The customer did exactly what you asked. Sent the email, filled in the form, registered the return. And then they hear nothing.
In our scans we see 235 negative signals about missing responses or updates, across 84 brands. Almost half of those sit in service, but it touches all eight touchpoints. On returns it's a small number of brands with a big effect: parcel on its way, no confirmation, no sight of your money.
Anger isn't the most dangerous emotion in your reviews. Resignation is. An angry customer still gives you a chance. A resigned customer doesn't come back and doesn't tell you either.
Five rules against the silence
This is the cheapest AI investment you can make, and at the same time the safest first rung.
- 1
Always confirm. Every customer action acknowledged within a minute, with a reference.
- 2
Promise a clock. A date, not “as soon as possible”. Uncertainty frustrates more than waiting.
- 3
Update proactively. On every status change and when there isn't one. “It's taking longer” is an update too.
- 4
Guard your promises. Every commitment gets a timer. Expired promises come back into the queue automatically.
- 5
Close the loop. Actively sign off, even on a “no”. Silence is not a closure.
Two failure patterns, one cause: the design starts from the system, not from the customer who is waiting.
Customers don't hate AI. They hate a closed door.
So the question isn't whether you automate, but what. Automate the answer. Never the way out.
And build it as a ladder, not a jump:
- 1
FAQ — static answers from your knowledge base.
- 2
Status lookup — only with live order and return data.
- 3
Transactional — start a return, change an address, move an appointment.
- 4
Autonomous handling — exceptions and goodwill.
One rung at a time, and only move up once the escalation path demonstrably works and satisfaction after bot contact holds up. Most accidents happen because organisations jump from 1 to 3 because the demo was impressive.
What a way out looks like
Six design requirements. This is the bit you screenshot.
- ✓
Always visible — from message one, not after three failed attempts.
- ✓
Unconditional — no mandatory bot round as a toll gate.
- ✓
With an expectation — show wait time or callback time.
- ✓
With context — the agent sees the bot conversation, the customer tells their story once.
- ✓
Automatic — on doubt, repetition or emotion the bot escalates itself. That's design, not failure.
- ✓
Measured — escalation rate is a KPI, not a number to hide.
Containment rate says nothing on its own
Containment rate is the percentage of conversations your bot handles entirely on its own, without a handover to an agent.
Formula
Containment = conversations handled by the bot ÷ total conversations started with the bot × 100%
Numerator: no handover, no ticket, no callback.
A fine number on paper. In practice the number most AI business cases are justified with. Four reasons why.
- 1
Contained is not resolved. The customer who gives up in frustration after three rounds counts as contained. So your bot scores highest at exactly the moment your customer quits. Always pair containment with CSAT and repeat contact.
- 2
Deflection and containment are two different things. Deflection: the contact never happened, because your help center already had the answer. Containment: the contact did start, and the bot finished it. Mix them in one report and nobody knows where the gain came from.
- 3
The scope is easy to manipulate. Route only the simple intents to your bot and containment shoots up without a single customer being helped better. So measure per C1-C2, never as one number across everything.
- 4
Repeat contact is the real test. Contained, and a week later contact again about the same topic? Then it wasn't contained. It was postponed, with an angry customer as a surcharge.
Same measurement rules as the rest of your reporting: a 7-day window, and at least 20 responses before a category gets a score. Below that threshold you don't have a measurement, you have an anecdote with a percentage sign.
That number is a lot lower than what's on your dashboard today. That's not bad news, that's your first honest baseline.
Measure alongside it: escalation rate, CSAT after bot contact and time-to-human. Allowed to add only one number to your dashboard? Take repeat contact within 7 days on the same C1.
The escalation scorecard
Is your customer in the service prison? Score each item with 1 (yes, demonstrably) or 0 (no or not measured). Only "yes" if you can prove it today — not if it's on the roadmap.
| # | Criterion | What you test |
|---|---|---|
| 1 | Visible way out | The first bot message already says how to reach a human |
| 2 | Unconditional way out | No mandatory bot round, quiz or “did this help?” as a toll gate |
| 3 | Expectation | On escalation you see wait time, callback time or response time |
| 4 | Context handover | The agent sees the bot conversation; the customer doesn't repeat their story |
| 5 | Automatic escalation | On doubt, a repeated question or emotion the bot escalates itself |
| 6 | Honest status | Without live order or return data the bot says “I don't know” instead of guessing |
| 7 | Escalation rate measured | On the dashboard as a KPI, per flow and per touchpoint |
| 8 | Repeat contact measured | Repeat contact on the same C1 within 7 days after bot contact is known and tracked |
| 9 | CSAT after bot contact | Measured separately, not buried in the overall CSAT |
| 10 | Rollback | Every AI flow can be switched off within a day, without a vendor ticket |
9-10 · Open door
You automate the answer, not the way out. The next rung is justified.
7-8 · Ajar
It works, but the escape hatch is still conditional or unmeasured. Fix the zero scores first.
4-6 · Door sticks
Customers get through, but with effort — and you'll read it back in your reviews. No new flows until 1 through 5 are green.
0-3 · Service prison
Deflection has become the goal. Turn on the escalation path before you optimise anything else.
Red flags, regardless of your score
- ✗Your escalation rate is zero, or it's falling and presented as a success.
- ✗Containment rate is the only AI KPI on your dashboard, or it's reported as one number across all categories.
- ✗The bot answers status questions without a live connection.
- ✗“Talk to an agent” only appears after three failed attempts.
- ✗Nobody can say how many customers came back within 7 days with the same question.
- ✗“No reply to my email” or “never heard anything again” shows up in your reviews. That's not an incident, that's a missing follow-up flow.
And a word for the vendors
Part of this problem isn't built at the brands, it's delivered. Four things customers need from you: escalation as a default instead of a setting, honest status data where "I don't know" is a valid answer, reporting on resolution instead of containment, and a brake the customer can press themselves.
Is your customer in the service prison?
It's already in your own reviews. We read them monthly, tagged per touchpoint, alongside your own ticket data. Then you see exactly where the door sticks.
Book half an hourOn 29 September I'm bringing this story to the CustomerFirst Congres at DeFabrique.
And if you say no afterwards, that's fine too. No is an answer here as well.
Source: tagged customer reviews from more than 100 e-commerce customer journey scans, read per touchpoint in the CX Report cockpit.
Veelgestelde vragen
What is the service prison?+
The situation where deflection has become the goal instead of the means. The customer lands on a bot, gets an answer to a question they never asked, and there is no visible, unconditional path to a human. You're not automating the answer, you're automating the way out.
Why is containment rate a vanity metric?+
Containment rewards lock-in: the customer who gives up after three rounds counts as contained. On top of that the scope is easy to manipulate (only route simple intents to the bot) and it says nothing about repeat contact. Always measure containment per C1-C2, alongside CSAT after bot contact and repeat contact within 7 days.
How do you define containment honestly?+
The bot resolves it, there is no agent handover, and there is no repeat contact on the same C1 within 7 days. Use the same measurement rules as the rest of your reporting: a 7-day window and at least 20 responses before a category gets a score.
What does a good escape hatch look like?+
Always visible from message one, unconditional (no mandatory bot round), with an expectation (wait or callback time), with context (the agent sees the bot conversation), automatic on doubt or emotion, and measured: escalation rate is a KPI, not a number to be ashamed of.
What is the second failure pattern besides bots?+
The silence after the action. The customer did exactly what you asked — sent the email, filled in the form, registered the return — and then hears nothing. In our scans we see 235 negative signals about missing responses or updates across 84 brands. Always confirm, promise a clock, update proactively, guard promises and close the loop.
In what order should you build AI into customer service?+
As a ladder, not a jump: 1) FAQ from your knowledge base, 2) status lookup with live order and return data, 3) transactional (start a return, change an address), 4) autonomous handling of exceptions. One rung at a time, and only move up once the escalation path demonstrably works and satisfaction after bot contact holds up.
Verder lezen
- Zendesk ticket categorization: best practices with C1-C2CX Digital Academy
Without clean C1-C2 you can't measure containment per category.
- Objective Scan: measure the chaos in your categorizationCX Digital Academy
Free tool that scores your ticket export on four data points.
- Nederlandse versie van dit artikelCX Digital Academy
De servicegevangenis: automatiseer het antwoord, nooit de uitweg.