The short version
- Call reviews exist to help agents improve, not to catch them doing something wrong.
- Review a mix of calls, use a simple scorecard, and score the behaviors that matter most to customers.
- Hold regular calibration sessions so every reviewer scores the same way.
A call review, sometimes called a quality review or QA evaluation, means listening to a recorded customer conversation and assessing how well it was handled. Done well, reviews show you exactly what your team does well and where it needs help. Done poorly, they feel like a gotcha, and agents stop trusting the process.
This guide walks through a simple, fair approach any supervisor can use.
Why call reviews matter
Numbers like handle time and satisfaction scores tell you what is happening. Listening to calls tells you why. A review can reveal:
- Skill gaps, such as an agent who doesn’t fully understand a product
- Process problems, such as a confusing policy that causes repeat calls
- Coaching opportunities, both strengths to reinforce and habits to change
- Compliance risks, such as skipped verification steps or missing required disclosures
- Customer insights, such as common complaints or questions your website should answer
Three kinds of reviews
| Type | Purpose | Who does it |
|---|---|---|
| Quality evaluation | Scores a call against a standard scorecard | Supervisor or QA specialist |
| Coaching review | Listens to a call together with the agent to discuss it | Supervisor and agent |
| Calibration | Several reviewers score the same call and compare results | Supervisors, QA, and sometimes agents |
Most teams use all three. Evaluations measure, coaching reviews build skills, and calibration keeps everyone fair.
Step 1: Choose which calls to review
How you pick calls affects how fair the results are.
- Mix random and targeted calls. Random calls show typical performance. Targeted calls, such as long calls, escalations, or calls with low survey scores, help you investigate specific problems.
- Include good calls. If you only review problem calls, agents learn to dread reviews, and you miss chances to recognize great work.
- Cover different call types and channels. Include billing calls, technical calls, chats, and emails, not just one kind.
- Review the same number for each agent. A handful of calls per agent each month is a common starting point. It’s better to review fewer calls thoroughly than many calls quickly.
- Don’t judge on one call. Look for patterns across several calls before drawing conclusions.
Step 2: Use a simple scorecard
A scorecard is the checklist you score each call against. Keep it short enough to use consistently. Most scorecards cover five or six areas:
| Area | What to look for |
|---|---|
| Opening | Professional greeting, verified the customer’s identity correctly |
| Understanding | Asked good questions, confirmed the customer’s issue before solving it |
| Resolution | Gave accurate information, solved the problem or set a clear next step |
| Communication | Clear, courteous, showed empathy, avoided jargon |
| Process and compliance | Followed required steps, disclosures, and documentation |
| Closing | Summarized next steps, confirmed nothing else was needed |
Tips for a better scorecard:
- Write clear descriptions. “Showed empathy” means different things to different people. Spell it out, for example: “Acknowledged the customer’s frustration in their own words before moving to the solution.”
- Weight what matters most. Resolving the issue correctly should count more than using the customer’s name.
- Separate critical items. Compliance failures, such as skipping identity verification, are usually scored separately so they’re never hidden by a high overall score.
- Use simple scales. “Yes / No / Not applicable” or a three-point scale is easier to apply consistently than a 1–10 scale.
Step 3: Review the call
- Listen to the whole call before scoring. Early moments often make sense only once you’ve heard the rest.
- Check the account notes and any related records, so you understand what the agent could see.
- Score each section using the scorecard descriptions, not your general impression.
- Write specific comments with timestamps, such as “At 3:10, confirmed the order number before processing the refund. Great catch.”
- Note any process problems that weren’t the agent’s fault, such as a system outage or a confusing policy.
Step 4: Share the results
A score on its own changes nothing. The value comes from the conversation afterward.
- Share results promptly, ideally within a few days, while the call is still fresh in the agent’s memory.
- Listen together when possible, and ask the agent how they think it went before sharing your view.
- Start with strengths, then focus on one area to improve.
- Agree on a next step and a follow-up date.
Our guide to coaching conversations that work covers this conversation step by step.
Step 5: Calibrate regularly
Calibration keeps reviews fair. Without it, one supervisor might score a call 95% while another scores the same call 80%, and agents notice.
How to run a calibration session:
- Pick one or two recorded calls.
- Have each reviewer score them independently, using the same scorecard.
- Meet and compare scores, section by section.
- Discuss differences and agree on how each item should be scored.
- Update the scorecard descriptions if they caused confusion.
Many teams calibrate monthly. Inviting an experienced agent to join now and then helps build trust in the process.
Let agents review themselves
Asking agents to score one of their own calls before a coaching session is one of the most effective quality tools available. Agents often spot their own improvement areas, and they take ownership of changes they identify themselves.
What about technology?
Many contact centers now use speech analytics and AI-assisted quality tools that can review far more calls than a person can, flagging issues like long silences, negative customer language, or missed compliance phrases. These tools help you decide which calls to listen to, but they work best alongside human reviewers, who understand context, tone, and judgment calls that software can miss.
Common mistakes to avoid
- Only reviewing bad calls. Agents come to see quality as punishment.
- Scoring on impressions. Stick to the scorecard descriptions and specific moments in the call.
- Long, complicated scorecards. If reviewers can’t apply it consistently, it isn’t measuring anything.
- Skipping the conversation. A score without coaching rarely changes behavior.
- Blaming agents for broken processes. If several agents struggle with the same thing, the process is likely the problem.
- Never calibrating. Inconsistent scoring quickly destroys trust.
What to read next
- Coaching conversations that work: how to turn review results into real improvement
- Reading your dashboard: which numbers matter and what they’re telling you
- Your first 90 days as a supervisor: what to focus on in your first three months