Help Center
Docs

Conversation Quality

Score resolved support conversations against your own rubric, with a dispute trail your team can trust

What Conversation Quality Is

Every resolved conversation gets a quality score, judged against a bar your team defines.

Conversation quality reviews your resolved support tickets and scores each one from 0 to 100, so coaching conversations start from evidence instead of anecdotes. It lives in two places:

  • The Quality tab of the Service hub shows the scores: what was scored, and any dispute about it.
  • Service, Configuration, Quality holds the setup, in two sections: Rubrics (what tickets are judged on) and Lanes (which scoring lanes run). The Configure link beside Learn more on the Quality tab opens it. It opens for people who can view tickets and assign tickets; anyone else reads You need permission to view tickets and to assign tickets before you can configure conversation quality. An administrator in your workspace can grant it.
Included with ticketing, and scoring is free
Conversation quality is part of the ticketing suite, available on Business and above. The scoring itself costs nothing extra: the built-in checks are unlimited, and the AI review never draws your workspace's AI credits. Nothing on this surface is metered or billed.
AI agent conversations are not scored yet
Scoring covers resolved tickets. A conversation a customer has with the AI Customer Support Agent is not scored. If the agent passes the question to your team, the ticket it opens is scored once your team resolves it, like any other ticket.

Reading the Scores

A rolling list of scored conversations, with the workspace average alongside.

Resolved tickets are scored within about 30 minutes and appear on the Quality tab, newest first. A summary row shows the Average score, Open disputes and Overturned scores. You can narrow the list to All, the scores at or under your pass mark (for example 70 or lower), or Disputed. Opening a score shows the per-criterion breakdown behind the number, so a 62 is never just a 62: you can see which criteria earned it.

Before the first score

  • With scoring on, the tab reads No scored conversations yet and Scores appear within about 30 minutes after a ticket is resolved. Until you add a rubric, the built-in criteria apply. with Open the Inbox. Resolve a ticket or two and the first scores follow.
  • With scoring off, it reads Scoring is turned off, so no conversations are scored. If you can manage quality, Turn scoring on opens Configuration, Quality. Otherwise it adds A manager can turn it back on.
Every score names its yardstick
Each stored score records exactly what produced it: Custom rubric or Built in criteria, the rubric version it was graded against, plus the scoring model and prompt version. When someone questions a score six weeks later, the criteria that produced it are still on the record, even if the rubric has moved on since.

The Two Scoring Lanes

Deterministic checks that always apply, and an AI review of the conversation itself.

  • Checks that run without AI: rules the app checks itself, such as whether the customer got a reply inside your target and whether the conversation was actually resolved. Free and unlimited on every plan.
  • Scored by AI: an AI review reads the conversation and grades it against your active rubric (or the built-in criteria). Included at no cost. It never uses your AI credits.

The Lanes section of Configuration, Quality holds a switch for each lane, and only a service administrator can change them. Turning one lane off never changes the other lane's setting. But nothing is scored while Scored by AI is off, so the checks lane pauses too, and its row says Nothing is scored while Scored by AI is off, so this lane is paused too. With both lanes on, every resolved conversation carries both the deterministic checks and the AI review.

Building Your Own Rubric

Define what a good conversation means for your team, and test it before it goes live.

Until you author a rubric, conversations are scored on the built-in criteria: empathy, sentiment, comprehension, and resolution. A rubric replaces that default with your own bar: a set of criteria, each with a weight, and optionally marked Critical (a conversation that misses a critical criterion fails outright, whatever its other marks). With no rubric yet, the Rubrics section reads No rubrics yet and Create a rubric, test it, then activate it. Creating and activating rubrics needs permission to assign tickets.

1

Create the rubric

In Configuration, Quality, press New rubric. Give it a Rubric name and a Pass mark, out of 100, then Add criterion for each thing you judge: what good looks like, its Weight, percent, whether it is Critical, and its options and their scores. New rubrics always start inactive and untested: nothing is graded on your draft while you shape it.

2

Test it against real conversations

Run test saves the rubric and dry-runs it against your recent resolved conversations without writing a single score: The dry run reads real resolved conversations without calling a model, so it costs nothing and changes no score. Under Worth knowing before you activate, the report warns when one criterion soaks up most of the signal (several criteria asking the same question) or never fires at all (too narrow to matter). Run test needs Scored by AI to be on.

3

Activate it

Activation is refused until the rubric has been tested, because going live changes how everyone's work is graded from that moment on. One rubric is active at a time; activating a new one stands the previous one down. Stand down on the active rubric returns scoring to the built-in criteria.

No resolved tickets yet? The test uses a sample
On a new workspace there is nothing to test against, so Run test runs on a built-in sample conversation instead and says so: No ticket is resolved yet, so the test ran on a built in sample conversation. It calls no model, costs nothing and changes no score. A rubric tested on the sample can be activated, so you can set up quality on day one.
Versions, not edits
A live rubric cannot be edited: past scores point at its exact criteria, and rewriting them would change what those scores meant. Creating a rubric with the same name mints the next version instead, and editing a draft's criteria clears its tested state, so an untested yardstick can never slip through the activation gate.

Disputes and Overturned Scores

A score that grades a person's work has to be contestable by that person.

The agent a score is about can press Dispute this score, say Why this score is wrong, and Send dispute. Until a manager looks, the score reads Waiting for a manager to review it. A manager then rules on the dispute, with an optional Note for the record: Uphold leaves the score standing, and Overturn records that the team decided the score was wrong. The score then reads Upheld by a manager or Overturned by a manager. Nothing is deleted or rewritten at any step: the original score, the objection, and the ruling all stay on the record, which is what makes the number defensible when it comes up in a coaching conversation.

Neither side has to go looking. Filing a dispute sends a Conversation quality dispute filed notification to everyone who can decide it, and ruling on one sends a Conversation quality dispute decided notification to the agent the score is about. Both arrive in the app, in your notifications, and neither is emailed on its own. They are there so nobody has to poll a tab: the objection reaches a decider and the outcome reaches the person it is about, without either of them refreshing anything.

A notification, not a task
Both of these are things to know rather than things to do, so neither one lands in My Work. That is deliberate: a filed dispute is not claimable by one particular manager, so putting it on a shared to-do list would suggest an owner it does not have. The Quality tab is where disputes are actually read and ruled on, filtered to Disputed, and it stays the one place that work is worked. You can turn either notification down like any other, under your notification settings.
Overturned scores stay out of the math
An overturned score remains visible in the list, flagged, but it is excluded from every average and aggregate: This score is excluded from averages and from coaching. A finding your team decided was wrong should not keep dragging on the team's quality number.