← All field notes

What happens to the person who reports an AI mistake?

· Updated

Hands holding notes reading Good News and Bad News.
Illustrative image

Imagine a customer-service employee reviewing a proposed reply. The assistant has confused a contractual deadline with an internal target. The employee corrects the response before sending it, then considers whether to report the mistake.

Reporting takes extra time. Their manager measures handling speed. The AI project team has been celebrating successful adoption. The employee is unsure whether a report will be treated as useful information, resistance to change or evidence that they cannot use the tool properly.

Watch what happens after someone uses the feedback button.

If the organisation wants honest feedback, the work of reporting needs a credible place in the operating process.

Make the reporting cost visible

Ask someone to show how they would report a real problem. Can they attach the proposed answer and relevant source without exposing unnecessary customer information? Do they need to recreate the entire conversation? Does the form require technical labels they cannot reasonably choose?

Capture enough to investigate: the task, the observed output, why it was unsuitable and what the person did instead. The system can preserve its own configuration and authorised diagnostic details. The employee should not have to become an AI engineer before their observation counts.

The report also needs time. If the person must complete the same volume of cases while documenting defects outside their measured work, leadership has created a conflict it should resolve explicitly.

Separate learning from individual performance claims

Operational records may contain both tool failures and user mistakes. That does not justify turning every correction into a ranking of employees.

Define who can see reports and what uses are permitted. Explain those rules in ordinary language before collecting the data. Where employment, privacy or consultation requirements apply, involve the appropriate specialists and employee representatives.

Do not promise anonymity if the workflow cannot provide it. A case identifier or a shift pattern may make the reporter identifiable. A narrower, truthful promise is more useful than a sweeping statement the system contradicts.

Managers also need guidance. An increase in reports after launch may reflect better detection, wider use, declining quality or some combination. It does not establish which explanation is correct. Comparing raw report counts between employees is especially weak when their case types differ.

Show that a report changes something

A closed feedback ticket can still leave the reporter unsure whether anyone understood the problem.

Return a usable answer. Perhaps the source document was outdated, a retrieval filter missed an exception, or the task is outside the approved scope. Explain the action taken and what the employee should do if the issue appears again.

Sometimes the investigation cannot reproduce the defect. Say what evidence is missing and whether the workflow remains safe to use within its current limits. Avoid a generic “resolved” message when the underlying question remains open.

Where a fix is released, test the original situation and relevant neighbouring cases. Then communicate the practical change. People need to know whether they can rely on a corrected behaviour or must continue a manual check.

Give managers an answer they can actually give

Employees may ask whether the tool will change staffing, workloads or responsibilities. A manager who has only received a product presentation cannot answer those questions credibly.

Leadership should distinguish decisions already made from options under review. Name the next decision point and the people responsible. Do not use reassurance about jobs as a substitute for an actual workforce plan.

The same discipline applies to performance targets. If faster drafting leads to more cases assigned, explain how review time and complexity will be handled. Otherwise, employees may reasonably conclude that revealing an improvement only increases their workload.

Start with the first few reports

Before expanding the rollout, review a small set of reports end to end. Did the employee receive an answer? Was the issue investigated? Did the manager protect time for the correction? Were access and retention rules respected?

The objective is a process people can understand and use without guessing its consequences. A survey about trust can complement that review; it cannot replace observing what the organisation does with inconvenient information.

Bring one AI feedback workflow to a Strategy Session. We can examine the reporting burden, the response path and the management decisions needed before wider adoption.

Further reading