AI tools are introducing new errors into customer service interactions, workers say

Workers in customer-facing roles say errors generated by artificial intelligence tools are creating new complications in their interactions with customers, according to a report from The Verge.

Madison, a server in New York City who asked that her last name be withheld, routinely asks diners about food allergies as part of standard practice. She told The Verge that in recent interactions, some customers have described situations suggesting confusion introduced by AI-generated information, such as diners mentioning allergy information without the follow-up questions that would typically be expected.

A new layer of friction

The report frames these incidents as part of a broader pattern in which AI systems used in customer service contexts are producing inaccurate, or "hallucinated," information, which can complicate interactions for frontline workers who must then manage customer expectations shaped by that incorrect information.

According to the report, this dynamic is adding to the pressures already faced by service workers, who are left to navigate situations where customers may believe inaccurate information to be accurate because it came from an AI tool.

The report suggests that as AI tools become more embedded in customer service processes, incidents stemming from their errors are becoming a more frequent part of frontline workers' daily experience.