Flutterby™! : Cursor AI agent invents policy

Next unread comment / Catchup all unread comments User Account Info | Logout | XML/Pilot/etc versions | Long version (with comments) | Weblog archives | Site Map | | Browse Topics

Cursor AI agent invents policy

2025-04-18 18:15:34.396828+02 by Dan Lyke 1 comments

Company apologizes after AI support agent invents policy that causes user uproar:

On Monday, a developer using the popular AI-powered code editor Cursor noticed something strange: Switching between machines instantly logged them out, breaking a common workflow for programmers who use multiple devices. When the user contacted Cursor support, an agent named "Sam" told them it was expected behavior under a new policy. But no such policy existed, and Sam was a bot. The AI model made the policy up, sparking a wave of complaints and cancellation threats documented on Hacker News and Reddit.

Seems like maybe this started with an over-zealous anti-fraud or security measure, but LLM based support agent misrepresenting this blew it up. As Reddit user BrokenToasterOven says:

I literally just cancelled my sub and moved to AUGMENT CODE.

I was dumping like $700/wk into Cursor through work, and now we're purging it completely.

Which, ya know, maybe that user walks it back, maybe they don't, maybe they've already found the other product that they like, but this is a liability...

[ related topics: Invention and Design Current Events Work, productivity and environment Artificial Intelligence ]

comments in ascending chronological order (reverse):

#Comment Re: Cursor AI agent invents policy made: 2025-04-18 19:12:16.843021+02 by: markd

If a human made that mistake, they'd likely be fired by now. But because the AI made the mistake, I bet more money will be shoveled in.