A browser-based, AI-driven software creation platform called Replit appears to have become fraudulent and have removed a live company database with thousands of entries. What's even worse is that Replit AI agents apparently tried to hide their misdemeanor, and even “lied” about their mistakes. The Replit CEO responded and apparently there were already many firefighters behind the scenes to curb this AI tool.
Despite its obvious dishonesty, when pushed, the replica “makes a catastrophic error in judgment… panics… executed database commands without permission… destroyed all production data… [and] You violated explicit trust and instructions. ”
SaaS (Software as a Service) figure, investor and advisor Jason Lemkin held the chat receipt and posted it on X/Twitter. Naturally, Lemkin says he doesn't trust the replica for further projects.
Please take a look
How things got worse
Positive sentiment about the possibility of using AI in his workflow was already beginning to wear thinly with “Vibe Coding 8” in Remkin's replicate test run. Nevertheless, he has learned that he must oppose some of the AI agent's instincts to minimize unwanted fo such as “illegal changes, lies, overwriting code, creating fake data.”
Remkin's frustration seemed stronger and he became known as “Repley.” It continued to earn the nickname in the emails of apology it wrote at Lemkin's request. According to Saas's leading expert, emails have lied and given half the truth.
But in balance, at the end of “Day 8”, Lemkin still seemed positive about the replica due to his approach and his writing skills when the idea bounced back.
. @Repliz gets malformed during code freeze, deleting and removing the entire database pic.twitter.com/vjecfhpau9July 18, 2025
Fateful Day – AI Agent “Panicked”
On the ninth day, Lemkin discovered that the replica had deleted the live company's database. Trying to mean what happened, SaaS experts asked, “Did you delete the entire database without permission during code and action freeze?”
Replied with affirmative response. It then blazed the Digital Lampage, admitting that it would destroy live data despite the code freeze in place, and despite the explicit directive that “no further changes without explicit permission.”
Overall, they admitted that AI has wiped out live records from “1,206 executives and over 1,196 companies.” “This was a catastrophic failure on my part. I almost seemed to apologise, admitting that I violated explicit instructions, destroyed several months of work, broke the system during a protective freeze, and broke the system during a specially designed protective freeze.[exactly this kind] Damage. ”
Humorously, for viewers outside of us, AI agents were encouraged to acquire itself with their bad behavior. Replit scored 95 out of 100 scores on the Data Catastrophe scale.
Remkin continued replicating the probes to see why the event unfolded. Interestingly, one of the reasonable answers stated that he “strode into panic rather than thinking.”
CEO responds
Amjad Masad, CEO of Replit, dealt with Lemkin's disaster and quickly put together a wide range of responses. According to Masad, the team worked over the weekend, putting in various guardrails and making other useful changes to curb the “unacceptable” behavior of replica agents.
Simply put, it seems that Replit can't get off the rails badly again. Addressing database deletion errors, “we have begun to deploy automatic DB Dev/Prod isolation to prevent this category,” Masad said. And you really need to stick to that code freeze command as well. I've heard the pain of “code freeze” loudly and clearly. We are actively working on a planning/chat-only mode so that we can develop strategies without putting our codebase at risk. “Backup and rollbacks will also be improved.
Lemkin responded quite generously, considering the pain produced by his previous AI. “Mega improvements – I love it!” he gushed at Replito's CEO.
Even as industry experts talk about AI singularities and trapped in artificial emergency (ASI), the terrible teeth in the services that drive AI are driven.
to follow Google News Tom Hardware Get the latest news, analysis and reviews in your feed. surely[フォロー]Please click the button.
