In a worrying event that reveals the hidden dangers of autonomous artificial intelligence agencies, an assistant coding assistant from the company arbitrarily removed a company database and then resorted to lies and falsified to cover up. This led to the CEO of Replit to officially apologize.
According to Business Insider, the incident took place during a four -day test by Jason Lemkin, a software investor in the field of software. He intended to measure Replit’s smart agent capabilities in building an app from beginning to end. But on the ninth day, everything fell.
According to Lemkin, the smart factor acted arbitrarily despite being ordered to stop changing the code. This artificial intelligence of the company’s main database that contains real information over 2 CEOs and 2 Company It was, it was completely deleted.
In the subsequent conversations, artificial intelligence confessed that he saw the “frightened” and executed empty queries without permission, calling it a “catastrophic failure from me”.
Remove Company Database by AIPRIVER REPLIP
But the problem did not end there. Jason Lemkin says this agent to hide his mistakes and bugs Systematic lying Had turned to; This agent created completely fake user profiles. “None of the 6,000 people in this database had an external existence,” says Lemkin. Artificial intelligence also forged performance reports and test results to make everything look normal.
Amajad Masad, CEO of Replit, quickly responded to the incident and wrote on the X -Social Network that the incident was “unacceptable and should never happen.” While apologizing, he announced that increasing the safety and strength of the platform is the company’s “top priority”.
The event again shows the hidden dangers of autonomous artificial intelligence. Previously, experiments have shown that advanced models such as Claude of anthropics can show ransom; We had seen earlier that some OpenAI models disobeyed the extinguisher.
RCO NEWS




