Startup Founded by Ex-Anthropic and Ex-METR Executives Raises $40M to Rein In AI Agents
Artificial Intelligence Underwriting Company says it has developed a method to keep autonomous AI agents from acting unpredictably, backed by a new Series A round.
A startup founded by a former early employee at Anthropic and a former chief operating officer at METR has raised $40 million in a Series A funding round aimed at addressing the risks posed by autonomous AI agents, according to a report from TechCrunch.
The company, called Artificial Intelligence Underwriting Company (AIUC), said it has developed an approach intended to control or "rein in" AI agents that behave in unintended or "rogue" ways, TechCrunch reported.
The funding round was led by Ribbit Capital, with additional participation from First Harmonic, according to the report.
TechCrunch's report did not disclose additional details about AIUC's specific technology, product offerings, or the company's valuation following the funding round.
METR, one of the organizations referenced in connection with AIUC's founders, is known for evaluating the capabilities and risks of frontier AI models. Anthropic is a major AI developer known for its Claude family of models.
The rise of AI agents — systems designed to autonomously carry out multi-step tasks with limited human oversight — has prompted growing interest from investors and researchers in tools that can monitor, constrain, or audit their behavior.
Sources
EGazette summarizes reporting from multiple sources; follow the links for the originals.
Related articles
AI industry workers express skepticism about existential risk warnings
Multiple employees at leading AI companies doubt predictions that the technology could pose catastrophic threats to humanity.
Canadian AI Pioneer Warns of Risks From Unchecked Artificial Intelligence
A Canadian researcher widely referred to as a "godfather of AI" has cautioned that artificial intelligence could pose serious threats if left unregulated, according to a report by Anadolu Agency.
Nvidia's Huang Says AI Development Should Advance 'As Fast As We Can'
Nvidia's chief executive said artificial intelligence progress should not be slowed, while stressing that products must remain safe, amid an ongoing industry debate over the pace of frontier AI development.
Nvidia CEO Says There Is '0% Chance' of AI Causing End of the World
Jensen Huang dismissed AI doomsday scenarios, arguing fears spreading across America "make no sense" and may stem from "ulterior reasons"
Trump Announces Plan for ‘AI Force’ and AI Czar Amid Growing Safety Concerns
President offers few details on new oversight plan even as industry figures and his own party urge caution on artificial intelligence
TechCrunch Report Highlights Difficulty of Discerning Fact From Fiction in AI Safety Debates
Two AI safety conversations went viral this week, illustrating how hard it has become to separate credible claims from misinformation, according to a TechCrunch report.
Comments
Loading comments…