What occurs when the software program that everybody’s racing to undertake turns into too dangerous for anybody to insure? In accordance with reporting from the Financial Times, we’re about to search out out.

Main insurers together with AIG, Nice American, and WR Berkley are asking U.S. regulators for permission to exclude AI-related liabilities from company insurance policies. One underwriter describes the AI fashions’ outputs to the FT as “an excessive amount of of a black field.”

The business has good purpose to be spooked, the story reminds us. Google’s AI Overview falsely accused a photo voltaic firm of authorized troubles, triggering a $110 million lawsuit again in March. Air Canada final yr obtained caught honoring a reduction its chatbot invented. And fraudsters final yr used a digitally cloned model of a senior govt to steal $25 million from the London-based design engineering agency Arup throughout a video name that appeared solely actual.

What actually terrifies insurers isn’t one large payout; it’s the systemic danger of 1000’s of simultaneous claims when a extensively used AI mannequin steps in it. As one Aon govt put it, insurers can deal with a $400 million loss to at least one firm. What they will’t deal with is an agentic AI mishap that triggers 10,000 losses without delay.