Hallucinated AI-provided intelligence almost led to U.S. boarding Chinese ship. Now, the U.S. is proposing an AI hotline to China

https://preview.redd.it/z4wc4h0zn4rh1.png?width=773&format=png&auto=webp&s=3c0c579ce45d78a09953bd603c3d4ef0d38d6911 Last Friday, CNN reported that the U.S. and China could have gone to war due to hallucinated intelligence provided by AI: "The intelligence report, circulated across the US military this spring in the midst of the war with Iran, immediately set off alarm bells: A Chinese ship in the Middle East was transporting components of a nuclear weapons program. The US military swung into action with plans to intercept the vessel ... armed members of the US military were preparing to board the ship. It was only just before the planned operation that officials dug deeper into the report put together by a special operations command analyst and found it had been generated with the help of artificial intelligence (AI) ... The report, according to one of the sources, was 'entirely false.' But it also 'almost started a war,' the source said. Any US operation against a Chinese vessel could have risked spiraling into an armed conflict between the two nations. The U.S. military has gone full speed ahead with integrating generative AI into its operations. Today, news reports indicate Trump will propose an AI hotline to China. Maybe partly due to this incident? The problem of what I call 'agent telephone' is not only plaguing businesses, people using online search and research scientists, but also the military. Bad data supplied by AI is being integrated into decision-making without the appropriate checks. We're deploying the tools, but not giving people the training to assess AI outputs properly. - CNN Report on hallucinated intelligence - Aljazeera on the hotline