It was revealed by KPMG, one of many world’s ‘Huge 4’ accounting companies.
In October final 12 months, KPMG revealed a report titled Complete Expertise: Redefining Excellence within the Age of Agentic AI, which was about how firms are utilizing AI to cater to prospects’ wants. KPMG is among the “Huge 4” skilled companies and accounting companies on this planet, together with Deloitte, PricewaterhouseCoopers and Ernst & Younger. Apparently, although, that report was filled with AI hallucinations and included examples of agentic AIs that both didn’t exist or didn’t have the capabilities KPMG acknowledged within the paper. Investigators for GPTZero, the maker of an AI content material detection software, discovered inaccuracies and faux footnotes all around the report, which have been additionally verified by the Monetary Occasions.
In its report of the investigation, GPTZero mentioned that solely 5 citations out of 45 within the paper precisely pointed to actual sources. A complete of 28 citations paraphrased titles or added faux elements to actual sources, whereas 12 have been phrased too vaguely to find out whether or not they really existed. GPTZero referred to as the creation of faux references by AI fashions “vibe citing.”
Along with the faux or inaccurate citations, the investigators additionally discovered that roughly half of the claims within the paper have been faux or misattributed. They have been “seemingly the results of an AI analysis software over-complying with a request to search out examples of ‘agentic AI’ within the wild,” GPTZero wrote. In a single instance, KPMG claimed that Emirates launched a cellular chatbot referred to as Sara that may speak to passengers and alter their flights for them. Sara was a cellular assistant launched in 2023 and never an AI-powered chatbot, and it additionally did not have the ability to vary bookings for passengers.
KPMG additionally claimed that Swiss multinational funding financial institution UBS built-in agentic AI throughout its “funding advisory, danger administration and compliance monitoring.” The financial institution informed the Occasions that the data was “factually incorrect.” In one other instance, KMPG mentioned that Swiss Federal Railways (SBB) has AI brokers that may assist passengers plan, e-book and optimize their journeys primarily based on preferences, real-time situations and carbon impression. An SBB spokesperson mentioned that was “not correct.”
Papers by firms like KPMG are usually cited in different analysis papers and articles, since they’re thought of as extremely trusted sources. GPTZero chief government Edward Tian defined that error-riddled papers revealed by the Huge 4 may “poison the nicely of knowledge” and will result in second-hand AI hallucinations. A KPMG spokesperson informed the Occasions that the corporate “takes the accuracy and integrity of its revealed content material severely.” KPMG has since pulled the paper and is now “reviewing the circumstances surrounding its publication.”
