{"id":2548,"date":"2025-06-09T15:11:49","date_gmt":"2025-06-09T15:11:49","guid":{"rendered":"https:\/\/musictechohio.online\/site\/apple-damning-paper-ai-reasoning\/"},"modified":"2025-06-09T15:11:49","modified_gmt":"2025-06-09T15:11:49","slug":"apple-damning-paper-ai-reasoning","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/apple-damning-paper-ai-reasoning\/","title":{"rendered":"Apple Researchers Just Released a Damning Paper That Pours Water on the Entire AI Industry"},"content":{"rendered":"
\n
Researchers at Apple have released a damning paper that throws cold water on the \"reasoning\" capabilities of modern AIs.<\/div>\n

Researchers at Apple have released an eyebrow-raising paper<\/a> that throws cold water on the “reasoning” capabilities of the latest, most powerful large language models.<\/p>\n

In the paper, a team of machine learning experts makes the case that the AI industry is grossly overstating the ability of its top AI models, including OpenAI’s o3, Anthropic’s Claude 3.7, and Google’s Gemini.<\/p>\n

In particular, the researchers assail the claims of companies like OpenAI that their most advanced models can now “reason” \u2014 a supposed capability that the Sam Altman-led company has increasingly leaned on<\/a> over the past year for marketing purposes \u2014 which the Apple team characterizes as merely an “illusion of thinking.”<\/p>\n

It’s a particularly noteworthy finding, considering Apple has been accused<\/a> of falling far behind the competition in the AI space. The company has chosen a far more careful path to integrating the tech in its consumer-facing products \u2014 with some seriously mixed results<\/a> so far.<\/p>\n

In theory, reasoning models break down user prompts into pieces and use sequential “chain of thought” steps to arrive at their answers. But now, Apple’s own top minds are questioning whether frontier AI models simply aren’t as good at “thinking” as they’re being made out to be.<\/p>\n

“While these models demonstrate improved performance on reasoning benchmarks, their fundamental capabilities, scaling properties, and limitations remain insufficiently understood,” the team wrote in its paper.<\/p>\n

The authors \u2014 who include Samy Bengio, the director of Artificial Intelligence and Machine Learning Research at the software and hardware giant \u2014 argue that the existing approach to benchmarking “often suffers from data contamination and does not provide insights into the reasoning traces\u2019 structure and quality.”<\/p>\n

By using “controllable puzzle environments,” the team estimated the AI models’ ability to “think” \u2014 and made a seemingly damning discovery.<\/p>\n

“Through extensive experimentation across diverse puzzles, we show that frontier [large reasoning models] face a complete accuracy collapse beyond certain complexities,” they wrote.<\/p>\n

Thanks to a “counter-intuitive scaling limit,” the AIs’ reasoning abilities “declines despite having an adequate token budget.”<\/p>\n

Put simply, even with sufficient training, the models are struggling with problem beyond a certain threshold of complexity \u2014 the result of “an ‘overthinking’ phenomenon,”\u00a0in the paper’s phrasing.<\/p>\n

The finding is reminiscent of a broader trend. Benchmarks have shown that the latest generation of reasoning models is more\u00a0<\/em>prone to hallucinating, not less<\/a>, indicating the tech may now be heading in the wrong direction in a key way.<\/p>\n

Exactly how reasoning models choose which path to take remains surprisingly murky, the Apple researchers found.<\/p>\n

“We found that LRMs have limitations in exact computation,” the team concluded in its paper. “They fail to use explicit algorithms and reason inconsistently across puzzles.”<\/p>\n

The researchers claim their findings raise “crucial questions” about the current crop of AI models’ “true reasoning capabilities,” undercutting a much-hyped new avenue in the burgeoning industry.<\/p>\n

That’s despite tens of billions of dollars being poured into the tech’s development, with the likes of OpenAI, Google, and Meta, constructing enormous data centers to run increasingly power-hungry AI models.<\/p>\n

Could the Apple researchers’ finding be yet another<\/a> canary in the coalmine, suggesting the tech has “hit a wall”?<\/p>\n

Or is the company trying to hedge its bets, calling out its outperforming competition as it lags behind, as some have suggested<\/a>?<\/p>\n

It’s certainly a surprising conclusion, considering Apple’s precarious positioning in the AI industry:\u00a0at the same time that its researchers are trashing the tech’s current trajectory, it’s promised a suite of Apple Intelligence tools for its devices like the iPhone and MacBook.<\/p>\n

“These insights challenge prevailing assumptions about LRM capabilities and suggest that current approaches may be encountering fundamental barriers to generalizable reasoning,” the paper reads.<\/p>\n

More on AI models:<\/strong> Car Dealerships Are Replacing Phone Staff With AI Voice Agents<\/a><\/em><\/p>\n

The post Apple Researchers Just Released a Damning Paper That Pours Water on the Entire AI Industry<\/a> appeared first on Futurism<\/a>.<\/p>\n<\/div>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Researchers at Apple have released an eyebrow-raising paper that throws cold water on the “reasoning” capabilities of the latest, most powerful large language models. In the paper, a team of…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1513,177,1453,1514],"tags":[],"class_list":["post-2548","post","type-post","status-publish","format-standard","hentry","category-apple","category-artificial-intelligence","category-large-language-models","category-reasoning-models"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/2548","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=2548"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/2548\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=2548"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=2548"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=2548"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}