{"id":3726,"date":"2025-07-16T16:15:31","date_gmt":"2025-07-16T16:15:31","guid":{"rendered":"https:\/\/musictechohio.online\/site\/top-ai-researchers-concerned\/"},"modified":"2025-07-16T16:15:31","modified_gmt":"2025-07-16T16:15:31","slug":"top-ai-researchers-concerned","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/top-ai-researchers-concerned\/","title":{"rendered":"Top AI Researchers Concerned They\u2019re Losing the Ability to Understand What They\u2019ve Created"},"content":{"rendered":"
\n
\"Researchers<\/div>\n

Researchers from OpenAI, Google DeepMind, and Meta have joined forces to warn about what they’re building.<\/p>\n

In a new position paper<\/a>, 40 researchers spread across those four companies called for more investigation of AI powered by so-called “chains-of-thought” (CoT), the “thinking out loud” process that advanced “reasoning” models \u2014 the current vanguard of consumer-facing AI \u2014 use when they’re working through a query.<\/p>\n

As those researchers acknowledge, CoTs add a certain transparency into the inner workings of AI, allowing users to see “intent to misbehave” or get stuff wrong as it happens. Still, there is “no guarantee that the current degree of visibility will persist,” especially as models continue to advance.<\/p>\n

Depending on how they’re trained, advanced models may no longer, the paper suggests, “need to verbalize any of their thoughts, and would thus lose the safety advantages.” There’s also the non-zero chance that models could intentionally “obfuscate” their CoTs after realizing that they’re being watched, the researchers noted \u2014 and as we’ve already seen, AI has indeed rapidly become very good at lying and deception<\/a>.<\/p>\n

To make sure this valuable visibility continues, the cross-company consortium is calling on developers to start figuring out what makes CoTs “monitorable,” or what makes the models think out loud the way they do. In this request, those same researchers seem to be admitting something stark: that nobody is entirely sure why the models are “thinking” this way, or how long they will continue to do so.<\/p>\n

Zooming out from the technical details, it’s worth taking a moment to consider how strange this situation is. Top researchers in an emerging field are warning that they don’t quite understand how their creation works, and lack confidence in their ability to control it going forward, even as they forge ahead making it stronger; there’s no clear precedent in the history of innovation, even looking back to civilization-shifting inventions like atomic energy and the combustion engine.<\/p>\n

In an interview with\u00a0TechCrunch<\/em><\/a> about the paper, OpenAI research scientist and paper coauthor Bowen Baker explained how he sees the situation.<\/p>\n

“We’re at this critical time where we have this new chain-of-thought thing,” Baker told the website. “It seems pretty useful, but it could go away in a few years if people don\u2019t really concentrate on it.”<\/p>\n

“Publishing a position paper like this, to me, is a mechanism to get more research and attention on this topic,” he continued, “before that happens.”<\/p>\n

Once again, there appears to be tacit acknowledgement of AI’s “black box” nature \u2014 and to be fair, even CEOs like OpenAI’s Sam Altman<\/a> and Anthropic’s Dario Amodei<\/a> have admitted that at a deep level, they don’t really<\/em> understand how the technology they’re building works<\/a>.<\/p>\n

Along with its 40-researcher author list that includes DeepMind cofounder Shane Legg<\/a> and xAI safety advisor Dan Hendrycks<\/a>, the paper has also drawn endorsements from industry luminaries including former OpenAI chief scientist Ilya Sutskever<\/a> and AI godfather and Nobel laureate Geoffrey Hinton<\/a>.<\/p>\n

Though Musk’s name doesn’t appear on the paper, with Hendrycks on board, all\u00a0of the “Big Five” firms \u2014 OpenAI, Google, Anthropic, Meta, and xAI \u2014 have been brought together to warn about what might happen when and if AI stops showing its work.<\/p>\n

In doing so, that powerful cabal has said the quiet part out loud: that they don’t feel entirely in control of AI’s future. For companies with untold billions between them, that’s a pretty strange message to market \u2014 which makes the paper all the more remarkable.<\/p>\n

More on AI warnings:<\/strong> Bernie Sanders Issues Warning About How AI Is Really Being Used<\/em><\/a><\/p>\n

The post Top AI Researchers Concerned They\u2019re Losing the Ability to Understand What They\u2019ve Created<\/a> appeared first on Futurism<\/a>.<\/p>\n<\/div>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Researchers from OpenAI, Google DeepMind, and Meta have joined forces to warn about what they’re building. In a new position paper, 40 researchers spread across those four companies called for…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[177,2701,2702,2703,1514],"tags":[],"class_list":["post-3726","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence","category-black-box","category-chains-of-thought","category-frontier-models","category-reasoning-models"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/3726","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=3726"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/3726\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=3726"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=3726"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=3726"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}