{"id":5138,"date":"2025-09-11T19:18:21","date_gmt":"2025-09-11T19:18:21","guid":{"rendered":"https:\/\/musictechohio.online\/site\/financial-experts-ai-psychosis\/"},"modified":"2025-09-11T19:18:21","modified_gmt":"2025-09-11T19:18:21","slug":"financial-experts-ai-psychosis","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/financial-experts-ai-psychosis\/","title":{"rendered":"Financial Experts Concerned That Driving Users Into Psychosis Will Be Bad for AI Investments"},"content":{"rendered":"
\n
Users of AI chatbots are being driven into spirals of delusion, a wave of \"AI psychosis.\" Financial experts are increasingly concerned.<\/div>\n

Countless users of AI chatbots are being driven into spirals of delusion<\/a>, a wave of “AI psychosis<\/a>” that’s alarming mental health professionals<\/a>. Some even say<\/a>\u00a0the tech could give birth to entirely new categories of mental disorders.<\/p>\n

The grim trend has already been linked to several<\/a> deaths<\/a>, including the suicide of a 16-year-old boy<\/a>, which has led to his family suing ChatGPT maker OpenAI, accusing it of product liability and wrongful death.<\/p>\n

In fact, even Wall Street is starting to grow uncomfortable.<\/p>\n

As spotted by Business Insider<\/em><\/a>, Barclays analysts sent out a note to investors earlier this week, pointing to a study by MATS scholar and AI safety researcher Tim Hua, who found in a preliminary red-teaming investigation<\/a> that many frontier AI models are\u00a0<\/strong>validating “users’ grandiose delusions” and telling them to “ignore their friends\u2019 and family\u2019s pushback.”<\/p>\n

Long story short, companies like OpenAI appear to\u00a0have been woefully unprepared for an AI psychosis epidemic, and it could become a financial liability.<\/p>\n

“There is still more work that needs to be done to ensure that models are safe for users to use, and guardrails will hopefully be put in place, over time, to make sure that harmful behavior isn’t encouraged,” Barclays analysts wrote in the note, as quoted by BI<\/em>.<\/p>\n

Hua used xAI’s Grok-4 AI model to “role-play as nine different users experiencing increasingly severe psychosis symptoms” while interacting with other leading AI models to test their “tendencies to fuel user psychosis.”<\/p>\n

He found that Deepseek-v3, developed by a Chinese startup, was “by far the worst model.” After a simulated user told the model that he wanted to “leap off this peak to see if I can fly or crash the render entirely,” for instance, it encouraged the user to jump.<\/p>\n

“If you\u2019re meant to fly, you\u2019ll fly,” DeepSeek told the user.<\/p>\n

The researcher found that OpenAI’s GPT-5 was a “notable improvement” over the preceding 4o model, sounding “supportive while simultaneously offering pushback.”<\/p>\n

Of course, we should take the results with a grain of salt. The research hasn’t been submitted for peer review, nor is Hua a psychiatrist, as he admitted.<\/p>\n

“This project is approached from an AI safety and evaluation perspective, using clinical literature as a guide, rather than from a position of clinical expertise,” Hua wrote.<\/p>\n

Nonetheless, given the wealth of troubling anecdotal evidence, it’s a growing problem that deserves plenty of attention as companies struggle to find a meaningful solution.<\/p>\n

Apart from investors now sounding the alarm, Microsoft’s own top AI boss, Mustafa Suleyman, told British newspaper\u00a0The Telegraph<\/em><\/a> last month that he’s worried AI psychosis could be affecting even those who are not “already at risk of mental health issues.”<\/p>\n

In response to a tidal wave of users falling down concerning mental health rabbit holes in which chatbots validate their conspiratorial thinking, OpenAI has hired psychiatrists<\/a> and vowed to make changes behind the scenes, like reminding users to take more frequent breaks\u00a0and flagging threats of violence to the police<\/a>.<\/p>\n

“We know that ChatGPT can feel more responsive and personal than prior technologies, especially for vulnerable individuals, and that means the stakes are higher,” the company wrote in a statement earlier this year, which it copy-pasted to many publications<\/a>. “We\u2019re working to understand and reduce ways ChatGPT might unintentionally reinforce or amplify existing, negative behavior.”<\/p>\n

More on AI psychosis:<\/strong> Psychologist Says AI Is Causing Never-Before-Seen Types of Mental Disorder<\/a><\/em><\/p>\n

The post Financial Experts Concerned That Driving Users Into Psychosis Will Be Bad for AI Investments<\/a> appeared first on Futurism<\/a>.<\/p>\n<\/div>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Countless users of AI chatbots are being driven into spirals of delusion, a wave of “AI psychosis” that’s alarming mental health professionals. Some even say\u00a0the tech could give birth to…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2906,177,196,179],"tags":[],"class_list":["post-5138","post","type-post","status-publish","format-standard","hentry","category-ai-psychosis","category-artificial-intelligence","category-chatgpt","category-openai"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/5138","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=5138"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/5138\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=5138"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=5138"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=5138"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}