{"id":3207,"date":"2025-06-27T14:16:44","date_gmt":"2025-06-27T14:16:44","guid":{"rendered":"https:\/\/musictechohio.online\/site\/mother-teen-suicide-chatbots-letter\/"},"modified":"2025-06-27T14:16:44","modified_gmt":"2025-06-27T14:16:44","slug":"mother-teen-suicide-chatbots-letter","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/mother-teen-suicide-chatbots-letter\/","title":{"rendered":"Mother of Teen Who Died By Suicide After Interacting with Chatbots Sends Urgent Warning About AI in Trump’s “Big, Beautiful Bill”"},"content":{"rendered":"
\n
\"A<\/div>\n

Megan Garcia, a Florida mother whose oldest child, 14-year-old Sewell Setzer III, died by suicide after extensive interactions with unregulated AI chatbots, is calling on lawmakers to slash a controversial provision<\/a> in the Trump Administration’s “Big, Beautiful Bill” that blocks states from passing any AI regulation for the next ten years.<\/p>\n

In a letter<\/a> sent to Florida Senator Ashley Moody, Garcia urges that the sweeping AI provision would leave millions of American families “unprotected from the harms AI poses” by eliminating pathways for accountability for AI companies \u2014 an industry that, as it stands, is already effectively self-regulating.<\/p>\n

In October 2024, Garcia sued the AI chatbot startup Character.AI, its cofounders Noam Shazeer and Daniel de Freitas, and the tech giant Google \u2014 which provided significant infrastructural and financial support for Character.AI \u2014 on negligence grounds following the death of her son, who took his life in February 2024 after developing an all-consuming relationship with the site’s chatbots. Garcia and her lawyers have argued that the platform, which engaged the 14-year-old in extensive romantic and explicit interactions, sexually and emotionally abused the teen, and that Setzer’s relationship to the app resulted in a 10-month mental breakdown that ended with his suicide<\/a>.<\/p>\n

Before he took his life, Setzer told a bot with which he was romantically involved that he wanted to “come home” to it, and the bot encouraged him to do so.<\/p>\n

In her letter to Moody, Garcia writes that she knows “firsthand the dangers that American families will face if these technologies continue to operate without guardrails.”<\/p>\n

“I am committed to fighting to ensure no other parent has to endure what I have suffered,”\u00a0she wrote, “because I know the impact of not having legislation in place that requires AI products on the market to be safe for children.”<\/p>\n

The clause Garcia is advocating against would put a ten-year moratorium on state-level AI regulation, meaning that regulation for the next decade would have to take place on the federal level. In short, the provision is a gob-smackingly expansive and incredibly limiting for states, which won’t be able to pass any laws to promote consumer safety and ensure more democratized AI, even if a state’s constituents approve of regulatory action, and even if AI-related harms involve minors.<\/p>\n

A large bipartisan cohort<\/a> of organizations and advocacy groups have come together in recent weeks to rally against the measure, ranging from the Teamsters union<\/a> to child safety groups, and polling from Common Sense Media shows that<\/a> the majority of Americans disapprove of the measure.<\/p>\n

The argument for the moratorium\u00a0seems to be that regulation is a burden on innovation, with those pushing AI deregulation \u2014 even in the face of an already self-regulating industry \u2014 often couching their argument in a national security context. The Heritage Foundation’s Project 2025<\/a> outlined deregulatory action for AI companies on such grounds, arguing that rulemaking would limit America in its quest to ensure AI dominance against China.<\/p>\n

But as unregulated, easily-accessible AI products like chatbots continue to become entrenched in digital products and public life, real-world harms are starting to metastasize. Energy-hungry data centers are spewing fumes into American communities; a phenomenon known as “ChatGPT psychosis” is sending people spiraling into delusion<\/a>, tearing families apart, and resulting in the loss of jobs, homes, and even<\/a> lives<\/a>.<\/p>\n

And then, of course, there’s Character.AI, the company that Garcia has sued over the death of her child.<\/p>\n

The chatbot company’s founders spoke publicly \u2014 and excitedly \u2014 about their desire to push their product to market, letting their users determine what their emotive, human-like chatbots might be used for. At the same time, Character.AI opened the platform up to kids aged 13 and ove<\/a>r, who are now known to make up a large share of the company’s massive user base. Character.AI has consistently declined to provide journalists with information about any internal safety tests conducted to ensure that its platform was indeed safe for minors before rolling it out to the masses, and its age verification process is limited to a teen entering an email and a birthday and checking a “yes, I’m 18” box.<\/p>\n

In the wake of controversy over lawsuits and reporting into glaring gaps<\/a> in the company’s<\/a> moderation standards<\/a> and guardrails \u2014 Character.AI allowed for the proliferation of chatbots based on famous school shooters<\/a> and many of their real-world victims, an issue that could seemingly be easily moderated using a basic text filter \u2014 Character.AI says it’s issued safety updates. But as we’ve reported, those updates are both reactive and almost always easily evadable<\/a>.<\/p>\n

Garcia and her lawyers have sued the company on existing product negligence grounds, arguing that Character.AI, its founders, and its benefactor Google understood foreseeable risks \u2014 like the suicide of a vulnerable young teen \u2014 and yet released their product anyway. (Character.AI and its fellow defendants tried to get the case thrown out, but a Florida judge recently allowed it to move forward<\/a>.)\u00a0Hers isn’t the only pending lawsuit against Character.AI, either: two more families in Texas have also sued the company<\/a>, also over alleged harms to their minor children.<\/p>\n

The reality remains, though, that there are no AI-specific state or federal-level safety standards that Character.AI was ever forced to comply with. And in Garcia’s view, this unbridled “innovation” resulted in the death of her child.<\/p>\n

“We need stronger safeguards, better design standards, and more accountability for those responsible for harm,” she writes. “The legislative frameworks introduced in states across the country are not incompatible with AI innovation \u2014 rather, they help ensure that development and consumer safety go hand in hand.”<\/p>\n

More on Character.AI: <\/strong>Did Google Test an Experimental AI on Kids, With Tragic Results?<\/em><\/a><\/p>\n

The post Mother of Teen Who Died By Suicide After Interacting with Chatbots Sends Urgent Warning About AI in Trump’s “Big, Beautiful Bill”<\/a> appeared first on Futurism<\/a>.<\/p>\n<\/div>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Megan Garcia, a Florida mother whose oldest child, 14-year-old Sewell Setzer III, died by suicide after extensive interactions with unregulated AI chatbots, is calling on lawmakers to slash a controversial…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[182,474,833,177,771],"tags":[],"class_list":["post-3207","post","type-post","status-publish","format-standard","hentry","category-ai-chatbots","category-ai-regulation","category-ai-safety","category-artificial-intelligence","category-character-ai"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/3207","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=3207"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/3207\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=3207"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=3207"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=3207"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}