{"id":7867,"date":"2026-01-06T17:03:54","date_gmt":"2026-01-06T17:03:54","guid":{"rendered":"https:\/\/musictechohio.online\/site\/court-hallucinating-ai-ready-deployed\/"},"modified":"2026-01-06T17:03:54","modified_gmt":"2026-01-06T17:03:54","slug":"court-hallucinating-ai-ready-deployed","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/court-hallucinating-ai-ready-deployed\/","title":{"rendered":"Court System Says Hallucinating AI System Is Ready to Be Deployed After Dramatically Lowering Expectations"},"content":{"rendered":"
\n

AI\u2019s use in the legal sphere is the gift that keeps on giving<\/a>.<\/p>\n

This time, it\u2019s the sobering sense of disappointment that set in after a team building an AI chatbot for Alaska\u2019s court system actually tested it and found out it was a hallucinating disaster, NBC News <\/em>reports<\/a>.<\/p>\n

The chatbot, dubbed the Alaska Virtual Assistant, was designed to help people handle forms and other procedures involved in probate, the legal process of transferring a person\u2019s belongings after their death.<\/p>\n

In a predictable turn of events, instead of streamlining an already headache-inducing process inflicted on people who are probably mourning the loss of a loved one, the AI bungled simple questions and left most users feeling annoyed rather than supported.<\/p>\n

Exhibiting a failing inherent to all large language models, the esteemed virtual assistant kept hallucinating, or making up facts and sharing exaggerated information, according to the people involved in its development.<\/p>\n

\u201cWe had trouble with hallucinations, regardless of the model, where the chatbot was not supposed to actually use anything outside of its knowledge base,\u201d Aubrie Souza, a consultant with the National Center for State Courts (NCSC), told NBC News<\/em>. \u201cFor example, when we asked it, \u2018Where do I get legal help?\u2019 it would tell you, \u2018There\u2019s a law school in Alaska, and so look at the alumni network.\u2019 But there is no law school in Alaska.\u201d<\/p>\n

And rather than finding it helpful, most people who tested it found it incredibly grating. The bot, unsurprisingly, suffered from the same character flaw plaguing most chatbots: being too sycophantic and cloying, feigning empathy and plying you with pleasantries instead of just getting down to business.<\/p>\n

\u201cThrough our user testing, everyone said, \u2018I\u2019m tired of everybody in my life telling me that they\u2019re sorry for my loss,\u201d Souza said. \u201cSo we basically removed those kinds of condolences, because from an AI chatbot, you don\u2019t need one more.\u201d<\/p>\n

Built in collaboration with Tom Martin, a lawyer who runs an a company called LawDroid that makes AI legal tools, the AVA AI has been trapped in development hell for over a year now, when it was \u201csupposed to be a three-month project,\u201d according to Souza. After lowering their expectations \u2014 and assuredly ironing out its horrendous flaws \u2014 AVA\u2019s team says it\u2019s finally ready for a public launch in late January.<\/p>\n

\u201cWe did shift our goals on this project a little bit,\u201d Stacey Marz, administrative director of the Alaska Court System and an AVA project leader, told NBC News<\/em>. \u201cWe wanted to replicate what our human facilitators at the self-help center are able to share with people. But we\u2019re not confident that the bots can work in that fashion, because of the issues with some inaccuracies and some incompleteness.\u201d\u00a0<\/p>\n

\u201cIt was just so very labor-intensive to do this,\u201d Marz added, despite \u201call the buzz about generative AI, and everybody saying this is going to revolutionize self-help and democratize access to the courts.\u201d<\/p>\n

More on AI:<\/strong> Judge Horrified as Lawyers Submit Evidence in Court That Was Faked With AI<\/em><\/a><\/p>\n

The post Court System Says Hallucinating AI System Is Ready to Be Deployed After Dramatically Lowering Expectations<\/a> appeared first on Futurism<\/a>.<\/p>\n<\/div>\n

<\/div>","protected":false},"excerpt":{"rendered":"

AI\u2019s use in the legal sphere is the gift that keeps on giving. This time, it\u2019s the sobering sense of disappointment that set in after a team building an AI…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[177],"tags":[],"class_list":["post-7867","post","type-post","status-publish","format-standard","hentry","category-artificial-intelligence"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/7867","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=7867"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/7867\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=7867"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=7867"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=7867"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}