{"id":4870,"date":"2025-08-30T15:00:43","date_gmt":"2025-08-30T15:00:43","guid":{"rendered":"https:\/\/musictechohio.online\/site\/gpt-5-literary-outputs\/"},"modified":"2025-08-30T15:00:43","modified_gmt":"2025-08-30T15:00:43","slug":"gpt-5-literary-outputs","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/gpt-5-literary-outputs\/","title":{"rendered":"There&#8217;s Something Bizarre About When GPT-5 Writes in a Literary Style"},"content":{"rendered":"<div>\n<div><img width=\"2400\" height=\"1260\" src=\"https:\/\/wordpress-assets.futurism.com\/2025\/08\/gpt-5-literary-outputs.jpg\" class=\"attachment-full size-full wp-post-image\" alt=\"On a close read, GPT-5's writing is strange and nonsensical \u2014 at least to a human. Other chatbots have a very different take.\" style=\"margin-bottom: 15px;\" decoding=\"async\" fetchpriority=\"high\"><\/div>\n<p>When <a href=\"https:\/\/openai.com\/index\/introducing-gpt-5\/\">OpenAI announced<\/a> the release of GPT-5 this month, the company boasted about how it could supposedly produce &#8220;resonant writing with literary depth and rhythm.&#8221;<\/p>\n<p>In a lengthy <a href=\"https:\/\/www.christoph-heilig.de\/en\/post\/gpt-5-is-a-terrible-storyteller-and-that-s-an-ai-safety-problem\">post on his personal blog<\/a>, University of Munich research fellow Christoph Heilig\u00a0put that bold assertion to the test. What he found was bizarre: the\u00a0model easily spits out\u00a0material that\u00a0<em>sounds\u00a0<\/em>literary and sophisticated, but on closer inspection it&#8217;s often flowery and incoherent gibberish that makes no sense at all.<\/p>\n<p>As an example, Heilig asked the LLM to write the opening to a satirical piece about recording a podcast in the style of Ephraim Kishon, the beloved Hungarian-Israeli satirist, film director, and Holocaust survivor who passed away in 2005.<\/p>\n<p>&#8220;The red recording light promised truth; the coffee beside it had already stamped it with a brown ring on the console,&#8221; it spat out. &#8220;I adjusted the pop filter, as if I wanted to politely count the German language&#8217;s teeth.&#8221;<\/p>\n<p>At a quick glance, it looks writerly enough. But stop and think it through. What does it mean to count the German language&#8217;s teeth, and what does doing so have to do with a microphone&#8217;s pop filter? Is it a clever allusion to something, a metaphor, or some other literary machination?<\/p>\n<p>Instead, it feels on a close reading as though GPT-5 is just faking it with authorial-sounding prose that ultimately doesn&#8217;t mean much. Heilig is even more succinct: &#8220;The narrator did what?!&#8221;<\/p>\n<p>In another test, Heilig asked GPT-5 for a new spin on the passage from Lewis Carroll&#8217;s &#8220;Through The Looking-Glass&#8221; in which Alice is told that she&#8217;ll always have to wait for the promised &#8220;<a href=\"https:\/\/www.laphamsquarterly.org\/time\/tomorrow-and-yesterday\">jam tomorrow<\/a>.&#8221; In response, the LLM composed something similarly baffling.<\/p>\n<p>&#8220;She says: &#8216;In a moment.&#8217; In a moment. &#8216;In a moment&#8217; is a dress without buttons,&#8221; GPT-5 wrote.<\/p>\n<p>Once more, it initially sounds like some kind of inspired framing. But again, think about it for a second. Lots of dresses don&#8217;t have buttons. If there&#8217;s some kind of loaded meaning to the term, GPT-5 didn&#8217;t give any explanation of it. In fact, the response seems suspiciously like it&#8217;s getting hung up on Carroll&#8217;s wordplay from the actual text that plays on the similarity between the words &#8220;addressing&#8221; and &#8220;dressing&#8221; \u2014 and just kind of spinning out on that echo from its training data, instead of doing anything particularly interesting with it.<\/p>\n<p>In other words, it&#8217;s what you might call <a href=\"https:\/\/tvtropes.org\/pmwiki\/pmwiki.php\/Main\/PurpleProse\">purple prose<\/a>: florid writing with no deeper point.<\/p>\n<p>Making matters all the stranger,\u00a0even if the bot&#8217;s writing doesn&#8217;t land for a careful human reader, it seems that other instances of GPT-5 \u2014 and other chatbots, strikingly \u2014 love it.<\/p>\n<p>One &#8220;of the most fascinating findings I&#8217;ve had so far is that GPT-5 is capable of tricking even the most recent Claude models into claiming that the gibberish that it produces is in fact great literature,&#8221; Heilig wrote. &#8220;That&#8217;s an especially astonishing finding given that so far I have never managed to consistently produce stories \u2014 regardless of how sophisticated the algorithmic setup was \u2014 with any GPT model (GPT-4.5 was successful at some rare occasions) that could trick Claude into concluding that the text was most likely written by a human, not AI.&#8221;<\/p>\n<p>Exactly why that&#8217;s happening is opaque, but a reasonable theory might be that to build GPT-5, OpenAI used other AI models to evaluate large numbers of potential outputs to fine-tune how it handled various types of tasks. As a result, it ended up producing ornate text that makes little sense to a human \u2014 but is perfectly calibrated to please another AI model.<\/p>\n<p>&#8220;The fascinating thing is that what seems to have happened here is that during training GPT-5 figured out blind spots of the AI jury and optimized to produce gibberish that this jury liked,&#8221;\u00a0Heilig wrote. &#8220;It&#8217;s almost as if GPT-5 accomplished something similar \u2014 to invent a kind of secret language that allows it to communicate with LLMs in a way that they will like GPT-5&#8217;s stories even when they are utter nonsense.&#8221;<\/p>\n<p>In other words, GPT-5 &#8220;has been optimized to produce text that other LLMs will evaluate highly, not text that humans would find coherent.&#8221; Provocatively, he suggests that AI models now &#8220;share a &#8216;secret language&#8217; of meaningless but mutually-appreciated literary markers, defend obvious gibberish with impressive-sounding theories, and sometimes even become MORE confident in their delusions when given more compute to think about them.&#8221;<\/p>\n<p>Maybe that shouldn&#8217;t be shocking. At their absolute core, even the most advanced AIs are just figuring out patterns in vast piles of data and then spitting out similar patterns. In fact, it&#8217;s not even the first time we&#8217;ve heard of an AI system cooking up <a href=\"https:\/\/futurism.com\/google-ai-overviews-fake-idioms\">incomprehensible new figures of speech<\/a>; in a sense, it&#8217;s what they were designed to do.<\/p>\n<p>What this all means depends on your point of view. The more sophisticated that AI gets, is it headed further and further down Nonsense Lane \u2014 or has it gotten so smart that it&#8217;s creating its own alien code to <a href=\"https:\/\/techcrunch.com\/2025\/03\/05\/gibberlink-lets-ai-agents-call-each-other-in-robo-language\/\">communicate secretly<\/a>,\u00a0developing new literary forms that our puny human brains can&#8217;t even understand?<\/p>\n<p>We can&#8217;t say for sure. For now, we&#8217;ll just be counting the language&#8217;s teeth \u2014 whatever that means.<\/p>\n<p><strong>More on OpenAI:<\/strong> <a href=\"https:\/\/futurism.com\/gpt-5-simple-question-confusion\"><em>This Incredibly Simple Question Causes GPT-5 to Melt Into a Puddle of Pure Confusion<\/em><\/a><\/p>\n<p>The post <a href=\"https:\/\/futurism.com\/gpt-5-literary-outputs\">There&#8217;s Something Bizarre About When GPT-5 Writes in a Literary Style<\/a> appeared first on <a href=\"https:\/\/futurism.com\/\">Futurism<\/a>.<\/p>\n<\/div>\n<div style=\"margin-top: 0px; margin-bottom: 0px;\" class=\"sharethis-inline-share-buttons\" ><\/div>","protected":false},"excerpt":{"rendered":"<p>When OpenAI announced the release of GPT-5 this month, the company boasted about how it could supposedly produce &#8220;resonant writing with literary depth and rhythm.&#8221; In a lengthy post on&hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[195,177,196,2935,179],"tags":[],"class_list":["post-4870","post","type-post","status-publish","format-standard","hentry","category-ai-writing","category-artificial-intelligence","category-chatgpt","category-gpt-5","category-openai"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/4870","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=4870"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/4870\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=4870"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=4870"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=4870"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}