{"id":3697,"date":"2025-07-15T22:17:27","date_gmt":"2025-07-15T22:17:27","guid":{"rendered":"https:\/\/musictechohio.online\/site\/grok-4-ai-leaderboard\/"},"modified":"2025-07-15T22:17:27","modified_gmt":"2025-07-15T22:17:27","slug":"grok-4-ai-leaderboard","status":"publish","type":"post","link":"https:\/\/musictechohio.online\/site\/grok-4-ai-leaderboard\/","title":{"rendered":"Elon Musk Said Grok 4 Was the “Smartest AI in the World,” But Its Leaderboard Scores Just Came Out and They Tell a Different Story"},"content":{"rendered":"
\n
\"Elon<\/div>\n

Elon Musk has been boasting about what he says<\/a> are the incredible capabilities of xAI’s new Grok 4 AI chatbot.<\/p>\n

“Grok 4 is smarter than almost all graduate students in all disciplines, simultaneously,” Musk bragged, adding that Grok 4 was “the smartest AI in the world.”<\/p>\n

Is it really? Intelligence was a hard thing to measure even before back before AI hit the scene, but certain tests can provide something of a clue.<\/p>\n

One prominent platform for doing so is the UC Berkeley-developed\u00a0LMArena leaderboard<\/a>, which crowdsources rankings on AI models by\u00a0having users score their responses in categories ranging from creative writing and coding to math and vision.<\/p>\n

In its latest scores, Grok 4 ranked third place overall and on text generation.\u00a0Make no mistake, that’s impressive \u2014 but it’s still trailing behind advanced models from Google and OpenAI. (Specifically, Google’s Gemini 2.5 placed first and OpenAI’s o3 and 4o reasoning models tied for second, with GPT-4.5 tied with Grok 4 for third.)<\/p>\n

While\u00a0Grok is clearly a fearsome competitor in the arenas of racism and antisemitism<\/a>, in other words, even its latest release clearly falls short of being the “smartest AI in the world.”\u00a0(This isn’t entirely surprising; Musk has a long history of fibbing in his professional life<\/a>, political activities<\/a>, and even his hobbies<\/a>.)<\/p>\n

Perhaps the only saving grace for Grok is the suggestion, per expert criticism, that Berkeley’s chatbot arena may be more vibes-based than strictly scientific.<\/p>\n

According to a recent study<\/a>, conducted by a consortium of AI researchers and led by the machine learning firm Cohere, the leaderboard allegedly has a bunch of “systematic issues that have resulted in a distorted playing field.” Among the serious allegations raised by the researchers is the claim that the arena conducts “undisclosed private testing” before publicly releasing scores \u2014 and that rankings can be retracted at will.<\/p>\n

Soon after the paper’s release, it was revealed<\/a> that the version of Meta’s LLaMA 4 that had been used by the leaderboard wasn’t the same one that had been released publicly \u2014 a bait-and-switch ploy on Meta’s part to charm the human voters behind the arena.<\/p>\n

Though an apology was issued<\/a> and Meta was thrown under the bus for its sketchy attempts to rig the game, it was still a really bad look that marred the chatbot arena’s credibility.\u00a0What that means for Grok, though? We’ll have to ask the smartest AI in the world.<\/p>\n

More on Grok:<\/strong> The Pentagon Is Pumping $200 Million Into Elon Musk’s AI That Just Had a Nazi Meltdown<\/em><\/a><\/p>\n

The post Elon Musk Said Grok 4 Was the “Smartest AI in the World,” But Its Leaderboard Scores Just Came Out and They Tell a Different Story<\/a> appeared first on Futurism<\/a>.<\/p>\n<\/div>\n

<\/div>","protected":false},"excerpt":{"rendered":"

Elon Musk has been boasting about what he says are the incredible capabilities of xAI’s new Grok 4 AI chatbot. “Grok 4 is smarter than almost all graduate students in…<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2674,177,2675,178,184],"tags":[],"class_list":["post-3697","post","type-post","status-publish","format-standard","hentry","category-ai-leaderboard","category-artificial-intelligence","category-chatbot-arena","category-elon-musk","category-grok"],"_links":{"self":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/3697","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/comments?post=3697"}],"version-history":[{"count":0,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/posts\/3697\/revisions"}],"wp:attachment":[{"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/media?parent=3697"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/categories?post=3697"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/musictechohio.online\/site\/wp-json\/wp\/v2\/tags?post=3697"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}