Back to Blog
Product Updates

Grok 4.5: The cheapest near‑frontier model that also hallucinates twice as much

At $0.31 per Intelligence Index task, Grok 4.5 undercuts rivals, yet its hallucination rate jumps from 25% to 54%, raising safety concerns for cost‑focused adopters.

bhargavjoshi12376 min read

According to Artificial Analysis, Grok 4.5 can be run for just $0.31 per Intelligence Index task – a price that undercuts Claude Opus 4.8 and GPT‑5.5 by more than 60%. The same benchmark, however, flags a hallucination rate that climbs from 25% in Grok 4.3 to 54% in the new release. The tension between rock‑bottom cost and a confidence explosion is the story worth unpacking.

Cost efficiency beats the competition

The numbers speak loudly. Artificial Analysis reports Grok 4.5’s per‑task cost on the Intelligence Index at $0.31, while the Coding Agent Index sits at $2.49 per task. By contrast, GPT‑5.5 costs $5.07 per coding task and Fable 5 (Claude Code) tops out at $11.80. The price advantage stems from a token‑pricing model of $2 per million input/output tokens, with a 75 % discount on cache hits, and a token usage of roughly 14 k output tokens per Intelligence Index task – over 60 % fewer than Opus 4.8.

Even on the Coding Agent side, Grok 4.5 consumes only 1.9 M tokens per task, while its closest rivals burn 6.2 M (GPT‑5.5) and 7.2 M (Fable 5). The Pareto frontier that the benchmark draws places Grok 4.5 at the sweet spot of high score and low token count, confirming the model as a cost‑effective choice for budget‑conscious deployments.

Agentic performance rivals top‑tier models

Performance‑wise, Grok 4.5 is not a budget‑only player. On the Artificial Analysis Intelligence Index it climbs to an Elo of 1543, slotting it between Claude Opus 4.8 (1600) and GLM‑5.2 (1513). In the 𝜏³‑Banking slice, the model reaches a 33 % success rate, edging out GPT‑5.5’s 31 %.

When the focus shifts to coding, the model scores a 76 on the Coding Agent Index – identical to GPT‑5.5 in the Codex harness and just shy of Fable 5’s top score. The breakdown shows Grok 4.5 excelling in Terminal‑Bench v2, a benchmark that stresses agentic terminal use, indicating that the model’s “knowledge‑work” and “customer‑service” claims are substantiated by the data.

Hallucination rate spikes – the hidden cost

The most uncomfortable figure is the hallucination jump. While accuracy improves from 35 % to 52 % (a 17‑point gain), the confidence misfire climbs from 25 % to 54 %. Artificial Analysis notes that larger models “know more but are also more confident in their knowledge,” a pattern that now manifests as a doubled hallucination risk. For users who prioritize factual fidelity – especially in regulated domains – the cost savings may be outweighed by the need for additional verification layers.

In practice, this means that any pipeline built around Grok 4.5 should incorporate post‑processing filters or human‑in‑the‑loop checks, eroding some of the monetary advantage. The trade‑off is stark: a model that can be run for a few cents per task but may require twice the downstream validation effort.

Token usage and pricing advantages

Beyond raw cost, the token economics are noteworthy. The model’s 500 k token context window – a reduction from Grok 4.3’s 1 M – still supports “configurable reasoning and vision input,” according to the vendor’s release notes. The lower context length translates into fewer tokens needed to achieve comparable results, reinforcing the cost narrative.

Moreover, the cache‑hit discount (down to $0.5 per million tokens) can be leveraged in repeat‑query scenarios, further driving down the effective price per task. Organizations that can cache intermediate reasoning steps stand to gain the most.

Context window trade‑off

The shrink from 1 M to 500 k tokens is a double‑edged sword. While the reduced window cuts token consumption, it may limit long‑form reasoning or multi‑turn conversations that rely on extensive context. For workloads that demand deep, multi‑step analysis – such as long‑horizon knowledge work evaluated in the upcoming AA‑Briefcase benchmark – the smaller window could become a bottleneck.

In short, the model’s design favors short‑to‑medium tasks where token efficiency is paramount, but it may cede ground to larger‑context models when the problem space expands.

Bottom line: who should adopt Grok 4.5?

For teams whose primary metric is cost per inference and who can tolerate a higher hallucination rate through downstream checks, Grok 4.5 presents a compelling value proposition. Its agentic capabilities place it on par with the current leaders, and its token efficiency keeps operating expenses low.

Conversely, organizations that cannot afford extensive validation – such as financial services, legal advice platforms, or any regulated industry – should weigh the hallucination surge carefully. In those contexts, a higher‑priced but more reliable model like Claude Opus 4.8 or GPT‑5.5 may still be the safer bet.

Ultimately, the model sits on a Pareto frontier that rewards cost‑savvy adopters, but the hidden confidence cost forces a decision: save dollars now and invest in guardrails, or pay more upfront for a cleaner signal.

Keep reading

Related articles

GEIGER STUDIO