Back to Geiger

Field notes

Blog

Ideas for teams that make things: product decisions, working methods, and dispatches from inside Geiger Studios.

GPT‑5.6 Sol cuts cost by two‑thirds but raises hallucination risk
Latest dispatch
July 11, 20266 min

Model Reviews

GPT‑5.6 Sol cuts cost by two‑thirds but raises hallucination risk

GPT‑5.6 Sol delivers the same Intelligence Index score as Claude Fable 5 for $1.04 per task – about one‑third the price – but introduces a measurable rise in hallucinations.

Read dispatch

The archive

08 notes
01
Product Updates
July 11, 20266 min

Grok 4.5: The cheapest near‑frontier model that also hallucinates twice as much

At $0.31 per Intelligence Index task, Grok 4.5 undercuts rivals, yet its hallucination rate jumps from 25% to 54%, raising safety concerns for cost‑focused adopters.

02
Case Studies
July 9, 20268 min

Muse Spark 1.1 Review: Meta Scores 51 on the Intelligence Index - Benchmarks, Cost Per Task & Where It Still Lags

Meta's Muse Spark 1.1 scores 51 on the Artificial Analysis Intelligence Index at ~$0.26 per task — but its 4x factuality gain came from abstention, not accuracy.

03
Case Studies
July 6, 20265 min

AutomationBench-AA: How AI Agents Perform on Real SaaS Workflows (and Why They All Break the Rules)

A new benchmark from Zapier and Artificial Analysis tested AI agents on 657 real SaaS workflow tasks. Anthropic's models lead — but every model breaks business rules, and Finance automation is still the weak spot.

04
Case Studies
July 1, 20266 min

Claude Sonnet 5 Review: Benchmarks, Cost Per Task & How It Compares to Opus 4.8

Claude Sonnet 5 scores 53 on the Artificial Analysis Intelligence Index and matches Opus 4.8 on agentic tasks — but at standard pricing it costs more per task than the model it's supposed to undercut. Here's what the numbers actually show.

05
Product Updates
June 17, 20264 min

GLM-5.2 Review: Benchmarks, Cost & How It Compares to DeepSeek and MiniMax.

GLM-5.2 tops the open weights leaderboard with a score of 51 on the Intelligence Index. Here's a breakdown of its benchmarks, cost per task, and how it stacks up.

06
Product Updates
March 14, 20265 min

Introducing Geiger Flow 2.0

We're excited to announce the release of Geiger Flow 2.0 with revolutionary new features for workflow automation.

07
Tutorials
March 12, 20268 min

Getting Started with Geiger Notes

Learn how to make the most of Geiger Notes with this comprehensive beginner's guide.

08
Case Studies
March 10, 202612 min

How Acme Corp Saved 40% Development Time

Discover how Acme Corporation streamlined their development workflow using Geiger products.

GEIGER STUDIO