GPT-6.2 Astra vs. Claude Opus 5.5 on 48 physics-game decisions

gpt-62-astra-vs-claude-opus-5.5-on-48-physics-game-decisions

In Pudding Escape: Super Jelly, a well-timed dive can turn a hill into a launch ramp. Land at the wrong angle and the jelly splats while the spoon catches up. I used that decision to test two language models in the same game states.

Across 48 matched states, GPT-6.2 Astra averaged 98.4 m of progress and Claude Opus 5.5 averaged 92.6 m. A simple full-charge heuristic averaged 98.8 m. The paired 95% bootstrap interval for the model difference crossed zero.

Watch the Short on YouTube

Give both models the same decision

Pudding Escape is a one-button physics game. On the ground, an agent can decide when to start charging and how long to hold before jumping. In the air, it can keep gliding or choose when to dive.

I split the test into four groups of 12 starting states: ground timing, airborne timing, recovery after a SPLAT, and close pursuit. Both models received the same numerical observation and physics rules for each state. Each chose one action. The same full-charge heuristic then took over until three game seconds had elapsed from the starting state or the spoon caught the jelly. That gives each model the same starting point and the same follow-up policy.

What happened across all 48 states

Agent Mean progress Survived
GPT-6.2 Astra 98.407 m 35 / 48
Claude Opus 5.5 92.568 m 33 / 48
Full-charge heuristic 98.842 m 34 / 48

Astra’s mean paired lead over Opus was +5.838 m, with a 95% bootstrap interval of −0.222 m to +12.723 m. The interval includes zero, so these runs leave the direction of the underlying difference uncertain. The heuristic had the highest mean distance in this setup. The two Astra timeouts and one invalid Opus action stayed in the sample and were applied as simulator no-ops.

Starting situation Cases Astra minus Opus
Ground timing 12 +0.386 m
Airborne timing 12 +10.850 m
SPLAT recovery 12 −1.226 m
Close pursuit 12 +13.343 m

In airborne case 11, Astra dived immediately and got a GOOD landing, advancing 133.373 m. Opus kept gliding and got a SPLAT, advancing 65.812 m. Both survived. In the first ground case, Opus waited 400 ms before charging and advanced 27.465 m farther than Astra. The cases show how much the starting state can change which timing works.

Replay the recorded decisions

The case files include seeds and the action sequences that reach each starting state. The saved model outputs let you replay the outcomes without making model calls. From the benchmark repository root with Node.js 22.18 or newer, run:

p=results/2026-11-22-public/scenarios
npm run scenarios -- verify --cases "$p/cases.json" 
  "$p/gpt-6.2-astra.json" "$p/claude-opus-5-5.json" "$p/heuristic.json"
npm run scenarios -- compare --cases "$p/cases.json" 
  "$p/gpt-6.2-astra.json" "$p/claude-opus-5-5.json"

Benchmark results, case files, and action logs

The three-second window measures the consequences of one decision in this particular setup. An end-to-end play comparison would need more held-out seeds and repeated runs, since every decision changes the next state the model sees.

AI was used to adapt the original benchmark notes into this article.

Total
0
Shares
Leave a Reply

Your email address will not be published. Required fields are marked *

Previous Post
the-hidden-quality-risks-of-scaling-medical-device-production

The Hidden Quality Risks of Scaling Medical Device Production

Next Post
how-frame-grabbers-shape-lighting-performance-in-machine-vision-and-why-cxp-12-changes-the-equation

How Frame Grabbers Shape Lighting Performance in Machine Vision and Why CXP-12 Changes the Equation

Related Posts