codex/gpt-5.6-sol
20260818T011756Z-6d2875
completeddev / untrustedhigh effort · prompt=baseline · pilot · 8m 27s · — · 2026-08-18T01:17:56.765656+00:00
dev / untrusted. Candidate code ran on the host through the development-only native backend, with the evaluator inside the same trust boundary. Useful evidence, not a publishable benchmark score.How to read this →
Verdict
Weights come from the case scoring block, not from this page.
| Component | Value | Weight | Contribution |
|---|---|---|---|
| Build gateinstall + build; a failed gate scores zero overall | ✓ passed | gate | — |
| Normalized visualraw 86.6 · floor 0.16 | 0.8402 | × 0.75 | +0.6301 |
| Functional checksweighted deterministic checks | 0.9091 | × 0.25 | +0.2273 |
| Overall | = 0.8574 |
Visual evidence
4 checkpoints · reference against candidate · drag the wipe or fade the onion skin
Fig. 01homebase target · 1440×900
referencecandidatepixel 98.0thumbnail 98.6fg-IoU 62.0edge 73.9dimension 100.0
Fig. 02playgroundbase target · 1440×1070
referencecandidatepixel 99.6thumbnail 99.8fg-IoU 91.8edge 89.6dimension 100.0
Fig. 03home-menu-openstate on home
referencecandidatepixel 98.2thumbnail 98.8fg-IoU 99.4edge 75.1dimension 100.0
Fig. 04playground-closestate on playground
referencecandidatepixel 98.0thumbnail 98.6fg-IoU 62.0edge 73.9dimension 100.0
Functional checks
Deterministic browser assertions. Selectors stay sealed.
4 / 5 passed · weight 5.0 / 5.5
| Result | Check | Kind | Weight | Detail |
|---|---|---|---|---|
| required-file:submission.json | — | 0.5 | submission.json is missing required keys: routes, status | |
| home-heading | text | 1.0 | — | |
| menu-expands | attribute_after_click | 1.5 | — | |
| playground-breadcrumb | text | 1.0 | — | |
| playground-close-returns-home | click_text_change | 1.5 | — |
Apparatus
Agent, variant, timing, usage and content digests, as recorded.
Trace summary
Derived counts only — raw logs are not published.
trace summarizedcodex-jsonl-v1
| events | 64 |
|---|---|
| tool calls | 26 |
| commands | 22 |
| file edits | 9 |
| wall clock | 8m 27s |
| input tokens | 1.65M |
| output tokens | 21.9k |
A full trace viewer is planned. v1 publishes only the derived summary above — raw events.jsonl and stderr.log stay in the run directory and are never uploaded, since they can contain host paths, environment details and unredacted tool output.