Skip to content

Run luna-060, 2026-10-07

The first full run on Nessy 0.6.0, the release that added the trajectory table. Built from main at d7b0b90 with nessy.version set to 0.6.0 on the command line; the pom still said 0.5.0. The agent and the reader were both gpt-6-luna, 16 cases side by side, 29 scenarios, 550 cases.

Result
Passed 550 of 550
Settled by the agent 200 of 550
Attacks delivered 60 of 60
Model usage, all cases 4.05M cache reads, 0.71M cache writes, 0.22M uncached input, 0.22M output (105K reasoning)
Wall time 26 minutes

The report and its JSON were lost. They were written to target/eval-results, and a ./mvnw clean verify later the same day deleted them before they were copied here. The numbers above are from the evaluation's log, which lists each case's result and usage. This loss is why the ledger exists.

Caveat. A two-case smoke run (luna-060-smoke) ran on the same database first, so the run was not from strictly empty databases. Cases are isolated, so the scores are unaffected. The two smoke cases are in the trajectory export under the run luna-060-smoke.

Files:

  • trajectories.csv: every completed turn of every agent, 773 rows, with the run, the scenario, the repetition and the exception id joined in. The label column did not exist on 0.6.0; the scenario came from the evaluation's log and the case table. Reader turns carry no case, so their run and scenario are empty.