Teknium 0ee5ae61e2 docs(evals): real Codex CLI head-to-head arm + results ...

scripts/codex_arm.py drives OpenAI Codex CLI end-to-end on the same
transcripts: chunk-file reads until its REAL auto-compaction fires (verified
via compacted events in the rollout jsonl; peak 455-483K vs its 258K
window), then quizzes post-compaction with the identical question banks and
judge. Results (results/codex-arm-2026-08-15/): codex 36.7% avg vs lean
closed-book 40.0% vs lean+recovery 68.3%. Codex has no runtime re-access
over its rollout history — the session_search differentiator, measured.

2026-08-15 18:41:24 -07:00

..

build_html_report.py

docs(evals): ship transcript-building scripts + full eval detail in-repo

2026-08-15 17:40:43 -07:00

codex_arm.py

docs(evals): real Codex CLI head-to-head arm + results

2026-08-15 18:41:24 -07:00

reconstruct_lineage.py

docs(evals): ship transcript-building scripts + full eval detail in-repo

2026-08-15 17:40:43 -07:00

replay_lineage.py

docs(evals): ship transcript-building scripts + full eval detail in-repo

2026-08-15 17:40:43 -07:00