sessionwiki

Session: html-report-for-eval-runs — 2026-10-30

eval-harness · Codex · branch feat/html-report · gpt-5-codex · 2026-10-30 14:10 · 1 msgs · 3 tools · 1 min read · updated 5 days ago

tools: Bash, Write
← eval-harness Download .md .txt .json
Tool calls
Write Write: 2 calls (66.7%) 2 Bash Bash: 1 call (33.3%) 1
Token usage89.6K total
Input9.6K
Cache creation19.2K
Cache read57.6K
Output3.2K
Cache hit ratio67%· warming up

Project: eval-harness · Branch: feat/html-report · Mode: default · Model: gpt-5-codex

Summary

Generated a self-contained HTML report per eval run: summary table, per-metric distributions, a diff view against the previous run, and drill-down into failing cases with judge rationales.

Conversation

Turn 1 — User

Give me a report I can share, comparing this run with the last one.

Turn 1 — Assistant

Single HTML file with inline CSS/JS, metrics summary, histogram per metric, regressions highlighted against the baseline run, and expandable failing cases.

Tools used in this turn:

  • Write: harness/report/html.py
  • Write: harness/report/template.html
  • Bash: python -m harness report runs/latest --baseline runs/prev — report.html

Connections

  • [[eval-harness]]
  • [[Reporting]]
  • [[RegressionTracking]]

Keyboard shortcuts

⌘K / Ctrl+KOpen command palette
/Focus search
g hGo to home
g pGo to projects
g sGo to sessions
j / kNext / prev row (tables)
?Show this help
EscClose dialogs

Structured queries

Mix key:value filters with free text in the palette:

type:sessionOnly session pages
project:llm-wikiFilter by project name (substring)
model:claudeFilter by model name (substring)
date:>2026-03-01Sessions after a date
date:<2026-04-01Sessions before a date
tags:rustPages mentioning a tag/topic
sort:dateSort results by date (newest first)

Example: type:session project:llm-wiki date:>2026-04 sort:date