Skip to content

Result files

One JSON per cell at bench/results/<task>/<encoder>__<protocol>__s<seed>.json, written by the task's scorer:

{
  "task": "microgesture_openwatch",
  "encoder": "mae_5src",
  "protocol": "probe",
  "seed": 42,
  "metrics": {"clip_macro_f1": 0.647, "clip_acc": 0.678, "window_macro_f1": 0.494, "window_acc": 0.536},
  "primary_metric": "clip_macro_f1",
  "eval_split": "test",
  "run": "bench_microgesture_openwatch__mae_5src__probe__s42",
  "checkpoint": "runs/.../checkpoints/best.pt",
  "checkpoint_step": 1200,
  "selection": {"split": "val", "monitor": "macro_f1", "mode": "max"},
  "job_ids": [7212525],
  "provenance": {"legacy_run": false, "scorer": "bench.score.microgesture", "scored_at": "..."},
  "status": "ok",
  "notes": "",
  "schema_version": 1
}
Field Meaning
metrics every metric the scorer computes; the leaderboard reads primary_metric
eval_split test where a test split exists (gesture, retrieval), otherwise the held-out validation split the card defines
checkpoint_step the step selected by the card's rule on the validation split
provenance scorer, time, and whether the run predates the harness (legacy_run)

imu-bench leaderboard collects these files into bench/leaderboard_tracks.json (per track and protocol: rows, cells, ranks) and the Markdown/HTML tables. The released result files, the registry and the leaderboard data are mirrored in the dataset YiquanLi/IMU-Bench-results, whose results_long.csv lists every cell as one row.