Skip to content

Quickstart

Four steps from a clone to a first scored cell.

1. Install and point the harness at your data

git clone https://github.com/SPICExLAB/IMU-Bench && cd IMU-Bench
python -m venv imu-bench && source imu-bench/bin/activate && pip install -e .
export IMUBENCH_DATA_ROOT=/data/imubench      # layout in Datasets
imu-bench tasks

2. Run a reference encoder on one task

imu-bench eval --encoder control_random --tasks har_hhar --protocols probe

control_random is the shared backbone with random weights, never trained: the number it reaches is what the decoder alone achieves. The cell writes runs/bench_har_hhar__control_random__probe__s42/ and bench/results/har_hhar/control_random__probe__s42.json.

3. Run InrtlWrist through the plugin interface

imu-bench eval --encoder examples/plugin/inrtlwrist_plugin.yaml --tasks har_hhar pd_pads --protocols probe

The card points at the released checkpoint on the Hugging Face Hub; the harness downloads it. The scores should match the released result files for these cells, which verifies the data preparation.

4. Run your own encoder

Copy examples/plugin/inrtlwrist_plugin.py and .yaml, replace the model, then:

imu-bench eval --encoder my_encoder.yaml            # all ten tasks, both protocols
imu-bench check my_encoder                           # complete? protocol-faithful? which track?
imu-bench package my_encoder --out submission/       # ready for the leaderboard pull request

Details: Submission modes, Evaluation, Tracks and leaderboard submission.