Calibra is an open-source toolkit designed to help researchers audit robot datasets and identify quality issues before training policies. The first public release includes a Robot Dataset Health Check interactive Space for auditing LeRobot datasets and a benchmark of 30 public LeRobot datasets with health scores.

  • Robot Dataset Health Check: An interactive Hugging Face Space for auditing LeRobot datasets in seconds.
  • Benchmark of 30 public LeRobot datasets: Includes health scores, quality diagnostics, and community comparisons.
  • Toolkit features: Quality-aware coreset selection, training outcome prediction, and a Python API/CLI.

The toolkit aims to address the difficulty of understanding dataset quality prior to training by providing auditing capabilities and outcome estimation.