The author has open-sourced AgentBox, a lightweight, single-file tool designed to provide observability for the smolagents framework without requiring external infrastructure.

  • It operates with zero dependencies and stores telemetry data in a local SQLite database.
  • The tool automatically intercepts agent logs to calculate fractional USD costs, track token usage, and measure latency.
  • A live-refreshing HTML dashboard is included to monitor agent runs in real-time.
  • Usage involves adding a single decorator to the agent function to enable automatic instrumentation.

This solution addresses the friction of setting up heavy Docker containers or cloud APIs for local agent monitoring.