NVIDIA addresses the challenge of rigorously evaluating robotics foundation models, which can now follow natural language instructions to manipulate objects. The company identifies evaluation as a critical unsolved problem and presents a new method to address these issues.
The article highlights that while current systems are capable, rigorous assessment remains difficult for the field.