Box pick and place
The robot (Box B) is instructed to pick up a box (Box C) from its current position over a table (Box D) and place it over a table (Box A) on the other side of the setting.
Instruction given to the robot
Please walk to the table (Box D) and pick up the box (Box C) placed on top, turn around, walk towards the table (Box A) and place the picked up box (Box C) over it.
Observed failure
The robot (Box B) dropped the box after placing it over the table (Box A).
| Outcome | Failure |
|---|---|
| Episode | episode_010 |
| Robot | Booster T1, humanoid |
| Duration | 60 s |
| Cameras | External and robot views, 30 fps |
| Joints | 4,615 samples at 76.9 Hz |
| State | 34 samples at 0.6 Hz |
| Package | 174.6 MB, 7 files |
Proprioception
Loading the sensor preview.
Objects in the first frame
The box around each object in the external camera’s first frame, in pixels.
| Label | Box position | Box size |
|---|---|---|
| Box A | 370, 649 | 261 × 279 px |
| Box B | 869, 502 | 104 × 385 px |
| Box C | 1170, 561 | 116 × 58 px |
| Box D | 1125, 617 | 265 × 168 px |
Files in the original package
| File | Contents | SHA-256 |
|---|---|---|
| cast/camera_0.mp4 | External camera, 30 fps | 60e5d60a36cd7c7ab5722e906b84ac9ad0c0cf669c72af24c3d5086df16feb9b |
| feed/visual/camera_0.mp4 | Robot camera, 30 fps, 1,801 frames | f4e5385e76eb5821adff93c2d5ae32b9405bc67fb3441ca74df16c72c4020ef2 |
| feed/audio/microphone_0.wav | Microphone audio | d1db72d410708ecca1f0ecc5c4898a8d144876417d82435f3b1fb77aedf4678e |
| feed/proprioception/joints.jsonl | Positions, velocities and efforts, 4,615 samples at 76.9 Hz | dab0c66280d5e26711ecbcee69a74d0fd74978264ff18e0a7ff61660ec82b455 |
| feed/proprioception/state.jsonl | Battery level and mode, 34 samples at 0.6 Hz | c6a21b431e52248f54d17ff9e55ded3729ed375d034039d045f37a2030f3857a |
| annotations/scene_objects.json | 4 annotated scene objects | 1f0efe02298bb3c9caa95dd461719b9fafa1f7ff79e71f4321cf39036b93f0de |
| annotations/first_frame_annotated.jpg | Annotated first frame | d130bfbee3b37e10c8e42140c351b0395cbba05118f378610e483a82fee6a991 |
SHA-256 checksums come from the episode’s manifest. The videos on this page are compressed previews; the package has the originals.
Request the original package
The package has the full-quality video, audio and joint data files listed above. This episode is a sample of Robot Teleoperation Demonstrations.