Box pick and place
The robot (Box B) is instructed to pick up a box (Box C) from its current position over a table (Box D) and place it over a table (Box A) on the other side of the setting.
Instruction given to the robot
Please walk to the table (Box D) and pick up the box (Box C) placed on top, turn around, walk towards the table (Box A) and place the picked up box (Box C) over it.
Observed failure
The robot (Box B) held the box too low and it fell off by colliding with the table (Box A).
| Outcome | Failure |
|---|---|
| Episode | episode_011 |
| Robot | Booster T1, humanoid |
| Duration | 60 s |
| Cameras | External and robot views, 30 fps |
| Joints | 4,556 samples at 75.9 Hz |
| State | 34 samples at 0.6 Hz |
| Package | 181.0 MB, 7 files |
Proprioception
Loading the sensor preview.
Objects in the first frame
The box around each object in the external camera’s first frame, in pixels.
| Label | Box position | Box size |
|---|---|---|
| Box A | 461, 646 | 250 × 231 px |
| Box B | 806, 493 | 129 × 395 px |
| Box C | 1220, 529 | 126 × 72 px |
| Box D | 1192, 582 | 239 × 173 px |
Files in the original package
| File | Contents | SHA-256 |
|---|---|---|
| cast/camera_0.mp4 | External camera, 30 fps | bc8f4b511bdc54fd63c631911f091fd192655720b65f473d60eccca96b7cab3c |
| feed/visual/camera_0.mp4 | Robot camera, 30 fps, 1,801 frames | cdacaa1c4cfacede950e10b56d14ed763ea7b7528754941ac330b4621386e074 |
| feed/audio/microphone_0.wav | Microphone audio | 0856ab4220c3847e073d20f910e7e556f0337ba4afc936b3547062aae1a95867 |
| feed/proprioception/joints.jsonl | Positions, velocities and efforts, 4,556 samples at 75.9 Hz | 53387fe5c21131e27a301190ac67b67d8d7746200dd64386eeb0030b6b5eab90 |
| feed/proprioception/state.jsonl | Battery level and mode, 34 samples at 0.6 Hz | 93ee0accc62bb534b1aef1c6cdead5d6a844273a03bf1896ab5082026dd3e24f |
| annotations/scene_objects.json | 4 annotated scene objects | 38ef74f3889ec01f035766788ece7598666c0d0c9f81adc00e4420a1053ba6ab |
| annotations/first_frame_annotated.jpg | Annotated first frame | 76d49e4866da20679067f7a65e58a27afb591b78d167c496bff3f75f7f2b231f |
SHA-256 checksums come from the episode’s manifest. The videos on this page are compressed previews; the package has the originals.
Request the original package
The package has the full-quality video, audio and joint data files listed above. This episode is a sample of Robot Teleoperation Demonstrations.