Skip to content

Box pick and place

The robot (Box B) is instructed to pick up a box (Box C) from its current position over a table (Box D) and place it over a table (Box A) on the other side of the setting.

Instruction given to the robot

Please walk to the table (Box D) and pick up the box (Box C) placed on top, turn around, walk towards the table (Box A) and place the picked up box (Box C) over it.
OutcomeSuccess
Episodeepisode_013
RobotBooster T1, humanoid
Duration60 s
CamerasExternal and robot views, 30 fps
Joints4,828 samples at 80.5 Hz
State34 samples at 0.6 Hz
Package184.2 MB, 7 files
External camera
Robot camera. The two videos play in sync.
Proprioception

Loading the sensor preview.

Objects in the first frame

The box around each object in the external camera’s first frame, in pixels.

LabelBox positionBox size
Box A477, 624214 × 292 px
Box B853, 48190 × 420 px
Box C1223, 565142 × 72 px
Box D1172, 606300 × 192 px

Files in the original package

FileContentsSHA-256
cast/camera_0.mp4External camera, 30 fps604f1741f5e49f55f34f1a75583a820c379299a7934c3ba3f2617aefef0d55c3
feed/visual/camera_0.mp4Robot camera, 30 fps, 1,801 framesa5f829ed9341edc3235056b5fa6e5c50581fa6fb4dd24ce657f95da6f7875f70
feed/audio/microphone_0.wavMicrophone audiocfb608aad2c1b3062120975d89a41da34a024baa3ba9141453dda37bd5a5985e
feed/proprioception/joints.jsonlPositions, velocities and efforts, 4,828 samples at 80.5 Hz965cc3319a352919343edb93f43d5b7b8ba82001962eb951ec46eddb632523e2
feed/proprioception/state.jsonlBattery level and mode, 34 samples at 0.6 Hz546bc74ba30d35ef09e61a9d60f2a7b770c89f922d6d570bd4a9e868629ffa6c
annotations/scene_objects.json4 annotated scene objects8ba651eef14cdd459ad65d163a69cb2fccc4a35412a38d3bf3cd4756692d6711
annotations/first_frame_annotated.jpgAnnotated first framea978e4087b124b782932c5515ea3e50058bebb8b7d7ad6ea8d886b1f0c589e93

SHA-256 checksums come from the episode’s manifest. The videos on this page are compressed previews; the package has the originals.

Request the original package

The package has the full-quality video, audio and joint data files listed above. This episode is a sample of Robot Teleoperation Demonstrations.