Physical AI samples
Recorded robot runs with video from two cameras and joint data, first-person video of people doing household tasks, and generated video with 3D body pose. Open any sample to see its details and media.
The samples come from Robot Teleoperation Demonstrations, Robot Sensor Recordings and First-Person Human Motion. How we collect robot data: Training data for physical AI.
Agent replays show software agents at work, step by step.
robot episodes delivered
Robot trajectories with video and sensor data
Full attempts by humanoid and two-legged robots, including the ones that failed. Each sample has both camera views, the labeled objects in the scene and the robot’s joint data.
Part of Robot Teleoperation Demonstrations.
The joint and sensor streams are also available as Robot Sensor Recordings.
- Two camera views, in sync
- Joint and state data at the original rate
- Outcomes checked by a person
Everyday work from a first-person view
Household tasks filmed from the point of view of the person doing them. Video previews are unavailable for now, but each capture’s details are listed.
Part of First-Person Human Motion.
- Up to 4K at 60 fps
- Hand pose for every frame, where recorded
- Objects and actions, where recorded
| Capture | Record | Task family | Duration | Frame rate |
|---|---|---|---|---|
| Loading and Starting a Washing Machine | pov_20251228_104702 | Laundry & Clothing | 60.4 s | 30 fps |
| Organizing Desk and Shelf | pov_20251228_090740 | Organizing | 57.5 s | 60 fps |
| Hanging Laundry | pov_20251228_091347 | Laundry & Clothing | 58.7 s | 30 fps |
| Setting the Table | pov_20251228_091755 | Dishes & Kitchen | 60 s | 60 fps |
| Folding Laundry | pov_20251228_093704 | Laundry & Clothing | 60.6 s | 30 fps |
| Drying and Storing Utensils | pov_20251228_095542 | Dishes & Kitchen | 60.6 s | 30 fps |
| Tidying and Organizing Room | pov_20251228_102155 | Organizing | 6.9 min | 30 fps |
| Folding a Shirt | pov_20251228_104014 | Laundry & Clothing | 44 s | 30 fps |
| Drying and Arranging Dishes | pov_20251228_105333 | Dishes & Kitchen | 60.6 s | 30 fps |
| Organizing Bedside Drawer | pov_20251228_105942 | Organizing | 61.7 s | 24 fps |
| Making the Bed | pov_20251228_054858 | Bed-Making | 63.1 s | 30 fps |
| Cleaning a Shelf and Electronics | pov_20251228_080630 | Cleaning | 96.6 s | 24 fps |
| Drying and Storing Kitchen Utensils | pov_20251228_073219 | Dishes & Kitchen | 60.6 s | 30 fps |
| Loading and Starting a Washing Machine | pov_20251228_073744 | Laundry & Clothing | 60.5 s | 24 fps |
| Sorting and Organizing Objects | pov_20251228_085110 | Organizing | 56.9 s | 24 fps |
| Cleaning the Counter | pov_20251228_072228 | Cleaning | 41.3 s | 30 fps |
| Making the Bed | pov_20251228_071212 | Bed-Making | 63.1 s | 30 fps |
| Folding Laundry | pov_20251228_065448 | Laundry & Clothing | 41.2 s | 30 fps |
| Folding Laundry on a Bed | pov_20251228_084039 | Laundry & Clothing | 60.1 s | 30 fps |
| Hanging Laundry | pov_20251228_065000 | Laundry & Clothing | 49.1 s | 24 fps |
| Folding Laundry | pov_20251228_074808 | Laundry & Clothing | 57.1 s | 30 fps |
| Watering Plants | pov_20251228_090421 | Plant Care | 49.8 s | 30 fps |
| Making the Bed | pov_20251228_061254 | Bed-Making | 63.1 s | 30 fps |
| Organizing and Cleaning Desk | pov_20251228_103153 | Organizing | 68.7 s | 30 fps |
| Cleaning a Bathroom Mirror | pov_20251228_082618 | Cleaning | 31.5 s | 60 fps |
| Task 20: Folding Clothes | pov_20251214_144339 | Laundry & Clothing | 65 s | 29 fps |
Generated first-person video
Short generated clips for testing vision models and data pipelines. Each sample has a watermarked video, a labeled frame and a manifest file.
Offered with First-Person Human Motion.
- 1280 × 720 H.264 video
- Eight-second clips at 24 fps
- Watermarked previews
Generated full-body movement with 3D pose
Generated video of people moving, filmed from the outside, with the body’s position worked out for every frame. Open a sample to turn the 3D pose and step through it.
Offered with First-Person Human Motion.
- 33 body points per frame
- A 3D pose you can turn and play
- Pose data for every frame
