Physical AI samples
Recorded robot runs with video from two cameras and joint data, first-person video of people doing household tasks, and generated video with 3D body pose. Open any sample to see its details and media.
The samples come from Robot Teleoperation Demonstrations, Robot Sensor Recordings and First-Person Human Motion. How we collect robot data: Training data for physical AI.
Agent replays show software agents at work, step by step.
robot episodes delivered
Robot trajectories with video and sensor data
Full attempts by humanoid and two-legged robots, including the ones that failed. Each sample has both camera views, the labeled objects in the scene and the robot’s joint data.
Part of Robot Teleoperation Demonstrations.
The joint and sensor streams are also available as Robot Sensor Recordings.
- Two camera views, in sync
- Joint and state data at the original rate
- Outcomes checked by a person
Box pick and placeBooster T1 · 60 s · two camera views
Box pick and placeBooster T1 · 60 s · two camera views
Box pick and placeBooster T1 · 60 s · two camera views
Box pick and placeBooster T1 · 60 s · two camera views
Stand upBooster T1 · 15 s · two camera views
Stand upBooster T1 · 15 s · two camera views
Fall recoveryLimX Tron 1 · 15.6 s · two camera views
Fall recoveryLimX Tron 1 · 15.6 s · two camera views
Everyday work from a first-person view
Household tasks filmed from the point of view of the person doing them. Video previews are unavailable for now, but each capture’s details are listed.
Part of First-Person Human Motion.
- Up to 4K at 60 fps
- Hand pose for every frame, where recorded
- Objects and actions, where recorded
| Capture | Record | Task family | Duration | Frame rate |
|---|---|---|---|---|
| Loading and Starting a Washing Machine | pov_20251228_104702 | Laundry & Clothing | 60.4 s | 30 fps |
| Organizing Desk and Shelf | pov_20251228_090740 | Organizing | 57.5 s | 60 fps |
| Hanging Laundry | pov_20251228_091347 | Laundry & Clothing | 58.7 s | 30 fps |
| Setting the Table | pov_20251228_091755 | Dishes & Kitchen | 60 s | 60 fps |
| Folding Laundry | pov_20251228_093704 | Laundry & Clothing | 60.6 s | 30 fps |
| Drying and Storing Utensils | pov_20251228_095542 | Dishes & Kitchen | 60.6 s | 30 fps |
| Tidying and Organizing Room | pov_20251228_102155 | Organizing | 6.9 min | 30 fps |
| Folding a Shirt | pov_20251228_104014 | Laundry & Clothing | 44 s | 30 fps |
| Drying and Arranging Dishes | pov_20251228_105333 | Dishes & Kitchen | 60.6 s | 30 fps |
| Organizing Bedside Drawer | pov_20251228_105942 | Organizing | 61.7 s | 24 fps |
| Making the Bed | pov_20251228_054858 | Bed-Making | 63.1 s | 30 fps |
| Cleaning a Shelf and Electronics | pov_20251228_080630 | Cleaning | 96.6 s | 24 fps |
| Drying and Storing Kitchen Utensils | pov_20251228_073219 | Dishes & Kitchen | 60.6 s | 30 fps |
| Loading and Starting a Washing Machine | pov_20251228_073744 | Laundry & Clothing | 60.5 s | 24 fps |
| Sorting and Organizing Objects | pov_20251228_085110 | Organizing | 56.9 s | 24 fps |
| Cleaning the Counter | pov_20251228_072228 | Cleaning | 41.3 s | 30 fps |
| Making the Bed | pov_20251228_071212 | Bed-Making | 63.1 s | 30 fps |
| Folding Laundry | pov_20251228_065448 | Laundry & Clothing | 41.2 s | 30 fps |
| Folding Laundry on a Bed | pov_20251228_084039 | Laundry & Clothing | 60.1 s | 30 fps |
| Hanging Laundry | pov_20251228_065000 | Laundry & Clothing | 49.1 s | 24 fps |
| Folding Laundry | pov_20251228_074808 | Laundry & Clothing | 57.1 s | 30 fps |
| Watering Plants | pov_20251228_090421 | Plant Care | 49.8 s | 30 fps |
| Making the Bed | pov_20251228_061254 | Bed-Making | 63.1 s | 30 fps |
| Organizing and Cleaning Desk | pov_20251228_103153 | Organizing | 68.7 s | 30 fps |
| Cleaning a Bathroom Mirror | pov_20251228_082618 | Cleaning | 31.5 s | 60 fps |
| Task 20: Folding Clothes | pov_20251214_144339 | Laundry & Clothing | 65 s | 29 fps |
Generated first-person video
Short generated clips for testing vision models and data pipelines. Each sample has a watermarked video, a labeled frame and a manifest file.
Offered with First-Person Human Motion.
- 1280 × 720 H.264 video
- Eight-second clips at 24 fps
- Watermarked previews
Operating a Document LaminatorGenerated first-person video
Spreading RiceGenerated first-person video
Turkish Get-UpGenerated first-person video
Load PaperGenerated first-person video
Surface CleaningGenerated first-person video
Hand MovementGenerated first-person video
Router SetupGenerated first-person video
Whisking SabayonGenerated first-person video
Dispensing SoapGenerated first-person video
Sushi PreparationGenerated first-person video
Generated full-body movement with 3D pose
Generated video of people moving, filmed from the outside, with the body’s position worked out for every frame. Open a sample to turn the 3D pose and step through it.
Offered with First-Person Human Motion.
- 33 body points per frame
- A 3D pose you can turn and play
- Pose data for every frame
First-Person ActivityGenerated motion with 3D pose
Leg SwingsGenerated motion with 3D pose
Ball TossingGenerated motion with 3D pose
Milk SteamingGenerated motion with 3D pose
Arm ExtensionGenerated motion with 3D pose
SlicingGenerated motion with 3D pose
Kettlebell SwingGenerated motion with 3D pose
Arm CirclesGenerated motion with 3D pose
Leveling TripodGenerated motion with 3D pose