Physical AI training data

Healthcare data for physical AI.

Expert human demonstrations from real-world care environments for robotics, embodied AI, and VLA models.

Egocentric VideoExocentric VideoRGB-DHuman MotionPoseExpert DemonstrationsTask AnnotationsMultimodal Data
01Domain expertcare workflow demo
02Capture protocolego + exo + depth
03Training recordsvideo, pose, labels

Collection focus

Data built around real healthcare work

Collection modalities

Signals for embodied models

Egocentric Video

First-person demonstrations capturing hands, tools, objects and complete workflows.

Exocentric Video

Third-person views capturing body motion, environment and interactions.

Human Motion & Pose

Body, hand and task trajectories suitable for physical-AI training.

Multimodal Expert Demonstrations

Synchronize video with depth, pose, gaze, annotations, sensor data or other requested modalities.

How custom collection works

From expert work to training data

  1. 01

    Define the task

  2. 02

    Design the collection protocol

  3. 03

    Source appropriate domain experts

  4. 04

    Deliver structured training data

Public dataset library

Explore public datasets shaping healthcare robotics and embodied AI.

Healthcare

OpenRoboCare

2025

Multimodal expert demonstrations for robot-assisted caregiving tasks.

RGB-DPoseGaze
Verified scale
21 occupational therapists
Verified scale
315 sessions, 19.8 hours

Source institution: Cornell University, Columbia University, National University of Singapore, UMass Lowell

View dataset

Healthcare

Ego-Exo4D Health

2024

Synchronized egocentric and exocentric recordings of skilled activities, including health tasks.

Egocentric VideoExocentric VideoPose
Verified scale
1,286.30 V2 video hours
Verified scale
5,035 V2 takes

Source institution: Ego-Exo4D Consortium

View dataset

Caregiving

Toyota Smarthome

2019

Daily-living activities by older adults captured with multi-camera RGB-D sensing.

RGBDepthRGB-D
Verified scale
16,115 short RGB-D samples
Verified scale
31 activity classes

Source institution: Toyota Motor Europe and research collaborators

View dataset

Healthcare

JIGSAWS

2014

Robotic-surgery skill benchmark with synchronized video, kinematics, and gesture labels.

Exocentric VideoKinematicsAnnotations
Verified scale
8 surgeons
Verified scale
3 tasks with 5 repetitions

Source institution: Johns Hopkins University and Intuitive Surgical

View dataset

Egocentric

Ego4D

2021

Large-scale egocentric daily-life video for first-person perception research.

Egocentric VideoRGBGaze
Verified scale
3,670 video hours
Verified scale
923 participants

Source institution: Ego4D Consortium

View dataset

Robot Manipulation

DROID

2024

Large in-the-wild robot manipulation dataset collected across scenes and tasks.

RGB-DRobot ActionsKinematics
Verified scale
76K trajectories
Verified scale
350 hours of interaction data

Source institution: DROID research consortium

View dataset

Can't find the task or scale you need? We can design a custom collection.

Request Custom Data