Ego500: The Most Densely Annotated Open-Source Egocentric Action Dataset — Human Archive
Egocentric video is emerging as a core data source for robotics, but there is little work on benchmarking data quality or defining what high-quality annotations look like. For this data to be useful for policy training, every clip must: Existing datasets are neither as diverse, as rigorously QA'd, nor as granularly and accurately annotated as Human Archive's datasets. This is made possible by our custom pipelines and human-in-the-loop review process, where over 100 trained annotators at our QC center review, correct, and refine our labels. We then use this labeled data to continually retrain and improve the underlying annotation models. Today, we're releasing HA-Ego-500. Not only do our labels set a new state of the art in temporal accuracy and granularity, but HA-Ego-500 is also the first open-source egocentric dataset to provide large-scale, in-the-wild data across a diverse range of real commercial environments. HA-Ego-500 is a large-scale collection of in-the-wild egocentric video
Egocentric video is emerging as a core data source for robotics, but there is little work on benchmarking data quality or defining what high-quality annotations look like. For this data to be useful for policy training, every clip must: Pass rigorous quality assurance (e.g. hands remain visible, the task is economically useful, lighting is sufficient, and there are no hardware issues). Be temporally accurate, with action boundaries precisely aligned to when each action begins and ends. Contain dense, fine-grained action annotations that describe every sub-action without mislabeling…
saved by
related reading
- Macrodata Labs — better data for better robotsmacrodata.co
- GitHub - ant-research/Open-AoEgithub.com
- The First Fully General Computer Action Model | blogsi.inc
- EgoScaleresearch.nvidia.com
- State of Robot Learning, December 2025vedder.io
- Causal Video Models Are Data-Efficient Robot Policy Learners | Rhoda AIrhoda.ai
- Emergence of Human to Robot Transfer in Vision-Language-Action Modelspi.website
- ABC-130K: The largest open source teleoperation datasetxdof.ai
- 45d74e190008c7bff2845ffc8e3facd3-Paper-Conference.pdfproceedings.iclr.cc
- Thinking about High-Quality Human Data | Lil'Loglilianweng.github.io
- Open X-Embodiment: Robotic Learning Datasets and RT-X Modelsarxiv.org
- Scalable Behavior Cloning with Open Data, Training, and Evaluationabc.bot