ant-research/Open-AoE ·
2,000 Hours of Smartphone-Collected Egocentric Manipulation Data with a Complete Data-to-Model Toolchain English | 简体中文 Tip New to Open-AoE? Start with the data specification, render one segment with AoE-Visualization, then choose a model recipe from AoE-Training-Ready. Use DTCoder to start your experiment. Open-AoE is a large-scale, real-world egocentric manipulation dataset collected entirely with consumer smartphones. It provides approximately 2,000 hours of first-person video with synchronized hand motion, camera motion, and bilingual atomic-action annotations. The repository connects those signals to visualization, human-to-robot retargeting, robot replay, and model-specific training recipes. The technical report is available on arXiv. Choose either Hugging Face or ModelScope, then locate one extracted segment directory. Its expected layout is documented in the data specification. Some visualization and retargeting workflows require MANO model files. Register and download MANO_RIG
2,000 Hours of Smartphone-Collected Egocentric Manipulation Data with a Complete Data-to-Model Toolchain English | 简体中文 Open-AoE is a large-scale, real-world egocentric manipulation dataset collected entirely with consumer smartphones. It provides approximately 2,000 hours of first-person video with synchronized hand motion, camera motion, and bilingual atomic-action annotations. The repository connects those signals to visualization, human-to-robot retargeting, robot replay, and model-specific training recipes. Get the Release Resource Access What you get Technical report Read on…
saved by
related reading
- Macrodata Labs — better data for better robotsmacrodata.co
- The Most Densely Annotated Open-Source Egocentric Action Dataset — Human Archiveego500.humanarchive.ai
- ABC-130K: The largest open source teleoperation datasetxdof.ai
- ACT-1: A Robot Foundation Model Trained on Zero Robot Data | Sunday Robotics | The helpful robotics companysunday.ai
- Humanoid Atlas | Humanoid Robot Supply Chain Map, OEM Database & Industry Analysishumanoids.fyi
- Scalable Behavior Cloning with Open Data, Training, and Evaluationabc.bot
- Datacurve | The data engine for frontier AIdatacurve.ai
- How Claude Performs on Robotics Tasks \ Anthropicanthropic.com
- eventual.aieventual.ai
- Generalist - GEN-0 / Embodied Foundation Models That Scale with Physical Interactiongeneralistai.com
- EgoScaleresearch.nvidia.com
- Dataset list - A list of the biggest machine learning datasetsdatasetlist.com