ant-research/Open-AoE ·
2,000 Hours of Smartphone-Collected Egocentric Manipulation Data with a Complete Data-to-Model Toolchain English | 简体中文 Tip New to Open-AoE? Start with the data specification, render one segment with AoE-Visualization, then choose a model recipe from AoE-Training-Ready. Use DTCoder to start your experiment. Open-AoE is a large-scale, real-world egocentric manipulation dataset collected entirely with consumer smartphones. It provides approximately 2,000 hours of first-person video with synchronized hand motion, camera motion, and bilingual atomic-action annotations. The repository connects those signals to visualization, human-to-robot retargeting, robot replay, and model-specific training recipes. The technical report is available on arXiv. Choose either Hugging Face or ModelScope, then locate one extracted segment directory. Its expected layout is documented in the data specification. Some visualization and retargeting workflows require MANO model files. Register and download MANO_RIG
2,000 Hours of Smartphone-Collected Egocentric Manipulation Data with a Complete Data-to-Model Toolchain English | 简体中文 Open-AoE is a large-scale, real-world egocentric manipulation dataset collected entirely with consumer smartphones. It provides approximately 2,000 hours of first-person video with synchronized hand motion, camera motion, and bilingual atomic-action annotations. The repository connects those signals to visualization, human-to-robot retargeting, robot replay, and model-specific training recipes. Get the Release Resource Access What you get Technical report Read on…
saved by
related reading
- GitHub - NVlabs/alpamayo-coc-autolabeler: NVIDIA CoC Autolabeler is an open autolabeling pipeline for autonomous vehicles that generates Chain-of-Causation reasoning labels and meta-actions from raw driving clips.github.com
- GitHub - cuevhv/mamma: Official code for MAMMA: Markerless Accurate Multi-person Motion Acquisition.github.com
- GitHub - AmmarkoV/SAM3DBody-cpp: Real-time 3D full-body reconstruction from a single camera, Multiperson BVH output, Pure C++ runtime, ONNX + ggml, 70-joint skeleton with hands.github.com
- [2606.19161] HT-Bench: Benchmarking and Learning Dexterous Full-Hand Tactile Representations with Egocentric Visionarxiv.org
- Kimodo: Scaling Controllable Human Motion Generationresearch.nvidia.com
- GitHub - FusionBrainLab/Vision_GRPOgithub.com
- The Most Densely Annotated Open-Source Egocentric Action Dataset — Human Archiveego500.humanarchive.ai
- Automated Weak-to-Strong Researcheralignment.anthropic.com
- Scalable Behavior Cloning with Open Data, Training, and Evaluationabc.bot
- Humanoid Atlas | Humanoid Robot Supply Chain Map, OEM Database & Industry Analysishumanoids.fyi
- GitHub - awesomedata/awesome-public-datasets: A topic-centric list of HQ open datasets. · GitHubgithub.com
- ABC-130K: The largest open source teleoperation datasetxdof.ai