Transformer Transformer: A Unified Model for Motion-Conditioned Robot Co-design
transformer-transformer.github.io · 2,707 words · saved by 5 readers
Transformer Transformer: A Unified Model for Motion-Conditioned Robot Co-design. Project website.
Transformer Transformer Huy Ha, Karen Liu, Shuran Song Conference on Robot Learning 2026 Not all robots are created equal Not all robots are created equal — but what if you could design one for a specific task? We propose Transformer Transformer, a unified model that does exactly this: hand it a manipulation demonstration, and it generates a complete robot — every link, joint, motor, and inertial property — optimized for that motion. We fabricated one such design for cloth flinging on an ALOHA2 bimanual platform; it reduced tracking error by 73% and max joint speed by 30% versus the…
saved by
related reading
- Towards Machines with a Thousand Hands - Generalist AIgeneralistai.com
- Differentiable Robot Renderingdrrobot.cs.columbia.edu
- How Claude Performs on Robotics Tasks \ Anthropicanthropic.com
- A Steerable Model with Emergent Capabilitiespi.website
- Animesh Gargscholar.google.com
- Explore | alphaXivalphaxiv.org
- How Can We Make Robotics More like Generative Modeling? | Eric Jangevjang.com
- Takeaways from DeepMind's RoboCat Paperevjang.com
- GEN-1.5: Embodied Foundation Models are One-Shot Learners - Generalist AIgeneralistai.com
- Open X-Embodiment: Robotic Learning Datasets and RT-X Modelsarxiv.org
- ERCEIVER-ACTOR: A Multi-Task Transformer for Robotic Manipulationarxiv.org
- Generating Robot Hands from Human Demonstrationsarxiv.org