GelNeuro: A Sensing-Computing Integrated Neuromorphic Tactile System for Texture Recognition
Neuromorphic visuo-tactile sensing offers a promising paradigm for low-latency and low-power robotic perception. However, existing systems still rely heavily on a host computer for event readout, preprocessing, or relaying prior to chip inference. This paper presents GelNeuro, a fully integrated sensing-computing visuo-tactile system that directly pairs a GelSight Mini-based optical tactile front end with the Speck2f neuromorphic system-on-chip (SoC). Contact-induced marker motions are captured as dynamic vision sensor (DVS) events and routed through the on-chip network to a spiking convolutional neural network (SCNN) classifier. To mitigate accuracy degradation during 8-bit deployment, a hardware-aware weight clamping strategy is introduced. Evaluated on a 15-class natural texture recognition task, hardware-in-the-loop testing on the physical chip achieves a 96.3% accuracy within an 80 ms inference window. Notably, the system consumes only 19.6 mW of board-level active power-over thre
Xinpan Meng Zhenghua Ma Houcheng Li Long Cheng ††thanks: This work was supported in part by the Brain Science and Brain-like Intelligence Technology - National Science and Technology Major Project under Grant 2025ZD0215600, in part by the National Natural Science Foundation of China under Grant U25A20475, in part by the Beijing Municipal Natural Science Foundation under Grants F2024201068, L243014 and L232140, in part by Young Scientists Fund of The State Key Laboratory of Multimodal Artificial Intelligence Systems under Grant ES2P100114, and in part by the Fundamental Research Funds for…
saved by
related reading
- FORTE: Tactile Force and Slip Sensing on Compliant Fingers for Delicate Manipulationarxiv.org
- PLATO Hand: Shaping Contact Behavior with Fingernails for Precise Manipulationplatohand.github.io
- When Models Manipulate Manifolds: The Geometry of a Counting Tasktransformer-circuits.pub
- Could a Neuroscientist Understand a Microprocessor? | PLOS Computational Biologyjournals.plos.org
- An underleveraged modality in neuroscience | Abhi Upadhyayaxu.sh
- OSMO: Open-Source Tactile Glove for Human-to-Robot Skill Transferarxiv.org
- Soft Robotic Link with Controllable Transparency for Vision-based Tactile and Proximity Sensingquan-luu.github.io
- [2606.19161] HT-Bench: Benchmarking and Learning Dexterous Full-Hand Tactile Representations with Egocentric Visionarxiv.org
- Tiny TPUtinytpu.com
- Robot Synesthesia: In-Hand Manipulation with Visuotactile Sensingarxiv.org
- A Million Spiking-Neuron Integrated Circuit with a Scalable Communication Network and Interfacepaulmerolla.com
- A brain-computer interface that evokes tactile sensations improves robotic arm control - PMCncbi.nlm.nih.gov