Adaptive spatial-temporal information processing based on in-memory attention-inspired devices | Nature Communications

Pan et al. report an attention-inspired architecture for adaptive spatial-temporal information processing based on 0D-2D hetero-dimensional interface between MoS2 and Ag filament. Wafer-scale device array is prepared for in-memory analog computing and applied to autonomous driving edge intelligence scenarios.

Download PDF Subjects Electrical and electronic engineering Electronic devices Two-dimensional materials Abstract Spatial-temporal information perception is widely used for motion processing in dynamic scenes, but present technology requires relatively huge hardware resource consumption. The attention mechanism helps the human brain extract required information from tremendous data at a low cost. Here, we propose an attention-inspired artificial intelligence architecture based on hetero-dimensional modulations between zero-dimensional contact and two-dimensional electrostatic interfaces. An ad

saved by

• Sunain Dhingra

related reading

• MoNETA: A Mind Made from Memristors - IEEE Spectrumspectrum.ieee.org
• Overleaf Examplearxiv.org
• NL.pdfabehrouz.github.io
• The Unbearable Slowness of Beingarxiv.org
• [2501.00663] Titans: Learning to Memorize at Test Timearxiv.org
• DeltaNet Explained (Part I) | Songlin Yangsustcsonglin.github.io
• Memory makes computation universal, remember?thinks.lol
• [2012.09852] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruningarxiv.org
• 2502.11089arxiv.org
• Attention-Residuals/Attention_Residuals.pdf at master · MoonshotAI/Attention-Residuals · GitHubgithub.com
• Transformers Inference Optimization Toolset | AstraBlogastralord.github.io
• What is an attention mechanism? | IBMibm.com