Frontiers | Natural Image Reconstruction From fMRI Using Deep Learning: A Survey
With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain decoding tasks is the accurate reconstruction of the perceived natural images from brain activities measured by functional magnetic resonance imaging (fMRI). In this work, we survey the most recent deep learning methods for natural image reconstruction from fMRI. We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics and present a fair performance evaluation across standardized evaluation metrics. Finally, we discuss the strengths and limitations of existing studies and present potential future directions.
;import{g as i,s as o,r as s,e as a,a as u,h as l,b as c,i as h,t as f,c as d,d as p,f as m,j as g,k as y,l as b,K as v,_ as w,S as E,m as _,o as C,w as M,n as S,p as O,q as B,u as D,v as I,x as T,y as x,z as R,A as N,U as k,H as F,B as L,C as P,Y as U,D as j,E as q,F as z,G as $,I as V,J as H,L as W,M as G,N as K,O as Z,P as Y,Q as J,R as X,T as Q,V as AA,W as eA,X as tA,Z as rA,$ as nA,a0 as iA,a1 as oA,a2 as sA,a3 as aA,a4 as uA,a5 as lA,a6 as cA,a7 as hA,a8 as fA,a9 as dA,aa as pA,ab as mA,ac as gA,ad as yA,ae as bA,af as vA,ag as wA,ah as EA,ai as _A,aj as CA,ak as MA,al as SA,am as OA,an
Explore this link on the map →related reading
- Frontiers | End-to-End Deep Image Reconstruction From Human Brain Activityfrontiersin.org
- Retrieving and reconstructing conceptually similar images from fMRI with latent diffusion models and a neuro-inspired brain decoding model - IOPscienceiopscience.iop.org
- GitHub - nkmjm/mental_img_recon: Mental image reconstruction from human brain activity · GitHubgithub.com
- Illustrating Reinforcement Learning from Human Feedback (RLHF)huggingface.co
- [2305.18274] Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsarxiv.org
- [2506.06898] NSD-Imagery: A benchmark dataset for extending fMRI vision decoding methods to mental imageryarxiv.org
- Sélection de votre établissementwww-sciencedirect-com.ezproxy.universite-paris-saclay.fr
- Frontiers | Signal Generation, Acquisition, and Processing in Brain Machine Interfaces: A Unified Reviewfrontiersin.org
- Frontiers | Simulating Emotions: An Active Inference Model of Emotional State Inference and Emotion Concept Learningfrontiersin.org
- MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datamedarc-ai.github.io
- Frontiers | Decoding EEG Brain Activity for Multi-Modal Natural Language Processingfrontiersin.org
- Frontiers | The entropic brain: a theory of conscious states informed by neuroimaging research with psychedelic drugsfrontiersin.org