Frontiers | Natural Image Reconstruction From fMRI Using Deep Learning: A Survey
With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain decoding tasks is the accurate reconstruction of the perceived natural images from brain activities measured by functional magnetic resonance imaging (fMRI). In this work, we survey the most recent deep learning methods for natural image reconstruction from fMRI. We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics and present a fair performance evaluation across standardized evaluation metrics. Finally, we discuss the strengths and limitations of existing studies and present potential future directions.
;import{g as i,s as o,r as s,e as a,a as u,h as l,b as c,i as h,t as f,c as d,d as p,f as m,j as g,k as y,l as b,K as v,_ as w,S as E,m as _,o as C,w as M,n as S,p as O,q as B,u as D,v as I,x as T,y as x,z as R,A as N,U as k,H as F,B as L,C as P,Y as U,D as j,E as q,F as z,G as $,I as V,J as H,L as W,M as G,N as K,O as Z,P as Y,Q as J,R as X,T as Q,V as AA,W as eA,X as tA,Z as rA,$ as nA,a0 as iA,a1 as oA,a2 as sA,a3 as aA,a4 as uA,a5 as lA,a6 as cA,a7 as hA,a8 as fA,a9 as dA,aa as pA,ab as mA,ac as gA,ad as yA,ae as bA,af as vA,ag as wA,ah as EA,ai as _A,aj as CA,ak as MA,al as SA,am as OA,an
related reading
- Frontiers | End-to-End Deep Image Reconstruction From Human Brain Activityfrontiersin.org
- AI to Interpret Your Mindjonathanxu.com
- Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsmedarc-ai.github.io
- [2305.18274] Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsarxiv.org
- Retrieving and reconstructing conceptually similar images from fMRI with latent diffusion models and a neuro-inspired brain decoding model - IOPscienceiopscience.iop.org
- GitHub - nkmjm/mental_img_recon: Mental image reconstruction from human brain activity · GitHubgithub.com
- Illustrating Reinforcement Learning from Human Feedback (RLHF)huggingface.co
- [2506.06898] NSD-Imagery: A benchmark dataset for extending fMRI vision decoding methods to mental imageryarxiv.org
- MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datamedarc-ai.github.io
- Sélection de votre établissementwww-sciencedirect-com.ezproxy.universite-paris-saclay.fr
- Semantic reconstruction of continuous language from non-invasive brain recordings | Nature Neurosciencenature.com
- Frontiers | Signal Generation, Acquisition, and Processing in Brain Machine Interfaces: A Unified Reviewfrontiersin.org