Frontiers | Natural Image Reconstruction From fMRI Using Deep Learning: A Survey
With the advent of brain imaging techniques and machine learning tools, much effort has been devoted to building computational models to capture the encoding of visual information in the human brain. One of the most challenging brain decoding tasks is the accurate reconstruction of the perceived natural images from brain activities measured by functional magnetic resonance imaging (fMRI). In this work, we survey the most recent deep learning methods for natural image reconstruction from fMRI. We examine these methods in terms of architectural design, benchmark datasets, and evaluation metrics and present a fair performance evaluation across standardized evaluation metrics. Finally, we discuss the strengths and limitations of existing studies and present potential future directions.
;import{g as i,s as o,r as s,e as a,a as u,h as l,b as c,i as h,t as f,c as d,d as p,f as m,j as g,k as y,l as b,K as v,_ as w,S as E,m as _,o as C,w as M,n as S,p as O,q as B,u as D,v as I,x as T,y as x,z as R,A as N,U as k,H as F,B as L,C as P,Y as U,D as j,E as q,F as z,G as $,I as V,J as H,L as W,M as G,N as K,O as Z,P as Y,Q as J,R as X,T as Q,V as AA,W as eA,X as tA,Z as rA,$ as nA,a0 as iA,a1 as oA,a2 as sA,a3 as aA,a4 as uA,a5 as lA,a6 as cA,a7 as hA,a8 as fA,a9 as dA,aa as pA,ab as mA,ac as gA,ad as yA,ae as bA,af as vA,ag as wA,ah as EA,ai as _A,aj as CA,ak as MA,al as SA,am as OA,an
related reading
- Frontiers | End-to-End Deep Image Reconstruction From Human Brain Activityfrontiersin.org
- Frontiers | Decoding EEG Brain Activity for Multi-Modal Natural Language Processingfrontiersin.org
- Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsmedarc-ai.github.io
- [2305.18274] Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsarxiv.org
- AI to Interpret Your Mindjonathanxu.com
- Frontiers | Feature Extraction and Classification Methods for Hybrid fNIRS-EEG Brain-Computer Interfacesfrontiersin.org
- Retrieving and reconstructing conceptually similar images from fMRI with latent diffusion models and a neuro-inspired brain decoding model - IOPscienceiopscience.iop.org
- Semantic reconstruction of continuous language from non-invasive brain recordings | Nature Neurosciencenature.com
- Frontiers | Simulating Emotions: An Active Inference Model of Emotional State Inference and Emotion Concept Learningfrontiersin.org
- Frontiers | The Defensive Activation Theory: REM Sleep as a Mechanism to Prevent Takeover of the Visual Cortexfrontiersin.org
- MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datamedarc-ai.github.io
- Frontiers | Physical principles for scalable neural recordingfrontiersin.org