A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence | Nature Neuroscience

The authors measured high-resolution fMRI activity from eight individuals who saw and memorized thousands of annotated natural images over 1 year. This massive dataset enables new paths of inquiry in cognitive neuroscience and artificial intelligence.

Subjects Cortex Neural encoding Object vision Perception Abstract Extensive sampling of neural activity during rich cognitive phenomena is critical for robust understanding of brain function. Here we present the Natural Scenes Dataset (NSD), in which high-resolution functional magnetic resonance imaging responses to tens of thousands of richly annotated natural scenes were measured while participants performed a continuous recognition task. To optimize data quality, we developed and applied novel estimation and denoising techniques. Simple visual inspections of the NSD data reveal clear repres

related reading

• [2506.06898] NSD-Imagery: A benchmark dataset for extending fMRI vision decoding methods to mental imageryarxiv.org
• Retrieving and reconstructing conceptually similar images from fMRI with latent diffusion models and a neuro-inspired brain decoding model - IOPscienceiopscience.iop.org
• MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datamedarc-ai.github.io
• GitHub - nkmjm/mental_img_recon: Mental image reconstruction from human brain activity · GitHubgithub.com
• High-level visual representations in the human brain are aligned with large language models | Nature Machine Intelligencenature.com
• THINGS-data, a multimodal collection of large-scale datasets for investigating object representations in human brain and behavior | eLifeelifesciences.org
• Triple-N Dataset: Non-human Primate Neural Responses to Natural Scenes | bioRxivbiorxiv.org
• Feature Visualizationdistill.pub
• [2305.18274] Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsarxiv.org
• POYO-1poyo-brain.github.io
• Sélection de votre établissementwww-sciencedirect-com.ezproxy.universite-paris-saclay.fr
• Frontiers | End-to-End Deep Image Reconstruction From Human Brain Activityfrontiersin.org