[1703.05463] Using Human Brain Activity to Guide Machine Learning
Machine learning is a field of computer science that builds algorithms that learn. In many cases, machine learning algorithms are used to recreate a human ability like adding a caption to a photo, driving a car, or playing a game. While the human brain has long served as a source of inspiration for machine learning, little effort has been made to directly use data collected from working brains as a guide for machine learning algorithms. Here we demonstrate a new paradigm of "neurally-weighted" machine learning, which takes fMRI measurements of human brain activity from subjects viewing images, and infuses these data into the training process of an object recognition learning algorithm to make it more consistent with the human brain. After training, these neurally-weighted classifiers are able to classify images without requiring any additional neural data. We show that our neural-weighting approach can lead to large performance gains when used with traditional machine vision features, as well as to significant improvements with already high-performing convolutional neural network features. The effectiveness of this approach points to a path forward for a new class of hybrid machine learning algorithms which take both inspiration and direct constraints from neuronal data.
[1703.05463] Using Human Brain Activity to Guide Machine Learning --> Computer Science > Computer Vision and Pattern Recognition arXiv:1703.05463 (cs) [Submitted on 16 Mar 2017 ( v1 ), last revised 19 Sep 2017 (this version, v2)] Title: Using Human Brain Activity to Guide Machine Learning Authors: Ruth Fong , Walter Scheirer , David Cox View a PDF of the paper titled Using Human Brain Activity to Guide Machine Learning, by Ruth Fong and 2 other authors View PDF Abstract: Machine learning is a field of computer science that builds algorithms that learn. In many cases, machine learning algorithm
Explore this link on the map →saved by
related reading
- Zoom In: An Introduction to Circuitsdistill.pub
- GitHub - nkmjm/mental_img_recon: Mental image reconstruction from human brain activity · GitHubgithub.com
- Distill — Latest articles about machine learningdistill.pub
- Neural networks and deep learningneuralnetworksanddeeplearning.com
- Machine learning - Wikipediaen.wikipedia.org
- Sélection de votre établissementwww-sciencedirect-com.ezproxy.universite-paris-saclay.fr
- [2305.18274] Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsarxiv.org
- Building machines that learn and think like people | Behavioral and Brain Sciences | Cambridge Corecambridge.org
- Frontiers | End-to-End Deep Image Reconstruction From Human Brain Activityfrontiersin.org
- MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Datamedarc-ai.github.io
- Continuous Thought Machinespub.sakana.ai
- Retrieving and reconstructing conceptually similar images from fMRI with latent diffusion models and a neuro-inspired brain decoding model - IOPscienceiopscience.iop.org