[2007.04871] Subject-Aware Contrastive Learning for Biosignals
Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on contrastive learning to model biosignals with a reduced reliance on labeled data and with fewer subjects. In this regime of limited labels and subjects, intersubject variability negatively impacts model performance. Thus, we introduce subject-aware learning through (1) a subject-specific contrastive loss, and (2) an adversarial training to promote subject-invariance during the self-supervised learning. We also develop a number of time-series data augmentation techniques to be used with the contrastive loss for biosignals. Our method is evaluated on publicly available datasets of two different biosignals with different tasks: EEG decoding and ECG anomaly detection. The embeddings learned using self-supervision yield competitive classification results compared to entirely supervised methods. We show that subject-invariance improves representation quality for these tasks, and observe that subject-specific loss increases performance when fine-tuning with supervised labels.
[2007.04871] Subject-Aware Contrastive Learning for Biosignals Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Machine Learning arXiv:2007.04871 (cs) [Submitted on 30 Jun 2020] Title: Subject-Aware Contrastive Learning for Biosignals Authors: Joseph Y. Cheng , Hanlin Goh , Kaan Dogrusoz , Oncel Tuzel , Erdrin Azemi View a PDF of the paper titled Subject-Aware Contrastive Learning for Biosignals, by Joseph Y. Cheng and 4 other authors View PDF Abstract: Datasets for biosignals, such
related reading
- Toward accessible, real-time brain decoding: Introducing ENIGMA | Alljoined Blogalljoined.com
- [2211.02625] MAEEG: Masked Auto-encoder for EEG Representation Learningarxiv.org
- 2310.16532.pdfarxiv.org
- d89a66c7c80a29b1bdbab0f2a1a94af8-Paper.pdfproceedings.neurips.cc
- Decoding Emotion from EEG: Introducing NOVA | Alljoined Blogalljoined.com
- Reconstructing the Mind's Eye: fMRI-to-Image with Contrastive Learning and Diffusion Priorsmedarc-ai.github.io
- Self-supervised learning: The dark matter of intelligenceai.facebook.com
- 2206.14483.pdfarxiv.org
- Thinking about High-Quality Human Data | Lil'Loglilianweng.github.io
- 2306.16934.pdfarxiv.org
- 2206.14483arxiv.org
- Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io