[2007.04871] Subject-Aware Contrastive Learning for Biosignals
Datasets for biosignals, such as electroencephalogram (EEG) and electrocardiogram (ECG), often have noisy labels and have limited number of subjects (<100). To handle these challenges, we propose a self-supervised approach based on contrastive learning to model biosignals with a reduced reliance on labeled data and with fewer subjects. In this regime of limited labels and subjects, intersubject variability negatively impacts model performance. Thus, we introduce subject-aware learning through (1) a subject-specific contrastive loss, and (2) an adversarial training to promote subject-invariance during the self-supervised learning. We also develop a number of time-series data augmentation techniques to be used with the contrastive loss for biosignals. Our method is evaluated on publicly available datasets of two different biosignals with different tasks: EEG decoding and ECG anomaly detection. The embeddings learned using self-supervision yield competitive classification results compared to entirely supervised methods. We show that subject-invariance improves representation quality for these tasks, and observe that subject-specific loss increases performance when fine-tuning with supervised labels.
[2007.04871] Subject-Aware Contrastive Learning for Biosignals Skip to main content arXiv is now an independent nonprofit! Learn more × Search arXiv Press Enter to search · Advanced search --> Computer Science > Machine Learning arXiv:2007.04871 (cs) [Submitted on 30 Jun 2020] Title: Subject-Aware Contrastive Learning for Biosignals Authors: Joseph Y. Cheng , Hanlin Goh , Kaan Dogrusoz , Oncel Tuzel , Erdrin Azemi View a PDF of the paper titled Subject-Aware Contrastive Learning for Biosignals, by Joseph Y. Cheng and 4 other authors View PDF Abstract: Datasets for biosignals, such
Explore this link on the map →related reading
- [2211.02625] MAEEG: Masked Auto-encoder for EEG Representation Learningarxiv.org
- Gap Mapgap-map.org
- Contrastive Representation Learning | Lil'Loglilianweng.github.io
- Learning with not Enough Data Part 1: Semi-Supervised Learning | Lil'Loglilianweng.github.io
- Untangling the Moons: A Visual History of Contrastive Learningtahabouhsine.com
- Using Interpretability to Identify a Novel Class of Alzheimer's Biomarkersgoodfire.ai
- Understanding self-supervised and contrastive learning with "Bootstrap Your Own Latent" (BYOL) - Imbueimbue.com
- Self-Supervised Learning Advances Medical Image Classificationai.googleblog.com
- Zyphrazyphra.com
- [2002.05709] A Simple Framework for Contrastive Learning of Visual Representationsarxiv.org
- Self-Supervised Representation Learning | Lil'Loglilianweng.github.io
- Self-supervised learning - Wikipediaen.wikipedia.org