[1904.12320] Real numbers, data science and chaos: How to fit any dataset with a single parameter
We show how any dataset of any modality (time-series, images, sound...) can be approximated by a well-behaved (continuous, differentiable...) scalar function with a single real-valued parameter. Building upon elementary concepts from chaos theory, we adopt a pedagogical approach demonstrating how to adjust this parameter in order to achieve arbitrary precision fit to all samples of the data. Targeting an audience of data scientists with a taste for the curious and unusual, the results presented here expand on previous similar observations regarding expressiveness power and generalization of machine learning models.
We show how any dataset of any modality (time-series, images, sound...) can be approximated by a well-behaved (continuous, differentiable...) scalar function with a single real-valued parameter. Building upon elementary concepts from chaos theory, we adopt a pedagogical approach demonstrating how to adjust this parameter in order to achieve arbitrary precision fit to all samples of the data. Targeting an audience of data scientists with a taste for the curious and unusual, the results presented here expand on previous similar observations regarding expressiveness power and generalization of ma
Explore this link on the map →related reading
- What's new | Updates on my research and expository papers, discussion of open problems, and other maths-related topics. By Terence Taoterrytao.wordpress.com
- Zipfian grokking | Jasper Gilleyjagilley.github.io
- GitHub - google-research/tuning_playbook: A playbook for systematically maximizing the performance of deep learning models. · GitHubgithub.com
- deeplearningbook.org/contents/ml.htmldeeplearningbook.org
- Go smol or go home | Harm de Vriesharmdevries.com
- arxiv.org/pdf/1805.08522arxiv.org
- ML Contestsmlcontests.com
- 3.6. Generalization — Dive into Deep Learning 1.0.3 documentationd2l.ai
- Time Series - From Analyzing the Past to Predicting the Future | Towards Data Sciencetowardsdatascience.com
- Forecasting: Principles and Practice (2nd ed)otexts.com
- Khoa học dữ liệuphamdinhkhanh.github.io
- A Course in Machine Learningciml.info