[0812.4360] Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokes
I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once he learns to predict or compress the data in a better way, thus making it subjectively simpler and more beautiful. Curiosity is the desire to create or discover more non-random, non-arbitrary, regular data that is novel and surprising not in the traditional sense of Boltzmann and Shannon but in the sense that it allows for compression progress because its regularity was not yet known. This drive maximizes interestingness, the first derivative of subjective beauty or compressibility, that is, the steepness of the learning curve. It motivates exploring infants, pure mathematicians, composers, artists, dancers, comedians, yourself, and (since 1990) artificial systems.
View PDF HTML (experimental) Abstract: I argue that data becomes temporarily interesting by itself to some self-improving, but computationally limited, subjective observer once he learns to predict or compress the data in a better way, thus making it subjectively simpler and more beautiful. Curiosity is the desire to create or discover more non-random, non-arbitrary, regular data that is novel and surprising not in the traditional sense of Boltzmann and Shannon but in the sense that it allows for compression progress because its regularity was not yet known. This drive maximizes…
saved by
related reading
- Formal Theory of Creativity and Fun and Intrinsic Motivation Explains Science, Art, Music, Humor (Juergen Schmidhuber). Artificial Scientists, Artificial Artists, Developmental Robotics, Curiosity, Attention, Surprise, Novelty, Discovery, Opeople.idsia.ch
- 0812.4360.pdfarxiv.org
- 0812.4360arxiv.org
- - YouTubeyoutube.com
- Nabeel S. Qureshi | Substacknabeelqu.substack.com
- The Bus Ticket Theory of Geniuspaulgraham.com
- The Bus Ticket Theory of Geniuspaulgraham.com
- 500'000€ Prize for Compressing Human Knowledgeprize.hutter1.net
- Musical beauty and information compression: Complex to the ear but simple to the mind? | BMC Research Notes | Springer Nature Linkbmcresnotes.biomedcentral.com
- The Bus Ticket Theory of Geniuspaulgraham.com
- Juergen Schmidhuber's home page - Universal Artificial Intelligence - AI - Deep Learning - Recurrent Neural Networks - Computer Vision - Object Detection - Image segmentation - GANs - Transformers with linearized self-attention - Goedel Macpeople.idsia.ch
- Data Compression Explainedmattmahoney.net