Formal Theory of Creativity and Fun and Intrinsic Motivation Explains Science, Art, Music, Humor (Juergen Schmidhuber). Artificial Scientists, Artificial Artists, Developmental Robotics, Curiosity, Attention, Surprise, Novelty, Discovery, Open-Ended Learning, Formal Theory of Beauty, Creating Novel Patters

Since 1990 JS has built curious, creative agents that may be viewed as simple artificial scientists & artists with an intrinsic desire to explore the world by continually inventing new experiments. They never stop generating novel & surprising stuff, and consist of two learning modules: (A) an adaptive predictor or compressor or model of the growing data history as the agent is interacting with its environment, and (B) a general reinforcement learner (RL) selecting the actions that shape the history. The learning progress of (A) can be precisely measured and is the agent's fun: the intrinsic reward of (B). That is, (B) is motivated to learn to invent interesting things that (A) does not yet know but can easily learn. To maximize future expected reward, in the absence of external reward such as food, (B) learns more and more complex behaviors that yield initially surprising (but eventually boring) novel patterns that make (A) quickly improve. Many papers on this since 1990 can be found

Formal Theory of Creativity and Fun and Intrinsic Motivation Explains Science, Art, Music, Humor (Juergen Schmidhuber). Artificial Scientists, Artificial Artists, Developmental Robotics, Curiosity, Attention, Surprise, Novelty, Discovery, Open-Ended Learning, Formal Theory of Beauty, Creating Novel Patters . . . Formal Theory of Creativity & Fun & Intrinsic Motivation (1990-2010) by Jürgen Schmidhuber Since 1990 JS has built curious, creative agents that may be viewed as simple artificial scientists & artists with an intrinsic desire to explore the world by continually inventing new exper

saved by

• Svitlana Midianko
• Yoyo Yuan

related reading

• Driven by Compression Progress: A Simple Principle Explains Essential Aspects of Subjective Beauty, Novelty, Surprise, Interestingness, Attention, Curiosity, Creativity, Art, Science, Music, Jokesarxiv.org
• Juergen Schmidhuber's home page - Universal Artificial Intelligence - AI - Deep Learning - Recurrent Neural Networks - Computer Vision - Object Detection - Image segmentation - GANs - Transformers with linearized self-attention - Goedel Macpeople.idsia.ch
• 0812.4360arxiv.org
• 0812.4360.pdfarxiv.org
• The Shard Theory of Human Valuesturntrout.com
• Formal Theory of Creativity, Fun, and Intrinsic Motivation (1990–2010) | IEEE Journals & Magazine | IEEE Xploreieeexplore.ieee.org
• Metalearning or Learning to Learn Since 1987people.idsia.ch
• pdfopenreview.net
• The shard theory of human values — LessWronglesswrong.com
• Complex behavior from intrinsic motivation to occupy future action-state path spacenature.com
• Prolegomena to a Theory of Fun — LessWronglesswrong.com
• The Fun Theory Sequence — LessWronglesswrong.com