deeplearningbook.org/contents/prob.html
Chapter 3 Probability and Information Theory In this chapter, we describe probability theory and information theory. Probability theory is a mathematical framework for representing uncertain statements. It provides a means of quantifying uncertainty as well as axioms for deriving new uncertain statements. In artificial intelligence applications, we use probability theory in two major ways. First, the laws of probability tell us how AI systems should reason, so we design our algorithms to compute or approximate various expressions derived using probability theory. Second, we can use probability and statistics to theoretically analyze the behavior of proposed AI systems. Probability theory is a fundamental tool of many disciplines of science and engineering. We provide this chapter to ensure that readers whose background is primarily in software engineering, with limited exposure to probability theory, can understand the material in this book. While probability theory allows us to make un
Chapter 3 Probability and Information Theory In this chapter, we describe probability theory and information theory. Probability theory is a mathematical framework for representing uncertain statements. It provides a means of quantifying uncertainty as well as axioms for deriving new uncertain statements. In artificial intelligence applications, we use probability theory in two major ways. First, the laws of probability tell us how AI systems should reason, so we design our algorithms to compute or approximate various expressions derived using probability theory. Second, we can use…
saved by
related reading
- Visual Information Theory -- colah's blogcolah.github.io
- Interpretations of Probability (Stanford Encyclopedia of Philosophy)plato.stanford.edu
- Economics Dictionary of Argumentsphilosophy-science-humanities-controversies.com
- 275A, Notes 0: Foundations of probability theory | What's newterrytao.wordpress.com
- Probability theory, understood meta-rationallymeaningness.substack.com
- A Mathematical Theory of Communicationpeople.math.harvard.edu
- Interpretations of Probability (Stanford Encyclopedia of Philosophy)plato.stanford.edu
- Introduction to Probability by Joseph K. Blitzstein, Jessica Hwang (z-lib.org).pdfuni.dcdev.ro
- 254A, Notes 0: A review of probability theory | What's newterrytao.wordpress.com
- Seeing Theoryseeing-theory.brown.edu
- [2206.07867] A visual introduction to information theoryarxiv.org
- 275A, Notes 0: Foundations of probability theory | What's newterrytao.wordpress.com