Lecture 1: Introduction to Sequence Prediction | CS 8803 Sequence Prediction

Course materials for CS 8803 Sequence Prediction, Spring 2026 at Georgia Tech.

Lecture 1: Introduction to Sequence Prediction | CS 8803 Sequence Prediction Lecture 1: Introduction to Sequence Prediction Date: January 16, 2026 Topic: Course Intro, Online Learning Basics, Exponential Weights, and the Perceptron 1. Course Overview and Policies Welcome to CS 8803: Sequence Prediction This course explores the theoretical foundations of sequential prediction and decision making. We bridge the gap between classical information theory (Kolmogorov Complexity, Solomonoff Induction) and modern sequence models (Transformers, Diffusion). Logistics Lectures: Fridays (Two sessions per

saved by

• Akash Singirikonda

related reading

• Juergen Schmidhuber's home page - Universal Artificial Intelligence - AI - Deep Learning - Recurrent Neural Networks - Computer Vision - Object Detection - Image segmentation - GANs - Transformers with linearized self-attention - Goedel Macpeople.idsia.ch
• Online Learning: A Comprehensive Surveyarxiv.org
• 1 An Informal Introduction to Intelligencema-lab-berkeley.github.io
• NL.pdfabehrouz.github.io
• The Little Book of Deep Learningfleuret.org
• A Course in Machine Learningciml.info
• ARC progress update: Competing with sampling — LessWronglesswrong.com
• deeplearningbook.org/contents/ml.htmldeeplearningbook.org
• [2109.14412] Apple Tasting Revisited: Bayesian Approaches to Partially Monitored Online Binary Classificationar5iv.labs.arxiv.org
• Guess Again: The Ehrenfeucht-Mycielski Sequence |mathenchant.wordpress.com
• Sequence Modeling with CTCdistill.pub
• [2501.12352] Test-time regression: a unifying framework for designing sequence models with associative memoryar5iv.labs.arxiv.org