cs.unc.edu/~mbansal/teaching/nlp-comp790-590-spring23.html
Instructor: Mohit Bansal Units: 3 Lectures: Wed 11am-1.30pm ET, Room SN-115 Office Hours: Wed 1:30pm-2:15pm ET (by appointment) (remote/zoom option) Course Webpage: https://www.cs.unc.edu/~mbansal/teaching/nlp-comp790-590-spring23.html Course Email: nlpcomp790unc -at- gmail.com This course will be based on the connections between the fields of natural language processing (NLP) and its important multimodal connections to computer vision and robotics; it will cover a wide variety of topics in the area of multimodal-NLP such as image/video-based captioning, retrieval, QA, and dialogue; vision+language commonsense; query-based video summarization; text-to-image/video generation; robotic navigation + manipulation instruction execution and generation; unified multimodal and embodied pretraining models (as well as ethics/bias/societal applications + issues). Topics Grading will (tentatively) consist of: For NLP concepts refresher, see: For multimodal NLP concepts, see corresponding lectures
COMP 790/590: Connecting Language to Vision and Robotics (Spring 2023) Instructor: Mohit Bansal Units: 3 Lectures: Wed 11am-1.30pm ET, Room SN-115 Office Hours: Wed 1:30pm-2:15pm ET (by appointment) (remote/zoom option) Course Webpage: https://www.cs.unc.edu/~mbansal/teaching/nlp-comp790-590-spring23.html Course Email: nlpcomp790unc -at- gmail.com Introduction This course will be based on the connections between the fields of natural language processing (NLP) and its important multimodal connections to computer vision and robotics; it will cover a wide variety of topics in the area of multimod
saved by
related reading
- [CVPR2023 Tutorial Talk] Large Multimodal Models: Towards Building and Surpassing Multimodal GPT-4youtube.com
- Advanced Topics in Natural Language Processingblender.cs.illinois.edu
- Stanford CS336 | Language Modeling from Scratchcs336.stanford.edu
- VS265: Neural Computation - Fall 2024 - Redwood Center for Theoretical Neuroscienceredwood.berkeley.edu
- CS 294-277, Robots That Learn (Spring 2026)robots-that-learn.github.io
- 6.S898 Deep Learning, Fall 2023phillipi.github.io
- CS124 - From Languages to Information (Winter 2026)web.stanford.edu
- Computer Vision and Geometry Group | Robot Learningcvg.ethz.ch
- Stanford CS25: Transformers United V6 I Overview of Transformersyoutube.com
- 2403.09611.pdfarxiv.org
- MIT6.S192: Deep Creativityali-design.github.io
- MAS.S60 How2AI | Schedulemit-mi.github.io