Connecting Language to Actions & the World @ CMU



Semester

Course

Fall 26

Nada, zilch -- Hanging out with my new daughter

Spring 27

Great question, don't know...



Previously...

Fall 23 -- 25

11-851 Talking to Robots

How do we build models and systems for connecting language to robot control? How can embodiment inform language representations?

Spring 2024

11-777 MultiModal Machine Learning

Focus on core techniques and modern advances for integrating different "modalities" into a shared representation or reasoning system. Specifically, these include text, audio, images/videos and action taking.

Fall 21 -- 23

11-767 On-Device Machine Learning

Build, train, and deploy models that can run on low-power devices. Covering distillation, quantization, pruning, and power/carbon calculation. The final model produced will have an mAh "budget".

Spring 21 -- 23

11-777 MultiModal Machine Learning
2021, 2022, 2023

Focus on core techniques and modern advances for integrating different "modalities" into a shared representation or reasoning system. Specifically, these include text, audio, images/videos and action taking.