Connecting Language to Actions & the World @ CMU



Semester

Course

Fall 2023, 2024

11-851 Talking to Robots

How do we build models and systems for connecting language to robot control? How can embodiment inform language representations?

Spring 2024

11-777 MultiModal Machine Learning

Focus on core techniques and modern advances for integrating different "modalities" into a shared representation or reasoning system. Specifically, these include text, audio, images/videos and action taking.



Previously...

Fall '21, '22, '23

11-767 On-Device Machine Learning

Build, train, and deploy models that can run on low-power devices. Covering distillation, quantization, pruning, and power/carbon calculation. The final model produced will have an mAh "budget".

Spring '21, '22, '23

11-777 MultiModal Machine Learning
2021, 2022, 2023

Focus on core techniques and modern advances for integrating different "modalities" into a shared representation or reasoning system. Specifically, these include text, audio, images/videos and action taking.