Connecting Language to Actions & the World @ CMU



Semester

Course

Spring 2024

11-777 MultiModal Machine Learning

Focus on core techniques and modern advances for integrating different "modalities" into a shared representation or reasoning system. Specifically, these include text, audio, images/videos and action taking.



Previously...

Fall 2023

11-851 Talking to Robots

How do we build models and systems for connecting language to robot control? How can embodiment inform language representations?

Fall 2021, 2022, 2023

11-767 On-Device Machine Learning

Build, train, and deploy models that can run on low-power devices. Covering distillation, quantization, pruning, and power/carbon calculation. The final model produced will have an mAh "budget".

Spring 2021, 2022, 2023

11-777 MultiModal Machine Learning
2021, 2022, 2023

Focus on core techniques and modern advances for integrating different "modalities" into a shared representation or reasoning system. Specifically, these include text, audio, images/videos and action taking.