The lab is run by Yonatan Bisk and is housed primarily in the Language Technologies Institute, but includes members from both the Machine Learning Department and the Robotics Institute.
PhD Students
@_Hao_Zhu he/him/他
(co- Graham Neubig)
SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents
SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents
WebArena: A Realistic Web Environment for Building Autonomous Agents
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Computational Language Acquisition with Theory of Mind
Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue
Simulated Language Learning from Communicative Goals and Linguistic Input
Dependency Induction Through the Lens of Visual Perception
Few-shot Language Coordination by Modeling Theory of Mind
The Return of Lexical Dependencies: Neural Lexicalized PCFGs
SOTOPIA-π: Interactive Learning of Socially Intelligent Language Agents
SOTOPIA: Interactive Evaluation for Social Intelligence in Language Agents
WebArena: A Realistic Web Environment for Building Autonomous Agents
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Computational Language Acquisition with Theory of Mind
Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue
Simulated Language Learning from Communicative Goals and Linguistic Input
Dependency Induction Through the Lens of Visual Perception
Few-shot Language Coordination by Modeling Theory of Mind
The Return of Lexical Dependencies: Neural Lexicalized PCFGs
@SoYeonTiffMin she/her
(co- Rus Salakhutdinov)
AgentKit: Flow Engineering with Graphs, not Coding
SPRING: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Self-Supervised Object Goal Navigation with In-Situ Finetuning
Tackling AlfWorld with Action Attention and Common Sense from Language Models
Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue
FILM: Following Instructions in Language with Modular Methods
AgentKit: Flow Engineering with Graphs, not Coding
SPRING: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning
Plan, Eliminate, and Track -- Language Models are Good Teachers for Embodied Agents
EXCALIBUR: Encouraging and Evaluating Embodied Exploration
Self-Supervised Object Goal Navigation with In-Situ Finetuning
Tackling AlfWorld with Action Attention and Common Sense from Language Models
Don't Copy the Teacher: Data and Model Challenges in Embodied Dialogue
FILM: Following Instructions in Language with Modular Methods
@viddivj she/her
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Spatial-Language Attention Policies for Efficient Robot Learning
HomeRobot: Open-Vocabulary Mobile Manipulation
HomeRobot Open Vocab Mobile Manipulation Challenge
MAEA: Multimodal Attribution for Embodied AI
Transformers are Adaptable Task Planners
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis
Open X-Embodiment: Robotic Learning Datasets and RT-X Models
Spatial-Language Attention Policies for Efficient Robot Learning
HomeRobot: Open-Vocabulary Mobile Manipulation
HomeRobot Open Vocab Mobile Manipulation Challenge
MAEA: Multimodal Attribution for Embodied AI
Transformers are Adaptable Task Planners
Masters, Independent Studies, and Visitors
Alumni, Undergraduates, and Visitors
| 2024 | Minyoung Hwang | Intern | → PhD @ MIT | |
| 2022 | Xiang Fan | Undergraduate | → PhD @ UWashington |  |
| 2022 | Andy Liu | Intern | → PhD @ CMU | |
| 2022 | Deogratias Amani | Intern | → | |
| 2022 | Josh Zhanson | MLT | → Data Scientist @ MSFT | |
| 2022 | Xiaoyu (Erin) Zhang | 5th year MS | → PhD @ UIUC | |
| 2021 | Feiyu (Gavin) Zhu | Undergrad | → PhD @ CMU | |
| 2021 | Blessing Bassey | Intern | → | |
| 2021 | Melanie Sclar | Intern | → PhD @ UWashington | |