Enriching Communication between Humans and AI Agents


Khanh Nguyen

Princeton University
Fri, Oct 7 2022 - 10:00 am (GMT + 7)
About Speaker

Khanh Nguyen is a postdoctoral researcher at Princeton university. His research focuses on the topics of grounded-interactive learning, with the goal of building AI agents that extend human capabilities through natural communication. He has published papers at top-tier conferences in various subfields of AI, including computer vision (CVPR), natural language processing (EMNLP), and core machine learning (ICML). Khanh obtained his Ph.D. degree in Computer Science at the University of Maryland, College Park.


In this talk, I will present new training and evaluation frameworks that enrich communication between humans and AI agents. My work focuses on improving two important capabilities of an agent: (1) the ability to learn from humans through language-based communication and (2) the ability to request and interpret information from humans to make better decisions. To improve the first capability, I propose a learning framework that allows agents to learn from descriptive human language. To enhance the second capability, I introduce new benchmarks that simulate and measure an agent’s ability to actively ask for and interpret information from humans to successfully complete tasks. On these benchmarks, I build agents that are capable of requesting rich, contextually useful information and show that they significantly outperform agents without such capability. I will conclude with a discussion on future directions to endow AI agents with more expressive communication capabilities and models of cognition.

Related seminars

Anh Nguyen

Microsoft GenAI

The Revolution of Small Language Models
Fri, Mar 8 2024 - 02:30 pm (GMT + 7)

Thang D. Bui

Australian National University (ANU)

Recent Progress on Grokking and Probabilistic Federated Learning
Fri, Jan 26 2024 - 10:00 am (GMT + 7)

Tim Baldwin

MBZUAI, The University of Melbourne

Tue, Jan 9 2024 - 10:30 am (GMT + 7)

Quan Vuong

Google DeepMind

Scaling Robot Learning
Wed, Dec 27 2023 - 10:00 am (GMT + 7)