CS Peer Talk | Building Embodied 3D Foundation Models

第三十八期

报告人：Yining Hong, UCLA

时间：1月8日（星期一）3:00pm

地点：静园五院204

报告信息

Title

Building Embodied 3D Foundation Models

Abstract

Powerful as recent large language models and vision language models can be, these models are not grounded in the 3D physical world like human beings, let alone explore and interact within the richer realm of 3D embodied environments. Yining Hong’s work emphasizes the development of 3D embodied foundation models, dedicated to building general-purpose embodied agents that could actively explore and interact with the 3D physical world, and perform common sense reasoning within the embodied environment. These models facilitate dynamic interactions with 3D spaces, incorporating essential embodied concepts such as spatial relationships, affordances, physics, layout, multisensory learning and so on. Yining Hong’s research specifically emphasizes on three critical perspectives in building such generalist embodied agents: Building 3D world models; embodied foundation models and common sense reasoning.

Biography

Yining Hong is a fourth-year PhD candidate in UCLA and a research member at MIT-IBM Watson AI Lab, supervised by Prof. Chuang Gan, Prof. Song-Chun Zhu and Prof. Ying-Nian Wu. She obtained her bachelor degree in Shanghai Jiao Tong University under the supervision of Prof. Xinbing Wang and Prof. Weinan Zhang. Her research interests include embodied AI, 3D large language models and machine reasoning. She has published multiple first-authored papers in NeurIPS, CVPR, ICCV, AAAI and so on. She was the recipient of Baidu Scholarship 2022.

about CS Peer Talk

作为活动的发起人，我们来自北京大学图灵班科研活动委员会，主要由图灵班各年级同学组成。我们希望搭建一个CS同学交流的平台，促进同学间的交流合作，帮助同学练习展示，同时增进友谊。

目前在计划中的系列包括但不限于：

• 教程系列：学生讲者为主，介绍自己的研究领域

• 研究系列：学生讲者为主，介绍自己的研究成果

• 客座系列：邀请老师做主题报告

除非报告人特别要求，报告默认是非公开的，希望营造一个自由放松但又互相激励的交流氛围。

主讲嘉宾招募

如果你愿意和大家分享你的学术成果、经历经验，总结回顾、触发新思，欢迎报名自荐。

主讲人报名：发邮件至 cs_research_tc@163.com，写明想讲的题目、内容及时间。

北京大学图灵班科研活动委员会

—   版权声明  —

本微信公众号所有内容，由北京大学前沿计算研究中心微信自身创作、收集的文字、图片和音视频资料，版权属北京大学前沿计算研究中心微信所有；从公开渠道收集、整理及授权转载的文字、图片和音视频资料，版权属原作者。本公众号内容原作者如不愿意在本号刊登内容，请及时通知本号，予以删除。