Jiangyong Huang

I am a Ph.D. student at Peking University (PKU), advised by Prof. Song-Chun Zhu. I major in artificial intelligence (AI) with a primary focus on computer vision (CV). Previously, I graduated and obtained my Bachelor’s degree from PKU in 2022.
I am also a research intern at Beijing Institute for General Artificial Intelligence (BIGAI), where I am affiliated with General Vision Lab and mentored by Dr. Siyuan Huang.
My research interests include multi-modal learning, 3D scene understanding, and embodied AI. My research goal is to develop embodied generalist agents capable of understanding the 3D world and following human instructions to interact with the 3D world.

News

Feb, 2025	`Beacon3D` is accepted by CVPR 2025
Sep, 2024	`MSR3D` is accepted by NeurIPS 2024
May, 2024	`LEO` is accepted by ICML 2024
Mar, 2024	Host ARNOLD Challenge on CVPR 2024 Embodied AI Workshop
Jul, 2023	`ARNOLD` is accepted by ICCV 2023
Sep, 2022	Start my Ph.D. at PKU
Jun, 2022	Graduate and obtain Bachelor’s degree from PKU

Unveiling the Mist over 3D Vision-Language Understanding: Object-centric Evaluation with Chain-of-Analysis

Jiangyong Huang, Baoxiong Jia, Yan Wang, Ziyu Zhu, Xiongkun Linghu, Qing Li, Song-Chun Zhu, and Siyuan Huang
CVPR 2025
Website
Multi-modal Situated Reasoning in 3D Scenes

Xiongkun Linghu*, Jiangyong Huang*, Xuesong Niu*, Xiaojian Ma, Baoxiong Jia, and Siyuan Huang
NeurIPS 2024 (Datasets and Benchmarks Track)
arXiv Website Code
An Embodied Generalist Agent in 3D World

Jiangyong Huang*, Silong Yong*, Xiaojian Ma*, Xiongkun Linghu*, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, and Siyuan Huang
ICML 2024
arXiv Website Code
ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes

Ran Gong*, Jiangyong Huang*, Yizhou Zhao, Haoran Geng, Xiaofeng Gao, Qingyang Wu, Wensi Ai, Ziheng Zhou, Demetri Terzopoulos, Song-Chun Zhu, Baoxiong Jia, and Siyuan Huang
ICCV 2023
arXiv Website Code
Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation

Jiangyong Huang*, William Yicheng Zhu*, Baoxiong Jia, Zan Wang, Xiaojian Ma, Qing Li, and Siyuan Huang
arXiv preprint
arXiv Website Code

2022 - Now	Reviewer for NeurIPS, CVPR, ICLR, ECCV, ICML, AAAI
2021 - Now	Research intern at BIGAI
Fall, 2022 & 2023	TA for Statistical Vision at PKU
Summer, 2022	TA for Directed Research in AI System at PKU
Spring, 2021	Intern at AI Innovation Center, PKU
2019 - 2020	PKU annual scholarship and award
2018 - 2019	PKU annual scholarship and award