Jiangyong Huang

PKU & BIGAI, Beijing, China

prof_pic.jpg

  • Currently, I am a Ph.D. student at Peking University (PKU), majoring in artificial intelligence (AI) and focusing on computer vision (CV), advised by Prof. Song-Chun Zhu. Previously, I graduated and obtained my Bachelor’s degree from PKU in 2022.

  • Meanwhile, I am also a long-term research intern at Beijing Institute for General Artificial Intelligence (BIGAI), where I am affiliated with General Vision Lab and instructed by Siyuan Huang. There I conduct research on vision-based topics covering various domains, e.g., language, reasoning, robotics.

  • My research interests include general-purpose vision, multi-modal learning, representation learning, statistical models, world models, etc. My recent focus is on endowing embodied agents with the capabilities of grounding and following human instructions.

News

Sep, 2022 Start my Ph.D. at PKU
Jun, 2022 Graduate and obtain my Bachelor’s degree from PKU
Aug, 2021 Start my research internship at BIGAI

Publications

  1. ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
    Ran Gong*, Jiangyong Huang*, Yizhou Zhao, Haoran Geng, Xiaofeng Gao, Qingyang Wu, Wensi Ai, Ziheng Zhou, Demetri Terzopoulos, Song-Chun Zhu, and 2 more authors
    arXiv preprint arXiv:2304.04321 2023
    arXiv Website Code
  2. Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
    Jiangyong Huang*, William Yicheng Zhu*, Baoxiong Jia, Zan Wang, Xiaojian Ma, Qing Li, and Siyuan Huang
    arXiv preprint arXiv:2211.15402 2022
    arXiv Website Code

Experiences

2021 - Now Research intern at BIGAI
2022 - Now Reviewer for NeurIPS, CVPR
Fall, 2022 TA for Statistical Vision at PKU
Summer, 2022 TA for Directed Research in AI System at PKU
Spring, 2021 Intern at AI Innovation Center, PKU
2018 - 2020 Received the PKU annual scholarship and award twice