Jiangyong Huang

PKU & BIGAI, Beijing, China

prof_pic.jpg

  • I am a Ph.D. student at Peking University (PKU), advised by Prof. Song-Chun Zhu. I major in artificial intelligence (AI) with a primary focus on computer vision (CV). Previously, I graduated and obtained my Bachelor’s degree from PKU in 2022.

  • I am also a long-term research intern at Beijing Institute for General Artificial Intelligence (BIGAI), affiliated with General Vision Lab and mentored by Dr. Siyuan Huang.

  • My research interests include general-purpose vision, multi-modal learning, scene understanding, embodied AI, etc. Currently I am working on embodied generalist agents that can understand 3D scenes and human instructions, and follow instructions to interact with the 3D world.

News

Sep, 2024 MSR3D accepted by NeurIPS 2024
May, 2024 LEO accepted by ICML 2024
Mar, 2024 Host ARNOLD Challenge on CVPR 2024 Embodied AI Workshop
Jul, 2023 ARNOLD accepted by ICCV 2023
Sep, 2022 Start my Ph.D. at PKU
Jun, 2022 Graduate and obtain my Bachelor’s degree from PKU
Aug, 2021 Start my research internship at BIGAI

Publications

  1. Multi-modal Situated Reasoning in 3D Scenes
    Xiongkun Linghu*, Jiangyong Huang*, Xuesong Niu*, Xiaojian Ma, Baoxiong Jia, and Siyuan Huang
    NeurIPS 2024 (Datasets and Benchmarks Track)
    arXiv Website Code
  2. An Embodied Generalist Agent in 3D World
    Jiangyong Huang*, Silong Yong*, Xiaojian Ma*, Xiongkun Linghu*, Puhao Li, Yan Wang, Qing Li, Song-Chun Zhu, Baoxiong Jia, and Siyuan Huang
    ICML 2024, ICLR 2024 Workshop AGI & LLMAgents & GenAI4DM
    arXiv Website Code
  3. ARNOLD: A Benchmark for Language-Grounded Task Learning With Continuous States in Realistic 3D Scenes
    Ran Gong*, Jiangyong Huang*, Yizhou Zhao, Haoran Geng, Xiaofeng Gao, Qingyang Wu, Wensi Ai, Ziheng Zhou, Demetri Terzopoulos, Song-Chun Zhu, Baoxiong Jia, and Siyuan Huang
    ICCV 2023, CoRL 2022 Workshop LangRob Spotlight
    arXiv Website Code
  4. Perceive, Ground, Reason, and Act: A Benchmark for General-purpose Visual Representation
    Jiangyong Huang*, William Yicheng Zhu*, Baoxiong Jia, Zan Wang, Xiaojian Ma, Qing Li, and Siyuan Huang
    arXiv preprint arXiv: 2211.15402
    arXiv Website Code

Experiences

2022 - Now Reviewer for NeurIPS, CVPR, ICLR, ECCV, ICML, AAAI
2021 - Now Research intern at BIGAI
Fall, 2022 & 2023 TA for Statistical Vision at PKU
Summer, 2022 TA for Directed Research in AI System at PKU
Spring, 2021 Intern at AI Innovation Center, PKU
2019 - 2020 PKU annual scholarship and award
2018 - 2019 PKU annual scholarship and award