prof_pic.jpg

Hang Ye

I am a third-year Ph.D. student in Computer Science at Center on Frontiers of Computing Studies, Peking University. I am a member of the Computer Vision and Digital Art Lab, advised by Prof. Yizhou Wang. I received my Bachelor's degree in Artificial Intelligence from Peking University in 2023.

Research

My research spans human-centric 3D vision and embodied intelligence, with the long-term goal of building human-like systems that can perceive, reason, and interact across virtual and physical worlds.

  • Humanoid agents. My current research explores how to integrate perception, reasoning, planning, and whole-body control to enable autonomous, goal-directed behavior in complex environments. I am particularly interested in learning generalizable skills from human behavior and adapting them across scenes and tasks to support robust physical interaction. Representative projects: VGHuman and SUGAR.
  • Digital humans. My work has focused on modeling human appearance, geometry, and behavior, spanning 3D human reconstruction and generation, clothed human modeling, and socially interactive avatars. Representative projects: GeneMAN, FreeCloth, and Resonant Minds.

Preprints

  1. vghuman.png
    Visually-grounded Humanoid Agents
    Hang Ye, Xiaoxuan Ma, Fan Lu, Wayne Wu, Kwan-Yee Lin, and Yizhou Wang
    arXiv 2026
    Paper Video Code Project Page
  2. resonant.gif
    Resonant Minds: Closed-Loop Social Avatars with Theory of Mind
    Jianxu Shangguan*, Jing Xu*, Hang Ye, Xiaoxuan Ma, Yizhou Wang, Jenq-Neng Hwang, and Wentao Zhu
    arXiv 2026
    Paper Video Code Project Page

Publications

  1. sugar.gif
    SUGAR: A Scalable Human-Video-Driven Generalizable Humanoid Loco-Manipulation Learning Framework
    Tianshu Wu*, Xiangqi Kong*, Yue Chen*, Qize Yu, Hang Ye, Jia Li, Yizhou Wang, and Hao Dong
    Neural Information Processing Systems (NeurIPS), 2026
    Paper Code Project Page
  2. richcontrol.png
    RichControl: Structure- and Appearance-Rich Training-Free Spatial Control for Text-to-Image Generation
    Lexi Pang, Liheng Zhang, Hang Ye, Xiaoxuan Ma, and Yizhou Wang
    ECCV Workshop on Human-AI Co-Creation, 2026  (Best Student Paper Award)
    Paper Video Code Project Page
  3. geneman.gif
    GeneMAN: Generalizable Single-Image 3D Human Reconstruction from Multi-Source Human Data
    Wentao Wang*, Hang Ye*, Fangzhou Hong, Xue Yang, Jianfu Zhang, Yizhou Wang, Ziwei Liu, and Liang Pan
    Neural Information Processing Systems (NeurIPS), 2025
    Paper Video Code Project Page
  4. freecloth.gif
    FreeCloth: Free-form Generation Enhances Challenging Clothed Human Modeling
    Hang Ye, Xiaoxuan Ma, Hai Ci, Wentao Zhu, and Yizhou Wang
    Conference on Computer Vision and Pattern Recognition (CVPR), 2025  (Highlight)
    Paper Video Code Project Page
  5. social-ch_teaser.gif
    Social Motion Prediction with Cognitive Hierarchies
    Wentao Zhu*, Jason Qin*, Yuke Lou, Hang Ye, Xiaoxuan Ma, Hai Ci, and Yizhou Wang
    Neural Information Processing Systems (NeurIPS), 2023
    Paper Video Code Project Page
  6. dmae.png
    Denoising Masked Autoencoders Help Robust Classification
    Quanlin Wu, Hang Ye, Yuntian Gu, Huishuai Zhang, Liwei Wang, and Di He
    International Conference on Learning Representations (ICLR), 2023
    Paper Code
  7. faster-voxelpose.jpeg
    Faster VoxelPose: Real-time 3D Human Pose Estimation by Orthographic Projection
    Hang Ye*, Wentao Zhu*, Chunyu Wang, Rujie Wu, and Yizhou Wang
    European Conference on Computer Vision (ECCV), 2022
    Paper Code

Experience

Shanghai AI Lab
Research Intern, Shanghai Artificial Intelligence Laboratory
Advisor: Wayne Wu, Liang Pan
2023.5 – 2024.9

Services

Reviewer
  • Conference: CVPR, ICCV, ECCV, NeurIPS, ICLR, SIGGRAPH Asia, AAAI

Selected Awards

  • Graduate Special Academic Scholarship, 2024, 2025
  • Fuguang Scholarship, 2020, 2021, 2022
  • First prize in 12th Chinese Mathematics Competition, 2020
  • Merit Student, 2020, 2021, 2022
  • Second Class Scholarship for Freshmen of Peking University, 2019