Zhengzhe Liu

Postdoctoral Associate

School of Computer Science
Carnegie Mellon University
United States

Email: liuzhengzhelzz [at] gmail.com

Biography

I am a postdoctoral associate at Carnegie Mellon University. I obtained my PhD degree from Computer Science and Engineering Department, The Chinese University of Hong Kong (CUHK), supervised by Prof. Chi-Wing Fu. I got MPhil from The Chinese University of Hong Kong and Bachelor from Shanghai Jiao Tong University (SJTU). My research interest includes GenAI, Multimodality, 3D Vision, 3D Generation, Computer Graphics, and AI4Science.

Selected Publications [Google Scholar]

*: equal contribution, †: corresponding author

What Matters in Detecting AI-Generated Videos like Sora?
Chirui Chang, Zhengzhe Liu, Xiaoyang Lyu, Xiaojuan Qi
Preprint, 2024.
Zero-shot 3D-Aware Text-driven Talking Avatar Generation
Xiuzhe Wu, Yang-Tian Sun, Handi Chen, Hang Zhou, Jingdong Wang, Zhengzhe Liu, Xiaojuan Qi
European Conference on Computer Vision (ECCV), 2024.
Object-level Scene Deocclusion
Zhengzhe Liu, Qing Liu, Chirui Chang, Jianming Zhang, Daniil Pakhomov, Haitian Zheng, Zhe Lin, Daniel Cohen-Or, Chi-Wing Fu
SIGGRAPH, 2024.
[Project page]
CNS-Edit: 3D Shape Editing via Coupled Neural Shape Optimization
Jingyu Hu, Ka-Hei Hui, Zhengzhe Liu, Hao (Richard) Zhang, Chi-Wing Fu
SIGGRAPH, 2024.
Make-A-Shape: a Ten-Million-scale 3D Shape Model
Ka-Hei Hui, Aditya Sanghi, Arianna Rampini, Kamal Rahimi Malekshan, Zhengzhe Liu, Hooman Shayani, Chi-Wing Fu
International Conference on Machine Learning (ICML), 2024.
[Project page]
EXIM: A Hybrid Explicit-Implicit Representation for Text-Guided 3D Shape Generation
Zhengzhe Liu, Jingyu Hu, Ka-Hei Hui, Xiaojuan Qi, Daniel Cohen-Or, Chi-Wing Fu
SIGGRAPH Asia (Journal Track), 2023.
ACM Transactions on Graphics (TOG), 2023,
[Code] [Project page]
CLIPXPlore: Coupled CLIP and Shape Spaces for 3D Shape Exploration
Jingyu Hu*, Ka-Hei Hui*, Zhengzhe Liu, Hao (Richard) Zhang, Chi-Wing Fu
SIGGRAPH Asia, 2023.
Texture Generation on 3D Meshes with Point-UV Diffusion
Xin Yu, Peng Dai, Wenbo Li, Lan Ma, Zhengzhe Liu†, Xiaojuan Qi† (†: Corresponding author)
IEEE International Conference on Computer Vision (ICCV) Oral , 2023.
[Project page]
DreamStone : Image as Stepping Stone for Text-Guided 3D Shape Generation
Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023.
[Code] [Project page]
Neural Wavelet-domain Diffusion for 3D Shape Generation, Inversion, and Manipulation
Jingyu Hu*, Ka-Hei Hui*, Zhengzhe Liu, Ruihui Li, Chi-Wing Fu
ACM Transactions on Graphics (TOG), 2023.
MGFN++: Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detection
Yingxian Chen, Weibin Kou, Wilton Fok, Zhengzhe Liu†, Xiaojuan Qi, Yik-Chung Wu† (†: Corresponding author)
Preprint, 2023.
Command-driven Articulated Object Understanding and Manipulation
Ruihang Chu, Zhengzhe Liu, Xiaoqing Ye, Xiao Tan, Xiaojuan Qi, Chi-Wing Fu, Jiaya Jia
IEEE Conference on Computer Vision and pattern Recognition (CVPR), 2023.
[Code]
ISS : Image as Stepping Stone for Text-Guided 3D Shape Generation
Zhengzhe Liu, Peng Dai, Ruihui Li, Xiaojuan Qi, Chi-Wing Fu
International Conference on Learning Representations (ICLR) Spotlight , 2023.
[Code]
You Only Need One Thing One Click: Self-Training for Weakly Supervised 3D Scene Understanding
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu
Book chapter in the incoming book “ Towards Realistic 3D Deep Learning: Algorithms and Applications”, edited by Xiaoli Li, Xulei Yang, and Hao Su. World Scientific, 2023
World Scientific Annual Review of Artificial Intelligence, 2024 (Invited paper) [Code]
MGFN : Magnitude-Contrastive Glance-and-Focus Network for Weakly-Supervised Video Anomaly Detection
Yingxian Chen, Zhengzhe Liu, Baoheng Zhang, Wilton Fok, Xiaojuan Qi, Yik-Chung Wu
AAAI Conference on Artificial Intelligence (AAAI) Oral , 2023.
[Code]
Sparse2Dense: Learning to Densify 3D Features for 3D Object Detection
Tianyu Wang, Xiaowei Hu, Zhengzhe Liu, Chi-Wing Fu
Neural Information Processing Systems (NeurIPS), 2022.
[Code]
Towards Implicit Text-Guided 3D Shape Generation
Zhengzhe Liu, Yi Wang, Xiaojuan Qi, Chi-Wing Fu
IEEE Conference on Computer Vision and pattern Recognition (CVPR), 2022.
[Code]
TWIST: Two-Way Inter-label Self-Training for Semi-supervised 3D Instance Segmentation
Ruihang Chu, Xiaoqing Ye, Zhengzhe Liu, Xiao Tan, Xiaojuan Qi, Chi-Wing Fu, Jiaya Jia
IEEE Conference on Computer Vision and pattern Recognition (CVPR), 2022.
[Code]
MEN: Mutual Enhancement Networks for Sign Language Recognition and Education
Zhengzhe Liu, Lei Pang, Xiaojuan Qi.
IEEE Transactions on Neural Networks and Learning Systems (TNNLS), 2022.
3D-to-2D Distillation for Indoor Scene Parsing
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu
IEEE Conference on Computer Vision and pattern Recognition (CVPR), Oral (4.3% acceptance rate) , 2021.
[Code]
One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu
IEEE Conference on Computer Vision and pattern Recognition (CVPR), 2021.
[Code][Video]
Global Texture Enhancement for Fake Face Detection in the Wild
Zhengzhe Liu, Xiaojuan Qi, Philip H.S. Torr.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[Code]
GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimation
Xiaojuan Qi*, Zhengzhe Liu*, Renjie Liao, Philip H. S. Torr, Raquel Urtasun, Jiaya Jia.
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2020.
[Code][Training data]
3D Motion Decomposition for RGBD Future Dynamic Scene Synthesis
Xiaojuan Qi*, Zhengzhe Liu*, Qifeng Chen, Jiaya Jia.
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
Self-Boosted Gesture Interactive System with ST-Net
Zhengzhe Liu* , Xiaojuan Qi*, Lei Pang.
ACM Multimedia Conference (ACM MM), 2018.
GeoNet: Geometric Neural Network for Joint Depth and Surface Normal Estimation
Xiaojuan Qi, Renjie Liao, Zhengzhe Liu, Raquel Urtasun, Jiaya Jia
IEEE Conference on Computer Vision and Pattern Recognition(CVPR), 2018.
[Code][Training data]
Augmented Feedback in Semantic Segmentation under Image Level Supervision
Xiaojuan Qi, Zhengzhe Liu, Jianping Shi, Jiaya Jia.
European Conference on Computer Vision (ECCV), 2016.