Yuchao Gu

Ph.D. Student

Show Lab
National University of Singapore

Email: yuchaogu9710 [at] gmail.com


Biography

Hi there! I am a second-year Ph.D. student in Show Lab @ NUS, working with Prof. Mike Shou. Before that, I received master's degree in Nankai University in 2022, working with Prof. Ming-Ming Cheng.

My research interests lie in AIGC, especially Video Geneation/Editing and Customized Generation.

News

Publications

MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance
Qi Mao, Lan Chen, Yuchao Gu, Zhen Fang, Mike Zheng Shou.

Arxiv, 2023.
[project] [paper] [code]

VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence
Yuchao Gu, Yipin Zhou, Bichen Wu, Licheng Yu, Jiawei Liu, Rui Zhao, Jay Zhangjie Wu, David Junhao Zhang, Mike Zheng Shou, Kevin Tang.

Arxiv, 2023.
[project] [paper] [code]

DynVideo-E: Harnessing Dynamic NeRF for Large-Scale Motion- and View-Change Human-Centric Video Editing
Jia-Wei Liu, Yan-Pei Cao, Jay Zhangjie Wu, Weijia Mao, Yuchao Gu, Rui Zhao, Jussi Keppo, Ying Shan, Mike Zheng Shou.

Arxiv, 2023.
[project] [paper] [code]

Show-1: Marrying Pixel and Latent Diffusion Models for Text-to-Video Generation
David Junhao Zhang, Jay Zhangjie Wu, Jia-Wei Liu, Rui Zhao, Lingmin Ran, Yuchao Gu, Difei Gao, Mike Zheng Shou.

Arxiv, 2023.
[project] [paper] [code]

MotionDirector: Motion Customization of Text-to-Video Diffusion Models
Rui Zhao, Yuchao Gu, Jay Zhangjie Wu, David Junhao Zhang, Jiawei Liu, Weijia Wu, Jussi Keppo, Mike Zheng Shou.

Arxiv, 2023.
[project] [paper] [code]

Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models
Yuchao Gu, Xintao Wang, Jay Zhangjie Wu, Yujun Shi, Yunpeng Chen, Zihan Fan, Wuyou Xiao, Rui Zhao, Shuning Chang, Weijia Wu, Yixiao Ge, Ying Shan and Mike Zheng Shou.

Neural Information Processing Systems (NeurIPS), 2023.
[project] [paper] [code]

Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generation
Jay Zhangjie Wu, Yixiao Ge, Xintao Wang, Weixian Lei, Yuchao Gu, Wynne Hsu, Ying Shan, Xiaohu Qie and Mike Zheng Shou.

International Conference on Computer Vision (ICCV), 2023.
[project] [paper] [code]

Rethinking the Objectives of Vector-Quantized Tokenizers for Image Synthesis
Yuchao Gu, Xintao Wang, Yixiao Ge, Ying Shan, Xiaohu Qie, Mike Zheng Shou.

Arxiv, 2022.
[paper] [code]

VQFR: Blind Face Restoration with Vector-Quantized Dictionary and Parallel Decoder
Yuchao Gu, Xintao Wang, Liangbin Xie, Chao Dong, Gen Li, Ying Shan and Ming-Ming Cheng.

European Conference on Computer Vision (ECCV), 2022. Oral (2.7%)
[project] [paper] [code]

iNAS: Integral NAS for Device-Aware Salient Object Detection
Yuchao Gu, Shang-Hua Gao, Xu-Sheng Cao, Peng Du, Shao-Ping Lu and Ming-Ming Cheng.

IEEE International Conference on Computer Vision (ICCV), 2021.
[paper] [code]

DOTS: Decoupling Operation and Topology in Differentiable Architecture Search
Yuchao Gu, Li-Juan Wang, Yun Liu, Yi Yang, Yu-Huan Wu, Shao-Ping Lu and Ming-Ming Cheng.

IEEE Computer Vision and Pattern Recognition Conference (CVPR), 2021.
[paper] [code]

Pyramid Constrained Self-Attention Network for Fast Video Salient Object Detection
Yuchao Gu, Li-Juan Wang, Ziqin Wang, Yun Liu, Shao-Ping Lu and Ming-Ming Cheng.

Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2020
[paper] [code]

Honors

Service

Acknowledgment

I have been fortunate to work with these wonderful people who generously provided me with mentorship.

@ ARC Lab, Tencent

Dr. Xintao Wang

@ GenAI, Meta

Dr. Yipin Zhou
Dr. Bichen Wu
Dr. Licheng Yu



© Yuchao Gu