Principal Researcher

International Digital Economy Academy (IDEA)

Guangdong-HongKong-Macau Greater Bay Area

Shenzhen, China


      liyu[at]idea.edu.cn


   Google Scholar          IDEA-GenAI
Yu's Profile Picture

I am currently a Principal Researcher at International Digital Economy Academy (IDEA), where I lead IDEA's Vistring Lab and focus on video content generation and editing. Before joining IDEA, I was part of the founding team at Tencent ARC Lab, and worked at Blackmagic Design. There I contributed to the AI features behind the Emmy™ award-winning DaVinci Resolve. I got my PhD degree from National University of Singapore, advised by Prof. Michael S Brown. I was a PostDoc Researcher at UIUC Advanced Digital Science Center. I am also an adjunct professor at the South China University of Technology.


Recent Services:

  • Area Chair: CVPR'23-24, NeurIPS'23-24, ECCV'24, MM'24, ICLR'25
  • Workshop (Co)organizer: 1-4th PBDL Workshop (in conjunction with ICCV'17-21, CVPR'24)
  • Guest Editor: IJCV Special Issue on Physics Based Vision meets Deep Learning

News:

  • [Jan. 2024] Three papers accepted by ICLR 2024
  • [Oct. 2023] 2022 World's Top 2% Scientists by Stanford University

  • Recent Highlight:


     

    Selected Publications:

    Maomao Li, Yu Li, Tianyu Yang, Yunfei Liu, Dongxu Yue, Zhihui Lin, Dong Xu
    A Video is Worth 256 Bases: Spatial-Temporal Expectation-Maximization Inversion for Zero-Shot Video Editing
    CVPR 2024
    [Website]

    Junming Chen, Yunfei Liu, Jianan Wang, Ailing Zeng, Yu Li, Qifeng Chen
    DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
    CVPR 2024
    [Website]

    Zhendong Yang, Ailing Zeng, Chun Yuan, Yu Li
    DWPose: Effective Whole-body Pose Estimation with Two-stages Distillation
    ICCV-W 2023
    GitHub stars

    Ziyang Yuan, Yiming Zhu, Yu Li, Hongyu Liu, Chun Yuan
    Make Encoder Great Again in 3D GAN Inversion through Geometry and Occlusion-Aware Encoding
    ICCV 2023
    GitHub stars

    Jing Lin, Ailing Zeng, Haoqian Wang, Lei Zhang, Yu Li
    OSX: One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer
    CVPR 2023 (Top 1 on AGORA SMPL-X Benchmark )
    GitHub stars

    Shuchen Weng, Jimeng Sun, Yu Li, Si Li, Boxin Shi
    CT^2: Colorization Transformer via Color Tokens
    ECCV 2022 ( oral )
    GitHub stars
    [pdf]

    Xiangguang Chen*, Ye Zhu*, Yu Li, Bingtao Fu, Lei Sun, Ying Shan, Shan Liu
    Robust Human Matting via Semantic Guidance
    ACCV 2022
    GitHub stars
    [pdf]

    Yu Li*, Ye Zhu*, Ruoteng Li, Xintao Wang, Yue Luo, Ying Shan
    Hybrid Warping Fusion for Video Frame Interpolation
    IJCV 2022
    [link]

    Shusheng Yang, Xinggang Wang, Yu Li, Yuxin Fang, Jiemin Fang, Wenyu Liu, Xun Zhao, Ying Shan
    TeViT: Temporally Efficient Vision Transformer for Video Instance Segmentation
    CVPR 2022 ( oral )
    GitHub stars
    [pdf]

    Yuxin Fang*, Shusheng Yang*, Xinggang Wang, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu
    QueryInst: Instances as Queries
    ICCV 2021
    GitHub stars
    [pdf] [demo]

    Shusheng Yang*, Yuxin Fang*, Xinggang Wang, Yu Li, Chen Fang, Ying Shan, Bin Feng, Wenyu Liu
    CrossVIS: Crossover Learning for Fast Online Video Instance Segmentation
    ICCV 2021
    GitHub stars
    [pdf] [demo]

    Yanze Wu, Xintao Wang, Yu Li, Honglun Zhang, Xun Zhao, Ying Shan
    Towards Vivid and Diverse Image Colorization with Generative Color Prior
    ICCV 2021
    GitHub stars
    [pdf]

    Feifan Lv, Yu Li, Feng Lu
    Attention Guided Low-light Image Enhancement with a Large Scale Low-light Simulation Dataset
    IJCV 2021
    [pdf] [website] [code]

    Xintao Wang, Yu Li, Honglun Zhang, Ying Shan
    GFP-GAN: Towards Real-World Blind Face Restoration with Generative Facial Prior
    CVPR 2021
    GitHub stars
    [pdf] [website]

    Fan Zhang, Yu Li, Shaodi You, Ying Fu
    Learning Temporal Consistency for Low Light Video Enhancement from Single Images
    CVPR 2021
    GitHub stars
    [pdf]

    Lijian Lin, Haosheng Chen, Honglun Zhang, Jun Liang, Yu Li, Ying Shan, Hanzi Wang
    Dual Semantic Fusion Network for Video Object Detection
    ACM MM 2020
    [link]

    Yu Li*, Zhuoran Shen*, Ying Shan
    Fast Video Object Segmentation using the Global Context Module
    ECCV 2020
    [pdf]

    Yunfei Liu, Yu Li, Shaodi You, Feng Lu
    Unsupervised Learning for Intrinsic Image Decomposition from a Single Image
    CVPR 2020
    [pdf]

    Zhixiang Hao, Yu Li, Shaodi You, Feng Lu
    Detail Preserving Depth Estimation from a Single Image Using Attention Guided Networks
    3DV 2018
    [pdf]

    Xiaojie Guo, Yu Li, Jiayi Ma, Haibin Ling
    Mutually Guided Image Filtering
    ACM MM 2017 & T-PAMI 2018
    [link]

    Xiaojie Guo, Yu Li, Haibin Ling
    LIME: Low-light Image Enhancement via Illumination Map Estimation
    T-IP 2016
    [link]

    Jiangbo Lu, Yu Li, Hongsheng Yang, Dongbo Min, Weiyong Eng, Minh N. Do
    PatchMatch Filter: Edge-Aware Filtering Meets Randomized Search for Correspondence Field Estimation
    T-PAMI 2016
    [link]

    Yu Li, Dongbo Min, Minh N. Do, Jiangbo Lu
    Fast Guided Global Interpolation for Depth and Motion
    ECCV 2016 ( spotlight )
    [project page]

    Yu Li, Robby. T. Tan, Xiaojie Guo, Jiangbo Lu, Michael S. Brown
    Rain Streak Removal Using Layer Priors
    CVPR 2016
    [pdf] [code]

    Yu Li, Dongbo Min, Michael S. Brown, Minh N. Do, Jiangbo Lu
    SPM-BP: Sped-up PatchMatch Belief Propagation for Continuous MRFs
    ICCV 2015 ( oral )
    [project page]

    Yu Li, Robby T. Tan, Michael S. Brown
    Nighttime Haze Removal with Glow and Multiple Light Colors
    ICCV 2015
    [pdf] [code]

    Yu Li, Fangfang Guo, Robby T. Tan, Michael S. Brown
    A Contrast Enhancement Framework with JPEG Artifacts Suppression
    ECCV 2014
    [pdf] [code]

    Yu Li, Michael S. Brown
    Single Image Layer Separation using Relative Smoothness
    CVPR 2014 ( oral )
    [pdf] [code]

    Yu Li, Michael S. Brown
    Exploiting Reflection Change for Automatic Reflection Removal
    ICCV 2013
    [pdf] [code&data]

    Junhong Gao, Yu Li, Tat-Jun Chin, Michael S. Brown
    Seam-Driven Image Stitching
    Eurographics (EG) 2013
    [pdf]