profile photo

Yao Luo 骆 瑶

I'm a lecturer at the School of Computer and Electronic Information / Artificial Intelligence of Nanjing Normal University in Nanjing, China.

I did my PhD at Nanjing University of Science & Technology in Computer Science and Technology, where I was advised by Professor Jinhui Tang and Professor Jinshan Pan. Before that, I received my master's degree from Texas A&M University in Electrical Engineering and my bachelor's degree from Southeast University in Electronic Science and Technology.

Email  /  Scholar  /  Github  /  CV

Research

My current research focuses on computer vision, deep learning and spatial intelligence, especially inferring scene motion and structure from videos for enhanced visual experience, with constrained resources.

dvp Dual-view Pyramid Network for Video Frame Interpolation
Yao Luo, Ming Yang, Jinhui Tang,
ACM MM, 2024
bibtex

We aim to unleash the multifaceted knowledge yielded by the hierarchical views at multiple scales in a pyramid network for video frame interpolation. To this end, we present a dual-view pyramid network with an auxiliary multi-scale collaborative supervision.

svmv SVMV: Spatiotemporal Variance-Supervised Motion Volume for Video Frame Interpolation
Yao Luo, Jinshan Pan, Jinhui Tang,
ICASSP, 2023
bibtex poster & video

We investigate the unary potentials of the characterizations to improve efficiency of video frame interpolation. To this end, we design a lightweight neural network to construct motion volumes via ensembles of offset approximations, and a spatiotemporal variance-aware loss for supervision.

bp3d Bi-Directional Pseudo-Three-Dimensional Network for Video Frame Interpolation
Yao Luo, Jinshan Pan, Jinhui Tang,
IEEE Transactions on Image Processing, 2022
bibtex demo

We present a bi-directional pseudo-three-dimensional network to exploit the correlation between motion estimation and depth-related occlusion estimation, in both the past and future directions, synthesizing intermediate frames through a bi-directional pseudo-three-dimensional warping layer with a novel multi-task collaborative learning strategy.

bibranch Bi-branch network for dynamic scene deblurring
Yao Luo, Zhong-Hui Duan, Jinhui Tang,
Computer Vision and Image Understanding, 2021
bibtex

We present a bi-branch network for efficient dynamic scene deblurring. The proposed network conduct heterogeneous transformations on motion and RGB content in an encoder–decoder structure with skip connections. We refine features captured by the motion branch and the color branch by incorporating a lightweight nonlocal fusion layer.

Academic Services

  • Conference Reviewer: ACM MM, ICASSP, IJCNN, China MM
  • Journal Reviewer: IEEE Transactions on Neural Networks and Learning Systems, Image and Vision Computing
  • Volunteer: NExT++ workshop, EIPBN

Thanks Jon Barron for the website template.