Research
My current research focuses on computer vision, deep learning and spatial intelligence, especially inferring scene motion and structure from videos for enhanced visual experience, with constrained resources.
|
|
Dual-view Pyramid Network for Video Frame Interpolation
Yao Luo,
Ming Yang,
Jinhui Tang,
ACM MM, 2024
bibtex
We aim to unleash the multifaceted knowledge yielded by the hierarchical views at multiple scales in a pyramid network for video frame interpolation. To this end, we present a dual-view pyramid network with an auxiliary multi-scale collaborative supervision.
|
|
SVMV: Spatiotemporal Variance-Supervised Motion Volume for Video Frame Interpolation
Yao Luo,
Jinshan Pan,
Jinhui Tang,
ICASSP, 2023
bibtex
poster & video
We investigate the unary potentials of the characterizations to improve efficiency of video frame interpolation. To this end, we design a lightweight neural network to construct motion volumes via ensembles of offset approximations, and a spatiotemporal variance-aware loss for supervision.
|
|
Bi-Directional Pseudo-Three-Dimensional Network for Video Frame Interpolation
Yao Luo,
Jinshan Pan,
Jinhui Tang,
IEEE Transactions on Image Processing, 2022
bibtex
demo
We present a bi-directional pseudo-three-dimensional network to exploit the correlation between motion estimation and depth-related occlusion estimation, in both the past and future directions, synthesizing intermediate frames through a bi-directional pseudo-three-dimensional warping layer with a novel multi-task collaborative learning strategy.
|
|
Bi-branch network for dynamic scene deblurring
Yao Luo,
Zhong-Hui Duan,
Jinhui Tang,
Computer Vision and Image Understanding, 2021
bibtex
We present a bi-branch network for efficient dynamic scene deblurring. The proposed network conduct heterogeneous transformations on motion and RGB content in an encoder–decoder structure with skip connections. We refine features captured by the motion branch and the color branch by incorporating a lightweight nonlocal fusion layer.
|
Academic Services
- Conference Reviewer: ACM MM, ICASSP, IJCNN, China MM
- Journal Reviewer: IEEE Transactions on Neural Networks and Learning Systems, Image and Vision Computing
- Volunteer: NExT++ workshop, EIPBN
|
|