Polygonal finite element-based content-aware image warping

Computational Visual Media

Research Article

Yongjie Jessica Zhang¹  Jiannan Huang²  Juan Cao²  Xiaoyi Zhang² 

[1] Department of Mechanical Engineering, Carnegie Mellon University, 15213, Pittsburgh, PA, USA;School of Mathematical Sciences, Xiamen University, 361005, Xiamen, China;Fujian Provincial Key Laboratory of Mathematical Modeling and High-Performance Scientific Computation, Xiamen University, 361005, Xiamen, China;

关键词: image warping;    finite element method (FEM);    polygonal element;    mesh generation;   

DOI  :  10.1007/s41095-022-0283-7

 received in 2022-02-09, accepted in 2022-03-08,  发布年份 2022

来源: Springer

【 摘 要 】

Mesh-based image warping techniques typically represent image deformation using linear functions on triangular meshes or bilinear functions on rectangular meshes. This enables simple and efficient implementation, but in turn, restricts the representation capability of the deformation, often leading to unsatisfactory warping results. We present a novel, flexible polygonal finite element (poly-FEM) method for content-aware image warping. Image deformation is represented by high-order poly-FEMs on a content-aware polygonal mesh with a cell distribution adapted to saliency information in the source image. This allows highly adaptive meshes and smoother warping with fewer degrees of freedom, thus significantly extending the flexibility and capability of the warping representation. Benefiting from the continuous formulation of image deformation, our poly-FEM warping method is able to compute the optimal image deformation by minimizing existing or even newly designed warping energies consisting of penalty terms for specific transformations. We demonstrate the versatility of the proposed poly-FEM warping method in representing different deformations and its superiority by comparing it to other existing state-of-the-art methods.

【 授权许可】

CC BY   
© The Author(s) 2022