access icon free Improved matching criterion for frame rate upconversion with trilateral filtering

© The Institution of Engineering and Technology
Received 10/10/2012, Published

Frame rate upconversion (FRUC) is an important post-processing technique to enhance the visual quality of low frame rate video. A major, recent advance in this area is FRUC based on trilateral filtering which novelty mainly derives from the combination of an edge-based motion estimation block matching criterion with the trilateral filter. However, there is still room for improvement, notably towards reducing the size of the uncovered regions in the initial estimated frame, this means the estimated frame before trilateral filtering. In this context, proposed is an improved motion estimation block matching criterion where a combined luminance and edge error metric is weighted according to the motion vector components, notably to regularise the motion field. Experimental results confirm that significant improvements are achieved for the final interpolated frames, reaching PSNR gains up to 2.73 dB, on average, regarding recent alternative solutions, for video content with varied motion characteristics.

Inspec keywords: vectors; edge detection; video signal processing; image matching; filtering theory; motion estimation

Other keywords: trilateral filtering; frame rate upconversion; video content; block matching criterion; FRUC; visual quality; edge-based motion estimation; motion vector components; low frame rate video

Subjects: Video signal processing; Computer vision and image processing techniques; Algebra; Algebra; Optical, image and video signal processing

References

    1. 1)
      • 1. Wong, C. K., Au, O. C., Tang, C. W.: ‘Motion compensated temporal interpolation with overlapping’. Proc. IEEE Int. Symp. Circuits and Systems, Atlanta, CA, USA, 1996, Vol. 2, pp. 608–611.
    2. 2)
      • 3. Wang, C., He, Y., Tan, Y.-P.: ‘Frame rate upconversion using trilateral filtering’, IEEE Trans. Circuits Syst. Video Technol.,2010, 20, (6), pp. 886–893 (doi: 10.1109/TCSVT.2010.2046057).
    3. 3)
      • 5. Castagno, R., Haavisto, P., Ramponi, G.: ‘A method for motion adaptive frame rate upconversion’, IEEE Trans. Circuits Syst. Video Technol.,1996, 6, (5), pp. 436–446 (doi: 10.1109/76.538926).
    4. 4)
      • 2. Choi, B.-T., Lee, S.-H., Ko, S.-J.: ‘New frame rate upconversion using bi-directional motion estimation’, IEEE Trans. Consum. Electron.,2000, 46, (3), pp. 603–609 (doi: 10.1109/30.883418).
    5. 5)
      • 4. Jung, H. S., Kim, U. S., Sunwoo, M. H.: ‘Simplified frame rate upconversion algorithm with low computational complexity’. Proc. 20th European Signal Processing Conf., Romania, August 2012, pp. 385–389.
    6. 6)
    7. 7)
      • Jung, H.S., Kim, U.S., Sunwoo, M.H.: `Simplified frame rate upconversion algorithm with low computational complexity', Proc. 20th European Signal Processing Conf., 2012, Romania, p. 385–389.
    8. 8)
      • Wong, C.K., Au, O.C., Tang, C.W.: `Motion compensated temporal interpolation with overlapping', Proc. IEEE Int. Symp. Circuits and Systems, 1996, Atlanta, CA, USA, p. 608–611Vol. 2, .
    9. 9)
    10. 10)
http://iet.metastore.ingenta.com/content/journals/10.1049/el.2012.3454
Loading

Related content

content/journals/10.1049/el.2012.3454
pub_keyword,iet_inspecKeyword,pub_concept
6
6
Loading