No Access

A SURVEY OF ALGORITHMS AND ARCHITECTURES FOR H.264 SUB-PIXEL MOTION ESTIMATION

MOHAMMAD REZA HOSSEINY FATEMI

Faculty of Computer Science and Information Technology, University of Malaya, 50603 Kuala Lumpur, Malaysia

Search for more papers by this author

HASAN F. ATES

Department of Electronics Engineering, Isik University, Sile 34980 Istanbul, Turkey

Search for more papers by this author

, and

ROSLI SALLEH

Faculty of Computer Science and Information Technology, University of Malaya, 50603 Kuala Lumpur, Malaysia

Search for more papers by this author

https://doi.org/10.1142/S0218126612500168Cited by:0 (Source: Crossref)

Abstract

This paper reviews recent state-of-the-art H.264 sub-pixel motion estimation (SME) algorithms and architectures. First, H.264 SME is analyzed and the impact of its functionalities on coding performance is investigated. Then, design space of SME algorithms is explored representing design problems, approaches, and recent advanced algorithms. Besides, design challenges and strategies of SME hardware architectures are discussed and promising architectures are surveyed. Further perspectives and future prospects are also presented to highlight emerging trends and outlook of SME designs.

This paper was recommended by Regional Editor Piero Malcovati.

Keywords:

References

Joint Video Team (JVT) of ITU-T VCEG and ISO/IEC MPEG, Draft ITU-T Recommendation and Final Draft International Standard of Joint Video Specification, ITU-T Rec. H.264 and ISO/IEC 14496-10 AVC (2003) . Google Scholar
T. Wiegandet al., IEEE Trans. Circuits Syst. Video Technol. 13, 560 (2003). Crossref, Web of Science, Google Scholar
Information technology — generic coding of moving pictures and associated audio information: Video, ISO/IEC 13 818-2 and ITU-T Rec. H.262 (1996) . Google Scholar
Video Coding for Low Bit Rate Communication, ITU-T Rec. H.263 (1998) . Google Scholar
Information technology — coding of audio-visual objects — part 2: Visual, ISO/IEC 14 496-2 (1999) . Google Scholar
A. Jochet al., Performance comparison of video coding standards using lagrangian coder control, Proc. IEEE Int. Conf. Image Process. (2002) pp. 501–504. Google Scholar
T. Wiegand, X. Zhang and B. Girod, IEEE Trans. Circuits Syst. Video Technol. 9, 70 (1999). Crossref, Web of Science, Google Scholar
G. J. Sullivan and T. Wiegand, Rate-distortion optimization for video compression, IEEE Signal Process. Mag. 15 (1998) 74–90 . Google Scholar
T. Wiegandet al., IEEE Trans. Circuits Syst. Video Technol. 13, 688 (2003). Crossref, Web of Science, Google Scholar
D. Marpe, H. Schwarz and T. Wiegand, IEEE Trans. Circuits Syst. Video Technol. 13, 620 (2003). Crossref, Web of Science, Google Scholar
M. R. H. Fatemi, H. F. Ates and R. Salleh, J. Circuits Syst. Comput. 19, (2010). Google Scholar
P. Pirsch, N. Demassieux and W. Gehrke, Proc. IEEE 83, 220 (1995). Crossref, Web of Science, Google Scholar
F. Dufaux and F. Moscheni, Proc. IEEE 83, 858 (1995). Crossref, Web of Science, Google Scholar
P. Pirsch and H.-J. Stolberg, IEEE Trans. Circuits Syst. Video Technol. 8, 878 (1998). Crossref, Web of Science, Google Scholar
P.-C. Tsenget al., Proc. IEEE 93, 184 (2005). Crossref, Web of Science, Google Scholar
Y.-W. Huanget al., J. VLSI Signal Process 42, 297 (2006). Crossref, Web of Science, Google Scholar
Joint Video Team Reference Software version 11.0 (2007), http://iphome.hhi.de/suehring/tml/download/old_jm/ . Google Scholar
G. Bjontegaard, Calculation of average PSNR differences between R-D curves, Document VCEG-M33 (2001) . Google Scholar
Y.-W. Huanget al., IEEE Trans. Circuits Syst. Video Technol. 16, 507 (2006). Crossref, Web of Science, Google Scholar
Y. Songet al., H.264/AVC fractional motion estimation engine with computation reusing in HDTV1080p real-time encoding applications, IEEE SiPS07 (2007) pp. 509–514. Google Scholar
C. L. Suet al., Low complexity high quality fractional motion estimation algorithm and architecture design for H.264/AVC, Proc. IEEE Asia Pacific Conf. Circuits Syst. (2006) pp. 578–581. Google Scholar
A. Abdelazim, M. Yang and C. Grecos, Opt. Eng. Lett. 48, (2009). Google Scholar
Y. J. Wang, C. C. Cheng and T. S. Chang, IEEE Trans. Circuits Syst. Video Technol. 17, 578 (2007). Crossref, Web of Science, Google Scholar
J. W. Suh and J. Jeong, IEEE Trans. Consum. Electron. 50, 968 (2004). Crossref, Web of Science, Google Scholar
P. R. Hillet al., IEEE Trans. Circuits Syst. Video Technol. 16, 1519 (2006). Crossref, Web of Science, Google Scholar
R. Wanget al., Sub-pixel motion compensation interpolation filter in AVS, Proc. IEEE Int. Conf. Multimedia and Expo.1 (2004) pp. 93–96. Google Scholar
C.-Y. Tsaiet al., Bandwidth optimized motion compensation hardware design for H.264/AVC HDTV decoder, Proc. IEEE Midwest Symp., Circuit System2 (2005) pp. 1199–1202. Google Scholar
C. J. Hyun and M. H. Sunwoo, J. Signal Process. Syst. 56, 285 (2009). Crossref, Web of Science, Google Scholar
N. T. Ta, J. H. Kim and J. R. Choi, Fully parallel fractional motion estimation for H.264/AVC encoder, ICIS4 (2009) pp. 306–306. Google Scholar
Y.-H. Chen et al. , An H.264/AVC scalable extension and high profile HDTV 1080p encoder chip , Proc. IEEE SOVC ( 2008 ) . Google Scholar
T.-Y. Kuo, Y.-K. Lin and T.-S. Chang, SIFME: A single iteration fractional-pel motion estimation algorithm and architecture for HDTV sized H.264 video coding, Proc. IEEE Int. Conf. Acoustics, Speech, and Signal Processing (2007) pp. 1185–1188. Google Scholar
Y.-K. Linet al., A 242mw 10mm2 1080p H.264/AVC high profile encoder chip, Proc. IEEE ISSCC (2008) pp. 314–315. Google Scholar
G. Kim, J. Kim and C.-M. Kyung, A low cost single-pass fractional motion estimation architecture using bit clipping for H.264 video codec, ICME (2010) pp. 661–666. Google Scholar
O. Akbulut, O. Urhan and S. Ertürk, Fast Sub-Pixel Motion Estimation By Means of One-Bit Transform, Lecture Notes in Computer Science (LNCS) 4263 (2006) pp. 503–510. Crossref, Google Scholar
A. Celebiet al., IEEE Trans. Consum. Electron. 50, 1928 (2008). Google Scholar
S. Ertürk, IEEE Signal Process. Lett. 14, 109 (2007). Crossref, Web of Science, Google Scholar
Y.-H. Chenet al., J. Signal Process. Syst. 53, 335 (2008). Crossref, Web of Science, Google Scholar
T.-C. Chen, Y.-W. Huang and L.-G. Chen, Fully utilized and reusable architecture for fractional motion estimation of H.264/AVC, IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP)5 (2004) pp. 9–12. Google Scholar
Y. Yang, S. Goto and T. Ikenaga, High performance VLSI architecture of fractional motion estimation in H.264 for HDTV, Proc. IEEE ISCAS (2006) pp. 2605–2608. Google Scholar
J. Park, K. Muhammad and K. Roy, IEEE Trans. VLSI Syst. 11, 244 (2003). Crossref, Google Scholar
H. Samueli, IEEE Trans. Circuits Syst. 35, 1542 (1988). Crossref, Google Scholar
D. Lei et al. , An efficient VLSI architecture for MC interpolation in AVC video coding , Int. Multiconf. in Computer Science and Computer Engineering ( 2004 ) . Google Scholar
Y. Songet al., A VLSI architecture for motion compensation interpolation in H.264/AVC, IEEE ASICON05 (2005) pp. 262–265. Google Scholar
L. Lu, J. V. McCanny and S. Sezer, IEEE Trans. Circuits Syst. Video Technol. 19, 1897 (2009). Web of Science, Google Scholar
T. C. Wang et al. , Parallel 4x4 2D transform and inverse transform architecture for MPEG-4 AVC/H.264 , Proc. of ISCAS ( 2003 ) . Google Scholar
H. Malvaret al., Low-complexity transform and quantization with 16-bit arithmetic for H.26L, Proc. ICIP 20022 (2002) pp. 489–492. Google Scholar
M. S. Porto et al. , Design space exploration on the H.264 4 × 4 Hadamard transform , 23rd NORCHIP Conf. ( 2005 ) . Google Scholar
Z.-Y. Cheng et al. , High throughput 2-D transform architectures for H.264 advanced video coders , Proc. 2004 IEEE Asia-Pacific Conf. Circuits and Systems ( 2004 ) . Google Scholar
J. Vanneet al., IEEE Trans. Circuits Syst. Video Technol. 16, 876 (2006). Crossref, Web of Science, Google Scholar
H.-C. Kuo, Efficient VLSI architectures for inter and intra mode decision in high resolution H.264/MPEG-4 part10 AVC encoding, Master thesis, National Tsing Hua University, Hsinchu, Taiwan (2006) . Google Scholar
M. R. H. Fatemi, Algorithm optimization and low cost bit-serial architecture design for integer pixel and sub-pixel motion estimation in H.264/AVC, Ph.D. thesis, University of Malaya, Kuala Lumpur, Malaysia (2012) . Google Scholar
S. Wuytack et al. , Power exploration for data dominated video applications , Proc. IEEE Int. Conf. Low Power Electronics and Design (ISLPED) ( 1996 ) . Google Scholar
S. Wuytacket al., IEEE Trans. VLSI Syst. 6, 529 (1998). Crossref, Google Scholar
D. Soudris, N. D. Zervas, A. Argyriou, M. Dasygenis, K. Tatas, C. E. Goutis and A. Thanailakis, Data-Reuse and Parallel Embedded Architectures for Low-Power, Real-Time Multimedia Applications, Lecture Notes in Computer Science, Vol. 1918 (Springer, 2000), pp. 243–254 . Google Scholar
Y.-H. Chenet al., J. Signal Process Syst. 50, 1 (2008). Crossref, Web of Science, Google Scholar
Z. Haihua, X. Zhiqi and C. Guanghua, VLSI implementation of sub-pixel interpolator for H.264/AVC encoder, High Density Packaging and Microsystem Integration (2007) pp. 1–3. Google Scholar
C.-L. Wu, C.-Y. Kao and Y.-L. Lin, A high-performance three-engine architecture for H.264/AVC fractional motion estimation, IEEE Int. Conf. Multimedia and Expo (2008) pp. 133–136. Google Scholar
C.-L. Wu, C.-Y. Kao and Y.-L. Lin, IEEE Trans. VLSI Syst. 18, 662 (2010). Google Scholar
G. A. Ruiz and J. A. Michell, J. Signal Process Syst. 60, (2010). Google Scholar
P.-K. Tsung et al. , Single-iteration full-search fractional motion estimation for quad full HD H.264/AVC encoding , Int. Conf. Multimedia & Expo (ICME) ( 2009 ) . Google Scholar
T.-C. Chen et al. , Low power and power aware fractional motion estimation of H.264/AVC for mobile applications , IEEE Int. Symp. Circuits and Systems (ISCAS) ( 2006 ) . Google Scholar
M. Shaoet al., IEIEC Trans. Fundamentals 90-A, 756 (2007). Google Scholar
P.-K. Tsung et al. , Cache-based integer motion/disparity estimation for quad-HD H.264/AVC and HD multiview video coding , IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP) ( 2009 ) . Google Scholar
Y.-L. Lin (ed.) , Essential Issues in SOC Design ( Springer , 2006 ) . Crossref, Google Scholar
http://www.vcodex.com/h265.html . Google Scholar
M. Sugawaraet al., SMPTE Mot. Imag. J. 112, 339 (2003). Crossref, Web of Science, Google Scholar
E. Nakasuet al., SMPTE Mot. Imag. J. 116, 279 (2007). Crossref, Web of Science, Google Scholar
C. Bilen, A. Aksay and G. B. Akar, A multi-view video codec based on H.264, IEEE Int. Conf. Image Processing (ICIP) (2006) pp. 541–544. Google Scholar
S. Wittmann and T. Wedi, Separable adaptive interpolation filter for video coding, Proc. IEEE ICIP (2008) pp. 2500–2503. Google Scholar
Y. Vatis and J. Ostermann, IEEE Trans. Circuits Syst. Video Technol. 19, 179 (2009). Crossref, Web of Science, Google Scholar
N. S. Kimet al., Computer 36, 68 (2003). Web of Science, Google Scholar
W. M. Elgharbawy and M. A. Bayoumi, Leakage sources and possible solutions in nanometer CMOS technologies, IEEE Circuits Syst. Mag. 5 (2005) 6–17 . Google Scholar
T. Sakurai, Design challenges for 0.1um and beyond: Embedded tutorial, ASP-DAC 2000 (2000) pp. 553–558. Google Scholar