An Optimal Framework of Video Adaptation and Its Application to Rate Adaptation Transcoding

ETRI Journal

关键词: utility function;    MPEG-21 DIA;    universal multimedia access (UMA);    Video rate adaptation;   

Others  :  1185247
DOI  :  10.4218/etrij.05.0105.0019

【 摘 要 】

The adaptation of video according to the heterogeneous and dynamic resource constraints on networks and devices, as well as on user preferences, is a promising approach for universal access and consumption of video content. For optimal adaptation that satisfies the constraints while maximizing the utility that results from the adapted video, it is necessary to devise a systematic way of selecting an appropriate adaptation operation among multiple feasible choices. This paper presents a general conceptual framework that allows the formulation of various adaptations as constrained optimization problems by modeling the relations among feasible adaptation operations, constraints, and utilities. In particular, we present the feasibility of the framework by applying it to a use case of rate adaptation of MPEG-4 video with an explicit modeling of adaptation employing a combination of frame dropping and discrete cosine transform coefficient dropping, constraint, utility, and their mapping relations. Furthermore, we provide a description tool that describes the adaptation-constraint-utility relations as a functional form referred to as a utility function, which has been accepted as a part of the terminal and network quality of service tool in MPEG-21 Digital Item Adaptation (DIA).

   

【 参考文献 】

• [1]R. Mohan, J.R. Smith, and C.-S. Li, "Adapting Multimedia Internet Content for Universal Access," IEEE Trans. Multimedia, vol. 1., Mar. 1999, pp. 104-114.
• [2]P. van Beek, J.R. Smith, T. Ebrahimi, T. Suzuki, and J. Askelof, "Metadata-Driven Multimedia Access," IEEE Signal Processing Mag., vol. 20, Mar. 2003, pp. 40-52.
• [3]J. Bormans, J. Gelissen, and A. Perkis, "MPEG-21: The 21st Century Multimedia Framework," IEEE Signal Processing Mag., vol. 20, Mar. 2003, pp. 53-62.
• [4]A. Vetro, C. Christopoulos, and H. Sun, "Video Transcoding Architectures and Techniques: An Overview," IEEE Signal Processing Mag., vol. 20, Mar. 2003, pp. 18-29.
• [5]Y. Nakajima, H. Hori, and T. Kanoh, "Rate Conversion of MPEG Coded Video by Requantization Process," Proc. IEEE Int. Conf. Image Processing, Washington, DC, 1995, pp. 408-411.
• [6]H. Sun, W. Kwok, and J. Zdepski, "Architecture for MPEG Compressed Bitstream Scaling," IEEE Trans. Circuits Syst. Video Technol., vol. 6, Apr. 1996, pp. 191-199.
• [7]P. Assuncano and M. Ghanbari, "Post-Processing of MPEG2 Coded Video for Transmission at Lower Bit Rates," Proc. IEEE Int. Conf. On Acoustic, Speech, and Signal Processing’96, vol. 4, Atlanta, GA, May 1996, pp. 1998-2001.
• [8]A. Eleftheriadis, "Dynamic Rate Shaping of Compressed Digital Video," Ph. D. dissertation, Dept., Elec. Eng., Columbia Univ., New York, June 1995.
• [9]J. Youn, M.T. Sun, and C.W. Lin, "Motion Vector Refinement for High Performance Transcoding," IEEE Multimedia, vol. 1, Mar. 1999, pp. 30-40.
• [10]T. Shanableh and M. Ghanbari, "Heterogeneous Video Transcoding to Lower Spatio-Temporal Resolutions and Different Encoding Formats," IEEE Trans. Multimedia, vol. 2, June 2000, pp. 101-110.
• [11]K.T. Fung, Y.L. Chan, and W.C. Siu, "New Architecture for Dynamic Frame-Skipping Transcoder," IEEE Trans. Image Processing, vol. 11, Aug. 2002, pp. 886-900.
• [12]A. Vetro, H. Sun, and Y. Wang, "Object-Based Transcoding for Adaptive Video Content Delivery," IEEE Trans. Circuit Syst. Video Technol., vol. 11, Mar. 2001, pp. 387-401.
• [13]W. Li, "Overview of Fine Granularity Scalability in MPEG-4 Video Standard," IEEE Trans. Circuit Syst. Video Technol., vol. 11, Mar. 2001, pp. 301-317.
• [14]M. van der Schaar and H. Radha, "A Hybrid Temporal-SNR Fine Granular Scalability for Internet Video," IEEE Trans. Circuit Syst. Video Technol., vol. 11, Mar. 2001, pp. 318-331.
• [15]MPEG. Available at: http://www.chiariglione.org/mpeg/
• [16]A. Vetro, Y. Wang, and H. Sun, "Rate-Distortion Optimized Video Coding Considering Frameskip," Proc. IEEE Int. Conf. Image Processing, Thessaloniki, Greece, Oct. 2001, pp. 534-537.
• [17]J.-J. Chen and H.-M. Hang, "Source Model of Transform Video Coder and its Application? Part II: Variable Frame Rate Coding," IEEE Trans. Circuits Syst. Video Technol., vol. 7, Apr. 1997, pp. 187-298.
• [18]E.C. Reed and J.S. Lim, "Optimal Multidimensional Bit-Rate Control for Video Communications," IEEE Trans Image Processing, vol. 11, no. 8, Aug. 2002, pp. 873-885.
• [19]S.-F. Chang, "Optimal Video Adaptation and Skimming Using a Utility-Based Framework," Proc. IWDC-2002, Capri Island, Italy, Sept. 2002.
• [20]S.-F. Chang and A. Vetro, "Video Adaptation: Concepts, Technologies, and Open Issues," Proc. IEEE, vol. 93, no. 1, Jan. 2005, pp. 148-158.
• [21]J.-G. Kim, Y. Wang, and S.-F. Chang, "Content-Adaptive Utility-Based Video Adaptation," Proc. ICME-2003, Baltimore, Maryland, July 2003.
• [22]Y. Wang, J.-G. Kim, S.-F. Chang, and Hyung-Myung Kim, "Utility-Based Video Adaptation for UMA and Content-Based Utility Function Prediction for Real Time Video Transcoding," revision for publication in IEEE Trans. Multimedia.
• [23]J.-G. Kim, Y. Wang, S.-F. Chang, K. Kang, and J. Kim, "Description of Utility Function Based Optimum Transcoding," ISO/IEC JTC1/SC29/WG11/M8319, Fairfax, May 2002.
• [24]ISO/IEC 21000-7:2004, Information Technology-Multimedia Framework-Part 7: Digital Item Adaptation.
• [25]J-G Kim, H.S. Chang, J. Kim, and H.-M. Kim, "Threshold-Based Camera Motion Characterization of MPEG Video," ETRI J., vol. 26, no. 3, June 2004, pp.269-272.
• [26]D. Mukherjee, E. Delfosse, J.-G. Kim, and Y. Wang, "Optimal Adaptation Decision-Taking and Network Quality-of-Service," IEEE Trans. Multimedia, vol. 7, no. 3, June 2005, pp. 454-462.
• [27]P. Bocheck, A. Campbell, S.-F. Chang, and R.R.-F. Liao, "Utility-Based Network Adaptation for MPEG-4 Systems," Proc. NOSSDAV ’99, Basking Ridge, New Jersey, June 1999.
• [28]C.E. Luna, L.P. Kondi, and A.K. Katsaggelos, "Maximizing User Utility in Video Streaming Applications," IEEE Trans. Circuits and Syst. Video Technol., vol. 13, no. 2, Feb. 2003, pp. 141-148.
• [29]Y. Wang, J.-G. Kim, and S.-F. Chang, "MPEG-4 Real Time FD-CD Transcoding," Columbia University, ADVENT Technical Report #11122003, 2003.
• [30]A. Vetro and C. Timmerer, "Digital Item Adaptation: Overview of Standardization and Research Activities," IEEE Trans. Multimedia, vol. 7, no. 3, June 2005, pp. 418-426.