Statistical Analysis of a Subjective QoE Assessment for VVoIP Applications

ETRI Journal

关键词: wireless networks;    VVoIP;    VoIP;    QoS;    QoE;   

Others  :  1185865
DOI  :  10.4218/etrij.10.0109.0645

【 摘 要 】

A successful deployment of multimedia applications over wireless environments entails improving the quality of service (QoS), not only from a technical point of view, but also considering the quality of experience (QoE) from the final user′s perception. Although objective QoE measure models avoid the difficulties of subjective surveys, subjective QoE assessments are essential to understand the way users evaluate the QoS. In this work, we study the effect of a wide range of parameters on the QoE of VVoIP applications in a real wireless scenario. Through a complete statistical analysis of users′ ratings, we identify the following facts. Although the use of VVoIP in wireless networks does not yet represent an advantage for users, there are great expectations for all applications under study, and with greater popularity comes higher expectations. It is easier for respondents to identify good behavior than poor behavior. Whereas the respondents′ frequency of Internet use does not impact on the scores, respondents′ gender does. Finally, the most determining parameters of quality from a user′s perspective were instability, video quality, voice distortion, usefulness, and graphical interface.

   

【 参考文献 】

• [1]ITU-T P.10/G.100 "Vocabulary for Performance and Quality of Service. Amendment 2. New Definitions for Inclusion in Recommendation ITU-T P.10/G.100," July 2008.
• [2]ITU-T Rec G.1010 "End-User Multimedia QoS Categories," Nov. 2001.
• [3]ANIQUE+, "Auditory Non-Intrusive Quality Estimation Plus (ANIQUE+) Perceptual Model for Non-Intrusive Estimation of Narrowband Speech Quality," ATIS-0100005.2006, ANSI, 2006.
• [4]ITU-T Rec. G.107, "The E-Model: A Computational Model for Use in Transmission Planning," Apr. 2009.
• [5]IEEE P1903™/D1 "Draft White Paper for Next Generation Service Overlay Network," May, 2008.
• [6]"Challenge to All: Roadmap for the Usage of Collaboration Tools," Keith Dickerson, ETSI Board, Nov. 26, 2009.
• [7]S. Möller et al., "Speech Quality while Roaming in Next Generation Networks," Proc. ICC, 2009, pp. 1-5.
• [8]P. Perala and M. Varela, "Some experiences with VoIP over Converging Networks," Proc. MESAQIN, 2007, pp. 1-7.
• [9]M.-D. Cano and F. Cerdan, "Subjective QoE Analysis of VoIP Applications in a Wireless Campus Environment," Telecommunication Systems, in press, 2010. Available: http://www. springerlink.com/content/7420510843151356/
• [10]T. Hayashi et al., "Multimedia Quality Integration Function for Videophone Services," Proc. GLOBECOM, 2007, pp. 2735-2739.
• [11]L. Malfait, J. Berger, and M. Kastner, "P.563–The ITU-T Standard for Single-Ended Speech Quality Assessment," IEEE Trans. Audio, Speech, and Language Process., vol. 14, no. 6, 2006, pp. 1924-1934.
• [12]P. Calyam et al.,"A "GAP-Model"-Based Framework for Online VVoIP QoE Measurement," J. Commun. Networks, vol. 9, no. 4, 2007, pp. 446-456.
• [13]S. Tao, J. Apostolopoulus, and R. Guerin, "Real Time Monitoring of Video Quality in IP Networks,"Proc. ACM NOSSDAV, 2005.
• [14]G. Rubino and M. Varela, "A New Approach for the Prediction of End-to-End Performance of Multimedia Streams," Proc. QEST, 2004.
• [15]Skype. Available: http://www.skype.com
• [16]TeleGeography. International Carriers’ Traffic Grows Despite Skype Popularity, TeleGeography Report and Database, 2006. Available: http://www.telegeography.com
• [17]Gizmo5. Available: http://www.gizmo5.com. Last visited Oct. 28, 2009.
• [18]Global IP Solutions. Available: http://www.gipscorps.com. Last visited Oct. 28, 2009.
• [19]ooVoo. Available: http://www.oovoo.com. Last visited Oct. 28, 2009.
• [20]Damaka. Available: http://www.damaka.com. Last visited Oct. 28, 2009.
• [21]vBuzzer. Available: http://www.vbuzzer.com. Last visited Oct. 28, 2009.
• [22]S. Andersen et al., "Internet Low Bit Rate Codec (iLBC)," IETF RFC 3951, 2004.
• [23]On2 web site. Available: http://www.on2.com. Last visited Oct. 28, 2009.
• [24]F. Fitzek and M. Reisslein, "MPEG–4 and H.263 Video Traces for Network Performance Evaluation," IEEE Network, vol. 15, no. 6, 2001, pp. 40-54.
• [25]ITU-T Rec P.910 "Subjective Video Quality Assessment Methods for Multimedia Applications," Sept. 1999.
• [26]ITU-T Rec. 920, "Interactive Test Methods for Audiovisual Communications," Mar. 2000.
• [27]ITU-T Rec. P.800, "Methods for subjective determination of transmission quality," Aug. 1996.
• [28]W.L. Wilkie, Consumer Behaviour, John Wiley & Sons Inc., New York, 1994.
• [29]B.G. Tabachnick and L.S. Fidell, Using Multivariate Statistics, 3rd ed., New York: Harper Collins, 1996.
• [30]NIST/SEMATECH, "e-Handbook of Statistical Methods," 2009. Available: http://www.itl.nist.gov/div898/handbook/