ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지
DOI QR코드

DOI QR Code

Statistical Analysis of a Subjective QoE Assessment for VVoIP Applications

  • Cano, Maria-Dolores (Department of Information and Communication Technologies, Technical University of Cartagena) ;
  • Cerdan, Fernando (Department of Information and Communication Technologies, Technical University of Cartagena) ;
  • Almagro, Sergio (Department of Information and Communication Technologies, Technical University of Cartagena)
  • Received : 2009.11.06
  • Accepted : 2010.09.16
  • Published : 2010.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

A successful deployment of multimedia applications over wireless environments entails improving the quality of service (QoS), not only from a technical point of view, but also considering the quality of experience (QoE) from the final user's perception. Although objective QoE measure models avoid the difficulties of subjective surveys, subjective QoE assessments are essential to understand the way users evaluate the QoS. In this work, we study the effect of a wide range of parameters on the QoE of VVoIP applications in a real wireless scenario. Through a complete statistical analysis of users' ratings, we identify the following facts. Although the use of VVoIP in wireless networks does not yet represent an advantage for users, there are great expectations for all applications under study, and with greater popularity comes higher expectations. It is easier for respondents to identify good behavior than poor behavior. Whereas the respondents' frequency of Internet use does not impact on the scores, respondents' gender does. Finally, the most determining parameters of quality from a user's perspective were instability, video quality, voice distortion, usefulness, and graphical interface.

Keywords

References

  1. ITU-T P.10/G.100 "Vocabulary for Performance and Quality of Service. Amendment 2. New Definitions for Inclusion in Recommendation ITU-T P.10/G.100," July 2008.
  2. ITU-T Rec G.1010 "End-User Multimedia QoS Categories," Nov. 2001.
  3. ANIQUE+, "Auditory Non-Intrusive Quality Estimation Plus (ANIQUE+) Perceptual Model for Non-Intrusive Estimation of Narrowband Speech Quality," ATIS-0100005.2006, ANSI, 2006.
  4. ITU-T Rec. G.107, "The E-Model: A Computational Model for Use in Transmission Planning," Apr. 2009.
  5. IEEE $P1903^{TM}$/D1 "Draft White Paper for Next Generation Service Overlay Network," May, 2008.
  6. "Challenge to All: Roadmap for the Usage of Collaboration Tools," Keith Dickerson, ETSI Board, Nov. 26, 2009.
  7. S. Moller et al., "Speech Quality while Roaming in Next Generation Networks," Proc. ICC, 2009, pp. 1-5.
  8. P. Perala and M. Varela, "Some experiences with VoIP over Converging Networks," Proc. MESAQIN, 2007, pp. 1-7.
  9. M.-D. Cano and F. Cerdan, "Subjective QoE Analysis of VoIP Applications in a Wireless Campus Environment," Telecommunication Systems, in press, 2010. Available: http://www. springerlink.com/content/7420510843151356/
  10. T. Hayashi et al., "Multimedia Quality Integration Function for Videophone Services," Proc. GLOBECOM, 2007, pp. 2735-2739.
  11. L. Malfait, J. Berger, and M. Kastner, "P.563–The ITU-T Standard for Single-Ended Speech Quality Assessment," IEEE Trans. Audio, Speech, and Language Process., vol. 14, no. 6, 2006, pp. 1924-1934. https://doi.org/10.1109/TASL.2006.883177
  12. P. Calyam et al.,"A "GAP-Model"-Based Framework for Online VVoIP QoE Measurement," J. Commun. Networks, vol. 9, no. 4, 2007, pp. 446-456. https://doi.org/10.1109/JCN.2007.6182880
  13. S. Tao, J. Apostolopoulus, and R. Guerin, "Real Time Monitoring of Video Quality in IP Networks,"Proc. ACM NOSSDAV, 2005.
  14. G. Rubino and M. Varela, "A New Approach for the Prediction of End-to-End Performance of Multimedia Streams," Proc. QEST, 2004.
  15. Skype. Available: http://www.skype.com
  16. TeleGeography. International Carriers' Traffic Grows Despite Skype Popularity, TeleGeography Report and Database, 2006. Available: http://www.telegeography.com
  17. Gizmo5. Available: http://www.gizmo5.com. Last visited Oct. 28, 2009.
  18. Global IP Solutions. Available: http://www.gipscorps.com. Last visited Oct. 28, 2009.
  19. ooVoo. Available: http://www.oovoo.com. Last visited Oct. 28, 2009.
  20. Damaka. Available: http://www.damaka.com. Last visited Oct. 28, 2009.
  21. vBuzzer. Available: http://www.vbuzzer.com. Last visited Oct. 28, 2009.
  22. S. Andersen et al., "Internet Low Bit Rate Codec (iLBC)," IETF RFC 3951, 2004.
  23. On2 web site. Available: http://www.on2.com. Last visited Oct. 28, 2009.
  24. F. Fitzek and M. Reisslein, "MPEG–4 and H.263 Video Traces for Network Performance Evaluation," IEEE Network, vol. 15, no. 6, 2001, pp. 40-54. https://doi.org/10.1109/65.967596
  25. ITU-T Rec P.910 "Subjective Video Quality Assessment Methods for Multimedia Applications," Sept. 1999.
  26. ITU-T Rec. 920, "Interactive Test Methods for Audiovisual Communications," Mar. 2000.
  27. ITU-T Rec. P.800, "Methods for subjective determination of transmission quality," Aug. 1996.
  28. W.L. Wilkie, Consumer Behaviour, John Wiley & Sons Inc., New York, 1994.
  29. B.G. Tabachnick and L.S. Fidell, Using Multivariate Statistics, 3rd ed., New York: Harper Collins, 1996.
  30. NIST/SEMATECH, "e-Handbook of Statistical Methods," 2009. Available: http://www.itl.nist.gov/div898/handbook/

Cited by

  1. Lightweight Quality Metric Based on No-Reference Bitstream for H.264/AVC Video vol.6, pp.5, 2010, https://doi.org/10.3837/tiis.2012.05.008
  2. QoE assessment model for multimedia streaming services using QoS parameters vol.72, pp.3, 2014, https://doi.org/10.1007/s11042-013-1507-8