OneClick: A Framework for Measuring Network Quality of Experience
- 1 April 2009
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 0743166X,p. 702-710
- https://doi.org/10.1109/infcom.2009.5061978
Abstract
As the service requirements of network applications shift from high throughput to high media quality, interactivity, and responsiveness, the definition of QoE (Quality of Experience) has become multidimensional. Although it may not be difficult to measure individual dimensions of the QoE, how to capture users' overall perceptions when they are using network applications remains an open question. In this paper, we propose a framework called OneClick to capture users' perceptions when they are using network applications. The framework only requires a subject to click a dedicated key whenever he/she feels dissatisfied with the quality of the application in use. OneClick is particularly effective because it is intuitive, lightweight, efficient, time-aware, and application-independent. We use two objective quality assessment methods, PESQ and VQM, to validate OneClick's ability to evaluate the quality of audio and video clips. To demonstrate the proposed framework's efficiency and effectiveness in assessing user experiences, we implement it on two applications, one for instant messaging applications, and the other for first- person shooter games. A Flash implementation of the proposed framework is also presented.Keywords
This publication has 10 references indexed in Scilit:
- Tuning Skype's Redundancy Control Algorithm for User SatisfactionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2009
- The user in experimental computer systems researchPublished by Association for Computing Machinery (ACM) ,2007
- How sensitive are online gamers to network quality?Communications of the ACM, 2006
- Quantifying Skype user satisfactionACM SIGCOMM Computer Communication Review, 2006
- The effects of latency on online madden NFL footballPublished by Association for Computing Machinery (ACM) ,2004
- Utility curves: mean opinion scores considered biasedPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- An experimental estimation of latency sensitivity in multiplayer quake 3Published by Institute of Electrical and Electronics Engineers (IEEE) ,2003
- Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Regression Modeling StrategiesPublished by Springer Nature ,2001
- Measuring perceived quality of speech and video in multimedia conferencing applicationsPublished by Association for Computing Machinery (ACM) ,1998