Subjective video quality


Subjective video quality

Subjective video quality is a subjective characteristic of video quality. It is concerned with how video is perceived by a viewer and designates his or her opinion on a particular video sequence. Subjective video quality tests are quite expensive in terms of time (preparation and running) and human resources.

Measurement

The main idea of measuring subjective video quality is the same as in the Mean Opinion Score for audio.To evaluate the subjective video quality of a video processing system:

*Choose video sequences for testing (they are often named SRC).
*Choose settings of system that you want to evaluate (often named HRC or Hyperthetical Reference Circuit).
*Choose a test method (how sequences are presented to experts and how their opinion is collected: DSCQS, SSCQE, DSCS).
*Invite sufficient number of experts (18 or more is recommended).
*Carry out testing.
*Calculate average marks for each HRC based on experts' opinion.

Many parameters of the viewing conditions can influence the results, such as room illumination, display type, brightness, contrast, resolution, viewing distance, and the age and educational level of experts.

Testing methods

There are an enormous number of ways of showing video sequences to experts and to record their opinions. A few of them have been standardized. They are thoroughly described in ITU-R recommendation BT.500. One of the standardized methods is DSIS - Double Stimulus Impairment Scale: the expert is presented with an unimpaired reference video, then with the same video impaired, and after that he is asked to vote on the second video using an impairment scale (from "impairments are imperceptible" to "impairments are very annoying").

Further refined testing methods to take into account low picture resolutions (VGA, CIF and QCIF), e.g. for mobile and multimedia applications are referred to in ITU-T Rec. P.910. Advanced setups for typical artefacts of high resolution (HDTV), e.g. in next generation networks incl. IPTV are also under development within the Video Quality Experts Group (VQEG).

Analysis of results

Opinions of experts can be averaged; average mark is usually given with confidence interval. Additional procedures can be used for averaging, for example experts who give unstable results can be rejected (for instance, if their correlation with average opinion is small)...

ee also

* Video quality
* Quality
* Mean Opinion Score
* PSNR
* Perceptual Evaluation of Video Quality (PEVQ)
* MDI
* SSIM

Further reading

* [http://bellerofonte.dii.unisi.it/dottorato/corsi/corsi2003/Perceptual%20Image%20Modeling/Further_readings/Part4/ITU-R_BT.500-11.pdf ITU-R BT.500-11 Recommendation: Methodology for the subjective assessment of the quality of television pictures]
* [http://www.its.bldrdoc.gov/pub/n3/video/spie03subj.pdf Comparing subjective video quality testing methodologies]
* [http://www.shenick.com/pdfs/Testing_MPEG_IPTV_VOD_QOE.pdf IPTV MPEG and Quality of Experience Testing]

External links

* [http://www.itu.int/rec/recommendation.asp?type=products&lang=e&parent=R-REC-BT ITU-T page with recommendations on subjective video quality assessments]
* [http://www.its.bldrdoc.gov/vqeg/ Video Quality Experts Group]


Wikimedia Foundation. 2010.

Look at other dictionaries:

  • Video quality — is a characteristic of a video passed through a video transmission/processing system, a formal or informal measure of perceived video degradation (typically, compared to the original video). Video processing systems may introduce some amounts of… …   Wikipedia

  • Video compression — refers to reducing the quantity of data used to represent video images and is a straightforward combination of image compression and motion compensation. This article deals with its applications: compressed video can effectively reduce the… …   Wikipedia

  • Quality of service — In the field of computer networking and other packet switched telecommunication networks, the traffic engineering term quality of service (QoS) refers to resource reservation control mechanisms rather than the achieved service quality. Quality of …   Wikipedia

  • Video — For films or movies, see Film. For other uses, see Video (disambiguation). For the use of video in Wikipedia articles, see Wikipedia:Creation and usage of media files. Video is the technology of electronically capturing, recording, processing,… …   Wikipedia

  • Video codec — A video codec is a device or software that enables video compression and/or decompression for digital video. The compression usually employs lossy data compression. Historically, video was stored as an analog signal on magnetic tape. Around the… …   Wikipedia

  • Quality (pragmatics) — Quality in business, engineering and manufacturing has a pragmatic interpretation as the non inferiority or superiority of something. This is the most common interpretation of the term quality.Many different techniques and concepts have evolved… …   Wikipedia

  • Quality (business) — This article is about quality in a business context. For other uses, see Quality. Quality in business, engineering and manufacturing has a pragmatic interpretation as the non inferiority or superiority of something. Quality is a perceptual,… …   Wikipedia

  • Quality — In the vernacular, quality can mean a high degree of excellence (“a quality product”), a degree of excellence or the lack of it (“work of average quality”), or a property of something (“the addictive quality of alcohol”). [The third meaning… …   Wikipedia

  • Quality of experience — (QoE), some times also known as Quality of User Experience, is a subjective measure of a customer s experiences with a vendor. It looks at a vendor s or purveyor s offering from the standpoint of the customer or end user, and asks, What mix of… …   Wikipedia

  • Quality television — (also called quality TV ) is a term used by television scholars [Dr. David Lavery (the Chair in Film and Television at Brunel University in London); Dr Janet McCabe (Trinity College, Dublin);Kim Akass (London Metropolitan University); and Kristin …   Wikipedia