The Development of a Methodology to Evaluate the Perceived Quality of Live TV Subtitles

Abstract

This paper describes the development of a methodology to measure the perceived quality of television subtitles based on well established guidelines for measuring perceived audio quality. The aim was to estimate the relative impact of reducing the delay in the appearance of live subtitles as against an increase in the accuracy of the subtitles. The results show a clear difference in the impact of timing and accuracy for our audience depending on whether they are watching television with the sound turned on or off. For those watching with sound the timing is the most important whilst for those watching with the sound off the accuracy is the key factor.

This paper was originally published at IBC2013.

White Paper copyright

© BBC. All rights reserved. Except as provided below, no part of a White Paper may be reproduced in any material form (including photocopying or storing it in any medium by electronic means) without the prior written permission of BBC Research except in accordance with the provisions of the (UK) Copyright, Designs and Patents Act 1988.

The BBC grants permission to individuals and organisations to make copies of any White Paper as a complete document (including the copyright notice) for their own internal use. No copies may be published, distributed or made available to third parties whether by paper, electronic or other means without the BBC's prior written permission.