TECHNICAL ISO/IEC TR REPORT 29170-1 First edition 2017-10 Information technology Advanced image coding and evaluation - Part 1: Guidelines for image coding system evaluation Technologies de I'information - Codage d'image avancé et évaluation Partie 1: Lignes directices pour I'évaluation des systemes de codage d'image Reference number IEC IS0/IEC TR29170-1:2017(E) s @IS0/IEC2017 JACKEY, MA ut license from IHS IS0/IECTR 29170-1:2017(E) COPYRIGHTPROTECTEDDOCUMENT IS0/IEC 2017, Published in Switzerland All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized otherwise in any form written permission. Permission can be requested from either ISO at the address below or ISO's member body in the country of the requester. IsO copyright office Ch. de Blandonnet 8 . CP 401 CH-1214 Vernier, Geneva, Switzerland Tel. +41 22 749 01 11 Fax +41 22 749 09 47 [email protected] www.iso.org @ IS0/IEC 2017 - All rights reserved licensee=NanyangTechnological Univ/5926867100,User=JACKEY,MA No reproductic r networking permitted without license from IHS IS0/IEC TR 29170-1:2017(E) Contents Page Foreword ..iv Introduction. ..V 1 Scope. 2 Normative references ..1 3 Terms and definitions 4 Abbreviated terms ..3 5 Selection and characteristics of test images .4 5.1 Common image characteristics 4 5.2 Bits per pixel .5 5.3 Compression ratio .5 5.4 Variation in bit rates. .5 5.4.1 Constant bit rate systems .5 5.4.2 Variable bit rate systems. .5 5.5 Error resilience 6 5.6 Recursive compression assessment .6 5.7 Image selection. . 6 6 Best practices of subjective image quality assessments .7 6.1 Goals of subjective assessment .7 6.2 Subjective assessment evaluation procedures .1 6.2.1 Observer selection .7 6.2.2 Visual acuity .7 6.2.3 Number of observers. .7 6.2.4 Instructions to observers ..8 6.2.5 Evaluation scales. .8 6.2.6 Statistical analysis .8 6.3 Viewing conditions for electronic displays ..8 6.3.1 Purpose ..8 6.3.2 ISO3664 .9 6.3.3 ISO9241 .9 6.4 Goals for evaluation of visually lossless and nearly lossless coding. .9 7 Best practices of objective image quality assessment methodology .9 AnnexA(informative)Subjectivemetrics .11 Annex B (informative) Objective metrics. ..14 Annex C (informative) Computational metrics. ..19 Annex D (informative) Verification of codec characteristics ..31 Bibliography .34 iii JACKEY, MA thout license from IHS