logo资料库

ISO_IEC_14496-12_2015.pdf

第1页 / 共248页
第2页 / 共248页
第3页 / 共248页
第4页 / 共248页
第5页 / 共248页
第6页 / 共248页
第7页 / 共248页
第8页 / 共248页
资料共248页,剩余部分请下载后查看
INTERNATIONAL STANDARD ISO/IEC 14496-12 Fifth edition 2015‐12‐15 Information technology — Coding of audio- visual objects — Part 12: ISO base media file format Technologies de l'information — Codage des objets audiovisuels — Partie 12: Format ISO de base pour les fichiers médias Reference number ISO/IEC 14496‐12:2015(E) © ISO/IEC 2015
ISO/IEC 14496-12:2015(E) COPYRIGHT PROTECTED DOCUMENT © ISO/IEC 2015 All rights reserved. Unless otherwise specified, no part of this publication may be reproduced or utilized in any form or by any means, electronic or mechanical, including photocopying and microfilm, without permission in writing from either ISO at the address below or ISO's member body in the country of the requester. ISO copyright office Case postale 56  CH‐1211 Geneva 20 Tel. + 41 22 749 01 11 Fax + 41 22 749 09 47 E‐mail copyright@iso.org Web www.iso.org Published in Switzerland ii © ISO/IEC 2015 – All rights reserved
ISO/IEC 14496-12:2015(E) Contents Page 1 Scope .......................................................................................................................................................................... 1 2 Normative references .......................................................................................................................................... 1 3 Terms, definitions, and abbreviated terms .................................................................................................. 3 3.1 Terms and definitions ...................................................................................................................................... 3 3.2 Abbreviated terms ............................................................................................................................................. 5 4 Object-structured File Organization ............................................................................................................... 6 4.1 File Structure ....................................................................................................................................................... 6 4.2 Object Structure .................................................................................................................................................. 6 4.3 File Type Box ....................................................................................................................................................... 7 5 Design Considerations ......................................................................................................................................... 8 5.1 Usage ....................................................................................................................................................................... 8 5.1.1 Introduction ..................................................................................................................................................... 8 Interchange ....................................................................................................................................................... 8 5.1.2 5.1.3 Content Creation ............................................................................................................................................. 9 5.1.4 Preparation for streaming ........................................................................................................................ 10 5.1.5 Local presentation ....................................................................................................................................... 10 5.1.6 Streamed presentation ............................................................................................................................... 10 5.2 Design principles ............................................................................................................................................. 11 ISO Base Media File organization .................................................................................................................. 12 6 6.1 Presentation structure ................................................................................................................................... 12 6.1.1 File Structure ................................................................................................................................................. 12 6.1.2 Object Structure ............................................................................................................................................ 12 6.1.3 Meta Data and Media Data ........................................................................................................................ 12 6.1.4 Track Identifiers ........................................................................................................................................... 12 6.2 Metadata Structure (Objects) ...................................................................................................................... 13 6.2.1 Box ..................................................................................................................................................................... 13 6.2.2 Data Types and fields .................................................................................................................................. 13 6.2.3 Box Order ........................................................................................................................................................ 14 6.2.4 URIs as type indicators ............................................................................................................................... 17 6.3 Brand Identification ........................................................................................................................................ 17 7 Streaming Support .............................................................................................................................................. 18 7.1 Handling of Streaming Protocols ............................................................................................................... 18 7.2 Protocol ‘hint’ tracks ....................................................................................................................................... 18 7.3 Hint Track Format ........................................................................................................................................... 19 8 Box Structures ...................................................................................................................................................... 20 8.1 File Structure and general boxes ................................................................................................................ 20 8.1.1 Media Data Box .............................................................................................................................................. 20 8.1.2 Free Space Box ............................................................................................................................................... 21 iii © ISO/IEC 2015 – All rights reserved
ISO/IEC 14496-12:2015(E) 8.1.3 Progressive Download Information Box ............................................................................................. 21 8.2 Movie Structure ................................................................................................................................................ 22 8.2.1 Movie Box ........................................................................................................................................................ 22 8.2.2 Movie Header Box ........................................................................................................................................ 22 8.3 Track Structure ................................................................................................................................................ 24 8.3.1 Track Box ........................................................................................................................................................ 24 8.3.2 Track Header Box ........................................................................................................................................ 24 8.3.3 Track Reference Box ................................................................................................................................... 26 8.3.4 Track Group Box .......................................................................................................................................... 27 8.4 Track Media Structure ................................................................................................................................... 28 8.4.1 Media Box ....................................................................................................................................................... 28 8.4.2 Media Header Box ........................................................................................................................................ 29 8.4.3 Handler Reference Box .............................................................................................................................. 29 8.4.4 Media Information Box .............................................................................................................................. 30 8.4.5 Media Information Header Boxes .......................................................................................................... 30 8.4.6 Extended language tag ............................................................................................................................... 31 8.5 Sample Tables ................................................................................................................................................... 32 8.5.1 Sample Table Box ......................................................................................................................................... 32 8.5.2 Sample Description Box ............................................................................................................................. 32 8.5.3 Degradation Priority Box .......................................................................................................................... 34 8.5.4 Sample Scale Box .......................................................................................................................................... 35 8.6 Track Time Structures ................................................................................................................................... 35 8.6.1 Time to Sample Boxes ................................................................................................................................ 35 8.6.2 Sync Sample Box ........................................................................................................................................... 40 8.6.3 Shadow Sync Sample Box .......................................................................................................................... 40 Independent and Disposable Samples Box ......................................................................................... 41 8.6.4 8.6.5 Edit Box ............................................................................................................................................................ 43 8.6.6 Edit List Box ................................................................................................................................................... 43 8.7 Track Data Layout Structures ..................................................................................................................... 45 8.7.1 Data Information Box ................................................................................................................................. 45 8.7.2 Data Reference Box ..................................................................................................................................... 45 8.7.3 Sample Size Boxes ........................................................................................................................................ 47 8.7.4 Sample To Chunk Box ................................................................................................................................. 48 8.7.5 Chunk Offset Box .......................................................................................................................................... 49 8.7.6 Padding Bits Box .......................................................................................................................................... 49 8.7.7 Sub-Sample Information Box ................................................................................................................... 50 8.7.8 Sample Auxiliary Information Sizes Box ............................................................................................. 51 8.7.9 Sample Auxiliary Information Offsets Box ......................................................................................... 53 8.8 Movie Fragments ............................................................................................................................................. 54 8.8.1 Movie Extends Box ....................................................................................................................................... 54 8.8.2 Movie Extends Header Box ....................................................................................................................... 54 8.8.3 Track Extends Box ....................................................................................................................................... 55 8.8.4 Movie Fragment Box ................................................................................................................................... 56 8.8.5 Movie Fragment Header Box ................................................................................................................... 56 8.8.6 Track Fragment Box .................................................................................................................................... 57 8.8.7 Track Fragment Header Box .................................................................................................................... 57 iv © ISO/IEC 2015 – All rights reserved
ISO/IEC 14496-12:2015(E) 8.8.8 Track Fragment Run Box ........................................................................................................................... 58 8.8.9 Movie Fragment Random Access Box .................................................................................................... 60 8.8.10 Track Fragment Random Access Box ................................................................................................. 60 8.8.11 Movie Fragment Random Access Offset Box .................................................................................... 61 8.8.12 Track fragment decode time .................................................................................................................. 62 8.8.13 Level Assignment Box .............................................................................................................................. 63 8.8.14 Sample Auxiliary Information in Movie Fragments ...................................................................... 65 8.8.15 Track Extension Properties Box ........................................................................................................... 65 8.8.16 Alternative Startup Sequence Properties Box ................................................................................. 66 8.8.17 Metadata and user data in movie fragments ................................................................................... 66 8.9 Sample Group Structures .............................................................................................................................. 67 8.9.1 Introduction ................................................................................................................................................... 67 8.9.2 Sample to Group Box ................................................................................................................................... 68 8.9.3 Sample Group Description Box ................................................................................................................ 69 8.9.4 Representation of group structures in Movie Fragments .............................................................. 70 8.10 User Data .......................................................................................................................................................... 71 8.10.1 User Data Box .............................................................................................................................................. 71 8.10.2 Copyright Box .............................................................................................................................................. 72 8.10.3 Track Selection Box ................................................................................................................................... 72 8.10.4 Track kind .................................................................................................................................................... 74 8.11 Metadata Support .......................................................................................................................................... 75 8.11.1 The Meta box ............................................................................................................................................... 75 8.11.2 XML Boxes ..................................................................................................................................................... 76 8.11.3 The Item Location Box ............................................................................................................................. 77 8.11.4 Primary Item Box ....................................................................................................................................... 80 Item Protection Box .................................................................................................................................. 80 8.11.5 8.11.6 Item Information Box ............................................................................................................................... 81 8.11.7 Additional Metadata Container Box .................................................................................................... 83 8.11.8 Metabox Relation Box .............................................................................................................................. 84 8.11.9 URL Forms for meta boxes ...................................................................................................................... 85 8.11.10 Static Metadata ......................................................................................................................................... 85 8.11.11 Item Data Box ........................................................................................................................................... 86 Item Reference Box ................................................................................................................................. 87 8.11.12 8.11.13 Auxiliary video metadata ..................................................................................................................... 88 8.12 Support for Protected Streams ................................................................................................................. 88 8.12.1 Protection Scheme Information Box ................................................................................................... 89 8.12.2 Original Format Box .................................................................................................................................. 90 8.12.3 IPMPInfoBox ................................................................................................................................................ 90 8.12.4 IPMP Control Box ....................................................................................................................................... 90 8.12.5 Scheme Type Box ....................................................................................................................................... 90 8.12.6 Scheme Information Box ......................................................................................................................... 91 8.13 File Delivery Format Support .................................................................................................................... 91 Introduction ................................................................................................................................................. 91 8.13.1 8.13.2 FD Item Information Box ......................................................................................................................... 92 8.13.3 File Partition Box ....................................................................................................................................... 92 8.13.4 FEC Reservoir Box ...................................................................................................................................... 94 v © ISO/IEC 2015 – All rights reserved
ISO/IEC 14496-12:2015(E) 8.13.5 FD Session Group Box .............................................................................................................................. 95 8.13.6 Group ID to Name Box .............................................................................................................................. 96 8.13.7 File Reservoir Box ..................................................................................................................................... 96 8.14 Sub tracks ........................................................................................................................................................ 97 8.14.1 Introduction ................................................................................................................................................ 97 8.14.2 Backward compatibility .......................................................................................................................... 97 8.14.3 Sub Track box ............................................................................................................................................. 98 8.14.4 Sub Track Information box .................................................................................................................... 98 8.14.5 Sub Track Definition box ...................................................................................................................... 100 8.14.6 Sub Track Sample Group box .............................................................................................................. 100 8.15 Post-decoder requirements on media ................................................................................................. 100 8.15.1 General ........................................................................................................................................................ 100 8.15.2 Transformation ........................................................................................................................................ 101 8.15.3 Restricted Scheme Information box ................................................................................................. 102 8.15.4 Scheme for stereoscopic video arrangements .............................................................................. 102 8.16 Segments ........................................................................................................................................................ 104 8.16.1 Introduction .............................................................................................................................................. 104 8.16.2 Segment Type Box ................................................................................................................................... 104 8.16.3 Segment Index Box .................................................................................................................................. 105 8.16.4 Subsegment Index Box .......................................................................................................................... 109 8.16.5 Producer Reference Time Box ............................................................................................................ 111 8.17 Support for Incomplete Tracks .............................................................................................................. 112 8.17.1 General ........................................................................................................................................................ 112 8.17.2 Transformation ........................................................................................................................................ 113 8.17.3 Complete Track Information Box ...................................................................................................... 114 9 Hint Track Formats .......................................................................................................................................... 114 9.1 RTP and SRTP Hint Track Format ........................................................................................................... 114 9.1.1 Introduction ................................................................................................................................................. 114 9.1.2 Sample Description Format ................................................................................................................... 115 9.1.3 Sample Format ............................................................................................................................................ 117 9.1.4 SDP Information ......................................................................................................................................... 119 9.1.5 Statistical Information ............................................................................................................................. 120 9.2 ALC/LCT and FLUTE Hint Track Format ................................................................................................ 121 9.2.1 Introduction ................................................................................................................................................. 121 9.2.2 Design principles ....................................................................................................................................... 122 9.2.3 Sample Description Format ................................................................................................................... 123 9.2.4 Sample Format ............................................................................................................................................ 124 9.3 MPEG-2 Transport Hint Track Format ................................................................................................... 127 Introduction ................................................................................................................................................. 127 9.3.1 9.3.2 Design Principles ....................................................................................................................................... 128 9.3.3 Sample Description Format ................................................................................................................... 130 9.3.4 Sample Format ............................................................................................................................................ 132 9.3.5 Protected MPEG 2 Transport Stream Hint Track ........................................................................... 134 9.4 RTP, RTCP, SRTP and SRTCP Reception Hint Tracks ........................................................................ 134 9.4.1 RTP Reception Hint Track ...................................................................................................................... 134 vi © ISO/IEC 2015 – All rights reserved
ISO/IEC 14496-12:2015(E) 9.4.2 RTCP Reception Hint Track ................................................................................................................... 138 9.4.3 SRTP Reception Hint Track .................................................................................................................... 140 9.4.4 SRTCP Reception Hint Tracks ............................................................................................................... 142 9.4.5 Protected RTP Reception Hint Track ................................................................................................. 143 9.4.6 Recording Procedure ............................................................................................................................... 143 9.4.7 Parsing Procedure .................................................................................................................................... 143 10 Sample Groups ................................................................................................................................................ 143 10.1 Random Access Recovery Points .......................................................................................................... 143 10.2 Rate Share Groups ...................................................................................................................................... 144 10.2.1 Introduction .............................................................................................................................................. 144 10.2.2 Rate Share Sample Group Entry ........................................................................................................ 146 10.2.3 Relationship between tracks .............................................................................................................. 147 10.2.4 Bitrate allocation .................................................................................................................................... 147 10.3 Alternative Startup Sequences .............................................................................................................. 148 10.3.4 Examples .................................................................................................................................................... 149 10.4 Random Access Point (RAP) Sample Grouping ................................................................................ 151 10.5 Temporal level sample grouping .......................................................................................................... 152 10.6 Stream access point sample group ....................................................................................................... 152 11 Extensibility ..................................................................................................................................................... 153 11.1 Objects ............................................................................................................................................................ 153 11.2 Storage formats ........................................................................................................................................... 154 11.3 Derived File formats .................................................................................................................................. 154 12 Media-specific definitions ........................................................................................................................... 155 12.1 Video media .................................................................................................................................................. 155 12.1.1 Media handler .......................................................................................................................................... 155 12.1.2 Video media header ............................................................................................................................... 155 12.1.3 Sample entry ............................................................................................................................................. 156 12.1.4 Pixel Aspect Ratio and Clean Aperture ........................................................................................... 156 12.1.5 Colour information ................................................................................................................................. 158 12.2 Audio media ................................................................................................................................................. 159 12.2.1 Media handler .......................................................................................................................................... 159 12.2.2 Sound media header .............................................................................................................................. 159 12.2.3 Sample entry ............................................................................................................................................. 160 12.2.4 Channel layout ......................................................................................................................................... 162 12.2.5 Downmix Instructions ........................................................................................................................... 163 12.2.6 DRC Information ..................................................................................................................................... 165 12.2.7 Audio stream loudness ......................................................................................................................... 165 12.3 Metadata media ........................................................................................................................................... 167 12.3.1 Media handler .......................................................................................................................................... 167 12.3.2 Media header ............................................................................................................................................ 167 12.3.3 Sample entry ............................................................................................................................................. 167 12.4 Hint media ..................................................................................................................................................... 169 12.4.1 Media handler .......................................................................................................................................... 169 12.4.2 Hint media header .................................................................................................................................. 169 12.4.3 Sample entry ............................................................................................................................................. 170 vii © ISO/IEC 2015 – All rights reserved
ISO/IEC 14496-12:2015(E) 12.5 Text media ..................................................................................................................................................... 170 12.5.1 Media handler ........................................................................................................................................... 170 12.5.2 Media header ............................................................................................................................................ 170 12.5.3 Sample entry ............................................................................................................................................. 170 12.6 Subtitle media .............................................................................................................................................. 171 12.6.1 Media handler ........................................................................................................................................... 171 12.6.2 Subtitle media header ........................................................................................................................... 171 12.6.3 Sample entry ............................................................................................................................................. 171 12.7 Font media ..................................................................................................................................................... 172 12.7.1 Media handler ........................................................................................................................................... 172 12.7.2 Media header ............................................................................................................................................ 172 12.7.3 Sample entry ............................................................................................................................................. 172 12.8 Transformed media ................................................................................................................................... 172 Annex A (informative) Overview and Introduction ..................................................................................... 173 A.1 Section Overview ........................................................................................................................................... 173 A.2 Core Concepts ................................................................................................................................................. 173 A.3 Physical structure of the media ............................................................................................................... 174 A.4 Temporal structure of the media ............................................................................................................ 174 Interleave ......................................................................................................................................................... 175 A.5 A.6 Composition .................................................................................................................................................... 175 A.7 Random access ............................................................................................................................................... 175 A.8 Fragmented movie files ............................................................................................................................... 176 Annex B (void) ........................................................................................................................................................... 178 Annex C (informative) Guidelines on deriving from this specification ................................................ 179 Introduction .................................................................................................................................................... 179 C.1 C.2 General Principles ......................................................................................................................................... 179 C.2.1 General ........................................................................................................................................................... 179 C.2.2 Base layer operations ............................................................................................................................... 180 C.3 Boxes .................................................................................................................................................................. 180 C.4 Brand Identifiers ........................................................................................................................................... 181 C.4.1 Introduction ................................................................................................................................................. 181 C.4.2 Usage of the Brand ..................................................................................................................................... 181 C.4.3 Introduction of a new brand .................................................................................................................. 182 C.4.4 Player Guideline ......................................................................................................................................... 182 C.4.5 Authoring Guideline .................................................................................................................................. 182 C.4.6 Example ......................................................................................................................................................... 183 C.5 Storage of new media types ....................................................................................................................... 183 C.6 Use of Template fields .................................................................................................................................. 183 C.7 Tracks ................................................................................................................................................................ 184 C.7.1 Data Location ............................................................................................................................................... 184 C.7.2 Time ................................................................................................................................................................ 184 C.7.3 Media Types ................................................................................................................................................. 185 C.7.4 Coding Types ................................................................................................................................................ 185 C.7.5 Sub-sample information .......................................................................................................................... 185 C.7.6 Sample Dependency .................................................................................................................................. 185 viii © ISO/IEC 2015 – All rights reserved
分享到:
收藏