JP2006217602A - Information recording medium, apparatus and method for recording information into information recording medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information recording medium in which video information and audio information are recorded by being encoded to a video elementary stream and an audio elementary stream, respectively and multiplexed to a system stream. <P>SOLUTION: The information recording medium is provided with a constrained format which enables conversion from a first stream (for example, MPEG-TS) to a second stream (for example, MPEG-PS). The constrained format defines that a plurality of first packets are managed as a multiplexing unit 402 and the first one (AF#8) of complete audio frames in the multiplexing unit is the first one of audio frames in a payload of a second packet 413. Encoding information indicating whether or not the first one of complete audio frames in the multiplexing unit is the first one of audio frames in the payload of the second packet is stored in the system stream. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a readable / writable information recording medium, and more particularly to an information recording medium on which multimedia data including data of various formats such as moving image data, still image data, audio data, and data broadcasting is recorded. Furthermore, the present invention relates to an apparatus and method for recording information on such an information recording medium.

  In the field of rewritable optical discs, the upper limit of which is about 650 MB, a phase change disc DVD-RAM having a capacity of several GB has appeared. Combined with the practical application of MPEG (MPEG2), which is an encoding standard for digital AV data, DVD-RAM is expected as a recording / reproducing medium not only for computer use but also in the audio / video (AV) technical field.

  Recently, digital broadcasting has been started in Japan, and it is possible to simultaneously multiplex and send video, audio and data of multiple programs on an MPEG transport stream (hereinafter referred to as “MPEG-TS”). Digital broadcast recording devices using HDD and DVD are becoming widespread.

  Such next-generation digital broadcast recorders often record MPEG-TS as it is without conversion, in accordance with the form of digital broadcasting, and record externally input AV data as self-recording. Even in this case, it is expected that the recording is performed in MPEG-TS so that both the MPEG program stream (hereinafter referred to as “MPEG-PS”) and MPEG-TS need not be handled in the recorder.

  On the other hand, the current DVD logic standard (DVD-Video standard, DVD-Audio standard, DVD Video Recording standard, DVD Stream Recording standard, etc.) uses the MPEG-PS format for the recording method of the AV stream. When converting content recorded in MPEG-TS format, such as a digital broadcast compatible recorder, to DVD-Video format, for example, conversion from MPEG-TS to MPEG-PS format (TS2PS conversion) is essential. (See, for example, JP-A-2002-344888).

  However, in order to convert a stream multiplexed by MPEG-TS to MPEG-PS, it is necessary to recalculate the complicated buffer management of the decoder, and it takes time to convert TS2PS, and the elementary stream is re-encoded. As a result, the image quality and sound quality may be deteriorated, which is difficult to handle.

  The present invention has been made to solve the above-mentioned problems, and the object of the present invention is to enable easy and high-speed conversion when converting content recorded in the MPEG-TS format into the MPEG-PS format. An object of the present invention is to provide an information recording medium recorded in the MPEG-TS format and an apparatus and method for recording data on such an information recording medium.

  In a first aspect of the present invention, there is provided an information recording medium in which video information and audio information are encoded into a video elementary stream and an audio elementary stream, respectively, and multiplexed and recorded in a system stream.

  In the information recording medium, a first format (TS) and a second format (PS) are allowed for the system stream. The first format (TS) has a packet structure in which data is divided into first packets and stored. The second format (PS) has a pack structure in which data is divided and stored in packs. The pack size is larger than the size of the first packet. The first packet divides and stores the second packet for storing video information and audio information. The second packet stores at least one audio frame. For the first format (TS), a restricted format for converting the system stream from the first format (TS) to the second format (PS) is allowed.

  According to the restriction format, a predetermined number of first packets are grouped and managed as a multiplexing unit, and the total data area size of the packets managed as the multiplexing unit is the size of the data area stored in the pack The smaller, first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet. Further, encoded information indicating whether or not the first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet is stored in the system stream.

  In a second aspect of the present invention, an information recording apparatus for encoding video information and audio information into a system stream and recording the information on an information recording medium is provided.

  The system stream is allowed to have a first format (TS) and a second format (PS). The information recording apparatus performs a predetermined encoding on the video information and the audio information based on the first format (TS), and generates a video elementary stream and an audio elementary stream; Second encoding means for performing system encoding for multiplexing a video elementary stream and an audio elementary stream to generate a system stream based on the format (TS) of the above, and control means for controlling the first and second encoding means With.

  For the first format (TS), a restricted format for converting the system stream from the first format (TS) to the second format (PS) is allowed.

  The control unit controls each of the first and second encoding units to encode in the restricted format.

  The first format (TS) has a packet structure in which data is divided into first packets and stored. The second format (PS) has a pack structure in which data is divided and stored in packs. The pack size is larger than the size of the first packet. The first packet divides and stores a second packet that stores video information and audio information, and the second packet stores at least one audio frame.

  According to the restriction format, a predetermined number of first packets are grouped and managed as a multiplexing unit, and the total data area size of the packets managed as the multiplexing unit is the size of the data area stored in the pack The smaller, first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet. Further, encoded information indicating whether or not the first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet is stored in the system stream.

  In a third aspect of the present invention, an information recording method for encoding video information and audio information into a system stream and recording the information on an information recording medium is provided.

  The system stream is allowed to have a first format (TS) and a second format (PS). For the first format (TS), a restricted format for converting the system stream from the first format (TS) to the second format (PS) is allowed. The first format (TS) has a packet structure in which data is divided into first packets and stored. The second format (PS) has a pack structure in which data is divided and stored in packs. The pack size is larger than the size of the first packet. The first packet divides and stores a second packet that stores video information and audio information, and the second packet stores at least one audio frame.

  The information recording method performs predetermined encoding on video information and audio information based on a restriction format (TS), generates a video elementary stream and an audio elementary stream, and generates a video elementary stream based on the restriction format (TS). A system encoding for generating a system stream is performed by multiplexing the elementary stream and the audio elementary stream, and a predetermined number of the first packets are grouped and managed as a multiplexing unit. The total size of the data areas of the packets managed as the multiplexing unit is smaller than the size of the data area stored in the pack. The first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet. Further, encoded information indicating whether or not the first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet is stored in the system stream.

  According to the present invention, by referring to the encoding information stored in the system stream, the complete audio frame starting first in the multiplexing unit is the first in the payload of the PES packet in the multiplexing unit. It can be easily determined whether or not video information is recorded so as to be an audio frame. For this reason, a simple and high-speed conversion process can be realized at the time of conversion from recorded video information to a DVD-Video VOB.

  Hereinafter, a DVD disk, a DVD recorder, and a DVD player, which are embodiments of an information recording medium, a recording apparatus, and a reproducing apparatus according to the present invention, will be described in the following order with reference to the accompanying drawings.

In particular, the points of the invention will be described in “8. Summary of Invention” and “9. Detailed Embodiment”. Although the degree of association is different, all are embodiments of the present invention.
1. 1. System overview of DVD recorder device 2. Functional overview of the DVD recorder device Overview of DVD disc 4. 4. Outline of reproduced AV information Overview of AV information management information and playback control 6. 6. Basic operation of playback function Basic operation of recording function 8. Summary of the Invention Detailed embodiment

  Hereinafter, for convenience of explanation, conversion from an MPEG transport stream (MPEG-TS) to an MPEG program stream (MPEG-PS) is referred to as “TS2PS conversion”. In addition, the DVD-Video standard format and the DVD-Video Recording standard format, which are MPEG-PS formats, are collectively referred to as “DVD format”.

(1. System overview of DVD recorder device)
FIG. 1 is a diagram for explaining an example of an interface between an external appearance of a DVD recorder device and related devices.

  As shown in FIG. 1, a DVD, which is an optical disk, is loaded on a DVD recorder, and video information is recorded and reproduced. The operation is generally performed with a remote controller.

  The video information input to the DVD recorder includes both an analog signal and a digital signal. The analog signal includes analog broadcast, and the digital signal includes digital broadcast. In general, an analog broadcast is received and demodulated by a receiver built in the television apparatus and input to a DVD recorder as an analog video signal such as NTSC, and a digital broadcast is an STB (Set Top Box) which is a receiver. Are demodulated into digital signals and input to a DVD recorder for recording.

  On the other hand, a DVD disc on which video information is recorded is reproduced by a DVD recorder and output to the outside. Similarly to the input, both the analog signal and the digital signal are output. If the signal is an analog signal, the signal is directly input to the television device. If the signal is a digital signal, the signal is input to the television device via the STB and then converted to the analog signal. The video is input and displayed on the television device.

  Further, video information may be recorded / reproduced on / from a DVD disc by a DVD camcorder other than the DVD recorder or a personal computer. Even if it is a DVD disc on which video information is recorded outside the DVD recorder, the DVD recorder reproduces it if it is loaded in the DVD recorder.

  Note that audio information is usually attached to the video information of the above-described analog broadcast and digital broadcast. The accompanying audio information is similarly recorded and reproduced by the DVD recorder. The video information is generally a moving image, but may be a still image. For example, this is the case when a still image is recorded by the photo function of a DVD camcorder.

  The digital I / F between the STB and the DVD recorder can be IEEE 1394, ATAPI, SCSI, or the like.

  In addition, although NTSC which is a composite video signal was illustrated between a DVD recorder and a television apparatus, the component signal which transmits a luminance signal and a color difference signal separately may be sufficient. Furthermore, the video transmission I / F between the AV equipment and the television apparatus has been researched and developed to replace the analog I / F with a digital I / F, for example, DVI, and the DVD recorder and the television apparatus are digital I / F. Of course, it is expected to be connected by / F.

(2. Function overview of DVD recorder device)
FIG. 2 is a block diagram showing functions of the DVD recorder device. The drive device includes an optical pickup 101 that reads data from the DVD-RAM disc 100, an ECC (Error Correcting Code) processing unit 102, a track buffer 103, a switch 104 that switches input / output of the track buffer 103, an encoder unit 105, and a decoder unit 106. Is provided.

  As shown in the figure, data is recorded on the DVD-RAM disc 100 with 1 sector = 2 KB as a minimum unit. Further, as 16 sectors = 1 ECC block, the ECC processing unit 102 performs error correction processing in units of ECC blocks.

  Note that the DVD recorder device may include a semiconductor memory card or a hard disk drive as a data storage medium in addition to the DVD disk. FIG. 4 shows a block diagram of a DVD recorder provided with a semiconductor memory card and a hard disk drive device.

  One sector may be 512B, 8KB, or the like. The ECC block may be 1 sector, 16 sectors, 32 sectors, or the like. As the information capacity that can be recorded increases, the sector size and the number of sectors constituting the ECC block are expected to increase.

  The track buffer 103 is a buffer for recording AV data at a variable bit rate (VBR) in order to record AV data on the DVD-RAM disk 100 more efficiently. Since the read / write rate (Va) to the DVD-RAM 100 is a fixed rate, the bit rate (Vb) of AV data changes according to the complexity of the content (image if video). It is a buffer for absorbing the bit rate difference.

  If this track buffer 103 is used more effectively, AV data can be discretely arranged on the disk 100. This will be described with reference to FIG.

  FIG. 3A shows the address space on the disk. As shown in FIG. 3 (a), when AV data is recorded separately in a continuous area of [a1, a2] and a continuous area of [a3, a4], the track is tracked while seeking from a2 to a3. By supplying the data stored in the buffer to the decoder unit 106, AV data can be continuously reproduced. FIG. 3B shows the state at this time.

  The AV data that has been read out at the position a1 is input to the track buffer 103 from time t1, and data output from the track buffer 103 is started. As a result, data is accumulated in the track buffer by the rate difference (Va−Vb) between the input rate (Va) to the track buffer and the output rate (Vb) from the track buffer. This state continues until the search area reaches a2, that is, until time t2. Assuming that the amount of data stored in the track buffer 103 during this time is B (t2), B (t2) stored in the track buffer 103 from time t2 to time t3 when reading of data in the area a3 is started. As long as it is continuously supplied to the decoder 106.

  In other words, if a certain amount or more of data to be read before seeking ([a1, a2]) is secured, AV data can be continuously supplied even if a seek occurs.

The size of a continuous area in which AV data can be continuously supplied is expressed by the following equation when converted into the number of ECC blocks (N_ecc). In the equation, N_sec is the number of sectors constituting the ECC block, S_size is the sector size, and Tj is the seek performance (maximum seek time).
N_ecc = Vb * Tj / ((N_sec * 8 * S_size) * (1-Vb / Va))

In addition, a defective sector may occur in the continuous area. Considering this case as well, the continuous region is expressed by the following equation. In the equation, dN_ecc is the size of the defective sector that is tolerated, and Ts is the time required to skip the defective sector in the continuous region. This size is also expressed by the number of ECC blocks.
N_ecc = dN_ecc + Vb * Tj / ((N_sec * 8 * S_size) * (1-Vb / Va))

  Here, an example of reading data from a DVD-RAM, that is, a case of reproducing has been described, but writing data to a DVD-RAM, that is, a case of recording can be considered similarly.

  As described above, in a DVD-RAM, as long as a certain amount or more of data is continuously recorded, continuous reproduction / recording is possible even if AV data is distributedly recorded on the disc. In DVD, this continuous area is called CDA.

(3. Overview of DVD disc)
FIG. 5 shows the appearance and physical structure of a DVD-RAM disc that is a recordable optical disc. Note that the DVD-RAM is generally loaded in a DVD recorder while being stored in a cartridge. The purpose is to protect the recording surface. However, if the recording surface is protected by another configuration or is acceptable, it is of course possible to directly load the DVD recorder without storing it in the cartridge.

  DVD-RAM discs record data by the phase change method. The recording data on the disc is managed in units of sectors and accompanied with an access address. The 16 sectors are units for error correction, and are given an error correction code and are called ECC blocks.

  FIG. 5A shows a recording area of a DVD-RAM disc that is a recordable optical disc. As shown in the figure, the DVD-RAM disc has a lead-in area on the innermost periphery, a lead-out area on the outermost periphery, and a data area therebetween. In the lead-in area, a reference signal necessary for stabilizing the servo at the time of accessing the optical pickup, an identification signal with other media, and the like are recorded. In the lead-out area, the same reference signal as the lead-in area is recorded. The data area is divided into sectors (2048 bytes) which are the minimum access unit. Further, in the DVD-RAM, a data area is divided into a plurality of zone areas in order to realize rotation control called Z-CLV (Zone Constant Linear Velocity) during recording / reproduction.

  FIG. 5A is a diagram showing a plurality of zone regions provided concentrically on the DVD-RAM. As shown in the figure, the DVD-RAM is divided into 24 zone areas, zone 0 to zone 23. The rotational angular velocity of the DVD-RAM is set for each zone region so as to be faster in the inner peripheral zone, and is kept constant while the optical pickup accesses within one zone. This increases the recording density of the DVD-RAM and facilitates rotation control during recording / reproduction.

  FIG. 5B is an explanatory diagram in which the lead-in area, the lead-out area, and the zone areas 0 to 23 shown concentrically in FIG. 5A are arranged in the horizontal direction.

  The lead-in area and the lead-out area have a defect management area (DMA: Defect Management Area) therein. The defect management area refers to an area in which position information indicating the position of a sector in which a defect has occurred and replacement position information indicating in which of the replacement areas a sector that replaces the defective sector exists. .

  Each zone area has a user area therein, and an alternative area and an unused area at the boundary. The user area is an area that can be used as a recording area by the file system. The replacement area is an area that is used instead when a defective sector exists. The unused area is an area that is not used for data recording. Unused areas are provided for about two tracks. The unused area is provided because the sector address is recorded at the same position in the adjacent track in the zone, but in Z-CLV, the recording position of the sector address is different in the track adjacent to the zone boundary. This is to prevent erroneous sector address discrimination.

  Thus, there are sectors that are not used for data recording at the zone boundaries. Therefore, the DVD-RAM assigns logical sector numbers (LSN: Logical Sector Number) sequentially to the physical sectors in the user area so that only the sectors used for data recording are shown continuously.

  FIG. 6 shows a logical data space of a DVD-RAM composed of logical sectors. The logical data space is called a volume space and records user data.

  The volume area manages recording data with a file system. That is, volume structure information for managing a group of sectors for storing data as a file and further managing a group of files as a directory is recorded at the beginning and end of the volume area. The file system of this embodiment is called UDF and conforms to the ISO 13346 standard.

  The group of sectors is not necessarily arranged continuously in the volume space, but is partially arranged discretely. For this reason, the file system manages a group of sectors arranged continuously in the volume space among the sector groups constituting the file as extents, and manages the file as a set of related extents.

  FIG. 7 shows the structure of directories and files recorded on the DVD-RAM. Below the root is a VIDEO_RT directory, and below this, a file of various objects as data for reproduction, and a VIDEO Manager file as management information indicating their reproduction order and various attributes are stored.

  The object is data conforming to the MPEG standard, and includes PS_VOB, TS1_VOB, TS2_VOB, AOB, POB, and MNF (Manufacturer's Private Data).

  PS_VOB, AOB, and POB are MPEG program streams (PS), and TS1_VOB and TS2_VOB are transport streams (TS). The program stream has a data structure that allows for storing AV information in the package media, while the transport stream has a data structure that allows for communication media.

  PS_VOB, TS1_VOB, and TS2_VOB are all objects having both video information and audio information, and mainly video information. Among these, TS1_VOB is an object in which encoding is performed by a DVD recorder and the internal picture structure is managed in detail, and TS2_VOB is an object encoded outside the DVD recorder, and data such as the internal picture structure is included. An object whose structure is partially unknown.

  Typically, TS1_VOB is an object obtained by encoding an externally input analog video signal into a transport stream by a DVD recorder, and TS2_VOB is an object recorded directly on a disc without encoding an externally input digital video signal. It is. That is, when a DVD recorder records a digital broadcast, it is generally TS2_VOB.

  AOB and POB are MPEG program streams, AOB is an object mainly composed of audio information, and POB is an object mainly composed of a still image.

  MNF (Manufacturer's Private Data) is a data area for storing information unique to the manufacturer.

  The above-mentioned video information main body and audio information main body means that the bit rate is largely allocated. VOB is used for applications such as movies, and AOB is used for music applications.

(4. Overview of reproduced AV information)
FIG. 8 is a diagram showing the structure of MPEG data recorded as various AV objects on a DVD disc.

  As shown in FIG. 8, the video stream and the audio stream are each divided and multiplexed. In the MPEG standard, the multiplexed stream is called a system stream. In the case of a DVD, a system stream in which information specific to the DVD is set is called a VOB (Video Object). The unit of division is called a pack packet, and has a data amount of about 2 KB.

  The video stream is encoded according to the MPEG standard, is compressed at a variable bit rate, and the bit rate is high for complex video such as intense motion. In the MPEG standard, each picture of a video is encoded by being classified into an I picture, a P picture, and a B picture. Among these, the I picture is subjected to spatial compression coding that is completed within a frame, and the P picture and B picture are subjected to temporal compression coding using the correlation between frames. In MPEG, a section including at least an I picture is managed as a GOP (Group of Pictures). GOP becomes an access point for special playback such as fast-forward playback. This is because it has an I picture compressed in a frame.

  On the other hand, in the case of DVD, AC-3 or LPCM encoding is used for encoding an audio stream in addition to MPEG audio.

  As shown in FIG. 8, a multiplexed data unit including video information constituting the GOP and accompanying audio information is called a VOBU (Video Object Unit). The VOBU may include information for managing the moving image section as header information.

  The system stream described in FIG. 8 includes a program stream (PS) and a transport stream (TS). The former has a data structure considering a package medium, and the latter has a data structure considering a communication medium.

  FIG. 9 is a diagram for explaining the outline of the data structure of the program stream and the transport stream.

  The program stream is composed of a fixed-length pack that is a minimum unit of transmission and multiplexing, and the pack further includes one or more packets. Both packs and packets have a header part and a data part. In MPEG, the data part is called a payload. In the case of DVD, the fixed length of the pack is 2 KB, consistent with the sector size. A pack can have a plurality of packets, but since a pack for storing video and audio of a DVD has only one packet, 1 pack = 1 packet except in special cases.

  On the other hand, the unit of transport stream transmission and multiplexing consists of fixed-length TS packets. The size of the TS packet is 188B, which is consistent with ATM transmission, which is a communication standard. One or more TS packets gather to form a PES packet.

  The PES packet is a concept common to the program stream and the transport stream, and the data structure is common. The packets stored in the program stream pack directly constitute a PES packet, and one or more transport stream TS packets gather to form a PES packet.

  The PES packet is the minimum unit of encoding, and stores video information and audio information that are common to encoding. That is, video information and audio information with different encoding methods are not mixedly stored in one PES packet. However, picture boundaries and audio frame boundaries may not be guaranteed if the encoding method is the same. As shown in FIG. 9, there may be a case where one frame is stored in a plurality of PES packets or a plurality of frames are stored in one PES packet.

  10 and 11 show individual data structures of the transport stream and the program stream.

  As shown in FIGS. 10 and 12, the TS packet is composed of a TS packet header, an application field, and a payload portion. The TS packet header stores a PID (Packet Identifier), thereby identifying various streams such as a video stream or an audio stream to which the TS packet belongs.

  The application field stores PCR (Program Clock Reference). PCR is a reference value of a standard clock (STC) of a device that decodes a stream. The device typically demultiplexes the system stream at the timing of PCR and reconstructs it into various streams such as a video stream.

  In the PES header, DTS (Decoding Time Stamp) and PTS (Presentation Time Stamp) are stored. DTS indicates the decoding timing of the picture / audio frame stored in the PES packet, and PTS indicates the presentation timing such as video / audio output.

  Note that it is not necessary to have PTS and DTS in all PES packet headers. If there is a PTS and DTS in the header of a PES packet in which the head data of an I picture is started to be stored, there is no problem in decoding and output.

  Details of the structure of the TS packet are shown in FIG.

  As shown in FIG. 12, in addition to PCR, a random access display flag is stored in the application field, and data corresponding to the head of a video / audio frame and serving as an access point is stored in the corresponding payload portion by the flag. Indicates whether or not. In addition to the PID described above, a unit start display flag indicating the start of the PES packet and application field control information indicating whether the application field follows are stored in the header portion of the TS packet. The unit start display flag indicates the start of a new PES packet, and the PID indicates the type and attribute of the stream.

  FIG. 11 shows the structure of a pack that constitutes a program stream. The pack has an SCR in the pack header, and a stream_id in the packet header of the packet to be stored. SCR is the PCR of the transport stream, and stream_id is substantially the same as PID. Since the data structure of the PES packet is common to the transport stream, PTS and DTS are stored in the PES header.

  One of the major differences between a program stream and a transport stream is that multiple programs are allowed in the transport stream. That is, it is assumed that only one program can be transmitted in the unit of program, but the transport stream transmits a plurality of programs simultaneously. For this reason, in the transport stream, it is necessary for the playback device to identify either the video stream or the audio stream that constitutes the program for each program.

  FIG. 13 shows a PAT table and a PMAP table for transmitting configuration information of an audio stream and a video stream constituting a program. As shown in these figures, the PMAP table stores information related to the combination of the video stream and the audio stream used for each program, and the PAT table stores information related to the combination of the program and the PMAP table. The playback apparatus can detect a video stream and an audio stream that constitute a program whose output is requested by the PAT table and the PMAP table.

  Next, the arrangement of the program stream pack and transport stream TS packet described above on the disk will be described with reference to FIG.

  As shown in FIG. 14A, 16 sectors constitute an ECC block.

  A pack (PS Pack) that constitutes a video object (PS_VOB) having a program stream format is arranged on a sector boundary as shown in FIG. 14 (b). This is because the pack size and sector size are 2 KB.

  On the other hand, a video object (TS1-VOB / TS2-VOB) in the form of a transport stream is arranged in an ECC block in units having a size of 8 KB. This 8 KB unit has an 18B header area, and 43 TS packets to which ATS information is added are arranged in the data area. ATS information (Arrival Time Stamp Information) is information generated and added by a DVD recorder, and is information indicating the timing at which the packet is transmitted from the outside to the DVD recorder.

  As shown in FIG. 14 (c), there may be an MPEG-TS storage format in which a fixed byte ATS and an MPEG-TS packet are continuously recorded.

(5. Overview of AV information management information and playback control)
15 and 16 are diagrams showing the data structure of a file called video management information (Video Manager) shown in FIG.

  The video management information includes object information indicating management information such as recording positions of various objects on the disc, and reproduction control information indicating the reproduction order of the objects.

  FIG. 15 shows a case where there are PS-VOB # 1 to PS-VOB # n, TS1-VOB # 1 to TS1-VOB # n, and TS2-VOB # 1 to TS2-VOB # n as objects to be recorded on the disc. Show.

  As shown in FIG. 15A, according to the types of these objects, an information table for PS-VOB, an information table for TS1-VOB, and an information table for TS2-VOB exist individually, Each information table has VOB information for each object.

  Each VOB information includes general information of the corresponding object, attribute information of the object, an access map for converting the reproduction time of the object into an address on the disk, and management information of the access map. The general information includes identification information of the corresponding object, the recording time of the object, and the attribute information includes video stream information (V_ATR) including the coding mode of the video stream, the number of audio streams (AST_Ns), It consists of audio stream information (A_ATR) including the audio stream coding mode.

  There are two reasons for requiring an access map. The first is to prevent the playback path information from referring directly to the recording position of the object on the disk by the sector address or the like and to indirectly refer to the playback time of the object. In the case of a RAM medium, the object recording position may be changed by editing or the like, but when the reproduction path information directly refers to the object recording position by a sector address or the like, the reproduction path information to be updated This is because there are many. On the other hand, when referring indirectly by the playback time, it is not necessary to update the playback path information, and only the access map needs to be updated.

  The second reason is that an AV stream generally has two criteria, a time axis and a data (bit string) axis, and there is no perfect correlation between the two criteria.

  For example, in the case of MPEG-2 video, which is an international standard for video streams, it is becoming mainstream to use a variable bit rate (a method in which the bit rate is changed according to the complexity of the image quality). Since there is no proportional relationship between the amount of data and the playback time, random access based on the time axis is not possible. In order to solve this problem, the object information has an access map for performing conversion between the time axis and the data (bit string) axis.

  As shown in FIG. 15A, the playback control information includes a user-defined playback path information table, an original playback path information table, and a title search pointer.

  As shown in FIG. 16A, in the playback path, the original defined playback path information automatically generated so as to indicate all objects recorded by the DVD recorder during object recording, and the user can freely define the playback sequence. There are two types of user-defined playback path information. The playback path is collectively called PGC information (Program Chain Information) in the DVD, the user-defined playback path information is called U-PGC information, and the original playback path information is called O-PGC information. Each of the O-PGC information and the U-PGC information is information that lists cell information, which is information indicating cells that are playback sections of an object, in a table format. The playback section of the object indicated by the O-PGC information is called an original cell (O-CELL), and the playback section of the object shown by the U-PGC information is called a user cell (U-CELL).

  The cell indicates the object playback section by the playback start time and playback end time of the object, and the playback start time and playback end time are converted into the recording position information of the object on the actual disk by the access map described above.

  As shown in FIG. 16B, the cell group indicated by the PGC information constitutes a series of playback sequences that are sequentially played back according to the entry order of the table.

  FIG. 17 is a diagram for specifically explaining the relationship among objects, cells, PGCs, and access maps.

  As shown in FIG. 17, the original PGC information 50 includes at least one cell information 60, 61, 62, 63. The cell information 60... Designates an object to be reproduced, and designates the object type and the object reproduction period. The recording order of the cell information in the PGC information 50 indicates the reproduction order when the object designated by each cell is reproduced.

  One cell information 60 includes type information (Type) 60a indicating the type of object designated by the cell information 60, an object ID (Object ID) 60b which is object identification information, and a start time in the object on the time axis. Information (Start_PTM) 60c and end time information (End_PTM) 60d in the object on the time axis are included.

  At the time of data reproduction, the cell information 60 in the PCG information 50 is sequentially read, and the object designated by each cell is reproduced for the reproduction section designated by the cell.

  The access map 80c converts the start time information and end time information indicated by the cell information into position information on the disk of the object.

  The map information described above is generated and recorded together with the recording of the object. In order to generate a map, it is necessary to analyze the picture structure in the data of the object. Specifically, it is necessary to detect the position of the I picture shown in FIG. 9 and time stamp information such as PTS that is the reproduction time of the I picture shown in FIGS.

  Here, problems that occur when generating map information of PS-VOB, TS1-VOB, and TS2-VOB will be described below.

  PS-VOB and TS-VOB1 are generated mainly by encoding a received analog broadcast into an MPEG stream as described in FIG. Therefore, the information of the I picture and various time stamps is generated by itself, the data structure inside the stream is clear for the DVD recorder, and no problem occurs in the generation of map information.

  Next, as for TS2-VOB, as described with reference to FIG. 1, the received digital broadcast is mainly recorded directly on the disk without being encoded by the DVD recorder. For this reason, unlike the PS-VOB, the position and time stamp information of the I picture is not generated by itself, so that the data structure inside the stream is not clear for the DVD recorder, and this information is detected from the digital stream to be recorded. Is required.

  For this reason, the DVD recorder detects an I picture and a time stamp as follows for the map information of TS2-VOB recording a stream encoded outside the recorder.

  First, the I picture is detected by detecting the random access display information in the application field of the TS packet shown in FIG. The time stamp is detected by detecting the PTS in the PES header. As for the time stamp, instead of the PTS, the PCR of the application field or the ATS that is the arrival timing at which the TS packet is transmitted to the DVD recorder may be substituted. In any case, the DVD recorder detects the position of the I picture based on the information of the system layer that is an upper layer without analyzing the data structure of the video layer of the MPEG stream. This is because the load on the system is high until the analysis of the video layer is performed in order to generate the map information.

  In addition, the system layer may not be detected. In this case, map information cannot be generated, and thus it is necessary to indicate that there is no effective map information. In the DVD recorder, these are indicated by the map management information shown in FIG.

  As shown in FIG. 15B, the map management information includes map validity information and a self-encoding flag. The self-encoding flag indicates an object encoded by the DVD recorder itself, the internal picture structure is clear, and the time stamp information of the map information, the position information of the I picture, and the like are accurate. The map validity information indicates whether or not there is a valid access map.

  Note that examples in which the system layer cannot be detected include a case where an application field is not set or a digital stream that is not an MPEG transport stream in the first place. Since various types of digital broadcasting can be established in various countries around the world, it is naturally expected that DVD recorders record objects that cannot generate maps. For example, when a DVD recorder that assumes Japanese digital broadcasting is used in the US and US digital broadcasting is recorded, there are cases where an object that cannot generate a map is recorded.

  However, the DVD recorder can also sequentially reproduce objects from which no map information is generated from the top. In this case, the recorded digital stream can be reproduced by outputting it to the STB corresponding to the stream via the digital I / F.

(6. Basic operation of playback function)
Next, the reproduction operation of the DVD recorder player that reproduces the optical disk will be described with reference to FIG.

  As shown in FIG. 18, the player has an optical pickup 201 that reads data from the optical disc 100, an ECC processing unit 202 that performs error correction of the read data, and a track buffer that temporarily stores read data after error correction. 203, a PS decoder 205 that reproduces a program stream such as a moving image object (PS_VOB), a TS decoder 206 that reproduces a transport stream such as a digital broadcast object (TS2_VOB), and an audio decoder that reproduces an audio object (AOB) 207, a still picture decoder 208 that decodes a still picture object (POB), a switching unit 210 that switches data input to each of the decoders 205, 206, and a control unit 211 that controls each part of the player. That.

  Data recorded on the optical disc 100 is read from the optical pickup 201 and stored in the track buffer 203 through the ECC processing unit 202. The data stored in the track buffer 203 is input to any of the PS decoder 205, TS decoder 206, audio decoder 207, and still picture decoder 208, and is decoded and output.

  At this time, the control unit 211 determines data to be read based on the reproduction sequence indicated by the reproduction path information (PGC) shown in FIG. That is, in the example of FIG. 16, the control unit 211 reproduces the VOB # 1 partial section (CELL # 1) first, and then reproduces the VOB # 3 partial section (CELL # 2). And VOB # 2 (CELL # 3).

  Also, the control unit 211 can obtain the type of cell to be played, the corresponding object, the playback start time of the object, and the playback end time based on the cell information of the playback path information (PGC) shown in FIG. The control unit 211 inputs the data of the object section specified by the cell information to a suitable decoder.

  At this time, the control unit 211 specifies the object to be played back based on the Object ID of the cell information. Further, the control unit 211 identifies a cell, which is a playback section of the identified object, by converting StartPTM and EndPTM of the cell information into an address of the disc information using an access map of the corresponding VOB information.

  The player according to the present embodiment further includes a digital interface 204 for supplying an AV stream to the outside. Thereby, it is also possible to supply the AV stream to the outside via communication means such as IEEE 1394 and IEC 958. This is especially true for TS2-VOB that is not encoded by itself, since there may be no corresponding decoder inside the player, so it is output directly to the external STB through the digital interface 204 without decoding, It can be played back by the STB.

  When the digital data is directly output to the outside, the control unit 211 determines whether or not random access reproduction is possible based on the map management information in FIG. If the access point information flag is valid, the access map has I picture position information. For this reason, if there is a request for fast-forward playback or the like from the external device, the control unit 211 can output digital data including the I picture to the external device via the digital I / F. If the time access information flag is valid, time access is possible. Therefore, the control unit 211 can output digital data including picture data corresponding to the designated reproduction time to the external device via the digital I / F in response to a time access request from the external device. .

(7. Basic operation of recording function)
Next, the configuration and operation of the DVD recorder according to the present invention for recording and reproducing with respect to the optical disc will be described with reference to FIG.

  As shown in FIG. 19, the DVD recorder has a user interface unit 222 that accepts display to the user and requests from the user, a system control unit 212 that manages and controls the entire DVD recorder, and an analog broadcast tuner that receives VHF and UHF. 213, an encoder 214 that converts an analog signal into a digital signal and encodes it into an MPEG program stream, a digital broadcast tuner 215 that receives a digital satellite broadcast, an analysis unit 216 that analyzes an MPEG transport stream sent by the digital satellite, a television, a speaker, and the like Display unit 217 and decoder 218 for decoding the AV stream. The decoder 218 includes the first and second decoders shown in FIG. Further, the DVD recorder includes a digital interface unit 219, a track buffer 220 that temporarily stores write data, and a drive 221 that writes data to the DVD-RAM 100. The digital interface unit 219 is an interface that outputs data to an external device by communication means such as IEEE1394.

  In the DVD recorder configured as described above, the user interface unit 222 first receives a request from the user. The user interface unit 222 transmits a request from the user to the system control unit 212, and the system control unit 212 interprets the request from the user and makes a processing request to each module.

  Recording includes self-encoding that encodes input digital data by itself and outside encoding that records encoded digital data on a disc without encoding.

(7.1 Recording operation by self-encoding)
First, with respect to self-encoding recording, an operation of encoding an analog broadcast into PS-VOB and recording it will be specifically described below.

  The system control unit 212 requests reception to the analog broadcast tuner 213 and encoding to the encoder unit 214.

  The encoder unit 214 performs video encoding, audio encoding and system encoding on the AV data sent from the analog broadcast tuner 213 and sends the AV data to the track buffer 220.

  Immediately after the start of encoding, the encoder unit 214 sends the time stamp information included in the head data of the encoded MPEG program stream to the system control unit 212 as the reproduction start time (PS_VOB_V_S_PTM), and is necessary for subsequently creating an access map. This information is sent to the system control unit 212 in parallel with the encoding process. This value is set in Start_PTM of the cell information shown in FIG. The time stamp information is generally PTS, but SCR may be substituted.

  Next, the system control unit 212 issues a recording request to the drive 221, and the drive 221 extracts data stored in the track buffer 220 and records it on the DVD-RAM disk 100. At this time, the above-described continuous area (CDA) is searched from the recordable area on the disc, and data is recorded in the searched continuous area.

  The end of recording is instructed by a stop request from the user. The recording stop request from the user is transmitted to the system control unit 212 through the user interface unit 222, and the system control unit 212 issues a stop request to the analog broadcast tuner 213 and the encoder unit 214.

  The encoder 214 receives the encoding stop request from the system control unit 212, stops the encoding process, and sets the time stamp information included in the end data of the MPEG program stream that has been encoded as the playback end time (PS_VOB_V_E_PTM) to the system control unit 212. send. This value is set in End_PTM of the cell information shown in FIG. The time stamp information is normally set to PTS, but may be replaced with SCR.

  After the encoding process is completed, the system control unit 212 generates PS-VOB VOB information (PS-VOBI) and playback control information shown in FIG. 15 based on the information received from the encoder 214.

  Here, the generated VOB information includes an access map suitable for the object type and map management information. The system control unit 212 sets the map validity information of the map management information to be valid, and turns on the self-encoding flag.

  Further, as the reproduction control information, an original reproduction path (O-PGC information) shown in FIG. 16 is generated, in which an object to be recorded is one of reproduction targets. The generated O-PGC information is added to the original reproduction path table. The original reproduction path (O-PGC information) has cell information. “PS-VOB” is set in the type information of the cell information.

  Finally, the system control unit 212 requests the drive 221 to finish recording the data stored in the track buffer 220 and to record PS-VOB VOB information (PS_VOBI) and playback control information. The remaining data in the track buffer 220 and these pieces of information are recorded on the DVD-RAM disk 100, and the recording process is terminated.

Of course, analog broadcasting may be encoded into TS1-VOB. In this case, the encoder 214 needs to be an encoder that converts an analog signal into a digital signal and encodes it into an MPEG transport stream, and the type information in the cell information is set to “TS1-VOB”.
In this case, Start_PTM and End_PTM may be PTS or PCR.

(7.2 Recording operation by outside encoding)
Next, recording by outside encoding will be specifically described below through an operation of recording a digital broadcast. In this case, the type of object to be recorded is TS2-VOB.

  A digital broadcast recording request by the user is transmitted to the system control unit 212 through the user interface unit 222. The system control unit 212 requests reception to the digital broadcast tuner 215 and data analysis to the analysis unit 216.

  The MPEG transport stream sent from the digital broadcast tuner 215 is transferred to the track buffer 220 through the analysis unit 216.

  The analysis unit 216 obtains time stamp information included in the top data of the transport stream as information necessary for generating the VOB information (TS2_VOBI) of the encoded MPEG transport stream (TS2-VOB) received first as a digital broadcast. Is extracted as start time information (TS2_VOB_V_S_PTM) and sent to the system control unit 212. The start time information is set in Start_PTM of cell information shown in FIG. This time stamp information is PCR or PTS. Moreover, you may substitute with ATS which is a timing which an object is transmitted to a DVD recorder.

  The analysis unit 216 further analyzes the system layer of the MPEG transport stream and detects information necessary for creating an access map. As described above, the position of the I picture in the object is detected based on the random access indicator (random_access_indicator) in the application field (adaptation field) in the TS packet header.

  Next, the system control unit 212 outputs a recording request to the drive 221, and the drive 221 extracts the data stored in the track buffer 220 and records it on the DVD-RAM disk 100. At this time, the system control unit 212 instructs the drive 221 where to record on the disk from the allocation information of the file system. At this time, the above-described continuous area (CDA) is searched from the recordable area on the disc, and data is recorded in the searched continuous area.

  The end of recording is instructed by a stop request from the user. The recording stop request from the user is transmitted to the system control unit 212 through the user interface unit 222, and the system control unit 212 issues a stop request to the digital tuner 215 and the analysis unit 216.

  The analysis unit 216 stops the analysis process in response to the analysis stop request from the system control unit 212, and performs system control using the time stamp information included in the data of the end section of the MPEG transport stream analyzed last as the display end time (TS2_VOB_V_E_PTM). To the unit 212. This value is set in End_PTM of the cell information shown in FIG. This time stamp information is PCR or PTS. Moreover, you may substitute with ATS which is a timing which an object is transmitted to a DVD recorder.

  The system control unit 212 generates TS2-VOB VOB information (TS2_VOBI) and playback control information shown in FIG. 15 based on the information received from the analysis unit 216 after completion of the digital broadcast reception process.

  Here, the generated VOB information includes an access map suitable for the object type and map management information. When the system control unit 212 can detect the position of the I picture in the object and generates an effective access map, the system control unit 212 sets the map validity information of the map management information to be valid. The self-encoding flag is set to OFF. If a valid access map cannot be generated, the map validity information is set to invalid. In addition, as a case where a valid access map cannot be generated, a case where a non-supported digital broadcast is received or a case where there is no random access information in the application field can be considered. In addition, when input directly from the digital I / F, there may be cases where the stream is not an MPEG transport stream. In this case, naturally, the map validity information is set to invalid.

  Further, as the reproduction control information, an original reproduction path (O-PGC information) shown in FIG. 16 is generated, in which an object to be recorded is one of reproduction targets. The generated O-PGC information is added to the original reproduction path table. The original reproduction path (O-PGC information) has cell information. “TS2-VOB” is set in the type information of the cell information.

  Finally, the system control unit 212 requests the drive 221 to finish recording the data stored in the track buffer 220 and record the TS2-VOB VOB information (TS2_VOBI) and the reproduction control information. The remaining data in the track buffer 220 and these pieces of information are recorded on the DVD-RAM disk 100, and the recording process is terminated.

  The operation has been described above based on the recording start and end requests from the user. For example, in the case of timer recording used in a VTR, the system control unit automatically requests recording start and end instead of the user. The operation of the DVD recorder is not essentially different.

(8. Summary of the Invention)
The information recording medium of the present invention records data in various formats, and is an information recording medium that records a variety of data input via an analog / digital interface or analog / digital broadcast content. The information recording apparatus of the present invention is an apparatus for recording / reproducing AV data on the information recording medium.

  In particular, the information recording medium of the present invention records externally input AV data in MPEG-TS format, and records a stream in which decoder input time information of each MPEG-TS packet is assigned to each MPEG-TS packet. ing.

  In addition, PSI (Program Specific Information) packet allocation and recorder-specific / content-specific information, which is responsible for MPEG-TS control information, is embedded as a user private stream (UP packet), and decoder input time information for each packet is suitable for storage It is characterized in that it is given in a different format.

  Further, in order to facilitate conversion to MPEG-PS when the MPEG-TS is multiplexed, data corresponding to one pack (2048 bytes) is system-encoded as one multiplexed continuous unit, and each multiplexed continuous MPEG-TS recording is performed while the unit is divided into one or a plurality of MPEG-TS packets.

(9. Detailed embodiment)
First embodiment.
Since the basic operation at the time of recording / reproducing of the information recording / reproducing apparatus of the present invention is almost as described above, only the basic operation at the time of analog external input recording will be specifically described below with reference to FIG. To do. In this case, the type of object to be recorded is TS1-VOB.

  The external input recording request by the user is transmitted to the system control unit 212 through the user interface unit 222. The system control unit 212 requests reception to the external input unit 223 and data encoding to the encoder 214.

  The MPEG transport stream sent from the encoder 214 is transferred to the track buffer 220.

  The encoder 214 uses the time stamp information included in the top data of the transport stream as start time information (TS1_VOB_V_S_PTM) as information necessary for generating the VOB information (TS1_VOBI) of the MPEG transport stream (TS1-VOB) that has been encoded first. And sent to the system control unit 212. The start time information is set in Start_PTM of cell information shown in FIG. This time stamp information is PCR or PTS.

  The encoder 214 further generates information necessary for creating an access map while generating an MPEG transport stream.

  For example, the adaptation field is stored in the first MPEG transport packet of the I picture, the random_access_indicator bit is set, and the start of the VOBU is transferred to the system control unit 212.

  Next, the system control unit 212 outputs a recording request to the drive 221, and the drive 221 extracts the data stored in the track buffer 220 and records it on the DVD-RAM disk 100. At this time, the system control unit 212 instructs the drive 221 where to record on the disk from the allocation information of the file system. At this time, the above-described continuous area (CDA) is searched from the recordable area on the disc, and data is recorded in the searched continuous area.

  The end of recording is instructed by a stop request from the user. The recording stop request from the user is transmitted to the system control unit 212 through the user interface unit 222, and the system control unit 212 issues a stop request to the encoder 214.

  The encoder 214 receives the recording stop request from the system control unit 212, stops the encoding process, and uses the time stamp information included in the end section data of the MPEG transport stream that has been encoded as the display end time (TS1_VOB_V_E_PTM) as a system. The data is sent to the control unit 212. This value is set in End_PTM of the cell information shown in FIG. This time stamp information is PCR or PTS.

  The system control unit 212 generates TS1-VOB VOB information (TS1_VOBI) and playback control information shown in FIG. 15 based on the information received from the encoder 214 after the recording process is completed.

  Here, the generated VOB information includes an access map suitable for the object type and map management information. The system control unit 212 sets the map validity information of the map management information to be valid. The self-encoding flag is set to ON.

  Further, as the reproduction control information, an original reproduction path (O-PGC information) shown in FIG. 16 is generated, in which an object to be recorded is one of reproduction targets. The generated O-PGC information is added to the original reproduction path table. The original reproduction path (O-PGC information) has cell information. “TS1-VOB” is set in the type information of the cell information.

  Finally, the system control unit 212 requests the drive 221 to finish recording the data stored in the track buffer 220, and to record TS1-VOB VOB information (TS1_VOBI) and playback control information. The remaining data in the track buffer 220 and these pieces of information are recorded on the DVD-RAM disk 100, and the recording process is terminated.

  Details of the self-encoding MPEG transport stream generated by the encoder 214 will be described below.

  FIG. 21A shows the structure of a self-encoding MPEG transport stream. As shown in the figure, a self-encoding MPEG transport stream is divided into VOBU units, and a PAT packet, a PMT packet, and a user private packet (hereinafter referred to as an “UP packet”) in which information unique to the stream is embedded at the head of each VOBU. Followed by ")". Alternatively, a PAT packet and a PMT packet are arranged at least at the beginning of the VOB.

  As shown in FIG. 21 (b), ATS which is decoder input time information is given to each packet, and each packet is transferred to the decoder at a time intended by the corresponding ATS.

  Self-encoding program information (such as PID of the PMT packet) is stored in the PAT packet of the first packet, and is input to the decoder at the time of ATS1.

  The PMT packet of the second packet stores the PID and the like for each elementary stream constituting the program. Here, an example is shown in which PIDs of video, audio, data broadcast ("Data" in the figure), and user private ("private" in the figure) packet are stored.

  Additional information to the stream is stored in the UP packet of the third packet. For example, stream title information, recording date / time information, stream encoding information such as stream encoding information (bit rate, video resolution, frame rate, aspect ratio, encoding method, etc.), whether external input is analog or digital, etc. Input source identification information to be identified, information for specifying the encoding method of input AV data in the case of digital, copyright protection information such as copy permission / non-permission, and VBI (Vertical Blanking Interval) signal Closed captioning (CC), teletext data, WSS (Wide-Screen Signaling) that specifies display control, information indicating system encoding conditions, and convertibility (compatibility) with various DVD standards Information indicating the production and the recording of the stream High and menu information of the user convenience using specific data of persons, it is conceivable to store a variety of useful data in converting various DVD standards compatible MPEG-PS.

  The decoder input time of the packet arranged in the MPEG transport stream as described above and storing additional information will be described in detail with reference to FIG.

  FIG. 22A is a block diagram showing a basic decoder configuration called a transport stream system target decoder (T-STD), which analyzes PSI packets not mentioned above and controls the decoder. It is the figure which also added the system decoder 235.

  When PAT and PMT packets, which are PSI packets, are input to the T-STD, they are discriminated by the demultiplexer 232 according to the packet type, and the PSI packets related to system control are instantaneously transferred to the transport buffer 233.

  Subsequently, the data stored in the transport buffer 233 is transferred to the system buffer 234 at a rate of 1000000 bits / second (= Rsys) as needed.

  The PSI data becomes valid at the moment when necessary PSI data is prepared in the system buffer 234.

  As described above, the MPEG T-STD model defines an operation model of a decoder and defines a standard such as a transfer rate of an MPEG transport stream.

  Since the information recording apparatus needs to perform self-encoding according to the format of the MPEG transport stream that is guaranteed to be correctly decoded by the T-STD, there are some restrictions on the transfer of PSI packets. The ATS determination method for determining the packet transfer rate will be described below with reference to FIG.

  When reproducing a self-encoding stream, first, the first PAT, PMT, and UP packet are input to the T-STD at times indicated by ATS1, ATS2, and ATS3, respectively.

  Focusing on the PMT packet and the UP packet, the T-STD interprets and validates the PID of the UP packet specified by the PMT packet, and the last byte of TS_program_map_section (m bytes) is stored in the system buffer 234. Need to be.

  That is, in order for the PMT to become effective, (m + n + 5) × 8 / Rsys seconds must elapse from the ATS2 that is the PMT packet input time. Here, n is the byte length of adaptation_field of the PMT packet.

Since the system clock frequency (SCF), which is the T-STD reference clock, is 27000000 Hz (the allowable range up to ± 810 Hz is specified as an error), if the time information is represented by the time accuracy of the system clock frequency, The following relationship must be established between ATS3 and ATS2.
ATS3 ≧ ATS2 + ((m + n + 5) * 8 / Rsys) * SCF

  Further, since the minimum interval between ATS2 and ATS3 is when there is no adaptation_field in the PMT packet (n = 0) and only the minimum TS_program_map_section (21 bytes) is stored in the PMT packet, 208 / The Rsys × SCF time interval is minimized.

Similarly, with respect to the input time ATS1 of the PAT packet and the input time ATS2 of the PMT packet, the Program association in the PAT packet
If the byte length of the section is m0 and the byte length of the adaptation_field of the PAT packet is n0, the following relationship needs to be satisfied.
ATS2 ≧ ATS1 + ((m0 + n0 + 5) * 8 / Rsys) * SCF

  In addition, since the minimum interval between ATS1 and ATS2 is the time when there is no adaptation_field in the PAT packet (n0 = 0), and the minimum Program association section (16 bytes) is stored in the PAT packet. The time interval of 168 / Rsys × SCF is minimized.

  If the system clock frequency (SCF) is 27 MHz and the time is expressed with an accuracy of 27 MHz, the time interval between ATS1 and ATS2 and the time interval between ATS2 and ATS3 are 4536 and 5616, respectively.

  Next, a method for storing a User Private packet (UP packet) in a self-encoding transport stream will be described with reference to FIGS. 23, 24, 25, and 26.

  FIG. 23 shows the UP packet storage method when the UP packet is defined as User Private stream. In this case, an identification number of 0x80 or more and 0xFF or less is assigned to the stream_type of the PMT corresponding to the UP packet, a unique PID is assigned to the UP packet, and the data structure inside the UP packet is out of the MPEG standard. . Further, here, an example is shown in which a UP_packet has a section structure called DVD_attribute_section ().

  FIG. 24 shows a storage method in the case where the UP packet has a private_section structure and a unique PID is given. Although the data structure of the private_section differs slightly depending on the value of the section_syntax_indicator in the private_section, the unique data of the UP packet is stored in the private_data_byte of the private_section. In this case, an identification number of 0x05 is assigned to stream_type.

  FIG. 25 shows a method for storing UP packets as packets having the same PID as the PMT. In this case, the data structure of the UP packet follows the private_section structure. In this case, stream_type is not defined, and the PID of the PMT packet is assigned to the UP packet.

  Also, FIG. 26 shows a method of enclosing a PMT packet without providing an UP packet individually. Also in this case, the unique data corresponding to the UP packet has a private_section structure, and private_section is described following TS_program_map_section. That is, both TS_program_map_section and private_section are stored in the PMT packet.

  Here, details of the specific data stored in the MPEG-TS by the above-described method will be described.

  As described in FIG. 23, FIG. 24, FIG. 25, and FIG. 26, the specific data includes RDI_GI (Real-time Data Information General Information) of RDI Unit of DVD Video Recording standard and DCI_CCI (Display Control Information). and Copy Control Information).

RDI_GI stores the start playback start time (VOBU_S_PMT) and recording date / time information of the corresponding VOBU, and DCI_CCI includes information related to display control such as aspect ratio information, subtitle mode information, and film / camera mode information in the VOBU. , Copy generation management information, APS information, input source information, and the like are stored. (For details on RDI_GI and DCI_CCI, see DVD Video
See Recording standards. )

  Also, V_ATR includes video bit rate information, resolution information, frame rate information (or video_format information such as NTSC / PAL), aspect ratio information, and encoding scheme (identification of MPEG2-Video, MPEG1-Video, etc.). Information is stored.

  Similarly, A_ATR also stores information such as the bit rate, coding method, number of channels, number of quantization bits, dynamic range control, etc. of all or part of the audio according to the number of audios.

  The CC stores the closed caption data in the VOBU. In order to improve the portability of PS conversion, CC data may be stored in advance in extension_and_user_data (1) (method for storing user data in the GOP layer) format, or CC data may be described in a separate description method. You may do it.

  The reason why the efficiency of MPEG-PS conversion is described in the format in which CC data is stored in the user data of the GOP layer is that the DVD-Video and DVD Video Recording standards do so.

  Also, C_SE describes information on several problems that are problematic during TS2PS conversion of the VOBU (or VOB).

  For example, the CC / WSS / Teletext data storage location information indicates whether CC data is in the UP packet, whether it is described as user data in each picture header, or whether there is no CC data in this VOBU (VOB), etc. This is information for identification.

  The WSS storage location information is information indicating whether it is stored in the UP packet as unique data or is described in the user data of each picture header.

  The Teletext storage position information is information indicating whether the TS packet storing the Teletext is provided and stored, or is described in the user data of each picture header.

  As for the multiplexed block structure / transfer information, a fixed number of TS packets constituting the multiplexed block (data block in which only one elementary stream is stored without being mixed with other elementary streams) shown in FIG. Information indicating the fixed number, information indicating whether the PTS / DTS is attached to the first TS packet of the multiplexed block, or transfer within the same multiplexed block. Information about the rate is described. At the time of MPEG-TS encoding that does not impose conditions on conventional multiplexing, the multiplexed block can be described as a fixed length size composed of only one TS packet.

  For each decoder buffer control information, information indicating the video buffer margin such as vbv_delay and vbv_buffer_size that are parameters of the video verifying buffer (how much video data is pre-read from the ATS input time using this information) The time difference information between the input completion time and the decoding time of the frame whose buffer input time is closest to the decoding time of the frame in the frame in the VOBU (this information is used for video / audio) It is possible to determine how much data can be read later from the input time of ATS).

  Further, the DVD_Compatibility information is information indicating how much load is present when the MPEG-TS is transcoded to MPEG-PS conforming to each DVD standard.

  For example, when a multiplexed block is configured with 2 KB or less and level 1 indicator, CC, WSS, and Teletext data exist, CC and WSS data are stored in the UP packet, and Teletext stores the video data. Level 2 indicator if stored as a Teletext packet in the multiplexed block, Level 3 indicator if there is no need to consider buffer management when storing CC, WSS, and Teletext data in the area defined by each DVD standard, When replacing the ATS of the first TS packet of the multiplexed block with the SCR, if it is not necessary to consider buffer management, an indicator of level 4 and the like and whether or not the MPEG-TS can be easily converted into the format of each DVD Show the convertibility of Is information.

  This DVD_Compatibility information is a group of information indicating the ease of conversion corresponding to each DVD format, such as for DVD-Video, DVD-Audio, DVD Video Recording, DVD Stream Recording, etc.

  FIG. 27 shows a structure diagram of MPEG-TS using multiplexed blocks and a data structure diagram when it is converted into a DVD-Video and DVD Video Recording format.

  The self-recording TS stream shown in FIG. 27A is composed of VOBUs (units of reproduction / decoding) of the self-recording TS stream shown in FIG. As shown in FIG. 27C, one VOBU is composed of a plurality of multiplexed blocks (corresponding to an MPEG-PS pack). Each multiplexed block may be divided into fixed-length data sizes as shown in FIG. 27 (d) (this makes it easy to mount on a device), or as shown in FIG. 27 (e). Thus, it may be divided into variable length data sizes (in this case, the capacity of the recording medium is not wasted). In the case of FIGS. 27 (d) and 27 (e), a non-elementary stream such as a PSI / SI packet or an UP packet and an elementary stream are separated from each other to form a multiplexed block. As shown in (f), non-elementary streams such as PSI / SI packets and UP packets may be stored together with the elementary streams in the multiplexed block. In the case of FIG. 27 (f), the multiplexed block # 1 and the multiplexed block # 2 become one multiplexed block.

  Furthermore, the stream can be easily converted into the DVD-Video format shown in FIG. 27G or the DVD Video Recording format shown in FIG.

  In this case, an MPEG-PS pack is formed according to the arrangement of the multiplexed blocks, and one multiplexed block is a unit storing one pack of data, so that TS2PS conversion is easily performed.

  In FIG. 27, the capsule header and ATS are omitted because they are not related to the present invention. Each of the converted MPEG-PS packs shown in FIGS. 27 (g) and 27 (h) is subjected to stuffing or padding according to the byte length of the stored elementary or VOBU alignment.

  FIG. 28 is a diagram illustrating multiplexing according to the present invention in correspondence with the conventional stream multiplexing method shown in FIG. As shown in the figure, the final format is a format compliant with the MPEG-TS in FIG. A video stream (FIG. 28A) is composed of a plurality of GOPs (FIG. 28A). Each GOP includes predetermined picture data, and a TS packet group having a data amount corresponding to the data amount of one pack when converted to MPEG-PS is defined as one multiplexed block (see FIG. 28C). That is, one multiplexed block is divided into a plurality of TS packets corresponding to the data amount of one pack as shown in FIG. Similarly, for an audio stream, a plurality of TS packets are combined into one multiplexed block. Then, as shown in FIG. 28E, a VOBU is configured by multiplexing in units of multiplexed blocks. As described above, in the present invention, data having a data amount corresponding to the data amount of one pack of MPEG-PS is collectively arranged as a multiplexed block (see FIG. 28 (e)). The biggest difference from the example.

In addition, as shown in FIG. 29, ATS added to each packet of MPEG-TS may be added while increasing ATS by a fixed increment (ΔATS) in the same multiplexed block. This is effective for avoiding complicated buffer management when converting to TS2PS and replacing ATS to SCR without a simple offset or offset. At this time, ATSi (i = 0, 1, 2,...) Satisfies the following relationship.
ATS i + (number of packets in multiplexed block) × ΔATS ≦ ATS i + 1

When the multiplexed block has a fixed length, since the number of TS packets included in one multiplexed block is constant, the boundary between the multiplexed blocks can be easily known. However, when the multiplexed block has a variable length, the number of TS packets included in one multiplexed block is indefinite, so it is difficult to know the boundaries of the multiplexed blocks. Therefore, in this case, the increment (ΔATS) of the ATS value at the boundary of the multiplexed block is set to a predetermined value different from the increment (constant value) in the multiplexed block. That is, the difference (ΔATS) between the ATS value of the last packet in the previous multiplexed block and the ATS value of the first packet in the next multiplexed block is set to a predetermined value different from the constant value. Thereby, the boundary of the multiplexed block can be known by monitoring ΔATS. TS packets and packs for conversion to MPEG-PS can be associated one-to-one. At this time, ATSi satisfies the relationship of the following equation.
ATSi + (number of packets in multiplexed block) × ΔATS <ATSi + 1

  Also, as shown in FIG. 29, the ATSi assigned to the head packet of the multiplexed block in MPEG-TS corresponds to the SCRi assigned to each converted MPEG-PS pack.

  As shown in FIG. 29, character information such as Closed Caption and DSI may be stored in the UP packet. The DSI in the UP packet is used to generate the converted NV_PCK data, and the Closed Caption is stored in the video pack. Further, as shown in FIG. 30, a packet storing teletext data in a multiplexed block may be inserted between packets storing video data so as to be compatible with the PAL standard in Europe. At this time, the packet storing the teletext data is arranged immediately before the picture having the PTS displayed at the same time. Teletext data is stored in the video pack after conversion. FIG. 31 shows the data structure of the UP packet storing DSI and the like as described above.

  In addition, information specifying the TS packet storing the last byte of the I picture at the beginning of the VOBU (such as a relative number from the beginning of the VOBU) may be described in the additional information of the UP packet. Can be realized. Similarly, some I and P pictures in VOBU, picture coding type information of all pictures, data length information of the pictures (for example, information specifying a TS packet including the last byte, etc.), It is also possible to support special playback by describing information indicating the DTS / PTS of each picture.

  In the above-described embodiment, if encoding is performed so that the TS packet to which PTS / DTS is added is at the head of the multiplexed block, the head of the access unit is placed at the head of the pack after TS2PS conversion. The effect of simplifying the header processing unique to the DVD can be expected.

  In consideration of the conversion to MPEG-PS, the TS packets forming the multiplexed block may be appropriately stuffed so that the data stored in the pack does not overflow, or at the end of the multiplexed block. The necessary number of bytes may be inserted from the TS packet.

  In the above description, the description has been focused on recording on a DVD. However, the present invention is not limited to this, and the same information is recorded after the self-recording TS is recorded on an information recording medium such as an HDD or a semiconductor memory. Alternatively, an MPEG-PS converted stream may be recorded on another recording medium.

  In the above description, the PAT, PMT, and UP packets are recorded at the beginning of each VOBU. However, they may be recorded at least at the beginning of the VOB, or at least at the beginning of the cell that is the playback management unit. good.

  In the above description, the PAT, PMT, and UP packets are recorded. However, the UP packet may be omitted.

  In the above description, the arrangement of the PAT, PMT, and UP packet is fixed at the head. However, the present invention is not limited to this, and a packet storing a Null packet may be inserted and recorded. good.

  In the above description, the self-encoding stream starts from a PAT packet. However, the present invention is not limited to this, and may start from a Null packet.

  Note that the system transfer rate may be set to a fixed rate by appropriately inserting Null packets into the self-encoding stream.

  In addition, as shown in FIG. 7, a data area for storing manufacturer-specific information may be provided, and MPEG-TS system encoding conditions may be described therein.

  Note that all or part of the information described in the UP packet in the above description may be described in the TS1-VOB information shown in FIG.

  When converting a self-encoding transport stream recorded on a dual mono audio channel to the DVD-Video format, the dual-mon audio does not exist in the DVD-Video standard, so two different audio streams are used. Alternatively, the left and right monaural sounds may be divided and converted.

  In the above description, some or all of the parameters described in the UP packet may be described in the management information. This avoids recording a parameter that does not change many times in one self-encoding transport stream, thereby avoiding useless recording areas and determining whether the parameter has changed each time an UP packet appears. An effect of reducing the decoder processing.

Second embodiment.
(Encoder configuration)
Hereinafter, another embodiment of the present invention will be described in detail. First, the encoder of the information recording apparatus according to the present invention will be described with a focus on an encoding process that receives AV input and performs self-encoding on MPEG-TS.

  FIG. 33 shows the configuration of the encoder of the information recording apparatus according to the present invention. As shown in the figure, the encoder 214 includes elementary encoders 230 a, 230 b, and 230 c and a system encoder 232. The encoder 214 receives a control signal from the system control unit 212 and performs an encoding process while switching to elementary encoding or system encoding by the elementary encoders 230a, 230b, 230c and the system encoder 232. Each of the elementary encoders 230a, 230b, and 230c receives video, audio, and VBI (Vertical Blanking Interval) signals and performs encoding.

  The video encoder 230a receives the control signal from the system control unit 212, and encodes attributes such as the bit rate, resolution, aspect ratio, etc. of the video stream within a predetermined range according to the control signal. Specifically, the video encoder 230a receives a control signal for designating an operation mode of any one of “DVD-Video compatible mode”, “DVD Video Recording compatible mode”, and “normal mode” from the system control unit 212 at the start of encoding. Receive. If the mode specified by the control signal is “DVD-Video compatible mode”, a video stream conforming to the video attribute of the DVD-Video standard can be converted to a DVD Video Recording (hereinafter “DVD Video Recording” if the mode is “DVD Video Recording compatible mode”). VR ”.) If the video stream conforming to the standard video attribute is“ normal mode ”, the video stream conforming to an attribute of a predetermined category is generated.

  Similarly, the audio encoder 230b receives a control signal from the system control unit 212, and encodes attributes such as the bit rate, the number of quantization bits, the number of channels, and the like of the audio stream in accordance with the control signal. Similarly to the video encoder 230a, specifically, when a control signal indicating an operation mode is received from the system control unit 212 and the mode indicated by the control signal is “DVD-Video compatible mode”, the audio of the DVD-Video standard is used. If the audio stream conforming to the attribute is “DVD Video Recording compatible mode”, the audio stream conforming to the audio attribute of the DVD VR standard is “normal mode”, and the audio stream conforming to an attribute of a predetermined category is satisfied. Create a stream.

  The VBI encoder 230c also receives a control signal designating an operation mode from the system control unit 212, and encodes VBI data according to the control signal. Specifically, when the elementary stream encoding control signal input from the system control unit 212 to the VBI encoder specifies “DVD-Video compatible mode” or “DVD Video Recording compatible mode”, the VBI encoder 230c respectively. The VBI data is additionally encoded in accordance with the storage method of the VBI data defined by the standard. The additional encoding means that the method of storing the VBI data may be determined separately even in the original normal mode, so that it is stored redundantly in the elementary stream.

  The encoded elementary streams are multiplexed into the MPEG-TS system stream by the system encoder 232 as described above.

  Similarly to the elementary stream encoders 230a, 230b, and 230c, the system encoder 232 also receives an encoding control signal from the system control unit 212, and performs encoding according to this.

  The control signal from the system control unit 212 to the system encoder 232 is a system encoding control signal for the normal MPEG-TS or a restriction on the normal MPEG-TS, and can be easily converted to MPEG-PS (particularly a DVD-specific format). Either of the system encoding control signals (DVD-Video mode or DVD Video Recording mode) that can be converted.

  In the case of a system encoding control signal for normal MPEG-TS, the system encoder 232 uses the elementary streams input from the elementary stream encoders 230a, 230b, and 230c as a reference for the MPEG-TS system stream. System encoding is performed while buffer management so as not to cause a failure in the decoder model (hereinafter referred to as “T-STD”).

  Further, when the control signal from the system control unit 212 is a control signal for designating system encoding to MPEG-TS that can be easily converted to MPEG-PS, in addition to the above, further special system encoding rules are observed. Encode.

  The self-encoding MPEG-TS system stream generated in this way is output from the encoder 214.

  As described above, the information recording apparatus of the present invention is characterized in that the encoding mode is individually switched at the elementary stream and system stream levels. FIG. 34 shows a table summarizing the processing when converting to the DVD format for each encoding mode by switching the encoding mode.

  In this way, by causing the elementary stream encoders 230a, 230b, and 230c and the system stream encoder 232 to perform encoding assuming conversion to MPEG-PS, an MPEG-TS that can be easily converted to MPEG-PS can be obtained. Created.

(Self-encoded MPEG-TS)
In the following, one embodiment of the format of MPEG-TS self-encoded by the information recording apparatus of the present invention will be described in detail, and it will be described as normal MPEG-TS (hereinafter referred to as “SESF”) and MPEG-PS. Differences from easily convertible MPEG-TS (hereinafter referred to as “Constrained SESF”) will be described.

  In the following example, information representing the encoding condition of the stream is stored in VOBI that stores attribute information and the like in units of MPEG-TS streams. Whether or not the stream can be easily converted into the DVD-Video or DVD VR format without analyzing the stream by storing the information indicating the encoding condition in the management information instead of in the stream. Judgment can be made quickly. Note that information indicating the encoding condition of the stream may be stored in a Tip packet described later.

Information representing the coding condition of this stream is represented by a 2-bit flag “encode_condition”. The meaning of the flag value is as follows.
00b: Normal MPEG-TS (SESF)
01b: MPEG-TS (Constrained SESF) that can be easily converted to the stream format of the DVD VR standard
10b: Reserve 11b: MPEG-TS (Constrained SESF) that can be easily converted into a stream format of the DVD Video standard

  When the value of 00b is taken in the stream management information, encoding is performed without considering high-speed conversion to MPEG-PS, and conversion into individual MPEG-PS is performed by user editing work. A case where simple MPEG-PS is concatenated into one stream is conceivable.

  In addition, when the stream also has encode_condition, there is no meaning to have encode_condition = 00b indicating normal MPEG-TS in the stream, and in the stream (in a Tip packet described later), encode_condition = 00b is used as a reserve. As prohibited, the use of encode_condition may be different inside / outside the stream.

  By determining the value of the flag as described above, it is possible to determine whether or not the stream can be easily converted into the DVD-Video or VR format from the value of the encode_condition field of VOBI. Here, easy conversion means that conversion can be performed by a conversion method described later.

(Constrained SESF stream structure)
FIG. 80 shows the overall stream structure of Constrained SESF. Constrained SESF is composed of a plurality of SESF capsules (SESF capsules). The SESF capsule includes a predetermined Multiplexing Unit, and has a Tip packet (details will be described later) at the head. The reproduction time information (PTS) of each SESF capsule and the address information of the Tip packet are associated by the access map 80c. As will be described later, in TS2PS conversion, conversion processing is performed for each SESF capsule.

  FIG. 32 is a diagram showing the correspondence between each packet in one SESF capsule and an MPEG-PS pack. As shown in FIG. 32, a TS packet (hereinafter referred to as “Tip packet”) in which unique information of a stream is stored is inserted into the Constrained SESF. Hereinafter, the Tip packet embedded in the Constrained SESF will be described with reference to FIGS.

<Tip packet>
FIG. 35 shows the overall structure of the Tip packet. As shown in this figure, the Tip packet includes a Data_ID for specifying that the packet is a Tip packet, a display_and_copy_info including display control and copy control information, and a stream encoding information corresponding to the DCI_CCI field of DVD VR. The stored encode_info and MakersPrivateData that can describe additional information unique to the manufacturer are stored.

  As shown in FIGS. 35 and 36, in the Tip packet, a PCR value necessary for the SCR calculation described later is described in the adaptation field. Since this adaptation field also has a fixed byte length, various information in the Tip packet can be accessed with a fixed address.

  FIG. 37 shows the structure of Data_ID. Data_ID includes Data_Identifier for identifying that the packet is a Tip packet. Data_Identifier is a 3-byte field having a value of “0x544950” representing “TIP” in ASCII code. The decoder of the playback device can determine the value of this field and identify it as a Tip packet.

  FIG. 38 shows the structure of display_and_copy_info. The display_and_copy_info has the same structure and information as the DCI_CCI of the RDI unit of the DVD VR standard, thereby facilitating generation of an RDI pack when converting the Constrained SESF to the DVD VR format. (Note that the details of DCI_CCI of the DVD VR standard are disclosed in “DVD Specifications for Rewritable / Re-recordable Disc Part 3 VIDEO RECORDING” and Japanese Patent No. 3162044. Some field names are different. However, the definition of each field is the same to enable copying as it is at the time of conversion to the DVD VR format.)

FIG. 39 shows the structure of encode_info. In the video_resolution field, resolution information of the video stream following the Tip packet is described. The value of encode_info is shown below.
0000b: 720x480 (NTSC), 720x576 (PAL)
0001b: 704x480 (NTSC), 704x576 (PAL)
0010b: 352x480 (NTSC), 352x576 (PAL)
0011b: 352x240 (NTSC), 352x288 (PAL)
0100b: 544x480 (NTSC), 544x576 (PAL)
0101b: 480x480 (NTSC), 480x576 (PAL)
Others: Reserve

  In the DVD VR format, the resolution during one continuous recording may be variable. However, in this case, streams with different resolutions are managed as separate VOBs, and a seamless connection during playback is guaranteed depending on the recorder. Therefore, when a resolution change occurs during Constrained SESF recording, this field is used to determine from which point the VOB needs to be separated when converted to the DVD VR format.

  In Constrained SESF (encode_condition = 11b) recorded in consideration of conversion to the DVD-Video format, the resolution does not change in one stream.

  The encode_condition field is the same as the value stored in VOBI (except when it is 00b). The reason why the encode_condition field is stored not only in the management information of the stream but also embedded in the stream is that the recording device of the receiver is able to copy the stream through a digital interface represented by IEEE 1394. This is because by checking the encode_condition field in the Tip packet, it is possible to easily determine whether or not conversion to the DVD format is possible.

  In the FVFPST field, VOBU_S_PTM of the DVD VR standard is recorded. This eliminates the process of analyzing the video stream encoded following the Tip packet and calculating the playback time of the video field that is displayed first when converting the Constrained SESF to the DVD-Video / VR format. Because.

  The FVFPST field is composed of a 32-bit field representing the display time of the video field with 90 KHz accuracy and a 16-bit field represented with 27 MHz accuracy which is not represented by this.

  FIG. 40 shows the structure of PES_info. PES_info is information essential for converting the Constrained SESF to the DVD-Video format without analyzing the elementary stream. This information is necessary to generate information stored in a pack for supporting special playback, called NV_PCK, which is inserted into the DVD-Video stream.

  PES_info can store information of PES packets storing a total of 136 video data and audio data. 4-bit data is assigned to each PES packet, so that NV_PCK information can be generated without analyzing the inside of the PES packet. If there is a PES packet that does not store video or audio data, the PES packet is ignored.

For the SESF Capsule that is a data unit from the Tip packet to the packet immediately before the next Tip packet, the PES_existence_flag is a flag indicating whether or not the j-th PES packet exists in the corresponding SESF Capsule. is there. The value of PES_existence_flag is set as follows.
0b: The jth PES packet does not exist in the SESF Capsule.
1b: The jth PES packet exists in the SESF Capsule.

  When PES_extension_flag = 0b (when no PES packet is present), all the remaining fields of the PES packet are set to 0b.

PES_payload_identifier is information for identifying whether the data stored in the PES packet is video data or audio data. The value of PES_payload_identifier is set as follows.
0b: Video stream 1b: Audio stream

  PES_existence_flag and PES_payload_identifier are fields described for all target PES packets.

  Now, when it is determined by the PES_payload_identifier that video or audio is stored, the subsequent field definitions differ depending on the type of stream stored in the PES packet.

  When the PES packet stores a video stream (PES_payload_identifier = 0b), following the PES_payload_identifier, picture_coding_type indicating the type of picture stored in the PES packet is defined.

The value of picture_coding_type is set as follows.
00b: Pictures that have been encoded other than 01b, 10b 01b: A pair of frame-encoded I picture or field-encoded I picture, or a pair of field-encoded I picture and field-encoded P picture 10b : Pair of frame-encoded P picture or field-encoded P picture 11b: Reserved In other words, the 01b or 10b picture is a picture that becomes a reference picture defined in the DVD-Video standard. The above is the additional information for the PES packet storing the video.

  On the other hand, when the PES packet stores an audio stream (PES_payload_identifier = 1b), it is identified whether the audio stream stored in the PES packet is the first audio stream or the second audio stream following the PES_payload_identifier. This flag is used to determine whether or not the stream_identifier and the FVFPST described in each Tip packet (the playback start time of the video field displayed first) includes an audio frame that starts playback immediately thereafter. There is a certain sync_presentation_flag.

The value of stream_identifier is set as follows.
0b: first audio stream 1b: second audio stream

  The identification of the first audio stream or the second audio stream can be determined by the PID setting rule, the order of the elementary stream declarations in the PMT, and the like.

The value of sync_presentation_flag is set as follows.
0b: The audio PES packet does not store an audio frame that starts to be played simultaneously with or immediately after FVFPST.
1b: An audio frame to be played back at the same time as or immediately after FVFPST is stored in the audio PES packet.

  The above is the additional information for the PES packet storing the audio. PES_info is a field that extracts and stores information for each individual PES packet following the Tip packet.

  FIG. 41 shows MakersPrivateData. As shown in the drawing, MakersPrivateData provides a maker_ID that identifies the manufacturer that generated the Constrained SESF, and a maker_private_data in which the manufacturer describes unique additional information.

  FIG. 42 shows an example of the stream_type value indicating the PID of the Tip packet and the stream type. Since both PID and stream_type have values reserved in MPEG and other standards, the above values are selected in consideration of private data that does not interfere with them and are outside the MPEG standard.

  As described above, the attribute information of various streams is extracted and stored in the Tip packet stored in the Constrained SESF. Details of how the above-described fields are used when converting to the DVD format will be described later.

(System encoding condition)
Next, the system encoding conditions of Constrained SESF will be described in detail. The following system encoding conditions are not applied to normal SESF.

(Multiplexing Unit)
A TS packet storing an elementary stream in a Constrained SESF is composed of a multiplexing unit (Multiplexing Unit) that is a unit in which data stored in a 2 KB pack in the DVD format is collected. Note that this multiplexing unit corresponds to the multiplexed block of the first embodiment.

  Only one TS packet storing one type of elementary stream is stored in one Multiplexing Unit, and it is not mixed with TS packets storing other types of elementary streams. In addition, mixing with a NULL packet may be necessary when configuring one Multiplexing Unit (for example, Multiplexing Unit storing the last part of the stream), and is not prohibited. This is also necessary to clarify the relationship between the Multiplexing Unit and the pack.

  One Multiplexing Unit is composed of 11 consecutive TS packets, and the elementary stream (payload data) in each Multiplexing Unit is completely stored in one corresponding pack. This also limits the relevance of the pack.

When the PES packet storing the video stream is divided and arranged in a plurality of Multiplexing Units, all the Multiplexing except for the Multiplexing Unit including the last byte of the PES packet.
The unit stores TS packet payload data of 184 × 11 = 2024B. This is because the stream is transferred with the maximum efficiency and the sequential processing in units of TS packets can be easily executed at the time of TS2PS conversion. If the data amount of the Multiplexing Unit other than the last is recognized as 2024B or less, the value of PES_packet_length stored in the packet header of each MPEG-PS pack when converting the first TS packet of the Multiplexing Unit during TS2PS conversion is easy. Can not be determined.

  The first complete audio frame data starting in the Multiplexing Unit must be the first audio frame in the PES packet payload.

  This is easy to understand when considering that PES packets storing audio streams are stored in a plurality of Multiplexing Units. Assuming that one audio PES packet is divided and arranged in a plurality of Multiplexing Units, a PTS is specified to generate a packet header when converting the second and subsequent Multiplexing Units into an MPEG-PS pack. It is necessary to determine the number of audio frames stored in one pack. For this reason, an internal analysis of the audio stream is required at the time of TS2PS conversion, thereby avoiding complicated conversion processing.

  The above is the definition of Multiplexing Unit. An encoder that generates a Constrained SESF performs system encoding within the limitations of the Multiplexing Unit.

(Restriction of PES packet header in Constrained SESF)
Next, some restrictions on the field value of the PES packet header in the Constrained SESF will be described.

  As shown in FIG. 43, some PES packet header fields allow only fixed values. This is because unnecessary processing does not occur when converting to the DVD format. Extra processing means processing a field that is additionally generated / disappeared by a value different from the value defined in the DVD format. In other words, at the time of TS2PS conversion, the purpose of limiting the PES packet header is to suppress fields that are added to or deleted from the header as much as possible.

  The value of PES_packet_length may be 0 in the case of a video stream stored in MPEG-TS.

  PTS_DTS_flags is a flag indicating whether or not PTS and DTS are described.

  In the case of a PES packet storing an audio stream, one or more audio frames are always started in the PES packet, and PTS_DTS_flags is set to 10b (11b if there is a DTS).

  PES_extension_flag and PES_header_data_length have restrictions for performing sequential processing in units of TS packets during TS2PS conversion. This is shown in FIG.

  As shown in FIG. 44, each value is defined by the type of elementary stream, the position of the PES packet, and the value of encode_condition.

Here, the VPD in FIG. 44 is a byte length obtained by adding the PTS field and the DTS field of the PES packet. That is,
If PTS_DTS_flags = 00b, VPD = 0
If PTS_DTS_flags = 10b, VPD = 5
If PTS_DTS_flags = 11b, VPD = 10
It is.

  As described above, when converting to DVD-Video or VR, this limitation is necessary in order to facilitate sequential processing for each TS packet, rather than configuring a pack after the payload length of one pack is determined. Become.

  The above is the definition of the PES packet header. The encoder that generates the Constrained SESF performs system encoding within the above restrictions.

(Restriction on Tip packet insertion interval)
Next, limitations on the insertion interval of Tip packets inserted in the Constrained SESF will be described.

The decoder input time indicated by the ATS (ATS1) of the Tip packet and the decoder input time indicated by the ATS (ATS2) of the TS packet storing the video or audio stream first input to the decoder following the Tip packet are as follows: A relationship needs to be established.
ATS1 + T <= ATS2
T = (PS_pack_size * 8 * system_clock_frequency) / PSrate
T is the minimum transfer period of the PS pack. This minimum transfer period is the minimum period from the start of input of the PS pack to the system decoder until completion. That is, the above formula indicates that the ATS interval of each TS packet needs to be at least larger than the interval at which the converted PS pack can be input to the system decoder.

The value of T is calculated as follows.

  PS_pack_size is the byte length of one pack in MPEG-PS generated by TS2PS conversion, system_clock_frequency is the frequency of the reference time of the MPEG-PS decoder, and PSrate is the multiplexing of the MPEG-PS stream generated by TS2PS conversion Rate.

In the case of the DVD format, since the following values are taken, the relationship between ATS1 and ATS2 is as follows.
PS_pack_size = 2048 bytes,
system_clock_frequency = 27000000 Hz,
PSrate = 10800000 bits / second,
ATS1 + 43885.714 ... <= ATS2

  Therefore, ATS1 + 43886 = ATS2 is the minimum value of ATS2. Typically, the TS packet is converted to a pack with 2KB size of NV_PCK (during DVD-Video conversion) or RDI_PCK (during DVD VR conversion) by TS2PS conversion described later, but the above formula is not satisfied In this case, the transfer time of the subsequent elementary stream is advanced, and the upper limit of the DVD system transfer rate of 10.08 Mbps is exceeded.

  An integer number of GOPs are aligned and arranged in one SESF capsule. This is to make the SESF capsule correspond to the VOBU of the DVD format in order to realize the concept of the VOBU of the DVD format on the Constrained SESF. In the DVD format (DVD VR), this VOBU needs to be composed of an integer number of GOPs.

  The time width on the playback time axis of video data stored in one SESF capsule must be 0.4 seconds or more and 1.0 seconds or less. Further, the time width on the playback time axis of the video data stored in the last SESF capsule is 0.4 seconds or more and 1.2 seconds or less when encode_condition = 11b (DVD-Video mode), and encode_condition = 01b ( (DVD VR mode) must be 1.0 second or less. This is necessary for the SESF capsule to be a VOBU and to follow each DVD format.

Each Tip packet is typically desired to be pointed one-to-one with an access map that performs time-address translation. This means that when TS2PS conversion is performed, conversion can be started immediately in units of VOBU in the DVD format, and when converting to DVD-Video format at the time of conversion, Tip packets are converted to NV_PCK. In order to create DSI (Data Search Information), which is address information to neighboring VOBUs stored in NV_PCK, from the access map. In order to calculate DSI, the access map stores the playback time (part or all of AV playback time information immediately after the Tip packet according to FVFPST) and the recording address of the Tip packet for each Tip packet. Multiplexing between two consecutive Tip packets
It is only necessary to know how many Units are stored. This is achieved by the following constraints.

  Note that not all Tip packets need to be pointed out of the access map. For example, AV data following the last Tip packet in the Constrained SESF has a different playback time length or no other Tip packet. Handling is different because it is in a different state from the packet. In such a case, since the last Tip packet is not registered in the access map, there is no particular hindrance to reproduction and conversion.

  A total of 32 packets that do not belong to the Multiplexing Unit are inserted between two consecutive Tip packets. This is necessary in order to specify how many packs of VOBU will be when converted to DVD format using an access map during TS2PS conversion. (The number of packets need not be limited to 32, but it must be a certain number. Since the number of TS packets following the Tip packet can be specified from the address information of the Tip packet in the access map, the packet is not a Multiplexing Unit. It is important to know how many packs are included in the VOBU when converted to the DVD format.This information is important, and this information is described in the MakersPrivateData in each Tip packet. Is also good.)

  The reason why the number is 32 is that PAT and PMT packets indicating MPEG-TS program configuration information are embedded at least once in 100 msec and that SIT packets storing unique information for each program are at least once per second. It is embedded more than once, a PCR packet storing a PCR (Program Clock Reference) for generating a decoder reference time is embedded at least once in 100 msec, and a NULL packet that does not belong to any Multiplexing Unit can be freely added Since the Tip packet insertion interval is 1.0 second or less on the AV data playback time axis, there should be at least 31 PAT, PMT, PCR, and SIT packets between two consecutive Tip packets. It will be a thing. Therefore, by inserting PAT, PMT, PCR, SIT packets according to the time between two consecutive Tip packets, and adding NULL packets until 32 packets are specified, the number of packs of VOBU is specified from the access map. be able to.

As an example, considering the number of packs after conversion when Tip packets are inserted at intervals of 0.5 seconds and the number of TS packets following the Tip packet that can be identified from the access map is 1209 TS packets, PAT, PMT The total of the PCR packets is 15 packets (= 5 + 5 + 5), one packet is assumed to be inserted after the Tip packet, and the remaining 16 packets are inserted as NULL packets. When converting this to the DVD format, the Tip packet is converted to NV_PCK (when converting to DVD-Video) or RDI_PCK (when converting to DVD VR), and one pack, one Multiplexing
Each unit (11 TS packet) is converted into one pack. Therefore, the number of packs of VOBU is
1 + Multiplexing Unit The number of Multiplexing Units can be calculated by the following formula:
(Number of TS packets following the Tip packet−32) / 11
So in this example,
1 + ((1209-32) / 11) = 1 + 107 = 108
Thus, the VOBU can be calculated to be a total of 108 packs. If there are the number of packs and playback start time information for each VOBU, it is possible to generate an NV_PCK DSI packet necessary for conversion to DVD Video at a very high speed.

The above is the restriction on the Tip packet insertion interval. The encoder that generates the Constrained SESF performs system encoding within the above restrictions.
(Restrictions on decoder control)

  Next, restrictions on decoder control (buffer management) of Constrained SESF will be described.

  The Constrained SESF needs to be created so as to satisfy the standard of T-STD, which is the standard decoder model of MPEG-TS. This means that even a STB or the like equipped with a T-STD compliant decoder can decode the Constrained SESF as long as the stream type matches.

  The MPEG-TS standard decoder model T-STD and the MPEG-PS standard decoder model P-STD have substantially the same operation and processing capability, but the input rate of the audio stream to the decoder is different. Specifically, in T-STD, the transfer rate from the transport buffer before the audio decoder to the audio buffer is fixed at 2 Mbps except for AAC, as described with reference to FIG. However, P-STD can input various streams to the decoder at a system rate, that is, a rate of 10.08 Mbps for DVD.

  Therefore, buffer management for Constrained SESF and DVD format cannot be made common.

  As described above, generally, buffer management cannot be made common between MPEG-TS and MPEG-PS, but when converting Constrained SESF to the DVD format, system encoding processing is performed again considering buffer management. If the SCR (System Clock Reference) indicating the decoder input start time of the converted pack can be calculated using the ATS assigned to each TS packet, the conversion can be executed extremely quickly and easily. Details of the SCR derivation method using ATS will be described later.

  The Constrained SESF of the present invention is T-STD compliant and needs to be encoded in advance so that MPEG-PS generated by the conversion method described later can be guaranteed to be P-STD compliant. .

  That is, Constrained SESF is a stream encoded in MPEG-TS so that it is P-STD compliant even if converted to MPEG-PS.

  The above is the restriction on Constrained SESF buffer management. In SESF, encoding is performed so as to match T-STD without worrying about these matters.

  Here, examples of MPEG-TS and MPEG-PS that do not comply with the T-STD and P-STD reference models will be described.

  First, FIG. 45 shows an example of MPEG-TS that can be converted into MPEG-PS but is self-encoded so as not to satisfy the T-STD model. The stream TS1 is an MPEG transport stream that is system-encoded to comply with the T-STD model. The stream TS2 is an MPEG transport stream that does not conform to the T-STD model. That is, in the stream TS2, the values of ATS [47] to ATS [57] are set so as to exceed the transfer rate allowed for audio data in MPEG-TS. The transport buffer (see FIG. 18) overflows so that the T-STD model is not satisfied. On the other hand, the stream TS1 is set so that the values of ATS [47] to ATS [57] satisfy the transfer rate allowed for audio data in MPEG-TS. This stream can be correctly converted into a P-STD-compliant MPEG program stream PS1 by the SCR conversion formula described later. Also, the stream TS2 does not satisfy T-STD, but PS1 is generated if it is converted by an SCR conversion formula described later. In order to make the stream TS2 MPEG-TS compliant with T-STD, it is necessary to increase the transfer time interval of audio packets specified by ATS [47] to ATS [57] so that the transport buffer does not overflow. is necessary.

  Next, FIG. 46 shows an example where the T-STD is satisfied but the MPEG-PS converted from the MPEG-TS does not satisfy the P-STD model. The stream TS3 is an MPEG transport stream, and the stream PS3 is an MPEG program stream converted from the MPEG transport stream TS3. FIG. 46B shows a change in the state of the video data buffer when each stream is decoded. The decoding time of the PES # 1 picture is SCR [2], and the decoding time of the PES # 2 picture is between SCR [4] and SCR [5]. As shown in FIG. 46B, in the transport stream TS3, the data transfer of each TS packet is in time until the picture data included in the PES # 1 and PES # 2 is decoded. On the other hand, in the program stream PS3, the transfer of V_PCK # 1 is in time for PES # 1, but the transfer of V_PCK # 4 is not in time for PES # 2, and decoding starts during the transfer. Cause a buffer underflow. Therefore, the P-STD model is not satisfied. In order to avoid such a situation, the ATS (ATS [14], The values of ATS [25] and ATS [36]) may be shifted so as to be earlier in time.

<ATS-SCR conversion>
Next, a method for deriving the SCR of a PS packet when converting a Constrained SESF stream into a program stream will be described. Since the SCR calculation is necessary when a new pack is generated, it is necessary only when converting the Tip packet and the first TS packet of the Multiplexing Unit.

The Constrained SESF stream has the structure shown in FIG. In the TS packet, a PCR packet storing reference time information (PCR) is appropriately inserted, and using this, a STC (System
(Time Clock) can be reset at certain time intervals. Each TS packet is preceded by an ATS that stores relative transmission time information between TS packets. Therefore, TS packets sent after the TS packet storing the PCR are input to the decoder at a timing obtained from the PCR value and ATS which is relative sending time information between TS packets. That is, the decoder input time of each TS packet (hereinafter referred to as “calculated_PCR”) can be generated for TS packets after the TS packet storing the PCR. Even if there is no TS packet storing PCR, information corresponding to PCR can be extracted as management information.

  FIG. 47 is a diagram showing the relationship between calculated_PCR and SCR when converted from Constrained SESF to MPEG-PS, and is the head of Capsule shown in FIG. In the figure, ATS given to each TS packet in ascending order from the stream head is denoted as ATS [k]. In addition, the PCR value calculated in the order of appearance of the TS packet at the top of the Multiplexing Unit is expressed as calculated_PCR [i] (i = 0, 1, 2,...). Similarly, the SCR of the converted pack is also expressed as SCR [i] in the order of appearance.

As described above, in the T-STD standard model, transfer of a video stream is limited to a maximum transfer rate of 15 Mbps (in the case of MP @ ML, the transfer rate from the multiplexer buffer to the video buffer does not exceed 15 Mbps), and the audio stream For input rate, there is a lower rate limit than video. (The transfer rate from the transport buffer to the audio buffer does not exceed 2 Mbps except for AAC) Therefore, the Multiplexing Unit that stores the audio data is the Multiplexing that stores the video data.
Unlike Unit, it is transferred at a low rate. Therefore, if the transfer rate of video data is increased to near the maximum rate of 9.8 Mbps, which is the maximum rate of the DVD format, the TS packet of video data is obtained in order to secure the transfer time of audio data that requires a low transfer rate and takes a long time. Therefore, it is necessary to transmit at a rate higher than the DVD transfer rate (10.08 Mbps).

  As shown in FIG. 47, it can be seen that the transfer time zone differs between Constrained SESF and the DVD format.

The following relational expression needs to be established between the decoder arrival time (calculated_PCR) of the first TS packet of the Tip packet or Multiplexing Unit and the SCR of the pack after the conversion.
SCR [0] = calculated_PCR [0]
SCR [i] = max (SCR [i-1] + T, calculated_PCR [i]) (i = 1,2,
3, ...)
calculated_PCR [i] = PCR_tip + (ATS [n]-ATS_tip + WA * BS)
T = PS_pack_size * 8 * system_clock_frequency / PSrate
Here, PCR_tip and ATS_tip are respectively the PCR value described in the Tip packet immediately before the Multiplexing Unit to be converted and the ATS value of the Tip packet. WA indicates how many digits overflowed in ATS between ATS (ATS [n]) and ATS_tip given to the first TS packet in i-th Multiplexing Unit, and BS This represents the amount of one-time overflow of ATS. Max (a, b) is a function for selecting the larger value of a and b.

In the relational expression related to SCR [i] (i = 0, 1, 2, 3,...), As described above, PS_pack_size is the byte length of one MPEG-PS pack generated by TS2PS conversion. . system_clock_frequency is the frequency at the reference time of the MPEG-PS decoder, and PSrate is the multiplexing rate of the MPEG-PS stream generated by TS2PS conversion. That is,
PS_pack_size = 2048 bytes,
system_clock_frequency = 27000000 Hz,
PSrate = 10800000 bits / second.

  Therefore, the packs after the first are sent after the minimum transfer time determined by the transfer rate has elapsed from the time of sending the previous pack, or at the decoder input time of the first TS packet forming the pack. There are two patterns. When the video data is sent at a time earlier than the time when the video data is converted to the DVD format, it is selected that the video data is sent with a minimum transfer time interval. For example, when video data is transmitted in a time zone earlier than when it is converted to the DVD format, it is transmitted after the minimum transfer time determined by the transfer rate has elapsed since the previous pack transmission time.

  Since the Constrained SESF can be edited, even when recording with encode_condition = 11b, calculated_PCR [0] = 0 may not be satisfied when the head portion of the stream is deleted by editing.

However, if encode_condition = 11b but not calculated_PCR [0] = 0, the problem can be solved by defining the following conversion equation only when encode_condition = 11b.
SCR [0] = 0
SCR [i] = max (SCR [i-1] + T, calculated_PCR [i])-calculated_PCR [0] (i = 1, 2, 3, ...)
calculated_PCR [i] = PCR_tip + (ATS [n]-ATS_tip + WA * BS)
T = PS_pack_size * 8 * system_clock_frequency / PSrate
PTS (DVD-Video) = PTS (Constrained SESF)-calculated_PCR [0]
DTS (DVD-Video) = DTS (Constrained SESF)-calculated_PCR [0]
As described above, ATS [n] and WA are the ATS value of the TS packet at the head of the i-th Multiplexing Unit and the number of overflows from ATS_tip.

  That is, in order to comply with the DVD-Video standard, SCR [0] = 0 is set, and the subsequent SCR uses a value offset by the time calculated_PCR [0] as a result of the above-described conversion formula. All PTS and DTS are also offset by the time calculated_PCR [0].

  Thus, by uniformly offsetting the time information of the stream, even if the head of Constrained SESF (encode_condition = 11b) is deleted, it is managed as encoded_condition = 11b and can be converted to the DVD-Video format.

  In conversion to the DVD-Video standard format, conversion of PTS / DTS values occurs, but this can be easily realized by sequential processing in units of TS packets.

When performing TS2PS conversion, SCR is calculated from ATS based on the above equation. The program stream obtained by the TS2PS conversion needs to conform to the P-STD model as described above, and therefore, the SCR value is limited to a certain range. Therefore, the value of ATS given to each packet of Constrained SESF needs to be set in consideration of the above-described ATS-SCR relational expression.
(Restrictions on elementary streams)

  Next, restrictions on the elementary stream of Constrained SESF will be described.

  Since the re-encoding of the elementary stream is a very heavy processing for the device, only MPEG2-Video is allowed for video data, and AC-3, MPEG1-Audio, and LPCM are allowed for audio data.

  The Constrained SESF described here excludes the LPCM, which is to avoid the risk of re-encoding the elementary stream in the case of an LPCM having a quantization bit number of 20 bits or more. This is also to facilitate buffer management by reducing the amount of audio data that cannot be raised. However, it is not necessary to exclude a 16-bit LPCM. The stream permitted for Constrained SESF described below will be described as only two types of MPEG2-Video for video, AC-3 for audio, and MPEG1-Audio. Note that in normal SESF that is not Constrained SESF, the encoding of audio data is not limited to this, and an encoding scheme such as AAC (Advanced Audio Coding) used in BS digital broadcasting may be used.

  FIG. 48 collectively shows the elementary stream attributes when encode_condition = “11b”.

  Since the attribute shown in the figure is set to maintain compatibility at the elementary stream level with respect to the DVD-Video or DVD VR format, Constrained SESF (encode_condition = 11b) according to this attribute is When converting to the DVD-Video or DVD VR format, high-speed conversion is possible without requiring re-encoding of the elementary stream.

  FIG. 49 collectively shows the elementary stream attributes when encode_condition = “01b”.

Since the attribute shown in the figure is set so as to maintain compatibility with the DVD VR at the elementary stream level, the Constrained SESF (encode_condition = 01b) according to this attribute is
When converting to the VR format, re-encoding of the elementary stream is not required, and conversion can be performed at high speed.

  Here, Notes 1 to 4 described in FIGS. 48 and 49 will be described.

Note 1: This attribute must not change within the same VOB.
Note 2: This attribute may change in the TS packet storing the first elementary stream following the Tip packet. In other words, it can be changed only in the first video or audio TS packet in the SESF Capsule.
Note 3: sequence_end_code must not be inserted between sequence_headers in which horizontal_size, vertical_size, and aspect_ratio_information are the same.
Note 4: This attribute may change within the same VOB as long as it is between monaural, stereo, and dual mono.

  The above is the restriction on Constrained SESF elementary streams.

  Here, by adding the encoding conditions described above, it is possible to generate a Constrained SESF that can be easily and rapidly converted to the DVD format.

(DVD-Video / DVD VR format after conversion)
Next, the field setting in the DVD-Video and DVD VR formats to which the Constrained SESF is to be converted will be described.

<DVD-Video format>
Hereinafter, a stream of the DVD-Video standard will be briefly described. For details on the DVD-Video stream format, see “DVD
"Specifications for Read-Only Disc Part 3 VIDEO SPECIFICATIONS".

  FIG. 50 shows the stream structure of the DVD-Video standard format. As shown in the figure, each stream includes a plurality of VOBs, and each VOB includes an integer number of VOBUs. The VOBU is composed of an integer number of packs, and the video pack (V_PCK) and the audio pack (A_PCK) are followed by NV_PCK as the head. Unlike the normal DVD pack structure, NV_PCK has a form including two packets. Each packet is called a PCI (Presentation Control Information) packet and a DSI (Data Search Information) packet, and reproduction control information for the VOBU is stored in the PCI packet. The DSI packet stores information useful for special reproduction such as the positional relationship between the VOBU and the surrounding VOBU. In the following, the fields will be described and the generation method will be described together.

  FIG. 51 shows the structure of NV_PCK PCI data. PCI data includes PCI_GI (PCI General Information) for storing general PCI information, NSML_AGLI which is non-seamless angle information, HLI which is information for highlighting menu buttons and the like, ISRC (International Standard Recording Code) is stored in the RECI.

  NSML_AGLI and HLI describe data indicating invalidity when converted from Constrained SESF.

  Although data indicating invalidity may be described in ISRC, or the ISRC code may be described correctly, it is not related to the conversion from Constrained SESF, so description here is omitted. Therefore, only PCI_GI has a problem when creating PCI data from Constrained SESF.

  FIG. 52 shows a PCI_GI structure of NV_PCK. Below, the calculation method is demonstrated only about the field which requires calculation at the time of converting from Constrained SESF.

  NV_PCK_LBN (the NV_PCK relative address in the VOBS file) can be generated by counting the number of packs that the information recording apparatus is to convert during conversion.

  VOBU_CAT (analog copy protection state information) can be acquired from display_and_copy_info of a Tip packet corresponding to NV_PCK.

  VOBU_S_PTM (reproduction time information of the video field first displayed in VOBU) can be calculated from FVFPST of the Tip packet corresponding to NV_PCK.

  VOBU_E_PTM (time information when the video data in the VOBU is played back) is acquired from the playback time information described in the next entry of the access map, or the video stream corresponding to the VOBU is analyzed and the video playback ends. It can be generated by calculating the time to perform.

  Since VOBU_SE_E_PTM (time information at which playback is ended by sequence_end_code in video data in VOBU) is only allowed at the end of the VOB (see FIG. 48), VOBU in the middle of the stream has no sequence_end_code of 000, “000” Is filled. Only NV_PCK having Sequence_end_code in the last VOBU has the same value as VOBU_E_PTM.

  C_ELTM (time difference information between the playback time of the first video frame displayed in the CELL in which the NV_PCK is stored and the first video frame displayed in the VOBU, frame accuracy is required) is being converted by the information recording device In addition, it is possible to calculate at any time using the reproduction time information of the video frame displayed first in the CELL and the FVFPST of the corresponding Tip packet.

  As described above, NV_PCK PCI data can be generated in units of VOBU at any time during conversion.

  FIG. 53 shows the structure of the NV_PCK DSI. As shown in the figure, DSI data includes DSI_GI (Data Search Information General Information) that stores general information of DSI, and SML_PBI (Seamless Playback) that stores recording addresses, playback information, and the like necessary for seamless playback between VOBs. Information), SML_AGLI (Angle Information for seamless) storing arrangement information for seamless reproduction between different angles, VOBU_SRI (VOB Unit Search Information) storing recording address information of VOBUs in the vicinity of the VOBU, It consists of SYNCI (Synchronous Information), which is information for synchronized playback of video and audio / subpicture.

  SML_AGLI describes data indicating invalidity when converted from Constrained SESF.

FIG. 54 shows the structure of NV_PCK DSI_GI. Constrained
In the case of converting from SESF, only the fields that need to be calculated will be described below.

  The NV_PCK_SCR (the SCR value of NV_PCK) is derived from the SCR derived from the ATS of the Constrained SESF by a calculation method described later.

  NV_PCK_LBN (NV_PCK relative address in the VOBS file) is the same as that for obtaining PCI data.

  VOBU_EA (relative address from NV_PCK to the last pack in VOBU) can be calculated from the access map. As described above, since the number of packets that do not belong to the Multiplexing Unit is known (fixed) between two consecutive Tip packets, the number of TS packets from the access map to the next entry (next Tip packet) can be calculated. By subtracting the number of TS packets that do not belong to the Multiplexing Unit in the TS packet and dividing the result by 11, it is possible to calculate how many packs are formed following NV_PCK. For NV_PCK derived from the last Tip packet, or all NV_PCK, the number of packs generated after conversion may be counted and described.

  VOBU_1STREF_EA (in VOBU, relative address from NV_PCK to the last pack of the first reference picture), VOBU_2NDREF_EA (in VOBU, relative address from NV_PCK to the last pack of the second reference picture), and VOBU_3RDREF_A In VOBU, the relative address from NV_PCK to the last pack of the third reference picture is derived without the need to analyze the video stream layer by performing TS2PS conversion while referring to the PES_info of the Tip packet. Is possible.

  PES_info describes picture_coding_type indicating what kind of encoded picture the PES packet of each video has. A PES packet having picture_coding_type = 01b, 10b stores a reference picture in the DVD-Video standard.

  Therefore, while performing TS2PS conversion, the PES_info is referred to, it is determined whether or not the currently converted PES packet stores a reference picture, and the pack in which the converted PES packet has ended is referred to This is the pack at the end of the picture.

  In this way, since the pack at the end of the reference picture is identifiable during the conversion, it is determined in which pack the first, second, and third reference pictures are completed while generating the VOBU. It is possible to describe relative addresses up to the end of each VOBU_1STREF_EA, VOBU_2NDREF_EA, and VOBU_3RDREF_EA of the NV_PCK at the beginning of VOBU.

  Or, referring to the value of PTS_DTS_flags of the PES packet storing the video while converting the SESF Capsule, if PTS_DTS_flags = 11b, the reference picture is stored, and if PTS_DTS_flags = 10b, the non-reference picture is stored These values may be calculated while sequentially determining that the

  VOBU_VOB_IDN (ID number of the VOB to which the VOBU belongs) should be able to be obtained during conversion by the information recording apparatus. When one Constrained SESF is converted, the same number is assigned without the possibility that the VOB is divided under the condition of the stream such as attribute change, according to the definition of Constrained SESF (encode_condition = 11b).

  Similarly to VOBU_VOB_IDN, VOBU_C_IDN (ID number of CELL to which VOBU belongs) is a number set by the information recording apparatus during conversion, and has no relation to the stream. When CELL is intentionally divided from management information such as PGC information of Constrained SESF, a number corresponding to the division is only given.

  C_ELTM (time difference information between the playback time of the first video frame displayed in the CELL in which NV_PCK is stored and the first video frame displayed in VOBU, frame accuracy is required) is C_ELTM described in the PCI data. Is the same.

  As described above, each field of the NV_PCK DSI_GI can be generated as needed in units of VOBU during conversion.

  FIG. 55 shows the structure of SML_PBI in NV_PCK. Below, the calculation method is demonstrated only about the field which requires calculation when converting from Constrained SESF.

  VOB_V_S_PTM (time information of the video frame displayed at the beginning of the VOB to which NV_PCK belongs) can be calculated from FVFPST of the first Tip packet.

  VOB_V_E_PTM (video playback end time information of the VOB to which NV_PCK belongs) is a video playback end time by analyzing the stream after the last Tip packet in the portion designated for conversion in the Constrained SESF in advance before TS2PS conversion. Can be set at any time.

  As described above, each field of SML_PBI of NV_PCK can be calculated before conversion, and the value may be used during conversion.

  Since VOBU_SRI can be calculated using an access map as described above, description thereof is omitted here.

  Also, since VOBU_SRI is described completely for each cell, it cannot be calculated unless the cell is defined. Therefore, in a recorder that records in the DVD-Video format in real time, cells cannot be cut in an arbitrary section and lacks editability and reproducibility. However, when converting from Constrained SESF, follow the above method. Since the section specified by the user can be defined and converted as a cell, chapters can be created as intended by the user, and a playlist that starts playback from a point specified by the user is realized in the DVD-Video format. It becomes possible.

  FIG. 56 shows the structure of the NV_PCK SYNCI. Below, the calculation method is demonstrated only about the field which needs calculation when converting from Constrained SESF.

  A_SYNCA0 (relative address of the pack storing the primary audio and the audio frame stored at the same time as or immediately after VOBU_S_PTM) is being converted to TS2PS without performing stream analysis using PES_info in the Tip packet It is possible to get to.

  By referring to the stream_identifier of the PES_info, it is possible to determine whether the PES packet stores primary audio, and the next sync_presentation_flag plays the audio frame included in the PES packet at the same time as or immediately after the VOBU_S_PTM. Whether there is an audio frame to be played can be identified. Therefore, the address from NV_PCK to the pack storing the PES packet can be described when the PES packet includes primary audio and sync_presentation_flag = 1b while performing TS2PS conversion.

  There is no guarantee that the sync_presentation_flag is 1b in one audio pack in the VOBU. In the case of an encoder that multiplexes audio first, an audio pack that is played back simultaneously with or immediately after VOBU_S_PTM of a certain VOBU may be stored in the previous VOBU, and vice versa.

  Therefore, in setting the value of A_SYNCA0, it is necessary to set the value after correctly understanding the order relationship between the primary audio PES packet being converted (the sync_presentation_flag is 1b) and the NV_PCK generated thereafter.

  In order to eliminate this processing, the Constrained SESF performs system encoding so that the audio data to be reproduced at the same time or immediately after the FVFPST described in the Tip packet of the SESF capsule is stored in the SESF capsule in advance. You can leave it.

  By defining in this way, it is possible to eliminate processing for detecting audio data that exceeds VOBU (SESF capsule) and is synchronized with VOBU_S_PTM (FVFPST).

  A_SYNCA1 (a relative address of a pack storing secondary audio and a pack storing an audio frame reproduced immediately after VOBU_S_PTM) can be set in the same manner as A_SYNCA0.

  As described above, NV_PCK DSI data can be generated as needed in units of VOBU except for A_SYNCA during conversion.

  FIG. 82 summarizes an example of the NV_PCK generation method.

<DVD Video Recording format>
A field setting at the time of conversion to a DVD Video Recording (VR) stream format will be described.

  Hereinafter, a stream of a DVD VR will be briefly described. The details of the DVD VR stream format are described in “DVD Specifications for Rewritable / Re-recordable Discs Part3 VIDEO RECORDING”.

  FIG. 57 shows a stream structure in the DVD VR format. As shown here, each stream includes a plurality of VOBs, and each VOB includes an integer number of VOBUs. The VOBU is composed of an integer number of packs, and the video pack (V_PCK) and the audio pack (A_PCK) follow the RDI_PCK as the head. Unlike normal packs, RDI_PCK stores display and copy control information and manufacturer-specific information. Hereinafter, each field included in RDI_PCK will be described, and the calculation method thereof will be described together.

As shown in the figure, RDI_PCK payload data (RDI Unit) is RDI_GI (Real-time Data Information) storing general information of RDI.
General information), DCI_CCI (Display Control Information and Copy Control Information) storing information for display and copy control, and MNFI (Manufacturer's Information) storing manufacturer-specific information.

  RDI_GI includes a VOBU_S_PTM field therein, only this field is variable, and other fields are embedded with fixed values.

  Since VOBU_S_PTM has the same format as FVFPST described in the corresponding Tip packet in the transport stream before conversion, the value of FVFPST can be copied as it is.

  Since DCI_CCI has exactly the same format as the display_and_copy_info of the Tip packet, the value of display_and_copy_info can be copied as it is.

  The MNFI is assigned a unique manufacturer ID only when the maker_ID described in the Tip packet is the same as the manufacturer ID of the information recording apparatus, and the manufacturer unique information is described (copied). However, when the maker_ID in the Tip packet is an ID of another manufacturer or an invalid maker_ID value, an RDI pack may be generated by describing invalid data in the MNFI.

  It is assumed that some data described in the Tip packet is invalid. In this case, since a flag (invalidation flag) indicating that the corresponding data in the Tip packet is invalid should be stored, when the invalidation flag is ON, the corresponding data in the Tip packet is stored. Needs to be updated after updating to the latest data.

  As an example, the case where the latest CCI information and the CCI data invalidation flag in the TS packet exist in the ATS (4B) for each TS packet can be considered.

  In this case, when TS2PS conversion is performed, it is confirmed that the invalidation flag is not set. If it is set, it is necessary to convert to RDI_PCK using data obtained by updating the CCI information of display_and_copy_info with the CCI flag in the ATS. is there.

  As described above, RDI_PCK can be created sequentially from only the corresponding Tip packet (and its ATS).

  FIG. 58 shows a flowchart for generating the above RDI_PCK.

  In the case of RDI_PCK (or NV_PCK), the system header is composed of a fixed value field. Details of the system header are shown in FIG. FIG. 62 shows a packet header and a private header stored in RDI_PCK. As shown, these headers are also composed of fixed value fields, so that they are easy to generate.

  FIG. 59 shows a flowchart for generating a PS pack from a TS packet (1 Multiplexing Unit) storing AV data.

  As shown in the figure, a Constrained SESF TS packet storing AV data is converted into a 2 KB pack of MPEG-PS storing AV data, with 1 Multiplexing Unit as a processing unit. Hereinafter, the process will be described for each step.

  (Step S4200) Only one TS packet is read from the conversion start point of the Constrained SESF stream.

  (Step S4201) It is determined whether or not the read TS packet stores AV data and is the first TS packet of the Multiplexing Unit. The determination of AV data storage is made by referring to the PID value of the TS packet declared to store AV data in the PMT. Regarding the determination of whether or not it is the head of the Multiplexing Unit, when the preceding TS packet is any of a Tip packet, a PSI / SI packet, and a PCR packet, the TS packet storing the AV data immediately after that is the Multiplexing It is determined that it is the head of the unit. Since the conversion start point is expected to be a Tip packet, it is possible to determine whether or not it is the head of the Multiplexing Unit by sequentially reading TS packets (that is, a TS packet storing AV data immediately after the Tip packet is always Multiplexing). It is the head of Unit.) As a result of the determination, if the TS packet is not the head of the Multiplexing Unit, or if conversion has not started from the Tip packet and determination cannot be made, the process returns to S4200 to read the next TS packet. If it is confirmed that the head is Multiplexing Unit, the process proceeds to the next process.

  (Step S4202) Using the ATS assigned to the first TS packet of Multiplexing Unit, the time (calculated_PCR) at which the MPEG-PS pack into which the TS packet is converted is input to the decoder is calculated. This calculation method is as described above. When the PCR is calculated, the SCR can be calculated by the above-described calculation method, and the pack header shown in FIG. 60 is completely determined. This is because the pack header allows only fixed values except for the SCR.

  (Step S4203) A packet header and a private header are created.

  The packet header is created based on the PES packet header of Constrained SESF. The created packet header must have a format that satisfies the field values shown in FIG. This is because the conversion from Constrained SESF is not uniquely determined unless the value of a field that changes the header length is determined, which may affect the buffer management. Fields not shown here are fixed values and are not listed.

  The reason why each field value of the PES packet header is determined in detail by Constrained SESF is to minimize the processing required for conversion from the PES packet header (MPEG-TS) to the packet header (MPEG-PS). is there.

  When the size of the PES packet is larger than the size of one pack, one PES packet is converted into a plurality of packs. In this case, the packet headers of the second and subsequent packs have PTS_DTS_flags of the first packet header generated from the PES packet set to “00b”, PES_extension_flag set to “0b”, adjustment of the stuffing_byte length, and The correction point is to correct PES_header_data_length.

  Since the private header is required when storing a stream that is not MPEG standard, it is necessary for a pack storing NV_PCK, RDI_PCK, AC-3, LPCM, and the like.

  FIG. 64 shows an AC-3 private header. Of the fields shown in the figure, according to the definition of the Constrained SESF Multiplexing Unit, only the number_of_frame_headers need to be calculated during TS2PS conversion. Since this field specifies the number of AC-3 audio frames stored in the pack, the value of the field can be calculated from the bit rate of one audio frame byte length for a fixed rate AC-3. Since the value becomes a fixed length, it can be easily calculated from PES_packet_length and the like.

Constrained by AC-3 private header (4B)
It should be noted that the PES_header_data_length in the SESF PES packet header is stuffed by an extra 4 bytes. (See FIG. 44) Thus, by sequentially estimating the header length after conversion and shifting the position of the payload, sequential processing in units of TS packets is facilitated.

  As described above, the first packet header is partially modified from the header of the PES packet, the second and subsequent packet headers are partially modified from the first packet header, and the private header is an MPEG non-standard stream only. By inserting, it is possible to generate a packet header and a private header.

  (Step S4204) If a private header is created, the payload part of the TS packet is simply packed in order from the beginning of the payload part of the PS pack and copied.

  (S4205 to S4207) This is simply repeated until the Multiplexing Unit (11 TS packets) is completed, but a NULL packet may be inserted in the middle, so the PID (0x1FFF) of the NULL packet is confirmed. Then, the payload data of the TS packet is copied.

  At this time, it is preferable to define so that only the TS packet storing the last data of the PES packet has an adaptation field. As a result, the payload data of 184B is always stored in the TS packet except the end of the TS packet storing the last data of the PES packet in the Constrained SESF, so that the payload data can be easily read.

  (Step S4208) Next, when the copying is completely completed up to the payload data of Multiplexing Unit, the byte length of the formed pack is calculated, and it is confirmed whether it is 2048B. If it is already 2048B, the generation of the pack ends. If it is not yet 2048B, the process proceeds to S4209.

  (Step S4209) If the pack is not 2048B, a padding packet is added to the end of the payload so that it becomes 2048B.

  As described above, the conversion process from the Multiplexing Unit storing AV data is performed. The above processing may be repeated only when a Multiplexing Unit is detected until the processing of the conversion portion designated by Constrained SESF is completed.

  The conversion results for each pack in the conversion process will be described as follows.

<Conversion to video pack (V_PCK)>
FIG. 65 illustrates the conversion from Constrained SESF to MPEG-PS. As shown in FIG. 65A, since one video PES packet is usually larger than 2 KB, it is generally divided into a plurality of Multiplexing Units and multiplexed in a Constrained SESF.

  According to the Constrained SESF regulations, the video PES packet data is stuffed to the maximum in the Multiplexing Unit except for the last Multiplexing Unit constituting one video PES packet. Accordingly, except for the last Multiplexing Unit, data of 2024 bytes (= 184 × 11 bytes) is stored in all the Multiplexing Units.

  By defining in this way, fields such as PES_packet_length and stuffing_byte of each pack can be determined in advance at the time of TS2PS conversion.

  The last Multiplexing Unit storing the data of one video PES packet may make up one complete Multiplexing Unit by filling the remaining data amount with the adaptation field and the NULL packet, and improving the efficiency of data transfer ( For the purpose of increasing the amount of data stored in the converted MPEG-PS pack, the data of the next PES packet may be stored.

  However, considering the ease of conversion to DVD, only the I picture in the SESF Capsule is arranged from the first TS packet of the Multiplexing Unit that stores the first video data in the SESF Capsule.

  As described above, the P picture and the B picture do not have to be arranged from the top of the Multiplexing Unit.

  As shown in FIG. 65, the Multiplexing Units constituting one video PES packet can be classified into the following three types.

  The first Multiplexing Unit (MU # 1 in the figure) storing the head data of the PES packet, and the Multiplexing Unit (MU # n in the figure, where n = 2, 3,... N-1) and Multiplexing Unit (MU # N in the figure) storing the last data of the PES packet.

  Each pack of an MPEG-PS stream that has undergone TS2PS conversion has a structure shown in FIG.

  Since packs converted from MU # 1 always have a space of 10 bytes or more at the time of pack generation, a padding packet is inserted at the end.

  In DVD format, stuffing bytes (the last field of the packet header) are added to 2048 bytes when there is 7 bytes or less in the pack, and padding packets are inserted when 8 bytes or more are available. It is because it has become.

  Further, the pack converted from MU # n forms a pack by adding 1 byte of stuffing.

  In addition, a pack converted from MU # N usually has a free area larger than 8 bytes in the pack configuration, and a padding packet is inserted.

<Conversion to audio pack (A_PCK)>
FIG. 66 illustrates the conversion from Constrained SESF to MPEG-PS. As shown in FIG. 66 (a), one audio PES packet (which stores one or more audio frames) has a size smaller than one Multiplexing Unit.

  Since one audio PES packet fits in one Multiplexing Unit, complicated conversion is not required unlike a video PES packet. That is, as shown in FIG. 66 (b), a pack into which a padding packet is inserted must be generated.

  Also, since PES_packet_length is not changed by TS2PS conversion, the calculation at the time of conversion is as simple as setting stream_id appropriately when converting MPEG1-Audio or generating a private header for AC-3. It is only a simple process.

  Also, as shown in the figure, buffer management can be simplified by minimizing the transfer time of audio data, which is a major factor that makes Constrained SESF system encoding difficult.

  The transfer time of the audio multiplexing unit cannot be transferred because video data or other PSI / SI packets cannot be transferred, and the overall transfer rate decreases (deterioration in image quality). It is ideal to transfer video data in as short a time as possible in order to cause problems such as the problem that the video data needs to be transferred ahead of time on TS (system encoding becomes complicated).

  In other words, transferring the audio Multiplexing Unit in a short time means increasing the audio transfer rate, which is a significant difference between the T-STD and the P-STD, which is the allowable audio input rate. It leads to reducing the difference. Therefore, there is a great advantage of facilitating generating a Constrained SESF that must match two decoder models.

  FIG. 67 shows the bit rate of each audio allowed by Constrained SESF and the maximum payload length stored in one audio PES packet when AC-3 and MPEG1-Audio are stored for each. Since data larger than the byte length shown here is not stored in one audio PES packet, a padding packet is always inserted.

(Restrictions in PES packets)
An integer number of PES packets including an integer number of audio frames may be stored in an integer number of Multiplexing Units to increase the amount of data stored in the converted MPEG-PS pack and efficiently multiplex them. However, in this case, calculation of PTS at the time of conversion becomes a problem.

  In the DVD standard, the PTS of the first audio frame starting in the PES packet is described as the PTS in the audio PES packet header.

  When performing TS2PS conversion, there is a case where the audio frame that becomes the head of the PES packet after conversion to MPEG-PS (DVD) does not match the audio frame that becomes the head of the PES packet multiplexed by the Constrained SESF before conversion. . Therefore, in the present invention, multiplexing is performed by Constrained SESF so that the first audio frame starting in the PES packet of the converted MPEG-PS pack always has PTS. As a result, there is no need to newly calculate and obtain PTS during TS2PS conversion.

  Therefore, it is effective that the first complete audio frame in the Multiplexing Unit is the first audio frame (that is, an audio frame in which PTS is always described) in the payload of the PES packet in the Multiplexing Unit. . Therefore, the Constrained SESF according to the present invention stipulates that “the first complete audio frame starting in the Multiplexing Unit is the first audio frame in the payload of the PES packet in the Multiplexing Unit”. Note that this rule may be “the audio frame in which the first byte of the frame starts first in the Multiplexing Unit is the first audio frame in the payload of the PES packet in the Multiplexing Unit”. Since the restriction according to this rule is one of the constraints of Constrained SESF, it can be determined whether or not the above rule is satisfied by referring to the encode_condition flag.

  FIG. 83A is a diagram for explaining MPEG-TS formatted by Constrained SESF that satisfies the above-mentioned regulations and MPEG-PS converted from the MPEG-TS.

  The PES packet headers of the PES packets 411, 412, and 413 correspond to the first audio frames (AF # 1, AF # 5, and AF # 8) among the audio frames included in the PES packets 411, 412, and 413, respectively. PTS values (PTS # 1, PTS # 5, PTS # 8) are included.

  The first Multiplexing Unit (401) includes all data of the PES packet 411 and data up to the middle of the PES packet 412.

  In the first Multiplexing Unit (401), the first complete audio frame in the Multiplexing Unit (401) is Audio Frame # 1, which is the first audio frame in the payload of the PES packet 411, Meets the above requirements. Also, looking at the second Multiplexing Unit (402), the first complete audio frame in the Multiplexing Unit (402) is audio frame # 8, which is the first audio frame in the payload of the PES packet 413. And meets the above requirements. Note that the Multiplexing Unit (402) includes the latter half of the audio frame # 7 immediately after the PES packet header, but it is a part of the audio frame and not a complete audio frame. This is not a condition.

  The PES packet header of the PES packet 411 included in the first Multiplexing Unit (401) includes the PTS value (PTS # 1) of the first complete audio frame # 1 in the subsequent audio frame (AF). . The second Multiplexing Unit (402) includes the PTS value (PTS # 8) of the first complete audio frame # 8 in the subsequent audio frame (AF).

  When the second Multiplexing Unit (402) is converted to MPEG-PS, the PES packet header in the conversion-destination MPEG-PS includes the PTS packet header contained in the Multiplexing Unit (402). The value (PTS # 8) is copied as it is. In this way, at the time of PS2TS conversion, it is only necessary to copy the PTS value as it is, and the processing is simplified.

  Next, a case where video data is included in the PES packet will be described. As one of the constraints of Constrained SESF, a constraint that “a PES packet storing an I picture starts from the top of a Multiplexing Unit” may be provided for a PES packet including video data.

  FIG. 83B shows an example satisfying the above rules. In FIG. 83B, a PES packet 416 includes an I picture, and the PTS value (PTS # 2) of the I picture is stored in the PES packet header. The PES packet 416 is arranged at the head of the Multiplexing Unit (404).

  In the converted MPEG-PS pack, the PTS value (PTS # 2) stored in the PES packet header 421 indicates the I picture immediately after that. The Multiplexing Unit (403) stores the P picture included in the payload of the PES packet 415, and inserts a NULL packet into the remaining part, thereby aligning the I picture to the next Multiplexing Unit (404). .

  When converting the Multiplexing Unit (404) to MPEG-PS, the value (PTS # 2) of the PES packet header in the Multiplexing Unit (404) is copied to the PES packet header 421 of the MPEG-PS pack. Since the PTS value only needs to be copied in this way, it is not necessary to calculate the PTS value and obtain a simplified process.

(TS2PS conversion process)
Details of the TS2PS conversion processing will be described with reference to the flowcharts of FIGS.

  FIG. 68 is a flowchart showing the main processing of TS2PS conversion. This process is started when a user requests TS2PS conversion. First, the head SESF Capsule for starting the conversion is sought (S11). Then, it is determined whether or not there is a SESF Capsule to be processed (S12). If there is a SESF Capsule, the process ends. If there is a SESF Capsule, an initialization process (S13) and a capsule unit process (S14) are performed.

The initialization process (S13) will be described using the flowchart of FIG. Here, variables and the like used for the subsequent processing are set and initialized. First, it is determined whether or not the Tip packet has been read (S21). If the Tip packet has not been read yet, the Tip packet is read (S22). The ATS value of the Tip packet is substituted into the variable ATS Tip (S23). The PCR value of the Tip packet is substituted into the variable PCRTip (S24). Multiplexing in process
A variable MU_num that designates a unit number is set to 0 (S25). A variable WA indicating the number of ATS overflows is set to 0 (S26).

  The capsule unit process (S14) will be described with reference to the flowchart of FIG. One TS packet is read (S31). It is determined whether or not the read TS palette is a Tip packet (S32). If it is a Tip packet, the process ends. If it is not a Tip packet, it is determined whether the read TS packet is an audio packet or a video packet (S33). If the read TS packet is not an audio packet or a video packet, the process returns to step S31, and the TS packets are sequentially read until the read TS packet becomes an audio packet or a video packet (S31 to S33). If the read TS packet is an audio packet or a video packet, the subsequent 10 TS packets are read (S34). MU_num is incremented (S35). The ATS value of the first TS packet of the Multiplexing Unit is stored in the variable ATS [MU_num] (S36). The byte length of the payload data of the PES packet stored in the Multiplexing Unit is set to payload_len (S37). Then, pack unit processing is performed (S38).

  As shown in the flowchart of FIG. 71, the pack unit processing includes SCR calculation processing (S41), pack header processing (S42), packet header processing (S43), payload processing (S44), and padding packet processing (S45). Each process will be described in detail below.

  The SCR calculation process will be described with reference to FIG.

  Here, the SCR value of the pack is obtained. First, referring to the value of the variable MU_num, it is determined whether or not it is the first Multiplexing Unit in the capsule. If it is the first, the value of the variable ATS Tip is set to the variable ATS [0], and the variable SCR [0] is set. The value of the variable PCRTip is substituted (S51 to S53).

  Then, ATS [MU_num] is compared with ATS [MU_num-1] (S55). ATS “i” stores the ATS value of the first packet of the Multiplexing Unit, and this ATS value is a value indicating a relative transfer timing based on a certain packet. Therefore, normally, the ATS value of the subsequent packet is larger than the ATS value of the previous packet. However, since the ATS value is generally a finite value represented by 30 bits, overflow may occur. In this case, the ATS value of the subsequent packet is smaller than the ATS value of the previous packet. In step S54, the reversal of this ATS value is observed, and it is determined whether or not an overflow has occurred. If ATS [MU_num] is equal to or less than ATS [MU_num-1], that is, if an overflow has occurred, the variable WA is incremented (S55).

  Then, SCR [MU_num] + T or (PCRTIP + ATS [MU_num] -ATSTip + WA × BS), whichever is larger, is substituted into SCR [MU_num] (S56).

  The pack header process will be described with reference to FIG.

  Here, pack header data having the data structure shown in FIG. 60 is edited. The remainder of SCR divided by 300 is substituted into SCR_extension (S61). The value of the quotient obtained by dividing SCR by 300 is substituted into SCR_base (S62). “0x6270” is substituted into program_mux_rate (S63). “000b” is substituted into pack_stuffing_length (S64). Other fields are edited to complete the pack header data (S65).

  Packet header processing will be described with reference to FIG.

  First, stream ID processing for setting a stream ID is performed (S71). Thereafter, it is determined whether or not video data is included in the Multiplexing Unit (S72).

  If video data is included in the Multiplexing Unit, it is determined whether the TS packet at the head of the Multiplexing Unit includes a PES packet header (S73). When the TS at the beginning of the Multiplexing Unit includes the PES packet header, the Video PES packet head process is performed (S74). Otherwise, the PES packet non-head process is performed (S75). Whether the TS packet at the head of the Multiplexing Unit includes a PES packet header is determined by referring to the payload_unit_start_indicator of the TS packet header or directly referring to whether the start code of the PES packet header is stored. .

  On the other hand, when video data is not included in the Multiplexing Unit, it is determined whether or not a PES packet header is included in the Multiplexing Unit (S76). If the Multiplexing Unit includes a PES packet header, audio PES packet head processing is performed (S77). Otherwise, audio PES packet non-head processing is performed (S78).

  The stream ID process will be described with reference to FIG.

  Here, the value of the stream_id field is set. If the type of stream being processed is “MPEG2-video”, “0xE0” is set to stream_id (S81, S82). If the type of stream being processed is “AC3-audio”, “0xBD” is set to stream_id (S83, S84). If the type of stream being processed is “MPEG1-audio” and “Primary audio”, “0xC0” is set in stream_id (S85, S86, S87). When the type of stream being processed is “MPEG1-audio” and “Secondary audio”, “0xC1” is set to stream_id (S85, S88, S89).

  The video PES packet head process will be described with reference to FIG. 76A.

  FIG. 81 is a diagram showing in detail the structure of a PES packet in the MPEG standard. In this processing, each field is edited according to the structure shown in FIG.

First, a PES packet header that is the same as the PES packet header stored in the first TS packet of the Multiplexing Unit is generated as a PES packet header of the converted MPEG-PS (S91). Next, a value calculated by the following equation is set in PES_packet_length (S92).
PES_packet_length =
(3 + PES_header_data_length) + payload_len

  Next, it is determined whether or not PES_extension_flag is “1” (S93). When PES_extension_flag is “1”, 3 bytes from PES_private_data_flag to P-STD_buffer_size are overwritten with a predetermined value (“0x1E60E8S”). .

  The video PES packet non-leading process will be described with reference to FIG. 76B.

  A temporary value (“0x000001E007EC800001FF”) is set in the PES packet header (S111). It is determined whether the value of (2025-payload_len) is between 1 and 8 (S112).

  If the value of (2025-payload_len) is 8 or more, the process proceeds to step S116.

If the value of (2025−payload_len) is between 1 and 8, PES_header_data_length is set to (2025−payload_len) (S113), and the value calculated by the following equation is set to PES_packet_length (S114).
PES_packet_length =
(3 + PES_header_data_length) + payload_len

  Then, stuffing bytes of (2024-payload_len) bytes are set in stuffing_byte (S115), and the process proceeds to step S116.

In step S116, it is determined whether the value of (2025-payload_len) is 8 or more. If it is equal to or greater than 8, PES_header_data_length is set to 0 (S117), and the value calculated by the following equation is set to PES_packet_length (S118).
PES_packet_length = 3 + payload_len

  Then, one stuffing byte is deleted from the stuffing_byte (S119).

  The audio PES packet head process will be described with reference to FIG. 77A.

First, a PES packet header that is the same as the PES packet header that first appears in the Multiplexing Unit is generated as a PES packet header of the converted MPEG-PS (S181). Next, a value calculated by the following equation is set in PES_packet_length (S182).
PES_packet_length =
(3 + PES_header_data_length) + payload_len

  Next, it is determined whether or not the PES_extension_flag is “1” (S183). When the PES_extension_flag is “1”, 1 is set in the P-STD_buffer_flag (S184). Then, it is determined whether the audio data is AC-3 audio (S185). In the case of AC-3 audio, 2 bytes following PES_extension_flag_2 are set to a predetermined value (“0x603A”) (S186). If it is not AC-3 audio, 2 bytes following PES_extension_flag_2 are set to a predetermined value ("0x4020") (S187).

  The audio PES packet non-leading process will be described with reference to FIG. 77B.

It is determined whether stream_id is “0xBD”, that is, whether the audio data is AC-3 audio (S191). If the stream_id is “0xBD”, the temporary value “0x000001BD000000800004FFFFFFFF” is set in the PES packet header (S192). Then, the value calculated by the following equation is set in PES_packet_length (S193).
PES_packet_length = 7 + payload_len

On the other hand, if the stream_id is not “0xBD”, it is determined whether the stream_id is “0xC0”, that is, whether the audio data is MPEG-1 primary audio (S194). If it is MPEG-1 primary audio, a temporary value “0x000001C000000800000” is set in the PES packet header (S195). If it is not MPEG-1 primary audio, a temporary value “0x000001C10000800000” is set in the PES packet header (S196). Then, the value calculated by the following equation is set in PES_packet_length (S197).
PES_packet_length = 3 + payload_len

  The payload process will be described with reference to FIG.

  1 is set to the variable i (S121). The payload data of the PES packet stored in the i-th TS packet is read (S122). The payload data of the PES packet stored in the i-th TS packet is added to the pack payload (S123). The variable i is incremented (S124). The above processing is repeated as long as the variable i does not exceed 12 (S125). That is, the process is repeated until the above process is performed for all TS packets included in one Multiplexing Unit (S122 to S125).

  The padding packet process will be described with reference to FIG.

  It is determined whether or not PES_packet_length is 2028 (S131). If PES_packet_length is not 2028, {(2028-PES_packet_length) -6} is set in PES_packet_length of the padding packet (S132). A padding packet is added following the payload (S133).

  The PTS described in the MPEG-2 PES packet converted as described above can be set with reference to the PES packet header that appears first in the Multiplexing Unit. (See FIGS. 83A and 83B)

  In the above description, since the PES_packet_length indicating the length of the video PES packet is 0, there is a problem that the calculation of PES_packet_length in the packet header after conversion into a pack is not determined unless data is determined in the pack. However, PES_packet_length for each video PES packet in the SESF capsule may be described in the Tip packet. As a result, PES_packet_length can be determined by sequential processing in units of TS packets, and conversion can be performed at higher speed.

  In the above description, the pack header (SCR) is generated at the time of TS2PS conversion. However, the pack header may be stored in advance in the PES packet header stored in the MPEG-TS. For example, pack_header_field_flag = 1b of the PES packet header is used to store a pack header after TS2PS conversion in the PES packet header, and data stored in the same pack as the pack header is determined from a predetermined rule (for example, Data stored in up to a predetermined number of TS packets may be stored in the pack.

(Restriction of video picture within one continuous STC section)
As shown in FIG. 84 (a), the video picture (Pf) displayed first in the first complete SESF Capsule in the continuous STC (system target decoder reference time) section is the top field, The last displayed video picture (Pl) in the last complete SESF Capsule may be the bottom field. FIG. 84B shows a case where this rule is not satisfied. The video picture (Pf) that is displayed first in the first complete SESF Capsule becomes the bottom field, and in the last complete SESF Capsule. The video picture (Pl) displayed last is the top field.

  The reason for limiting the video display mode in such a complete SESF Capsule continuous section is to prevent re-encoding of the video stream when converting to DVD-Video VOB (if there is no editing to the recorded stream). It is because it can do. This is because in the DVD-Video standard, a video in one VOB is required to be played back from the top field and end with the playback of the bottom field.

  Since the above constraint is one of the constraints of Constrained SESF, it can be determined whether or not the above constraint is satisfied by referring to the encode_condition flag. That is, by referring to this flag, the video picture that is displayed first in the first complete SESF Capsule is the top field and last in the last complete SESF Capsule within one continuous STC interval. It can be determined whether or not the displayed video picture is a bottom field.

  FIG. 85 is a flowchart of a recording process in Constrained SESF with the above restrictions.

  First, generation of a continuous STC is started (S201). Next, the value of encode_condition set in advance is acquired (S202). The value of encode_condition is set in advance by the initial setting of the user or the recording device. It is determined whether or not encode_condition is “11b” (S203). When encode_condition is “11b” (recording in the DVD-Video mode), it is determined whether or not the first complete SESF Capsule is encoded (S208). When the first complete SESF Capsule is encoded, encoding is performed so that the first display picture in the first complete SESF Capsule becomes the top field (S209). Subsequently, the data is encoded as Constrained SESF that satisfies the request when encode_condition is “11b” (S210).

  On the other hand, when encode_condition is “01b” (recording in the DVD-Video Recording mode), data is encoded as a Constrained SESF that satisfies the request when encode_condition is “01b” (S204).

  Thereafter, time map information is sequentially added every time the SESF Capsule is completed (S205). It is determined whether or not the recording is finished (S206). If the recording is finished, a recording end process is performed (S207). Steps S203 to S205 are repeated until the end.

  The recording end process will be described with reference to FIG.

  It is determined whether or not encode_condition is “11b” (S211). When encode_condition is “11b”, it is determined whether or not the last picture displayed in the last complete SESF Capsule is a bottom picture (S212). If it is not the bottom picture, a new SESF is created or the currently encoded SESF is completed and encoded so that the last ends with the bottom picture (S213).

  On the other hand, if encode_condition is not “11b”, the last SESF Capsule that satisfies the request when encode_condition is “01b” is generated (encoding is stopped) (S214).

  Thereafter, the time map information is completed and recorded on the recording medium (S215).

  Although the reverse conversion from MPEG-PS to MPEG-TS is not described in the above description, it can be considered similarly as the reverse of TS2PS conversion.

  For example, one PS pack is converted into a plurality of continuous TS packets, and the ATS increment of a plurality of continuous TS packets generated at that time is fixed, and the information is stored on the disk or in the stream. Is also possible.

  In addition, when an MPEG-PS clip name (program information indicating content contents, etc.) is stored in a SIT packet and converted into MPEG-TS, the original program name can be displayed in a menu by a decoder such as STB. It becomes possible.

  In the information recording apparatus / method described above, when externally input AV data is self-encoded into the MPEG transport stream format, it is possible to efficiently perform encoding / decoding processing while maintaining decoder compatibility. .

  Further, since the user private information can be stored in the stream recorded on the information recording medium, it is possible to increase the added value of the recorded content in the MPEG transport stream format.

  Furthermore, since the MPEG-TS recorded on the information recording medium is multiplexed in block units of 2 KB or less so as to increase the affinity for MPEG-PS, the MPEG-TS is converted to MPEG-PS. Can be realized very easily without considering buffer management.

  Needless to say, the data processing according to the present invention described above can be realized by a computer executing a predetermined program. The program can be stored in a floppy disk, hard disk, CD-ROM, or other computer-readable information recording medium.

  Although the present invention has been described with respect to particular embodiments, many other variations, modifications, and other uses will be apparent to those skilled in the art. Accordingly, the invention is not limited to the specific disclosure herein, but can be limited only by the scope of the appended claims. The present application relates to a Japanese patent application, Japanese Patent Application No. 2003-106399 (submitted on April 10, 2003), the contents of which are incorporated herein by reference.

  The present invention is useful for an information recording apparatus having a format conversion function from a first stream (for example, an MPEG transport stream) to a second stream (for example, an MPEG program stream).

It is the figure explaining an example of the interface with the external appearance of DVD recorder apparatus, and related apparatus. It is a block diagram of the drive device of a DVD recorder. (A) It is the figure explaining the continuous area on a disk, (b) It is the figure explaining the change of the data storage amount in a track buffer. It is a block diagram of a DVD recorder in the case of including a semiconductor memory card and a hard disk drive device. (A) It is the figure explaining the data area of a disk, (b) It is the figure explaining the data structure. It is a figure explaining the logical data space of the disk. It is a figure explaining the directory and file structure of a disk. It is a figure which shows the structure of a video object. It is a figure explaining an MPEG system stream. It is a figure explaining an MPEG-TS stream. It is a figure explaining an MPEG-PS stream. It is a figure explaining TS packet. It is a figure explaining the PAT table. It is a figure explaining arrangement | positioning on the disc of a video object. It is a figure explaining the data structure of video management information. It is a figure explaining the data structure of video management information. It is the figure explaining the relationship between PGC information of video management information, object information, and an object. It is a block diagram which shows the structure of the function of a reproducing | regenerating apparatus. It is a block diagram which shows the function structure of a recording device. It is a block diagram which shows the structure of the information recording / reproducing apparatus of this invention. It is a figure explaining the structure of a self-recording stream. It is a figure explaining a packet transfer time interval. It is a figure explaining the storage method of a User Private packet. It is a figure explaining the storage method of a User Private packet. It is a figure explaining the storage method of a User Private packet. It is a figure explaining the storage method of a User Private packet. It is a figure explaining conversion from MPEG-TS to MPEG-PS. It is a figure explaining the encoding method of MPEG-TS with easy conversion to MPEG-PS. It is a figure explaining the conversion to DVD-Video format (in the case of NTSC). It is a figure explaining the conversion to DVD-Video format (in the case of PAL). It is a figure explaining the internal data structure of a User Private packet. It is the figure explaining the correspondence of MPEG-TS encoded so that conversion to MPEG-PS was possible easily, and MPEG-PS after conversion. It is a block diagram which shows the encoder of the information recording device of this invention. It is a figure explaining the difference in the process at the time of converting from self-encoding MPEG-TS to DVD format by the difference in a system encoding method. It is a figure explaining the data structure of a Tip packet. It is a figure explaining the data structure of adaptation_field. It is a figure explaining the data structure of Data_ID. It is a figure explaining the data structure of display_and_copy_info. It is a figure explaining the data structure of encode_info. It is the figure which showed the structure of PES_info. It is a figure explaining the data structure of MakersPrivateData. (A) It is the figure explaining PID of the Tip packet, (b) It is the figure explaining stream_type of the Tip packet. It is a figure explaining the field value of the PES packet header in a Constrained SESF stream. It is a figure explaining PES_extension_flag and PES_header_data_length in a Constrained SESF stream. It is the figure which showed the example of MPEG-TS self-encoded so that the T-STD model may not be satisfy | filled. It is the figure which showed the example in case MPEG-PS converted from MPEG-TS does not satisfy P-STD model. It is a figure explaining calculation of SCR. It is a figure explaining the elementary stream attribute of Constrained SESF in the case of encode_condition = "11b". It is a figure explaining the elementary stream attribute of Constrained SESF in the case of encode_condition = "01b". It is the figure which showed the stream structure of the format of DVD-Video specification. It is the figure which showed the structure of the PCI data of NV_PCK. It is the figure which showed the structure of PCI_GI data of NV_PCK. It is the figure which showed the structure of DSI data of NV_PCK. It is the figure which showed the structure of DSI_GI data of NV_PCK. It is the figure which showed the structure of SML_PBI data of NV_PCK. It is the figure which showed the structure of the SYNCI data of NV_PCK. It is the figure which showed the stream structure of the format of DVD-Video Recording specification. It is a flowchart of the conversion process of TS packet (RD_PCK). It is a flowchart of the conversion process of TS packet (V_PCK, A_PCK). It is a figure explaining a part of data structure of the pack header of the pack of MPEG2-PS. It is a structure figure of the system header of DVD format. (A) Packet header stored in RDI_PCK and (b) Structure of private header stored in RDI_PCK. It is a figure explaining a part of data structure of the packet header of the packet of MPEG2-PS. FIG. 3 is a structural diagram of a private header of the AC format standard in DVD format. It is the figure explaining conversion from Constrained SESF to MPEG-PS. (Video pack) It is the figure explaining conversion from Constrained SESF to MPEG-PS. (Audio pack). It is the figure which showed the response | compatibility with the bit rate of each audio | voice permitted by Constrained SESF, and the maximum payload length stored in one audio PES packet in the case of storing AC-3 and MPEG1-Audio. It is a flowchart of the whole TS2PS conversion process. It is a flowchart of the initialization process of TS2PS conversion process. It is a flowchart of the capsule unit process of TS2PS conversion process. It is a flowchart of a pack unit process. It is a flowchart of SCR calculation processing. It is a flowchart of a pack header process. It is a flowchart of a packet header process. It is a flowchart of a stream ID process. It is a flowchart of a video PES packet head process. It is a flowchart of a video PES packet non-head process. It is a flowchart of an audio PES packet head process. It is a flowchart of an audio PES packet non-head process. It is a flowchart of a payload process. It is a flowchart of a padding packet process. It is the figure which showed the stream format of Constrained SESF. It is a data structure figure of the PES packet by the MPEG standard. It is a figure explaining the production | generation method of NV_PCK data. It is the figure explaining the efficient multiplexing method using Multiplexing Unit with which the audio frame was aligned. It is the figure explaining the efficient multiplexing method using Multiplexing Unit with which the I picture was aligned to the head. (A) It is a figure for demonstrating the encoding conditions regarding the video display field order in Constrained SESF (when satisfy | filling DVD-Video specification), (b) In order to demonstrate the encoding conditions regarding the video display field order in Constrained SESF (When DVD-Video standard is not satisfied). It is a flowchart of the video recording process by Constrained SESF which provided the restrictions regarding a top field and a bottom field. It is a flowchart of a video recording end process.

Explanation of symbols

100 Optical disc (DVD-RAM)
212 System Controller 214 Encoder 218 Decoder 220 Track Buffer 221 Drive 230a Video Encoder 230b Audio Encoder 230c VBI Data Encoder 232 System Encoder

Claims (3)

An information recording medium in which video information and audio information are encoded into a video elementary stream and an audio elementary stream, respectively, and multiplexed and recorded in a system stream,
The system stream is allowed a first format (TS) and a second format (PS),
The first format (TS) has a packet structure in which data is divided and stored in first packets, and the second format (PS) has a pack structure in which data is divided and stored in packs. And the size of the pack is larger than the size of the first packet,
The first packet is divided and stored in a second packet storing video information and audio information, and the second packet stores at least one audio frame;
In the first format (TS), a restricted format for converting a system stream from the first format (TS) to the second format (PS) is allowed,
According to the restriction format,
A predetermined number of the first packets are grouped and managed as a multiplexing unit, and the total data area size of the packets managed as the multiplexing unit is smaller than the data area size stored in the pack,
The first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet;
Coding information indicating whether the first complete audio frame in the multiplexing unit is the first audio frame in the payload portion of the second packet is stored in the system stream. Information recording medium. An information recording apparatus for encoding video information and audio information into a system stream and recording the information on an information recording medium,
The system stream is allowed a first format (TS) and a second format (PS),
The information recording device includes:
First encoding means for performing predetermined encoding on video information and audio information based on the first format (TS) to generate a video elementary stream and an audio elementary stream;
Second encoding means for performing system encoding to multiplex the video elementary stream and the audio elementary stream to generate the system stream based on the first format (TS);
Control means for controlling the first and second encoding means,
In the first format (TS), a restricted format for converting a system stream from the first format (TS) to the second format (PS) is allowed,
The control means controls each of the first and second encoding means to encode in the restricted format,
The first format (TS) has a packet structure in which data is divided and stored in first packets, and the second format (PS) has a pack structure in which data is divided and stored in packs. And the size of the pack is larger than the size of the first packet,
The first packet stores a divided second packet storing video information and audio information, and the second packet stores at least one audio frame;
According to the restriction format,
A predetermined number of the first packets are grouped and managed as a multiplexing unit, and the total data area size of the packets managed as the multiplexing unit is smaller than the data area size stored in the pack,
The first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet;
Coding information indicating whether the first complete audio frame in the multiplexing unit is the first audio frame in the payload portion of the second packet is stored in the system stream. Information recording device. An information recording method in which video information and audio information are encoded into a system stream and recorded on an information recording medium,
The system stream is allowed a first format (TS) and a second format (PS),
In the first format (TS), a restricted format for converting a system stream from the first format (TS) to the second format (PS) is allowed,
The first format (TS) has a packet structure in which data is divided and stored in first packets, and the second format (PS) has a pack structure in which data is divided and stored in packs. And the size of the pack is larger than the size of the first packet,
The first packet stores a divided second packet storing video information and audio information, and the second packet stores at least one audio frame;
The information recording method includes:
Based on the restriction format (TS), video information and audio information are subjected to predetermined encoding, and a video elementary stream and an audio elementary stream are generated,
Based on the restriction format (TS), the video elementary stream and the audio elementary stream are multiplexed, and system encoding for generating the system stream is performed.
A predetermined number of the first packets are grouped and managed as a multiplexing unit;
The total size of the data area of the packet managed as the multiplexing unit is smaller than the size of the data area stored in the pack,
The first complete audio frame in the multiplexing unit becomes the first audio frame in the payload portion of the second packet;
Coding information indicating whether the first complete audio frame in the multiplexing unit is the first audio frame in the payload portion of the second packet is stored in the system stream. Information recording method.

Images