TWI242197B - Information storage medium with data structure for multi-angle and apparatus therefor - Google Patents

Abstract

Provided are an information storage medium with a data structure for multi-angle, and recording and reproducing apparatuses therefore. In the information storage medium, video object data for a multi-angle is recorded in units of clips. At least one clip for a certain angle is divided into predetermined units and recorded in contiguous areas of the information storage medium. Therefore, it is easy to adjust the layout of a record space in which video object data for a multi-angle is recorded and perform random access therein, thereby effectively reading the video object data.

Description

1242197 V. Description of the Invention (1) The present invention declares the priority of South Korean Patent Application No. 2002-62882 and the US Provisional Application No. 60/452, 551, and the application dates of these two cases are 2000 AD On October 15 and March 7, 2003, the contents of the two cases are hereby incorporated by reference. TECHNICAL FIELD The present invention relates to an information storage medium having a multi-view data structure and a recording and reproducing device thereof. Prior art

The DVD 'digital versatile disc' is a representative traditional information storage medium for recording multi-view data. The inter-leave method is used to record multi-view data on a DVD, and the interleave method divides the data into predetermined units and records the units alternately. Below, the image data structure of the conventional information storage medium (DVI) will be described with reference to the drawings. Figure 1 shows the data structure of an information storage medium (2DVI). Refer to Figure 1, DVD is divided into video manager (VMG)

Area ^ plural video title set (VTS) area. The menu information of the video movie and video subtitles is stored in the VMG area, and the video subtitle data is stored in the VTS areas. Generally, the VMG area includes two or three files, and each VTS area includes 3 to 12 files. Figure 2 shows the data structure of the VMG area. Referring to Figure 2, the VMG area includes: image management unit information (vide〇manager infommatiQn VMGO area 'includes additional information of the VMG area; the video object group (vide〇, object set, V0BS) area, including information about the subtitle menu Image object

1242197 V. Description of the invention (2) Information; and a VGMI spare area. The VMGI area, the v〇BS area, and the VM (spare area exist in the form of a broadcast. However, the VMG area may optionally include the v0bs area. In some cases, the VMG area may not include the v〇BS Each VTS area contains the word | information for the reproduction unit | Information and image object information VOBS. The digital screen can be recorded in a VTS area. Figure 3 shows the data structure of the VTS area. Refer to Figure 3 for image block information ( VTSI (Video title set information), the VOBS of the menu screen, the v0BS of the video subtitle group, and the VTSI spare area are recorded in the VTS area. For the playback of the menu screen, you can optionally record ㈣ ". Each V0BS segmentation A plurality of video objects and a grid (cel 1) as a recording unit. V0B includes a plurality of grids. The most basic recording unit in the present invention is a grid. In a DVD, a reproduction unit is recorded in a layered structure. Subtitles are formed there The top layer of the layered structure. Generally speaking, subtitles are linked to at least one program chain (PGC). The first PGC that is reproduced among a plurality of PGCs is called the entry PGC. Figure 4 shows Link to a PGC (i.e. (Subject to PGC). Figure 5 shows a subtitle linked to a plurality of PGCs. As shown in Figure 5, after a PGC is reproduced, a certain PGC is selected from those PGCs and reproduced, and the PGC is determined to be selected and reproduced. The instructions must be stored in the DVD. The navigation sequence is controlled by the navigator. The instructions that determine the navigator are included in the program chain information (PGCI). Figure 6 shows the data structure of the PGC. Figure 6. The PGC is stored in the PGCI which is an information structure. The PGCI includes: a face with a pilot command 12388pif.ptd Page 10 1242197 5. Description of the invention (3) Pre-command, after Command (p〇st_c〇mmand) 'and plural program information. The pre-command is executed before regeneration, and the post-command is executed after regeneration. Each program includes plural lattice information. The lattice system link included in a program Each grid in y OB which is a recorded unit of s. Each grid, that is, a regeneration unit, has a grid instruction provided after regeneration. The PGCI is a layered structure of the PGC (that is, a regeneration unit). And has a grid (that is, The basic reproduction unit) is linked to an information structure of one of the most basic recording unit grids. In particular, the PGC is a link of a plurality of grids of reproduction units. The 'these grids form a perspective block. Figure 7 shows a The structure of the perspective block. Referring to FIG. 7, the block structure is such that the cells are arranged in parallel to reproduce only a single cell. The cells forming the perspective block have the same regeneration time. Each box has a specific perspective. If a view block is formed for the grid of the reproduction unit, the data of a specific perspective is divided into predetermined interleaved bits using the interleaving method (1111 ^ 1'bu 3 ^^ (1111111 :, 11 ^ 1〇 and recorded in 7 (^ ( It is recorded. Mouth /, and grid (for recording unit). ° ,,, early position) Figure 8 shows the knot of v0B and grid when multi-view is not supported. Figure 8, V0B is sequentially stored and recorded In the continuous side of the information storage medium, the continuous block is a continuous recording space. However, as shown in Figure 9, when multi-view is supported, the V0B of each view and its grid use the interleaving method = ILVU recorded in the interleaving block. Therefore, 3 items of 1 for a specific perspective are recorded in the continuous recording area. That is, the perspective data is recorded using the interlace method = 栌 圯 staggered. / Another sequence and 12388pif.ptd page 11 1242197

Figure 9 shows two pieces of angle data recorded sequentially and staggered using the interlace method. Referring to Fig. 9, the ILVU has the same reproduction time. The amount of data to be recorded will vary depending on the type of compression method used. If the data is wrong, it is necessary to jump to the required ILVU in order to reproduce a view data or a changed view data. For example, in order to reproduce the data of the first perspective, the data of the first perspective in the ILVU must be detected. To this end, the image object bitstream contains the data NXT_ILVU_SA and NXT_ILVU_SZ shown in Figure 11, which indicate the position and size of the ILVU data below the bitstream. After regenerating the ILVU data, use the data NXT_ILVU_SA and NXT_ILVU_SZ to jump to the next ILVU data. In order to change the viewing angle during data reproduction, it is necessary to jump to the position of the data in the changed viewing angle. The degree of jump jump depends on the ILVU. Figure 10 shows the situation of jumping to the selected perspective when considering the grid. Referring to FIG. 10, even if the user issues an instruction to change the viewing angle at a certain time during the reproduction of the LVU data, in order to achieve an uninterrupted change, subsequent image data should be reproduced without pause. This can be done by first completing the regeneration of I data, and then jumping to the LVU data of the changed perspective to follow a link: and to reproduce the ILVU data of the changed perspective. The location information of the ILVU data is various and included in the bit stream of the image object data recorded by the interleaving method. Figure 12 shows the structure of the information contained in the image object bit stream specifying the positions and sizes of the iILVU data at nine perspectives: SML — AGL — Cn — DSTA (n is a natural number between 1 and 9). The maximum viewing angle supported by DVD is 9. SML jGL —Cn ~ DSTA data is provided through links in current ILVU data

1242197

: 角 # 叮? Information related to LVU data. After regenerating the current 1LVU data, you can change the current perspective to the desired perspective SML_AGL —Cn-DSTA to regenerate the required perspective data. In the process of verifying the DVD with Ϊ ^ f viewing angle data, the photos taken at different viewing angles are compressed to form several data bit works with the same reproduction length, the interlaced method is used to form the bit stream, and the data can be reproduced. Information that is referenced from other perspectives is inserted into each metastream. Therefore, recording video object data on a DVD allows the viewing angle to be changed during the data reproduction period. However, if the multi-view data is divided into predetermined units by the interleaving method and stored in the DVD, the multi-view data is not continuously recorded in the continuous area of the DVD. Therefore, in order to continuously reproduce the data of a certain view, a reproduction device is necessary Move the reading position more than $ to read the data. In particular, if the reproduction device reproduces data from an optical disc or a hard disk, it takes considerable time for the device to change its reading position. When the device changes its reading position, there will also be a bit rate upper limit for the compressed 7C stream to compensate for the time delay caused by the invention. SUMMARY OF THE INVENTION The present invention provides an information storage medium with a data structure and its device. Why multi-view data can be accessed randomly. According to an aspect of the present invention, there is provided an information storage medium for recording image object data with multi-view data, the medium including at least one segment as a recording unit when the image object data for each view is recorded, in which a certain view At least one segment is recorded in a continuous area of the information storage medium

1242197

5. Description of invention (6). The image objects of various angles of view from various perspectives. 4. Point, eclipse, ^ ^ head & — data points • plural jump points, which are access points, so that image objects of different perspectives q take external information, Include track jump point information files, and then repeat them; and the amount is better, the image object ancestor 4. The additional information of the fragment information m, and: the second package J has information about the fragment. And the piece of negative information includes that the jump point asset is preferably 'the track point information contains the jump point information, and it is better to save it in the segment' The segment information includes and the jump point information is added to This entry can be used as a jumping point. Cover a table with information from a starting point to the segment. Random access point information, point > message and specify whether each point

The position of the jump point recorded in the perspective is preferably 'the track point information is common and segments of additional image object data, and the segment information is sequentially included in the common track point information. Fortunately, the distance between the position of the track jump point and the adjacent jump point is determined so that when a segment is reproduced in a current perspective, when the reproduction position is changed at a track transition point for the perspective change, the The segment is continuously reproduced without interruption.

Preferably, is the information about the Play Item and PiayList recorded as information about the reproduction unit, and the plural about forming a perspective block? The information of 13 乂 116 !! 1 is recorded as information about 1 > 1 ”^ 6111 about plural perspectives, the Play Item has about the segment, and each piayLi st has a complex number P 1 ay 11em 〇

Page 14 1242197 V. Explanation of the invention (7) Right off = strict: off, ^ and the information is recorded as negative information about the regeneration of the early position, and PlayUst is recorded to be relevant? 13 ya 1 to 111 are related to the fragment, each 1) 1 inch 1 ^ 3 seven, ~ P1 ay 11em 〇 Preferably, additional information about a perspective is added to =, the PlayList is a different perspective The information is recorded as being related to the better. The fragment information includes random information, and the jump point information is the entry point information: = = The entry points are all track jump points. u is better for all entries. 'Determine whether to regenerate one segment of the segment that passes through the entry point or jumps to an entry point. The length of the :: m :::: region is determined not to cause -Buffer record; better 疋 ° 海 片 # and the information includes information about the area where the data A is not allowed to spit immediately. Brothers regenerate or skip the data reproduction device on the information storage medium according to another persuasion of the present invention. Records are recorded in segments. ♦ Multiple image object data records. Reproducing multi-view image object data = :: "This segment 'is better, the" ί should take and reproduce the detected segment. ~ Object data with multiple jump points

1242197 V. Description of the invention (8) The image object data of different perspectives are intermittently reproduced. The track point information is recorded on the information storage medium with additional information. The two track points represent the position of the fragment in the same reproduction time zone. The device detects, reads, and regenerates a fragment of a view in a continuous area of the information storage medium. During the reproduction of the fragment, when the perspective needs to be changed, the device reproduces the fragment to a specific track jumping point and One of the specific jumping points reproduces a segment of a changed perspective to reproduce multi-view image object data. Preferably, the image object data further includes segment information, which provides additional information about the segment as a recording unit, and the segment information point information 'the device measures the jump from the segment information of the relevant segment. Better, The jump point information covers from a starting point to each jump point, and the information is stored in the fragment information in a table form. The farming appraisal multi-view ΐίίίίί: track = connected to each other, the jump point information records the jump track Πίΐΐί: A point-of-change-connected track-jump point of a change of perspective, and the clips are reproduced at the detected jump points; preferably, the clip information includes a random ^ message: and the track-jump point Information is added to the entry: Whether the entry point is regarded as a track-jump point, the device evaluates the relevant entry of this link, and the information of the track-jump point is recorded in the information of the track-jump point and other points to detect the connected points. The track-jump point, and the segment to be reproduced with the entry as the jump point detected. When supporting the present angle, it is better that the jump point information is based on the building blocks of the perspective. The total is 1242197.

Also included in the image object data, ^ u and the jump point location information of each segment are sequentially included in the common jump point owner from one of the tables * * Female Shao Xi Xi Xi a a mouth hungry σκ The device reads the common under-track points for clips with multiple perspectives, and regenerates the clips at the track-jump points of the two detected connected jumps a ^ ^ when the viewing angle is changed. Fortunately, the distance between this position of the μ jump point and the adjacent jump point is determined so that during the reproduction of one segment of a view point, when the view point is changed, the second step can be continuously reproduced. When a user enters a change of perspective number, the device regenerates the changed perspective by completing the regeneration of the segment to the track jump point closest to the playback position and starting from a jump point related to the previous jump point. One clip is reproduced continuously. Preferably, is the information about Playltem and PiayList recorded as information about the reproduction unit, and the plural about forming a perspective box? The information of 1371-7111 is recorded as information about 1) 1 & 711 ^ 111 about plural perspectives, and each Play Item specifies the fragment or a part of the fragment, and the Play Items have the fragment and each piay List With a plurality of Playltems, the device reproduces one of the piayitems forming the perspective block to regenerate the P 1 ay 11 em of the perspective block, and regenerates another PI ay Item from the perspective block when the perspective needs to be changed. Preferably, the information about PI ay Item and PI ayLi st is recorded as information about the reproduction unit, each P1 ay 11 em designates the segment or a part of the segment, and records the P1 ay L ist to have Regarding the perspectives, the 4b-13a 116111 are related to the fragments, and? 13 ^ 1 ^ 31: With a plurality of Playltems, the device reproduces one PlayList about a desired perspective. Preferably, each P1 ayL i s t includes information about a related perspective.

12388pif.ptd Page 17 1242197 V. Description of the invention (10) The device regenerates PIayUst, which is another brother TV according to the present invention. The multi-view negative image object data can be set in two rows of 3 and 5 records. On the record body, the device records one piece of information accessed by the information storage medium. Segment, and the segment is not recorded using interleaving. It is better to divide Beco into pieces, except for the perspective of the image, the plural number of jumping points and the number of these jumping points on the device body. 'The jumping points make the video pieces of different perspectives Inventory matchmaking. Ding Bei needle month b is continuously better again, the information of the fragment information. It is better that in addition to the image object data, the clip is a recording unit and the clip is a clip of the clip * contains the jump point and the track point is negative § fL covers the period from the start of the stone to the month The information included in the form is included in the clip's pure jump ring, and the information of the track points is recorded on the information storage medium

Preferably, the device records fragment information to include the ancient W G3's entry point information about the random access point and add the track jump point information to S ^ ^ Wang Lu Entry Point Master to specify whether the entry point can be used as a jump Hold the point. "Stomach Λ

Preferably, the device collectively records a multi-view segment w 4 A ~ and it also contains information of the Xile point, the common track point information is in the form of a tabular ★ 4 ^ 'sequence of the clips Click that location. Preferably, the device determines the distance between the track jump point and the position of the track jump point in § 录, so that the track jump point is regenerated in a section from one perspective.

12388pif.ptd 1242197 V. Description of the invention (11) " One of the corner changes can continuously reproduce the segment when the track jump point changes the reproduction position. > It is better that 'the information recorded by the earthquake is related to the reproduction unit, and the related information of the plural Play Items that form a perspective box is information about the plural perspective, and the PUyItem is related to the segment And each PlayList has a plurality of P1 ay 11em 〇 > Better: 'This setting records information about pi ay 丨 tem, ^ has information about the reproduction unit, and records piayI tem to have a section, the Play Item has Regarding this fragment, each PlayU st has a complex number ❶

Playltem. Preferably, the device adds additional information about a certain perspective to the PlayList recorded as the perspective. In order to make the above and other objects, features, and advantages of the present invention clearer ... Beijing It, the following exemplifies the preferred embodiments and the accompanying drawings for detailed description as follows: Embodiment: According to the present invention, & Supporting multiple perspectives allows the perspective data to be recorded in the information store using a separate recording method rather than an interlaced method. The bits of the data of each perspective are streamed in the continuous recording area of the information storage medium to complete the multi-view support. During data reproduction, the perspective change can divide each perspective data into jumping units (specify this: PU-the starting address is the jump point, and recording the relevant information of the jump point of each visual material is additional Information. If the entry point is a track jump

12388pif.ptd Page 19 1242197 V. Description of the invention (12) The point can be used to detect the jumping point based on the entry point information. In order to better understand the present invention, the main elements of the present invention are listed as follows: (a) Compressing and encoding video and audio (A / V) streams from various perspectives | (b) The clip (cl ip) information file includes the encoded video and audio (A / Information (such as attribute information); (c) PlayItem specifies the playback time of the playback area between the part of the component (a) and (b) and OUT-time; ~ (d) PlayList includes at least one PlayItem; (e ) The position of the jump point is recorded in the form of the jump point map in the form of a table. In the present invention, the multi-view data is regarded as a plurality of reproduction units of an image object with respect to a certain-reproduction time. That is, multi-view = eye shadow camera Data captured at different perspectives.-Generally speaking, ί is generated differently. In summary, regenerating in the same time zone = = angle data 'and regenerating in the same-time zone ... In general, image objects The data can be stored or transmitted in 4 bit, 1 stream mode. The present invention: using a chip to compress the bit). The clip is about a grid (DVD 内 呓 # i > · ,,, no later

PlayLlst with? 1 "11: 6111 is about Crazy Eight Box (reproduction list in DVD, that is, according to the present invention, the AV stream is stored in the storage medium with η. Generally speaking, the fragment $ = is The unit is recorded in the asset. It has been recorded in the information storage media. 12388pif.ptd Page 20 1242197 V. Description of the invention (13) Continuation area. The AV stream is also compressed and recorded to reduce the size of the a V stream. When When regenerating recorded clips, the characteristics of the clip information recorded in each clip are needed to interpret the compressed image object data. The clip information includes the sound and image attributes of each clip 'and random access points The point map of the location information. In the dynamic pattern expert group (m〇ti 〇n

In the case of Picture Expert Group (MPEG) image compression technology, the entry point is located in the internal coding pattern. The entry point mapping map is mainly used for the time search of the detected data position after a predetermined time of data reproduction. The 13th picture is not in the relationship between piayList, piay Item, segment information and segment reading p. Referring to Figure 13, PlayList is the basic unit of reproduction. In the information storage medium according to the present invention, a plurality of playUsts are stored. / ^, 131; link to the plural 1 ^ ac 14111. 1) 1 "1 ^ 111 is a part of the fragment ^ = and in particular, Play Item indicates the beginning and end of the reproduced fragment. This can be easily done using fragment information Detect the required part of the clip. In the following, the data structure and the track points of the multi-view data will be explained with reference to the figures. == The track jump unit and jump between the audio and video (A / V) stream clips. Video object strain: Referring to Figure 14, if the fragment represents the multi-view data of the two-track single #shell material and part of a specific perspective, the fragment is divided into a certain number & The starting point is called the jumping point. The jumping point instead jumps into or jumps to a point in the t-segment, which may be the starting or destination point of a clip with a different perspective during the regeneration of the segment. ^ However 'for recurring reproduction of data, all access

1242197 V. Description of the invention (14) The point may not always be set as an entry point. Figure 15 shows the same track jumping point in the area and after the regeneration point is detected during the phase regeneration period, the bit is detected from the relevant segment. In FIG. 15, the fragment view of the third fragment and a command, and further instructions to change the discontinuous position of the media according to the distribution, it is still possible, the location change information storage media is the material of the optical disc, the track jump needs Speed of object data Even if the information storage medium is read and clear, the image object is set as the jump point, because it will only form multiple fragments of multi-view data at an interval of about 0.5 seconds. As shown in FIG. 15, it is assumed that a plurality of pieces are linked to each other, and the pieces are recorded at jump points at different reproduction times and linked to each other. In order to regenerate different segments in the segment, the segment is completed to a predetermined one. The fixed jump has a single-track-track unit for the different segments of the predetermined jump point, so it can be reproduced continuously without interruption. Partially regenerate the third perspective segment, select the first perspective during the segment regeneration, and regenerate the process of selecting the mth and mth perspective segments during the segment regeneration of the first segment. When using the input corner ', the change is made in units of track jumps. [Explanation]: Make the data recorded in the information storage area that can be accessed at random 'to change the reproduction device 1 within a predetermined time > the storage medium continuously reproduces the data. In the present invention it is called jump jumping. Generally, no extra time is required for the jump of the electrical property of the memory, for example. However, in the storage media of Erxun, the reading data from the mobile optical reading :: time. In addition, when the image f is read from the information storage medium at a speed different from the speed at which the image object data is reproduced, the body needs to be able to compensate for the difference between the reading and reproduction speed, which is already the data in the continuous area. According to the present invention, the buffer memory is regarded as the device providing the speed difference. From f

1242197

V. Description of the invention (15) The data read from the information storage medium at a predetermined speed is stored in the image object buffer memory, and then the data is reproduced from the buffer memory. During the data reading process, it is very important to control the data reading speed to avoid the buffering of video objects. Lu Jiyi ’s overflow or underflow. The use of scene buffer memory can cause the data to be reproduced without interruption, even if the image% is not the data. The data is recorded at a variable bit rate (VBR, variable bit rate). As shown in Figure 16, the size of each jump unit is determined by the image object data stored in the image object buffer when the image object data segments of different perspectives are jumped to and can be reproduced without interruption and in the event of occurrence. The memory ^ ^ can be reproduced within the range of a track jumping unit under different perspectives before starting. In the case where the reproduction device requires extra time to jump to jump points of different perspectives, the size of the jump unit is determined by the underlying conditions. Assuming the longest jump time is T-JUMP, the data reading speed is v — R, image Object data reproduction 3 is V-0: ^ Track skip unit size> V_R * V_R * T —JUMP / (V_R_V_〇) d) In addition, the size of the image object buffer memory must conform to the buffer Memory size (B) > V —〇 * T—JUMP (2)

FIG. 17 shows a multi-view structure ^ PlayList according to the first embodiment of the present invention. The PiayList of Fig. 17 includes a plural Playltem with a sequential structure and a view block piayIte [n with a multi-view structure. In this perspective, the block Playltem is composed of a plurality of perspective blocks ^ ”^ ㈣. In the perspective block Playltem, when PlayUst is reproduced, only one pUyitem is reproduced. In addition, during the PlayIteffl regeneration process, the Play can be changed from the perspective block piayitem phase selection perspective Play Item and regenerate the selected piayItem to achieve perspective penetration

1242197 V. Description of Invention (16). In general, the squares “构成” and “㈣” constituting the viewing angle have the same reproduction time length. According to the present invention, the clips 2 to 4 designated by the perspective block 卩 丨 "^ ㈣ are not interleaved but recorded in the continuous area. That is, the clips 2 to 4 are recorded in the same manner as the clips designated by the Play Item. It belongs to the area of the perspective block. However, the segments 2 to 4 can be characterized by the track jump point information. Below, the three preferred types of track track point data structure will be described with reference to the drawings. The data structure of the track-jump point of the perspective segment of an embodiment. Referring to FIG. 18, in addition to the general information of the conventional technology, the point-to-point map is included, and the segment information includes the track-to-point map. The jump point information in the point map is highly related to the image object data. Therefore, the jump point information is included in the clip information data and provides additional information about the clip. ^ / General information includes the following information:-¥ 6factory 31〇11—111111 ^ 61 ': Version of fragment information file-EPMap_start —address ·· The starting address of the point map pair map, represented by the number of bytes in the beginning byte of the fragment information slot

-JPMap_start—address ·· The starting address of the jump point map map is represented by the number of bytes in the first byte of the fragment information audit. If the value of JPMap_start_address is 0, it means that the relevant segment of the segment information file is not a perspective segment and the segment does not contain packet map information. -Cl ip Inf 〇: The attribute of the AV stream slot related to the clip information file. Entry point maps contain times for random access points

1242197 V. Description of the invention (17) ----- and location information. The jump point map map contains jump point information for clips that can be virtually connected to clips from different perspectives. According to the embodiment of the present invention, the number of track jump points indicated by the jump track management unit information in the jump point map and the number of jump point information behind the jump track management unit information are included. The 1-jump information is used to detect the position of the track-jump point and the start position of the relevant clip. The anchor information is better expressed as bytes or sectors. In addition, if the video object > is encoded as a MPEE transmission stream, the jump point information is better represented as the number of MPEG-TS packets. Figure 19 shows the data structure of the track jump point according to the second embodiment of the present invention. Figure 19 shows the data structure of the jump point. The advantage of the data structure of Figure 9 is that no extra space is needed to store track jumping point information. As mentioned above, when the shadow ^ object data is encoded using a time-space compression method such as MpEG, the jumper needs to be set to random Access one of the entry points. The information of whether the entry point is the jump point is incorporated into the entry point map, and the jump can be easily recorded. Figure 20 shows the data of the jump point according to the third embodiment of the present invention. The result is the structure information of the jump point map, # includes the jump point information forming the angle Θ times π a. The map point structure of the jump point map is collected separately from the film. The jump point map The map information includes: jump management management = ^ ΐ · 'refers to the number of segments that do not form the perspective block and the jump point 1-in the segment, and the total jump execution of the clips behind the 泫 track management unit information ^, The structure of the map information of the L-click point map makes the required perspective Light can be set

1242197 Description of the invention (18) Figure 21 shows a piayItem

PlayList. Referring to Figure 21, each piayitem information includes general

Play Item information and perspective box information. The perspective block information basically specifies whether the related Play Item forms a perspective block. To form the perspective box, 1371-7111 must be recorded sequentially. During the 1) 1 "1 ^ regeneration period, at least one selected square of a viewing angle is reproduced ^" ^ ㈣. During the playback of the Play Item that forms the perspective block, another P1 ay 11em that can form the perspective block can be reproduced. Figure 22 shows the figure 22, and the PlayLi Playltem means that each PlayList package user chooses a perspective or According to the present invention, the continuous interface of the information storage medium is determined to be track jump information. Its connection, related corner information. Playlists with the same perspective include those not used to shape each PlayList, including about a perspective. Changing the perspective will form a multi-view data area. It doesn't matter the representative 'and the jump is on the record unit (reproduction unit). References are single-in-one-view-angle. View angle information as shown in Figure 23. When playing a related PlayList. Recording units are recorded between the recording units of the same perspective. Related information is stored as additional information. Unit information is stored as multiple views.

The reproduction device according to the present invention reproduces multi-view data and has the following advantages

First of all, if the perspective is changed, the continuous area is read out, and the read and non-multi-perspective data encoders are reproduced ^ No additional data and encoding operations are required. Multi-perspective data can be derived from information storage media. That is, the multi-view data is the same. Therefore, compared with the interlace method, the viewing angle data can be continuously reproduced.

1242197 V. Description of the invention (19) Secondly, the segment of “recording unit” contains the track point information of the image object data that can be connected to the perspective box. In order to change the angle of view when regenerating the image object data of the current perspective, the reproduction device reproduces the image object data of the current angle of view to the next jump point and then reproduces the changed angle of view from one jump point related to the next jump point. Image object data. Third, when the multi-view information is recorded in the plural 1 ^ inch 11 ^ 111 (that is, the reproduction unit) which forms a perspective block and belongs to? 1371 ^ 31; (refer to FIG. 21), it is one of the blocks in the perspective. The perspective is changed during the playback of the PlayItem, and the playback device reproduces the Play Item to the track jump point closest to the current playback position of the clip, and then plays back the clip with the changed perspective from the track jump point. As shown in Figure 22, if a single piayUst of each perspective is recorded, when the user wants to

When changing the viewing angle during PlayList playback, detect and playback the changing PlayList. Recording with reproduction i: r ί ”For example, to reproduce the early bits of the information spot for the clip and the track jumping point on an information storage medium. = The recording device of the preferred embodiment of the present invention skips the track according to the reproduction speed V_R The time T_JUMp, and the item of the video object data = rate V_0 \ determines the size of the track jumping unit converted to the reproduction time by referring to the equations ⑴ and ⑺ the best "the person" to the reproduction time, The data encoding enables the random access point to set the reproduction time. Here, the interface of the image object data is skipped; the second is to say that the random access point is like a group ⑽ °, p, gr0UP like MPEG 〇f Picture) starting from V;; I, the shadow cylinder ⑽, ~? Starting point. Therefore, 々. The early bits include plural GOPs. In addition, the jump point must be jumped by each dagger * formed on each video object

1242197 V. Description of the invention (20) The same reproduction time zone of the data For the viewing angle, the encoded video object is a continuous zone of the media. The track jump point position information is recorded in the information storage. In the preferred embodiment of the present invention, the jump ^ 1 of each segment is recorded as additional information. According to news. Track information can be recorded as clip data. Second, multi-view information is created and recorded. For example, related to the PlayIt ^ regeneration unit of the clip

PlayList links PiayItem to another perspective, and a single PlayList is about a single perspective. em. Save the media Γ. FIG. 4 to FIG. 26 show the data structure of the information storage according to another embodiment of the present invention and the information storage medium according to the embodiment of the present invention. The multi-view image object data is recorded in segments and formed in the unit. All entry points in a clip are jump points. The recording device according to the present invention records the image object data of multiple perspectives on the information storage medium in units of sections, so that all the entry points in the section are track jump points. During the segment reproduction of an angle of view, when the user wants to change the angle of view, the reproduction device according to the present invention reproduces the segment to an entry point of the segment closest to the current reproduction position, and jumps to the point of change of an angle of one segment. The entry point (which has the entry point with respect to the reproduced segment), and the segment with the perspective change after the entry point of the segment with the perspective change is reproduced. Here, all entry points for all perspectives must be formed in the same segment in the same time zone. That is, as shown in Fig. 24,

12388pi f.ptd Page 28 1242197

The data of the three metaphysical objects within the different points are logically connected through the entry point. -In general, as shown in Figure 25, the entry point is to record the green position, and the reproduction time between 5 seconds and 1 second is also formed at a randomly accessible position. When the image object data is compressed using MPEG, The video object is provided with 々 ° GOP. In the perspective change period Fb1, in order to regard the entry point of the video material including the plural Gop as the jump point, all the videos in the Gop must be formed with only the closed-down Gop of the video encoding in the related GOP. ,

In the data structure where all the entry points are jump points, there is no additional information about jump points. However, in this kind of data structure, when the synchronizing device jumps to an entry point to change the viewing angle, a deficit of the regeneration buffer memory ^ may occur. During or immediately after the jump, the playback device must be prevented from jumping to an entry point in an area of the information storage medium. These areas that are not allowed to jump are called non-jumping blocks (n0_jumping M0ck °, NBJ) 〇Refer to Figure 26, the buffer memory in the memory immediately after the data of a playback device is regenerated or jumped. When the amount of data is less than the amount of data B, it is not allowed to change the perspective. Here, the data amount B is the minimum data amount that allows the uninterrupted reproduction of the jUMp-T video. When the image is reproduced continuously and exceeds the length of Njb, the amount of data in the buffer memory is always greater than the amount of data B and all entry points are allowed to skip tracks. The NJB length can be calculated using the same method as the JPU length. In particular, suppose the longest track-jump time is T-JUMP, the data reading speed is V-R, and the reproduction speed of the video object data is V-0. The length of NJB can be calculated as

12388pif.ptd Page 29 1242197

V. Description of the invention (22): NJB length> V —R * V—〇 * T — JUMPAV — RV —〇) (3) In addition, the size of the buffer memory must meet: Buffer memory size (B) > V —0 * T —JUMP (4) As mentioned above, according to the present invention, the image object data of the multi-view data is divided into predetermined units and recorded in a continuous area of the information storage medium, without using the interleaving method. Therefore, the layout of the data area can be easily controlled and random access can be easily implemented, so multi-view data can be effectively read. Although the present invention has been disclosed as above with several preferred embodiments, it is not intended to limit the present invention. Anyone skilled in the art can make some modifications and decorations without departing from the spirit of the present invention. Therefore, the scope of protection of this issue shall be determined by the scope of the attached patent application.

1242197 Schematic description "-Schematic description of the first picture shows the data structure of the DVD; Figure 2 shows the data structure of the VMG area; Figure 3 shows the data structure of the VTS area; Figure 4 shows the link to a PGC (That is, enter PGC) Figure 5 shows an example of a subtitle that includes a plurality of linked PGCs; Figure 6 shows the data structure of PGC; Figure 7 shows the data structure of a perspective block; Figure 8 shows the application When viewing from multiple perspectives, the structure of the v0 grid; Feng β Jilu's early position 9 shows the interlaced recording using the interlace method. The second display shows that the grid τ is considered, and the track is jumped to the selected image. : The information structure in the & home object bitstream of the interleaved unit (ILvu) data with perspective # 1 is not included; Figure Γ; 2 shows the information contained in the bitstream of the image object in the multi-view Figure ^ shows PlayList, PlayItem, clip information and clips. Figure 14 shows the relationship between video and audio (A / V) 〇 point;; track jump unit and jump in Figure 15 shows multi-view data. Figures 1 to 6 of the plural show jumps and turns, ^ ~ like objects The 1242197 drawing of the material can be continuously regenerated. The diagram briefly explains the relationship between the slow and easy device. Figure 17 Figure 18 Figure 19 Figure 19) Figure 20 Figure 21 Figure 21-Example of the black member; Figure 22 Display picture 23 and picture 24 to the media. Schematic description of the PlayList of Figure 17 and Figure 18, and Figure 18-Xi of the perspective view structure; data of track jumping points according to the first embodiment of the present invention and data of track jumping points according to the second embodiment of the present invention The data of the track jumping point according to the third embodiment of the present invention is a PlayList VMG which forms a perspective block Playltem VMG: Video Management Unit VTS: Video Subtitle Group

VMGI VOBS VTSI Image Management Unit Information Image Object Group Video Subtitle Group Information PGC: Program Chain PGCI: Program Chain Information ILVU: Interleaved Unit

1242197 Schematic description of jpu: Jump unit €

I 1HII1 12388pif.ptd Page 33

Claims (1)

1242197 VI. Scope of patent application 1 · An information storage medium recording image object data of multiple perspectives' This medium includes at least one segment, which is used as a recording unit when recording image object data of each perspective. At least one segment is recorded in a continuous area of the information storage medium. 2. The information storage medium described in item 1 of the scope of patent application, in which the image object data of each perspective is included. The plural track jumping points are access points, so that the image object data of different perspectives can be reproduced without interruption. And "extra information, including jump point information. 3. The information storage medium as described in item 2 of the scope of the patent application, wherein the image object data includes clip information that is additional information about the clip 'and the clip information Include the jump point information. 4. The information storage medium as described in item 3 of the scope of patent application, wherein each track point information includes information about a jump point from a starting point to the segment, and in a table The form is stored in the segment information. 5 · The information storage medium as described in item 3 of the scope of the patent application, wherein the segment information includes information on the access point that can be accessed randomly, and the information on the jump point is added to the access point Information and specify whether each entry point can be regarded as a jump point. 6. The information storage medium as described in item 2 of the scope of patent application, where the jump point information is common and Recording the image on the material of the object owned fragment viewing angles, and the location-based track-jumping points of each of the plurality of sequence fragments contained in the common point of the track-jump information. 12388pif.ptd Page 34 1242197 6. Scope of patent application 7. The information storage medium described in item 2 of the scope of patent application 'where the distance between the position of the jump point and the adjacent track jump point is determined such that When a segment is reproduced in a viewing angle, the segment can be reproduced without interruption when the reproduction position is changed at a jump point at a viewing angle change. 8. The information storage medium described in item 1 of the scope of the patent application, wherein the information about Play Item and PlayList is recorded as information about the reproduction unit, and information about plural Play Items forming a perspective box It is recorded as information about a Play Item with plural perspectives, the Playltem has information about the segment, and each PlayList has a plural Play Item. 9. The information storage medium described in item 1 of the scope of the patent application, wherein the information about the Play Item and PlayList is recorded as the information about the reproduction unit, the P 1 ay Item is recorded to have the perspective, the P 1 ay Item is related to this segment, and each PlayList has a plural PI ay Item. 10. The information storage medium as described in item 9 of the scope of patent application, wherein additional information about a perspective is added to each PlayList, which is information of different perspectives and recorded to be related to the perspective. 11 · The information storage medium as described in item 5 of the scope of the patent application, wherein the fragment information includes information about access points that can be randomly accessed, and the jump point information is the access point information because all the access points All jumped to I point. 1 2. The information storage medium as described in item 11 of the scope of patent application, wherein it is decided that it is not allowed to jump to one of the sections of the entry point immediately after the reproduction or jumping of the section to an entry point, And the length of the zone where the jump is not allowed is determined by a range that does not cause a deficit in buffer memory 12388pif.ptd Page 35 1242197 6. Scope of Patent Application _ Within the scope. 1 3 · As mentioned in item No. 丨 2 of the patent scope of Shenyan: The reading information includes information about the area that is not allowed to be stored in the media. Immediately after the material is regenerated or skipped, the material is skipped and reborn again. The Λ device is recorded on the information storage media =! In multi-view angles, it means that when the record contains information about sight, the device ^ ί The fragment 'When regenerating multi-view image object data and related fragments in the continuous area of the 1 M * 5 U 1 Besson storage media, and reading and reproducing the detected fragments. I5. The reproduction device as described in item 14 of the scope of the patent application, in which the image object data of the perspective has a plurality of jump points to continuously reproduce the image object data of ^ Same as Ϊ, the track point information is additional The information is recorded on the Bexun storage medium. The two jump points represent the fragment position in the same reproduction time zone ^. During the reproduction of the fragment, when the viewing angle needs to be changed, the device detects 'read and reproduce the information storage medium' A fragment of a view in a continuous zone and a fragment of a changed view are reproduced from a track jumping point related to the specific jump point to reproduce multi-view image object data. 16. The reproduction device as described in item 5 of the scope of patent application, wherein the image object data further includes segment information, which provides additional information about the segment as a recording unit, and the segment information relates to the jump Point information, the device detects the jump point information from the clip information of the relevant clip. 12388pif.ptd Page 36 1242197 VI. Patent application scope 17. The regeneration device as described in item 6 of the patent application scope, wherein the track jumping point information includes the information from a starting point to each track jumping point and is stored in the fragment information in a table form. Here, the device evaluates that the track-jump points of the segment of the multi-view are connected to each other, the jump-point information is recorded at the same point in the table, and when the view angle is to be changed during a segment reproduction, the device detects a positive The jump points of a segment being reproduced and a segment with a changed perspective are reproduced and the segments are reproduced at the detected jump points. 18. The regeneration device as described in item 6 of the scope of the patent application, wherein the fragment information includes random access point information, and the jump point information is added to the entry point information to specify whether a relevant entry point is available As a jump point 'The device evaluates the jump points of the clip connected to each other, the jump point information is recorded at the same location as the entry point information, and when the perspective is to be changed Jump point and regenerate clips at detected track points. 19 · The reproduction device as described in item 15 of the scope of the patent application, wherein the jump point information is included in the image object data to be regarded as a plurality of segments of the perspective, and the position information of the jump points of each segment is sequentially included in In one of the tables of the common track jumping point information, the device reads the common track jumping point information of the pieces of multi-view data, detects the connected track jumping points, and detects the track jumping points when the angle of view is changed. Regenerate clips. 2 0. The reproduction device as described in item 15 of the scope of the patent application, wherein the segment information includes information about the access points that can be accessed randomly, and the track jumping point information is the entry point information, because all the entry points The points are jump points. When the angle of view is to be changed, the device detects the phase based on the information of the entry point. 12388pif.ptd Page 37 1242197 VI. Scope of Patent Application The connected points and the detected jump points will test the segment. 2 1 · The reproduction device as described in item 20 of the scope of patent application, which determines a section of the section that is not allowed to skip tracks immediately after the section is reproduced or jumped, and the length of the section is determined Within a range that does not cause a buffer memory underrun. 22. The reproduction device as described in item 21 of the scope of patent application, which detects from the segment information that the data is not allowed to be reproduced or that the area immediately jumps after the jump. 23. The reproduction device according to item 14 of the scope of the patent application, wherein the distance between the position of the track jump points and the adjacent jump point is determined such that, during the playback of a segment under one view point, when the view point changes When the user can input a viewing angle change signal, the device regenerates the clip to the jump point closest to the playback position, and reproduces a changed perspective from the jump point. One fragment for regeneration. 24. The reproduction device described in item 14 of the scope of the patent application, wherein the information about the Play Item and PlayList is recorded as the information about the reproduction unit 'and the information about the plural Play Items forming a perspective box is recorded There is information about p 1 ay Item of plural perspectives, and each Playltem specifies the fragment or part of the fragment, and the piayitem has about the fragments and each p 1 ay L ist has a complex number P1 ay 11 em, the The device regenerates the Playltems used to form the perspective block to regenerate the Playltems of the perspective block, and regenerates another Playltem from the perspective block when the perspective needs to be changed. 2 5 · As described in any one of the 14th to the 22nd patent application scope 12388pif.ptd Page 38 1242197 VI. Patent Application Range Reproduction Device 'Among them, information about the Play Item is recorded as information about the reproduction unit, and each P 1 ay Item specifies the segment or part of the segment, as well as these P1 ay L i S t is recorded with regard to these perspectives, which? 1 & 7 ^ 6111 about these fragments, and what? 1 &# 151: With plural Playltem ', the device reproduces one playList about a desired perspective. 26. The reproduction device described in item 25 of the scope of patent application, wherein each PlayList further includes information about a related perspective, and the device reproduces a PlayList about one related perspective. 27. — A recording device that records image data of multiple perspectives on an information storage medium that can be accessed randomly. The device records the image data of perspectives in segments on a continuous area of the information storage medium. Segment the image object data in segments, and record the segment in an information storage medium using unfavorable methods. 28. According to the recording device described in item 27 of the scope of patent application, in addition to the image object data of the perspective, it generates a plurality of track jumping points and f information of the track jumping points on the information storage medium. The track points enable continuous reproduction of the image object data from an intermediate perspective. 'It is in addition to the segment where it is) / 29 · In addition to the recording device, the movie and the object data described in item 27 of the scope of the patent application, the segment information of the segment is also established, the recording unit and the segment information includes the jumping point information . 30. The record set-up track point information described in item 29 of the scope of the patent application covers information from a starting point to the track point of each segment, and j a table format is included in the segment information, and Recorded on Indigenous Media. % A Alum Storage Page 39 1242197 VI. Patent Application Range 31 · The recording device as described in item 30 of the patent application range, which records segment information to include entry point information about randomly accessible points and the jump point. Information is added to the entry point information to specify whether the entry point can be used as a jump point. 3 2. The recording device as described in item 31 of the scope of patent application, which records the fragment information to include information about the access points that can be accessed randomly, but does not additionally record the information of the jump points because all the access points Both the jump point and the jump point information are the entry point information. 33. The recording device as described in item 32 of the scope of patent application, which decides an area of the segment that is not allowed to jump immediately after the segment is reproduced or skipped, and the length of the area is not Will cause a buffer memory to fall within one of the range. 34. The recording device described in item 32 of the scope of patent application, which records information about the area where data reproduction is not allowed or the track is immediately jumped after the jump. 35. The recording device described in item 28 of the scope of patent application, which collectively records a multi-view segment to include the track jumping point information, and the common track jumping point contains a sequence of each segment in a table form. Information about the location of the jump point. 36. The recording device as described in item 28 of the scope of the patent application, which determines and records the distance between the position of the jump point and an adjacent track jump point, so that during a segment reproduction, when When the track changes the reproduction position, the segment can be reproduced without interruption. 37. The recording device as described in item 28 of the scope of patent application, which records information about Play Item and PlayList as information on the reproduction unit. 1242197 VI. Scope of patent application information, and records related information of plural numbers P1 ay 11 em forming a viewing angle box are information about plural viewing angles, the Play Item is related to the segment, and each PlayList has plural Playltem. 38. The recording device as described in item 28 of the scope of the patent application, which records information about Playltem and PlayList as information about reproduction units, and records Playltem for related segments, and the Playltem is related to the segment, and each PlayList With plural PI ay Item. 3 9 · The recording device as described in item 38 of the scope of patent application, which adds additional information about a certain perspective to the PlayList recorded as the perspective. 12388pif.ptd Page 41