JP2005136762A - High definition video reproduction method and apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method to provide the HDTV video of video information whose recording capacity is large and a method with a problem on a copyright taken into consideration concerning a compressed moving image data decoding technology. <P>SOLUTION: An HDTV video is reproduced from the basic video data of an SDTV video stored in a medium and extended video data obtained from a network. Alternatively, the HDTV video is reproduced from the basic video data of the SDTV video received from broadcasting and the extended video data obtained from the network. Access to a data server in which the extended video data are stored is made possible by being supplied with link information recorded in the medium or product information included in the medium. Alternatively, the access is made possible by making a contract with a broadcasting agent or a communication carrier. Thus, it is possible to selectively provide an extended service only to a user having a legal right. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention belongs to a technique for decoding compressed moving image data.

  Standard (SD) TV video can be converted to high-definition (HD) TV video using scalable coding technology. The scalable coding technique is standardized by an international standard (for example, see Non-Patent Document 1). By using scalable coding, HDTV video (high-definition TV video) can be obtained by playing back a base layer bit stream (basic video data) that is a compressed SDTV video (standard TV video) and basic video data. SDTV video can be separated and compressed into an enhancement layer bitstream (extended video data) for expanding HDTV video.

  In addition, there is a technique for providing information for extending SDTV video to HDTV video via a network (see, for example, Patent Document 1). In this example, the video editing history is mutually notified between the video editing machines, so that the editing process can be easily handed over to the next video editing machine. When the editing process is taken over from the editing machine that edits the SDTV video (SD editing machine) to the editing machine that edits the HDTV video (SD editing machine), the SDTV video is acquired based on the editing history data. Edit the video after up-converting it to HDTV video.

ISO / IEC 13818-2: 1995, MPEG-2 Video

ISO / IEC 14496-2: 2001, MPEG-4 Visual ISO / IEC 14496-2: 2001 / Amd.2: 2002, MPEG-4 Visual Streaming Video Profile.

JP 2002-191011 A

  Large screen displays such as PDP have been introduced to the market, but the mainstream video content currently on the market, such as DVD video and standard TV broadcasts, is mainly SDTV video, and can display HDTV video in high definition. The advantages of the screen display are not utilized. Also, existing optical disks such as DVDs have a limited recording capacity. Therefore, even if the player is improved so that HDTV video can be reproduced, one HDTV movie cannot be stored. Furthermore, since HDTV video is more valuable than SDTV video, downloading compressed data of HDTV video from the Internet is seriously damaged when used secondarily and may not be preferable in terms of copyright.

  Further, in the method of providing editing history data over a network as in Patent Document 1, it is possible to indicate a procedure for converting SDTV video to HDTV video, but extended video data to be used for conversion. Is not provided. Therefore, when extended video data does not exist on the receiving side, conversion work cannot be performed even if data is received from the network.

  HDTV video is played back using the basic video data of SDTV video stored on the medium and the extended video data acquired from the network. Alternatively, the HDTV video is played back with the basic video data of the SDTV video received from the broadcast and the extended video data acquired from the network. Further, enlargement of the screen size and additional data are adopted as the extended video data.

  Access to the data server that stores the extended video data is made possible by providing link information recorded on the medium and product information included in the medium. Or it becomes possible by contract with a broadcaster or a communication carrier.

  According to the HDTV video playback system of the present invention, after identifying the user's possession of the basic video data and the expandability of the basic video data owned by the user (right to receive the extended video data), the extended video data is transmitted through the network. Therefore, the extended service can be selectively provided only to a user who has a legitimate right to receive the extended video data.

  A basic configuration of an HDTV video system according to the present invention will be described with reference to FIG. The basic system of the present invention includes an SD playback device (100-1) that handles basic video data, an HD playback device (110-1) that receives extended video data and plays back HD frames, and stores and distributes extended video data. And the content service server (200-1). The HD playback device is connected to the data server via the network (300). Further, the SD playback device is connected to the HD playback device, and provides an SD frame in which the basic video data is played back to the HD playback device in response to a request from the HD playback device. The HD playback device can access the data server via the network, and acquires the extended video data from the data server. Here, the basic video data is compressed data (base layer bit stream) obtained by encoding a plurality of SD frames constituting an SDTV video. The extended video data is compressed data (enhancement layer bit stream) obtained by encoding a difference frame between a plurality of reproduced SD frames and a plurality of HD frames constituting HDTV video. The HD playback device plays back an HD frame using the SD frame played back by the SD playback device and the extended video data acquired from the data server.

  According to this configuration, it is possible to realize a service of selectively providing extended video data to a user who has basic video data with a formal right. More specifically, the basic video data is provided with link information (such as a URL) to the extended data and product information for identifying the content of the basic video data at the same time as the basic video data, and the content service server provides these information to the extended video. By using key data for providing data, it is possible to limit the provision of extended video data only to users who have a legitimate right to provide an HDTV image service.

  In addition, since extended video data cannot be played back without basic video data, it is illegal for high-definition HDTV video by separating it from basic video data and managing only the extended video data on the content service server. Use protection is stronger. In this case, 1) Extended video data is not left in the device after HDTV video playback (streaming), 2) Access to the acquired extended video data is restricted (copy protection is applied to the hard disk after recording), etc. By taking measures for the HDTV device, it is possible to prevent the extension video data from being leaked. Furthermore, if measures such as interleaving or encrypting the extended video data are taken and a mechanism that prevents the extended video data from being reproduced without authentication of the content service server is provided, the basic video data can be illegally used. Even if the obtained extended video data is illegally extracted from the content server, the HDTV video cannot be reproduced.

  Specific examples of the SD playback device include an optical disc player (DVD player or CD player) that reads and plays data from an optical disc and a broadcast receiving device that receives broadcast data. Specific examples of the HD playback device include a dedicated playback device and a PC. Examples of the network include the Internet and a portable wireless network. Specific examples of the data server include a content media library and a service site. When the HD playback device has an SD playback function, there are configurations in which the system does not have an SD playback device as a separate device or a configuration in which the SD playback device has a function of providing basic video data before playback to the HD playback device. Conceivable.

  A first embodiment of the system disclosed in the present application will be described with reference to FIG. FIG. 1 shows only the minimum configuration necessary for the description. For example, the audio data playback function is not included in the drawing. The SD playback device 100-1 stores data storage 105 (for example, an optical disc, a buffer for temporarily recording received broadcast data, or received broadcast data) in which media data (mixed data of basic video data, audio, and text) is recorded. A hard disk for recording, etc.) and a separating unit 101-1 for separating media data into data, a link information decoder 103 for extracting link information from text data, and a base layer decoder 102 for reproducing basic video data into SD frames. Composed. The HD playback device 110-1 receives a request from the data transmission / reception unit 112-1 that acquires the extended video data, the enhancement layer decoder 111-1 that plays back the HD frame from the SD frame and the extended video data, and the SD playback device. The control unit 114-1 is configured to be controlled. The control unit 114-1 plays a role of requesting the SD playback device to play back and provide link information included in the text data of the media data and to play back the basic video data and the played back SD frame. Here, the link information is data indicating the location of the extended video data corresponding to the basic video data (for example, URL). When the link information is input from the SD playback device 100-1, the data transmitting / receiving unit connects to the link destination described in the link information (the data server 201-1 in the content service server 200-1) via the network 300. And plays a role of acquiring extended video data. In this way, the playback SD frame and the extended video data are provided to the enhancement layer decoder 111-1 by the control of the control unit 114-1, and the HD frame playback processing is realized. In this configuration, since the extended video data is streamed and distributed, it is temporarily stored in the buffer in the enhancement layer decoder for playback processing, but is overwritten with the next HD frame data after playback, It does not remain in the HD playback device.

  A second embodiment of the system disclosed in the present application will be described with reference to FIG. The difference between FIG. 1 and FIG. 2 is that the link information decoder in the SD playback device 100-2 is replaced with a product information decoder, and the data server 201-2 and media library 202-2 (in this specification, access The content service server 200-2 is configured by a content list displaying available content as a generic term called a media library. Therefore, the operation of the control unit 114-2 that handles product information is different from the control unit 114-1 of FIG. 1 that handles link information. In this embodiment, the media data does not include link information, and the content in the media library list selected by the user is selected. At this time, if the product information provided from the product information decoder in the SD playback device via the data transmission / reception unit 112-2 of the HD playback device 110-2 includes the selected content, the extension video data is obtained. Make it possible. Further, a system configuration having the functions of FIGS. 1 and 2 is also conceivable (second embodiment modification 1). In this case, the product information decoder 104 has a function of extracting link information and product information from the text data, and the data transmitting / receiving unit 112-2 identifies link information and product information, which will be described later, and the content server 200-2. It has a function to provide access information. Here, the product information means general information for identifying content. For example, product information embedded in an optical disc, title information, program information included in received broadcast data, and the like can be used as product information.

  A third embodiment of the system disclosed in the present application will be described with reference to FIG. The difference between FIG. 2 and FIG. 3 is that there is no product information decoder in the SD playback device 100-3. In this case, the extension video data is accessed under another contract. Further, in FIG. 3, the data transmission / reception unit 112 is not provided, but this is because it is assumed that the enhancement layer decoder 111-1 includes a reception function, and is included in the HD playback device 110-3. Cases are also conceivable.

In the embodiment shown in FIGS. 1 to 3, the “method of accessing the data server from the HD playback device” differs as follows.
A. Access according to the link information recorded on the recording medium or broadcast data (Figure 1),
B. Access after product information authentication process (Figure 2),
C. Access after personal authentication processing based on broadcast contract or carrier contract (Figure 3),
D. Access without information / authentication (Figure 3).
The effect of each embodiment will be described here. The “method of accessing by link information” can be considered as an optimal method for new products and services because it can provide access rights to specific users without making the existence of the data server public. Further, in this method, by preparing a plurality of link information, it is possible to randomly access the extended video data and browse the HDTV video from the middle of the scene. The “method of accessing after authentication processing using product information” is suitable for selecting content to be viewed from a list of content disclosed on the Internet. According to this method, it is possible to confirm that the selected content is owned when the basic video data is recorded on the medium. Therefore, it is possible to provide a service that provides extended video data only to a user who has purchased a product (for example, a DVD that has already been released) or a user who has received pay broadcast content. “A method of accessing after personal authentication processing based on a broadcast contract or a carrier contract” is also suitable for selecting content to be viewed from a content list (media library) disclosed on the Internet. With this method, it is possible to provide an additional service for viewing HDTV video to a user who has received basic video data by broadcasting or wireless communication. “Access without information / authentication” is a method that utilizes the fact that content cannot be played back only with extended video data. ) Is effective.

FIG. 5 shows a processing flow example 1 of the HDTV video reproduction method disclosed in the present application. This FIG. 5 is adapted to FIGS. 1 to 3 and the second embodiment variant 1. FIG. As indicated above, the difference between the three embodiments is the “method of accessing the data server from the HD playback device”. The processing flow is divided into authentication processing and reproduction processing.
First, as an example, an authentication process of a system having the functions of FIGS. 1 and 2 (the second embodiment modification 1) will be described. In this embodiment, adaptive processing can be performed according to access information (link information or product information) included in text data. First, when a playback instruction specifying a user's content is input, the control unit 114 checks whether there is media data or product information data associated with the basic video data of the content in the link information decoder or product information decoder. Request checking. In response to this request, the access information decoder (reproducing link information and product information) searches the media data. If it is determined that “link information is present” (701), the separation unit 101-1 of the SD playback device in FIG. 1 converts the media data (mixed data of video, audio, and text) into the scene specified by the user. Corresponding text data is separated, and link information is reproduced by the link information decoder 103. The data transmitting / receiving unit 112-1 of the HD playback device 110-1 that has acquired the link information (751) distributes the link information to the data server 201-1 via the network 300 (752). The data server that has received the link information determines its validity, and if there is no problem, notifies the user of the authentication information. After receiving the authentication information (702), the HD playback device 110 starts playback processing. When it is determined that “no link information” (701), as shown in FIG. 2, the separation unit 101-2 of the SD playback device 100-2 separates the text data of the media data, and the product information decoder 103 Reproduce product information at. The HD playback device 110-2 acquires the product information (761), and then connects to the media library 202 in accordance with a user instruction (762). After the user's content selection, the product information together with the selection information is distributed to the data server 201-2 via the data transmission / reception unit 112-2 (763). The data server that has received the product information confirms that the content selected by the user matches the product information, and if there is no problem, notifies the user of the authentication information. After receiving the authentication information (702), the HD playback device 110-2 starts playback processing. In the case of FIG. 1 and FIG. 2, access information to the server is requested from the HD playback device to the SD playback device in response to a processing start request (700) from the user, and authentication processing with the data server is performed. Specifically, the processing flow of only 751 to 752 (in the case of FIG. 1) or 761 to 763 (in the case of FIG. 2) is performed without performing the processing 701.

  In the case of FIG. 3, the user connects to the media library 202-3 in response to a processing start request (700). After the user selects the content, the selection information is distributed to the data server 201-3. When personal authentication processing based on a contract is required, authentication processing is performed when connecting to the media library or distributing content selection information. The authentication processing method is not limited in the present application. For example, a method in which encrypted access information is automatically sent to the data server and collated with personal information recorded in advance can be considered. Subsequent reproduction processing is basically the same as any modification. First, the control unit 114 of the HD playback device 110 requests the SD playback device 100 to start playback of basic video data. In response to this request, the base layer decoder 102 in the SD playback device 100 starts playback of basic video data and provision of SD frames to the HD playback device 110 (703). At the same time, the control unit 114 starts acquisition processing of extended video data from the data server (704). When the control unit 114 confirms the completion of reception of the next SD frame (705), the enhancement layer decoder 111 in the HD playback device 110 plays back the extended video data of the next frame (706) and synthesizes the HD frame (707). ). The HD playback device outputs the played back HD frame to an HD monitor. Thereafter, the enhancement layer decoder 111 repeats the processing 705 to processing 707 until the reproduction processing of the received extended video data ends (709) (708).

  Here, FIG. 7 is an example of an optical disc. Data 801 is a part of data recorded on the disk 800, data 810 and 820 indicate text data, and data 812 and 822 indicate video and audio combined data. Here, it is assumed that the data 812 and 822 are data units that can be randomly accessed from the display menu of the optical disc. At this time, data 811 is link information for accessing extended video data corresponding to (synchronized with) data 812, and data 821 is link information for accessing extended video data compatible with (synchronized with) data 822. Playback on the way becomes possible. For example, when the user selects to reproduce the data 812 from the reproduction menu of the optical disc, the data 811 is distributed as link information to the data server. FIG. 7B is an example of broadcast data. Since broadcast data can be played back during channel switching or the like, the random access unit is usually set finely. It is assumed that data 830 and 840 indicate text data, and data 832 and 842 indicate video and audio composite data. Here, it is assumed that data 832 and 842 are randomly accessible data units, data 830 is program information of data 832, and data 840 is program information of data 842. At this time, the data 831 is link information for accessing extended video data corresponding to (synchronized with) the data 832 and the data 841 is link information for accessing extended video data corresponding (synchronized) with the data 842. HDTV video can be played from. For example, when the user selects a program channel corresponding to the data 832, the data 831 is distributed to the data server as link information.

  A fourth embodiment of the system disclosed in the present application will be described with reference to FIG. The difference between FIG. 1 and FIG. 4 is that a hard disk 113 is provided between the data transmission / reception unit 112-1 and the enhancement layer decoder 111-1 of the HD playback device 110-4. In this embodiment, the extended video data acquired from the data server can be stored on the hard disk. Therefore, under the control of the control unit 114-4, after the extension video data is downloaded to the hard disk, the SD frame playback / provision request and HD frame playback processing can be performed. When product information is used instead of the link information in FIG. 4, the link information decoder 103 is replaced with the product information decoder 104, and the content service server 200-1 is replaced with the content service server 200-2 in FIG. Fourth embodiment modification 1). Furthermore, if a product information decoder 104 is provided in addition to the link information decoder 103, a system configuration that handles two types of access information can be realized (Modification 2 of the fourth embodiment). Further, as shown in FIG. 3, a system configuration in which neither a link information decoder nor a product information decoder is present, and a method for accessing extended video data under another contract is also conceivable (fourth embodiment modification 3). As described above, also in FIG. 4, a modification of the method for accessing the data server can be implemented as shown in FIGS.

1 and FIG. 4 are different from each other in “data reception / reproduction method of HD reproduction apparatus” as follows. A. Streaming playback while receiving data (Figure 1),
B. Download that performs playback after receiving data (Figure 4).
Since the received data is deleted after reproduction, the former is suitable when using a device that does not have a lot of memory or when it is desired to protect the copyright of the content by leaving no received data. The latter requires a memory for storing received data, but can avoid a data reception error and can provide a stable service. Regarding the danger of secondary use due to the extension video data remaining in the hard disk, the hard disk is restricted to access the extension video data, and a function for deleting the extension video data from the hard disk after viewing is provided. Therefore, it is desirable to prevent secondary use of extended video data.
FIG. 6 shows a processing flow example 3 of the HDTV video reproduction method disclosed in the present application. This FIG. 6 is applied to FIG. 4 and its modification (access method to the data server). As in FIG. 5, the processing flow is divided into an authentication process and a reproduction process. The authentication process is the same as that in FIG. Subsequent playback processing is basically the same for all four examples. First, the HD playback device 110-4 downloads the extended video data from the data server 201-1 to the hard disk 113 in accordance with an instruction from the control unit 114-4 (724). Next, the control unit 114-4 of the HD playback device 110-4 requests the SD playback device 100-4 to start playback of basic video data. In response to this request, the base layer decoder 102 in the SD playback device 100-4 starts playback of basic video data and provision of SD frames to the HD playback device 110-4 (703). When the control unit 114-4 confirms the completion of reception of the next SD frame (705), the enhancement layer decoder 111-1 in the HD playback device 110-4 plays back the extended video data of the next frame (706), and the HD The frame is synthesized (707). The HD playback device outputs the played back HD frame to an HD monitor. Thereafter, the enhancement layer decoder 111-1 repeats the processing 705 to the processing 707 until the playback processing of the downloaded extended video data is completed (709) (708). Note that by dividing and downloading the extended video data, it is possible to start the reproduction process without waiting for the download of all the extended video data. 1 to 4, the SD playback device and the HD playback device are separate devices. However, when the function of the SD playback device is included in the HD playback device, the HD video playback of the present application can be performed by one device. Processing can be performed. However, in this case, in the processing flow of FIGS. 5 and 6, it is not necessary to start providing the SD frame in the processing 703, and the SD frame reception confirmation in the processing 705 is the SD frame reproduction confirmation.

  8 and 9 show specific examples of the HDTV video playback apparatus of the present invention. FIG. 8A shows an optical disc player 902 (DVD player) that reads data on an optical disc 901 (DVD-ROM, DVD-R, Blu-ray Disc ROM, CD-ROM / CD-R, etc.) as the SD playback device. This is an example in the case of a PC 903 having an enhancement layer decoding function as the HD playback device. The player 902 reads basic video data recorded on the optical disc 901 and reproduces an SD frame. The PC 903 reproduces an HD frame using the extended video data and the SD frame acquired through the network 904, and displays the HD frame on the PDP display 905. Hereinafter, as an SD playback device, a TV receiver 912 (FIG. 8B) that plays back broadcast data (including basic video data) received by the antenna 911, and a set-top box that plays back CATV data received from the wired cable 921 922 (FIG. 8C) is an example of a combination of the portable terminal 931 and the player 932 (FIG. 8D). In the case of FIG. 8D, the player 932 reproduces the basic video data received by the portable terminal from the service site of the portable wireless network into an SD frame. When the mobile terminal has a base layer decoding function, the mobile terminal can be an SD playback device. 8A to 8D, the HD playback device is a PC, but a configuration in which this is replaced with a dedicated player having an enhancement layer decoder is also included in the present application. Further, FIGS. 8A to 8D are configurations for receiving extended video data from a wired network, but the HD playback device has a function of connecting to a portable wireless network (connection via a portable terminal is also possible). A configuration for receiving extended video data from a wireless mobile network is also included in the present application.

  FIGS. 9A to 9D are configuration examples in the case where the PC 903 serving as the HD playback device has both a base layer decoding function and an enhancement layer decoding function in FIG. Also in this case, the PC is replaced with a dedicated player including a base layer decoder and an enhancement layer decoder. Further, the present invention includes a configuration in which the HD playback device has a function of connecting to a portable wireless network (including connection via a portable terminal) and receives extended video data from the wireless portable network.

  In the present invention, the encoding / decoding method of the basic video data and the extended video data is not limited, but the internal configurations of the base layer decoder and the enhancement decoder are shown in FIGS. 10 and 11 by taking MPEG-4 Video Simple Scalable Profile as an example. Keep it. Although details of MPEG-4 decoding technology (Non-Patent Document 2) are omitted, each frame of a moving image is encoded in units of blocks. The encoded data is composed of motion information in which redundancy in the time direction is compressed and texture information in which redundancy in the spatial direction is compressed. The basic video data is separated into motion information and texture information by the separation unit 501 by the base layer decoder (FIG. 10). The motion information is decoded into a differential motion vector by the motion information decoding unit 521. The motion vector predictor 522 adds the difference motion vector to the motion vector predictor to restore the motion vector. The motion vector is input to the motion compensation unit 523. The motion compensation unit 523 extracts the block at the position indicated by the motion vector from the decoded SD frame stored in the frame memory 524 as a prediction block. The texture information is decoded into quantized DCT coefficients by the variable length decoding unit 511. The quantized DCT coefficient is inversely quantized by the inverse quantization unit 512 and then reproduced into an error block by the inverse DCT unit 513. The error block and the prediction block are added for each pixel by the adding unit 502, and restored to a reproduction block. Each restored reproduction block is synthesized into an SD frame by the frame synthesis unit 503. Next, the enhancement layer decoder (FIG. 11) will be described. First, the SD frame reproduced by the base layer decoder is expanded to the size of the HD frame by the upsampling unit 604, and an HD low-resolution frame is created. The extended video data is separated into motion information, prediction type information, and texture information by the separation unit 601. There are three types of prediction types: base layer prediction, enhancement layer prediction, and interpolation prediction, and each block is decoded. For a block whose prediction type is base layer prediction, the composite prediction unit 605 extracts a block at a position spatially matching the current block from the HD low-resolution frame as a prediction block. In a block whose prediction type is base layer prediction, motion information is not decoded. For a block whose prediction type is enhancement layer prediction, motion information is decoded into a differential motion vector by the motion information decoding unit 621. The motion vector predictor 622 adds the motion vector difference to the motion vector predictor to restore the motion vector. The motion vector is input to the motion compensation unit 623. The motion compensation unit 623 extracts the block at the position indicated by the motion vector from the decoded HD frame stored in the frame memory 624 as a prediction block. When the prediction type is interpolation prediction, base layer prediction and enhancement layer prediction are performed. Then, the combined prediction unit 605 obtains an average value for each pixel of the two prediction blocks and sets it as a prediction block. The texture information is decoded by the variable length decoding unit 611 into quantized DCT coefficients. The quantized DCT coefficient is inversely quantized by the inverse quantization unit 612 and then regenerated into an error block by the inverse DCT unit 613. The error block and the prediction block are added for each pixel by the adding unit 602 and restored to a reproduction block. Each restored reproduction block is synthesized into an HD frame by the frame synthesis unit 603.

  1 to 4, the SD playback device is controlled by the control unit 114 in the HD playback device 110, but the present application includes a case where the control unit 114 controls only a processing unit in the HD playback device. . In this case, the data request in the process 703 of FIGS. 5 and 6 is performed by the user operating the SD playback device. In the description so far, the HD playback device requires the enhancement layer decoding function, and the configuration for acquiring the extended video data from the network has been described. However, a configuration is also conceivable in which, after the user possesses the basic video data of the SDTV video in the authentication process of the present application, the basic video data of the HDTV video is acquired from the network instead of the extended video data. Even in this case, the configuration of the present application is effective because the application means of the basic video data ownership authentication process of the present application using link information or product information can be utilized.

  The feature of the present invention is also effective in a configuration in which the image size of a reproduced image obtained by decoding the basic video bitstream is expanded by the extended video bitstream. For example, when pay digital broadcasting (basic video bitstream) for mobile phones is recorded on a PC, extended video data is acquired from the content service server by pay reception rights authentication, and a higher resolution video is viewed. And so on.

  Also, the video bit stream at hand and the additional video bit stream received from the content service server (obtained by the ownership authentication at the user's hand) differ from the playback video of the video bit stream at hand (for example, The configuration of the present invention is effective for a service capable of obtaining an image quality or a picture that changes). As an example of image quality improvement, an extended video bitstream created by the SNR scalability function of MPEG-2 (Non-Patent Document 1) or MPEG-4 (Non-Patent Documents 2 and 3) is prepared in the content service server. By receiving this from the Internet, it is possible to view the digital broadcast with DVD-level image quality. Another example of improving image quality is to prepare an extended video bitstream created by the temporal scalability function in a content service server and receive it from the Internet, so that video for mobile phones with a low frame rate can be obtained. It will be possible to enhance and view images with smooth motion. As an example of the case where the picture changes, a video object bitstream created by the MPEG-4 (Non-Patent Document 2) shape coding function is prepared in the content service server and received from the Internet. It is possible to view a video in which a new person appears in the playback video of the basic video bitstream or a video in which a part of the playback video of the basic video bitstream is changed.

It is the figure which showed the 1st example of the HDTV video reproduction | regeneration system in this invention. It is the figure which showed the 2nd example of the HDTV video reproduction | regeneration system in this invention. It is the figure which showed the 3rd example of the HDTV video reproduction system in this invention. It is the figure which showed the 4th example of the HDTV video reproduction system in this invention. It is the figure which showed the 1st example of the HDTV video reproduction process in this invention. It is the figure which showed the 2nd example of the HDTV video reproduction process in this invention. It is the figure which showed the example of embedding the link information to the basic video data of this invention. It is the figure which showed the specific example of the combination of a basic video data material, SD reproduction apparatus, and HD reproduction apparatus about the HDTV video reproduction apparatus of this invention. It is the figure which showed the specific example of the combination of a basic video data material and HD playback device about the HDTV video playback device of this invention. It is the figure which showed the structural example of the base layer decoder. It is the figure which showed the structural example of the enhancement layer decoder.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... SD reproduction apparatus, 101, 501, 601 ... Separation part, 102 ... Base layer decoder, 103 ... Link information decoder, 104 ... Product information decoder, 110 ... HD reproduction apparatus, 111 ... Enhancement layer decoder, 112 ... Data transmission / reception part , 113: hard disk, 114: control unit, 201: data server, 202 ... media library, 300 ... network, 502, 602 ... addition unit, 503, 604 ... frame synthesis unit, 604 ... upsampling unit, 605 ... synthesis prediction unit 511, 611 ... variable length decoding unit, 512, 612 ... inverse quantization unit, 513, 613 ... inverse DCT unit, 521, 621 ... motion information decoding unit, 522, 622 ... motion vector prediction unit, 523, 623 ... motion Compensators, 524, 624 ... frame memory.

Claims (9)

A storage medium playback device for storing media data, a data transmission / reception unit connected to a network, and a control unit;
The control unit receives extension video data corresponding to the basic video data in the media data from the network via the communication unit, and controls processing for converting the basic video data using the extension data. Characteristic data processing device. The media data includes link information to the extended video data corresponding to the basic video data,
The control unit outputs the link information to the network via the data communication unit, receives the extended video data from the link destination of the network specified in the link information, and uses the extended data to transmit the basic video data The data processing apparatus according to claim 1, wherein a process for converting the data is controlled. The media data includes identification information for identifying the extended video data corresponding to the basic video data,
The control unit outputs the input content information and the identification information to the network via the data transmission / reception unit, and when the identification information and the content are authenticated by a server connected to the network, 2. The data processing apparatus according to claim 1, wherein the extended video data can be received. The basic video data is a video base layer bitstream, and the extended video data is an enhancement layer bitstream that expands a decoding screen size corresponding to the base layer bitstream,
4. The data processing apparatus according to claim 1, wherein the conversion is a process of enlarging a decoded image size of the basic video data. The playback device is
A separation unit that separates the media data according to the data type;
A base layer decoder for reproducing the separated basic video data;
The data processing apparatus according to claim 2, further comprising a link information decoder that extracts information data from the separated data. The playback device is
A separation unit that separates the media data according to the data type;
A base layer decoder for reproducing the separated basic video data;
The data processing apparatus according to claim 3, further comprising a link information decoder that extracts product information from the separated data.   7. The reproduction apparatus according to claim 1, wherein the playback apparatus includes a receiver having a reception antenna for broadcast data, and the media data is broadcast data received via the reception antenna. Data processing device. A connection unit with a storage medium for storing media data, a data transmission / reception unit connected to a network, and a control unit;
In response to the input video playback request, the control unit
Link information data associated with the basic video data in the media data of the video requested to be played is sent via the transceiver.
Receiving the extended video data associated with the basic video decoder via the network;
A data processing apparatus for controlling a process of converting the basic video data using the extension data. A connection unit with a storage medium for storing media data, a data transmission / reception unit connected to a network, and a control unit;
In response to the input video playback request, the control unit
The product information data associated with the basic video data in the media data of the video requested to be played and the selection information of the video are transmitted via the transmission / reception unit,
When the authentication information is received via the network, the extended video data associated with the basic video decoder is received,
A data processing apparatus for controlling a process of converting the basic video data using the extension data.

Images