JP2010200357A - Transcoder, recording apparatus and transcode method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a transcoder, a recording apparatus and a transcode method for carrying out transcoding with enhanced convenience, using coding information (Inter/Intra-coding mode) attached to a stream prior to conversion. <P>SOLUTION: The transcoder includes a decoder that decodes a moving picture stream coded by a first coding system for carrying out in-frame coding and inter-frame prediction coding, encodes the decoded stream by a second coding system, and detects sub information for denoting whether the stream is coded by the in-frame coding or inter-frame coding; and an encoder that changes the frame referred to on encoding between the case that the sub information is information denoting that the coding is carried out by the in-frame coding system and the case that the sub information is information denoting that the coding is carried out by the inter-frame prediction coding system. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

The present invention relates to a transcoder that enables bit rate conversion and format conversion of a moving image stream.

In transcoding technology, it is common to decode a moving image stream before conversion, use the decoded image as an input image, and re-encode it into a format after conversion. In this transcoding, Patent Document 1 discloses a technique for reducing the processing load on the encoding side by using a vector, which is a motion search result, from a moving image stream before conversion as motion information in encoded information.

JP 2004-23444 A

However, Patent Document 1 does not disclose that transcoding is performed using information on whether an encoded frame is encoded by Intra or Inter.

Here, in the case of encoding with Inter, since there is a correlation between the reference frame and the frame to be encoded, the reference frame can be determined based on the same relationship as that of the stream before conversion. .

On the other hand, in the case of encoding with Intra, if the reference frame is determined based on the same relationship as that of the stream before conversion, since there is not much correlation, efficient compression cannot be performed.

Also, once you search for a frame that has the same relationship as that of the stream before conversion,
If another frame is searched, extra processing is required, which is not preferable for reducing the circuit scale and power consumption.

In the present invention, in order to solve the above-described problem, transcoding with improved usability is performed using information indicating whether encoding is performed in an Inter or Intra mode of encoded information added to a stream before conversion. It is an object to provide a transcoder, a recording apparatus, and a transcoding method.

  The above object is solved by the invention described in the claims.

According to the present invention, it is possible to provide a transcoder, a recording apparatus, and a transcoding method with improved usability.

Block diagram of the first embodiment Conceptual diagram of Example 1 Conceptual diagram of Example 1 Example of uncovered area Reference memory configuration example Reference memory configuration example Product example to which Example 1 is applied Flow chart for selecting reference image

In the following embodiment, an example of converting from MPEG2 to H.264 will be described. However, the present invention is not limited to this, and intra-frame encoding and inter-frame prediction encoding are performed, and compression is performed using an encoding method having information indicating whether the frame is intra-frame encoded or inter-frame encoded as frame information. This can be applied when transcoding the recorded video stream. In addition to MPEG2 and H.264, MPEG4, H.261, H.263, and SMPTE VC
1 etc.

In H.264 (ITE / ISO 14496-10 / H.264AVC) or the like, multiframe motion compensation is possible in which a reference frame for motion compensation can be arbitrarily selected from already decoded frames.

The configuration of the embodiment will be described with reference to FIG. The upper part of the figure shows a stream supply unit 001 that supplies a digital moving image stream read from a broadcast or a recording medium, a VLD unit 002 that decodes the decoding syntax, and an inverse frequency conversion that converts a frequency conversion region to an image region. Part 003, VLD
A decoder having a motion compensation unit 004 that performs motion compensation from the reference image using the vector information decoded by the unit and adds the output from the inverse frequency transform unit to create a decoded image (output image) (
Decoding device) 005.

The lower part of the figure shows a buffer unit 006 that stores the output image output from the decoder in the buffer as an input image, and motion compensation that can perform motion compensation between the input image and a plurality of already encoded reference images. Unit 007, frequency conversion unit 008 for frequency-converting the error image after motion compensation, VLC unit 009 for encoding with a standard-compliant syntax, reference image storage unit using the encoded image as a reference image for later motion compensation An encoder (encoding device) 011 having a reference memory unit 010 is shown.

In the decoder, the frame header is decoded for each frame, and the decoding process is performed for each rectangular area called a macro clock (MB). At this time, the encoding type of a picture, which will be described later, and vector information / intra / inter information decoded for each MB unit can be used in the motion compensation unit of the encoder.

In the present embodiment, for example, the upper decoder is connected to the international standard MPEG2 (ISO / IEC 1
3813-2, International Standard), H.264 (ISO / IEC 1)
4496-10 / ITU H.264 AVC).

FIG. 2 shows an outline of this embodiment. The upper row shows the decoding of the MPEG2 stream before transcode conversion, I, B, and P indicate the picture coding type (picture_coding_type), respectively, and I is the encoding (intra-coded) using only the information in the screen , P is a coding that can also use past information (predictive-codec), B is a coding that can use past and future information (bidirectionally-
represents the type that performs predictive-codec).

On the other hand, the lower row shows H.264 encoding. The encoded input image is an MPEG2 decoded image, and the encoding type is the same as the conversion source MPEG2.
With such a configuration, the vector information added to MPEG2 can be used in H.264 encoding. MPEG2 corresponding to MB to be encoded during H.264 encoding
Obtain and use vector information. In this way, the H.264 encoder can reduce the motion search circuit with a large amount of calculation, and the encoder circuit scale can be reduced.

At this time, if the MPEG2 MB is encoded by Intra that does not have vector information as shown in FIG. 3, the H.264 encoder cannot acquire vector information from MPEG2. In such a case, the encoder side of H.264 can also be set to Intra. However, considering the improvement in image quality with a configuration that assumes a small circuit scale and low power consumption, A method of performing a search is effective.

In the MB in which Intra is selected in the MPEG2 stream, it is determined that the correlation between the MPEG2 and the reference image that was originally in the reference relationship is small, and the H.264 encoder determines that the reference frame is newly searched. exclude.

FIG. 8 shows a flowchart for selecting a reference image. When encoding for each MB in H.264, refer to the information of Intra or Inter for each MB of MPEG2 (S801), and if it is Intra, the reference image that would have been in the MPEG2 reference relationship is H A reference image that is different from the reference image that is excluded from the motion compensation target of .264 and has a reference relationship in MPEG2 is selected (S802), and motion compensation is performed using the selected reference image (S804). If it is Inter, a reference image having a reference relationship in MPEG2 is selected using the decoding information of MPEG2 (S803), and H.264 motion compensation is performed (S804).

In the low power consumption H.264 encoder LSI, in order to realize multi-frame encoding, a method of actually searching for multiple reference images and selecting an efficient reference image is as follows:
It is not practical because it increases the circuit scale and power consumption. Therefore, in order to reduce circuit scale and power consumption, the number of reference frames for motion compensation is MPE, which is an existing technology, even for H.264 encoders.
Same as G2. In the present embodiment, it is effective to exclude a reference image with a low correlation with Intra selected from the reference target in terms of efficiency.

Further, when Intra is selected in MPEG2, a situation called an uncovered area as shown in FIG. 4 can be considered. This is a phenomenon that occurs when a hidden area appears, and the temporal correlation is lowered because the appearing area does not exist in the reference image. In the figure, when the face that was hidden when the star moved from the upper right to the lower left appears, the correlation decreases when picture n refers to n-1. However, in the past image n-2, a highly correlated image may be found. In the present embodiment, in view of this effect, when MPEG2 is Intra, a past image is further selected as a reference image.

The following examples can be considered as reference images at this time. In encoding, since an image encoded as shown in FIG. 5 is used as a later reference image, it must be stored in a reference memory. MPEG2
In the same reference relationship, the reference memory performs encoding using the image stored in the two planes. In this embodiment, this memory is increased to increase the reference image as shown in FIG.
When motion compensation information cannot be obtained with Intra, reference is made from the I2 frame that has been recorded in the memory due to the increase.

It should be noted that any frame that has already been decoded can be stored in the memory area that has been increased by one page and stored as a reference object. in this case,
For example, the first frame of a unit (for example, GOP) to be encoded is stored, and a method of using that as a reference object can be considered. Further, it is possible to increase the number of candidates for reference by increasing the memory, but from the viewpoint of small circuit scale, the reference memory unit should be configured to store three surfaces as shown in FIG. good.

Further, the search range on the reference image does not necessarily need to be set in a wide range in consideration of the uncovered area, and the corresponding surrounding pixels can be set as the search range.

By removing reference images with little correlation in this embodiment, it is possible to obtain the effect of multi-encoding with low power consumption and a small circuit scale.

Next, practical examples of products using this embodiment will be shown. This embodiment is effective when analog and digital television broadcasts and programs that have already been recorded are stored in recording media such as HDDs and DVDs with different encoding formats and encoding rates. FIG. 7 shows a block diagram when digital broadcasting is stored in a recording medium. The digital broadcast received by the tuner unit 701 is decoded by the demodulation unit 702 and decomposed into moving image information, audio information, and the like by the demultiplexer unit 703. The moving image information is decoded by the decoder 705, and if the image is output to the display, the decoded image is sent to the display unit 710. The reproduced image and sub-information decoded by the decoder are acquired by the encoder, encoded, and a stream is generated.

Further, according to the above embodiment, it is possible to realize high image quality of the bit rate conversion and format conversion of moving images.

Claims (14)

A transcoder that decodes a moving image stream encoded by a first encoding scheme that performs intraframe encoding and interframe predictive encoding, and encodes the encoded video stream by a second encoding scheme;
A decoder that decodes the input moving image stream and detects sub-information indicating whether it is encoded by intraframe encoding or interframe predictive encoding;
An encoder that changes a frame to be referred to when encoding, when the sub-information is information indicating that intra-frame encoding is performed and when it is information indicating that inter-frame prediction encoding is performed;
A transcoder characterized by comprising: The transcoder according to claim 1, wherein
The input moving image stream is a first input that is encoded while switching between inter-frame prediction encoding or intra-frame encoding for each encoding processing unit with reference to an input F0 frame.
F1 frame,
A second input F2 frame that is encoded while switching the interframe prediction encoding or the intraframe encoding for each encoding processing unit with reference to the first input F1 frame;
Have
When the encoder is information indicating that the sub information of the second input F2 frame is inter-frame prediction encoded,
With reference to the first output F1 frame image corresponding to the first input F1 frame, the second output F2 frame corresponding to the second input F2 frame is subjected to inter-frame prediction encoding, and the second input When the sub-information of the F2 frame is information indicating that intra-frame encoding is performed, the second output F2 frame is interframe prediction encoded with reference to the output F0 frame corresponding to the input F0 frame. Transcoder characterized by. The transcoder according to claim 2, wherein
The encoder refers to the output F0 frame without referring to the first output F1 frame when the sub-information of the second input F2 frame is information indicating that intra-frame encoding is performed. A transcoder characterized in that the second output F2 frame is subjected to interframe predictive coding. The transcoder according to claim 2, wherein
The encoder refers to any of the already decoded frames without referring to the first output F1 frame when the sub-information of the second input F2 frame is information indicating that intra-frame coding has been performed. Transcoder characterized by things. A transcoder that decodes a moving image stream encoded by a first encoding scheme that performs intraframe encoding and interframe predictive encoding, and encodes the encoded video stream by a second encoding scheme;
A decoder that decodes the input moving image stream and detects sub-information indicating whether it is encoded by intraframe encoding or interframe predictive encoding;
An encoder that changes a search order of frames to be referred to when encoding is performed depending on whether the sub-information is information indicating that intra-frame encoding has been performed or information indicating that inter-frame prediction encoding has been performed. When,
A transcoder characterized by comprising: The transcoder according to claim 5, wherein
The input video stream includes an input I frame that is an intra-frame-coded I picture, a first input P frame that is an inter-frame predictive P picture with reference to the input I frame, A second input P frame that is a P picture that is inter-frame prediction encoded with reference to the first input P frame, and
The encoder refers to a first output P frame image corresponding to the first input P frame when the sub information of the second input P frame is information indicating that inter-frame predictive coding has been performed. When the second output P frame corresponding to the second input P frame is inter-frame predictive encoded, and the sub information of the second input P frame is information indicating that it is intra-frame encoded, A transcoder that searches a frame to be referred to from frames other than the first output P frame and performs interframe predictive coding on the second output P frame. A transcoder according to any one of claims 2 to 4 and 6,
The input F0 frame is an input I frame that is an intra-coded I picture.
The first input F1 frame is a first input P frame that is a P picture that has been interframe predictively encoded with reference to the input I frame;
The transcoder, wherein the second input F2 frame is a second input P frame that is a P picture that has been subjected to interframe prediction encoding with reference to the first input P frame. The transcoder according to claim 1, wherein
The encoder includes a reference memory unit that stores three frames used for reference. The transcoder according to claim 1, wherein
The encoder searches for only one frame to be referenced. A transcoder according to any one of claims 1 to 9,
The transcoder is characterized in that the sub information is added for each macro block which is a decoding processing unit in a frame. A transcoder according to any one of claims 1 to 10,
The first encoding method is the MPEG method, and the second encoding method is H.264. A transcoder characterized by the H.264 system. A transcoder according to any one of claims 2 to 4 and 6,
When the encoder is information indicating that the sub information of the second input F2 frame is intra-frame encoded, the search range at the time of detecting vector information when performing inter-frame predictive encoding is around the search target position. Transcoder characterized by a few pixels. A recording medium interface for reading a moving image stream recorded on the recording medium and encoded by the first encoding method;
A transcoder according to any one of claims 1 to 12, wherein a moving image stream read by the recording medium interface is input.
The recording apparatus, wherein the recording medium interface records a moving image stream output from the transcoder and encoded by the second encoding method on a recording medium. A transcoding method for decoding a moving image stream encoded by a first encoding scheme that performs intraframe encoding and interframe predictive encoding, and encoding by a second encoding scheme,
Sub-information indicating whether the frame to be decoded is encoded by intra-frame encoding or inter-frame prediction encoding is added,
The transformer is characterized in that the reference frame is changed when encoding, depending on whether the sub-information is information indicating that intra-frame encoding is performed or information indicating that inter-frame encoding is performed. Code method.

Images