WO2008145039A1

WO2008145039A1 - Methods, systems and devices for generating upsample filter and downsample filter and for performing encoding

Info

Publication number: WO2008145039A1
Application number: PCT/CN2008/070902
Authority: WO
Inventors: Lizhong Peng; Hualin Wan; Jun Zhang
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2007-05-24
Filing date: 2008-05-07
Publication date: 2008-12-04
Also published as: CN101312529A; CN101312529B

Abstract

A method for generating an upsample filter and a downsample filter. The method comprises the steps of: upsampling and downsampling the video signal in conformity with Markov Model so as to derive the reconstructed signal; calculating the energy of the reconstructed signal; calculating the parameters of the wavelet filter corresponding to the maximum value of the energy of the reconstructed signal on the basis of the biorthogonal wavelet theory with parameters and the energy of the reconstructed signal, and generating an upsample filter and a downsample filter. Meanwhile, also provided are a method, device and system for performing the spatial scalable video encoding by use of the upsample filter and the downsample filter according to the present invention. With the solution according to the embodiment of the present invention, it is possible to minimize the loss of the encoding energy so that the qulity and performance of the video signal encoding could be improved.

Description

Method, system and device for generating upper and lower sampling filters and realizing coding

The present invention relates to coding techniques, and more particularly to a method, system and apparatus for generating up and down sampling filters and implementing coding. Background of the invention

With the development of technologies such as the Internet and wireless communications, the demand for video-based multimedia data is rapidly increasing. The transmission of uncompressed multimedia data requires a large amount of bandwidth and requires a large storage medium. The amount of multimedia data transmission is often very large, so it is necessary to compress and encode the multimedia data before transmitting. In addition, encoding and transmission are required to have time-varying network bandwidth adaptation capabilities, error-resistance performance, and support for spatial grading, time grading, and peak signal-to-noise ratio (PSNR) quality grading during transmission, allowing for Users with different terminal hardware facilities and requirements can intercept the embedded code stream according to their own conditions and restore the intercepted embedded code stream to different quality information.

In the scalable video coding (SVC) spatial scalable coding process, the video sequence is downsampled and upsampled into two samples. The original video sequence is downsampled to obtain a low resolution video signal. The corresponding macroblock obtained by the downsampling process is then subjected to upsampling processing to obtain a high resolution video, and the high resolution video is used for enhancement layer prediction or residual image prediction.

The upsampling filter and downsampling filter designed by using the prior art scheme are: [1 0 -5 0 20 32 20 0 -5 0 1]/32 and [2 0 -4 -3 5 19 26 19 5 -3 -4 0 2]/64, The upper and lower sampling filters used for inter-layer residual prediction are: [1 1]/2 and [2 0 -4 -3 5 19 26 19 5 - 3 -4 0 2]/64. It can be seen that the prior art is designed for video coding. When the upsampling filter and downsampling filter are used, the correlation between the upsampling filter and the downsampling filter is not considered, that is, the designed upsampling filter and downsampling filter are independent.

In practical applications, the up-and-down sampling operations using the above-described upsampling filter and downsampling filter are independent of each other and lack of correlation. Therefore, the video signals obtained by using these filters in the encoding process will have distortion, fast effects, etc., and bring a poor visual effect to the viewer.

In summary, due to the lack of correlation between the upsampling filter and the downsampling filter designed in the prior art, and the filtering performance is poor, the quality of encoding using the existing upsampling filter and downsampling filter is relatively high. difference. Summary of the invention

Embodiments of the present invention provide a method of generating an up-and-down sampling filter, by which an upsampling filter and a downsampling filter with better filtering performance can be generated.

Embodiments of the present invention provide a method for implementing spatial scalable video coding by using a downsampling filter, by which the quality of coding can be improved.

Embodiments of the present invention provide a method for implementing spatial scalable video coding by using an upsampling filter, by which the quality of coding can be improved.

Embodiments of the present invention provide a device for implementing spatial scalable video coding by using a downsampling filter, and the quality of the coding can be improved by using the device.

Embodiments of the present invention provide a device for implementing spatial scalable video coding by using an upsampling filter, and the quality of the coding can be improved by using the device.

Embodiments of the present invention provide a system for implementing spatial scalable video coding by using a downsampling filter and an upsampling filter, and the quality of the coding can be improved by using the system.

Embodiments of the present invention provide an apparatus for generating an up-and-down sampling filter, by which an upsampling filter and a downsampling filter having better filtering performance can be generated. Embodiments of the present invention provide a method of generating an up-and-down sampling filter, the method comprising:

Downsampling and upsampling the video signal conforming to the Markov model to obtain a reconstructed signal;

Calculating the energy of the reconstructed signal;

And calculating a wavelet filter parameter corresponding to a maximum value of the energy of the reconstructed signal according to a bi-orthogonal wavelet theory with parameters and an energy of the reconstructed signal, and generating an upsampling filter and a downsampling filter.

Embodiments of the present invention provide a method for implementing spatial scalable video coding by using a downsampling filter, where the method includes:

Downsampling the video signal used for encoding using a downsampling filter to obtain a downsampled video sequence;

Performing time domain decomposition on the downsampled video sequence to obtain an internal I frame, a predicted P frame, and a bidirectional predicted B frame;

Performing intra prediction and intra coding on the I frame to obtain a downsampled intra prediction coding signal; performing motion coding on the P frame and the B frame to obtain a motion prediction coding signal;

The downsampling filter is configured to downsample and upsample the video signal conforming to the Markov model to obtain a reconstructed signal, and calculate the energy of the reconstructed signal according to the parameter of the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal. The maximum value corresponds to the wavelet filter parameters generated by the downsampling filter.

The present invention provides a method for implementing spatial scalable video coding using an upsampling filter, the method comprising:

Upsampling the downsampled intraframe encoded signal using an upsampling filter to obtain an upsampled video sequence;

Performing intra prediction and intra coding on the upsampled video sequence to obtain an upsampled frame Predictive coded signal;

The upsampling filter is configured to downsample and upsample the video signal conforming to the Markov model to obtain a reconstructed signal, and calculate the energy of the reconstructed signal according to the parameter of the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal. The maximum value corresponds to the wavelet filter parameters generated by the upsampling filter.

An embodiment of the present invention provides a device for implementing spatial scalable video coding by using a downsampling filter, where the device includes:

a downsampling filter, configured to receive a video signal for encoding, and downsample the video signal to obtain a downsampled video sequence;

a time domain decomposition unit, configured to receive the downsampled video sequence from the downsampling filter, and decompose the downsampled video sequence into an I frame, a P frame, and a B frame;

a motion coding unit, configured to receive the P frame and the B frame from a time domain decomposition unit, and perform motion coding on the P frame and the B frame to obtain a motion prediction encoded signal;

a downsampling intra prediction and intra coding unit, configured to receive the I frame from the time domain decomposition unit, perform intra prediction and intra coding on the I frame, to obtain a downsampled intra prediction coding signal;

The downsampling filter is configured to perform downsampling processing and upsampling the video signal conforming to the Markov model to obtain a reconstructed signal, and calculate the reconstructed signal according to the parameter of the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal. The wavelet filter parameters corresponding to the maximum energy, the generated downsampling filter.

Embodiments of the present invention provide an apparatus for implementing spatial scalable video coding by using an upsampling filter, the apparatus comprising:

An upsampling filter, configured to receive a downsampled intra prediction encoded signal, and upsample the downsampled intra prediction encoded signal to obtain an upsampled video sequence;

Upsampling intra prediction and intra coding units for receiving from the upsampling filter An upsampled video sequence, performing intra prediction and intra coding on the upsampled video sequence to obtain an upsampled intra prediction encoded signal;

Embodiments of the present invention provide a system for implementing spatial scalable video coding by using a downsampling filter and an upsampling filter, the system comprising:

And a downsampling coding unit, configured to receive the downsampled video sequence from the downsampling filter, perform prediction and encoding on the downsampled video sequence, and generate a motion prediction coded signal and a downsampled intra prediction coded signal;

An upsampling filter, configured to receive the downsampled intra prediction encoded signal from the downsampling coding unit, and perform upsampling processing on the downsampled intra prediction encoded signal to obtain an upsampled video sequence;

Upsampling intra prediction and intra coding unit, configured to receive the upsampled video sequence from the upsampling filter, perform intra prediction and intraframe coding on the upsampled video sequence, to obtain upsampled intra prediction Coded signal

The downsampling filter and the upsampling filter are down-sampling and up-sampling the video signal conforming to the Markov model to obtain a reconstructed signal, according to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal, The wavelet filter parameters corresponding to the maximum value of the energy of the reconstructed signal, the generated downsampling filter and the upsampling filter.

Embodiments of the present invention provide an apparatus for generating an up-and-down sampling filter, the apparatus comprising: For downsampling and upsampling a video signal conforming to the Markov model to obtain a unit for reconstructing the signal;

Means for calculating the energy of the reconstructed signal; and

The wavelet filter parameters corresponding to the maximum value of the energy of the reconstructed signal are calculated according to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal, and the units of the upsampling filter and the downsampling filter are generated. BRIEF DESCRIPTION OF THE DRAWINGS

1 is a schematic structural diagram of a JSVM of two-level video coding in an application scenario according to an embodiment of the present invention;

2 is a schematic flow chart of a method for generating an upsampling filter and a downsampling filter according to an embodiment of the present invention;

2a is a schematic flowchart of implementing video signal reconstruction according to an embodiment of the present invention; FIG. 3 is a schematic flowchart of a method for implementing spatial scalable video coding by using a downsampling filter generated by the embodiment shown in FIG. 2;

3a is a schematic structural diagram of all pixels in a video signal frame;

4 is a schematic flow chart of a method for implementing spatial scalable video coding by using an upsampling filter generated by the embodiment shown in FIG. 2;

5 is an effect diagram of processing an image using a filter generated by the present invention; FIG. 6a is a graph of layer 0 intra-frame coding of a moving object (Mobile); FIG. 6b is a layer 0 frame for a foreman (foreman) Figure 6c is a graph of layer 0 intra-frame coding of a football; Figure 6d is a graph of layer 0 intra-frame coding of a bus; Figure 6al is a layer for Mobile The graphics obtained by encoding within 1 frame;

Figure 6b 1 is a graph of layer 1 intra-frame coding of foreman; Figure 6cl is a graph of layer 1 intraframe coding of the football;

Figure 6dl is a graph of layer 1 intra-frame coding of the bus;

7 is a schematic structural diagram of an apparatus for implementing spatial scalable video coding by using a downsampling filter generated by the embodiment shown in FIG. 2;

8 is a schematic structural diagram of an apparatus for implementing spatial scalable video coding by using an upsampling filter generated by the embodiment shown in FIG. 2;

FIG. 9 is a schematic structural diagram of a system for realizing spatial scalable video coding by using a downsampling filter and an upsampling filter generated by the embodiment shown in FIG. Mode for carrying out the invention

In an application scenario of the embodiment of the present invention, a signal is sampled by a binary binary (2D) sampling technique. The general downsampling method is as follows: First, the high resolution macroblock is filtered by a downsampling filter; then, the pixels of the even row even columns are directly discarded to obtain a low resolution macroblock. The specific operation of the upsampling is as follows: the low-resolution macroblock obtained by the downsampling process is interlaced or interlaced to obtain a high-resolution macroblock with the resolution of both the horizontal and vertical directions being twice the original resolution. . For example, let f _H and t represent high resolution and low resolution images, respectively, such that f _H ( 2x, 2y ) = fL ( x, y ). Then, the high-resolution macroblocks are convoluted by the upsampling filter in the horizontal direction and the vertical direction, respectively, and combined to obtain a high-resolution image. In actual operation, the pixels corresponding to the pixels of the low-resolution macroblock are directly filled on the high-resolution macroblock by using the characteristics of the up-sampling filter, and the remaining pixels of the high-resolution macroblock are processed by the interpolation method.

Currently, the coding model used by the Joint Video Group (JVT) SVC is the Joint Video Group Video Layered Coding Model (JSVM) 6.3.1. FIG. 1 is a schematic structural diagram of a JSVM of two-level video coding in an application scenario according to an embodiment of the present invention.

As shown in FIG. 1, the model includes: a video unit 100, a 2D spatial domain downsampling unit 110, The core encoder 120, an encoder 130 compatible with the H.264 main architecture, a 2D spatial domain upsampling unit 140, a multiplexing unit 150, and a bitstream output unit 160. The core encoder 120 includes: a time domain decomposition unit 121, a motion coding unit 122, and an intra prediction/coding unit 123. The encoder 130 compatible with the H.264 main architecture includes: a time domain decomposition unit 131 and a motion coding unit 132. And intra prediction/encoding unit 133.

The video unit 100 inputs the video signal to the 2D spatial domain downsampling unit 110, and the 2D spatial domain downsampling unit 110 performs a binary downsampling process on the video signal to generate a low resolution video signal, and outputs the generated low resolution video signal to the video signal. The time domain decomposition unit 121 and the time domain decomposition unit 131.

The time domain decomposition unit 121 and the time domain decomposition unit 131 respectively perform time domain grading on the received low resolution video signals, and output the gradation video signals to the motion coding unit 122 and the motion coding unit 132, respectively, and intra prediction/ The encoding unit 123 and the intra prediction/encoding unit 133.

The motion encoding unit 122 and the motion encoding unit 132 perform motion encoding processing on the received video signal subjected to the time domain hierarchical processing, and output it to the multiplexing unit 150.

The intra prediction/encoding unit 133 performs intra prediction and intra coding on the received video signal subjected to the time domain hierarchical processing, and transmits the video signal to the multiplexing unit 150, and the video signal is filled by the 2D spatial domain upsampling unit 140. And the interpolation process is sent to the intra prediction/encoding unit 123.

The intra prediction/encoding unit 123 receives the signal transmitted by the 2D spatial domain upsampling unit 140, performs intra prediction on the signal, and transmits the predicted video signal to the multiplexing unit 150.

The multiplexing unit 150 receives the video signals transmitted by the motion coding unit 122, the motion coding unit 132, the intra prediction/coding unit 123, and the intra prediction/encoding unit 133, and multiplexes the received video signals and transmits them to the bit stream. Output unit 160.

Intra prediction includes: inter-layer intra texture prediction and inter-layer residual prediction. Among them, inter-layer intra-textural prediction means that the macroblock of the low-resolution layer is not upsampled by using motion information. The process of predicting a macroblock to a high resolution layer; inter-layer residual prediction refers to a process of up-sampling residual information of a low-resolution layer to obtain high-resolution layer residual information prediction. In the frame prediction process, the motion information of the high-resolution layer may be predicted by using information of adjacent macroblocks or other layer-related macroblocks, or the high-resolution layer may be layered by upsampling processing of lower layer information. Inter-frame texture prediction and inter-layer residual prediction.

In the embodiment of the present invention, to generate an upsampling filter and a downsampling filter, first, a video signal conforming to the Markov model needs to be downsampled and upsampled to obtain a reconstructed signal, and then the energy of the reconstructed signal is calculated; Then, according to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal, the wavelet filter parameters corresponding to the maximum value of the energy of the reconstructed signal are calculated, and an upsampling filter and a downsampling filter are generated.

2 is a flow chart showing a method of generating an upsampling filter and a downsampling filter according to an embodiment of the present invention. As shown in FIG. 2, the method includes the following steps:

Step 21: Down-sampling and up-sampling the video signal conforming to the Markov model to obtain a reconstructed signal.

Step 22: Calculate the energy of the reconstructed signal.

Step 23: According to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal, calculate the wavelet filter parameters corresponding to the maximum value of the reconstructed signal, and generate an upsampling filter and a downsampling filter.

Step 24: Integring the upsampling filter and the downsampling filter to obtain an integer upsampling filter and an integer downsampling filter.

Step 25: Perform length reduction on the integer upsampling filter and the integer downsampling filter to obtain an optimized integer upsampling filter and an optimized integer downsampling filter.

In practice, steps 24 and 25 above are optional steps.

The specific operations of the foregoing steps 21 to 25 are as follows:

In step 21, the video signal conforming to the Markov model is subjected to downsampling processing and The sampling process, the method for obtaining the reconstructed signal includes:

S = {s _n } _{0 ≤ n < M} is a sequence of stationary random video signals, H ⁽¹ ) =

And ^ ² ) ^ ² ). , /^,...,^ ² ^ are two finite linear phase impulse response (FIR) low-pass filters, both of which are causal filters.

First, use H ⁽¹ ) for ^ = k}. _≤ „ _<M performs filtering processing, and then performs downsampling processing to obtain:

Then, the signal sequence is upsampled,

And filtering the signal sequence with H( ² ) to obtain a reconstructed signal:

S ^l = {s _p ^l \s _p ^l =∑h^ _p _ _2kSk ⁰ }(0<p<M) ₇ where, =∑^), — ₂ Α·.

k j

In practical applications, 95% of the video signals are video signals conforming to the Markov model, and the process of downsampling and upsampling the video signals to obtain the reconstructed signals is represented in the form of a flow diagram.

2a is a schematic flowchart of implementing video signal reconstruction according to an embodiment of the present invention. As shown in Figure 2a,

The video signal S is subjected to filtering processing using ^ω , and then subjected to downsampling processing to obtain a signal S ₀ . Then on the signal S. The upsampling process is performed, and the S(S) processed by the upsampling is used by the ( ² ) filter. A filtering process is performed to obtain a reconstructed signal Si.

In the step 22, the method for calculating the energy of the reconstructed signal according to the reconstructed signal is: In this step, calculating the energy of the reconstructed signal by using the reconstructed signal into the energy model, specifically:

First, choose an energy model: maxi IAI +

Wherein, Si is a reconstructed signal obtained by down-sampling and up-sampling the video signal S; S ₂ is a video signal obtained by correlating the video signal S with the SI; and S ₃ is for the S Line down the resulting video signal. It is the energy of the video signal after downsampling and upsampling. Is the correlation energy of the video signal before the downsampling and upsampling process and the reconstructed signal. It is the energy of the video signal after the downsampling process. Both α and β are positive integers greater than zero, and γ is a positive integer greater than or equal to zero.

Different energy models can be obtained when α, β and γ take different values, for example:

When _{α = 1} , β _{= λ} , _{γ = 0} , the energy model is: El = m _ax {E[ _e (W] + ^[e( )]} _; when α = 1/2, β = 1, γ When =0, the energy model is: 2 = m _ax {E[(l/2) _e (W] + [e(^)]} _; when α=1/2, β=λ, γ=0, energy The model is: 3 = m _ax {E[(l/2 (W) + ; When α=1/2, β=λ, γ=θ, the energy model is:

Ε4 = max {E[(l 12)e(S _l )] + AE[e(S ₂ )] + 0E[e(S ₃ )] } In this embodiment, the selected energy model is: ^ maxi ^ d)] ^?^^)]^ The energy of the video signal after downsampling and upsampling is:

The correlation between the video signal before the downsampling and the upsampling process and the reconstructed signal

E } =

for:

The energy of the reconstructed signal thus obtained is:

EieiS, )} + E{e(S ₂ )} = E{∑ (s _p ^l f } + E{∑ s _p ^l _+l s _p } where E[e( )] and E[e(S ₂ )] can be approximated as: E{e(S } - 2M 3⁄4 h ⁽²⁾ _p h ⁽²⁾ _pi ^ ^ ( ¹ "" ²¹

_{E {e (S 2)}} = E {Σ s p l + l s p} ¾ ΣΣΛ (2 ( In step 23, in the present embodiment, the parameterized bi-orthogonal wavelet theory is a parameterized formula of a bi-orthogonal wavelet filter with parameters. According to the parameterization formula of the bi-orthogonal wavelet filter with parameters and the energy of the reconstructed signal, the wavelet filter parameters corresponding to the maximum value of the reconstructed signal are calculated, and the methods for generating the upsampling filter and the downsampling filter include:

It can be seen from step 22 that the energy formula of the reconstructed signal in this embodiment is:

EieiS, )} + E{e(S ₂ )} = E{∑ (s _p ^l f } + E{∑

} _o In this embodiment, the length is

(7, 13) Single parameter bi-orthogonal wavelet parameterization formula.

The single parameter bi-orthogonal wavelet parameterization formula of length (7, 13) is as follows: = (-丄+丄-丄+丄7ϊ,丄+ I, 丄+ 7ϊ, -丄+丄ϊ, -丄+丄I )

4 32 2 4 4 32 4 32 2 4 4 32

L =—(-157-352Λ>/2 +13552Λ ² +1048576Λ ⁹ >/2 +4554752Λ ⁷ >/2

⁰ 64

+993792Λ/2Λ ⁵ -25784Λ ³ Λ/2 -162624Λ ⁴ -4225024Λ ⁶ -4849664Λ ⁸ )

/(-8Λ ² + 4hf2 - 1)(V2 - 256Λ ³ +20Λ + 16h ² 3⁄4(2 - 1);

h = 68 + 6120Λ ² + 262144/i ⁹ V2 +1298432Λ ⁷ Λ/2

+408768V2/i ⁵ -10160Λ ³ Λ/2 -89856Λ ⁴ -1413632Λ ⁶ -1277952Λ ⁸ )

/(-8Λ ² + 4 - 1)(Λ/Ϊ - 256Λ ³ +20A + 16h ² 3⁄4(2 - 1);

+1500672V2/i ⁵ - 19904Λ ³ 2 - 446784Λ ⁴ - 4823040Λ ⁶ - 4849664Λ ⁸ )

+1123392 23⁄4 ⁵ -30160Λ ³ >/2 +16008Λ ² -223168Λ ⁴ -4095488Λ ⁶ )

/(-8Λ ² +

+20Λ + 16h ² 3⁄4(2 - 1);

h, = -"- (-1808Λ + 125>/2 -12864Λ ³ - 4096Λ ⁵ + 4936Λ ² V2 + 8192h ⁴ Ϊ)

£ =— (-55-219h l + 4172h ² -1496Λ ³ Ϊ - 750 ⁴

+209024Λ/2Λ ⁵ + 286720Λ ⁷ Λ/Ϊ - 497664Λ ⁶ -131072k ⁸ )

/(-8k ² + 4ky/2 - 1)(V2 - 256k ³ +20k + l 6k ² 3⁄4;

=丄(-4560896Λ ⁶ - 4849664Λ ⁸ -165 + 1048576Λ ⁹ Ϊ

6 256

+1156608>/2Λ ⁵ +4620288/i ⁷ V2 -272ΛΛ/2 -34240Λ ³ >/2 -196928Λ ⁴ +15472Λ ² )

/(-8Λ ² + hl - 1)(V2 - 256Λ ³ +20Λ + 16h ²

It should be noted that the parameterized formula of the parameterized bi-orthogonal wavelet filter may include, but is not limited to: a single parameter double orthogonal wavelet parameterization formula, or a two parameter double orthogonal wavelet parameterization formula, or multiple parameters. Biorthogonal wavelet parameterization formula, or single parameter and multi-parameter bi-orthogonal wavelet parameterization formula. Method and utilization list for obtaining up-sampling filter and down-sampling filter by using two-parameter bi-orthogonal wavelet parameterization formula, multi-parameter bi-orthogonal wavelet parameterization formula, and single-parameter and multi-parameter bi-orthogonal wavelet parameterization formula The parameter bi-orthogonal d, the wave parameterization formula is the same as the method of obtaining the up-sampling filter and the down-sampling filter, and is also within the protection scope of the present invention.

The method for solving the wavelet filter parameters corresponding to the maximum value of the reconstructed signal is as follows: First, the parameterized formula of the bi-orthogonal wavelet filter with parameters is substituted into the energy formula of the reconstructed signal, that is, the single length (7, 13) The parameter bi-orthogonal wavelet parameterization formula is substituted into the E{e(S )} + )} = E{ ( ) ² } + E{ + ^ } formula. Secondly, 60 iterations are calculated for λ=1 and λ=0.1, respectively. It is calculated that when h=0.7, the energy of the reconstructed signal is near the maximum value.

Again, substituting h=0.7 into the one-parameter bi-orthogonal wavelet parameterization formula yields the values shown in Table 1, and Table 1 shows the wavelet filter parameter values.

H7 H13

_.4241747852752234e-l -.2864426763622237e-2 .3553390593273753e-2 -.2399583254419701e-3

.3959708691207962 .5084782097542918e- l

.7000000000000000 -.4525099414445236e- l

.3959708691207962 -.1811648336223731

.3553390593273753e-2 .3990443430631642

_.4241747852752234e- l .9734696600076678

.3990443430631642

-.1811648336223731

-.4525099414445236e- l

.5084782097542918e- l

-.2399583254419701e-3

-.2864426763622237e-2 Table 1

Finally, the wavelet filter parameters in the floating point form in Table 1 are written in the form of a matrix, that is, an upsampling filter and a downsampling filter can be generated.

In step 24, the upsampling filter and the downsampling filter generated in step 23 may be integerized, and the method of generating the integer upsampling filter and the integer downsampling filter is as follows: The wavelet filter is used for binary multiplication, and then the approximate result of the binary multiplication is obtained. The integer upsampling filter and the integer downsampling filter that can be generated are:

H7 = [-1 0 9 16 9 0 -1] /16 and H9=[ l -1 -4 9 22 9 -4 -1 1 ]/32 ,

Or, HH7=[-8 1 72 126 72 1 -8]/128 and HH13=[-1 0 18 -16 -65 144 352 144 -65 -16 18 0 -1]/512;

Or, H7 = [-5 0 21 32 21 0 -5]/32 and H3 = [17 30 17]/64.

In step 25, the integer upsampling filter and integer downsampling generated in step 24 may be performed. The filter is length-reduced to generate an optimized integer upsampling filter and an optimized integer downsampling filter:

The length of the filter directly affects the speed of its operation and the reconstruction quality of the video signal. Based on the trade-off between the operation speed and the reconstruction performance of the video signal, the effects of the integer up-sampling filter and the integer down-sampling filter are compared. Small values are omitted and added to the center value to generate an optimized integer upsampling filter and an optimized integer downsampling filter.

Perform length reduction on H7 =[-l 0 9 16 9 0 -1] /16^H9=[1 -1 -4 9 22 9 -4 -1 1 ]/32 in step 24, and generate optimized integer upsampling The filter and the optimized integer downsampling filter are: H7 = [-l 0 9 16 9 0 -1] /16; H5 = [-4 9 22 9 -4] / 32.

It should be noted that, in this embodiment, the up-sampling filter and the downsampling of the chrominance component or the luminance component of the video signal may be utilized by using other energy models in step 23 and a parameterized bi-orthogonal wavelet filter parameterization formula. The filter is designed and optimized. For example, another set of upsampling filters and downsampling filters can be generated: H7 = [-5, 0, 21, 32, 21, 0, -5]/64 and H3 = [ 17, 30, 17]/64.

The steps of the upsampling filter and the downsampling filter of the present invention can be implemented by performing steps 21 to 23. Further, step 24 can be used to perform integer processing on the floating point filter generated in step 23 to generate an integer filter. Similarly, step 25 may be further performed to perform length optimization processing on the integer filter generated in step 24 to generate an optimized integer upsampling filter and an optimized integer downsampling filter.

As can be seen from the embodiment, this embodiment mainly introduces the design of the upsampling filter and the downsampling filter in the spatial scalable coding process based on H.264. Compared with the prior art, it has the following advantages: 3⁄4 mouth:

First, the bi-orthogonal wavelet theory with parameters is used in the design of the upsampling filter and the downsampling filter, so that the designed upsampling filter and downsampling filter are related.

Secondly, the upsampling filter and the downsampling filter generated in this embodiment are energy models. The upper and lower sampling filters generated in the case of maximizing the solution are optimal for the energy model in ensuring the same filter length.

Finally, according to the coding complexity of different video signals, the generated integer filters can be clipped to different lengths to generate an optimized integer filter, so that the trade-off between the operation speed and the video signal reconstruction performance is the most realistic. Optimized integer upsampling filters and optimized integer downsampling filters are required.

So far, the introduction of the embodiment shown in Fig. 2 is ended.

The embodiment shown in Figure 2 shows how to generate an upsampling filter and a downsampling filter, which can be used for spatially scalable video encoding operations. The spatially scalable video signal encoding process is divided into: an encoding process using a downsampling filter and an encoding process using an upsampling filter. The following are introduced in specific embodiments:

FIG. 3 is a schematic flow chart of a method for implementing spatial scalable video coding by using a downsampling filter generated by the embodiment shown in FIG. As shown in FIG. 3, the method includes the following steps:

Step 31: Down-sampling the video signal as the encoded input by using a downsampling filter to obtain a downsampled video sequence.

In the present embodiment, the downsampling filter used is the downsampling filter generated in step 24: H9 = [l - 4 9 22 9 -4 - l l ] / 32.

Step 32: Perform time domain decomposition on the video signal sequence to obtain an internal (I) frame, a prediction (P) frame, and a bidirectional prediction (B) frame.

Step 33: Perform intra prediction and intra coding on the I frame to obtain a downsampled intra prediction coding signal, and perform motion coding on the P frame and the B frame to obtain a motion prediction coded signal.

The specific operations of steps 31 to 33 above are as follows:

In step 31, the video signal as the encoded input is subjected to the downsampling filter. The sampling operation, the specific operation of obtaining the downsampled video sequence is:

Convolution calculation of each pixel in the peer or interlaced line of the video signal as the code input with H9=[l -1 -4 9 22 9 -4 -1 1 ]/32 in the vertical direction to obtain the pixel value of each pixel Then, the pixel value of each pixel is convoluted with H9=[l -1 -4 9 22 9 -4 -1 1 ]/32 in the horizontal direction to obtain a downsampled video sequence; or, the level may be first The convolution operation in the direction obtains the pixel value of each pixel, and then calculates the pixel value of each pixel in a vertical direction with H9=[l -1 -4 9 22 9 -4 -1 1 ]/32. Get the downsampled video sequence. For the above process, the following is a specific example:

FIG. 3a is a schematic structural diagram of all pixels in a video signal frame. Figure 3a includes: a row including pixel E, pixel e, pixel F, pixel f, pixel G, pixel g, pixel H, pixel h, and pixel I; including pixel pixel K, pixel L, pixel k, pixel M, and a row of pixels N; a column including pixel eight, pixel a, pixel C, pixel b, pixel G, pixel c, pixel L, pixel d, and pixel P; and includes pixel B, pixel D, pixel H, pixel n, pixel M and the column of pixel Q.

Taking the pixel G as an example, in the first step, the pixel value of the G point and the pixel value in the vertical direction are convoluted with H9=[l -1 -4 9 22 9 -4 -1 1 ]/32 to obtain a convolution operation. Pixel value G, =

(A-a-4*C+9*b+22*G+9*c-4*L-d+P) /32. Similarly, for each pixel in the pixel G peer or interlaced line, convolution operation is performed according to this formula with H9=[l -1 -4 9 22 9 -4 -1 1 ]/32 to obtain the pixel value E' and the pixel value e, respectively. ', pixel value F', pixel value f', pixel value G', pixel value g', pixel value H', pixel value h', pixel value Γ, and the like.

In the second step, the pixel value G and the pixel values in the horizontal direction are convoluted with H9=[l -1 -4 9 22 9 -4 -1 1 ]/32 to obtain G"=

( E'-e'-4*F'+9*f'+22*G'+9*g'-4*H'-h'+r ) /32, where the pixel values on the right side of the equation are The pixel value obtained by the convolution operation of the first step.

The pixel values in the gray squares in Figure 3a are taken separately to obtain a downsampled video sequence. It should be noted that the operations of the first step and the second step described above can be reversed, and the obtained result is convoluted with the downsampling filter.

In step 32, the video signal sequence is subjected to time domain decomposition to obtain an operation of an I frame, a P frame, and a B frame, and in step 33, the I frame is subjected to intra prediction and intra coding to obtain a downsampled intra prediction encoded signal. The frame and the B frame are motion-encoded to obtain a motion prediction coded signal operation, which can be the same as the corresponding operation in the prior art.

So far, the introduction of the embodiment shown in Fig. 3 is ended.

4 is a flow chart showing a method for implementing spatial scalable video coding by using an upsampling filter generated by the embodiment shown in FIG. 2. As shown in Figure 4, the method includes the following steps:

Step 41: Upsampling the downsampled intra prediction encoded signal by using an upsampling filter to obtain an upsampled video sequence.

In this step, the upsampling filter used is the integer upsampling filter generated in step 24: H7 = [-1 0 9 16 9 0 -1] /16, the downsampling intra prediction coding involved The signal is an intra-frame prediction and intra-frame coding of the I frame in step 33 to obtain a downsampled intra-predicted coded signal.

Step 42: Perform intra prediction and intra coding on the upsampled video sequence to obtain an upsampled intra prediction encoded signal.

The specific operations of step 41 to step 42 are as follows:

In step 41, the upsampling encoded signal is upsampled using an upsampling filter to obtain an upsampled video sequence. The specific method is: using an upsampling filter to perform inter-frame processing on the downsampled intraframe encoded signal. The 2D spatial domain upsampling process of inner texture prediction and inter-layer residual prediction yields an upsampled video sequence.

Still referring to Fig. 3a, the gray squares in Fig. 3a represent the pixels of the macroblock in the downsampled intra prediction encoded signal, all of which represent the pixels of the macroblock in the upsampled video sequence. Use upsampling filter The waver performs intra-layer intratextural prediction and inter-layer residual prediction on the downsampled intra prediction encoded signal by 2D spatial domain upsampling, and the specific method for obtaining the upsampled video sequence is:

For pixels in gray square positions: Keep their pixel values unchanged.

For a pixel in the horizontal direction immediately adjacent to the gray square, shaped like g: the subsampled intra prediction encoded signal sequence is padded with zeros and then horizontally aligned with H7 = [-1 0 9 16 9 0 -1] /16 Convolution, the pixel value of g is: g = ( -F+9*G+9*Hi ) /16. In addition, pixels which are evenly spaced apart from g in the horizontal direction and the vertical direction are processed in the same manner.

For a pixel in the vertical direction immediately adjacent to the gray square, shaped like c: The subsampled intra prediction encoded signal sequence is padded with zeros and then scrolled in the vertical direction with H7 = [-1 0 9 16 9 0 -1] /16 Product, the pixel value of c is obtained: c= ( -C+9*G+9*LP ) /16ο In addition, for other pixels that are different from c in the horizontal direction and the vertical direction by an even number of pixels, the same method is used. Process it.

For pixels diagonally diagonal to the gray square, shaped like i: Convolute the downsampled intra-predictive coded signal sequence with H7 = [-1 0 9 16 9 0 -1] /16 in the vertical or horizontal direction , get the pixel value of i 1 = ( -m+9*c+9*no ) /16 or 1= ( -j+9*g+9*kl ) /16, these two values are equal, take it One can be.

In step 42, the upsampled intra-predictive coded signal is formed by performing intra prediction and transform/entropy coding on the enhancement layer using the upsampled video sequence obtained in step 41 and the original texture information.

Finally, the downsampled intra prediction encoded signal, the motion prediction encoded signal and the upsampled intra prediction encoded signal obtained by all encoding processes are multiplexed to obtain a reconstructed video signal.

The operation of this step can be similar to the corresponding operation in the prior art.

So far, the introduction of the embodiment shown in Fig. 4 is ended.

The upsampling filter and downsampling filter generated in the embodiment shown in Figure 2 are optimal for the energy model and are interrelated. The upsampling filter and the downsampling filter generated by the embodiment shown in FIG. 2 are respectively used in the encoding process of the video signals shown in FIG. 3 and FIG. 4, and can be reduced. Less image energy loss, improve the quality of encoding video signals, minimize energy loss and maximize video recovery quality, and improve the reconstruction quality of video signals, optimize the reconstruction of video signals at high resolution .

The upsampling filter and downsampling filter designed using the method shown in Figure 2 process the image to significantly improve the resolution of high resolution. The quantitative and qualitative test results obtained by processing the image are described below in the specific examples.

Table 2 shows the results obtained by quantitatively testing the images.

Table 2

As shown in Table 2, the columns represent the names of the eight standard images, and the rows represent the filters for testing the images, followed by SVC/H.264, h5/h7, h7/h9, H7/H9, and HH7/HH13 filters. ,

The test data is expressed in units of peak signal-to-noise ratio (PSNR), where a larger value of PSNR indicates that the test result is more ideal.

By comparing the values in Figure 2, it can be clearly seen that the PSNR value obtained by processing the image after using the latter two sets of filters is significantly larger than that obtained by using the existing filter. The value of PSNR. Therefore, it can be concluded that the image is processed by the upsampling filter and the downsampling filter designed by the method of the present invention, and the high-resolution reconstruction effect can be remarkably improved.

Fig. 5 is a view showing an effect obtained by processing an image using a filter generated by the present invention. From the graphics, you can get a very clear view.

At this point, the introduction of the quantitative test results of the image is ended.

The qualitative test results obtained by processing the image using the up-and-down sampling filter generated by the present invention are described below with reference to specific embodiments.

Fig. 6a is a diagram of layer 0 intraframe coding of a moving object (Mobile). As shown in Figure 6a, layer 0 represents the core layer, the abscissa represents the resolution, and the value ranges from 500bps to 3000bps; the ordinate represents PSNR, and the larger the PSNR, the more ideal the test result is.

Four test curves are shown in Fig. 6a, which are the curves obtained by optimizing the luminance components in the inter-layer intratextural prediction using the downsampling filter and the upsampling filter. From top to bottom: — Filter— 3—7 Filter Set, Default JS VM Filter Set, our—Filter—5—7 Filter Set, and JVT-U 147—Filter— 5—7 Curves from the Filter Set, Default JSVM Filter The curves of the bank and JVT-U 147—Filter—5-7 filter bank are indicated by dashed lines.

Our_Filter—3-7 filter bank and our_Filter—5-7 filter bank are filter banks designed using the method of the present invention, Default JSVM filter bank and JVT-U 147—Filter— 5-7 The filter bank is an existing filter bank. As can be seen from Figure 6a, at the same resolution, the values of PSNR obtained using the Our-Filter-3-7 filter bank and our-Filter-7-7 filter bank are greater than those using Default JSVM filtering. The value of the PSNR obtained by the filter set and the JVT-U147-Filter- 5-7 filter bank, so it can be concluded that the filter generated by the technical solution of the present invention is more than the existing JS VM 6.3.1 filter. When processing an image, Can significantly improve the reconstruction of high resolution.

Figure 6b is a graph of layer 0 intraframe coding of the foreman.

Figure 6c is a graph of layer 0 intra-frame coding of a football.

Figure 6d is a graph of layer 0 intraframe coding of a bus.

Figure 6al is a graph obtained by layer 1 intra-frame coding of Mobile. The pattern shown in Fig. 6al is different from Fig. 6a only in that Fig. 6al is a graph obtained by intraframe coding layer 1. From top to bottom: using the “our—Filter—3-7 filter bank, the Default JSVM filter bank, our—Filter—5-7 filter bank, and the JVT-U 147—Filter—5-7 filter bank. The curve obtained by the test, the default JSVM filter bank and the curve of the JVT-U 147-Filter-5-7 filter bank are indicated by dashed lines.

Figure 6b 1 is a graph of layer 1 intra-frame coding of foreman.

Figure 6c 1 is a graph of layer 1 intraframe coding of football.

Figure 6dl is a graph of layer 1 intra-frame coding of the bus.

The conclusions drawn from Fig. 6b, Fig. 6c, Fig. 6d, Fig. 6bl, Fig. 6cl, Fig. 6dl are the same as those obtained from Fig. 6a, that is, the filter generated by the technical solution of the present invention is more conventional than

The JSVM6.3.1 filter can significantly improve the reconstruction of high-resolution images when processing images.

At this point, the introduction of the qualitative test results of the image is ended.

In the following embodiments, an apparatus and system for implementing spatial scalable video coding using the downsampling filter and upsampling filter generated by the embodiment shown in Fig. 2 are described.

FIG. 7 is a schematic structural diagram of an apparatus for implementing spatial scalable video coding by using a downsampling filter generated by the embodiment shown in FIG. As shown in FIG. 7, the apparatus includes: a downsampling filter, a time domain decomposition unit, a motion coding unit, and downsampling intra prediction and intra coding units.

The downsampling filter is configured to receive a video signal as an encoded input, and perform downsampling processing on the video signal to obtain a downsampled video sequence, and send the downsampled video sequence Send to the time domain decomposition unit.

The time domain decomposition unit receives the downsampled video sequence sent by the downsampling filter, decomposes the downsampled video sequence into I frames, P frames, and B frames, and sends the I frames to the downsampled intra prediction and intra coding units, The P frame and the B frame are sent to the motion coding unit.

The motion coding unit receives the P frame and the B frame transmitted by the time domain decomposition unit, and performs motion coding on the P frame and the B frame to obtain a motion prediction coded signal.

The downsampled intra prediction and intra coding unit receives the I frame, and performs intra prediction and intra coding on the I frame to obtain a downsampled predictive coded signal.

It should be noted that the downsampling filter used in this embodiment is to perform downsampling processing and upsampling processing on the video signal conforming to the Markov model to obtain a reconstructed signal, and then according to the bi-orthogonal wavelet theory with parameters and reconstruction. The energy of the signal, the wavelet filter parameter corresponding to the maximum energy of the reconstructed signal is calculated, and the generated downsampling filter is used. In this embodiment, the bi-orthogonal wavelet theory with parameters is a bi-orthogonal wavelet filter with parameters. Parameterization formula. It should be noted that the video signal conforming to the Markov model used to generate the downsampling filter and the video signal as the coded input may be the same signal or different signals. The video signal input as a code can be all video signals, and about 95% of all of these video signals are video signals conforming to the Markov model.

So far, the introduction of the embodiment shown in Fig. 7 is ended.

FIG. 8 is a schematic structural diagram of an apparatus for implementing spatial scalable video coding by using an upsampling filter generated by the embodiment shown in FIG. As shown in Figure 8, the apparatus includes: an upsampling filter and upsampled intra prediction and intra coding units.

The upsampling filter is configured to receive the downsampled intra prediction coding signal outputted by the downsampled intra prediction and the intra coding unit in FIG. 7, and perform upsampling processing on the received downsampled intra prediction coding signal, An upsampled video sequence is obtained, which is sent to the upsampled intra prediction and intra coding units. The upsampling intra prediction and intra coding unit is configured to receive an upsampled video sequence sent by the upsampling filter, perform intra prediction and intraframe coding on the received upsampled video sequence, to obtain an upsampled intra prediction encoded signal.

It should be noted that the upsampling filter used in this embodiment is to perform downsampling processing and upsampling processing on the video signal to obtain a reconstructed signal, and then calculate according to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal. The wavelet filter parameters corresponding to the energy maximum of the reconstructed signal, the generated upsampling filter, in this embodiment, the parameterized bi-orthogonal wavelet theory, that is, the parameterized formula of the parameterized bi-orthogonal wavelet filter. It should be noted that the video signal conforming to the Markov model used to generate the upsampling filter and the video signal used as the code input may be the same signal or different signals, which are generally not the same.

So far, the introduction of the embodiment shown in Fig. 8 is ended.

FIG. 9 is a schematic structural diagram of a system for realizing spatial scalable video coding by using a downsampling filter and an upsampling filter generated by the embodiment shown in FIG. As shown in FIG. 9, the system includes: a downsampling filter, a downsampling coding unit, an upsampling filter, upsampling intra prediction and intra coding units, and a multiplexing unit. The downsampling coding unit includes: a time domain decomposition unit, a motion coding unit, and a downsampling intra prediction and intra coding unit.

The downsampling filter is configured to receive a video signal as an encoded input, perform downsampling processing on the video signal, obtain a downsampled video sequence, and send the downsampled video sequence to a time domain decomposition unit of the downsampling coding unit.

a time domain decomposition unit, configured to receive a downsampled video sequence sent by the downsampling filter, decompose the received downsampled video sequence into I frames, P frames, and B frames, and send the I frames to the downsampled intra prediction and frame. The inner coding unit transmits the P frame and the B frame to the motion coding unit.

The motion coding unit is configured to receive the P frame and the B frame, perform motion coding on the received P frame and the B frame to obtain a motion coded signal, and send the motion prediction coded signal to the multiplexing unit.

Down-sampling intra-pre and intra-coded units for receiving I-frames, for incoming I-frames The intra-frame prediction and the intra-frame coding obtain a downsampled intra prediction and coding signal, and send the downsampled intra prediction coding signal to the upsampling filter and the multiplexing unit.

An upsampling filter, configured to receive the downsampled intra prediction coded signal, perform upsampling on the received downsampled intraframe predictive coded signal, obtain an upsampled video sequence, and send to the upsampled intraframe and intraframe coding unit.

An upsampled intra prediction and intra coding unit, configured to receive an upsampled video sequence sent by the upsampling filter, perform intra prediction and intraframe coding on the upsampled video sequence, to obtain an upsampled intra prediction coding signal, and The upsampled intra prediction encoded signal is transmitted to the multiplexing unit.

And a multiplexing unit, configured to receive the downsampled intra prediction encoded signal, the motion prediction encoded signal, and the upsampled intra prediction encoded signal, and perform synthesis processing on the received signal to obtain a video encoded signal.

It should be noted that the downsampling filter and the upsampling filter used in this implementation are down-sampling and up-sampling the video signal conforming to the Markov model to obtain a reconstructed signal, according to the bi-orthogonal wavelet theory with parameters. And the energy of the reconstructed signal, the d, the filter parameter corresponding to the maximum value of the energy, the generated downsampling filter and the upsampling filter, in this embodiment, the bi-orthogonal with parameters Wavelet theory is a parametric formula of a bi-orthogonal wavelet filter with parameters. It should be noted that the video signal conforming to the Markov model used to generate the downsampling filter and the upsampling filter may be the same signal or a different signal as the encoded input, and is generally different. signal.

In addition, the multiplexing unit mainly performs synthesis processing on the downsampled intra prediction encoded signal, the motion prediction encoded signal, and the upsampled intra prediction encoded signal to obtain a video encoded signal. If the spatial scalable video coding system does not synthesize these three signals, the multiplexing unit may not be included in this embodiment.

So far, the introduction of the embodiment shown in Fig. 9 is ended. As can be seen from the above embodiment, the up and down sampling filters appearing in FIGS. 2 to 6 are formulas, and the up and down sampling filters in FIGS. 7 to 9 are actual physical units.

Embodiments of the present invention have the following advantages:

First, the upsampling filter and the downsampling filter generated by the embodiment of the present invention are upper and lower sampling filters generated when the energy model is maximized, and are optimal for the energy model in ensuring the same filter length. The upsampling filter and the downsampling filter generated by the embodiment of the present invention are used for encoding processing of a video signal, which can reduce image energy loss, improve quality of encoding the video signal, minimize energy loss, and restore video quality. maximize.

Secondly, the bi-orthogonal wavelet theory with parameters is applied to the design of the upsampling filter and the downsampling filter, so that the designed upsampling filter and downsampling filter are related. In order to improve the reconstruction quality of the video signal, the reconstruction effect of the video signal under high resolution is optimized.

Finally, according to different video signal coding complexity requirements, the generated integer filter can be tailored to different lengths to generate an optimized integer filter, thereby generating the most trade-off between the operation speed and the video signal reconstruction performance. Optimized integer upsampling filters and optimized integer downsampling filters that meet actual needs.

It should be noted that the embodiments of the present invention may be implemented in a computer program language, or may be implemented by hardware components of a preset program, other related components, or a combination of hardware and software.

Moreover, the methods, apparatus, and systems shown in the embodiments of the present invention can be fabricated into a computer program product for use in a computer system. For example, it can be fabricated as a series of computer instructions that are solidified in actual media (CD, CD-ROM, ROM or hard disk), or media implemented using wireless technology. In conclusion, the above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

Claim

A method for generating an up-and-down sampling filter, comprising: down-sampling and up-sampling a video signal conforming to a Markov model to obtain a reconstructed signal;

Calculating the energy of the reconstructed signal;

The method according to claim 1, wherein the calculating the energy of the reconstructed signal comprises:

Substituting the reconstructed signal into an energy model, calculating the energy of the reconstructed signal, and obtaining an energy formula for reconstructing the signal.

The method according to claim 2, wherein the calculating the wavelet filter parameters corresponding to the maximum value of the energy of the reconstructed signal comprises:

The parameterized formula of the parameterized bi-orthogonal wavelet filter is substituted into the energy formula of the reconstructed signal, and the wavelet filter parameter corresponding to the maximum value of the energy of the reconstructed signal is calculated.

4. Method according to claim 2 or 3, characterized in that the energy model is: El = max{aE[e(W] + βΕ[ε(Ξ ₂ )] + /E[e(S ₃ )]};

Wherein, the energy of the video signal after performing the downsampling and the upsampling process, wherein the video signal before the downsampling and the upsampling process and the reconstructed signal are related energy, wherein the ^£[ 3]] is The energy of the video signal after the downsampling process; the α and β are positive integers greater than zero, and γ is a positive integer greater than or equal to zero.

The method according to claim 3, wherein the parametric formula of the parameterized bi-orthogonal wavelet filter comprises: a single parameter double orthogonal wavelet parameterization formula, or a double parameter A bi-orthogonal wavelet parameterization formula, or a multi-parameter bi-orthogonal wavelet parameterization formula, or a single-parameter and multi-parameter bi-orthogonal wavelet parameterization formula.

6. The method according to claim 1, further comprising: performing integer processing on the upsampling filter and the downsampling filter to generate an integer upsampling filter and an integer downsampling filter.

The method according to claim 6, further comprising: performing length reduction on the integer upsampling filter and the integer downsampling filter to generate an optimized integer upsampling filter and an optimized integer downsampling filter. .

The method according to claim 6, wherein the integer upsampling filter and the integer downsampling filter are: H7 = [-1 0 9 16 9 0 -1] /16 and H9=[ l -1 -4 9

22 9 -4 -1 1 ]/32;

Or, respectively: HH7=[-8 1 72 126 72 1 -8]/128 and HH13=[-1 0 18 -16 -65 144 352 144 -65 -16 18 0 -1]/512;

Or, respectively: H7 = [-5 0 21 32 21 0 -5]/32 and H3 = [17 30 17]/64. The method according to claim 7, wherein the length reduction of the integer upsampling filter and the integer downsampling filter comprises:

The small-valued values of the integer up-sampling filter and the integer down-sampling filter are omitted and added to the center value to generate an optimized integer upsampling filter and an optimized integer downsampling filter, respectively.

10. The method according to claim 9, wherein the generated optimized integer upsampling filter and optimized integer downsampling filter are: H7 = [-1 0 9 16 9 0 -1] /16 And H5=[-4 9 22 9 -4]/32.

11. A method for spatially scalable video coding using a downsampling filter, the method comprising:

Downsampling the video signal used for encoding using a downsampling filter Video sequence

12. The method according to claim 11, wherein the downsampling filter is used to downsample the video signal for encoding, and obtaining the downsampled video sequence comprises:

Performing convolution calculation of each pixel in the peer or interlaced line of the video signal for encoding in the vertical direction with the downsampling filter to obtain pixel values of each pixel; and the respective video sequences;

Or performing a convolution calculation in the horizontal direction of each pixel in the video signal or in the interlaced signal with the downsampling filter to obtain a pixel value of each pixel; and setting the pixel value of each pixel to the lower The sampling filter performs a convolution calculation in the vertical direction to obtain a downsampled video sequence.

The method according to claim 11, wherein the video signal for encoding and the video signal conforming to the Markov model are the same type of signal.

14. A method for spatially scalable video coding using an upsampling filter, the method comprising:

Upsampling the downsampled intra prediction encoded signal using an upsampling filter to obtain an upsampled video sequence; Performing intra prediction and intra coding on the upsampled video sequence to obtain an upsampled intra prediction encoded signal;

The method according to claim 14, wherein the upsampling the intra-predictive coded signal is upsampled using an upsampling filter, and the obtained upsampled video sequence comprises: a prediction and an inter-layer residual prediction. The 2D 2D spatial domain is upsampled to obtain an upsampled video sequence.

16. A device for spatially scalable video coding using a downsampling filter, the method comprising:

The downsampling filter is configured to perform downsampling processing and upsampling the video signal conforming to the Markov model to obtain a reconstructed signal, and calculate the reconstructed signal according to the parameter of the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal. Wavelet filter parameter corresponding to the maximum value of energy Number, generated downsampling filter.

17. An apparatus for spatially scalable video coding using an upsampling filter, the method comprising:

18. A system for spatially scalable video coding using a downsampling filter and an upsampling filter, comprising:

Upsampling intra prediction and intra coding unit, configured to receive the upsampled video sequence from the upsampling filter, perform intra prediction and intraframe coding on the upsampled video sequence, to obtain upsampled intra prediction Coded signal The downsampling filter and the upsampling filter are down-sampling and up-sampling the video signal conforming to the Markov model to obtain a reconstructed signal, according to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal, The wavelet filter parameters corresponding to the maximum value of the energy of the reconstructed signal, the generated downsampling filter and the upsampling filter.

The system according to claim 18, wherein the downsampling coding unit comprises:

a motion coding unit, configured to receive the P frame and the B frame from the time domain decomposition unit, and perform motion coding on the P frame and the B frame to obtain a motion prediction encoded signal;

The upsampling filter is further configured to receive the downsampled intra prediction encoded signal sent by the downsampled intra prediction and the intra coding unit.

20. The system of claim 19, further comprising: a multiplexing unit;

The downsampling intra prediction and intra coding unit is further configured to send the downsampled intra prediction encoded signal to a multiplexing unit;

The motion coding unit is further configured to send the motion prediction encoded signal to the multiplexing unit;

The upsampling intra prediction and intra coding unit is further configured to send the upsampled intra prediction encoded signal to a multiplexing unit;

The multiplexing unit is configured to receive the downsampled intra prediction encoded signal, the motion prediction encoded signal, and the upsampled intra prediction encoded signal, and perform synthesis processing on the received signal, The video encoded signal is obtained.

An apparatus for generating an up-and-down sampling filter, comprising: means for down-sampling and up-sampling a video signal conforming to a Markov model to obtain a unit for reconstructing a signal;

Means for calculating the energy of the reconstructed signal; and

The wavelet filter parameters corresponding to the maximum value of the energy of the reconstructed signal are calculated according to the bi-orthogonal wavelet theory with parameters and the energy of the reconstructed signal, and the units of the upsampling filter and the downsampling filter are generated.

22. The apparatus according to claim 21, further comprising: performing integer processing on the upsampling filter and the downsampling filter to generate a unit of an integer upsampling filter and an integer downsampling filter.

The apparatus according to claim 22, further comprising: performing length reduction on the integer upsampling filter and the integer downsampling filter to generate an optimized integer upsampling filter and an optimized integer downsampling filter Unit.