WO2019080136A1

WO2019080136A1 - Video encoding and decoding method and device

Info

Publication number: WO2019080136A1
Application number: PCT/CN2017/108159
Authority: WO
Inventors: 王力强; 余全合; 陈军佑; 郑建铧; 何芸
Original assignee: 华为技术有限公司; 清华大学
Priority date: 2017-10-28
Filing date: 2017-10-28
Publication date: 2019-05-02

Abstract

Disclosed in the present invention is a video encoding and decoding method, comprising: dividing a source video into M first video segments and then dividing each first video segment into T second video segments; performing parallel encoding of the T second video segments of each first video segment to obtain M*T second code stream data; and integrating the M*T second code stream data into M first code stream data, and integrating the source video sequence header, M first code stream data, and sequence stop code into a source video code stream. Equally dividing the source video code stream into M first code stream data and expanding each first code stream data into T second code stream data; performing parallel decoding of the T second code stream data of each first code stream data to obtain M*T second video segments; and splicing the M*T second video segments to obtain the source video. Also disclosed in the present invention is a video encoding and decoding device. The present invention improves video encoding and decoding efficiency.

Description

Video codec method and device

Technical field

The present application relates to the field of video coding and decoding, and in particular, to a video coding and decoding method and device.

Background technique

At present, with the increasing demand for visual enjoyment, the resolution of video display devices is getting higher and higher, and the complexity of video decoding standard implementation is also increasing rapidly, which makes it necessary to encode and decode especially large-resolution video. The time has increased greatly.

In order to improve the efficiency of the video codec, the prior art specifically divides each frame of the source video into blocks, obtains multiple image blocks, and then simultaneously encodes and decodes multiple image blocks in one frame of image. However, in the implementation of the prior art, the data amount of one frame of image is large, the video encoding and decoding efficiency is low, and the applicability is poor.

Summary of the invention

The embodiment of the invention discloses a video encoding and decoding method and device, which improves the efficiency of video encoding and decoding and has wide applicability.

In a first aspect, an embodiment of the present invention provides a video encoding method, including:

The video encoding device divides the source video into M first video segments, each of the M first video segments is composed of N frames of the first image, and the N frames of the first image are consecutive frame images. , wherein M and N are integers greater than one;

The video encoding device divides each of the M first video segments into T second video segments to obtain M*T second video segments, where any of the second videos The segment includes an N-frame second image, the resolution of the second image is less than a resolution of the first image, and the T is an integer greater than one;

The video encoding device performs parallel encoding on the T second video segments in each of the M first video segments to obtain M*T second code stream data;

The video encoding device integrates the M*T second code stream data to obtain a code stream of the source video.

In a possible embodiment, the video encoding device divides each of the M first video segments into T second video segments, including:

The video encoding device performs the following operations on the first video segment i of the M first video segments:

Decoding a first image of each frame of the N frames of the first video segment i into a second image of the T frame according to a preset resolution, and numbering the second image of the T frame to obtain N *T frame second image, wherein the resolution of any second image is less than or equal to the preset resolution, and the position of the first image of each frame of the N image of the first video segment i corresponds to The second image has the same number;

Combining N frames of second images with the same number in the second image of the N*T frame to obtain T second video segments;

The first video segment i is any one of the M first video segments.

In a possible embodiment, the video encoding device performs parallel encoding on the T second video segments in each of the M first video segments, including:

The video encoding device performs the following operations on the first video segment i:

Obtaining an encoding priority corresponding to each of the T second video segments of the first video segment i;

And encoding, according to the coding priority corresponding to the T second video segments in the first video segment i, the T second video segments of the first video segment i to obtain T second code stream data.

In a possible embodiment, before the video encoding device performs parallel encoding on the T second video segments in each of the M first video segments, the method further includes:

The video encoding device generates a sequence header of a code stream of the source video according to the encoding configuration information.

In a possible embodiment, the video encoding device integrates the M*T code stream data to obtain a code stream of the source video, including:

The video encoding device integrates T second code stream data of each of the M first video segments to obtain M first code stream data, where a first video segment is Integrating T pieces of second stream data to obtain a first stream data;

The video encoding device integrates the sequence header, the M first code stream data, and a sequence termination code into a code stream of the source video.

In a possible embodiment, any second code stream data includes a set of image headers and a set of image data, and the video encoding device will each of the first of the M first video segments The T second code stream data of the segment is integrated to obtain M first code stream data, including:

Obtaining an encoding priority of each second code stream data of the corresponding T second code stream data of the first video segment i, the encoding priority of the second code stream data and the corresponding second video segment thereof The coding priority is consistent;

Determining, according to an encoding priority of each second code stream data of the T second code stream data corresponding to the first video segment i, each of the T second code stream data corresponding to the first video segment i An order of integration of image data of the second code stream data; wherein, the higher the coding priority of the second code stream data, the higher the integration order of the image data of the second code stream data;

And according to the integration order of the image data of each of the T second code stream data corresponding to the first video segment i, the T second code stream data corresponding to the first video segment i Image data is integrated into image data of a first code stream data, and a set of image headers of any of the second code stream data corresponding to the first video segment i and the second video stream data The image data of the first code stream data integrates one of the first code stream data, wherein each of the first code stream data includes a set of the image header and T group image data, and the T second codes The T second video segments corresponding to the stream data belong to the same first video segment.

In a possible embodiment, after the video encoding device generates a sequence header of the code stream of the source video according to the configuration information, the method further includes:

The video encoding apparatus adds, in the sequence header, a first syntax element for indicating the preset resolution and a number of frames N for indicating the first image included in the first video segment. Two syntax elements.

In a second aspect, an embodiment of the present invention further provides a video decoding method, including:

The video decoding device acquires code stream data of the source video from a code stream of the source video, where the code stream data of the original video is a code stream of the original video that does not include a sequence header and a sequence termination code;

The video decoding device divides the code stream data of the source video into M first code stream data, and the Each first code stream data of the M first code stream data is expanded into T second code stream data to obtain M*T second code stream data;

The video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data to obtain M*T second video segments;

The video decoding device splices the M*T second video segments to obtain the source video.

In a possible embodiment, before the video decoding device divides the code stream data of the source video into M pieces of the first code stream data, the method further includes:

The video decoding device acquires a sequence header from a code stream of the source video;

The video decoding device acquires the number T of the first code stream data that can be expanded into the second code stream data according to the resolution of the source video and the preset resolution indicated by the first syntax element in the sequence header.

In a possible embodiment, each of the first code stream data includes a set of image headers and T sets of image data, and each of the first streams of the M first code stream data The data is expanded into T second stream data, including:

The video decoding device copies a set of image headers of the first code stream data i of the M first code stream data to obtain a T group image header;

The video decoding device expands to obtain T second data code streams according to the T group image header and the T group image data of the first code stream data i;

The video decoding device acquires T second code stream data corresponding to each first code stream data of the M first code stream data to obtain M*T second code stream data;

The second code stream data includes a set of image headers and a set of image data, and the first code stream data i is any one of the M first code stream data.

In a possible implementation, the video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data, including:

The video encoding device performs the following operations on the first code stream data i of the M first code stream data:

Obtaining a decoding priority corresponding to each second code stream data of the T second code stream data of the first code stream data i;

Decoding the T second code stream data of the first code stream data i in parallel according to a decoding priority corresponding to the T second code stream data of the first code stream data i, to obtain T second Video clip

The first code stream data i is any one of the M first code stream data.

In a possible implementation, before the video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first code stream data, the method Also includes:

The video decoding device culls the first syntax element and the second syntax element in the sequence header, and the second syntax element is used to indicate a frame number N of a second image included in the second video segment.

In a possible embodiment, any second video segment includes an N-frame second image, and the video decoding device splices the M*T second video segments to obtain the source video, including:

The video decoding device, in the second image of the N*T frames in the T second video segments corresponding to each of the M first stream data, each T frame of the same image header The second images are stitched together to obtain M first video segments, each of the first video segments includes an N-frame first image, and the resolution of the first image is greater than the first image The resolution of the two images;

The video decoding device splices the M first video segments to obtain the source video.

In a third aspect, an embodiment of the present invention provides a video encoding device, including:

a first dividing unit, configured to divide the source video into M first video segments, each of the M first video segments being composed of N frames of the first image, the N frames of the first image For consecutive frame images, the M and N are integers greater than one;

a second dividing unit, configured to divide each of the M first video segments into T second video segments to obtain M*T second video segments, where any of the foregoing The second video segment includes an N-frame second image, the resolution of the second image is less than a resolution of the first image, and the T is an integer greater than one;

a coding unit, configured to perform parallel coding on the T second video segments in each of the M first video segments to obtain M*T second code stream data;

And an integration unit, configured to integrate the M*T second code stream data to obtain a code stream of the source video.

In a possible embodiment, the second dividing unit is specifically configured to:

Performing the following operations on the first video segment i of the M first video segments:

The first video segment i is any one of the M first video segments.

In a possible embodiment, the coding unit is specifically configured to:

Performing the following operations on the first video segment i:

In a possible embodiment, the video encoding device further includes:

a generating unit, configured to generate a sequence header of the source video code stream according to the encoding configuration information, before performing parallel encoding on the T second video segments in each of the M first video segments .

In a possible embodiment, the integration unit comprises:

a first integration subunit, configured to integrate T second code stream data of each of the M first video segments to obtain M first code stream data, where Integrating T pieces of second stream data of the video segment to obtain a first stream data;

And a second integration subunit, configured to integrate the sequence header, the M first code stream data, and the sequence termination code into a code stream of the source video.

In a possible embodiment, any of the second code stream data includes a set of image headers and a set of image data, and the first integration unit is specifically configured to:

Performing the following operations on the first video segment i:

In a possible embodiment, the video encoding device further includes:

Adding a unit, after generating a sequence header of the source video code stream according to the encoding configuration information, adding a first syntax element for indicating the preset resolution and indicating the location in the sequence header a second syntax element of the number N of frames of the first image included in the first video segment.

In a fourth aspect, an embodiment of the present invention provides:

a first acquiring unit, configured to acquire code stream data of the source video from a code stream of the source video, where the code stream data of the original video is a code stream of the original video that does not include a sequence header and a sequence termination code;

a dividing unit, configured to divide the code stream data of the source video into M first code stream data, and expand each first code stream data of the M first code stream data into T second Code stream data to obtain M*T second code stream data;

a decoding unit, configured to perform parallel decoding on the T second code stream data corresponding to each of the M first code stream data to obtain M*T second video segments;

And an integration unit, configured to integrate the M*T second video segments to obtain the source video.

In a possible embodiment, the video decoding device further includes:

a second acquiring unit, configured to acquire a sequence header in a code stream of the source video before the code stream data of the source video is equally divided into M first code stream data;

a third acquiring unit, configured to acquire, according to a resolution of the source video and a preset resolution indicated by the first syntax element in the sequence header, the number of the first code stream data that can be expanded into the second code stream data T.

In a possible embodiment, each of the first code stream data includes a set of image headers and T sets of image data, and the dividing unit comprises:

a copying subunit, configured to copy a set of image headers of the first code stream data i of the M first code stream data to obtain a T group image header;

An extension subunit, configured to expand, according to the T group image header and the T group image data of the first code stream data i, to obtain T second data code streams;

a first acquiring sub-unit, configured to acquire T second code stream data corresponding to each first code stream data of the M first code stream data, to obtain M*T second code stream data;

In a possible embodiment, the decoding unit is specifically configured to:

Performing the following operations on the first code stream data i of the M first code stream data:

The first code stream data i is any one of the M first code stream data.

In a possible embodiment, the video decoding device further includes:

a culling unit, configured to cull the first one of the sequence headers before performing parallel decoding on the T second code stream data corresponding to each of the M first code stream data And a second syntax element, the second syntax element is used to indicate the number N of frames of the second image included in the second video segment.

In a possible embodiment, any second video segment includes an N-frame second image, and the splicing unit includes:

a first splicing subunit, configured to: in the second image of the N*T frames in the T second video segments corresponding to each of the M first code stream data, the image header is the same The second image is spliced together every T frame to obtain M first video segments, each of the M first video segments includes an N frame first image, and the resolution of the first image is greater than The resolution of the second image;

a second splicing subunit, configured to splicing the M first video segments to obtain the source video.

In a fifth aspect, an embodiment of the present invention provides a video encoding device, including:

a memory storing executable program code;

a processor coupled to the;

The processor invokes the executable program code stored in the memory to perform some or all of the steps as described in the first aspect of the embodiments of the present invention.

In a sixth aspect, an embodiment of the present invention provides a video decoding device, including:

a memory storing executable program code;

a processor coupled to the;

The processor invokes the executable program code stored in the memory to perform some or all of the steps as described in the second aspect of the embodiments of the present invention.

It can be seen that, in the solution of the embodiment of the present invention, the video encoding device divides the source video into M first video segments, and then divides each of the M first video segments into T first segments. Two video clips. The video encoding device performs parallel encoding on the T second video segments of each of the first video segments to obtain M*T second code stream data; and the video encoding device integrates the M*T second code streams data. The M first stream data is then integrated into the sequence of the source video, the M first stream data, and the sequence termination code into a stream of the source video. The video decoding device divides the code stream data of the source video into M first code stream data, and then expands each first code stream data of the M first code stream data into T second code stream data. The video decoding device performs parallel decoding on the T second code stream data of each of the first code stream data to obtain M*T second video segments, and then splices the M*T second video segments to obtain a source video. Compared with the prior art, the present invention performs parallel encoding and decoding on multiple sub-video segments of a video segment, which improves the efficiency of video encoding and decoding; and after decoding multiple sub-videos of the video segment, the video can be directly displayed. Fragments that improve the user experience.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a schematic diagram of a frame of a video codec according to an embodiment of the present invention;

2 is a schematic flowchart of a video encoding method according to an embodiment of the present invention;

3 is a schematic diagram of a first image division of a frame;

FIG. 4 is a schematic diagram of a format of a first code stream data corresponding to a first video segment according to an embodiment of the present disclosure;

FIG. 5 is a schematic diagram of a format of another first stream data corresponding to a first video segment according to an embodiment of the present disclosure;

FIG. 6 is a schematic flowchart diagram of a video encoding and decoding method according to an embodiment of the present disclosure;

7 is a schematic diagram of another first frame division of one frame;

FIG. 8 is a schematic flowchart of a video encoding and decoding method according to an embodiment of the present disclosure;

FIG. 9 is a schematic structural diagram of a video encoding apparatus according to an embodiment of the present disclosure;

FIG. 10 is a schematic structural diagram of a part of a video encoding apparatus according to an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram of a video decoding device according to an embodiment of the present disclosure;

FIG. 12 is a schematic structural diagram of a partial structure of a video decoding device according to an embodiment of the present disclosure;

FIG. 13 is a schematic structural diagram of another video decoding device according to an embodiment of the present disclosure;

FIG. 14 is a schematic structural diagram of another video encoding apparatus according to an embodiment of the present disclosure;

FIG. 15 is a schematic structural diagram of another video decoding device according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described in the following with reference to the accompanying drawings.

Referring to FIG. 1, FIG. 1 is a schematic diagram of a frame of a video codec according to an embodiment of the present invention. As shown in FIG. 1, the video codec architecture includes a video encoding device 101 and a video decoding device 102.

After acquiring the source video, the video encoding device 101 encodes the source video to obtain a code stream of the source video. The video encoding device 101 transmits the code stream of the source video to the video decoding device 102, and the video decoding device 102 decodes the code stream of the source video to obtain a source video, and outputs the source video.

It should be noted that the above video encoding device and video decoding device may be integrated in the same device, and may be integrated into two different devices. Among them, the above two different devices can be produced by different manufacturers, or can be produced by the same manufacturer.

Referring to FIG. 2, FIG. 2 is a schematic flowchart diagram of a video encoding method according to an embodiment of the present invention. As shown in Figure 2, the method includes:

S201. The video encoding device divides the source video into M first video segments.

Each of the M first video segments is composed of N frames of the first image, and the N frames of the first image are consecutive frame images, and the M and N are integers greater than 1.

It should be noted that the above source video is composed of the first image of the M*N frame, and the resolution of the first image of the M*N frame is W*H. The resolution of the above source video can be regarded as W*H.

S202. The video encoding device divides each of the M first video segments into T second video segments to obtain M*T second video segments.

Wherein any of the second video segments comprises an N-frame second image, the resolution of the second image is less than a resolution of the first image, and the T is an integer greater than 1.

The video encoding device divides each of the M first video segments into T second video segments, including:

The first video segment i is any one of the M first video segments.

Specifically, the video encoding device divides each frame of the first image of the N frames of the first video segment i into a second image of the T frame according to the same division order and preset resolution. When the above preset resolution is w*h, the above T=([W/w]+1)*([H/h]+1). The video encoding device numbers the second image of the T frame of the first image of each frame of the first video segment i according to the above-mentioned dividing order, so that the first image of each frame of the first image of the N frames of the first video segment i The encoding of the second image corresponding to the middle position is the same. The video encoding apparatus acquires the second image of the T frame obtained by dividing the first image of each frame of the first frame of the N frames of the first video segment i to obtain the second image of the N*T frame. The encoding device combines the second images of the N frames having the same number in the second image of the N*T frame to obtain T second video segments.

Wherein, the above W is greater than or equal to the above w, and the above H is greater than or equal to the above h.

It should be noted that each second video segment of the T second video segments is composed of N frames of second images, and the resolution of the second image is less than or equal to the preset resolution.

Wherein, the preset resolution is a multiple of 4.

For example, it is assumed that the first video segment i includes five frames of the first image, and the resolution of the first image of each frame is 416*240, and the preset resolution is 128*128. The video encoding apparatus divides the first image of each frame of the first image with the resolution of 416*240 of the above five frames into 6 frames of the second image according to the preset resolution and the same division order, and the 6 frames The second image includes a second image with a resolution of 128*128 for 2 frames, a second image with a resolution of 128*112 for both frames, a second image with a resolution of 128*64 for 1 frame, and a resolution of 112 for 1 frame. *64 second image. Referring to FIG. 3, FIG. 3 is a schematic diagram of a first image division of a frame. As shown in a diagram of FIG. 3, the video encoding apparatus divides a frame of the first image into a 6-frame second image from left to right and from top to bottom according to a preset resolution, and follows from left to right. The numbers are sequentially numbered from top to bottom; as shown in the figure b in FIG. 3, the video encoding device divides the first image of one frame into a second image of 6 frames from right to left and from top to bottom according to a preset resolution. And numbered from right to left and from top to bottom; as shown in c in FIG. 3, the above video encoding device takes a frame of the first image according to a preset resolution, from left to right, from bottom to top. Divided into 6 frames of the second image, and numbered from left to right, from bottom to top; as shown in the figure d in Figure 3, the above video encoding device will first frame a frame according to a preset resolution, from the left To the right, the second image is divided into 6 frames from top to bottom, and is numbered sequentially from right to left and from bottom to top.

It can be seen that the order of division shown in the a diagram, the b diagram, the c diagram and the d diagram in FIG. 3 is from left to right, from top to bottom; from right to left, from top to bottom; from left to right, From bottom to top; from left to right, from top to bottom.

The above encoding apparatus may divide the first image of each frame of the above five frames of the first image into six frames of the second image according to the method shown in FIG. 3, and divide the first image of each frame into six according to the method shown in FIG. The second image of the frame is numbered to obtain 30 frames of the second image. The video encoding device combines the images of every 5 frames of the same number in the 30 frames of the second image to obtain 6 second video segments.

The above six second video segments include two video segments with a resolution of 128*128, two video segments with a resolution of 128*112, one video segment with a resolution of 128*64, and one resolution of 112. *64 video clips.

The video encoding device obtains T second video segments corresponding to each of the M first video segments according to the foregoing method, to obtain M*T second video segments.

S203. The video encoding device performs parallel coding on the T second video segments in each of the M first video segments to obtain M*T second code stream data.

Before the video encoding device performs parallel encoding on the T second video segments in each of the M first video segments, the method further includes:

The video encoding device generates a sequence header of the source video code stream according to the encoding configuration information.

Specifically, the foregoing coding configuration information includes a path, a width, a height, a sampling precision, an output stream name, a motion search mode, a motion search range, a maximum number of reference frames, and a quantization parameter of the video sequence to be encoded. And information such as coding tools.

The video encoding device performs parallel encoding on the T second video segments in each of the M first video segments, including:

Obtaining an encoding priority corresponding to each of the T second video segments of the first video segment i.

Specifically, the video encoding apparatus determines, according to a division order in which the first image of each frame in the first video segment i is divided into the second image of the T frame, the coding priority of the second video segment composed of the second image of the N frames; The higher the division order of the N frames second image of any second video segment i, the higher the coding priority of the second video segment i.

For example, assume that the first video segment i described above includes five frames of the first image. The video encoding device divides the first image of each frame of the first video segment i into 6 frames of the second image according to the method shown in FIG. 3, and 6 frames corresponding to the first image of each frame of the first video segment i The second image is numbered. The above video encoding apparatus combines five frames of images of the same number to obtain six second video segments. The encoding priority of the 6 second video segments, the second video segment consisting of the 5 frames second image numbered 1 having the highest encoding priority; the second video segment consisting of the 5 frames second image numbered 6 The encoding has the lowest priority.

According to the above method, the video encoding device acquires the coding priority corresponding to the T second video segments of the first video segment i.

Further, after acquiring the coding priority corresponding to the T second video segments of the first video segment i, the video encoding device according to the coding priority corresponding to the T second video segments of the first video segment i Parallel encoding of T second video segments of the first video segment.

Specifically, the video segment encoding apparatus includes S sub-video segment encoding modules, and S is an integer greater than 1. When the S is greater than T, that is, the number S of the sub video coding modules is greater than the number T of the second video segments included in the first video segment i, any T sub video coding devices in the S sub video coding modules are The T second video segments are coded in parallel to obtain T second code stream data without encoding according to the coding priorities of the T second video segments to obtain T second code stream data. When the S is smaller than the T, that is, the number S of the sub video encoding modules of the video encoding device is smaller than the number T of the second video segments included in the first video segment i, the S sub video encoding modules firstly parallel the video segments. Among the T second video segments of i, the S second video segments with higher priority are encoded for parallel encoding. After the encoding of the second video segment is completed by any one of the S sub-video encoding modules, the sub-video encoding module encodes a second video with a higher priority among the sub-video segments that are not encoded in the T sub-video segments. The fragment is encoded. By analogy, the S sub-video encoding devices complete encoding the first video segment i to obtain T second code stream data.

The video encoding device encodes the T sub-video segments by using a preset encoding mode.

Optionally, the foregoing preset coding mode may be an All Intra (AI) mode, a Low Delay (LD) mode, a Random Access (RA) mode, or another coding mode.

The S sub-video encoding modules of the video encoding device may be S computers in a computer group; may also be S-core processors in a multi-core processor; or may be S threads in multiple threads; Any combination of the above computer clusters, multi-core processors, multi-threading, and other video encoding hardware modules.

For example, it is assumed that the video encoding device has six sub video encoding modules, and the video encoding device divides the first video segment i into ten second video segments, which are respectively the second video segments B1, B2, B3, B4, and B5. B6, B7, B8, B9, and B10, and the coding priorities of the 10 second video segments are sequentially lowered. Based on the coding priorities of the 10 sub video segments, the six sub video coding modules first perform parallel coding on the sub video segments B1, B2, B3, B4, B5, and B6, respectively. After the encoding of a first video segment is performed by any one of the six sub video encoding modules, the sub video encoding module compares the encoding priorities of the second video segments B7, B8, B9, and B10. The high second video segment is encoded. According to the above method, and so on, until the encoding of the above 10 second video segments is completed, to obtain 10 second code stream data.

According to the above method, the video encoding device acquires second code stream data of T second video segments of each of the M first video segments to obtain M*T second code stream data.

S204. The video encoding device integrates the M*T second code stream data to obtain a code stream of the source video.

The second code stream data includes a set of image headers and a set of image data; the video encoding device integrates the M*T code stream data to obtain a code stream of the source video, including :

The video encoding device integrates the sequence header, the M first code stream data, and a sequence termination code into the source The stream of video.

Further, any second code stream data includes a set of image headers and a set of image data, and the video encoding device sets T second of each of the M first video segments The code stream data is integrated to obtain M first code stream data, including:

It should be noted that the above set of image headers includes N image headers, and the set of image data includes N image data.

Optionally, the format of the first code stream data corresponding to the first video segment j may be:

H ₁ (D ₁₁ D ₁₂ D ₁₃ ... D _1T-1 D _1T )...H _k (D _k1 D _k2 D _k3 ... D _kT-1 D _kT )...H _N (D _N1 D _N2 D _N3 ... D _NT-1 D _NT )

Or for:

H ₁ H ₂ ... H _N (D ₁₁ D ₂₁ D ₃₁ ... D _N-11 D _N1 ) (D _1k D _2k D _3k ... D _N-1k D _Nk ) (D _1T D _2T D _3T ... D _{N- 1T} D _NT )

Wherein, H ₁ , H ₂ , . . . , H _N are respectively image headers of the first image of N frames in the first video segment j, and the D _k1 D _k2 D _k3 ... D _kT-1 D _kT are respectively the first image The image data of the second image of the T frame corresponding to the first image of the kth frame in the video segment j, the above D _1k D _2k D _3k ... D _N-1k D _Nk are respectively the kth second video in the first video segment j Image data corresponding to the N image of the second image of the segment.

For example, it is assumed that the first video segment has three frames of the first image, respectively labeled 1, 2, and 3, and the first video segment is divided into two second video segments, which are I and II, respectively. The video encoding device encodes the first video segment to obtain image data corresponding to three image headers and six second images. The video encoding device integrates the image data corresponding to the three image headers and the six second images into one first code stream data. The format of the first code stream data is: H1(I1II1)H2(I2II2)H3(I3II3), as shown in FIG. The format of the first code stream data may also be: H1H2H3 (I1I2I3) (II1II2II3), as shown in FIG. 5. The H1, H2, and H3 are image headers of the first frame of the three frames, and the image data I1 and II1 are image data of two frames of the second image of the first frame of the first video segment, respectively. The image data I2 and II2 are image data of two frames of the second image of the first image of the second frame in the first video segment, and the image data I3 and II3 are respectively the first image of the third frame of the first video segment. The image data of the second image of the two frames.

It should be noted that, after the video encoding device performs encoding on the second image of the foregoing frame, an image header and an image data are obtained; and the video encoding device performs encoding on the second video segment to obtain a group of images. A header and a set of image data, a set of image headers comprising N image headers, and a set of image data comprising N image data. After the video encoding device finishes encoding a first video segment, the T group image header and the T group image data are obtained. Since the image headers of the second image of the T frame belonging to the first image of the same frame are the same, the video encoding device retains only one set of image headers, and the code stream data corresponding to the first video segment includes a set of image headers and T Group image data.

Specifically, the video encoding device determines, according to the coding priority corresponding to the T second video segments of any of the first video segments i, the second code stream data corresponding to the T second video segments of the first video segment i. Integrating the image data in the order of integration, and integrating the image data in the second code stream data corresponding to the T second video segments of the first video segment i according to the integration sequence, to obtain the corresponding first video segment i Image data of the first code stream data; then, the first code corresponding to the first video segment i of any one of the second code stream data corresponding to the T second video segments of the first video segment The image data of the stream data is integrated to obtain the first stream data of the first video segment i;

The video encoding device obtains the first code stream data obtained by integrating the second code stream data of each of the first video segments of the M first video segments according to the foregoing method, to obtain M first code stream data. The video encoding apparatus integrates the M first code stream data into the code stream data of the source video according to the division order of the M first video segments. The video encoding device integrates the code stream data, the sequence header and the sequence termination code of the source video into the code stream of the source video.

The code stream format of the above original video is as follows:

S1H ₁₁ H ₁₂ ... H _1N (D ¹ ₁₁ D ¹ ₁₂ ... D ¹ _1N ) (D ^m ₁₁ D ^m ₁₂ ... D ^m _1N ) (D ^T ₁₁ D ^T ₁₂ ... D ^T _1N ) H ₂₁ H ₂₂ ... H _2N (D ¹ ₂₁ D ¹ ₂₂ ... D ¹ _2N ) (D ^m ₂₁ D ^m ₂₂ ... D ^m _2N ) (D ^T ₂₁ D ^T ₂₂ ... D ^T _2N )...H _n1 H _n2 ... H _nN (D ¹ _n1 D ¹ _n2 ... D ¹ _nN ) (D ^m _n1 D ^m _n2 ... D ^m _nN ) (D ^T _n1 D ^T _n2 ... D ^T _nN )...H _M1 H _M2 ... H _MN (D ¹ _M1 D ¹ _M2 ... D ¹ _MN )...(D ^m _M1 D ^m _M2 ... D ^m _MN )...(D ^T _M1 D ^T _M2 ... D ^T _MN )S2

The S1 is a sequence header of the source video, and the S2 is a sequence termination code of the source video; and the H ₁₁ H ₁₂ ... H _1N are respectively N frames in the first first video segment of the source video. The image header of the image, the above D ^m ₁₁ D ^m ₁₂ ... D ^m _1N are respectively the image data of the N image of the second image of the first first video segment of the source video, which is numbered m; the above H ₂₁ H ₂₂ ... H _2N is an image header of an N-frame first image in the second first video segment of the source video, and the D ^m ₂₁ D ^m ₂₂ ... D ^m _2N are respectively the second first video segment of the source video. The image data of the second image of the N frames of the number m; the H _n1 H _n2 ... H _nN are the first image headers of the N frames of the nth video segment of the source video, respectively, the D ^m _n1 D ^m _n2 ... D ^m _nN are respectively image data of an N-frame second image numbered m in the nth video segment of the source video; the above H _M1 H _M2 ... H _MN are respectively the Mth video of the source video first image segment of the first image frame N, the above-described ^{_{^{_{D m M1 D m M2 ... D}}}} m MN respectively above the m video source video The image data of the second image segment of N frames numbered m; m is greater than the above 0 and less than or equal to the integer T, the number n is greater than 0 and less than or equal to the integer M.

Optionally, after the video encoding device generates the sequence header of the source video code stream according to the configuration information, the method further includes:

For example, when the value indicated by the first syntax element is 0, the preset resolution is 64*64; when the value indicated by the first syntax element is 1, the preset resolution is 128*. 128; the first syntax element above When the value of the indication is 2, the above preset resolution is 256*256.

It should be noted that the first syntax element and the second syntax element are both bit data.

It can be seen that, in the solution of the embodiment of the present invention, the video encoding device divides the source video into M first video segments, and then divides each of the M first video segments into T segments. The second video clip. The video encoding device performs parallel encoding on the T second video segments of each of the first video segments to obtain M*T second code stream data; and the video encoding device integrates the M*T second code streams data. The M first stream data is then integrated into the sequence of the source video, the M first stream data, and the sequence termination code into a stream of the source video. Compared with the prior art, the present invention performs parallel coding on multiple second video segments of one video segment, which improves the efficiency of video coding and improves the user experience.

Referring to FIG. 6, FIG. 6 is a schematic flowchart diagram of a video decoding method according to an embodiment of the present invention. As shown in FIG. 6, the method includes:

S601. The video decoding device acquires code stream data of the source video from a code stream of the source video.

The code stream data of the original video is a code stream of the original video that does not include a sequence header and a sequence termination code.

S602. The video decoding device divides the code stream data of the source video into M first code stream data, and expands each first code stream data of the M first code stream data into T The second code stream data is obtained to obtain M*T second code stream data.

The method further includes: before the video decoding device divides the code stream data of the source video into the M first code stream data, the method further includes:

Specifically, the resolution of the source video is W*H, and the preset resolution is w*h, and the first code stream data can be expanded into the number of second code stream data T=([W/w]+ 1) *([H/h]+1), where W is greater than or equal to w, and H is greater than or equal to h.

It should be noted that the above first syntax element is a number of bit data.

Each of the first code stream data includes a set of image headers and T sets of image data, and the first code stream data of the M first code stream data is expanded to T seconds. Code stream data, including:

The video decoding device acquires T second code stream data corresponding to each first code stream data of the M first code stream data, to obtain M*T second code stream data,

Specifically, the video decoding device divides the code stream data of the source video into M first code stream data. Each of the M first stream data includes a set of image headers and T sets of image data. Above video The decoding device copies a set of image headers in any of the first code stream data i to obtain a T group image header, and then the T group image header and the T group image in the first code stream data i The data is expanded to obtain T second code stream data, and each second code stream data includes a set of image headers and a set of image data.

According to the above method, the video decoding device acquires T second code stream data corresponding to each first code stream data of the M first code stream data to obtain M*T second code stream data.

S603. The video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first code stream data to obtain M*T second video segments.

Before the video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data, the method further includes:

The video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data, including:

The first code stream data i is any one of the M first code stream data.

Further, after the video decoding device determines the corresponding decoding priority of the T second code stream data corresponding to the first code stream data i, the video decoding device performs T seconds corresponding to the first code stream data i. The corresponding decoding priority of the code stream data performs parallel decoding on the T second code stream data corresponding to the first code stream data i.

Specifically, the video decoding device includes S sub-video decoding modules, and S is an integer greater than 0. When the S is greater than T, the T sub video decoding devices of the S sub video decoding modules perform parallel decoding on the T second code stream data corresponding to the first video stream data i to obtain T second video segments. When the S is smaller than the T, the S sub-video decoding module first performs parallel decoding on the S second code stream data corresponding to the first video stream data i, and decoding the S second code stream data with higher priority. Parallel decoding. After the sub-video decoding module of the S sub-video decoding module completes decoding the second code stream data, the sub-video decoding module performs the second code stream data that is not decoded in the T second code stream data. And decoding a second code stream data with a higher priority for decoding. And so on, after the S sub-video decoding devices complete the T second code stream data corresponding to the first video stream data i, obtain T second video segments.

The S sub-video decoding modules of the video decoding device may be S computers in a computer group; may also be S-core processors in a multi-core processor; or may be S threads in multiple threads; Any combination of the above computer clusters, multi-core processors, multi-threading, and video decoding hardware modules.

According to the above method, the video decoding device acquires corresponding T second video segments of each of the M first code stream data to obtain M*T second video segments.

S604. The video decoding device splices the M*T second video segments to obtain the source video.

The second video segment includes an N-frame second image, and the video decoding device splices the M*T second video segments to obtain the source video, including:

Specifically, any of the second video segments includes an N-frame second image, and the T second video segments corresponding to any of the first code stream data include an N*T frame second image. Since the second image of the T frame belonging to the first image of the same frame has the same image header, the video decoding device splices the second image of the T frame with the same image header in the second image of the N*T frame to obtain a The first video clip. The first video segment includes an N frame of the first image, the first image resolution being greater than the resolution of the second image.

According to the above method, the video decoding device acquires the first video segment obtained by splicing the T video segments corresponding to each of the first code stream data, to obtain M first video segments; The decoding device splices the M first video segments together according to the division order of the M first video segments to obtain the source video.

It can be seen that, in the solution of the embodiment of the present invention, the video decoding device obtains the code stream data of the source video from the code stream of the source video, and divides the code stream data of the source video into M first code stream data. And then expanding each of the first code stream data of the M first code stream data into T second code stream data. The video decoding device performs parallel decoding on the T second code stream data of each of the first code stream data to obtain M*T second video segments. The M*T second video segments are then spliced to obtain the source video. Compared with the prior art, the present invention performs parallel decoding on multiple sub-video segments of a video segment, thereby improving the efficiency of video decoding; and after decoding multiple sub-videos of the video segment, the video segment can be directly displayed. Improve the user experience.

In a specific application scenario, it is assumed that the source video with a resolution of 416*240 includes 20 frames of the first image, and the video encoding device divides the source video into four first video segments, each of which includes 5 frames of the first image, and the 5 frames of the first image are consecutive frame images. The video encoding device divides each of the four first video segments into eight second video segments according to a preset resolution of 128*128 to obtain 32 second video segments. For the 20 frames of the first image of the source video, the video encoding device divides the first image of each frame into 8 frames of the second image. As shown in FIG. 7, the video encoding device divides the first image with a resolution of 416*240 into a second image of 8 frames according to a preset resolution of 128*128, and the second image of the 8 frames includes 3 frames. The second image is 128*128, the second image with a frame resolution of 128*112, the second image with a frame resolution of 32*128, and the second image with a frame resolution of 32*112. The video encoding device numbers the second image of the 8 frames from left to right, and from top to bottom, A, B, C, D, E, F, G, I. For each of the 8 second video segments corresponding to each first video segment, each second video segment includes 5 frames of the second image with the same number.

Before the parallel coding of the corresponding 8 second video segments of the first video segment, the video encoding device generates a sequence header according to the configuration information.

It is assumed that any one of the above four first video segments is the first video segment A, and the video encoding device determines the coding priority of the eight second video segments of the first video segment A. As shown in FIG. 7, the coding priority of the eight second video segments in the first video segment A is sequentially lowered from left to right and from top to bottom. The above video coding design The eight second videos in the first video segment A are encoded in parallel according to the coding priority. After the encoding is completed, 8 sets of image headers and 8 sets of image data are obtained, each set of image headers including 5 image headers, and each set of image data includes 5 image data. Since the 8 frames of the second image belonging to the first image of the same frame have the same image header, the above video encoding apparatus retains only one set of image headers for the above-mentioned 8 sets of image headers. The video encoding apparatus integrates the set of image headers and the eight sets of image data into the first stream data of the first video clip A. The format of the first code stream data of the first frequency segment A is as follows:

H1(A1B1C1D1E1F1G1I1)H2(A2B2C2D2E2F2G2I2)...H5(A5B5C5D5E5F5G5I5),

Or the first code stream data format of the first video segment A is as follows:

H1H2H3H4H5(A1A2A3A4A5)(B1B2B3B4B5)...(I1I2I3I4I5),

The above H1, H2, H3, H4, and H5 are image headers of the first frame of the five frames in the first video segment A, that is, the group of image headers, and the above-mentioned A1, B1, C1, D1, E1, F1, G1, and I1 are respectively corresponding image data of 8 frames of the second image of the first image of the first frame in the first frame of the above 5 frames; A2, B2, C2, D2, E2, F2, G2, and I2 are respectively Corresponding image data of 8 frames of the second image of the first image of the second frame in the first frame of the 5 frames; A3, B3, C3, D3, E3, F3, G3, and I3 are respectively in the first image of the above 5 frames. Corresponding image data of 8 frames of the second image of the first frame of the third frame; A4, B4, C4, D4, E4, F4, G4, and I4 are the first image of the fourth frame in the first image of the above 5 frames, respectively Corresponding image data of the 8 frames of the second image; A5, B5, C5, D5, E5, F5, G5, I5 are respectively the 8 frames of the first image of the fifth frame of the 5 frames of the first image Corresponding image data.

According to the above method, after the video encoding device performs encoding on the four first video segments of the source video, four first code stream data corresponding to the four first video segments are obtained. The video encoding device integrates the sequence header, the 44 first code stream data and the sequence termination code to obtain a code stream of the source video.

Before the foregoing sequence header, the four first code stream data and the sequence termination code are integrated, the video encoding device adds a first syntax element for indicating the preset resolution 128*128 and the use in the sequence header. And a second syntax element indicating a second image frame number N in the second video segment.

After acquiring the code stream of the source video, the video decoding device parses the sequence header and the sequence termination code from the code stream of the source video. The video decoding device acquires the number T of the second video segments in each of the first video segments according to the resolution 416*240 of the source video and the resolution 128*128 indicated by the first syntax element in the sequence header. . The above video decoding device copies the above sequence header to obtain 8 sequence headers. The video decoding device changes the resolution indicated by the first syntax element in the eight sequence headers to 128*128, 128*128, 128*128, 32*128, 128*112, 128*112, 128*, respectively. 112 and 112*32. The video decoding device divides the code stream data of the source video into four first code stream data according to the coding order, and then expands each first code stream data of the four first code stream data into eight second. Code stream data.

The video decoding apparatus culls the first syntax element and the second syntax element in the sequence header before performing the decoding operation on the code stream data of the sub video clip.

The video decoding device performs parallel decoding on the eight second code stream data in the first code stream data in the four first code stream data according to the eight sequence headers, to obtain four second video segment groups, each of which is configured. The two video clip groups include eight second video clips. The video decoding device splices together the second images of the 8 second video segments of the first video segment group of the four first video segment groups having the same image header to obtain four first video segments. And smoothing the first of the four video segments.

The video decoding device splices the four first video segments together according to the division order of the first video segment to obtain the source video.

Referring to FIG. 8, FIG. 8 is a schematic flowchart diagram of a video encoding and decoding method according to an embodiment of the present invention. As shown in Figure 8, the method includes:

S801. The video encoding device divides the source video into M first video segments.

The first video segment of the M first video segments includes an N frame first image, and the N frame first image is a continuous frame image.

S802. The video encoding device divides each of the M video segments into T second video segments to obtain M*T second video segments.

Specifically, the video encoding apparatus divides, according to a preset resolution, a first image of each frame of each of the M video segments into a second image of a T frame, and the second image of the T frame. Numbering to obtain a second image of the N*T frame; the video encoding apparatus combining the second images of each N frame of the same number in the second image of the N*T frame to obtain T second video segments; The video encoding acquires the second video segment obtained by dividing each of the first video segments of the M first video segments to obtain M*T second video segments.

The second video segment of the M*T second video segment includes an N frame second image, and the resolution of the second image is smaller than the resolution of the first video segment.

S803. The video encoding device performs parallel coding on the T second video segments of the first video segment A1 to obtain T second code stream data.

The first video segment A1 is any one of the M first video segments.

Before the parallel coding of the T second video segments of each of the M video segments, the video encoding device generates a sequence header of the code stream of the source video according to the configuration information; A first syntax element for indicating a preset resolution and a second syntax element for indicating the number N of image subframes in each sub video segment are added to the sequence header.

Further, the video encoding device sends the sequence header to the video decoding device.

S804. The video encoding device integrates the T second code stream data corresponding to the first video segment into a first code stream data.

S805. The video encoding device sends the first code stream data corresponding to the first video segment A1 to the video decoding device.

After the first code stream data corresponding to the first video segment A1 is sent to the video decoding device, the video encoding device performs parallel encoding on the T second video segments of the first video segment A2.

The first video segment A1 and the first video segment A2 are adjacent in the dividing order, and the first video segment A1 is before the first video segment A2.

According to the above method, the encoding device performs an encoding operation on the M first video segments, and transmits the encoded M first code streams to the video decoding device.

S806. The video decoding device expands the first code stream data corresponding to the first video segment A1 according to the sequence header, to obtain T second code stream data corresponding to the first video segment A1.

S807. The video decoding device performs parallel decoding on the T second code stream data corresponding to the first video segment A1 to obtain T second video segments.

S808. The video decoding device concatenates the T second video segments into a first video segment A1.

Further, after the video encoding device splices the T second video segments into one first video segment A1, the video display device may directly display the first video segment A1.

After the T second video segments obtained by parallel decoding the T second code stream data corresponding to the first video segment A1 are spliced, the video decoding device corresponds to the T segments of the first video segment A2. The second code stream data is decoded in parallel, and so on, until the decoding of the T second code stream data corresponding to each of the first video segments of the M first video segments is completed, to obtain M first video segments.

It should be noted that the detailed process of the foregoing steps S801-S807 can be referred to the specific process of the method embodiment shown in FIG. 2 and FIG. 6, and will not be described herein.

FIG. 9 is a schematic structural diagram of a video encoding apparatus according to an embodiment of the present invention. As shown in FIG. 9, the video encoding apparatus 900 includes:

a first dividing unit 901, configured to divide the source video into M first video segments, where each of the M first video segments is composed of N frames of the first image, and the N frames are first The image is a continuous frame image, and both M and N are integers greater than one.

a second dividing unit 902, configured to divide each of the M first video segments into T second video segments to obtain M*T second video segments, where any of the The second video segment includes an N-frame second image, the resolution of the second image being less than the resolution of the first image, and the T being an integer greater than one.

The second dividing unit 902 is specifically configured to:

Combining the second images of each N frame with the same number in the second image of the N*T frame to obtain T second video segments;

The first video segment i is any one of the M first video segments.

The encoding unit 903 is configured to perform parallel encoding on the T second video segments in each of the M first video segments to obtain M*T second code stream data.

The coding unit 903 is specifically configured to:

Performing the following operations on the first video segment i:

The video encoding device 900 further includes:

a generating unit 905, configured to generate a sequence of the source video code stream according to the encoding configuration information, before performing parallel encoding on the T second video segments in each of the M first video segments head.

The integration unit 904 is configured to integrate the M*T second code stream data to obtain a code stream of the source video.

The second stream data includes a set of image headers and a set of image data; the integration unit 904 includes:

a first integration sub-unit 9041, configured to integrate T second code stream data of each of the M first video segments to obtain M first code stream data, where Integrating T pieces of second stream data of a video segment to obtain a first stream data;

The second integration subunit 9042 is configured to integrate the sequence header, the M first code stream data, and the sequence termination code into a code stream of the source video.

Any one of the second stream data includes a set of image headers and a set of image data, and the first integration unit 9041 is specifically configured to:

Performing the following operations on the first video segment i:

The video encoding device 900 further includes:

The adding unit 906 is configured to: after generating a sequence header of the source video code stream according to the encoding configuration information, adding a first syntax element for indicating the preset resolution to the sequence header and indicating the A second syntax element of the number N of frames of the first image included in the first video segment.

It should be noted that each of the above units (the first dividing unit 901, the second dividing unit 902, the encoding unit 903, the integrating unit 904, the generating unit 905, and the adding unit 906) is used to perform the relevant steps of the above method.

In the present embodiment, the video encoding apparatus 900 is presented in the form of a unit. A "unit" herein may refer to an application-specific integrated circuit (ASIC), a processor and memory that executes one or more software or firmware programs, integrated logic circuits, and/or other devices that provide the functionality described above. . Further, the above first dividing unit 901, second dividing unit 902, encoding unit 903, integrating unit 904, generating unit 905 and adding unit 906 can be realized by the processor 1401 of the video encoding apparatus 1400 shown in FIG.

FIG. 11 is a schematic structural diagram of a video decoding device according to an embodiment of the present invention. As shown in FIG. 11, the video decoding device 1100 includes:

a first acquiring unit 1101, configured to acquire code stream data of the source video from a code stream of the source video, where the code stream data of the original video is a code stream of the original video that does not include a sequence header and a sequence termination code. .

The dividing unit 1102 is configured to divide the code stream data of the source video into M first code stream data, and expand each first code stream data of the M first code stream data into T pieces. Two streams of data are obtained to obtain M*T second stream data.

The video decoding device 1100 further includes:

a second obtaining unit 1105, configured to acquire a sequence header in a code stream of the source video before the code stream data of the source video is equally divided into M first code stream data;

The third obtaining unit 1106 is configured to obtain, according to the resolution of the source video and the preset resolution indicated by the first syntax element in the sequence header, the first code stream data may be expanded into the second code stream data. Number T.

Each of the first code stream data includes a set of image headers and T sets of image data, and the dividing unit 1102 includes:

a copying subunit 11021, configured to copy a set of image headers of the first code stream data i of the M first code stream data to obtain a T group image header;

The extension subunit 11022 is configured to expand, according to the T group image header and the T group image data of the first code stream data i, the T second data code streams;

The obtaining sub-unit 11023 is configured to acquire T second code stream data corresponding to each first code stream data of the M first code stream data, to obtain M*T second code stream data;

Decoding unit 1103, configured to perform parallel decoding on T second code stream data corresponding to any first code stream data to obtain T second video segments; and acquire each of the M first code stream data T second video segments corresponding to T second code stream data of the first code stream data to obtain M*T second video segments.

The video decoding device 1100 further includes:

a culling unit 1107, configured to cull the first syntax element and the second syntax element in the sequence header before performing parallel decoding on the T second code stream data corresponding to any first code stream data, The second syntax element is used to indicate the number N of frames of the second image included in the second video segment.

The decoding unit 1103 is specifically configured to:

The first code stream data i is any one of the M first code stream data.

The splicing unit 1104 is configured to splicing the M*T second video segments to obtain the source video.

Wherein, any second video segment includes an N-frame second image, and the splicing unit 1104 includes:

The first splicing sub-unit 11041 is configured to: in the second image of the N*T frames in the T second video segments corresponding to each of the M first code stream data, the image header is the same The second image of each T frame is stitched together to obtain M first video segments, each of the first video segments includes N frames of the first image, and the resolution of the first image Greater than the resolution of the second image;

The second splicing sub-unit 11042 is configured to splicing the M first video segments to obtain the source video.

It should be noted that each of the foregoing units (the first obtaining unit 1101, the dividing unit 1102, the decoding unit 1103, the splicing unit 1104, the second obtaining unit 1105, the third obtaining unit 1106, and the culling unit 1107) is configured to perform the foregoing method. step.

In the present embodiment, the video decoding device 1100 is presented in the form of a unit. A "unit" herein may refer to an application-specific integrated circuit (ASIC), a processor and memory that executes one or more software or firmware programs, integrated logic circuits, and/or other devices that provide the functionality described above. . Further, the above first obtaining unit 1101, dividing unit 1102, decoding unit 1103, splicing unit 1104, second obtaining unit 1105, third obtaining unit 1106, and culling unit 1107 may pass the processing by the video decoding apparatus 1500 shown in FIG. The device 1501 is implemented.

As shown in FIG. 14, video encoding apparatus 1400 can be implemented in the structure of FIG. 14, which includes at least one processor 1401, at least one memory 1402, and at least one communication interface 1403. The processor 1401, the memory 1402, and the communication interface 1403 are connected by the communication bus and complete communication with each other.

The processor 1401 may be a general purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the above program.

The communication interface 1403 is configured to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Networks (WLAN), and the like.

The memory 1402 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type that can store information and instructions. The dynamic storage device can also be an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical disc storage, and a disc storage device. (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be Any other media accessed, but not limited to this. The memory can exist independently and be connected to the processor via a bus. The memory can also be integrated with the processor.

The memory 1402 is configured to store application code that executes the above solution, and is controlled by the processor 1401 for execution. The processor 1401 is configured to execute application code stored in the memory 1402.

The code stored in the memory 1402 may perform the above-described one video encoding method performed by the video encoding apparatus provided above, such as the video encoding apparatus dividing the source video into M first video segments, each of the M first video segments The first video segment is composed of N frames of first images, the N frames of the first image are consecutive frame images, and the M and N are integers greater than 1; the video encoding device uses the M first video segments Each of the first video segments is divided into T second video segments to obtain M*T second video segments, wherein any of the second video segments includes an N-frame second image, the second image The resolution is smaller than the resolution of the first image, the T is an integer greater than 1; the video encoding device performs parallel encoding on the T second video segments in any of the first video segments to obtain T first Second stream data, and acquiring second code stream data obtained by encoding the second video segment of each of the M first video segments to obtain M*T second code stream data; Encoding device pair of said M*T second codes The stream data is integrated to obtain a code stream of the source video.

The embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium can store a program, and the program includes some or all of the steps of any one of the video encoding methods described in the foregoing method embodiments.

As shown in FIG. 15, video decoding device 1500 can be implemented in the structure of FIG. 15, which includes at least one processor 1501, at least one memory 1502, and at least one communication interface 1503. The processor 1501, the memory 1502, and the communication interface 1503 are connected by the communication bus and complete communication with each other.

The processor 1501 may be a general purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the above program.

The communication interface 1503 is configured to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Networks (WLAN), and the like.

The memory 1502 may be a read-only memory (ROM) or other type of static storage device that can store static information and instructions, a random access memory (RAM) or other type that can store information and instructions. The dynamic storage device can also be an Electrically Erasable Programmable Read-Only Memory (EEPROM), a Compact Disc Read-Only Memory (CD-ROM) or other optical disc storage, and a disc storage device. (including compact discs, laser discs, optical discs, digital versatile discs, Blu-ray discs, etc.), magnetic disk storage media or other magnetic storage devices, or can be used to carry or store desired program code in the form of instructions or data structures and can be Any other media accessed, but not limited to this. The memory can exist independently and be connected to the processor via a bus. The memory can also be integrated with the processor.

The memory 1502 is configured to store application code that executes the above solution, and is controlled by the processor 1701 for execution. The processor 1501 is configured to execute application code stored in the memory 1502.

The code stored in the memory 1502 may perform the above-described video decoding method performed by the video decoding device provided by the video decoding device, for example, the video decoding device acquires the code stream data of the source video from the code stream of the source video, and the code stream of the original video. The data is a code stream of the original video that does not include a sequence header and a sequence termination code; the video decoding device divides the code stream data of the source video into M first code stream data, and the M Each first code stream data of the first code stream data is expanded into T second code stream data to obtain M*T second code stream data; the video decoding device corresponding to any first code stream data Performing parallel decoding on the T second code stream data to obtain T second video segments; and acquiring T second code stream data corresponding to each of the M first code stream data T second video segments to obtain M*T second video segments; the video decoding device splicing the M*T second video segments to obtain the source video.

The embodiment of the present invention further provides a computer storage medium, wherein the computer storage medium can store a program, and the program includes some or all of the steps of any one of the video decoding methods described in the foregoing method embodiments.

It should be noted that, for the foregoing method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. Secondly, those skilled in the art should also know It is to be understood that the embodiments described in the specification are all preferred embodiments and that the acts and modules involved are not necessarily essential to the invention.

In the above embodiments, the descriptions of the various embodiments are different, and the details that are not detailed in a certain embodiment can be referred to the related descriptions of other embodiments.

In the several embodiments provided herein, it should be understood that the disclosed apparatus may be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the unit is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be combined or may be Integrate into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be electrical or otherwise.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a standalone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may contribute to the prior art or all or part of the technical solution may be embodied in the form of a software product stored in a memory. A number of instructions are included to cause a computer device (which may be a personal computer, server or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention. The foregoing memory includes: a U disk, a ROM, a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk, and the like, which can store program codes.

A person skilled in the art can understand that all or part of the steps of the foregoing embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable memory, and the memory can include: a flash drive , ROM, RAM, disk or CD.

The embodiments of the present invention have been described in detail above, and the principles and implementations of the present invention are described in detail herein. The description of the above embodiments is only for helping to understand the method of the present invention and its core ideas; The present invention is not limited by the scope of the present invention, and the present invention is not limited by the scope of the present invention.

Claims

A video encoding method, comprising:

The video encoding device divides the source video into M first video segments, each of the M first video segments is composed of N frames of the first image, and the N frames of the first image are consecutive frame images. , wherein M and N are integers greater than one;

The video encoding device divides each of the M first video segments into T second video segments to obtain M*T second video segments, where any of the second videos The segment includes an N-frame second image, the resolution of the second image is less than a resolution of the first image, and the T is an integer greater than one;

The video encoding device performs parallel encoding on the T second video segments of each of the M first video segments to obtain M*T second code stream data;

The video encoding device integrates the M*T second code stream data to obtain a code stream of the source video.
The method according to claim 1, wherein the video encoding device divides each of the M first video segments into T second video segments, including:

The video encoding device performs the following operations on the first video segment i of the M first video segments:

Decoding a first image of each frame of the N frames of the first video segment i into a second image of the T frame according to a preset resolution, and numbering the second image of the T frame to obtain N *T frame second image, wherein the resolution of any second image is less than or equal to the preset resolution, and the position of the first image of each frame of the N image of the first video segment i corresponds to The second image has the same number;

Combining N frames of second images with the same number in the second image of the N*T frame to obtain T second video segments;

The first video segment i is any one of the M first video segments.
The method according to claim 2, wherein the video encoding device performs parallel encoding on the T second video segments in each of the M first video segments, including:

The video encoding device performs the following operations on the first video segment i:

Obtaining an encoding priority corresponding to each of the T second video segments of the first video segment i;

And encoding, according to the coding priority corresponding to the T second video segments in the first video segment i, the T second video segments of the first video segment i to obtain T second code stream data .
The method according to claim 3, wherein said video encoding device performs parallel encoding on T second video segments of each of said M first video segments before said The method also includes:

The video encoding device generates a sequence header of a code stream of the source video according to the encoding configuration information.
The method according to claim 4, wherein the video encoding device integrates the M*T second code stream data to obtain a code stream of the source video, including:

The video encoding device integrates T second code stream data of each of the M first video segments to obtain M first code stream data, where a first video segment is Integrating T pieces of second stream data to obtain a first stream data;

The video encoding device integrates the sequence header, the M first code stream data, and a sequence termination code into a code stream of the source video.
The method of claim 5 wherein any of the second code stream data comprises a set of image headers and a set of image data, said video encoding device for each of said M first video segments The T second code stream data of the first video segment are integrated to obtain M first code stream data, including:

The video encoding device performs the following operations on the first video segment i:

Obtaining an encoding priority of each second code stream data of the corresponding T second code stream data of the first video segment i, the encoding priority of the second code stream data and the corresponding second video segment thereof The coding priority is consistent;

Determining, according to an encoding priority of each second code stream data of the T second code stream data corresponding to the first video segment i, each of the T second code stream data corresponding to the first video segment i An order of integration of image data of the second code stream data; wherein, the higher the coding priority of the second code stream data, the higher the integration order of the image data of the second code stream data;

And according to the integration order of the image data of each of the T second code stream data corresponding to the first video segment i, the T second code stream data corresponding to the first video segment i Image data is integrated into image data of a first code stream data, and a set of image headers of any of the second code stream data corresponding to the first video segment i and the second video stream data The image data of the first code stream data integrates one of the first code stream data, wherein each of the first code stream data includes a set of the image header and T group image data, and the T second codes The T second video segments corresponding to the stream data belong to the same first video segment.
The method according to claim 4, wherein after the video encoding device generates a sequence header of the code stream of the source video according to the encoding configuration information, the method further includes:

The video encoding apparatus adds, in the sequence header, a first syntax element for indicating the preset resolution and a number of frames N for indicating the first image included in the first video segment. Two syntax elements.
A video decoding method, comprising:

The video decoding device acquires code stream data of the source video from a code stream of the source video, where the code stream data of the original video is a code stream of the original video that does not include a sequence header and a sequence termination code;

The video decoding device divides the code stream data of the source video into M first code stream data, and expands each first code stream data of the M first code stream data into T second Code stream data to obtain M*T second code stream data;

The video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data to obtain M*T second video segments;

The video decoding device splices the M*T second video segments to obtain the source video.
The method according to claim 8, wherein before the video decoding device divides the code stream data of the source video into M pieces of the first code stream data, the method further includes:

The video decoding device acquires a sequence header from a code stream of the source video;

The video decoding device acquires the number T of the first code stream data that can be expanded into the second code stream data according to the resolution of the source video and the preset resolution indicated by the first syntax element in the sequence header.
The method of claim 9 wherein each of said first code stream data comprises a set of image headers and T sets of image data, said each of said M first code stream data The first code stream data is expanded into T second code stream data, including:

The video decoding device complexes a set of image headers of the first code stream data i of the M first code stream data System to obtain a T group image header;

The video decoding device expands to obtain T second data code streams according to the T group image header and the T group image data of the first code stream data i;

The video decoding device acquires T second code stream data corresponding to each first code stream data of the M first code stream data to obtain M*T second code stream data;

The second code stream data includes a set of image headers and a set of image data, and the first code stream data i is any one of the M first code stream data.
The method according to claim 8, wherein the video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data. include:

The video encoding device performs the following operations on the first code stream data i of the M first code stream data:

Obtaining a decoding priority corresponding to each second code stream data of the T second code stream data of the first code stream data i;

Decoding the T second code stream data of the first code stream data i in parallel according to a decoding priority corresponding to the T second code stream data of the first code stream data i, to obtain T second Video clip

The first code stream data i is any one of the M first code stream data.
The method according to claim 11, wherein the video decoding device performs parallel decoding on the T second code stream data corresponding to each of the M first stream data. The method further includes:

The video decoding device culls the first syntax element and the second syntax element in the sequence header, and the second syntax element is used to indicate a frame number N of a second image included in the second video segment.
The method according to claim 12, wherein any second video segment comprises an N-frame second image, and the video decoding device splices the M*T second video segments to obtain the source Video, including:

The video decoding device, in the second image of the N*T frames in the T second video segments corresponding to each of the M first stream data, each T frame of the same image header The second images are stitched together to obtain M first video segments, each of the first video segments includes an N-frame first image, and the resolution of the first image is greater than the first image The resolution of the two images;

The video decoding device splices the M first video segments to obtain the source video.
A video encoding device, comprising:

a first dividing unit, configured to divide the source video into M first video segments, each of the M first video segments being composed of N frames of the first image, the N frames of the first image For consecutive frame images, the M and N are integers greater than one;

a second dividing unit, configured to divide each of the M first video segments into T second video segments to obtain M*T second video segments, where any of the foregoing The second video segment includes an N-frame second image, the resolution of the second image is less than a resolution of the first image, and the T is an integer greater than one;

a coding unit, configured to perform parallel coding on the T second video segments in each of the M first video segments to obtain M*T second code stream data;

And an integration unit, configured to integrate the M*T second code stream data to obtain a code stream of the source video.
The device according to claim 14, wherein the second dividing unit is specifically configured to:

Performing the following operations on the first video segment i of the M first video segments:

Decoding a first image of each frame of the N frames of the first video segment i into a second image of the T frame according to a preset resolution, and numbering the second image of the T frame to obtain N *T frame second image, wherein the resolution of any second image is less than or equal to the preset resolution, and the position of the first image of each frame of the N image of the first video segment i corresponds to The second image has the same number;

Combining N frames of second images with the same number in the second image of the N*T frame to obtain T second video segments;

The first video segment i is any one of the M first video segments.
The device according to claim 15, wherein the coding unit is specifically configured to:

Performing the following operations on the first video segment i:

Obtaining an encoding priority corresponding to each of the T second video segments of the first video segment i;

And encoding, according to the coding priority corresponding to the T second video segments in the first video segment i, the T second video segments of the first video segment i to obtain T second code stream data.
The device according to claim 16, wherein the video encoding device further comprises:

a generating unit, configured to generate a sequence of the code stream of the source video according to the encoding configuration information, before performing parallel encoding on the T second video segments in each of the M first video segments head.
The device according to claim 17, wherein the integration unit comprises:

a first integration subunit, configured to integrate T second code stream data of each of the M first video segments to obtain M first code stream data, where Integrating T pieces of second stream data of the video segment to obtain a first stream data;

And a second integration subunit, configured to integrate the sequence header, the M first code stream data, and the sequence termination code into a code stream of the source video.
The device according to claim 18, wherein any of the second code stream data comprises a set of image headers and a set of image data, and the first integration unit is specifically configured to:

Performing the following operations on the first video segment i:

Obtaining an encoding priority of each second code stream data of the corresponding T second code stream data of the first video segment i, the encoding priority of the second code stream data and the corresponding second video segment thereof The coding priority is consistent;

Determining, according to an encoding priority of each second code stream data of the T second code stream data corresponding to the first video segment i, each of the T second code stream data corresponding to the first video segment i An order of integration of image data of the second code stream data; wherein, the higher the coding priority of the second code stream data, the higher the integration order of the image data of the second code stream data;

And according to the integration order of the image data of each of the T second code stream data corresponding to the first video segment i, the T second code stream data corresponding to the first video segment i Image data is integrated into image data of a first code stream data, and a set of image headers of any of the second code stream data corresponding to the first video segment i and the second video stream data The image data of the first code stream data integrates one of the first code stream data, wherein each of the first code stream data includes a set of the image header and T group image data, and the T second codes The T second video segments corresponding to the stream data belong to the same first video segment.
The device according to claim 17, wherein the video encoding device further comprises:

An adding unit, after generating a sequence header of the source video code stream according to the encoding configuration information, in the A first syntax element for indicating the preset resolution and a second syntax element for indicating a frame number N of the first image included in the first video segment are added to the sequence header.
A video decoding device, comprising:

a first acquiring unit, configured to acquire code stream data of the source video from a code stream of the source video, where the code stream data of the original video is a code stream of the original video that does not include a sequence header and a sequence termination code;

a dividing unit, configured to divide the code stream data of the source video into M first code stream data, and expand each first code stream data of the M first code stream data into T second Code stream data to obtain M*T second code stream data;

a decoding unit, configured to perform parallel decoding on the T second code stream data corresponding to each of the M first code stream data to obtain M*T second video segments;

a splicing unit, configured to splicing the M*T second video segments to obtain the source video.
The device according to claim 21, wherein the video decoding device further comprises:

a second acquiring unit, configured to acquire a sequence header in a code stream of the source video before the code stream data of the source video is equally divided into M first code stream data;

a third acquiring unit, configured to acquire, according to a resolution of the source video and a preset resolution indicated by the first syntax element in the sequence header, the number of the first code stream data that can be expanded into the second code stream data T.
The device according to claim 22, wherein each of said first code stream data comprises a set of image headers and T sets of image data, said dividing unit comprising:

a copying subunit, configured to copy a set of image headers of the first code stream data i of the M first code stream data to obtain a T group image header;

An extension subunit, configured to expand, according to the T group image header and the T group image data of the first code stream data i, to obtain T second data code streams;

a first acquiring sub-unit, configured to acquire T second code stream data corresponding to each first code stream data of the M first code stream data, to obtain M*T second code stream data;

The second code stream data includes a set of image headers and a set of image data, and the first code stream data i is any one of the M first code stream data.
The device according to claim 21, wherein the decoding unit is specifically configured to:

Performing the following operations on the first code stream data i of the M first code stream data:

Obtaining a decoding priority corresponding to each second code stream data of the T second code stream data of the first code stream data i;

Decoding the T second code stream data of the first code stream data i in parallel according to a decoding priority corresponding to the T second code stream data of the first code stream data i, to obtain T second Video clip

The first code stream data i is any one of the M first code stream data.
The device according to claim 24, wherein the video decoding device further comprises:

a culling unit, configured to cull the first one of the sequence headers before performing parallel decoding on the T second code stream data corresponding to each of the M first code stream data And a second syntax element, the second syntax element is used to indicate the number N of frames of the second image included in the second video segment.
The device according to claim 25, wherein any of the second video segments comprises an N-frame second image, and the splicing unit comprises:

a first splicing subunit, configured to: in the second image of the N*T frames in the T second video segments corresponding to each of the M first code stream data, the image header is the same The second image is spliced together every T frame to obtain M first video segments, each of the M first video segments includes an N frame first image, and the resolution of the first image is greater than The resolution of the second image;

a second splicing subunit, configured to splicing the M first video segments to obtain the source video.