CN115037927A - Image coding and decoding method fusing full chroma and mixed chroma and application thereof - Google Patents
Image coding and decoding method fusing full chroma and mixed chroma and application thereof Download PDFInfo
- Publication number
- CN115037927A CN115037927A CN202210491142.7A CN202210491142A CN115037927A CN 115037927 A CN115037927 A CN 115037927A CN 202210491142 A CN202210491142 A CN 202210491142A CN 115037927 A CN115037927 A CN 115037927A
- Authority
- CN
- China
- Prior art keywords
- mode
- coding
- chroma
- chroma mode
- full
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000007906 compression Methods 0.000 claims description 78
- 230000006835 compression Effects 0.000 claims description 78
- 238000005070 sampling Methods 0.000 claims description 61
- 239000011159 matrix material Substances 0.000 claims description 12
- 230000009466 transformation Effects 0.000 claims description 12
- 238000009795 derivation Methods 0.000 claims description 6
- 239000000203 mixture Substances 0.000 claims description 4
- 238000004458 analytical method Methods 0.000 claims description 3
- 230000002123 temporal effect Effects 0.000 claims description 3
- 238000003491 array Methods 0.000 claims description 2
- 238000013459 approach Methods 0.000 abstract description 8
- 230000008569 process Effects 0.000 abstract description 3
- 238000013144 data compression Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 230000007547 defect Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Color Television Systems (AREA)
Abstract
The invention discloses a method and a device for encoding and decoding by fusing a full chroma mode and a mixed chroma mode. When encoding a data set or decoding a compressed data code stream, according to a predetermined condition, a full chroma mode is used for data of a part of contents and a mixed chroma mode is used for data of another part of contents. That is, in the encoding or decoding process, if a predetermined condition is satisfied, the full-chroma mode is used; otherwise, a mixed-chroma approach is used. For a large class of video content data, the coding efficiency can be effectively improved by fusing the full chroma mode and the mixed chroma mode.
Description
Technical Field
The invention relates to the technical field of image coding and decoding, in particular to an image coding and decoding method fusing full chroma and mixed chroma and application thereof, namely a coding and decoding system for lossy or lossless compression of data, and particularly relates to a coding and decoding method, a device, equipment and application thereof for compressing mixed video content containing computer generated content and photoelectric sensor shooting content.
Background
With the human society entering the era of artificial intelligence, big data, virtual reality, augmented reality, mixed reality, cloud computing, mobile computing, cloud-mobile computing, ultra-high definition (4K) and ultra-high definition (8K) video image resolution, 4G/5G communication, it becomes an indispensable technology to perform ultra-high compression ratio and extremely high quality data compression on various data including big data, image sequence data, i.e. video data, and various new-state data, such as data including mixed video (including image, i.e. single frame video) content of computer-generated content and photoelectric sensor-captured content.
A data set is a set of data elements (e.g., bytes, bits, pixels, pixel components, spatial sampling points, transform domain coefficients).
In data compression, an encoder encodes an input data set, also called an original data set, to generate a compressed data code stream; and the decoder decodes the compressed data code stream to generate an output data set and a reconstructed data set. Compression in which the input data set is identical to the output data set, i.e. without distortion, is referred to as lossless compression. Compression in which the input data set is not identical to the output data set, i.e. distorted, is referred to as lossy compression.
When encoding or decoding a data set (abbreviated as "codec"), data elements are usually ordered according to a predetermined rule, that is, in a predetermined order, and then encoded and decoded in the order.
When encoding (and corresponding decoding) data compression of a data set (e.g., a one-dimensional data queue, a two-dimensional data file, a frame of image, a video sequence, a transform domain, a transform block, a plurality of transform blocks, a three-dimensional scene, a sequence of continuously-changing three-dimensional scenes) arranged in a spatial (one-dimensional, two-dimensional, or multi-dimensional) shape, particularly a two-dimensional or more data sets, the data set is generally divided into a plurality of compressed subsets having predetermined shapes and/or sizes (i.e., numbers of elements), and the compressed subsets are sequentially encoded or decoded in a predetermined order, one after the other, in units of compressed subsets.
When encoding or decoding a compressed subset, the compressed subset is generally divided into a number of maximum compression units having a predetermined shape and/or size (i.e., number of elements), and one maximum compression unit and then one maximum compression unit are sequentially encoded or decoded in a predetermined order by the maximum compression unit. The maximum compression units arranged in a row from left to right constitute a maximum compression unit row.
Within a maximum compression unit, the maximum compression unit is further divided into a number of sub-units having a predetermined shape and/or size (i.e., the number of elements), called whole compression units, and the encoding or decoding is performed on a whole compression unit-by-whole compression unit basis in a predetermined order.
In short, the above process finally divides the data set into several subsets having predetermined shapes and/or sizes (i.e., number of elements), called whole compression units, and encodes or decodes one whole compression unit by one whole compression unit in a predetermined order in units of whole compression units.
At any one time, the compression subset being encoded or decoded is referred to as the current compression subset. The largest compression unit being encoded or decoded is called the current largest compression unit. The largest compression unit row being encoded or decoded is referred to as the current largest compression unit row. The integer compression unit being encoded or decoded is referred to as the current integer compression unit. A data element (also sometimes simply referred to as an element) being encoded or decoded is referred to as a currently encoded data element or a currently decoded data element, collectively referred to as a current data element, simply referred to as a current element. An element consists of N components (typically 1 ≦ N ≦ 5), so the data set, compression subset, maximum compression unit, and full compression unit all consist of N components as well. The components of an element are also referred to as component elements.
For example, a compression subset is a frame image whose elements, i.e., pixels, are arranged in a rectangular shape, having a size (resolution) of 3840 (width) x 2160 (height), and consisting of 3 components: g (green) component, B (blue) component, R (red) component or Y (luminance) component, U (Cb chrominance) component, V (Cr chrominance) component. One frame image is divided into maximum compression units of 128 × 128 size. Each maximum compression unit is further divided into square or rectangular whole compression units of varying sizes from 4x4 to 64x 64.
In the case of a data set divided into compression subsets, maximum compression units, and full compression units, one predetermined rule for ordering the elements is to first order the compression subsets, then the maximum compression units within each compression subset, then order the full compression units within each maximum compression unit, and then order the elements within each full compression unit.
That is, in the case where the data set is ultimately divided into whole compression units, one predetermined rule of ordering is to first order the whole compression units and then order the elements within each whole compression unit.
The relationship between the multi-component data set as an encoding object and the sampling rate of each component of the integral compression unit is generally expressed in a sampling format. Data in which the N components all have the same sample rate and size (i.e., the number of component samples) is referred to as full sample format data. The N components have different sampling rates and sizes, wherein data of which the sampling rate and size of N1 components, referred to as primary components, are integer multiples of the sampling rate and size of the remaining N-N1 components, referred to as secondary components, are referred to as downsampled format data. The integer multiple is typically 2 times, 4 times, 8 times, 2x2 times, 4x2 times, etc. In full-sample format data, all components are considered primary components and no secondary components. At least one component of the downsampled formatted data is a primary component and at least one component of the downsampled formatted data is a secondary component. For example, for an array of two-dimensional data elements of the type comprising computer-generated graphics and text-containing images, a sampling format known as 4:4:4 (or simply 444) is commonly employed, i.e., 3 components of the data set all have the same sampling rate and size (i.e., number of component samples). For another type of two-dimensional data element array, including natural images and videos captured by a camera, a sampling format called 4:2:0 (abbreviated 420) is commonly used, that is, the sampling rate and size of 2 components called minor components (D-component and E-component) of a data set (e.g., an image or video) having a rectangular shape and 3 components are each one quarter of the other component called major component (F-component), that is, there is a 4:1 downsampling relationship between the major and minor components. In this case, one D component D [ i ] [ j ] and one E component E [ i ] [ j ] correspond to four (2 × 2) F components F [2i ] [2j ], F [2i +1] [2j ], F [2i ] [2j +1], F [2i +1] [2j +1 ]. If the resolution of the F component is 2M × 2N (2M component elements horizontally, 2N component elements vertically), i.e., the F component of the data set is F ═ F [ M ] [ N ]: M-0-2M-1, N-0-2N-1, the resolutions of the D and E components are M × N (M component elements horizontally, N component elements vertically), i.e., the D and E components of the dataset are D { D [ M ] [ N ]: m is 0 to M-1, N is 0 to N-1, and E is { E [ M ] [ N ]: m is 0 to M-1, and N is 0 to N-1. Where higher quality is also required for the subcomponents, a sampling format called 4:2:2 (422 for short) is often used, i.e. the sampling rate and size of the 2 subcomponents (D-component and E-component) of a data set (e.g. image or video) having a rectangular shape and 3 components are each half of the other principal component (F-component), i.e. there is a 2:1 downsampled relationship between the principal and subcomponents. In this case, in one direction (e.g., horizontal direction) of a data set (e.g., image or video), one D component D [ i ] [ j ] and one E component E [ i ] [ j ] correspond to two (2 × 1) F components F [2i ] [ j ] and F [2i +1] [ j ]. If the resolution of the F component is 2 mxn, i.e., the F component of the dataset is F ═ F [ M ] [ N ]: m is 0 to 2M-1, N is 0 to N-1, and the resolutions of the D and E components are mxn, respectively, i.e., the D and E components of the dataset are D { D [ M ] [ N ]: m is 0 to M-1, N is 0 to N-1, and E is { E [ M ] [ N ]: m is 0 to M-1, and N is 0 to N-1. In images and video in YUV or YCbCr or YCgCo color formats, the F, D, E components described above are typically the Y, U, V components or the Y, Cb, Cr components or the Y, Cg, Co components, respectively. In images and video in RGB color format, the F, D, E components described above are typically G, B, R components or G, R, B components, respectively. Where the data is an image or video, the sampling format is also often referred to as a chroma format. The chroma format in which the components all have the same sampling rate is referred to as the panchromatic format. The chroma format having a downsampled relationship between a part of components and another part of components is referred to as a downsampled chroma format.
In the downsampling format, the position where one secondary component is located (generally referred to as a secondary component position) and its element correspond to the positions where a plurality of primary components are located (generally referred to as primary component positions, which do not cause confusion even if simply referred to as positions) and their elements. This one-to-many correspondence has uncertainty. To remove such uncertainty, it is common to previously designate a primary component positive position and its positive element (e.g., designate a 2x2 position and its element at the upper left corner among the positions of secondary components and their elements or a 2x1 position and its element at the left side among the positions of secondary components and their elements as a primary component positive position and its element) among a plurality of positions (e.g., 2x2 positions in 420 format or 2x1 positions in 422 format) and their elements corresponding to one secondary component position and its element as unique regular primary component positions and their elements in one-to-one correspondence with the secondary component positions and their elements. The primary component position and the secondary component position have a one-to-one correspondence relationship, and therefore, the primary component position and the secondary component position are collectively referred to as a "positive position", which means that the position is both a primary component positive position and a secondary component position, and the positive position and the secondary component position also have a one-to-one correspondence relationship, and the positions other than the positive position among the positions corresponding to one secondary component position are referred to as "non-positive positions". The positive element of the primary component and the secondary component element also have a one-to-one correspondence relationship, and therefore, the positive element of the primary component and the secondary component element are collectively called a positive element, which means that the element is both a positive element of the primary component and a secondary component element, the positive element and the secondary component element also have a one-to-one correspondence relationship, and the other elements except the positive element among the plurality of elements corresponding to one secondary component element are all called non-positive elements. On the other hand, in the full-sampling format, all positions are considered as principal component positive positions and positive positions, and all elements are considered as principal component positive elements and positive elements.
In the case where the data is an array or sequence of arrays of two-dimensional data elements in 420 sample format, there is one primary component F and two secondary components D and E;
the sampling rate and size of the secondary components D and E are respectively one quarter of that of the primary component F, i.e. there is a downsampling relationship of 4:1, i.e. 2x2:1, between the primary and secondary components;
one D component element D [ i ] [ j ] and one E component element E [ i ] [ j ] correspond to 2 × 2, that is, 4F component elements F [2i ] [2j ], F [2i +1] [2j ], F [2i ] [2j +1], F [2i +1] [2j +1 ];
the resolution of the F component elements is 2 mx 2N, i.e., the F component elements form an array F ═ F [ M ] [ N ]: m is 0 to 2M-1, N is 0 to 2N-1},
the resolution of the D component elements is M × N, i.e., the D component elements form an array D ═ D [ M ] [ N ]: m is 0 to M-1, N is 0 to N-1},
the resolution of the E component elements is also M × N, i.e., the E component elements form an array E ═ { E [ M ] [ N ]: m is 0 to M-1, and N is 0 to N-1.
The main component positive element at the pre-designated positive position is F2 i 2j, which is called the upper left corner type main component positive position and its positive element;
or,
the main component positive element on the preassigned positive position is F [2i +1] [2j ], which is called the upper right corner type main component positive position and the positive element thereof;
or,
the main component positive element at the pre-designated positive position is F [2i ] [2j +1], which is called the main component positive position of the lower left corner type and the positive element thereof;
or,
the positive element of the principal component at the pre-specified positive position is F [2i +1] [2j +1], referred to as the lower right corner type positive position of the principal component and its positive element.
In the case of a data set divided into whole compression units, one predetermined rule of ordering is to first order the whole compression units and then order the elements within each whole compression unit.
Due to the diversity of data, particularly mixed video content data, it is necessary to compress it using multiple coding modes. Common coding modes include intra prediction, inter prediction, intra block prediction, string prediction, general string prediction, line prediction.
In the prior art, there are two different colorimetric approaches as follows.
Full-color mode: all encoding modes employ a full sample format, such as 444 sample format.
Mixed color mode: the coding modes are divided into two predetermined classes, the first class of coding modes employing a fully sampled format, such as 444 sample format, and the second class of coding modes employing a downsampled format, such as 420 sample format.
In the prior art, a full-color mode and a mixed-color mode are used independently and singly respectively. A data set uses only a single panchromatic mode or only a single mixed chromaticity mode. That is, only a single panchromatic mode or only a single mixed chrominance mode is used for one compressed data stream.
However, there may be a variety of contents within one data set, some suitable for using the full-chroma mode and some suitable for using the mixed-chroma mode. Existing techniques that use a single chrominance approach (either a single panchromatic approach or a single mixed chrominance approach) significantly reduce the coding efficiency for a large class of video content data.
Therefore, it is very significant to develop an image signal processing method capable of fusing full chroma and mixed chroma.
Disclosure of Invention
Due to the defects in the prior art, the invention provides an image coding and decoding method, device and equipment fusing a full chroma mode and a mixed chroma mode and application thereof, and overcomes the defects that the prior art only can use a single chroma mode and has low coding efficiency.
In order to achieve the purpose, the invention provides the following technical scheme:
the method of the invention is specifically that when a data set is coded or a compressed data code stream is decoded, according to a predetermined condition, a full chroma mode is used for data of one part of contents and a mixed chroma mode is used for data of the other part of contents. That is, in the encoding or decoding process, if a predetermined condition is satisfied, the full-chroma mode is used; otherwise, a mixed chroma approach is used. For a large class of video content data, the coding efficiency can be effectively improved by fusing the full-chroma mode and the mixed-chroma mode.
Preferably (preferably 1) of the number of,
including one of the following features,
the method is characterized in that:
dividing a data set and a corresponding compressed data code stream thereof into a plurality of data subsets consisting of integral whole compression units and corresponding code stream subsets thereof; judging whether a preset condition is met or not by taking the data subset and the corresponding code stream subset as a unit; if the preset condition is met, using a full-chroma mode; otherwise, using a mixed chroma mode;
and (2) feature:
dividing a data set and a corresponding compressed data code stream thereof into a plurality of data subsets consisting of integral compression units and corresponding code stream subsets; judging whether a preset condition is met or not by taking the data subset and the corresponding code stream subset as a unit; if the preset condition is met, using a full-chroma mode; otherwise, using a mixed chroma mode; in the hybrid chroma mode, the first type of coding mode at least comprises a general string prediction coding mode, and the second type of coding mode at least comprises a traditional intra prediction coding mode which is also called a common intra prediction coding mode;
and (3) feature:
dividing a data set and a corresponding compressed data code stream thereof into a plurality of data subsets consisting of integral compression units and corresponding code stream subsets; judging whether a preset condition is met or not by taking the data subset and the corresponding code stream subset as a unit; if the preset condition is met, using a full-chroma mode; otherwise, using a mixed chroma mode; in the mixed chroma mode, the first type of coding mode at least comprises a universal serial prediction coding mode, and the second type of coding mode at least comprises a traditional intra-frame prediction coding mode which is also called a common intra-frame prediction coding mode; the coding mode is a coding mode of the entire compression unit.
Preferably (preferably 2) of the number of,
in the encoding method or apparatus, a first encoding method or apparatus,
precoding a data subset by using two chrominance modes, namely a full chrominance mode and a mixed chrominance mode respectively;
and/or
Determining whether the content of a subset of data is purely natural video (including natural images) content or hybrid video (including hybrid images) content or content with other predetermined characteristics;
selecting an optimal chrominance mode according to the result of precoding and/or judgment;
the predetermined condition is that the optimal chromaticity mode is a full chromaticity mode: if the optimal chroma mode is a full chroma mode, the data subset is encoded by using the full chroma mode, otherwise, the data subset is encoded by using a mixed chroma mode;
writing information representing the optimal chrominance mode into a compressed data code stream;
in the decoding method or apparatus, a decoding unit,
analyzing the compressed data code stream to obtain information representing an optimal chrominance mode of each code stream subset, wherein the predetermined condition is that the optimal chrominance mode is a full chrominance mode: and if the optimal chroma mode is the full chroma mode, decoding the code stream subset by using the full chroma mode, otherwise, decoding the code stream subset by using the mixed chroma mode.
Preferably (preferably 3) of the number of,
in the encoding method or encoding apparatus or decoding method or decoding apparatus or in the above preferences, the raw data (i.e. the data set in the corresponding encoding method) is a sequence comprising an image, a sequence of images, an array or array of two-dimensional data elements of a video;
the compression subset and the corresponding code stream segment thereof comprise one or a combination of the following coding units: picture, sub-picture of picture, tile, slice patch;
the maximum compression unit and the corresponding code stream segment thereof comprise one or the combination of the following coding units: a tile, a maximum coding unit LCU and a coding tree unit CTU;
the whole compression unit and the corresponding code stream section thereof comprise one or the combination of the following coding units: a macroblock, a coding unit CU, a sub-region of a CU, a sub-coding unit SubCU, a prediction block, a prediction unit PU, a sub-region of a PU, a sub-prediction unit SubPU, a transform block, a transform unit TU, a sub-region of a TU, a sub-transform unit SubTU;
the data subsets and the corresponding code stream subsets comprise one or a combination of the following coding units: a sequence, a sub-sequence of a sequence, a picture, a sub-picture of a picture, a tile, a slice, an integer number of largest coding units LCU, a largest coding unit LCU, an integer number of coding tree units CTU, a coding tree unit CTU, an integer number of coding units CU, a coding unit CU.
Preferably (preferably 4) of the number of,
information representing the optimal chroma mode is contained in a head unit of the code stream subset in a form of direct existence or implicit derivation or a mixed form of the two;
the directly existing form is composed of one or more syntax elements in a compressed data code stream;
the implicitly derived form is an agreed syntax element default value or a parameter or variable derived from other coding parameters and/or codec variables and/or other syntax elements of the compressed data stream;
the form of the mixing of the two is a mixing of the direct existence and the implicit derivation of the two forms;
the head unit of the code stream subset comprises one or a combination of the following head units:
1) a sequence parameter set;
2) a set of image parameters;
3) a sequence header;
4) an image head;
5) tile header;
6) a slice header;
7) a patch head;
8) a Largest Coding Unit (LCU) header;
9) a Coding Tree Unit (CTU) header;
10) a coding unit CU header;
11) encoding and decoding a block header;
12) and (4) the whole compression unit head.
Preferably (preferably 5) of the total weight of the composition,
including one of the following features that may be included,
the method is characterized in that:
the data subsets and their corresponding code stream subsets are sequences; the information representing the optimal chroma mode is the following syntax element non-temporal _ StringPrection _ Enable _ flag, which is present directly in the sequence parameter set and/or sequence header:
| sequence header definition or sequence parameter set definition | Descriptor(s) |
| sequence _ header () { or sequence _ parameter _ set () } | |
| ………… | |
| universal_string_prediction_enable_flag | u(1) |
| ………… | |
| } |
The value of the univariate _ string _ prediction _ enable _ flag is 0, which indicates that the current sequence is coded and decoded by using a full-chroma mode (a full-chroma mode is used relative to the optimal chroma mode), otherwise, the current sequence is coded and decoded by using a mixed chroma mode;
and (2) feature:
the data subsets and their corresponding code stream subsets are sequences; the information representing the optimal chroma mode is the following syntax element spatial _ String _ prediction _ enable _ flag, which is present directly in the sequence parameter set and/or the sequence header:
| sequence header definition or sequence parameter set definition | Descriptor(s) |
| sequence _ header () { or sequence _ parameter _ set () check-in space | |
| ………… | |
| universal_string_prediction_enable_flag | u(1) |
| ………… | |
| } |
The value of the univariate _ string _ prediction _ enable _ flag is 0, which indicates that the current sequence is coded and decoded by using a full-chroma mode (a full-chroma mode is used relative to the optimal chroma mode), otherwise, the current sequence is coded and decoded by using a mixed chroma mode;
when the current sequence is coded and decoded by using a full-chroma mode, all coding units CU in the current sequence are coded and decoded by adopting a full-sampling format no matter which coding mode is the coding mode; when a mixed chroma mode is used for coding and decoding a current sequence, a down-sampling format is adopted for coding and decoding a coding unit CU of a traditional intra-frame prediction coding mode in the current sequence, which is also called a common intra-frame prediction coding mode, and a full-sampling format is adopted for coding and decoding a coding unit CU of a non-traditional intra-frame prediction coding mode in the current sequence.
Preferably (preferably 6) of the number of,
on the basis of the above preferred 5, the following features are also provided:
in the decoder, the variables CuTypeUspFlag and IntraCuFlag are used to represent the coding mode of the coding unit CU; under the condition that the value of univeral _ string _ prediction _ enable _ flag is 1, when the value of CuTypeUspFlag is 0 and the value of IntraCuFlag is 1, dividing a coding unit into an intra-frame prediction block and a transformation block in a 4:2:0 format mode, performing transformation block decoding, intra-frame prediction and prediction compensation to generate compensated samples in a 4:2:0 format mode, and then performing chroma upsampling according to the following regulation to obtain compensated samples in a 4:4:4 format mode; otherwise, dividing the coding unit into an inter-frame prediction unit, an intra-frame prediction block and a transformation block in a 4:4:4 format mode, performing transformation block decoding, inter-frame prediction, universal string prediction and prediction compensation to generate compensated samples in a 4:4:4 format, and then performing chroma down-sampling according to the following specification to obtain compensated samples in a 4:2:0 format for reference samples of a subsequent intra-frame prediction block;
the specifications for chroma downsampling and upsampling between the 4:2:0 format and the 4:4:4 format are:
obtaining a chrominance sample matrix C420[ i ] [ j ] of compensated samples in a 4:2:0 format from a chrominance sample matrix C444[ i ] [ j ] (i ═ 0-2M-1, j ═ 0-2N-1) of compensated samples in a 4:4:4 format by the following method:
C420[i][j]＝(C444[2i][2j]+C444[2i+1][2j]+C444[2i][2j+1]+C444[2i+1][2j+1]+2)>>2
wherein i is 0 to M-1, and j is 0 to N-1;
obtaining a chrominance sample matrix C444[ i ] [ j ] (i is 0 to 2M-1, j is 0 to 2N-1) of compensated samples in a 4:4:4 format from a chrominance sample matrix C420[ i ] [ j ] (i is 0 to M-1, j is 0 to N-1) of compensated samples in a 4:2:0 format by:
C444[2i][2j]＝C420[i][j]
C444[2i+1][2j]＝C420[i][j]
C444[2i][2j+1]＝C420[i][j]
C444[2i+1][2j+1]＝C420[i][j]
wherein i is 0 to M-1, and j is 0 to N-1.
According to a first aspect of the present invention, the present invention provides an image coding method for fusing a full chroma mode and a mixed chroma mode, comprising at least the following steps:
1) inputting at least one data set;
2) coding data of one part of content by using a full chroma mode and coding data of the other part of content by using a mixed chroma mode according to at least a preset condition; if the predetermined condition is met, using a full-chroma mode as an optimal chroma mode for coding; otherwise, using a mixed chroma mode as an optimal chroma mode for coding; in the panchromatic mode, all encoding modes adopt a full sampling format; in the mixed chroma mode, the coding modes are divided into two predetermined types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a down sampling format;
3) and at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode is output.
According to a second aspect of the present invention, there is provided an image encoding apparatus fusing a full-chroma mode and a mixed-chroma mode, comprising at least the following modules:
1) an input module: inputting at least one data set;
2) the coding module: coding data of one part of content by using a full chroma mode and coding data of the other part of content by using a mixed chroma mode according to at least a preset condition; if the predetermined condition is met, using a full chroma mode as an optimal chroma mode to carry out coding; otherwise, using a mixed chroma mode as an optimal chroma mode to carry out coding; in the panchromatic mode, all encoding modes adopt a full sampling format; in the mixed chroma mode, the coding modes are divided into two predetermined types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a down sampling format;
3) an output module: and at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode is output.
According to a third aspect of the present invention, the present invention provides an image decoding method fusing a full-chroma mode and a mixed-chroma mode, comprising at least the following steps:
1) inputting at least one compressed data code stream set which is fused with a full chroma mode and a mixed chroma mode and at least contains information representing an optimal chroma mode;
2) analyzing the compressed data code stream to at least obtain information representing an optimal chrominance mode;
3) decoding data of a part of contents by using a full chroma mode and decoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition comprising an optimal chroma mode; if the predetermined condition is satisfied, decoding by using a full-chroma mode as an optimal chroma mode; otherwise, decoding by using a mixed chroma mode as an optimal chroma mode, wherein all coding modes adopt a full sampling format in the full chroma mode; in the mixed chroma mode, the coding modes are divided into two preset types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a downsampling format;
4) at least the reconstructed elements are output.
According to a fourth aspect of the present invention, there is provided an image decoding apparatus fusing a full-chroma mode and a mixed-chroma mode, comprising at least the following modules:
1) an input module: inputting at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode;
2) an analysis module: analyzing the compressed data code stream to at least obtain information representing an optimal chrominance mode;
3) a decoding module: decoding data of a part of contents by using a full chroma mode and decoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition comprising an optimal chroma mode; if the predetermined condition is satisfied, decoding by using a full-chroma mode as an optimal chroma mode; otherwise, decoding by using a mixed chroma mode as an optimal chroma mode, wherein all coding modes adopt a full sampling format in the full chroma mode; in the mixed chroma mode, the coding modes are divided into two preset types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a downsampling format;
4) an output module: at least the reconstructed elements are output.
The present invention is applicable to encoding and decoding for lossy compression of data, and is also applicable to encoding and decoding for lossless compression of data. The invention is suitable for encoding and decoding one-dimensional data such as character string data or byte string data or one-dimensional graphics or fractal graphics, and is also suitable for encoding and decoding data with two or more dimensions such as images, image sequences or video data.
In the present invention, the data involved in data compression includes one or a combination of the following types of data:
one-dimensional data;
two-dimensional data;
multidimensional data;
a graph;
dimension division graphics;
an image;
a sequence of images;
video;
audio frequency;
a file;
a byte;
a bit;
a pixel;
a three-dimensional scene;
a sequence of continuously changing three-dimensional scenes;
a virtual reality scene;
sequence of scenes of continuously changing virtual reality
An image in the form of pixels;
transform domain data of the image;
a set of two or more bytes;
a set of bits in two or more dimensions;
a set of pixels;
a set of single component pixels;
a set of three-component pixels (R, G, B, A);
a set of three-component pixels (Y, U, V);
a set of three-component pixels (Y, Cb, Cr);
a set of three-component pixels (Y, Cg, Co);
a set of four component pixels (C, M, Y, K);
a set of four component pixels (R, G, B, A);
a set of four component pixels (Y, U, V, A);
a set of four component pixels (Y, Cb, Cr, A);
a set of four component pixels (Y, Cg, Co, a).
The technical features of the present invention are explained above by specific embodiments. Other advantages and effects of the present invention will be readily apparent to those skilled in the art from the disclosure herein. The invention is capable of other and different embodiments and of being practiced or of being carried out in various ways, and its several details are capable of modification in various respects, all without departing from the spirit and scope of the present invention.
Drawings
The invention and its features will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following figures.
FIG. 1 is a schematic diagram of a step sequence of an image encoding method or an image encoding apparatus processing according to the present invention, wherein the method combines a full-color mode and a mixed-color mode;
fig. 2 is a schematic step diagram of an image decoding method or an image decoding apparatus processing step diagram of a fusion panchromatic mode and a mixed chrominance mode according to the present invention.
Detailed Description
The structure of the present invention will be further described with reference to the accompanying drawings and specific examples, but the present invention is not limited thereto.
The following units and the like involved in the method and apparatus are specifically as follows:
the raw data is a sequence comprising an image, a sequence of images, an array or array of two-dimensional data elements of a video;
the compression subset and the corresponding code stream segment thereof comprise one or a combination of the following coding units: an image, a sub-image of an image, a tile, a slice, a slice patch;
the maximum compression unit and the corresponding code stream segment thereof comprise one or the combination of the following coding units: a tile, a maximum coding unit LCU and a coding tree unit CTU;
the whole compression unit and the corresponding code stream section thereof comprise one or the combination of the following coding units: a macroblock, a coding unit CU, a sub-region of a CU, a sub-coding unit SubCU, a prediction block, a prediction unit PU, a sub-region of a PU, a sub-prediction unit SubPU, a transform block, a transform unit TU, a sub-region of a TU, a sub-transform unit SubTU;
the data subsets and the corresponding code stream subsets comprise one or a combination of the following coding units: a sequence, a sub-sequence of a sequence, a picture, a sub-picture of a picture, a tile, a slice, an integer number of largest coding units LCU, a largest coding unit LCU, an integer number of coding tree units CTU, a coding tree unit CTU, an integer number of coding units CU, a coding unit CU.
An image encoding method combining a panchromatic mode and a mixed chrominance mode is disclosed, as shown in fig. 1, and comprises the following steps:
(1) inputting at least one data set;
(2) encoding data of a part of contents by using a full chroma mode and encoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition; if the predetermined condition is met, using a full-chroma mode as an optimal chroma mode for coding; otherwise, using a mixed chroma mode as an optimal chroma mode for coding; in the full-chrominance mode, all encoding modes adopt a full-sampling format; in the mixed chroma mode, the coding modes are divided into two predetermined types, the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a downsampling format;
(3) and at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode is output.
Preferably, a data set is divided into a plurality of data subsets consisting of an integer number of whole compression units; judging whether a preset condition is met or not by taking the data subset as a unit (the optimal chroma mode is a full chroma mode); if the preset condition is met, using a full-chroma mode; otherwise, a mixed-chroma approach is used.
Preferably, in the hybrid chroma mode, the first type of coding modes at least include common serial prediction coding modes, and the second type of coding modes at least include conventional intra prediction coding modes, also referred to as common intra prediction coding modes.
Preferably, the coding mode is a coding mode of the entire compression unit.
Preferably, a data subset is pre-coded by using two chrominance modes, namely a full chrominance mode and a mixed chrominance mode;
and/or
Determining whether the content of a subset of data is purely natural video (including natural images) content or hybrid video (including hybrid images) content or content with other predetermined characteristics;
selecting an optimal chrominance mode according to the result of precoding and/or judgment;
the predetermined condition is that the optimum chromaticity mode is a full-chromaticity mode: if the optimal chroma mode is a full chroma mode, the data subset is coded by using a full chroma mode, otherwise, the data subset is coded by using a mixed chroma mode;
and at least writing information representing the optimal chroma mode into the compressed data code stream.
Preferably, the subset of data is a sequence; the information representing the optimal chroma mode is the following syntax element spatial _ String _ prediction _ enable _ flag, which is present directly in the sequence parameter set and/or the sequence header:
| sequence header definition or sequence parameter set definition | Descriptor(s) |
| sequence _ header () { or sequence _ parameter _ set () } | |
| ………… | |
| universal_string_prediction_enable_flag | u(1) |
| ………… | |
| } |
A value of 0 for spatial _ StringPredictionEnable _ flag indicates that the current sequence is encoded using a full chroma mode, otherwise, the current sequence is encoded using a mixed chroma mode.
Preferably, when the current sequence is coded and decoded by using a full chroma mode, all Coding Units (CU) in the current sequence are coded by adopting a full sampling format no matter which coding mode is the coding mode; when a mixed chroma mode is used for coding a current sequence, a down-sampling format is adopted for coding a coding unit CU of a traditional intra-frame prediction coding mode in the current sequence, which is also called a common intra-frame prediction coding mode, and a full-sampling format is adopted for coding a coding unit CU of a non-traditional intra-frame prediction coding mode in the current sequence.
An image coding device fusing a panchromatic mode and a mixed chroma mode comprises the following modules:
(1) an input module: inputting at least one data set;
(2) the coding module: coding data of one part of content by using a full chroma mode and coding data of the other part of content by using a mixed chroma mode according to at least a preset condition; if the predetermined condition is met, using a full-chroma mode as an optimal chroma mode for coding; otherwise, using a mixed chroma mode as an optimal chroma mode for coding; in the full-chrominance mode, all encoding modes adopt a full-sampling format; in the mixed chroma mode, the coding modes are divided into two predetermined types, the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a down sampling format;
(3) an output module: and at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode is output. The specific setting in the image encoding device is the same as the image encoding method of the merged panchromatic scheme and the mixed chroma scheme described above.
An image decoding method combining a full-color mode and a mixed-color mode is disclosed, as shown in fig. 2, and includes the following steps:
(1) inputting at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode;
(2) analyzing the compressed data code stream to at least obtain information representing an optimal chrominance mode;
(3) decoding data of a part of contents by using a full chroma mode and decoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition comprising an optimal chroma mode; if the predetermined condition is satisfied, decoding by using a full-chroma mode as an optimal chroma mode; otherwise, decoding by using a mixed chroma mode as an optimal chroma mode, wherein all coding modes adopt a full sampling format in a full chroma mode; in the mixed chroma mode, the coding modes are divided into two predetermined types, the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a downsampling format;
(4) at least the reconstruction elements are output.
Preferably, the compressed data code stream set is divided into a plurality of code stream subsets composed of integral whole compression units; judging whether a predetermined condition is met or not by taking the code stream subset as a unit (the optimal chroma mode is a full chroma mode); if the preset condition is met, using a full-chroma mode; otherwise, a mixed chroma approach is used.
Preferably, in the hybrid chroma mode, the first class of coding modes at least includes common serial prediction coding modes, and the second class of coding modes at least includes conventional intra prediction coding modes also called common intra prediction coding modes.
Preferably, the coding mode is a coding mode of the entire compression unit.
Preferably, the compressed data code stream is analyzed, and information representing the optimal chrominance mode of each code stream subset is at least obtained, wherein the predetermined condition is that the optimal chrominance mode is a full chrominance mode: and if the optimal chroma mode is the full chroma mode, decoding the code stream subset by using the full chroma mode, otherwise, decoding the code stream subset by using the mixed chroma mode.
Preferably, the information representing the optimal chroma mode is contained in the head unit of the codestream subset in a form of direct existence or implicit derivation or a mixture of the two;
the directly existing form is composed of one or more syntax elements in the compressed data code stream;
implicitly derived in the form of agreed syntax element default values or parameters or variables derived from other coding parameters and/or codec variables and/or other syntax elements of the compressed data stream;
the form of mixing both is a mixture of the direct presence and the implicit derivation; the head unit of the code stream subset comprises one or a combination of the following head units:
1) a sequence parameter set;
2) a set of image parameters;
3) a sequence header;
4) an image head;
5) tile header;
6) a strip slice head;
7) a patch head;
8) a Largest Coding Unit (LCU) header;
9) a Coding Tree Unit (CTU) head;
10) a coding unit CU header;
11) encoding and decoding a block header;
12) and (4) the whole compression unit head.
Preferably, the subset of codestreams is a sequence; the information representing the optimal chroma mode is the following syntax element spatial _ String _ prediction _ enable _ flag, which is present directly in the sequence parameter set and/or the sequence header:
| sequence header definition or sequence parameter set definition | Descriptor(s) |
| sequence _ header () { or sequence _ parameter _ set () check-in space | |
| ………… | |
| universal_string_prediction_enable_flag | u(1) |
| ………… | |
| } |
A value of universal _ Stringjprediction _ Enable _ flag of 0 indicates that the current sequence is decoded using a full chroma mode, otherwise, the current sequence is decoded using a mixed chroma mode.
Preferably, when the current sequence is decoded by using a full-chroma mode, all coding units CU in the current sequence are decoded by using a full-sampling format regardless of a coding mode of the coding units CU; when the mixed chroma mode is used for decoding the current sequence, the coding unit CU of a traditional intra-frame prediction coding mode in the current sequence, which is also called a common intra-frame prediction coding mode, is decoded by adopting a down-sampling format, and the coding unit CU of a non-traditional intra-frame prediction coding mode in the current sequence is decoded by adopting a full-sampling format.
Preferably, the variables CuTypeUspFlag and IntraCuFlag are used to represent the coding mode of the coding unit; under the condition that the value of univeral _ string _ prediction _ enable _ flag is 1, when the value of CuTypeUspFlag is 0 and the value of IntraCuFlag is 1, dividing a coding unit into an intra-frame prediction block and a transformation block in a 4:2:0 format mode, performing transformation block decoding, intra-frame prediction and prediction compensation to generate compensated samples in a 4:2:0 format mode, and then performing chroma upsampling according to the following regulation to obtain compensated samples in a 4:4:4 format mode; otherwise, dividing the coding unit into an inter-frame prediction unit, an intra-frame prediction block and a transformation block in a 4:4:4 format mode, performing transformation block decoding, inter-frame prediction, universal string prediction and prediction compensation to generate compensated samples in a 4:4:4 format, and then performing chroma down-sampling according to the following specification to obtain compensated samples in a 4:2:0 format for reference samples of a subsequent intra-frame prediction block;
the specifications for chroma downsampling and upsampling between the 4:2:0 format and the 4:4:4 format are:
obtaining a chrominance sample matrix C420[ i ] [ j ] of compensated samples in a 4:2:0 format from a chrominance sample matrix C444[ i ] [ j ] (i ═ 0-2M-1, j ═ 0-2N-1) of compensated samples in a 4:4:4 format by the following method:
C420[i][j]＝(C444[2i][2j]+C444[2i+1][2j]+C444[2i][2j+1]+C444[2i+1][2j+1]+2)>>2
wherein i is 0 to M-1, and j is 0 to N-1;
obtaining a chrominance sample matrix C444[ i ] [ j ] (i is 0 to 2M-1, j is 0 to 2N-1) of compensated samples in a 4:4:4 format from a chrominance sample matrix C420[ i ] [ j ] (i is 0 to M-1, j is 0 to N-1) of compensated samples in a 4:2:0 format by the following method:
C444[2i][2j]＝C420[i][j]
C444[2i+1][2j]＝C420[i][j]
C444[2i][2j+1]＝C420[i][j]
C444[2i+1][2j+1]＝C420[i][j]
wherein i is 0 to M-1, and j is 0 to N-1.
An image decoding device fusing a panchromatic mode and a mixed chrominance mode comprises the following modules:
(1) an input module: inputting at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode;
(2) an analysis module: analyzing the compressed data code stream to at least obtain information representing an optimal chrominance mode;
(3) a decoding module: decoding data of a part of contents by using a full chroma mode and decoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition comprising an optimal chroma mode; if the predetermined condition is satisfied, decoding by using a full-chroma mode as an optimal chroma mode; otherwise, decoding by using a mixed chrominance mode as an optimal chrominance mode, wherein in a full chrominance mode, all encoding modes adopt a full sampling format; in the mixed chroma mode, the coding modes are divided into two predetermined types, the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a down sampling format;
(4) an output module: at least the reconstruction elements are output. The specific setting in the image decoding apparatus is the same as the image decoding method of the merged panchromatic scheme and the mixed chroma scheme described above.
Those skilled in the art will appreciate that variations may be implemented by those skilled in the art in combination with the prior art and the above-described embodiments, and will not be described herein in detail. Such variations do not affect the essence of the present invention and are not described herein.
The above description is of the preferred embodiment of the invention. It is to be understood that the invention is not limited to the particular embodiments described above, in that devices and structures not described in detail are understood to be implemented in a manner common in the art; those skilled in the art can make many possible variations and modifications to the disclosed embodiments, or modify equivalent embodiments to equivalent variations, without departing from the spirit of the invention, using the methods and techniques disclosed above. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention are within the scope of the technical solution of the present invention, unless the technical essence of the present invention is not departed from the content of the technical solution of the present invention.
Claims (10)
1. An image coding method for fusing a panchromatic mode and a mixed chrominance mode is characterized by at least comprising the following steps:
(1) inputting at least one data set;
(2) coding data of one part of content by using a full chroma mode and coding data of the other part of content by using a mixed chroma mode according to at least a preset condition; if the predetermined condition is met, using a full-chroma mode as an optimal chroma mode for coding; otherwise, using a mixed chroma mode as an optimal chroma mode to carry out coding; in the panchromatic mode, all encoding modes adopt a full sampling format; in the mixed chroma mode, the coding modes are divided into two preset types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a downsampling format;
(3) and at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode is output.
2. An image encoding device for fusing a panchromatic mode and a mixed chrominance mode, comprising at least the following modules:
(1) an input module: inputting at least one data set;
(2) and an encoding module: coding data of one part of content by using a full chroma mode and coding data of the other part of content by using a mixed chroma mode according to at least a preset condition; if the predetermined condition is met, using a full chroma mode as an optimal chroma mode to carry out coding; otherwise, using a mixed chroma mode as an optimal chroma mode for coding; in the panchromatic mode, all encoding modes adopt a full sampling format; in the mixed chroma mode, the coding modes are divided into two predetermined types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a down sampling format;
(3) an output module: and at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode is output.
3. An image decoding method for fusing a panchromatic mode and a mixed chrominance mode is characterized by at least comprising the following steps:
(1) inputting at least one compressed data code stream set which is fused with a full chroma mode and a mixed chroma mode and at least contains information representing an optimal chroma mode;
(2) analyzing the compressed data code stream to at least obtain information representing an optimal chrominance mode;
(3) decoding data of a part of contents by using a full chroma mode and decoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition comprising an optimal chroma mode; if the predetermined condition is met, decoding by using a full chroma mode as an optimal chroma mode; otherwise, decoding by using a mixed chroma mode as an optimal chroma mode, wherein all coding modes adopt a full sampling format in the full chroma mode; in the mixed chroma mode, the coding modes are divided into two predetermined types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a down sampling format;
(4) at least the reconstruction elements are output.
4. An image decoding device for fusing a panchromatic mode and a mixed chrominance mode is characterized by at least comprising the following modules:
(1) an input module: inputting at least one compressed data code stream set which is fused with the full chroma mode and the mixed chroma mode and at least contains information representing the optimal chroma mode;
(2) an analysis module: analyzing the compressed data code stream to at least obtain information representing an optimal chrominance mode;
(3) and a decoding module: decoding data of a part of contents by using a full chroma mode and decoding data of another part of contents by using a mixed chroma mode according to at least a predetermined condition comprising an optimal chroma mode; if the predetermined condition is met, decoding by using a full chroma mode as an optimal chroma mode; otherwise, decoding by using a mixed chroma mode as an optimal chroma mode, wherein all coding modes adopt a full sampling format in the full chroma mode; in the mixed chroma mode, the coding modes are divided into two preset types, wherein the first type of coding mode adopts a full sampling format, and the second type of coding mode adopts a downsampling format;
(4) an output module: at least the reconstruction elements are output.
5. The image decoding method according to claim 3 or the image decoding apparatus according to claim 4, characterized by comprising one of the following features,
the method is characterized in that:
dividing a data set and a corresponding compressed data code stream thereof into a plurality of data subsets consisting of integral whole compression units and corresponding code stream subsets thereof; judging whether a preset condition is met or not by taking the data subset and the corresponding code stream subset as a unit; if the preset condition is met, using a full-chroma mode; otherwise, using a mixed chroma mode;
and (2) feature:
dividing a data set and a corresponding compressed data code stream thereof into a plurality of data subsets consisting of integral compression units and corresponding code stream subsets; judging whether a preset condition is met or not by taking the data subset and the corresponding code stream subset as a unit; if the preset condition is met, using a full-chroma mode; otherwise, using a mixed chroma mode; in the hybrid chroma mode, the first type of coding mode at least comprises a general string prediction coding mode, and the second type of coding mode at least comprises a traditional intra prediction coding mode which is also called a common intra prediction coding mode;
and (3) feature:
dividing a data set and a corresponding compressed data code stream thereof into a plurality of data subsets consisting of integral compression units and corresponding code stream subsets; judging whether a preset condition is met or not by taking the data subset and the corresponding code stream subset as a unit; if the preset condition is met, using a full-chroma mode; otherwise, using a mixed chroma mode; in the mixed chroma mode, the first type of coding mode at least comprises a universal serial prediction coding mode, and the second type of coding mode at least comprises a traditional intra-frame prediction coding mode which is also called a common intra-frame prediction coding mode; the coding mode is a coding mode of the entire compression unit.
6. The image decoding method or the image decoding apparatus according to claim 5, wherein the compressed data code streams are parsed to obtain at least information indicating an optimal chroma mode for each of the code stream subsets, and the predetermined condition is that the optimal chroma mode is a full chroma mode: if the optimal chroma mode is a full chroma mode, the data subset is decoded using a full chroma mode, otherwise, the data subset is decoded using a mixed chroma mode.
7. The image decoding method or the image decoding apparatus according to claim 3, 4, 5, or 6, wherein the original data is a sequence including an image, a sequence of images, an array of two-dimensional data elements of a video, or a sequence of arrays;
the compression subset and the corresponding code stream segment thereof comprise one or a combination of the following coding units: picture, sub-picture of picture, tile, slice patch;
the maximum compression unit and the corresponding code stream segment thereof comprise one or the combination of the following coding units: tile, LCU, CTU;
the whole compression unit and the corresponding code stream segment thereof comprise one or the combination of the following coding units: a macroblock, a coding unit CU, a sub-region of a CU, a sub-coding unit SubCU, a prediction block, a prediction unit PU, a sub-region of a PU, a sub-prediction unit SubPU, a transform block, a transform unit TU, a sub-region of a TU, a sub-transform unit SubTU;
the data subsets and the corresponding code stream subsets comprise one or a combination of the following coding units: a sequence, a sub-sequence of a sequence, a picture, a sub-picture of a picture, a tile, a slice, an integer number of largest coding units LCU, a largest coding unit LCU, an integer number of coding tree units CTU, a coding tree unit CTU, an integer number of coding units CU, a coding unit CU.
8. The image decoding method according to claim 3 or the image decoding apparatus according to claim 4, wherein the information representing the optimal chroma mode is included in a header unit of the bitstream subset in a form of direct existence or implicit derivation or a mixture of the two;
the directly existing form is composed of one or more syntax elements in a compressed data code stream;
the implicitly derived form is a default value of a default syntax element or a parameter or variable derived from other coding parameters and/or coding and decoding variables and/or other syntax elements of the compressed data stream;
the form of the mixing of the two is a mixing of the direct existence and the implicit derivation of the two forms;
the head unit of the code stream subset comprises one or a combination of the following head units:
1) a sequence parameter set;
2) a set of image parameters;
3) a sequence header;
4) an image head;
5) tile header;
6) a strip slice head;
7) a patch head;
8) a Largest Coding Unit (LCU) header;
9) a Coding Tree Unit (CTU) head;
10) a coding unit CU header;
11) encoding and decoding a block header;
12) and (4) the whole compression unit head.
9. The image decoding method or the image decoding apparatus according to claim 8, characterized by comprising one of the following features,
the method is characterized in that:
the data subsets and their corresponding code stream subsets are sequences; the information representing the optimal chroma mode is the following syntax element spatial _ String _ prediction _ enable _ flag, which is present directly in the sequence parameter set and/or the sequence header:
The value of the non-temporal _ string _ prediction _ enable _ flag is 0, which indicates that the current sequence is coded and decoded by using a full-chroma mode, otherwise, the current sequence is coded and decoded by using a mixed-chroma mode;
and (2) feature:
the data subsets and their corresponding code stream subsets are sequences; the information representing the optimal chroma mode is the following syntax element spatial _ String _ prediction _ enable _ flag, which is present directly in the sequence parameter set and/or the sequence header:
The value of the non-temporal _ string _ prediction _ enable _ flag is 0, which indicates that the current sequence is coded and decoded by using a full-chroma mode, otherwise, the current sequence is coded and decoded by using a mixed-chroma mode;
when the current sequence is coded and decoded by using a full-chroma mode, all coding units CU in the current sequence are coded and decoded by adopting a full-sampling format no matter which coding mode is the coding mode; when a mixed chroma mode is used for coding and decoding a current sequence, a down-sampling format is adopted for coding and decoding a coding unit CU of a traditional intra-frame prediction coding mode in the current sequence, which is also called a common intra-frame prediction coding mode, and a full-sampling format is adopted for coding and decoding a coding unit CU of a non-traditional intra-frame prediction coding mode in the current sequence.
10. The picture decoding method or device according to claim 9, wherein variables CuTypeUspFlag and IntraCuFlag are used to indicate an encoding mode of the encoding unit;
under the condition that the value of universal _ string _ prediction _ enable _ flag is 1, when the value of CuTypeUspFlag is 0 and the value of IntraCuFlag is 1, dividing a coding unit into an intra-frame prediction block and a transformation block in a mode of 4:2:0 format, performing transformation block decoding, intra-frame prediction and prediction compensation to generate compensated samples in a format of 4:2:0, and then performing chroma upsampling according to the following specification to obtain compensated samples in a format of 4:4: 4; otherwise, dividing the coding unit into an inter-frame prediction unit, an intra-frame prediction block and a transformation block in a 4:4:4 format mode, performing transformation block decoding, inter-frame prediction, universal string prediction and prediction compensation to generate compensated samples in a 4:4:4 format, and then performing chroma down-sampling according to the following specification to obtain compensated samples in a 4:2:0 format for reference samples of a subsequent intra-frame prediction block;
the specifications for chroma downsampling and upsampling between the 4:2:0 format and the 4:4:4 format are:
from the chrominance sample matrix C444[ i ] [ j ] (i 0 to 2M-1, j 0 to 2N-1) of compensated samples in 4:4:4 format, a chrominance sample matrix C420[ i ] [ j ] of compensated samples in 4:2:0 format is obtained as follows:
C420[i][j]＝(C444[2i][2j]+C444[2i+1][2j]+C444[2i][2j+1]+C444[2i+1][2j+1]+2)>>2
wherein i is 0 to M-1, and j is 0 to N-1;
obtaining a chrominance sample matrix C444[ i ] [ j ] (i is 0 to 2M-1, j is 0 to 2N-1) of compensated samples in a 4:4:4 format from a chrominance sample matrix C420[ i ] [ j ] (i is 0 to M-1, j is 0 to N-1) of compensated samples in a 4:2:0 format by:
C444[2i][2j]＝C420[i][j]
C444[2i+1][2j]＝C420[i][j]
C444[2i][2j+1]＝C420[i][j]
C444[2i+1][2j+1]＝C420[i][j]
wherein i is 0 to M-1, and j is 0 to N-1.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210491142.7A CN115037927B (en) | 2022-05-07 | 2022-05-07 | Image coding and decoding method and device integrating full chromaticity and mixed chromaticity |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210491142.7A CN115037927B (en) | 2022-05-07 | 2022-05-07 | Image coding and decoding method and device integrating full chromaticity and mixed chromaticity |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115037927A true CN115037927A (en) | 2022-09-09 |
| CN115037927B CN115037927B (en) | 2024-10-01 |
Family
ID=83119840
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210491142.7A Active CN115037927B (en) | 2022-05-07 | 2022-05-07 | Image coding and decoding method and device integrating full chromaticity and mixed chromaticity |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115037927B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009078736A1 (en) * | 2007-12-19 | 2009-06-25 | Tandberg Telecom As | Method for improving the colour sharpness in video- and still-images |
| WO2017211306A1 (en) * | 2016-06-08 | 2017-12-14 | 同济大学 | Methods and devices for decoding compressed stream of video data and encoding video data |
| CN108574845A (en) * | 2017-03-12 | 2018-09-25 | 上海天荷电子信息有限公司 | Dynamic uses the data compression method and device of a variety of sample formats |
| CN108989820A (en) * | 2017-06-03 | 2018-12-11 | 上海天荷电子信息有限公司 | Each stage uses the data compression method and device of respectively corresponding chroma |
| US20200213570A1 (en) * | 2019-01-02 | 2020-07-02 | Mediatek Inc. | Method for processing projection-based frame that includes at least one projection face and at least one padding region packed in 360-degree virtual reality projection layout |
-
2022
- 2022-05-07 CN CN202210491142.7A patent/CN115037927B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009078736A1 (en) * | 2007-12-19 | 2009-06-25 | Tandberg Telecom As | Method for improving the colour sharpness in video- and still-images |
| WO2017211306A1 (en) * | 2016-06-08 | 2017-12-14 | 同济大学 | Methods and devices for decoding compressed stream of video data and encoding video data |
| CN107483942A (en) * | 2016-06-08 | 2017-12-15 | 同济大学 | The decoding of video data compression code stream, the coding method of video data and device |
| CN108574845A (en) * | 2017-03-12 | 2018-09-25 | 上海天荷电子信息有限公司 | Dynamic uses the data compression method and device of a variety of sample formats |
| CN108989820A (en) * | 2017-06-03 | 2018-12-11 | 上海天荷电子信息有限公司 | Each stage uses the data compression method and device of respectively corresponding chroma |
| US20200213570A1 (en) * | 2019-01-02 | 2020-07-02 | Mediatek Inc. | Method for processing projection-based frame that includes at least one projection face and at least one padding region packed in 360-degree virtual reality projection layout |
Non-Patent Citations (2)
| Title |
|---|
| 张培君 等: "融合全色度LZMA与色度子采样HEVC的屏幕图像编码", 电子与信息学报, vol. 35, no. 1, 31 December 2013 (2013-12-31), pages 196 - 202 * |
| 赵利平 等: "一种多色度格式级联编码的AVS2全色度图像编码算法", 电信科学, no. 4, 31 December 2018 (2018-12-31), pages 57 - 67 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115037927B (en) | 2024-10-01 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102071764B1 (en) | Picture coding and decoding methods and devices | |
| US8369404B2 (en) | Moving image decoding device and moving image decoding method | |
| KR102243120B1 (en) | Encoding method and apparatus and decoding method and apparatus | |
| CN104754362B (en) | Image compression method using fine-divided block matching | |
| CN110830803B (en) | Image compression method combining block matching and string matching | |
| CN107483942B (en) | Decoding method of video data compressed code stream, encoding method and device of video data | |
| WO2023020560A1 (en) | Video coding and decoding method and apparatus, electronic device and storage medium | |
| CN111757117A (en) | Data coding and decoding method for performing serial prediction on component down-sampling format data | |
| CN113365074B (en) | Encoding and decoding method and device for limiting point prediction frequent position and point vector number thereof | |
| CN113395515B (en) | Coding and decoding method and device for point prediction of component down-sampling format data | |
| CN108574845B (en) | Data compression method and device dynamically adopting multiple sampling formats | |
| CN115037927B (en) | Image coding and decoding method and device integrating full chromaticity and mixed chromaticity | |
| CN108989819B (en) | Data compression method and device adopting respective corresponding color spaces for modes | |
| CN108989820B (en) | Data compression method and device adopting respective corresponding chroma sampling formats at all stages | |
| CN113938683A (en) | Coding and decoding method and device for point prediction chroma reconstruction value from multiple reference positions | |
| CN113452995A (en) | Data coding and decoding method and device with different scanning directions of current string and reference string | |
| CN115134605B (en) | Image encoding and decoding method and device using limited universal string prediction encoding mode | |
| CN117336491A (en) | Encoding and decoding method and device for increasing maximum value of point vector index value in point prediction | |
| CN117319663A (en) | Encoding and decoding method and device for multiplexing normal-present position with main component coming from point prediction | |
| CN117319665A (en) | Encoding and decoding method and device for representing unmatched element strings by aid of point vector index values | |
| CN114584792A (en) | Data encoding and decoding method and device for periodically updating value of point vector in point prediction | |
| CN115174929A (en) | Method and device for decoding serial prediction by sharing one buffer area by serial vectors and pixel values | |
| CN117319667A (en) | Encoding and decoding method and device for encoding length upper limit of unmatched element strings in current block | |
| CN117354376A (en) | Coding and decoding method and device adopting unified sequence numbers of matching strings and unmatched elements | |
| CN114245130A (en) | Data coding and decoding method and device for multiplexing point vector by using historical point prediction information table |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |