WO2005043882B1 - Video source coding with side information - Google Patents
Video source coding with side informationInfo
- Publication number
- WO2005043882B1 WO2005043882B1 PCT/US2004/034856 US2004034856W WO2005043882B1 WO 2005043882 B1 WO2005043882 B1 WO 2005043882B1 US 2004034856 W US2004034856 W US 2004034856W WO 2005043882 B1 WO2005043882 B1 WO 2005043882B1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- block
- ofthe
- information
- target codeword
- blocks
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
- G11B20/10—Digital recording or reproducing
- G11B20/14—Digital recording or reproducing using self-clocking codes
- G11B20/1403—Digital recording or reproducing using self-clocking codes characterised by the use of two levels
- G11B20/1423—Code representation depending on subsequent bits, e.g. delay modulation, double density code, Miller code
- G11B20/1426—Code representation depending on subsequent bits, e.g. delay modulation, double density code, Miller code conversion to or from block codes or representations thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/164—Feedback from the receiver or from the transmission channel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/395—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability involving distributed video coding [DVC], e.g. Wyner-Ziv video coding or Slepian-Wolf video coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
For video coding based on source coding (fig. 1) with side information (mode information), features pertain to modules in the encoder and the decoder, to the codec, and to systems utilizing an encoder, a decoder and/or a codec. An encoding (fig. 1) can provide an estimate of the degree of correlation between blocks, can identify a target codeword, can represent the target codeword by a set comprising a plurality of codewords with the set including the target codeword, and can determine a hash value (fig. 1) from the target codeword, for decoding to take advantage of such information. Advantageously also, the information can be used in transmission rate control (fig: 1). An encoding to be transmitted can be selected from several different encodings. Encoding of a block can benefit from information on previous blocks fed back from a decoder. In generating an encoding, different camera sources can be used, as well as sensors arrayed on a grid. An encoding can be multi-cast.
Claims
AMENDED CLAIMS [received by the International Bureau on 10 August 2005 (10.08.05); original claims 1-115 replaced by amended claims 1-118; remaining claims unchanged]
J . A method for encoding a block of digital information, utilizing a format which comprise, a plurality 0f fields wherein a target codeword represents at bast a p n o ofthe block and wherein at least one field is selected from: (a) a field including an encoded estimate ofthe degree θf COC-c OU IΛ-l the block and a plurality of further blocks of digital information at a decoder; (b) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set; and (c) a field including an encoded hash value derived from the target codeword.
2. Λ method for encoding a block of digital information in a sequence of blocks of digital information, comprising a step of ascertaining a degree of correlation o the block with a plurality of predecessor blocks ofthe sequence, 3 , The method of claim 2, wherein ascertaining the degree of correlation comprises determining residue energy with respect to at least one ofthe predecessor blocks.
4. The method of claim 3, wherein ascertaining the degree of correlation further comprises counting frame pixels above a residue energy threshold.
5. The method of claim 2, wherein ascertaining the degree of correlation further comprises determining variance of pixel-to-pixel differences between the block and each ofthe predecessor blocks.
6. The method of claim 2, wherein ascertaining the degree of correlation comprises using transform domain values of residue energy information.
7. The method of claim 6, wherein the transform is Discrete Cosine Transform.
47
8. The method of claim 7, wherein relative values of DC and AC coefficients are used,
9. The method of claim 3, wherein the predecessor block is a co-located block in predecessor information.
10. The method of claim 3, wherein ascertaining the degree of correlation comprises utilizing predecessor information. 11. The method of claim 10, wherein residue energy information is represented by encoding with a codebook available at both the encoder and a prospective decoder.
12. The method of claim 2, wherein ascertaining the degree of correlation comprises the steps of: (a) deteπnining residue energy on at least a portion of information from each of a chosen plurality ofthe predecessor blocks; and (b) using at least a portion ofthe residue energy values obtained in step (a) in ascertaining the degree of correlation.
13. The method of claim 12, wherein at least one ofthe plurality ofthe predecessor blocks is chosen taking into account feedback from a decoder.
14. The method of claim 12, wherein the plurality of predecessor blocks is chosen following a predetermined pattern.
15. The method of claim 14, wherein the pattern consists of overlapping predecessor blocks which arc displaced by a set amount from the position corresponding to a block lo be coded.
48
16. The method of claim 12, wherein the predecessor blocks arc chosen so as to minimize con-elation with respect to a current block, and to minimize relative overlap of blocks. 17. The method of claim 16, wherein the predecessor blocks are chosen from a set selected by means of matching techniques, ranked in order of correlation so as to form a first list of predecessor blocks, and removal from the first list blocks having substantial overlap with their predecessors in the first list. 18. The method of claim 16, wherein the selection ofthe predecessor blocks comprises utilizing motion estimation.
19. The method of claim 12, wherein the selection ofthe predecessor blocks comprises maximizing likelihood of at least one ofthe predecessor blocks being present at a prospective decoder.
20. The method of claim 12, further comprising encoding a block taking into account information on distribution of blocks into packets lor transmission over a communications link, and wherein the predecessor blocks are chosen so that the number of different packets containing predecessor blocks is maximized.
21 _ The method of claim 2, wherein ascertaining the degree of correlation comprises partitioning the block into sub-blocks and, for at least a portion ofthe sub- blocks, (a) using at least one of: (i) determining residue energy with respect to at least one ofthe predecessor blocks, (ii) using transform domain values of residue energy information, and (iii) determining residue energy on at least a portion of information from each of a chosen plurality of the predecessor blocks; and (b) using at least a portion o he values obtained in step (a).
49
22. The method of claim 21, wherein step (a) comprises using a weighted sum ofthe values. 23. The method of claim 2, wherein ascertaining the degree of correlation comprises (a) on a low-resolution representation of he block, using at least one of: (i) determining residue energy with respect to at least one ofthe predecessor blocks, (ϋ) using transform domain values of residue energy information, and (iii) determining residue energy on at least a portion of information from each of a chosen plurality of he predecessor blocks; and (b) using at least a portion of values obtained in step (a).
24. The method of claim 23, wherein step (a) comprises using a weighted sum of the values.
25. The method of claim 2, wherein ascertaining the degree of correlation further comprises (a) in selecting predecessor blocks, using at least one of (i) determining residue energy with respect to at least one ofthe predecessor blocks, (ii) using transform domain values of residue energy information, and (iii) determining residue energy on at least a portion of information from each of a chosen plurality of he predecessor blocks; and (b) generating motion vector information for at least a portion ofthe selected blocks,
26. The method of claim 25, wherein step (a) comprises using a weighted sum ofthe values.
50
27. The method of claim 25, where the motion vector information is represented by encoding with a codebook available at the encoder and at a prospective decoder.
28. A method for encoding a block of digital information, comprising the steps of: identifying a target codeword which represents at least a portion ofthe block; and determining a plurality of codewords such that the plurality includes the target codeword.
29. The method of claim of 28, wherein the target codeword is partitioned so that (a) the plurality of codewords is determined for at most a portion of he target codeword; and (b) a complementary portion of the target codeword is intra-coded as represented by encoding with a codebook available at both the encoder and a prospective decoder,
30. The method of claim of 29, wherein the partition is determined by encoding with a codebook available at both the encoder and the prospective decoder.
31. The method of claim 30, wherein a value ofthe plurality of codewords is determined using channel codes.
32. The method of claim 31, wherein the codes are linear channel codes,
33. The method of claim 32, wherein the codes are multi-level linear channel codes, with a separate channel code for each bit-plane ofthe target codeword,
34. The method of claim 30, wherein the partition is such that:
a first portion of the codeword will be transmitted by determining a plurality of codewords, and a second portion adjacent to the first portion will be transmitted by intra- coding as represented by encoding with the codebook, with the encoder providing to the decoder adjacency information,
35. The method of claim 30, wherein portions of different type arc transmitted in alternating fashion. 36, The method of claim 29, wherein only portions ofthe target codeword that are zero are sent in intra mode.
37. The method of claim 30, wherein location information of different portions of the target codeword is conveyed via hash information.
38. Λ method for encoding a block of digital infor ation, comprising the steps of (a) identifying a target codeword that represents at least a portion of the digital information; and (b) determining a hash value from the target codeword.
39. The method of claim 38, wherein the hash value is determined as a checksum on the target codeword. 40. The method of claim 38, wherein: the target codeword is intra-coded by encoding with a codebook at both the encoder and a prospective decoder, and the hash value is determined as intra-information corresponding to a portion of he target codeword.
4J . The method of claim 38, wherein the hash value is determined by using the most significant bit-plane for a portion ofthe target codeword,
52
42, The method of claim 38, wherein the hash value is determined by generating an arithmetic code based on a Continuous Error Detection codeword. 43. The method of claim 38, wherein the hash value is determined by using any combination of: (a) a checksum on the target codeword, (b) intra-information corresponding to a portion ofthe target codeword intra- coded by encoding with a codebook available at both the encoder and a prospective decoder, (c) the most significant bit-plane for a portion ofthe target codeword, and (d) an arithmetic code based on a Continuous Error Detection codeword.
44. The method of claim 38, for a prospective decoder to keep a table of most likely codewords that result in each hash value.
45. The method of claim 44, wherein the encoder has access to the table, for providing the decoder with a code to indicate values encoded. 46. The method of claim 38, wherein the hash value is for a concatenation of a plurality of blocks.
47, The method of claim 46, wherein the blocks arc selected so that a hash value is determined for each row of blocks within a frame and for each column of blocks within a frame.
48. The method of claim 46, wherein consecutive blocks following a predeteπnined scan of video frame blocks are concatenated to generate a hash value for the plurality of blocks.
49. A method for encoding at least one block of digital information, comprising at least one o he steps of
53
(a) identifying a target codeword that represents at least a portion ofthe block of digital information, (b) determining at least one ofthe degree of correlation of the block of digital information and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword; (d) deriving a hash value from the target codeword, and (c) for representing at least some o the values obtained in one of (b), (c) and (d), utilizing a format which comprises a plurality of ields wherein a target codeword represents at least a portion ofthe block, and wherein at least one Hold is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set, and (iii) a field including an encoded hash value derived from the target codeword.
50. The method of claim 49, wherein the block represents at least one pixel value in digital video information.
51. The method of claim 49, wherein the block represents a macro-block in a frame of digital video information. 52. The method of claim 49, wherein the target codeword representing at least a portion ofthe block is quantized,
53. A method for encoding a block of digital information partitioned into sub-blocks, comprising at least one ofthe steps of: (a) for each of al least a portion of the sub-blocks, identifying a target codeword that represents t least a portion o the corresponding sub-block of digital information;
54
(b) concatenating target codewords corresponding to at least a portion of sub- blocks to form another target codeword; (c) partitioning the target codeword into a plurality of target codewords; (d) for each of at least a portion ofthe target codewords, determining at least one ofthe degree of correlation ofthe target codeword with the predecessor information; (e) for each of at least a portion ofthe target codewords, determining a plurality of codewords, wherein the plurality contains Lhe target codeword; (1) for each of at least a portion ofthe target codewords, deriving a hash value from the target codeword; (g) for each of at least a portion of the target codewords, for representing at least some of he values obtained in one of (d), (e) or (1), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index ofa set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set, and (iii) a field including an encoded hash value derived from the target codeword.
54, A method for decoding an encoded block of digital information, comprising the steps of: (a) using an encoded index to determine a set of candidate code words; (b) using the index to infer a set of cues; (c) using the index to infer the hash value associated with a target codeword; (d) determining a subset ofthe set of candidate codewords by operating the set of cues on the set of candidate codewords; (e) determining the codewords from the subset of candidate codewords to generate a hash value that is in agreement with the target codeword hash value; (f) using the determined codewords along with the set of cues to generate a representation of the encoded block of digital information.
55
55. The method of claim 54, wherein, if multiple values satisfy a target hash value, a preferred candidate is identified upon comparing the target codeword intra- encoded information with corresponding information in the candidate.
56. The method of claim 49, for encoding a sequence of blocks of digital information, further comprising the step of making decisions between modes that are appropriate for a given set of constraints, 57. The method of claim 56, wherein the decisions are made per block or on a plurality of blocks.
58. The method of claim 56, wherein the constraints include a given budget of bits.
59. The method of claim 58, wherein the constraints further include a given target quality.
60. The method of claim 56, wherein the modes include different coding modes for a block.
61. The method of claim 60, wherein one ofthe modes is an intra-mode.
62. The method of claim 61, wherein one ofthe modes is a syndrome-mode.
63. The method of claim 58, wherein a given budget of bits is divided between a plurality of fields that are used for at least one of ascertaining degree of correlation, encoding the index of a set containing a plurality of codewords, and encoding a hash value.
64. The method of claim 56, further using information that is sent back by the decoder for making appropriate decisions.
56
65. A method for encoding a sequence of blocks of digital information, comprising the steps of: (a) encoding each block in a frame in intra mode to meet a set rate-distortion criterion, as specified by cither a target rate or a target distortion; (b) obtaining for each block in the frame rate and distortion values for the chosen quantization parameters; (c) estimating, for each candidate, at least one alternative coding mode for the respective rate and distortion; (d) selecting the coding mode that minimizes a suitable weighted sum of rate and distortion.
66". The method of claim 65, wherein tlie distortion of a block encoded using a syndrome mode is calculated as a weighted sum of (i) distortion when the block is correctly decoded; and (ii) distortion at the decoder when the block obtained from correct decoding is replaced by a selected predecessor block at the decoder.
67. The method of Claim 66, wherein the selected predecessor block is the block collocated with the current block in the previous frames.
6 . A method for encoding a block of digital information, comprising the steps of: (a) generating a plurality of different encodings for the block; and (b) selecting from the plurality of encodings.
69. The method of claim 68, wherein the different encodings arc generated using different formats. 70. The method of claim 69, wherein the different encodings represent the block at different resolutions.
57
1. The method of claim 70, wherein an encoding at a lesser resolution at least in part will serve a prospective decoder for decoding at a greater resolution.
72. The method of claim 68, wherein at least one o he encodings is effected using one of: (a) identifying a target codeword that represents at least a portion o the block of digital information, (b) determining at least one of he degree of correlation ofthe block of digital information and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword; (d) deriving a hash value from the target codeword, and (e) for representing at least some ofthe values obtained in one of (b), (c) and (d), utilizing a fomiat which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (ϊ) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set, and (iii) a field including an encoded hash value derived from the target codeword,
73. The method of claim 71, wherein encoding for least resolution is effected using one of- (a) identifying a target codeword that represents at least a portion ofthe block of digital information, (b) determining at least one o the degree of correlation ofthe block of digital information and the target codeword that represents the block with a plurality of blocks in he predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword,
58
(d) deriving a hash value from the target codeword, and (e) for representing at least some ofthe values obtained in one of (b), (c) and (d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set, and (iii) a field including an encoded hash value derived from the target codeword.
74, The method of claim 71, wherein encoding for greatest resolution is effected using one of; (a) identifying a target codeword that represents at least a portion ofthe block of digital information, (b) determining at least one ofthe degree of correlation of tlie block of digital information and the target codeword that represents the block with a plurality of blocks in he predecessor information, (e) determining a set o codewords, wherein the set contains the target codeword; (d) deriving a hash value from the target codeword, and (c) for representing at least some ofthe values obtained in one of (b), (c) and (d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of codewords, wherein the set includes the target codeword and the value ofthe set and (iii) a field including an encoded hash value derived from the target codeword.
59
75. The method of claim 74, wherein at least one o the encodings is effected using a format selected from a group of standard formats including MPEGx/H.26x fomiat for digital video information, 76. A method for transmitting digital information, comprising a step of converting from one format of encoded digital information to another format, usable by a prospective decoder.
77. The method of claim 76, wherein the format converted from is a standard format selected from a group of formats comprising MPEGx H,26x for digital video information.
78. The method of claim 77, wherein the format converted to comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (a) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder; (b) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set; and (c) a field including an encoded hash value derived from the target codeword.
79. The method of claim 76, wherein the format converted from comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (a) a field including an encoded estimate of the degree of correlation between the block and a plurality of further blocks of digital information at a decoder; (b) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set; and (c) a field including an encoded hash value derived from the target codeword.
60
80. The method of claim 77, wherein the format converted from is selected from a group of standard formats including MPROx/H.26x for digital video information. 81. The method of claim 76, wherein the format converted to is an authentic representation ofthe digital video information.
82. The method of claim 76, wherein the authentic representation is validated by information in addition to predecessor information,
83. A method for encoding a block of digital information, comprising the step of generating an encoding for the block of digital information with a specified format; followed by another encoding using at least one o the steps of: (a) identifying a target codeword that represents at least a portion ofthe block of digital information, (b) determining at least one ofthe degree of correlation o the block of digital information and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword; (d) deriving a hash value fro the target codeword, and (e) for representing at least some ofthe values obtained in one of (b), (c) and (d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion of the block and wherein at least one field is selected from (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set and (iii) a field including an encoded hash value derived from the target codeword.
61
84. The method of" claim 83, wherein predecessor information further comprises information represented by a specified format about the block of digital information. 85. The method of claim 84, wherein the specified format is selected from a group of standard foraiats comprising MPF.Gx/H.26x format for digital video information,
86, A method for transferring digital information, comprising a step of encoding by using at least one of: (a) identifying a target codeword that represents at least a portion ofthe block of digital information, (b) determining at least one o the degree of correlation o the block of digital information and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein tlie set contains the target codeword, (d) deriving a hash value from the target codeword, and (e) for representing at least some ofthe values obtained in one of (b), (c) and (d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value ofthe set, and (iii) a field including an encoded hash value derived from the target codeword; and using a decoder which sends information to the encoder that can be used by the encoder.
62
87. The method of claim 86, wherein the information sent by the decoder is used by the encoder to ascertain a degree of correlation o the block with a plurality of predecessor blocks. 88. The method of claim 87, wherein the information comprises motion vector information inferred by the decoder.
89. The method of claim 87, wherein the information comprises an estimate ofthe properties ofthe channel between encoder and decoder,
90. The method of claim 86, wherein the information comprises decoding results of prior transmissions, 1. The method of claim 86, wherein the information comprises state information about the decoder,
92. The method of claim 91 , wherein the state information comprises an estimate of predecessor information available at the decoder. 93. The method of claim 91, wherein the state information comprises processor state at the decoder,
94. A method for encoding a block of digital video information from a plurality of sources, comprising generating a plurality of encodings for each source with/without collaboration between sources using at least one of: (a) identifying a target codeword that represents at least a portion of the block of digital information, (b) determining at least one ofthe degree of correlation of the block of digital information and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword;
63
(d) deriving a hash value from the target codeword, and (e) for representing at least some ofthe values obtained in one of (b), (c) and (d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion of tlie block and wherein at least one field is selected from; (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value o the set, and (iii) a field including an encoded hash value derived from the target codeword.
95- The method of claim 94, wherein predecessor information further comprises information represented by at least a portion of encodings from other sources.
96. The method of claim 94, wherein encodings from a plurality of sources arc used by tlie decoder to generate a representation of digital video information at a higher resolution than from individual sources, 97. A method for transferring digital information, comprising the steps of: (1) encoding a block of digital video information from a plurality of sources, comprising generating a plurality of encodings for each source with/without collaboration between sources, using at least one of: (a) identifying a target codeword that represents at least a portion o the block of digital information, (b) determining at least one ofthe degree of correlation ofthe block of digital informati n and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword; (d) deriving a hash value from the target codeword, and (e for representing at least some of the values obtained in one of (b), (c) and
64
(d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the sot includes the target codeword and the value ofthe set and (iii) a field including an encoded hash value derived from the target codeword; and (2) using a decoder that sends infonnation that can be used by a plurality of encoders,
98, The method of claim 97, wherein the information sent by the decoder is used by a plurality of encoders to ascertain a degree of correlation ofthe block with a plurality of predecessor blocks.
99, The method of claim 97, wherein the infonnation comprises motion vector information inferred by the decoder. 100, The method of claim 97, wherein the information comprises an estimate o the properties of a channel between a plurality of encoders and the decoder,
101. The method of claim 97, wherein the information comprises decoding results of prior transmissions.
102. The method of claim 97, wherein the infonnation comprises state in ormation about the decoder.
103. The method of claim 102, wherein the state information comprises an estimate o f the predecessor i nformation avai lable at the decoder.
65
104. The method of claim 102, wherein the state information comprises processor state at the decoder.
1 5, A method for encoding digital video information, wherein the digital video information is captured by a series of elementary sensors arranged on a grid, and wherein information from at least one sensor or a group of neighboring sensors is directly encoded before being transferred to a processor for further processing and compression. 106. The method f claim 1 5, wherein infoπnatjon obtained from the sensors is first represented by a target codeword, with a codebook being available at both encoder and decoder, and (a) for at most a portion of sensor data, the encoder identifies a set of a plurality of codewords such that the set contains the target codeword for one sensor, and a set index is communicated to the decoder; and (b) for the remaining sensor data an original intra codeword is communicated to the decoder,
107. A method for encoding a block of digital information for a plurality of decoders, comprising generating multiple encodings for the block of digital information.
108. The method of claim 107, wherein the encodings are generated using the method of claim 68.
109. The method of claim 107, wherein each encoding generates a representation ofthe block at a certain resolution.
110. The method of claim 1 8, wherein a decoder uses at least a portion of the encodings.
66
111. The method of claim 109, wherein an encoding corresponding to a resolution is for a decoding which uses at least a portion of encodings for lesser resolutions. 1 12. The method of claim 107, wherein at least some ofthe encodings are generated using at least one of: (a) identi ying a target codeword that represents at least a portion ofthe block of digital information, (b) determining at least one o the degree of correlation ofthe block of digital infonnation and the target codeword that represents the block with a plurality of blocks in the predecessor information, (c) determining a set of codewords, wherein the set contains the target codeword, (d) deriving a hash value from tlie target codeword, and (e) for representing at least some ofthe values obtained in one of (b), (c) and
(d), utilizing a format which comprises a plurality of fields wherein a target codeword represents at least a portion ofthe block and wherein at least one field is selected from: (i) a field including an encoded estimate ofthe degree of correlation between the block and a plurality of further blocks of digital information at a decoder, (ii) a field including an encoded index of a set of a plurality of code words, wherein the set includes the target codeword and the value of tlie set, and (iii) a field including an encoded hash value derived from the target codeword. 1 13. The method of claim 107, wherein each encoding generates a representation ofthe block corresponding to a certain degree of correlation.
1 14. The method of claim 1 13, wherein a decoder uses at least a portion of the encodings,
67
5/043882
115, The method of claim 114, wherein an encoding corresponding to a degree of correlation is for a decoding which uses at least a portion of encodings follower correlations. 11 . The method of claim 1 , wherein the block comprises a collection of smaller blocks.
117. The method of claim 11 , further comprising the steps of establishing a concatenation ofthe smaller blocks and generating at least some o the fields ofthe concatenated blocks.
118. The method of claim 25, wherein the motion vector information is from a plurality of predecessor blocks.
68
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US51290203P | 2003-10-21 | 2003-10-21 | |
| US60/512,902 | 2003-10-21 |
Publications (3)
| Publication Number | Publication Date |
|---|---|
| WO2005043882A2 WO2005043882A2 (en) | 2005-05-12 |
| WO2005043882A3 WO2005043882A3 (en) | 2005-08-11 |
| WO2005043882B1 true WO2005043882B1 (en) | 2005-10-13 |
Family
ID=34549235
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2004/034856 WO2005043882A2 (en) | 2003-10-21 | 2004-10-21 | Video source coding with side information |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2005043882A2 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9338477B2 (en) | 2010-09-10 | 2016-05-10 | Thomson Licensing | Recovering a pruned version of a picture in a video sequence for example-based data pruning using intra-frame patch similarity |
| US9544598B2 (en) | 2010-09-10 | 2017-01-10 | Thomson Licensing | Methods and apparatus for pruning decision optimization in example-based data pruning compression |
| US9602814B2 (en) | 2010-01-22 | 2017-03-21 | Thomson Licensing | Methods and apparatus for sampling-based super resolution video encoding and decoding |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2007035147A1 (en) * | 2005-09-23 | 2007-03-29 | Telefonaktiebolaget Lm Ericsson (Publ) | Adaptive source signal encoding |
| US7827467B2 (en) * | 2006-01-04 | 2010-11-02 | Nokia Corporation | Method for checking of video encoder and decoder state integrity |
| US8358693B2 (en) | 2006-07-14 | 2013-01-22 | Microsoft Corporation | Encoding visual data with computation scheduling and allocation |
| US8311102B2 (en) | 2006-07-26 | 2012-11-13 | Microsoft Corporation | Bitstream switching in multiple bit-rate video streaming environments |
| US8340193B2 (en) | 2006-08-04 | 2012-12-25 | Microsoft Corporation | Wyner-Ziv and wavelet video coding |
| US7388521B2 (en) | 2006-10-02 | 2008-06-17 | Microsoft Corporation | Request bits estimation for a Wyner-Ziv codec |
| AU2006230691B2 (en) | 2006-10-19 | 2010-11-25 | Canon Kabushiki Kaisha | Video Source Coding with Decoder Side Information |
| GB0705328D0 (en) | 2007-03-20 | 2007-04-25 | Skype Ltd | Method of transmitting data in a communication system |
| US8340192B2 (en) | 2007-05-25 | 2012-12-25 | Microsoft Corporation | Wyner-Ziv coding with multiple side information |
| US8295342B2 (en) | 2007-11-14 | 2012-10-23 | International Business Machines Corporation | Method and system for efficient video compression with low-complexity encoder |
| US8228990B2 (en) | 2008-01-16 | 2012-07-24 | Sony Corporation | Template matching scheme using multiple predictors as candidates for intra-prediction |
| US8111755B2 (en) | 2008-06-25 | 2012-02-07 | International Business Machines Corporation | Method and system for low-complexity Slepian-Wolf rate estimation in Wyner-Ziv video encoding |
| US9813707B2 (en) | 2010-01-22 | 2017-11-07 | Thomson Licensing Dtv | Data pruning for video compression using example-based super-resolution |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5852664A (en) * | 1995-07-10 | 1998-12-22 | Intel Corporation | Decode access control for encoded multimedia signals |
| EP0946019A1 (en) * | 1998-03-25 | 1999-09-29 | CANAL+ Société Anonyme | Authentification of data in a digital transmission system |
-
2004
- 2004-10-21 WO PCT/US2004/034856 patent/WO2005043882A2/en active Application Filing
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9602814B2 (en) | 2010-01-22 | 2017-03-21 | Thomson Licensing | Methods and apparatus for sampling-based super resolution video encoding and decoding |
| US9338477B2 (en) | 2010-09-10 | 2016-05-10 | Thomson Licensing | Recovering a pruned version of a picture in a video sequence for example-based data pruning using intra-frame patch similarity |
| US9544598B2 (en) | 2010-09-10 | 2017-01-10 | Thomson Licensing | Methods and apparatus for pruning decision optimization in example-based data pruning compression |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2005043882A3 (en) | 2005-08-11 |
| WO2005043882A2 (en) | 2005-05-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2005043882B1 (en) | Video source coding with side information | |
| Reibman et al. | Multiple description coding for video using motion compensated prediction | |
| Reibman et al. | Multiple-description video coding using motion-compensated temporal prediction | |
| Memon et al. | Lossless compression of video sequences | |
| CN100558168C (en) | The method and apparatus that generates coded picture data and coded picture data is decoded | |
| US9350996B2 (en) | Method and apparatus for last coefficient indexing for high efficiency video coding | |
| Lam et al. | An error concealment algorithm for images subject to channel errors | |
| TWI407798B (en) | Motion prediction methods and video codecs | |
| EP1404133A1 (en) | Image encoder, image decoder, image encoding method, and image decoding method | |
| CN102656890B (en) | For the method and apparatus of Video coding | |
| Puri et al. | PRISM: an uplink-friendly multimedia coding paradigm | |
| US7474699B2 (en) | Moving picture encoding/transmission system, moving picture encoding/transmission method, and encoding apparatus, decoding apparatus, encoding method decoding method and program usable for the same | |
| CN1795679B (en) | Method, apparatus and system for encoding and decoding side information for multimedia transmission | |
| JP5545783B2 (en) | Method for decoding a stream of encoded data representing an image sequence and method for encoding an image sequence | |
| US20080231483A1 (en) | Binarizing method and device thereof | |
| CA2646562A1 (en) | Moving picture coding/decoding method and device using multiple reference frames for motion estimation | |
| CN102860006A (en) | Managing predicted motion vector candidates | |
| CN1738413A (en) | Error concealment in a video decoder | |
| CN1134171C (en) | Signal encoding device and method, signal recording medium and signal transmission method | |
| US5933105A (en) | Context-based arithmetic encoding/decoding method and apparatus | |
| CN1756363B (en) | Method and device for coding a sequence of source images | |
| CN101554058B (en) | Method and apparatus for encoding and decoding based on intra prediction | |
| JP4133346B2 (en) | Intra coding of video data blocks by selection of prediction type | |
| Chang et al. | A fast forward error correction allocation algorithm for unequal error protection of video transmission over wireless channels | |
| US6594310B1 (en) | Partition coding method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| B | Later publication of amended claims |
Effective date: 20050810 |
|
| 122 | Ep: pct app. not ent. europ. phase |