[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2002085025A1 - Video signal processing - Google Patents

Video signal processing Download PDF

Info

Publication number
WO2002085025A1
WO2002085025A1 PCT/GB2002/001729 GB0201729W WO02085025A1 WO 2002085025 A1 WO2002085025 A1 WO 2002085025A1 GB 0201729 W GB0201729 W GB 0201729W WO 02085025 A1 WO02085025 A1 WO 02085025A1
Authority
WO
WIPO (PCT)
Prior art keywords
video signal
coding parameter
signal
video
prediction
Prior art date
Application number
PCT/GB2002/001729
Other languages
French (fr)
Inventor
Martin Weston
Original Assignee
Snell & Wilcox Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Snell & Wilcox Limited filed Critical Snell & Wilcox Limited
Publication of WO2002085025A1 publication Critical patent/WO2002085025A1/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/513—Processing of motion vectors
    • H04N19/517—Processing of motion vectors by encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/527—Global motion vector estimation

Definitions

  • This invention concerns the compression of video signals, and in particular aspects, the manipulation of motion vectors accompanying an associated video signal through a video process.
  • Motion vectors can be used in a wide range of video processes such as data compression, noise reduction and standards conversion.
  • the extraction of accurate vectors from a video signal is a complex and difficult process and it is often more efficient to carry the vectors in a parallel path associated with the video signal than to re-create them from the video whenever they are required.
  • a particular problem with video data compression systems is that the subjective quality can become seriously degraded if several compression and decompression processes are cascaded.
  • a known technique for alleviating this degradation is to carry the motion vectors and other parameters used in the first compression process with the video and to use the same vectors in subsequent compression processes (for example, see SMPTE standards 327M and 319M: MPEG re-enco ⁇ ' g data set and its transport mechanism).
  • an MPEG-coded video signal may be required to pass through a low bandwidth or non-MPEG pathway.
  • the processes involved may have limited data capacity which may be exceeded by signals having accompanying previous coding parameters.
  • the invention consists in one aspect in a method of video signal processing comprising the steps of: receiving a decoded video signal and an associated coding parameter; using a deterministic process to provide a first prediction of the coding parameter; comparing the coding parameter with the first prediction of the coding parameter to form a comparison signal; replacing the associated coding parameter with the comparison signal; transporting the video signal and associated comparison signal along a video pathway; using the deterministic process to provide a second prediction of the coding parameter; reconstructing the coding parameter by comparing the second prediction of the coding parameter with the comparison signal; and replacing the comparison signal with the reconstructed coding parameter.
  • Figure 1 is a diagram illustrating the processing of a decoded video signal
  • Figure 2 is a diagram illustrating the processing of motion vectors according to an embodiment of the invention.
  • FIG. 1 illustrates an example of a problem to which the invention is addressed.
  • An MPEG-coded video signal (101) is required to pass through a baseband video (or other non-MPEG) process (103).
  • the process may include recording, transmission or post-production of the video.
  • the video is required to be re-encoded to the
  • the motion vectors which were used to code the video signal (101) are extracted by the MPEG decoder (102), passed through the process (103) and used to re-code the video in the MPEG coder (104) to create a processed MPEG signal (105).
  • the motion vectors included in the signal (101) may be highly accurate and have been derived from an "upstream" motion estimator (which could be incorporated in the previous MPEG coder).
  • the process (103) may have limited data capacity in its motion vector channel and, if so, it may be necessary to reduce the data content of the motion vectors so that they can fit into this limited capacity.
  • the data reduction, and subsequent data expansion, of the vectors according to an embodiment of the invention will now be described with reference to Figure 2.
  • a video signal (201) is accompanied by motion vectors (202).
  • Data reduction of the motion vectors is achieved by making a prediction (204) of the vectors and subtracting (205) the predicted vectors from the actual vectors to obtain a motion vector prediction error signal (206).
  • This error signal accompanies the video signal through the process (203) and, when motion vectors are required for subsequent processing, they are derived from it as will be explained subsequently.
  • the prediction is made by analysing the video signal (201) in a motion estimator (207).
  • This motion estimator need not be highly accurate as its output vectors will not be used directly. However, if the estimation process is deterministic, a particular sequence of input video frames will always result in the same output vectors, thus allowing reconstruction of the vectors after the process (203), as described below.
  • the input motion vectors (202) will differ only slightly from the predicted vectors (204) and so the prediction error signal (206) will usually be small.
  • the prediction error is coded for onward transmission in the block (208). This coder has a lower output data rate than the input vector signal (202); this data reduction can be achieved by variable length (Huffman) coding, though other methods will be apparent to those skilled in the art.
  • the video and the reduced-data-rate vector prediction error signal (209) are associated with each other in the process (203). Where subsequent motion- compensated processing of the video is required (for example, MPEG encoding) the original, full-data-rate motion vectors are reconstructed as follows.
  • the video signal (210) is applied to a motion estimator (211), which has the same deterministic input to output relationship as that (207) used to produce the motion vector error signal (206).
  • the output (212) from this second motion estimator should be the same as the original motion vector prediction (204).
  • the low-bit-rate vector prediction error signal (213) at the output of the process (203) is restored to the original bit rate in the block (214); this is achieved by the reverse of the process in block (208).
  • This full data rate error signal is added (215) to the predicted vector signal (212) from the motion estimator (211) so as to obtain a motion vector signal (216) which is equivalent to the original signal (202).
  • compensating vector delays (217, 218), and compensating video delays (219, 220) are included as shown in Figure 2.
  • the vector information accompanying a video signal is reduced to allow it to pass through a process with the video, providing the information required to enable lossless re-encoding at a later stage. It is therefore possible to employ vectors for lossless concatenation in numerous processes in which it would otherwise be problematic.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

In compressing coding parameters, such as motion vectors, for passage through a low bandwith or non-MPEG pathway, a decoded video signal is received with an associated coding parameter, a deterministic process is used to provide a first prediction of the coding parameter, the coding parameter is compared with the first prediction of the coding parameter to form a comparison signal, the associated coding parameter is replaced with the comparison signal, the video signal and associated comparison signal are tranported along a video pathway, the deterministic process is used to provide a second prediction of the coding parameter, the coding parameter is reconstructed by comparing the second prediction of the coding parameter with the comparison signal and the comparison signal is replaced with the reconstructed coding parameter.

Description

VIDEO SIGNAL PROCESSING
This invention concerns the compression of video signals, and in particular aspects, the manipulation of motion vectors accompanying an associated video signal through a video process.
Motion vectors can be used in a wide range of video processes such as data compression, noise reduction and standards conversion. The extraction of accurate vectors from a video signal is a complex and difficult process and it is often more efficient to carry the vectors in a parallel path associated with the video signal than to re-create them from the video whenever they are required. A particular problem with video data compression systems is that the subjective quality can become seriously degraded if several compression and decompression processes are cascaded. A known technique for alleviating this degradation is to carry the motion vectors and other parameters used in the first compression process with the video and to use the same vectors in subsequent compression processes (for example, see SMPTE standards 327M and 319M: MPEG re-encoά' g data set and its transport mechanism).
However, in certain circumstances, arising for example in recording, transmission or post-production, an MPEG-coded video signal may be required to pass through a low bandwidth or non-MPEG pathway. The processes involved may have limited data capacity which may be exceeded by signals having accompanying previous coding parameters.
It is therefore an object of the invention to address these problems and, in certain aspects, to reduce the data content of parameters such as motion vectors accompanying a video signal.
Accordingly, the invention consists in one aspect in a method of video signal processing comprising the steps of: receiving a decoded video signal and an associated coding parameter; using a deterministic process to provide a first prediction of the coding parameter; comparing the coding parameter with the first prediction of the coding parameter to form a comparison signal; replacing the associated coding parameter with the comparison signal; transporting the video signal and associated comparison signal along a video pathway; using the deterministic process to provide a second prediction of the coding parameter; reconstructing the coding parameter by comparing the second prediction of the coding parameter with the comparison signal; and replacing the comparison signal with the reconstructed coding parameter.
The invention will now be described by way of example with reference to the accompanying drawings, in which:
Figure 1 is a diagram illustrating the processing of a decoded video signal; and
Figure 2 is a diagram illustrating the processing of motion vectors according to an embodiment of the invention.
Figure 1 illustrates an example of a problem to which the invention is addressed. An MPEG-coded video signal (101) is required to pass through a baseband video (or other non-MPEG) process (103). The process may include recording, transmission or post-production of the video.
At the output of the process the video is required to be re-encoded to the
MPEG format and, in order to reduce the artefacts introduced by this multiple coding, the motion vectors which were used to code the video signal (101) are extracted by the MPEG decoder (102), passed through the process (103) and used to re-code the video in the MPEG coder (104) to create a processed MPEG signal (105).
The motion vectors included in the signal (101) may be highly accurate and have been derived from an "upstream" motion estimator (which could be incorporated in the previous MPEG coder). The process (103) may have limited data capacity in its motion vector channel and, if so, it may be necessary to reduce the data content of the motion vectors so that they can fit into this limited capacity. The data reduction, and subsequent data expansion, of the vectors according to an embodiment of the invention will now be described with reference to Figure 2.
A video signal (201) is accompanied by motion vectors (202). Data reduction of the motion vectors is achieved by making a prediction (204) of the vectors and subtracting (205) the predicted vectors from the actual vectors to obtain a motion vector prediction error signal (206). This error signal accompanies the video signal through the process (203) and, when motion vectors are required for subsequent processing, they are derived from it as will be explained subsequently.
The prediction is made by analysing the video signal (201) in a motion estimator (207). This motion estimator need not be highly accurate as its output vectors will not be used directly. However, if the estimation process is deterministic, a particular sequence of input video frames will always result in the same output vectors, thus allowing reconstruction of the vectors after the process (203), as described below.
The input motion vectors (202) will differ only slightly from the predicted vectors (204) and so the prediction error signal (206) will usually be small. The prediction error is coded for onward transmission in the block (208). This coder has a lower output data rate than the input vector signal (202); this data reduction can be achieved by variable length (Huffman) coding, though other methods will be apparent to those skilled in the art.
The video and the reduced-data-rate vector prediction error signal (209) are associated with each other in the process (203). Where subsequent motion- compensated processing of the video is required (for example, MPEG encoding) the original, full-data-rate motion vectors are reconstructed as follows.
The video signal (210) is applied to a motion estimator (211), which has the same deterministic input to output relationship as that (207) used to produce the motion vector error signal (206). As the video signal (210) is the same as the input video (201 ), the output (212) from this second motion estimator should be the same as the original motion vector prediction (204). The low-bit-rate vector prediction error signal (213) at the output of the process (203) is restored to the original bit rate in the block (214); this is achieved by the reverse of the process in block (208). This full data rate error signal is added (215) to the predicted vector signal (212) from the motion estimator (211) so as to obtain a motion vector signal (216) which is equivalent to the original signal (202). In order to retain synchronisation between the video signal and the motion vector signal, compensating vector delays (217, 218), and compensating video delays (219, 220) are included as shown in Figure 2.
Thus, in this manner, the vector information accompanying a video signal is reduced to allow it to pass through a process with the video, providing the information required to enable lossless re-encoding at a later stage. It is therefore possible to employ vectors for lossless concatenation in numerous processes in which it would otherwise be problematic.
It will be appreciated by those skilled in the art that the invention has been described by way of example only, and that a wide variety of alternative approaches may be adopted without departing from the scope of the invention. In particular, though the above examples describe the use of motion vectors, various other parameters reflecting previous coding decisions, such as the coding modes or quantisation levels employed, may be estimated and employed in compression in similar vein.

Claims

1. A method of video signal processing comprising the steps of: receiving a decoded video signal and an associated coding parameter; using a deterministic process to provide a first prediction of the coding parameter; comparing the coding parameter with the first prediction of the coding parameter to form a comparison signal; replacing the associated coding parameter with the comparison signal; transporting the video signal and associated comparison signal along a video pathway; using the deterministic process to provide a second prediction of the coding parameter; reconstructing the coding parameter by comparing the second prediction of the coding parameter with the comparison signal; and replacing the comparison signal with the reconstructed coding parameter.
2. A method of video signal processing comprising associating a comparison signal with a video signal and passing the signals through a reduced data capacity video process, wherein the comparison signal is derived from comparison of a coding parameter previously calculated for the video signal with a prediction of the coding parameter derived from the video signal.
3. A method according to Claim 2, wherein the prediction of the coding parameter is derived using a deterministic process.
4. A method according to Claim 2 or Claim 3, wherein the comparison signal iiss ccoommpprreesssseedd pprriioorr to the video process, and is de-compressed following the video process.
5. A method according to any of the above claims, wherein the coding parameter comprises motion vectors.
6. A video signal comprising a comparison signal, wherein the comparison signal is derived from a comparison of a coding parameter previously calculated for the video signal and a prediction of the coding parameter derived from the video signal.
7. A video signal according to Claim 6, wherein the comparison signal is compressed.
8. A video signal according to Claim 6 or Claim 7, wherein the coding parameter comprises motion vectors.
9. A method for the data reduction of motion vectors associated with a video signal in which motion vectors are predicted by applying an additional motion measurement process to the associated video signal and the predicted vectors are used in the data reduction process.
10. A method according to Claim 9 in which one or more of the vectors to be data reduced is compared with a predicted vector derived from a motion estimation process conducted on the associated video signal and the result is used to create a data signal which is associated with the said video signal.
11. A method of recovering motion vectors from data associated with a video signal by making use of predicted vectors derived by applying an additional motion measurement process to the associated video signal.
12. A method according to Claim 11 in which the predicted vectors are corrected by information derived from said associated data.
13. A method for the data reduction and subsequent data expansion of motion vectors associated with a video signal where the reduction and expansion processes include separate but substantially identical motion estimation processes carried out on the associated video signal.
14. A method according to any of claims 9 to 13, wherein the motion estimation process is a deterministic process.
PCT/GB2002/001729 2001-04-12 2002-04-12 Video signal processing WO2002085025A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0109264A GB2374479B (en) 2001-04-12 2001-04-12 Video signal processing
GB0109264.2 2001-04-12

Publications (1)

Publication Number Publication Date
WO2002085025A1 true WO2002085025A1 (en) 2002-10-24

Family

ID=9912813

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2002/001729 WO2002085025A1 (en) 2001-04-12 2002-04-12 Video signal processing

Country Status (2)

Country Link
GB (1) GB2374479B (en)
WO (1) WO2002085025A1 (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4575756A (en) * 1983-07-26 1986-03-11 Nec Corporation Decoder for a frame or field skipped TV signal with a representative movement vector used for individual vectors
EP0651574A1 (en) * 1993-03-24 1995-05-03 Sony Corporation Method and apparatus for coding/decoding motion vector, and method and apparatus for coding/decoding image signal
WO1995035628A1 (en) * 1994-06-17 1995-12-28 Snell & Wilcox Limited Video compression
EP0765087A2 (en) * 1995-08-29 1997-03-26 Sharp Kabushiki Kaisha Video coding device
EP0874526A2 (en) * 1997-04-25 1998-10-28 Victor Company Of Japan, Limited Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
US5905535A (en) * 1994-10-10 1999-05-18 Thomson Multimedia S.A. Differential coding of motion vectors using the median of candidate vectors
EP0921688A1 (en) * 1997-06-25 1999-06-09 Nippon Telegraph and Telephone Corporation Moving vector predictive coding method and moving vector decoding method, predictive coding device and decoding device, and storage medium stored with moving vector predictive coding program and moving vector decoding program
FR2773038A1 (en) * 1997-12-24 1999-06-25 Thomson Multimedia Sa MPEG-coded image data interpolation method, especially for standards conversion

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2333656B (en) * 1998-01-22 2002-08-14 British Broadcasting Corp Compressed signals
GB2333657B (en) * 1998-01-22 2002-08-21 Snell & Wilcox Ltd Video signal compression
GB2343319B (en) * 1998-10-27 2003-02-26 Nokia Mobile Phones Ltd Video coding
DE60003070T2 (en) * 1999-08-11 2004-04-01 Nokia Corp. ADAPTIVE MOTION VECTOR FIELD CODING

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4575756A (en) * 1983-07-26 1986-03-11 Nec Corporation Decoder for a frame or field skipped TV signal with a representative movement vector used for individual vectors
EP0651574A1 (en) * 1993-03-24 1995-05-03 Sony Corporation Method and apparatus for coding/decoding motion vector, and method and apparatus for coding/decoding image signal
WO1995035628A1 (en) * 1994-06-17 1995-12-28 Snell & Wilcox Limited Video compression
US5905535A (en) * 1994-10-10 1999-05-18 Thomson Multimedia S.A. Differential coding of motion vectors using the median of candidate vectors
EP0765087A2 (en) * 1995-08-29 1997-03-26 Sharp Kabushiki Kaisha Video coding device
EP0874526A2 (en) * 1997-04-25 1998-10-28 Victor Company Of Japan, Limited Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
EP0921688A1 (en) * 1997-06-25 1999-06-09 Nippon Telegraph and Telephone Corporation Moving vector predictive coding method and moving vector decoding method, predictive coding device and decoding device, and storage medium stored with moving vector predictive coding program and moving vector decoding program
FR2773038A1 (en) * 1997-12-24 1999-06-25 Thomson Multimedia Sa MPEG-coded image data interpolation method, especially for standards conversion

Also Published As

Publication number Publication date
GB2374479A (en) 2002-10-16
GB0109264D0 (en) 2001-05-30
GB2374479B (en) 2005-05-04

Similar Documents

Publication Publication Date Title
US6125140A (en) Processing encoded signals
US6650705B1 (en) Method for encoding and transcoding multiple video objects with variable temporal resolution
US6621866B1 (en) Method for inserting a visual element into an MPEG bit stream
US7231091B2 (en) Simplified predictive video encoder
JP4666695B2 (en) Video signal compression processing method
JP4198206B2 (en) Video information compression method and apparatus using motion dependent prediction
EP0874526A2 (en) Motion compensation encoding apparatus and motion compensation encoding method for high-efficiency encoding of video information through selective use of previously derived motion vectors in place of motion vectors derived from motion estimation
CA2421066A1 (en) Transcoder-based adaptive quantization for digital video recording
US5754239A (en) Motion compensated video processing
US5838265A (en) Method, encoder and decoder for resynchronization to a data stream which contains errors
JP2004032718A (en) System and method for processing video frame by fading estimation/compensation
JPH08111870A (en) Method and device for re-coding image information
CA2544880A1 (en) Improved frequency-domain error concealment
US20070143118A1 (en) Apparatus and method for lossless audio signal compression/decompression through entropy coding
US7173969B2 (en) Moving picture coding apparatus
US5822005A (en) Pre-oddification
EP0903041B1 (en) Improvements in or relating to changing the bit rate of a signal
US6804299B2 (en) Methods and systems for reducing requantization-originated generational error in predictive video streams using motion compensation
US5745181A (en) Motion compensated video processing
US20030123538A1 (en) Video recording and encoding in devices with limited processing capabilities
JP2000278700A (en) Device and method for decoding moving picture
US6012025A (en) Audio coding method and apparatus using backward adaptive prediction
US8018997B2 (en) System and method for video encoding
CN100518316C (en) Method and apparatus for motion compensated temporal interpolation of video sequences
JP2000059792A (en) High efficiency encoding device of dynamic image signal

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ OM PH PL PT RO RU SD SE SG SI SK SL TJ TM TN TR TT TZ UA UG US UZ VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP

WWW Wipo information: withdrawn in national office

Country of ref document: JP