[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

JP2898787B2 - Motion vector detection device - Google Patents

Motion vector detection device

Info

Publication number
JP2898787B2
JP2898787B2 JP14662491A JP14662491A JP2898787B2 JP 2898787 B2 JP2898787 B2 JP 2898787B2 JP 14662491 A JP14662491 A JP 14662491A JP 14662491 A JP14662491 A JP 14662491A JP 2898787 B2 JP2898787 B2 JP 2898787B2
Authority
JP
Japan
Prior art keywords
motion vector
gradient
horizontal
integrator
vertical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
JP14662491A
Other languages
Japanese (ja)
Other versions
JPH04345395A (en
Inventor
洋志 平林
裕司 野尻
保明 金次
正一 鈴木
源 曽根原
純二 熊田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Japan Broadcasting Corp
Original Assignee
Nippon Hoso Kyokai NHK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP14662491A priority Critical patent/JP2898787B2/en
Application filed by Nippon Hoso Kyokai NHK filed Critical Nippon Hoso Kyokai NHK
Priority to DE69230115T priority patent/DE69230115T2/en
Priority to US07/971,922 priority patent/US5436674A/en
Priority to PCT/JP1992/000659 priority patent/WO1992021210A1/en
Priority to EP92910679A priority patent/EP0540762B1/en
Priority to DE69229705T priority patent/DE69229705T2/en
Priority to EP97110945A priority patent/EP0806866B1/en
Publication of JPH04345395A publication Critical patent/JPH04345395A/en
Application granted granted Critical
Publication of JP2898787B2 publication Critical patent/JP2898787B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Image Analysis (AREA)

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【産業上の利用分野】この発明は複合勾配法を用いた画
像の動きベクトル検出装置に関するものである。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image motion vector detecting apparatus using a composite gradient method.

【0002】[0002]

【従来の技術】従来の複合勾配法を用いた画像の動きベ
クトル検出装置では、動きベクトルは大略以下のように
記載することができる。
2. Description of the Related Art In a conventional apparatus for detecting a motion vector of an image using a composite gradient method, a motion vector can be generally described as follows.

【0003】[0003]

【数1】 すなわち、Δti ,Δxi ,Δyi を各々フィールドま
たはフレーム間差信号、水平勾配、垂直勾配とすると検
出ベクトルv(vx ,vy )は、
(Equation 1) That, Delta] t i, [Delta] x i, each field or inter-frame difference signal [Delta] y i, horizontal gradient, the detected vector v and vertical gradient (v x, v y) is

【0004】[0004]

【数2】 となる。ここでiは零でない正の整数である。(Equation 2) Becomes Here, i is a non-zero positive integer.

【0005】ここで、複合勾配法の複合とは、画面をい
くつかの小ブロックに分割し、その各ブロックごとに画
像の動きベクトルを求めることを考える場合、その小ブ
ロックに属する複数画素iのフィールド又はフレーム間
差信号よりそれぞれ式(1) または式(2) の演算法を用い
て、その小ブロックの動きベクトルを求めるという意味
で名付けられたものである。また式(2) の分母の|Δx
i |および|Δyi |は、それぞれx方向およびy方
向、すなわち画面の水平走査方向および垂直方向隣接画
素間画像信号の差分より求まる勾配信号の絶対値のこと
である。
Here, the compound of the compound gradient method means that when a screen is divided into several small blocks and a motion vector of an image is obtained for each block, a plurality of pixels i belonging to the small block are considered. It is named in the sense that the motion vector of the small block is obtained from the field or inter-frame difference signal by using the calculation method of Expression (1) or Expression (2), respectively. Also, | Δx of the denominator of equation (2)
i | and | [Delta] y i | is, x and y directions, respectively, that is to say the absolute value of the slope signal determined by the difference in the horizontal scanning direction and the vertical direction adjacent-pixel image signals of the screen.

【0006】[0006]

【発明が解決しようとする課題】従来技術の項で述べて
きた式(1) および(2) より明らかなごとく、従来の複合
勾配法では、勾配信号が小さい領域では、演算式の分母
すなわち勾配信号の絶対値和が零に近い値になる。その
ため検出ベクトルの値が、真のベクトル値に比し非常に
大きな値を示すことになり大きな誤差を生ずる。従って
本発明の目的は、前述の欠点を排除した画像の動きベク
トル検出装置を提供せんとするものである。
As is clear from the equations (1) and (2) described in the section of the prior art, in the conventional compound gradient method, in a region where the gradient signal is small, the denominator of the arithmetic expression, that is, the gradient is used. The sum of absolute values of the signal becomes a value close to zero. Therefore, the value of the detection vector shows a very large value as compared with the true vector value, and a large error occurs. Accordingly, an object of the present invention is to provide an image motion vector detecting device which eliminates the above-mentioned disadvantages.

【0007】[0007]

【課題を解決するための手段】この目的を達成するた
め、本発明動きベクトル検出装置は、画面を複数の小ブ
ロックに分割し、各ブロック毎にそれを代表する画像の
動きベクトルを水平および垂直成分の組として複合勾配
法により求める動きベクトル検出装置であって、かつ、
前記複合勾配法により動きベクトルの水平または垂直成
分を求める動きベクトル検出装置が、前記小ブロックを
構成する正の整数i個の複数画素それぞれについて求め
られたフィールドまたはフレーム間差値Δti に、該間
差値Δtiのそれぞれの位置に対応する空間勾配の符号
を考慮した水平勾配符号 sign (Δxi )または垂直勾
配符号sign(Δyi )を乗ずる乗算器と、該乗算器で得
られたi個の乗算値を積算する第1の積算器と、前記i
個の複数画素それぞれに対応する水平勾配の絶対値|Δ
i |または垂直勾配の絶対値|Δyi |を積算する第
2の積算器と、第1の積算器で得られた積算値を第2の
積算器で得られた積算値で除する除算器とを具え、該除
算器から得られた除算値を動きベクトルの水平または垂
直成分として、これより前記小ブロックの動きベクトル
を求めるようにした動きベクトル検出装置であるものに
おいて、前記複数画素それぞれに対応する水平勾配Δx
i または垂直勾配Δyi にディザ信号 S1 またはS2
を加算したうえで絶対値|Δxi +S1 |または|Δy
i +S2 |をとり、第2の積算器への入力信号として供
給するように構成したことを特徴とするものである。
In order to achieve the above object, a motion vector detecting apparatus according to the present invention divides a screen into a plurality of small blocks, and for each block, moves a motion vector of a representative image horizontally and vertically. A motion vector detection device obtained by a composite gradient method as a set of components, and
A motion vector estimating device that obtains a horizontal or vertical component of the motion vector by the composite gradient method adds a field or inter-frame difference value Δt i obtained for each of a plurality of positive integer i pixels constituting the small block to the motion vector detecting device. A multiplier multiplied by a horizontal gradient code sign (Δx i ) or a vertical gradient code sign (Δy i ) considering the sign of the spatial gradient corresponding to each position of the difference value Δt i , and i obtained by the multiplier A first integrator for integrating the multiplied values, i.
Absolute value of the horizontal gradient corresponding to each of the plurality of pixels | Δ
a second integrator that integrates x i | or the absolute value of the vertical gradient | Δy i | and a division that divides the integrated value obtained by the first integrator by the integrated value obtained by the second integrator A motion vector detection device comprising a divider and a horizontal or vertical component of a motion vector obtained from the divider as a horizontal or vertical component, thereby obtaining a motion vector of the small block. Horizontal gradient Δx corresponding to
i or the vertical gradient Δy i to the dither signal S 1 or S 2
And the absolute value | Δx i + S 1 | or | Δy
i + S 2 | is taken and supplied as an input signal to the second integrator.

【0008】[0008]

【作用】複合勾配法を用いた本発明動きベクトル検出装
置によれば、式(1) および式(2) における除数Σ|Δx
i |およびΣ|Δyi |が小さくなり限りなく零に近づ
いた場合でも、Δxi およびΔyi にそれぞれ小さい値
ではあるが有限のディザ信号S1 とS2 が加算されてい
るので式(1) および式(2) の除数が有限となり動きベク
トルに大きな誤差を生ずることがない。
According to the motion vector detecting apparatus of the present invention using the composite gradient method, the divisor Σ | Δx in the equations (1) and (2) is used.
Even if i | and Σ | Δy i | become small and approach zero indefinitely, since the small but finite dither signals S 1 and S 2 are added to Δx i and Δy i , Equation (1) ) And the divisor of equation (2) are finite, so that no large error occurs in the motion vector.

【0009】[0009]

【実施例】以下添付図面を参照し実施例により本発明を
詳細に説明する。従来の複合勾配法を説明するためのブ
ロック線図を図2に示す。符号Δti ,Δxi ,Δyi
を各々着目画素のフィールド間差分、水平勾配、垂直勾
配とすると検出ベクトルv(vx ,vy ) は従来技術の
項でも述べたように次式で表わされる。
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described in detail below with reference to the accompanying drawings. FIG. 2 is a block diagram for explaining the conventional compound gradient method. Signs Δt i , Δx i , Δy i
Is the difference between the fields of the pixel of interest, the horizontal gradient, and the vertical gradient, the detection vector v (v x , v y ) is expressed by the following equation as described in the section of the prior art.

【0010】[0010]

【数3】 これに対し、本発明に係る複合勾配法を用いた動きベク
トル検出装置のブロック線図を図1に示す。図1に示す
ように、勾配信号にディザ信号S1 ,S2 を加算する。
検出ベクトルv(vx ,vy ) は次のように表わすこと
ができる。
(Equation 3) On the other hand, FIG. 1 shows a block diagram of a motion vector detecting device using the composite gradient method according to the present invention. As shown in FIG. 1, dither signals S 1 and S 2 are added to the gradient signal.
The detection vector v (v x , v y ) can be expressed as follows.

【0011】[0011]

【数4】 図1に示すように、ディザ信号S1 ,S2 は平均値が零
の交流信号であるため、勾配信号Δxi ,Δyi が大き
い領域では、積算器6の出力におけるディザ信号加算の
効果は零もくしは零に非常に近い値となるが、勾配信号
が小さくなるにしたがい、積算器6の出力におけるディ
ザ信号S1 ,S2 加算の効果は相対的に段々と大きくな
る。
(Equation 4) As shown in FIG. 1, since the dither signals S 1 and S 2 are AC signals having an average value of zero, the effect of the addition of the dither signal on the output of the integrator 6 is large in a region where the gradient signals Δx i and Δy i are large. Although zero comb is a value very close to zero, as the gradient signal becomes smaller, the effect of adding the dither signals S 1 and S 2 on the output of the integrator 6 becomes relatively larger.

【0012】すなわち、式(3) 、式(4) のvx ,vy
絶対値は、勾配の大きな領域では、ディザ加算の影響は
受けず、勾配が小さい領域では、式(2)に比べて分母
が大きくなることにより式(2)より小さい値を示すこ
とになる。この勾配信号にディザ信号を加算する方法
は、初期偏位ベクトルを用いた勾配法による動きベクト
ル検出においてより有効である(図3参照)。初期偏位
ベクトルとして真の動きベクトルに近い値が選択されて
いるとする。勾配信号にディザ加算を行なっていない方
法では、勾配の小さな領域で、式(2) から求まる偏位ベ
クトルvx ,vy の絶対値は非常に大きな値となり、検
出ベクトルが大きく誤まることになる。これに対して、
勾配信号にディザ信号を加えた方法では、勾配の小さな
領域でも、vx ,vy は零に近く、したがって検出ベク
トルも初期偏位ベクトルに近い値となり、大きな誤まり
を生じることがない。
That is, the absolute values of v x and v y in Equations (3) and (4) are not affected by dither addition in a region where the gradient is large, and are expressed by Equation (2) in a region where the gradient is small. By increasing the denominator, a value smaller than Expression (2) is indicated. The method of adding a dither signal to this gradient signal is more effective in detecting a motion vector by a gradient method using an initial deviation vector (see FIG. 3). It is assumed that a value close to the true motion vector is selected as the initial deviation vector. In the method in which dither addition is not performed on the gradient signal, the absolute values of the displacement vectors v x and v y obtained from the equation (2) become very large in a region where the gradient is small, and the detection vector becomes significantly wrong. Become. On the contrary,
In the method in which the dither signal is added to the gradient signal, even in a region where the gradient is small, v x and v y are close to zero, so that the detection vector has a value close to the initial deviation vector, and does not cause a large error.

【0013】[0013]

【発明の効果】従来の複合勾配法では、勾配信号の小さ
い領域で、検出ベクトル値が真のベクトル値に比べ、非
常に大きな値を示し、誤りベクトルとなる。本発明では
勾配信号にディザ信号を加えることにより、勾配信号の
小さい領域でも検出ベクトルに大きな誤差を生じること
なく、しかも勾配信号の大きい領域では影響を与えな
い。本発明を従来用いられている初期偏位ベクトルを用
いた複合勾配法に適用すると、ディザ信号の影響を受け
て勾配信号の小さい領域の偏位ベクトルは零に近く、検
出ベクトルは初期偏位ベクトルに近い値となり、初期偏
位ベクトルが正しければ動き検出ベクトルも正しい値が
算出される。
According to the conventional composite gradient method, the detected vector value shows an extremely large value as compared with the true vector value in an area where the gradient signal is small, and becomes an error vector. In the present invention, the addition of the dither signal to the gradient signal does not cause a large error in the detection vector even in the region where the gradient signal is small, and has no effect in the region where the gradient signal is large. When the present invention is applied to the conventional composite gradient method using the initial deviation vector, the deviation vector in a region where the gradient signal is small due to the influence of the dither signal is close to zero, and the detection vector is the initial deviation vector. , And if the initial displacement vector is correct, a correct value is calculated for the motion detection vector.

【図面の簡単な説明】[Brief description of the drawings]

【図1】図1は、本発明による動きベクトル検出装置の
ブロック線図を示す。
FIG. 1 shows a block diagram of a motion vector detection device according to the present invention.

【図2】図2は、従来の動きベクトル検出装置のブロッ
ク線図を示す。
FIG. 2 shows a block diagram of a conventional motion vector detection device.

【図3】図3は、従来用いられている初期偏位を用いた
勾配法に本発明を適用したブロック線図を示す。
FIG. 3 is a block diagram in which the present invention is applied to a conventionally used gradient method using an initial deviation.

フロントページの続き (72)発明者 鈴木 正一 東京都世田谷区砧一丁目10番11号 日本 放送協会放送技術研究所内 (72)発明者 曽根原 源 東京都世田谷区砧一丁目10番11号 日本 放送協会放送技術研究所内 (72)発明者 熊田 純二 東京都世田谷区砧一丁目10番11号 日本 放送協会放送技術研究所内 (58)調査した分野(Int.Cl.6,DB名) H04N 7/24 - 7/68 G06T 7/20 (72) Inventor Shoichi Suzuki 1-10-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Corporation Research Institute (72) Inventor Gen Sonehara 1-110-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Japan Broadcasting Corporation Research Institute (72) Inventor Junji Kumada 1-10-11 Kinuta, Setagaya-ku, Tokyo Japan Broadcasting Corporation Research Institute (58) Field surveyed (Int.Cl. 6 , DB name) H04N 7/24 -7/68 G06T 7/20

Claims (1)

(57)【特許請求の範囲】(57) [Claims] 【請求項1】 画面を複数の小ブロックに分割し、各ブ
ロック毎にそれを代表する画像の動きベクトルを水平お
よび垂直成分の組として複合勾配法により求める動きベ
クトル検出装置であって、かつ、前記複合勾配法により
動きベクトルの水平または垂直成分を求める動きベクト
ル検出装置が、前記小ブロックを構成する正の整数i個
の複数画素それぞれについて求められたフィールドまた
はフレーム間差値Δti に、該間差値Δti のそれぞれ
の位置に対応する空間勾配の符号を考慮した水平勾配符
号 sign (Δxi )または垂直勾配符号sign(Δyi
を乗ずる乗算器と、該乗算器で得られたi個の乗算値を
積算する第1の積算器と、前記i個の複数画素それぞれ
に対応する水平勾配の絶対値|Δxi |または垂直勾配
の絶対値|Δyi |を積算する第2の積算器と、第1の
積算器で得られた積算値を第2の積算器で得られた積算
値で除する除算器とを具え、該除算器から得られた除算
値を動きベクトルの水平または垂直成分として、これよ
り前記小ブロックの動きベクトルを求めるようにした動
きベクトル検出装置であるものにおいて、 前記複数画素それぞれに対応する水平勾配Δxi または
垂直勾配Δyi にディザ信号 S1 またはS2 を加算し
たうえで絶対値|Δxi +S1 |または|Δyi +S2
|をとり、第2の積算器への入力信号として供給するよ
うに構成したことを特徴とする動きベクトル検出装置。
1. A motion vector detecting device which divides a screen into a plurality of small blocks and obtains a motion vector of an image representing each block as a set of horizontal and vertical components by a composite gradient method, and A motion vector estimating device that obtains a horizontal or vertical component of the motion vector by the composite gradient method adds a field or inter-frame difference value Δt i obtained for each of a plurality of positive integer i pixels constituting the small block to the motion vector detecting device. Horizontal gradient code sign (Δx i ) or vertical gradient code sign (Δy i ) considering the sign of the spatial gradient corresponding to each position of the difference value Δt i
, A first integrator for integrating the i multiplied values obtained by the multiplier, and an absolute value | Δx i | or a vertical gradient of a horizontal gradient corresponding to each of the i pixels. A second integrator that integrates the absolute value | Δy i | of the first and second integrators, and a divider that divides the integrated value obtained by the first integrator by the integrated value obtained by the second integrator. In a motion vector detecting apparatus which obtains a motion vector of the small block from the divided value obtained from the divider as a horizontal or vertical component of the motion vector, a horizontal gradient Δx corresponding to each of the plurality of pixels is provided. i or the vertical gradient Δy i plus the dither signal S 1 or S 2 , and then the absolute value | Δx i + S 1 | or | Δy i + S 2
| Is supplied as an input signal to a second integrator.
JP14662491A 1991-05-23 1991-05-23 Motion vector detection device Expired - Lifetime JP2898787B2 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
JP14662491A JP2898787B2 (en) 1991-05-23 1991-05-23 Motion vector detection device
US07/971,922 US5436674A (en) 1991-05-23 1992-05-22 Method of detecting motion vector, apparatus therefor, and picture signal processing system utilizing the apparatus
PCT/JP1992/000659 WO1992021210A1 (en) 1991-05-23 1992-05-22 Method for detecting moving vector and apparatus therefor, and system for processing image signal using the apparatus
EP92910679A EP0540762B1 (en) 1991-05-23 1992-05-22 Method for detecting moving vector and apparatus therefor, and system for processing image signal using the apparatus
DE69230115T DE69230115T2 (en) 1991-05-23 1992-05-22 Evaluation device and method used for a device for the detection of motion vectors
DE69229705T DE69229705T2 (en) 1991-05-23 1992-05-22 METHOD FOR DETECTING A MOTION VECTOR AND DEVICE THEREFOR AND SYSTEM FOR PROCESSING AN IMAGE SIGNAL WITH THIS DEVICE
EP97110945A EP0806866B1 (en) 1991-05-23 1992-05-22 Evaluation apparatus and method usable in motion vector detecting apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP14662491A JP2898787B2 (en) 1991-05-23 1991-05-23 Motion vector detection device

Publications (2)

Publication Number Publication Date
JPH04345395A JPH04345395A (en) 1992-12-01
JP2898787B2 true JP2898787B2 (en) 1999-06-02

Family

ID=15411947

Family Applications (1)

Application Number Title Priority Date Filing Date
JP14662491A Expired - Lifetime JP2898787B2 (en) 1991-05-23 1991-05-23 Motion vector detection device

Country Status (1)

Country Link
JP (1) JP2898787B2 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5975791B2 (en) * 2012-08-27 2016-08-23 三菱電機株式会社 Image processing apparatus and method, and image display apparatus and method

Also Published As

Publication number Publication date
JPH04345395A (en) 1992-12-01

Similar Documents

Publication Publication Date Title
Shah et al. Resolution enhancement of color video sequences
US4672442A (en) Frame rate conversion system in television signal
US5341174A (en) Motion compensated resolution conversion system
JP2947360B2 (en) Method and apparatus for measuring image motion
US7412075B2 (en) Picture processing apparatus for processing picture data in accordance with background information
EP0632915B1 (en) A machine method for compensating for non-linear picture transformations, e.g. zoom and pan, in a video image motion compensation system
EP0367310B1 (en) Picture motion measurement
US6160917A (en) Method of calculating motion vectors
JP2898787B2 (en) Motion vector detection device
Vlachos Simple method for estimation of global motion parameters using sparse translational motion vector fields
US6496606B1 (en) Static image generation method and device
US5321515A (en) Image fluctuation correcting apparatus
EP0454483B1 (en) Movement vector detection device
JP4028615B2 (en) Signal processing system, image processing apparatus, and circuit for converting signal
JP3252418B2 (en) Image shake determination device
JP3078140B2 (en) Motion vector detection circuit
JP3303311B2 (en) Image vibration correction apparatus and image vibration correction method
JP3303312B2 (en) Image vibration correction apparatus and image vibration correction method
JPS59210773A (en) Television signal processing circuit
Belanger et al. Pixel and subpixel image stabilization at video rate for airborne long-range imaging sensors
Castellano et al. CDWT optical flow applied to moving target detection
JP2910284B2 (en) Moving vector detecting method and apparatus
JPH03140069A (en) Moving vector detector
JPH02295288A (en) Dynamic vector detecting device
JPH05153470A (en) Motion vector detector

Legal Events

Date Code Title Description
R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090312

Year of fee payment: 10

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100312

Year of fee payment: 11

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110312

Year of fee payment: 12

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120312

Year of fee payment: 13

EXPY Cancellation because of completion of term
FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120312

Year of fee payment: 13