JP2021068451A - 物体の流れを検出するためのカメラ及び物体の高さの測定方法 - Google Patents
物体の流れを検出するためのカメラ及び物体の高さの測定方法 Download PDFInfo
- Publication number
- JP2021068451A JP2021068451A JP2020177891A JP2020177891A JP2021068451A JP 2021068451 A JP2021068451 A JP 2021068451A JP 2020177891 A JP2020177891 A JP 2020177891A JP 2020177891 A JP2020177891 A JP 2020177891A JP 2021068451 A JP2021068451 A JP 2021068451A
- Authority
- JP
- Japan
- Prior art keywords
- camera
- image sensor
- image
- height
- event
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 13
- 238000005259 measurement Methods 0.000 claims abstract description 31
- 238000011156 evaluation Methods 0.000 claims abstract description 20
- 230000033001 locomotion Effects 0.000 claims abstract description 16
- 230000008859 change Effects 0.000 claims description 21
- 230000003287 optical effect Effects 0.000 claims description 14
- 239000011159 matrix material Substances 0.000 claims description 10
- 239000003550 marker Substances 0.000 claims description 5
- 230000007423 decrease Effects 0.000 claims 1
- 238000001514 detection method Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000004397 blinking Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 230000001502 supplementing effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000001174 ascending effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 229910052736 halogen Inorganic materials 0.000 description 1
- 150000002367 halogens Chemical class 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 210000000857 visual cortex Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/188—Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/06—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness for measuring thickness ; e.g. of sheet material
- G01B11/0608—Height gauges
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/04—Interpretation of pictures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
- G06T7/215—Motion-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/10—Image acquisition
- G06V10/12—Details of acquisition arrangements; Constructional details thereof
- G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
- G06V10/147—Details of sensors, e.g. sensor lenses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/695—Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
- H04N23/71—Circuitry for evaluating the brightness variation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/703—SSIS architectures incorporating pixels for producing signals other than image signals
- H04N25/707—Pixels for event detection
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Social Psychology (AREA)
- Psychiatry (AREA)
- Vascular Medicine (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Geometry (AREA)
- Length Measuring Devices By Optical Means (AREA)
- Image Analysis (AREA)
Abstract
Description
Claims (10)
- ある高さの物体(14)と共にカメラ(10)に対してある移動方向(16)に移動する物体の流れの画像データを取得するための多数の画素素子を有する画像センサ(20)と、前記画像データに基づいて各物体(14)の高さを測定するように構成された制御及び評価ユニット(22)とを備えるカメラ(10)において、
前記画像センサ(20)がイベントベースの画像センサであり、前記制御及び評価ユニット(22)は、移動方向に隣接する画素素子がイベントを次々に記録する時点の測定系列を捕らえ、該測定系列から前記画像センサ(20)上での物体(14)の物体像の速度を測定し、該速度から前記高さを測定するように構成されていることを特徴とするカメラ(10)。 - 各画素素子が、該画素素子により検出される強度が変化したらそれを確認し、正確にそのときにイベントベースで画像情報を生成すること、その際、該画素素子は強度が減少したか又は増加したかという差分情報及び/又は強度の変化により定まる時間窓における積分強度を画像情報として生成することを特徴とする請求項1に記載のカメラ(10)。
- 前記隣接する画素素子が前記画像センサ(20)上で少なくとも1つの列配置、特に行列の行又は列を成していることを特徴とする請求項1又は2に記載のカメラ(10)。
- その上で前記物体(14)が搬送されるコンベア装置(12)に固定的に取り付けられていることを特徴とする請求項1〜3のいずれかに記載のカメラ(10)。
- 前記制御及び評価ユニット(22)が、特にパラメータ設定により又は別のセンサ若しくは上位の制御装置との接続により、前記物体(14)の速度を予め与えられていることを特徴とする請求項1〜4のいずれかに記載のカメラ(10)。
- 前記制御及び評価ユニット(22)が、既知の距離にある基準物、特にベルトコンベア(12)の物体像の速度を測定することにより、前記物体(14)の速度を画像データから測定するように構成されていることを特徴とする請求項1〜5のいずれかに記載のカメラ(10)。
- 前記制御及び評価ユニット(22)が、前記基準物(12)の光学的マーカ、特に変調された光源を認識するように構成されていることを特徴とする請求項6に記載のカメラ(10)。
- 前記物体の流れの相対運動が好ましくは一定であり、前記制御及び評価ユニット(22)が前記測定系列のベストフィット直線を求め、その傾きを前記高さの尺度として求めるように構成されていることを特徴とする請求項1〜7のいずれかに記載のカメラ(10)。
- 前記物体(14)が前記カメラ(10)の方に向けられた平面を備えていることを特徴とする請求項1〜8のいずれかに記載のカメラ(10)。
- ある移動方向(16)に移動する物体の流れに含まれる物体(14)の高さを測定する方法であって、前記物体の流れの画像データを多数の画素素子を有する画像センサ(20)で取得して評価することで各物体(14)の高さを測定する方法において、
前記画像データがイベントベースの画像センサ(20)で取得され、移動方向に隣接する画素素子がイベントを次々に記録する時点の測定系列が捕らえられ、該測定系列から前記画像センサ(20)上での物体(14)の物体像の速度が測定され、該速度から前記高さが測定されることを特徴とする方法。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
DE102019128814.2A DE102019128814B4 (de) | 2019-10-25 | 2019-10-25 | Kamera zur Erfassung eines Objektstroms und Verfahren zur Bestimmung der Höhe von Objekten |
DE102019128814.2 | 2019-10-25 |
Publications (2)
Publication Number | Publication Date |
---|---|
JP2021068451A true JP2021068451A (ja) | 2021-04-30 |
JP7124030B2 JP7124030B2 (ja) | 2022-08-23 |
Family
ID=72665191
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
JP2020177891A Active JP7124030B2 (ja) | 2019-10-25 | 2020-10-23 | 物体の流れを検出するためのカメラ及び物体の高さの測定方法 |
Country Status (6)
Country | Link |
---|---|
US (1) | US11527007B2 (ja) |
EP (1) | EP3813355B1 (ja) |
JP (1) | JP7124030B2 (ja) |
CN (1) | CN112710283B (ja) |
DE (1) | DE102019128814B4 (ja) |
DK (1) | DK3813355T3 (ja) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114882853A (zh) * | 2022-04-18 | 2022-08-09 | 深圳锐视智芯科技有限公司 | 曝光时间调整方法、装置、调节设备及存储介质 |
WO2023214079A1 (en) * | 2022-05-06 | 2023-11-09 | Datalogic Ip Tech S.R.L. | Imaging systems with enhanced functionalities with event-based sensors |
WO2024022571A1 (en) * | 2022-07-25 | 2024-02-01 | Siemens Aktiengesellschaft | System and method for detecting an irregularity of an object |
EP4358530B1 (de) * | 2022-10-21 | 2024-09-11 | Sick Ag | Erfassung von objekten eines sich bewegenden objektstroms |
WO2024124288A1 (en) * | 2022-12-14 | 2024-06-20 | Western Sydney University | Systems for imaging a target object moving relative to background features |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011232324A (ja) * | 2010-04-09 | 2011-11-17 | Nippon Steel Corp | 表面欠陥検査装置、表面欠陥検査方法及びプログラム |
JP2017181402A (ja) * | 2016-03-31 | 2017-10-05 | 住友ベークライト株式会社 | 検査装置 |
JP2017187348A (ja) * | 2016-04-04 | 2017-10-12 | 新日鐵住金株式会社 | 表面欠陥検査システム、方法及びプログラム |
Family Cites Families (30)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0954387B1 (en) * | 1997-01-23 | 2004-05-26 | United Parcel Service Of America, Inc. | Optically-guided indicia reader system |
CN1194207C (zh) * | 2003-07-02 | 2005-03-23 | 西安邮电学院 | 一种多截面合成三维形面测量方法 |
DE102006004060B4 (de) * | 2006-01-28 | 2009-09-24 | Basler Ag | Verfahren und Vorrichtung zum Messen der Höhe und/oder des Höhenverlaufs eines Objekts |
EP2212827B1 (en) * | 2007-10-16 | 2019-09-11 | Accu-Sort System, Inc. | Dimensioning and barcode reading system |
US8284988B2 (en) * | 2009-05-13 | 2012-10-09 | Applied Vision Corporation | System and method for dimensioning objects using stereoscopic imaging |
US8508591B2 (en) * | 2010-02-05 | 2013-08-13 | Applied Vision Corporation | System and method for estimating the height of an object using tomosynthesis-like techniques |
IT1403978B1 (it) * | 2011-02-15 | 2013-11-08 | Datalogic Automation Srl | Metodo di acquisizione di immagini |
US8780358B2 (en) * | 2011-06-07 | 2014-07-15 | Sick, Inc. | Inspection apparatus, system, and method |
CN103063141A (zh) * | 2011-10-21 | 2013-04-24 | 东莞富强电子有限公司 | 基于激光测距的零件高度的测量方法 |
CN102433397A (zh) | 2011-12-29 | 2012-05-02 | 甘肃农业大学 | 禽白血病病毒的多重pcr检测引物及其应用 |
EP2677500B1 (en) | 2012-06-19 | 2021-06-23 | Samsung Electronics Co., Ltd. | Event-based image processing apparatus and method |
DK2693362T3 (da) * | 2012-07-31 | 2015-07-27 | Sick Ag | Detekteringssystem til montage på et transportbånd |
ES2593800T3 (es) | 2012-10-31 | 2016-12-13 | Vitronic Dr.-Ing. Stein Bildverarbeitungssysteme Gmbh | Procedimiento y patrón de luz para medir la altura o el curso de la altura de un objeto |
CN103063138B (zh) * | 2013-01-24 | 2016-08-10 | 惠州Tcl移动通信有限公司 | 移动终端摄像头测量物体尺寸的方法及移动终端 |
ES2811152T3 (es) | 2013-09-16 | 2021-03-10 | Prophesee | Circuito de píxel dinámico de un solo fotodiodo y método de funcionamiento del mismo |
NL2015542B1 (en) * | 2015-10-01 | 2017-04-20 | Rexnord Flattop Europe Bv | Planning system and method for maintaining a cycle time in an automobile factory. |
US10260862B2 (en) * | 2015-11-02 | 2019-04-16 | Mitsubishi Electric Research Laboratories, Inc. | Pose estimation using sensors |
KR102337970B1 (ko) | 2016-04-04 | 2021-12-10 | 프로페시 | 샘플-앤드-홀드 기반 시간적 대비 비전 센서 |
EP3313064A1 (en) | 2016-10-20 | 2018-04-25 | Chronocam | Pixel circuit for detecting time-dependent visual data |
US10133944B2 (en) * | 2016-12-21 | 2018-11-20 | Volkswagen Ag | Digital neuromorphic (NM) sensor array, detector, engine and methodologies |
DE102017119084A1 (de) * | 2017-08-21 | 2019-02-21 | Beckhoff Automation Gmbh | System und Verfahren zum Ausrichten eines Objekts |
CN107462742A (zh) * | 2017-09-05 | 2017-12-12 | 北京聚利科技股份有限公司 | 速度测量方法、测量装置、测量系统及车辆 |
EP3454298B1 (de) * | 2017-09-06 | 2019-08-07 | Sick AG | Kameravorrichtung und verfahren zur erfassung eines stromes aus objekten |
EP3505961A1 (en) * | 2017-12-29 | 2019-07-03 | Cognex Corporation | Lens assembly with integrated feedback loop and time-of-flight sensor |
US11493660B2 (en) * | 2018-01-31 | 2022-11-08 | Canon Denshi Kabushiki Kaisha | Inspection device |
DE102018105301B4 (de) * | 2018-03-08 | 2021-03-18 | Sick Ag | Kamera und Verfahren zur Erfassung von Bilddaten |
CN209093917U (zh) * | 2018-11-21 | 2019-07-12 | 广州市贝云科技有限公司 | 对焦读码装置及分拣系统 |
EP3663963B1 (de) | 2018-12-04 | 2021-03-10 | Sick Ag | Lesen von optischen codes |
JP7192627B2 (ja) * | 2019-04-04 | 2022-12-20 | 株式会社デンソー | 落下物判別装置、運転支援システムおよび落下物判別方法 |
CN114174957A (zh) * | 2019-07-30 | 2022-03-11 | 苹果公司 | 使用事件相机的像素传感器进行跟踪 |
-
2019
- 2019-10-25 DE DE102019128814.2A patent/DE102019128814B4/de not_active Expired - Fee Related
-
2020
- 2020-09-28 DK DK20198809.4T patent/DK3813355T3/da active
- 2020-09-28 EP EP20198809.4A patent/EP3813355B1/de active Active
- 2020-10-19 US US17/073,600 patent/US11527007B2/en active Active
- 2020-10-23 JP JP2020177891A patent/JP7124030B2/ja active Active
- 2020-10-26 CN CN202011158009.7A patent/CN112710283B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2011232324A (ja) * | 2010-04-09 | 2011-11-17 | Nippon Steel Corp | 表面欠陥検査装置、表面欠陥検査方法及びプログラム |
JP2017181402A (ja) * | 2016-03-31 | 2017-10-05 | 住友ベークライト株式会社 | 検査装置 |
JP2017187348A (ja) * | 2016-04-04 | 2017-10-12 | 新日鐵住金株式会社 | 表面欠陥検査システム、方法及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
DE102019128814B4 (de) | 2021-05-20 |
CN112710283A (zh) | 2021-04-27 |
JP7124030B2 (ja) | 2022-08-23 |
US20210125362A1 (en) | 2021-04-29 |
EP3813355B1 (de) | 2022-07-06 |
DE102019128814A1 (de) | 2021-04-29 |
DK3813355T3 (da) | 2022-09-05 |
EP3813355A1 (de) | 2021-04-28 |
CN112710283B (zh) | 2022-12-09 |
US11527007B2 (en) | 2022-12-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP2021068451A (ja) | 物体の流れを検出するためのカメラ及び物体の高さの測定方法 | |
CN111274834B (zh) | 光学代码的读取 | |
JP7074955B2 (ja) | 事象ベースの視覚センサのためのデータ速度制御 | |
EP3087341B1 (en) | Method for reconstructing a surface using spatially structured light and a dynamic vision sensor | |
US10134120B2 (en) | Image-stitching for dimensioning | |
JP2022546591A (ja) | Lidar画像の処理 | |
Molleda et al. | An improved 3D imaging system for dimensional quality inspection of rolled products in the metal industry | |
Song et al. | DOE-based structured-light method for accurate 3D sensing | |
US9684840B2 (en) | Detection system | |
CN113412413B (zh) | 用于对振动进行成像和感测的系统和方法 | |
JP5904069B2 (ja) | 画像処理装置、オブジェクト検出方法、およびオブジェクト検出プログラム | |
CN110260795B (zh) | 一种基于增量绝对光栅尺的绝对位移检测方法 | |
US11539895B1 (en) | Systems, methods, and media for motion adaptive imaging using single-photon image sensor data | |
Jadav et al. | Vision based moving object detection and tracking | |
Ge et al. | Lensless sensing using the event sensor | |
JP4674920B2 (ja) | 対象個数検出装置および対象個数検出方法 | |
JP4966096B2 (ja) | 光切断3次元計測装置 | |
JPH11241916A (ja) | 高さ測定方法、高さデータ処理方法及び高さ測定装置 | |
KR101863839B1 (ko) | 영상을 이용한 고속, 반복 길이 측정방법 및 장치 | |
KR102234984B1 (ko) | 반도체 웨이퍼의 파티클 검출장치 | |
US20230196808A1 (en) | Code reader and method of reading an optical code | |
US20240233087A9 (en) | Detection of objects of a moving object stream | |
El Shair et al. | High Speed Hybrid Object Tracking Algorithm using Image and Event Data | |
Kucukyıldız et al. | Bottle counting system for a re-cycling facility based on processing of depth images | |
JP2008232780A (ja) | 非接触振動計測システム、非接触振動計測方法及びコンピュータプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A621 | Written request for application examination |
Free format text: JAPANESE INTERMEDIATE CODE: A621 Effective date: 20201130 |
|
A131 | Notification of reasons for refusal |
Free format text: JAPANESE INTERMEDIATE CODE: A131 Effective date: 20220118 |
|
A521 | Request for written amendment filed |
Free format text: JAPANESE INTERMEDIATE CODE: A523 Effective date: 20220415 |
|
TRDD | Decision of grant or rejection written | ||
A01 | Written decision to grant a patent or to grant a registration (utility model) |
Free format text: JAPANESE INTERMEDIATE CODE: A01 Effective date: 20220809 |
|
A61 | First payment of annual fees (during grant procedure) |
Free format text: JAPANESE INTERMEDIATE CODE: A61 Effective date: 20220810 |
|
R150 | Certificate of patent or registration of utility model |
Ref document number: 7124030 Country of ref document: JP Free format text: JAPANESE INTERMEDIATE CODE: R150 |