KR20210070702A - Image processing apparatus and image processing method - Google Patents

Abstract

According to the present invention, provided is an image processing device, which includes: a DVS module which generates a flag when a change in input light occurs; an interface module which differently generates a control signal of a TDI sensor according to the flag; and a TDI module which controls whether the TDI sensor operates according to the control signal of the TDI sensor and outputs image information. The image processing device of the present invention can use equipment for a long time by reducing power consumption.

Description

Image processing apparatus and image processing method

The present invention relates to an image processing apparatus and an image processing method.

An imaging device to which the present invention time delay integration (TDI: Time Delay Integration) method is applied is known. The image sensor (hereinafter referred to as the TDI sensor) using the time delay integration method can secure a large amount of light by integrating the luminance value according to the movement of the subject while moving the subject little by little, and by integrating the image There is also an effect of improving noise through smoothing.

The TDI sensor may be applied to a line scanner. Specifically, it can be used to inspect the same product in a repeatedly moving batch, or to inspect the quality of a two-dimensional or three-dimensional product.

For example, Korean Patent Registration No. 10-1174081, a flat substrate automatic monitoring system and method, discloses a technology to which a TDI image sensor is applied as a method for detecting errors in the substrate.

The conventional TDI sensor has the following problems.

First, since the TDI sensor has to process the same repeated image, power consumption increases. This problem can shorten the operating time in the case of portable measuring equipment.

Second, since all image pixels are post-processed to generate an image, the load of the image processing apparatus increases for image processing.

Third, there is a problem in that the driving time increases for pixel processing and post-processing of the TDI sensor itself.

Republic of Korea Patent 10-1174081, Flat substrate automatic monitoring system and method

The present invention is proposed in order to solve the above problems, and proposes an image processing apparatus and an image processing method capable of reducing power consumption of an image processing apparatus using a TDI sensor.

The present invention proposes an image processing apparatus and an image processing method capable of reducing the load on the image processing apparatus by reducing the amount of post-processing of pixels.

The present invention proposes an image processing apparatus and an image processing method that enable rapid image processing by reducing the driving time required for pixel processing.

An image processing apparatus according to the present invention includes: a DVS module for generating a flag when a change occurs in input light; an interface module that differently generates a control signal of the TDI sensor according to the flag; and a TDI module that controls whether the TDI sensor operates according to the control signal of the TDI sensor and outputs image information.

The present invention proposes an image processing apparatus and an image processing method capable of using the device for a long time by reducing power consumption.

The present invention proposes an image processing apparatus and an image processing method that can operate more quickly and accurately by reducing the processing load of pixels.

1 is a block diagram of an image processing apparatus according to an embodiment;
2 is an enlarged view of an exemplary light receiving unit;
3 is a view for explaining an image processing method;
4 is a timing chart comparing an output signal of a conventional TDI sensor and an output signal of an image processing apparatus according to an embodiment;
5 is a timing chart in which only cases in which signals are present in all output signals of the image processing apparatus are collected;

Hereinafter, specific embodiments of the present invention will be described in detail with reference to the drawings. However, the spirit of the present invention is not limited to the following embodiments, and those skilled in the art who understand the spirit of the present invention can easily change other embodiments included within the scope of the same idea by adding, changing, deleting, and adding components. However, this will also be included within the scope of the present invention.

1 is a block diagram of an image processing apparatus according to an embodiment.

Referring to FIG. 1 , in the image processing apparatus of the embodiment, a DVS (Dynamic Vision Sensor) module 1 that generates a flag when a change occurs in input light, and a TDI sensor according to the flag of the DVS module 1 The interface module 2 for generating a control signal, and the TDI module 3 for controlling whether the TDI sensor operates according to the control signal of the interface module 2 are included.

The DVS applied to the DVS module 1 is a sensor that selectively outputs only data corresponding to a change in an image when an event such as a change in brightness of a light-receiving pixel occurs. According to the DVS, it is possible to operate quickly, to obtain this G information without blurring of an image moving at high speed, and to obtain the advantages of reducing output data.

The image processing apparatus of the embodiment can operate the image processing apparatus stably at high speed by applying the DVS.

In the DVS module 1, at least one light-receiving pixel 11 arranged perpendicular to the transfer direction of the image processing device, and a flag generating unit that generates a flag as output data when an event occurs in the light-receiving pixel 11 (12) is included.

The flag generated by the flag generating unit 12 may be generated when an event such as a change in brightness according to an image of an object received by the light receiving pixel 11 occurs.

The flag generated by the flag generator 12 is transmitted to the interface module 2 .

The interface module 2 includes a TDI mode control signal generating unit 21 that generates a control signal of the TDI module 3 according to the flag, and whether the background image is removed according to a control signal of an external manipulation unit 4 . A background control signal generating unit 22 that determines the background control signal, and a synthesizing unit 23 for transmitting the TDI mode control signal and the background control signal together may be included.

The manipulation unit 4 may be operated by the user selecting in advance that the background image is included or that the background image is removed. Accordingly, the background control signal generator 22 is configured to generate a first control signal corresponding to mode 0, which is a mode including a background signal, and a second control signal, corresponding to mode 1, which does not include a background signal. can

The third combining unit 23 may be provided when a single line communication method is applied. When each of the TDI mode control signal and the background control signal is transmitted separately, it may not be separately provided.

The TDI module 3 includes a TDI driver 31 that is selectively operated according to the presence or absence of the TDI mode control signal. When the TDI control signal is generated by generating the flag according to the change in brightness of the target object, the TDI driver 31 performs a series of operations as a TDI sensor. For example, the plurality of light-receiving pixels 311 provided in parallel to the moving direction of the object operate with a time difference, so that the signal of each light-receiving pixel may be integrated.

The TDI driver 31 may not perform a series of operations as a TDI sensor when there is no TDI control signal because the flag is generated because there is no change in the brightness of the target object. According to this, since the operation of the TDI sensor with a large amount of power consumption is not performed, a power dissipation effect can be obtained.

Meanwhile, at a current point in time when the TDI driver 31 operates, the output value of the image of the target object may be stored in the current output data storage unit 34 .

The TDI module 3 may include two operation units operated according to the background control signal. Specifically, first, when the background control signal is the first control signal, the previous output data storage unit 32 is activated to output previous output data, and secondly, when the background control signal is the second control signal, A skip signal generator 33 that is activated and generates a skip signal may be included.

The current output data output from the current output data storage unit 34 may be divided into three branches and transmitted. Specifically, first, it may be stored in the previous output data storage unit 32 and stored as previous output data after one cycle. Second, it may be transmitted to the first combining unit 35 and output as current output data in the case of mode 0. Third, it may be transmitted to the second synthesizing unit 36 and output as current output data in the case of mode 1.

The first combining unit 35 outputs the current output data output from the current output data storage unit 34 when the mode 0 is performed and there is the TDI control signal. The first combining unit 35 outputs the previous output data output from the previous output data storage unit 32 when the mode 0 is performed and there is no TDI control signal.

The data output from the first synthesizing unit 35 may output an entire image including a background, not just a boundary in which the brightness of the target object changes.

The second combining unit 36 outputs the current output data output from the current output data storage unit 34 when the mode 1 is performed and there is the TDI control signal. The second synthesizing unit 35 outputs a skip signal output from the skip signal generator 32 when the mode 1 is performed and there is no TDI control signal.

Data output from the first synthesizing unit 35 may output only a boundary in which the brightness of the target object changes. Therefore, images other than only the border may not be output.

In the image processing apparatus according to the embodiment, since it operates only when the operation of the TDI driver 31 is necessary, an effect of reducing power consumption can be obtained. In addition to this, since hardware resources and calculation amount for processing pixel information can be reduced, it can operate stably at high speed. In other words, by storing and using the changed image information only when an event such as the brightness of the target object changes, the amount of calculation for summing each pixel value in the TDI sensor can be reduced, thereby preventing wastage of additional hardware resources. can

In this embodiment, the user can take the background (herein, the background refers to all images except those that appear as a boundary) information together or exclude the background according to the user's selection, not just the boundary of the object. Of course you can get it.

The image processing apparatus according to the embodiment may be more accurately understood through the enlarged view of the exemplary light receiving unit shown in FIG. 2 and the image processing method shown in FIG. 3 .

First, referring to FIG. 2 , based on the relative movement direction of the target object and the image processing apparatus of the embodiment, at least one light receiving pixel 11 of the DVS module 1, preferably two or more placed orthogonally. If there is one light receiving pixel 11 of the DVS module 1, it may be used when checking a one-dimensional arrangement of a one-dimensional image. Preferably, in response to a two-dimensional image, at least two light-receiving pixels 11 are arranged to be orthogonal to the target object and the relative movement direction of the image processing apparatus of the embodiment.

The light-receiving pixels 311 of the TDI module 3 have the same arrangement of the light-receiving pixels 11 of the DVS module 1 in the relative movement direction of the object and the image processing apparatus of the embodiment and suitable for TDI action in the rear. It can be placed in number.

The DVS module 1 and the TDI module 3 may be connected to each other by the interface module 2 . The TDI module 3 may be controlled according to the flag of the DVS module 1 . In FIG. 2 , the manipulation unit 4 is omitted, and the interaction between the image processing apparatus and the target object can be understood through the configuration shown in FIG. 2 .

Referring to FIG. 3 , light is input to the light receiving pixel 11 of the nth DVS module 1 ( S1 ). Of course, the input light may include image information of a specific position of the target object. It is determined whether or not the received light is different from the light input immediately before, and whether to generate a flag (S2). When the received light differs from the light input immediately before, the flag is generated. The flag may be generated by the flag generator 12 .

According to the flag, the TDI mode control signal generator 21 generates the TDI mode control signal. When there is the TDI mode control signal, the TDI driver 31 drives (S3). The TDI driver 31 may time-integrate information input from the light-receiving pixel 311 of the TDI module 3 to provide current image information. The current image information may be output as n-th current output data (S8).

The n-th current output data may be provided as an integral value of signal values of the N light-receiving pixels 311 arranged in the same direction as the moving direction of the target object.

The n-th current output data may be stored in the current output data storage unit 34 , and may be output through the first combining unit 35 or the second combining unit 36 . The operations of the synthesizing units 35 and 36 have already been described. For example, the current output data may be outputted through the first synthesizing unit 35 in the case of the mode 0, and may be output through the second synthesizing unit 36 in the case of the 1st mode. have.

The above process may be returned to be performed for all of the N light-receiving pixels 11 . Thereafter, the target object may move in time and then return again (S9). That is, after being performed for all of the N light-receiving pixels, the first light-receiving pixel can be moved. The above process may be performed in parallel, may be performed serially, may be performed by merging serial and parallel.

On the other hand, if the light received in the flag generation determination step S2 is the same as the light input immediately before, the flag is not generated. In this case, the TDI driving unit 311 does not operate (S4), and inquires the set mode (S5).

When the set mode is the mode 0, the output data of the previous stage is output (S6) and output as the nth output data (S8). In this case, the n-th output data may be data stored in the previous output data storage unit 32 .

Even after the target object moves, if the flag is not generated in the flag generation determination step S2, the same output data may be continuously output. In this case, the regular TDI driving unit 31 does not operate, and only outputs the same data without any actual operation even in the post-processing stage.

On the other hand, if the light received in the flag generation determination step S2 is the same as the light input immediately before, the flag is not generated. In this case, the TDI driving unit 311 does not operate (S4) and inquires for a set mode (S5).

When the set mode is the mode 1, there is no output data and there is no output of pixel information (S7). In this case, the skip signal generated by the skip signal generator 33 is transmitted to the second synthesis unit 36, so that the signal-free state can be transmitted to the outside.

Thereafter, even after the target object moves, if a flag is not generated in the flag generation determination step S2, a state in which there is no output data may be continuously maintained. In this case, the regular TDI driver 31 does not operate, and a state in which there is no output signal may be maintained without a substantial operation even in the post-processing stage.

4 is a timing chart comparing the output signal of the conventional TDI sensor with the output signal of the image processing apparatus according to the embodiment, and FIG. 5 is a timing chart that collects only the case where there is a signal in all output signals of the image processing apparatus according to the embodiment to be.

Referring to FIG. 4 , in the case of the embodiment, the flag is not generated in the case of G2, G3, G6, G8, G9, and G10, indicating that the TDI driver does not operate. The light-receiving pixels of the DVS are exemplified in four cases. Of course, in the conventional TDI sensor, it can be seen that the TDI operation is performed in all cases.

Referring to FIG. 5 , it can be seen that the signal output by the image processing apparatus and the image processing method according to the embodiment is significantly reduced. Accordingly, a post-processing process for processing an image can be easily performed. In addition, it can be seen that the amount of power consumption for driving the TDI sensor is also reduced.

The image processing apparatus and processing method using the TDI sensor according to the present invention have the advantages of reducing power consumption, reducing hardware operation time, and reducing system load, thereby enabling stable system operation.

1: DVS module
2: Interfacing module
3: TDI module

Claims (9)

a DVS module that generates a flag when a change in input light occurs;
an interface module that differently generates a control signal of the TDI sensor according to the flag; and
and a TDI module for outputting image information by controlling whether the TDI sensor operates according to the control signal of the TDI sensor. The method of claim 1,
The DVS module includes: light-receiving pixels of at least two DVS modules arranged in a direction crossing the moving direction of the object; and
An image processing apparatus including a light-receiving pixel of a TDI module disposed behind a light-receiving pixel of each of the DVS modules. The method of claim 1,
In the TDI module,
TDI driver for performing TDI action;
a current output data storage unit for storing a current output signal of the TDI driver and outputting a current output signal when the flag is present;
and a previous output data storage unit for storing the previous output signal to output the previous output signal when the flag is absent. 4. The method of claim 3,
When the flag is absent, the TDI driver does not operate. 4. The method of claim 3,
a background control signal generator for generating a background control signal for controlling whether or not a background is included in the image information;
a skip signal generator that generates a skip signal when the control signal of the background control signal generator is an indication that does not include a background; and
and a second synthesizing unit for selecting and outputting an output signal of the current output data storage unit and the skip signal. 4. The method of claim 3,
a background control signal generator for generating a background control signal for controlling whether or not a background is included in the image information; and
and a first synthesizing unit for selecting and outputting an output signal of the previous output data storage unit and an output signal of the current output data storage unit when the control signal of the background control signal generating unit is an indication including a background; . determining whether to generate a flag according to a change in received light;
When the flag is generated, the TDI is driven to output the current output data signal representing the current output data as image information, and when the flag is not generated, the previous output data signal or the skip signal representing the previous output data is output as image information to do; and
and repeating the steps of determining the flag generation and outputting a signal. 8. The method of claim 7,
Depending on the mode setting,
-If the background is included in the image, output the previous output data signal,
- An image processing method of outputting the skip signal when the background is not included in the image. 8. The method of claim 7,
The current output data is stored as the previous output data after the stage has passed.

Images