JPH0896134A - Image processor and image processing method - Google Patents

Abstract

PURPOSE: To easily recognize the position of a model image when referring to the model image on a display screen and to easily compare the model image with a picked-up image. CONSTITUTION: An image, which has been picked up by a camera 1, is stored in an image memory 3 after A/D conversion, and an image of an area selected as the model image is registered in a model image registration memory 5. At the time of the registration, position information on the model image is stored in a position information table 5a at the same time. When a model image reference mode is selected with a key of an input part 10, the model image registered in the model image registration memory 5 is overwritten to the image picked up by the camera 1 on the basis of the information of the position information table 5a and this overwritten image is displayed on the display screen of a display part 9. Consequently, an operator can easily recognize the registration position of the model image on the display screen, and can immediately confirm that preprocessing is performed by a preprocessing part 11 for the picked-up image and model image.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method for registering a model image as a reference image at the time of image inspection, and particularly to an image processing apparatus in which a method of referring to a model image once registered is devised. And an image processing method.

[0002]

2. Description of the Related Art In an apparatus for sequentially inspecting an object to be inspected of the same type by image processing, such as an image processing apparatus for inspecting an image flowing on a conveyor by image processing, a model which is a reference image at the time of image inspection is usually used. An image is registered in advance, a portion corresponding to the model image is extracted from the image of the object to be inspected captured by a camera or the like, and the image is inspected by comparing with the model image.

When the model image is registered, the registered model image exists in the memory, but it may be necessary for the operator to actually check the registered model image with eyes. In such a case, the model image data is loaded from the memory and displayed on the video monitor, and the operator refers to the model image displayed on the video monitor.

In the conventional image processing apparatus having such a model image reference function, the display position of the model image on the monitor is fixed as shown in FIG. They are displayed side by side in the vertical direction on the upper left side of the display screen), and in the reference mode of the model image, nothing appears on the background image other than the model image (black or white).

[0005]

However, in the above image processing apparatus, when referring to the model image,
There is a problem that it is not immediately known which part of the object to be inspected (including the object to be measured) corresponds to the model image. Therefore, there is a problem that it is not possible to confirm whether or not the monitor image is correctly registered at the time of registering the monitor image. Also,
In order to facilitate image processing during inspection, the model image and each image of the object to be inspected are converted into edge images that have been subjected to density differentiation, and the mode for comparison can be selected. Although an image is required, if nothing appears in the background image in the model image reference mode as in the conventional image processing apparatus described above, even if the model image is displayed as an edge image, the object to be inspected It is not possible to immediately know whether the read image is an edge image or not. The same problem occurs even when the model image is registered as a normal image that is not an edge image. That is, there is a problem that it cannot be immediately recognized in the model reference mode whether or not the model image is registered in a correct state (whether it is an edge image or not).

An object of the present invention is to provide an image processing apparatus and an image processing method in which, when a model image is referred to on a display screen, its position can be recognized correctly and easily, and the comparison with the captured image is facilitated. To do.

[0007]

A model image registration apparatus of the present invention stores a model image and its position information in a model image memory, and stores the model image as the position information for the image stored in the image memory. It is characterized in that a display means for overwriting and displaying based on the above is provided.

Further, the display means is characterized in that a frame line surrounding the model image is further overwritten.

Further, the present invention is characterized in that an image preprocessing means for performing arbitrary image preprocessing on a picked-up image is provided, and the image subjected to this image preprocessing is stored in an image memory.

[0010]

According to the present invention, when the model image is registered, its position information is stored together with the model image in the model image memory, and the model image is overwritten on the image of the object to be inspected picked up by the image pickup means on the display means. Will be displayed. Then, at that time, the model image is overwritten based on the position information. Therefore, the operator can easily know the registration position of the model image with respect to the object to be inspected on the display screen, and immediately identify whether both images have been subjected to preprocessing such as an edge image. can do.

Further, since the frame line surrounding the model image is also displayed when the model image is overwritten and displayed, the position of the model image can be more easily recognized by the existence of the frame line.

[0012]

1 is a block diagram of an image processing apparatus according to an embodiment of the present invention.

The camera 1 captures an image of an object which is stationary or flowing on a line such as a conveyor,
It is converted into binary or multi-valued image data by the A / D converter 2 and input to the image memory 3 and the display unit 9. The memory control unit 4 controls the image memory 3 and the model image registration memory 5, and when the image stored in the image memory 3 is a model image, the model image is extracted from the image and the model image registration memory 5 is extracted. Register with. Model image memory 5
Includes a position information table 5a, and the position information is stored in the table 5a when the model image is registered. In addition,
The model image serves as a reference image at the time of inspection and measurement of the inspection object, and this model image is compared with the image of the inspection object. That is, when the object is inspected (measured) by this image processing device, the image data read by the camera 1 and stored in the image memory 3 is compared with the model image data stored in the model image registration memory 5. It
These controls are performed by the control unit including the CPU 6, the ROM 7, and the RAM 8. A display unit 9 including a video monitor (not shown) displays an image (captured image) read by the camera 1, is used for registering a model image, displays a menu for control, and the like. . Also,
In the monitor image reference mode described later, the camera 1
The model image stored in the model image registration memory 5 is overwritten and displayed on the image captured in (1). The input unit 10 is used to perform an operation for extracting a monitor image from an image displayed on the monitor, perform various menu selections, move a cursor, and input commands. use. The pre-processing unit 11 is a unit that performs pre-processing such as edge processing on the image that has been A / D converted. The line 12 is selected when the A / D converted image is output to the display unit 9 without being preprocessed, and the line 13 is selected when the image is sent to the display unit 9 after the preprocessing. The selection of whether or not to perform the preprocessing is performed by the input unit 10, and the CPU 6 actually controls whether the output of the A / D converter 2 is directly sent to the display unit 9 or the preprocessing unit 11. Regarding the pretreatment, C
It may be performed by the PU 6.

FIG. 2 shows an image I taken by the camera 1. In the figure, 9a indicates the display screen of the monitor. To extract and register the model image from the captured image I, a window surrounding the target portion of the model image is set on the display screen. In the example shown in the figure, W1 and W2 are set as the windows. Each is a rectangular window, and the upper left coordinates (x1, y1) and (x3, y3) and the lower right coordinates (x2, y2) and (x
4, y4) to extract and register the model image. Note that it is of course possible to select any part of the captured image as each model image, and in general, a part representing a characteristic part of the image is selected. In the present embodiment, the selection is made by the operator, but it is also possible to automatically judge and extract the characteristic part of the image and set and register the window. The characteristic part of the image can be known by any publicly known method, but if this characteristic part is automatically judged and displayed on the display screen and the operator waits for the operation to be registered, it will be registered. The time required is shortened, and there is an effect that an operator's judgment error can be prevented.

In the example shown in the figure, the area where the letters A and B are present is selected as the model image. The model image thus extracted and registered is registered in the model image registration memory 5 of FIG. Furthermore, in this embodiment, when registering these two model images, the position information thereof is also registered. As a method of expressing position information,
It may be coordinates on the display screen, or may be relative position information with respect to an image displayed on the display screen. With the relative position information, in the model image reference mode, even if the captured image is displayed with a shift, the model image is also displayed with a shift by the same size, and thus no positional shift occurs on the display. In addition, by registering the model image with the position information in this way, the reproduction screen is
If the model image has been subjected to edge processing, the image will be as shown in FIG. Same figure (B)
Shows a state in which the model image is displayed by being overwritten on the image I ′ obtained by edge-processing the image captured by the camera 1. This display state is a state when the operator selects the model image reference mode. When preprocessing (edge processing) is not performed on the model image and the captured image of the camera 1, the display screen is as shown in FIG. 4 even in the model image reference mode.

As described above, in the model image reference mode, the registration position of the model image, that is, the position of the model image with respect to the inspection object can be correctly known, and when a plurality of model images are registered, You can also see their positional relationship. Further, as shown in FIGS. 3B and 4, it is possible to confirm whether or not the preprocessing (edge processing) is performed on each of the model image and the captured image. If the edge processing is performed only on the model image, as shown in FIG. 5A, the output of the A / D converter 2 is switched in FIG. It is understood that the output should be made to the processing unit 11. On the contrary, when the model image is registered without being preprocessed and the captured image is displayed after being preprocessed, the edge area of the display screen shown in FIG. The operator can know that the output of the A / D converter 2 should be switched to the line 12 side that does not pass through the preprocessing unit 11.

It should be noted that, in FIGS. 3 to 5, frames P1 and P2 surrounding the area of the model image are displayed on the display screen. Accordingly, even if the captured image is displayed with the model image overwritten, the area of the model image can be correctly and easily confirmed.

6 and 7 show the operation in the model image registration mode and the operation in the model image reference mode, respectively.

When the model image is registered, the model image is cut out from the captured image by the windows W1, W2, etc. as shown in FIG. 2, and the model image registration memory 5 is registered. In this case, as described above, the model image position information is also stored in the position information table 5a. When the model image reference mode is selected by the operator, the image captured by the camera 1 is overwritten with the model image read from the model image registration memory 5 and displayed on the video monitor. Since the overwriting at this time is performed based on the model image position information stored in the position information table 5a, the model image is displayed at the correct position on the display screen. In the above embodiment, when referring to the model image, it was necessary for the operator to select the model image reference mode.
The mode may be automatically entered immediately after the model image is registered. Even in this case, it is desirable to be able to select the model image reference mode at any time.
Moreover, when the model image is registered, its position information is also registered. However, the position information can be registered in a table format in another memory instead of the model image registration memory.

[0020]

According to the present invention, when the model image is a part of the object to be inspected, it can be seen at a glance which part of the object to be inspected the model image corresponds to.
When there are a plurality of model images, the positional relationship between the model images can be clearly confirmed at a glance. Therefore, it is possible to easily determine whether or not the position of the model image is appropriate, and prevent erroneous inspection and measurement.

Furthermore, since the model image and the background image are displayed at the same time, it is possible to immediately know whether or not both images have been subjected to preprocessing such as edge processing.
It is possible to prevent wrong inspection and measurement.

Further, since the frame line surrounding the model image is displayed at the same time for the model image, there is an advantage that the region of the model image can be easily confirmed.

[Brief description of drawings]

FIG. 1 is a block diagram of an image processing apparatus that is an embodiment of the present invention.

FIG. 2 is a diagram for explaining how to register a model image.

3A and 3B are diagrams showing a registration position of a model image and a state in which the model image is displayed together with a background image.

FIG. 4 is a display state in which a model image is overwritten when edge processing is not performed.

FIG. 5 is a diagram showing a display state when a model image is edge-processed and a background image is not edge-processed.

FIG. 6 is a diagram showing an operation in a model image registration mode.

FIG. 7 is a diagram showing an operation in a model image reference mode.

FIG. 8 is a diagram showing a model image display example in a conventional image processing apparatus.

[Explanation of symbols]

 I-Captured image I'-Edge-processed captured image W1, W2-Window P1, P2-Frame line

Continuation of front page (51) Int.Cl. ⁶ Identification number Office reference number FI technical display location G06F 15/66 450

Claims (4)

[Claims] 1. An image pickup means for picking up an image of an object to be inspected, an image memory for storing the picked-up image, a model image referred to for comparison with the image during image inspection, and a model image for storing position information thereof. An image processing apparatus comprising: a memory; and a display unit that displays the model image overwritten on the image stored in the image memory based on the position information. 2. The image processing apparatus according to claim 1, wherein the display unit is a display unit that further overwrites a frame line surrounding the model image. 3. An image preprocessing means for performing arbitrary image preprocessing on the captured image, wherein the image memory is means for storing the image subjected to the image preprocessing. The image processing apparatus according to claim 1. 4. A model image referred to for comparison with an image of an object to be inspected at the time of inspection is stored in a model image memory together with position information thereof, and an image of the object to be inspected is picked up by an image pickup means such as a camera. Then, the model image is stored in the image memory, and the model image is overwritten and displayed on the image of the inspection object stored in the image memory based on the position information.