JP4668059B2 - Visual inspection support device, visual inspection support program, and recording medium recording the program - Google Patents

Description

The present invention relates to a visual inspection support device for supporting a visual inspection performed by a person on an imaged inspection target.

In a production site or the like, as an inspection of a product, it is inspected whether it is assembled correctly in appearance. Such an inspection is often performed by comparing a normal product (master) with a product to be inspected visually by an inspector. In addition, an image processing apparatus is used to compare and inspect an image to be inspected and a master image (Patent Document 1).
JP 2001-307071 (released November 2, 2001)

In the visual inspection by the person in charge of inspection, the inspection accuracy largely depends on the ability, experience, visual acuity, skill, etc. of the person in charge, and is likely to vary. In particular, recognition of places where problems are likely to occur depends on experience and skill level. For this reason, the inspection tends to be uneven.

On the other hand, the automation of the inspection by image processing can easily make the inspection quality uniform, but the cost of the equipment increases because the apparatus becomes large-scale. Also, it takes time to program for inspection (setting, preparation, start-up, etc.). In addition, in the comparison of simple images, the inspection is often limited to a part, and the errors that can be found are limited. In the comparison of images, it is necessary to set a threshold value for determining pass / fail, such as a non-defective product if both images match 90%, and a defective product if the match rate is less than that. Depending on the setting, the error rate may increase or decrease, and it may not be stable. In addition, when a part is temporarily changed, a slight difference between the master image and the inspection target image is determined as an error. As described above, the inspection by image processing is superior to the visual inspection in terms of accuracy and speed, but has a drawback that it is not flexible and is difficult to handle.

The present invention has been made in view of the above-described problems, and an object of the present invention is to provide a visual inspection support device that can improve the quality and efficiency of visual inspection.

A programmable display device according to the present invention, a block setting means for setting a predetermined number of blocks in the inspection target image, and a display unit for displaying said object image, by the inspector in the displayed target image A position detection unit for detecting the instructed position, block specifying means for specifying the block including the indicated position in the inspection target image based on the detected position, and the total number of defects for each specified block Determination means for determining whether a ratio of the number of defects to be inspected exceeds a predetermined value, and highlight display control means for highlighting and displaying blocks whose ratio exceeds the predetermined value in the inspection target image. It is characterized by having.

In the above configuration, when the inspector indicates a location where a defect has occurred in the displayed inspection target image, the position is detected by the position detection unit. Since a plurality of blocks are set in advance in the inspection target image by the block setting means, the position designated by the inspector is included in any of the blocks. The block is specified by the block specifying means at the detection position by the position detecting means. Then, the determination unit determines whether the ratio of the total number of each specified block to the total number of the inspection objects exceeds a predetermined value. Thereby, a block in which the ratio exceeds a predetermined number can be specified as a block having a high defect occurrence rate. Then, the specified block is highlighted by coloring or the like in the inspection target image by the highlighting control means. Thereby, the inspector can easily grasp a portion having a high defect occurrence rate in the inspection target image.

The visual inspection support device preferably includes a changing unit that changes a display state of the inspection target image. Thus, by changing the display state according to the ability and skill level of the inspector, the quality of the inspection based on these differences among the inspectors can be made closer to uniform.

The visual inspection support device preferably includes a display device including the display unit and the position detection unit. Thereby, the general purpose display with a touch panel like a programmable display can be used for a visual inspection assistance apparatus, and construction of a visual inspection assistance apparatus can be performed easily. Further, if the display device is connected to a network as a terminal, inspection results from a plurality of display devices can be collected in a host computer.

The visual inspection support program of the present invention causes a computer that implements the visual inspection support device to function as each of the means. The visual inspection support program is provided by being recorded on a computer-readable recording medium. Thereby, as above-mentioned, the location with a high defect rate can be grasped | ascertained easily.

As described above, the visual inspection support apparatus according to the present invention determines whether the ratio of the total number of defects for each block to the total number of defects to be inspected exceeds a predetermined value for the block indicated in the displayed inspection target image. The block exceeding the predetermined value is identified as a block having a high defect occurrence rate, and the block exceeding the ratio in the inspection target image is highlighted and displayed, so that the inspector indicates the defective portion. Thus, it is possible to easily grasp a block having a high defect occurrence rate. Therefore, by focusing on the block, it is possible to increase the concentration of the inspector and improve the quality and efficiency of the inspection.

An embodiment of the present invention will be described with reference to FIGS. 1 to 9 as follows.

As shown in FIG. 1, the visual inspection support device 1 according to this embodiment includes a plurality of programmable displays 2, an image database server 3, a network 4, a barcode reader 5, and a camera 6. .

Each programmable display 2 is connected to the image database server 3 via the network 4. The network 4 is a communication network including a local area network (LAN) made of Ethernet (registered trademark) or the like capable of performing communication using a common communication protocol (common communication protocol). In the present embodiment, a configuration in which four programmable displays 2 of A station, B station, C station, and D station are connected to the network 4 will be described.

The barcode reader 5 is provided for reading a barcode attached to a substrate 7 described later. The camera 6 is disposed at a fixed position in order to photograph the component mounting surface of the substrate 7.

The board 7 to be inspected is given a serial number necessary for production management in order to specify the board 7, and a bar code seal indicating a bar code representing the serial number is attached. When the board 7 finishes the soldering process by solder reflow, the component mounting surface is photographed by the camera 6. The image is stored in the storage device 33 as photographed image data IP in association with the serial number of the board by the database management unit 31 described later. Moreover, the board | substrate 7 which imaging | photography completed is stocked and is collectively used for a test | inspection in a test | inspection place.

The programmable display 2 as a display device includes an arithmetic processing unit such as a CPU, and realizes an operation function and a display function peculiar to the programmable display by displaying input operation and display screen data created by the user. It is a dedicated computer. The programmable display device 2 suitably used as an HMI device receives an input operation to the touch panel 25 described later based on the screen data, and performs an operation according to the input operation. The programmable display device 2 has a function of displaying an image taken from the outside.

In order to realize the above functions, the programmable display 2 has an HMI control unit 21, a data memory 22, a work memory 23, a display 24, a touch panel 25, and an interface unit (I / F in the figure) 26. , 27. Hereinafter, each main part of the programmable display device 2 will be described in detail.

As the display 24 as a display unit, a flat panel display such as a liquid crystal display, an EL display, or a plasma display is preferably used in order to make the programmable display device 2 thin. The touch panel 25 as a position detection unit is an input device provided for performing touch input on the display screen of the display 24.

The interface unit 26 is a communication control unit for the programmable display device 2 to communicate with the image database server 3, and is connected to the network 4. The interface unit 26 is configured to be able to perform network communication based on the IP addresses of the image database server 3 and the programmable display device 2.

On the other hand, the interface unit 27 is connected to the barcode reader 5 and is a communication control unit for performing serial communication with the barcode reader 5.

The data memory 22 is a memory for storing inspection screen data ST and the like, and FEPROM (Flash Erasable and Programmable ROM) is used. Since FEPROM is a rewritable read-only flash memory, it plays the role of a hard disk drive in a general personal computer. A flash memory does not have a movable part and is resistant to impacts, and thus operates stably even in a poor ambient environment.

The inspection screen data ST is inspection screen data for inspecting an image (inspection target image) of the substrate 7. The inspection screen is configured to display both of them together for comparison with a master image, which is an image of a substrate serving as a reference for inspection, or to display only the inspection target image by various display methods. The inspection screen data is created by an inspection screen creation unit 32 of the screen database server 3 described later and downloaded to the data memory 22.

The work memory 23 is composed of, for example, a DRAM, and is used for work at the time of arithmetic processing such as display control, as well as data exchanged with an externally connected device such as the barcode reader 5. Used for temporary storage. In particular, in order to display the master image and the inspection target image on the inspection screen, the DRAM uses the master image data IM as the master image data and the inspection image data IT as the inspection target image data in the image database. Reading from server 3. The master image data IM and the inspection target image data IT are converted in advance into a format that can be displayed on the programmable display 2 by the inspection screen creation unit 32.

The HMI control unit 21 is a functional block realized by causing an arithmetic processing means such as a CPU provided in the programmable display 2 to execute the HMI control program. The above-mentioned HMI control program can be recorded on a recording medium configured to be separable from the programmable display 2 and is installed in the programmable display 2 from the recording medium.

The above recording media include tape systems such as magnetic tapes and cassette tapes, magnetic disk systems such as flexible disks and hard disks, optical disk systems such as CD-ROM, MO, MD, and DVD, IC cards (including memory cards), optical A card system such as a card is preferred. In addition, the program medium may be a medium that carries a fixed program including a semiconductor memory such as a mask ROM, EPROM, EEPROM, flash ROM, or the like.

Further, if the visual inspection support device 1 is configured to be connectable to a communication network including the Internet, it may be a medium that fluidly carries the program so as to download the program from the communication network. However, when the program is downloaded from the communication network in this way, the download program may be stored in advance in the programmable display 2 or may be installed from another recording medium.

The HMI control unit 21 performs central control operations of the HMI function such as display control of the inspection screen, control of input operations on the inspection screen, and control of communication with the screen database server 3 and the barcode reader 5.

The above-described inspection screen data ST includes process definition information (tag) that defines various processes performed in relation to the inspection screen. This processing specification information is created for each event to be executed on the inspection screen. Basically, the screen number of the inspection screen on which the display processing is to be executed and the operation content to be executed on this inspection screen. And a set of reference information consisting of one or more data referred to for each execution event.

In the programmable display device 2 according to the present embodiment, as the above-mentioned tag, the master image data in the work memory 23 corresponding to the area (display range) on the inspection screen and the display of the master image and the inspection target image in the area. Display tag indicating correspondence with the address of the area where IM and inspection target image data IT are stored, and master image data IM and inspection target image corresponding to an area (input range) on the inspection screen and touch input to the area An input tag indicating the operation of data IT is defined.

When displaying the master image and the inspection target image on the inspection screen, the HMI control unit 21 repeatedly reads out the display tag, reads out the master image data IM and the inspection target image data IT from the work memory 22, and displays the display tag. The display 24 is displayed on the display area by the method specified by the display tag. Further, when the HMI control unit 21 gives an instruction to operate the master image and the inspection target image displayed on the inspection screen by input (touch input or numerical input) via the touch panel 25 on the inspection screen, The input tag is repeatedly read, and the range for specifying the input position in the predetermined area of the inspection screen (the effective input coordinate range in which the input is valid) and the operation of the touch panel 25 are specified, which are included in the reference information in the input tag The action specified by the event name to be executed is executed.

Here, the HMI control unit 21 includes an examination display control unit 211. The inspection display control unit 211 uses the display tag and the input tag to display an image for comparing the master image and the inspection target image on the inspection screen or to display the inspection target on the inspection screen. Take control. In order to perform this control, the HMI control unit 21 includes a blocking unit 212, a display execution unit 213, and a touch block determination unit 214.

As shown in FIG. 2, the blocking unit 212 serving as a block setting unit sets a plurality of blocks designated in advance in the inspection target image T. The example shown in FIG. 2 shows a state in which eight blocks are set. The blocking unit 212 assigns a block number to each set block. Block numbers are given in order from 1 from the left end to the right. Further, the blocking unit 212 adds a broken line image that divides the block to the inspection target image data IT. Further, the blocking unit 212 similarly sets a block for the master image as necessary (for example, for display on the examination screen 51 shown in FIG. 7).

In the example shown in FIG. 2, each block is formed into blocks having the same shape and the same size. However, the present invention is not limited to this, and the number of blocks, the shape, and the like are appropriately set by the user. For example, the blocks are not adjacent to each other as in the example of FIG. 2, but the blocks are provided at appropriate positions according to the board 7 to be inspected, or the mounting state of components such as ICs on the board 7 It is also possible to appropriately set the shape of the block according to the above. Such block data is created in advance by the user for each type of substrate 7 and stored in the data memory 22. The blocking unit 212 reads block data corresponding to the type of the board 7 from the data memory 22 based on a code for specifying the type of the board 7 included in the serial number of the board 7 and performs block setting. .

The display execution unit 213 performs the following various processes to execute the display of the inspection screen.

The display execution unit 213 causes the HMI control unit 21 to display an inspection initial screen for inputting an inspection instruction. When an inspection start instruction is input from the inspection initial screen, the display execution unit 213 reads the master image data IM. Thus, the master image data IM requested from the database management unit 31 of the image database server 3 and transmitted from the database management unit 31 is stored in the work memory 23. Further, when the serial number indicated by the barcode of the substrate 7 is read by the barcode reader 5, the display execution unit 213 requests the database management unit 31 to read the inspection target image data IT corresponding to the serial number.

The display execution unit 213 gives the inspection target image data IT transmitted from the database management unit 31 to the blocking unit 212 and instructs the block setting to be performed. Store in the memory 23. Then, the display execution unit 213 reads the master image data IM and the inspection target image data IT read from the work memory 23 and the data memory 22 by the display method defined by the display tag set in the inspection screen data ST. The HMI processing unit 21 is instructed to display the inspection screen based on the inspection screen data ST. Further, the display execution unit 213 (display state changing unit) performs various touch operations performed by the inspector on the inspection screen via the touch panel 25 according to the operation content defined by the input tag set on the inspection screen. The display state of the master image and the inspection target image on the inspection screen is changed as will be described later.

The display execution unit 213 (highlighting display means) adds data for emphasizing the display of the block to the inspection target image data IT based on the block number of the block having a high error occurrence rate obtained by the database management unit 31. The HMI control unit 21 displays the image to be inspected. The highlighting data includes coloring with a conspicuous color.

The touch block determination unit 214 (block specifying unit) outputs touch data (such as coordinates of the touch position) output from the touch panel 25 as a result of the touch operation performed by the inspector on the inspection target image displayed on the inspection screen. Based on the block number, it is determined which block on the inspection target image the position touched by the inspector is included. Further, the touch block determination unit 214 determines that the touched inspection target image is a defective product (NG), and the inspection information as well as the serial number of the substrate 7 of the inspection target image is used as the inspection information. The block number of the touch block (error block) in which an error has occurred is transmitted to the database management unit 31.

Here, the inspection screen displayed by the display execution unit 213 will be described.

First, as shown in FIG. 3, the first inspection screen 11 displays the master image M and displays the inspection target image T that is transmitted through the alpha blending process in an overlapping manner. This alpha blending process is performed by the display execution unit 213. The degree of transmission is adjusted by an operation in which the examiner slides left and right while touching the slide bar 12. This adjustment is also performed by the display execution unit 213. Such overlapping display makes it easy to understand whether or not there is a mismatch between the images M and T.

As shown in FIG. 4, the second inspection screen 21 displays the master image M and the inspection target image T alternately switched. The switching display is performed between the manual mode and the automatic mode, and the mode switching is performed by a touch operation of the selector switch 22 provided on the inspection screen 21. In the manual mode, the images M and T are switched manually, that is, when the changeover switch 23 provided on the inspection screen 21 is touched. In the automatic mode, both images M and T are automatically switched at regular time intervals. The time interval for automatic switching is adjusted by an operation in which the examiner slides left and right while touching the slide bar 24. These display operations are performed by the display execution unit 213. By switching the display alternately in this manner, a difference sensation occurs in the inspector's vision, and it becomes easy to understand the presence or absence of a mismatched portion between the images M and T.

As shown in FIG. 5, the third inspection screen 31 sequentially switches and displays a plurality of inspection target images T at certain time intervals. The switching time interval is adjusted by an operation in which the examiner slides left and right while touching the slide bar 32. These display operations are performed by the display execution unit 213. By sequentially switching the display in this way, the presence or absence of a mismatched portion between the images M and T can be easily understood based on the afterimage phenomenon of the human eye.

When the inspection screen 31 is displayed, it is necessary to read the inspection target image data IT from the image database server 3 into the work memory 23 for all the inspection target images T to be switched and displayed in advance.

As shown in FIG. 6, the fourth inspection screen 41 includes an EXOR (exclusive OR) image of the color master image M and the inspection target image T, and an EXOR of the monochrome master image M and the inspection target image T. The image synthesized with the image is displayed. According to EXOR, if both match, it is “0”, and if they do not match, it is “1”. Therefore, by coloring the portion that does not match in EXOR of the color image with a conspicuous color such as red , Make it easier to recognize color spots. In addition, by superimposing EXOR of monochrome images, the error location is displayed more conspicuously. If the position where the color image EXOR and the monochrome image EXOR overlap is slightly shifted, the error increases or decreases. For this reason, one position is adjusted when the inspector touches the right direction movement switch 42, the left direction movement switch 43, the upper direction movement switch 44, or the lower direction movement switch 45 provided on the inspection screen 41. . These display operations (including the EXOR operation) are performed by the display execution unit 213.

As shown in FIG. 7, the inspection screen 51 enlarges the master image T and the inspection target image T and displays them in a state where both are arranged. The enlargement range is one area selected from the blocks set by the blocking unit 212. The block to be enlarged is switched when the inspector operates the feed switch 52, the return switch 53 or the initialization switch 54 provided on the inspection screen 51. By operating the feed switch 52, the block of the master image M and the inspection target image T is switched to the block of the next block number. By operating the return switch 52, the blocks of the master image M and the inspection target image T are switched to the block having the previous block number. By operating the initialization switch 54, the blocks of the master image M and the inspection target image T are switched to the block having the block number “1”. These display operations are performed by the display execution unit 213. Thus, by enlarging and displaying the images M and T in block units, the comparison between the images M and T is facilitated.

As illustrated in FIG. 8, when the inspection target image T is touched, the inspection screen 61 displays an enlarged predetermined area centered on the touch position. The magnification for enlarging by one touch operation is set in advance. These display operations are performed by the display execution unit 213. As described above, by enlarging and displaying a desired portion in a desired size, it is possible to easily inspect a specific portion in more detail. Conversely, when the inspection target image T is touched, a predetermined area centered on the touch position may be reduced and displayed. Also in the case of reduction, a magnification for reduction by one touch operation is set in advance. When both enlargement and reduction operations can be performed, a switching operation can be performed by providing the search screen 61 with a switch for switching between the enlargement mode and the reduction mode.

Next, the image database server 3 will be described. The image database server 3 has a CPU, a memory (RAM, ROM, etc.), an external storage device (hard disk drive, MO drive, etc.), a display device and an input device (keyboard, mouse, etc.) as in a general-purpose personal computer. is doing. The image database server 3 also includes a database management unit 31, an inspection screen creation unit 32, and a storage device 33.

The database management unit 31 manages various data stored in the storage device 33. The database management unit 31 stores the image data of the substrate 7 (inspection target) input from the camera 6 in the storage device 33 as photographed image data. At this time, the serial number of the corresponding substrate 7 is associated with each captured image data. The serial number is obtained by reading a barcode with a barcode reader.

Upon receiving a request for reading the master image data IM from the display execution unit 213, the database management unit 31 reads the master image data IM from the storage device 33 and transmits it to the programmable display 2. When the display execution unit 213 receives a request to read the inspection target image data IT, the serial number inspection target image data IT transmitted from the display execution unit 213 is read from the storage device 33 and transmitted to the programmable display device 2. . In addition, the database management unit 31 downloads the inspection screen data ST stored in advance in the storage device 33 to the data memory 22 of the programmable display 2.

The database management unit 31 creates an inspection result database DBT in the storage device 33 using the inspection result transmitted from the touch block determination unit 214 and the serial number corresponding thereto. As shown in FIG. 9, the inspection result database DBT associates the file name of the inspection target image data IT, the serial number of the inspection target, the inspection result, and the block number of the error block.

The database management unit 31 serving as a determination unit adds up the number of error blocks based on the inspection result database DBT, and the ratio of the total number of error blocks to the total number of inspection objects exceeds a predetermined threshold value. An error block is identified as a block with a high error occurrence rate. The database management unit 31 notifies the display execution unit 213 of the block number of the block.

The database management unit 31 is a functional block realized by a computer constituting the image database server 3 executing an application program (server management program). This server management program is a program recorded on a recording medium configured to be separable from the image database server 3, and can be installed in the image database server 3 from this storage medium. This recording medium is a computer-readable recording medium similar to the recording medium on which the aforementioned HMI control program is recorded.

The inspection screen creation unit 32 is provided to create an inspection screen (inspection screen data ST), and is configured by a screen editor. The screen editor can create user screens that are unique to the user. Parts such as switches, lamps, numeric keys, various displays (for example, numeric displays, meter displays, and graph displays), and various tag settings Functions, drawing functions, text input functions, etc. are provided. As parts used for the inspection screen, parts such as operation switches are used. The parts are registered in a library format so that the user can easily select them, and input tags, display tags, and the like corresponding to the functions of the parts are assigned in advance.

The inspection screen creation unit 32 is a functional block realized by a computer constituting the image database server 3 executing an application program (screen creation program). This screen creation program is a program recorded on a recording medium configured to be separable from the image database server 3, and can be installed in the image database server 3 from this storage medium. This recording medium is a computer-readable recording medium similar to the recording medium on which the aforementioned HMI control program is recorded. The image database server 3 also functions as a screen creation device by including the examination screen creation unit 32.

The inspection screen creation unit 32 converts the captured image data IP stored in the storage device 33 into a file format that can be processed by the programmable display 2 to create inspection target image data IT. The master image data IM is also created based on the captured image data IP, similarly to the inspection target image data IT.

The file format conversion is performed by the inspection screen creation unit 32, but the database management unit 31 may perform the conversion instead. In this way, image data captured from the camera 6 can be converted into a file and stored in the storage device 33. Thereby, it is not necessary to separately read the photographed image data IP from the storage device 33 and convert the file format by the inspection screen creation unit 32, and data processing can be performed efficiently.

When an inspection screen is created using such an inspection screen creation unit 32, a display area for the master image M and the inspection target image T is set on a base screen developed in a screen editing window (not shown). The arrangement position of the operation parts is designated according to a predetermined procedure. The created examination screen data ST is stored with a unique screen number. Also, the master image data IM and the inspection target image data IT are given unique screen numbers when converted into a file format that can be processed by the programmable display 2 so that they can be handled as screens. In the inspection screen data ST, the screen number of the master image data IM and the inspection target image data IT is set as the screen number of the screen to be called. When the master image M and the inspection target image T are displayed on the inspection screen, The display execution unit 213 specifies the screen numbers of the master image data IM and the inspection target image data IT and reads them from the work memory 23.

Note that the examination screen creation unit 32 may be provided in a computer independent of the image database server 3. In this case, the computer having the examination screen creation unit 32 communicates with the image database server 3 via the network 4 to access the storage device 33 and save and read the examination screen data ST.

The storage device 33 is configured by, for example, a hard disk drive, and stores the above-described captured image data IP, master image data IM, inspection target image data IT, inspection screen data ST, and inspection result database DBT.

Here, the inspection support operation in the visual inspection support apparatus 1 configured as described above will be described.

First, in the storage device 33, master image data IM and inspection target image data IT are stored in advance. In the inspection, the substrate 7 that has already been photographed on the mounting surface is inspected. At this time, in the programmable display 2 of the A station to the D station, the inspection is performed by sharing the serial numbers 1-1000, 1001-2000, 2001-3000, 3001-4000, respectively.

When an inspector gives an instruction to start an inspection from the initial inspection screen displayed on the programmable display 2, the display execution unit 213 requests the database management unit 31 to acquire the master image data IM, and the work memory 23 is written. Next, when the inspector scans the barcode on the substrate 7 with the barcode reader 5, the HMI control unit 21 reads the serial number indicated by the barcode. The display execution unit 213 requests the database management unit 31 to acquire the inspection target image data IT specified by the serial number. At this time, the database management unit 31 searches the inspection result database DBT in which the serial number and the inspection target image data IT are associated in advance based on the given serial number and searches for the corresponding inspection target image data IT. The data is identified, read from the storage device 33, and transmitted to the execution display unit 13. The display execution unit 213 instructs the block forming unit 212 to set a block for the inspection target image data IT.

The blocking unit 212 sets a predetermined number of blocks in the inspection target image data IT, and writes the block to a predetermined address area in the work memory 23. The display execution unit 213 causes the HMI control unit 21 to display an inspection screen based on the inspection screen data ST in the data memory 22, the master image data IM in the work memory 23, and the inspection target image data IT set in blocks. As a result, inspection screens such as the inspection screens 11 to 61 in FIGS. 3 to 8 are displayed on the display 24.

The inspector performs an operation of changing the display state on the inspection screen so that it is easy to see while viewing the inspection screen. Thereby, it is possible to perform inspection with ease of viewing the master image M and the inspection target image T according to the ability and skill level of the inspector. Therefore, a high quality inspection can be performed. Also, the display execution unit 213 highlights the block where the error is likely to occur by coloring or the like. Thereby, it is possible to focus inspection on blocks with many errors. Therefore, the inspection efficiency can be improved.

When the inspector finds an error in the inspection target image T, the inspector touches that portion. Then, based on the touch position, the touch block determination unit 213 stores the block number of the touch block and the inspection result (the inspection target is a defective product) together with the serial number of the inspection target image T in the database. The management unit 31 is notified. Based on the inspection information received from the touch block determination unit 214, the database management unit 31 writes the block number of the error block and the inspection result in the inspection result database DBT. In this way, the database management unit 31 adds new information to the inspection result database DBT based on the inspection information collected from the programmable display 2 of each station. Further, the database management unit 31 identifies a block with a high error occurrence rate based on the created inspection result database DBT and notifies the display execution unit 213 of the block number of the block.

As described above, in the visual inspection support device 1 described above, an inspection screen is provided as a user interface for displaying the inspection target image T in an easily viewable state for the inspector. Thereby, it is possible to compensate for the difference in the ability and skill level of the inspector, and to achieve uniform inspection quality. In addition, the visual inspection support device 1 can identify a defect (error) and a defective portion of the inspection target simply by touching the inspection target image T, so that the inspector receives special education. The inspection can be easily performed without any problem. Further, in the visual inspection support device 1, since the location where an error is likely to occur is specified based on the information on the touch position in the inspection target image T, as described above, not only the inspection efficiency but also the inspection can be improved. The concentration of the person will increase and the quality of the examination will improve. And the quality of the board | substrate 7 used as a test object can be improved by feeding back to the production the location where an error is likely to occur.

In the present embodiment, the inspection object is the substrate 7, but the inspection object is not limited to the substrate 7. For example, a product that is designed to have the same structure and that can be visually checked for coincidence / non-coincidence of the structure using the above-described inspection screen is an inspection object.

Further, in the present embodiment, the touch panel 25 is used as a means for detecting a position where the inspector has indicated the defective portion in the inspection target image T. However, as long as it is a means capable of detecting the position indicated on the screen, A device other than the touch panel 25, such as a tablet, can be applied to the visual inspection support device 1.

Moreover, in this Embodiment, although the programmable display 2 was demonstrated as an apparatus which displays the test object image T and receives the touch input of an error location, as such an apparatus, not only the programmable display 2 but A display device with a touch panel that does not have an HMI function may be used. In a control system using such a display device, a computer having an HMI control unit 21, a data memory 22, and a work memory 23 is separately prepared.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately changed within the scope of the claims are also included in the technical scope of the present invention.

The visual inspection support device of the present invention collects information about a location where a defective portion of the displayed inspection target image is touched by an inspector, and highlights and displays a portion where the defect occurrence rate is high in the inspection target image. Therefore, it is possible to perform high-quality and efficient visual inspection, and it can be suitably used for production sites that require visual inspection.

It is a block diagram which shows the structure of the visual inspection assistance apparatus which shows one Embodiment of this invention. It is a figure which shows the test | inspection screen blocked in the programmable display image of the said visual inspection assistance apparatus. It is a figure which shows the test | inspection screen which permeate | transmits and displays a master image, in order to compare the master image with a programmable display in the said visual inspection assistance apparatus, and a test object image. It is a figure which shows the test | inspection screen which switches and displays a master image and a test object image, in order to compare the master image by a programmable display in the said visual test | inspection assistance apparatus, and a test object image. It is a figure which shows the test | inspection screen which switches and displays the several test object image by the programmable display in the said visual inspection assistance apparatus continuously. It is a figure which shows the test | inspection screen displayed by EXOR combining with a master image and a test object image, in order to compare the master image by a programmable display in the said visual test | inspection assistance apparatus, and a test target image. It is a figure which shows the test | inspection screen which expands and displays a part of test target image by the programmable display in the said visual inspection assistance apparatus. It is a figure which shows the test | inspection screen which switches and displays a master image and a test object image, in order to compare the master image by a programmable display in the said visual test | inspection assistance apparatus, and a test object image. It is a figure which shows the structure of the test result database constructed | assembled in the image database server of the said visual inspection assistance apparatus.

Explanation of symbols

1 Visual inspection support device 2 Programmable display (display device)
3 Image database server 5 Bar code reader 6 Camera 7 Substrate 21 HMI control unit 22 Work memory 23 Display (display unit)
24 Touch panel (position detection unit)
31 Database management part (determination means)
32 Storage device 211 Inspection display control unit 212 Blocking unit (block setting means)
213 Display execution determination unit (highlight display control means, display state change means)
213 Touch block determination unit (block specifying means)
MT master image data IT image data DBT inspection result database

Claims (5)

Block setting means for setting a predetermined number of blocks in the image to be inspected;
A display unit for displaying the inspection target image;
A position detector for detecting a position designated by the examiner in the inspection object image displayed,
Block specifying means for specifying the block including the position indicated in the inspection target image based on the detected position;
Determining means for determining whether the ratio of the total number of defects for each identified block to the total number of defects to be inspected exceeds a predetermined value;
A visual inspection support device, comprising: highlighting control means for highlighting and displaying blocks in which the ratio exceeds a predetermined value in the inspection target image. The visual inspection support apparatus according to claim 1, further comprising a display state changing unit that changes a display state of the inspection target image. The visual inspection support device according to claim 1, further comprising a display device including the display unit and the position detection unit. The visual inspection assistance program for functioning the computer which implement | achieves the visual inspection assistance apparatus of Claim 1 or 2 as said each means. The computer-readable recording medium which recorded the visual inspection program of Claim 4.

Images