JP7092563B2 - Printing inspection machine - Google Patents

Description

The present invention relates to a printing inspection machine.

A print inspection machine is a device that inspects characters printed on product packages, labels, and the like. The characters to be printed include various information about the product such as the product name, the date of manufacture, the expiration date, and the like, and the printing inspection machine inspects whether or not accurate information about the product is printed. As a printing inspection machine, for example, the following Patent Document 1 is disclosed.

Patent Document 1 discloses a print inspection device that manages a printing machine in order to eliminate erroneous printing and defective printing. Specifically, the printing inspection machine determines whether or not printing such as the original manufacturing date of the printing machine is performed correctly by pattern matching between the read image and the inspection character pattern. Also, in addition to the original print inspection, was it possible to correctly recognize the degree of defect by intentionally generating defective characters before operating the printing machine and printing them, and then performing pattern matching between this printed image and the inspection character pattern? Check.

Japanese Unexamined Patent Publication No. 2008-89379

By the way, in order to perform a print inspection by a print inspection machine, it is necessary to perform a learning phase of creating dictionary data that summarizes image data of each character to be printed. The learning phase includes each of the following steps:

(1) The operator captures the characters printed by the printer with the image pickup device. At that time, physical alignment such as adjustment of the imaging position is required. (2) Preprocessing of the captured image is performed. In the preprocessing, various processes are performed to make it easier to recognize the captured image. For example, noise removal and filter processing such as contraction, expansion, contour enhancement, linear correction, and gamma correction are performed. (3) The operator sets an inspection area and a mask area that does not need to be inspected in the captured image.

(4) The operator sets a block frame surrounding the characters to be inspected in the captured image. (5) The worker specifies a character string in the set block frame. That is, which character is included in the block frame is specified. (6) The worker cuts out the characters in the block frame character by character. The operations (1) to (6) are repeated until each character is cut out correctly.

(7) The worker registers the image data of each cut out character in the dictionary as a template image. If necessary, a plurality of image data are registered for each character. (8) The worker confirms the registered image data. (9) The worker performs the collation work using the dictionary created in (1) to (8). Template images are added and preprocessing conditions are reviewed until stable collation is performed.

As described above, there are various steps in the learning phase, but since these steps are performed manually, it takes an enormous amount of time to complete the learning phase. This also limits the operating time of the device.

The present invention has been made in view of the above-mentioned problems in the prior art, and an object of the present invention is to provide a print inspection machine in which the time for creating dictionary data for print inspection is shortened.

A brief description of the representative inventions disclosed in the present application is as follows.

The printing inspection machine according to a typical embodiment of the present invention is a printing inspection machine that inspects the printing of characters printed by a printer. The print inspection machine includes a communication unit connected to a printer, an image capture image input unit for receiving an image captured image of printed characters, and a dictionary data registration unit for creating dictionary data for print inspection. The communication unit receives from the printer the font data for printing the image for creating dictionary data, the characters included in the image for creating dictionary data, and the print data including the coordinates in the image for creating dictionary data of each character. The dictionary data registration unit extracts the character image data of each character from the captured image data of the image for creating the dictionary data based on the print data, and registers each character image data in the dictionary data in association with the corresponding character. do.

Among the inventions disclosed in the present application, the effects obtained by representative ones are briefly described as follows.

That is, according to a typical embodiment of the present invention, it is possible to shorten the time for creating dictionary data for print inspection.

It is a figure which shows an example of the structure of the print inspection system including the print inspection machine which concerns on Embodiment 1 of this invention. It is a figure which shows an example of the image for making a dictionary data. It is a flowchart which shows an example of the dictionary making method which concerns on Embodiment 1 of this invention. It is a block diagram which shows an example of the structure of the printer and the print inspection machine which concerns on Embodiment 2 of this invention. It is a figure which shows an example of the calibration pattern. It is a flowchart which shows an example of the generation method of the calibration data. It is a figure which shows an example of the printed image which concerns on Embodiment 3 of this invention.

Hereinafter, examples of embodiments of the present invention will be described with reference to the drawings. It should be noted that the embodiments described below are examples for realizing the present invention, and should be appropriately modified or modified depending on the configuration of the apparatus to which the present invention is applied and various conditions, and the present invention is the present invention. It is not limited to the following embodiments. Further, it may be configured by appropriately combining a part of each embodiment described later.

(Embodiment 1)
<Configuration of print inspection system>
FIG. 1 is a block diagram showing an example of a configuration of a print inspection system including a print inspection machine according to the first embodiment of the present invention. As shown in FIG. 1, the print inspection system 1 includes a printer 10 and a print inspection machine 20. The printer 10 and the print inspection machine 20 are connected to each other by, for example, a LAN (Local Area Network) 95. The print inspection system 1 is used, for example, for pre-shipment inspection of products in a factory, and inspects whether or not predetermined characters for displaying product information and the like are correctly printed.

<< Printer >>
The printer 10 is, for example, a device for printing product information or the like on a product package, a label, or the like. The printer 10 is, for example, a thermal printer, but may be an inkjet printer. As shown in FIG. 1, the printer 10 includes a print data storage unit 11, a font data storage unit 13, a print data output unit 15, a printer header 17, and a communication unit 19.

The print data storage unit 11 stores characters printed by the printer 10 and print data including the coordinates of each character. The print data may include size data of each character to be printed. The character size data is data that defines the size of the character when it is printed.

For example, in the learning phase of the print inspection machine 20, the print data storage unit 11 stores print data of characters included in the image for creating dictionary data, and stores print data of the image printed on the product at the time of print inspection of the product. do. The print data may be generated inside the printer 10 or may be received from an external device (not shown). The print data is output to the print data output unit 15. Further, the print data is transmitted from the communication unit 19 to the print inspection machine 20 via the LAN 95. The print data storage unit 11 may store a plurality of print data and appropriately select the print data to be output depending on the usage status of the print inspection system 1.

The font data storage unit 13 stores the print font data of the image for creating dictionary data and the image to be printed on the product. The font data for printing may also include bitmap data. The character bitmap data is data that defines the shape of the character when it is printed.

The print font data including these data may be generated inside the printer 10 or may be transmitted from an external device (not shown). The font data is output to the print data output unit 15. Further, the print font data is transmitted from the communication unit 19 to the print inspection machine 20 via the LAN 95.

FIG. 2 is a diagram showing an example of an image for creating dictionary data. The image for creating dictionary data includes, for example, characters for displaying a raw material name of a product, a manufacturing time, an expiration date (expiration date), a manufacturing place, and the like.

The print data output unit 15 outputs the print data output from the print data storage unit 11 and the print font data output from the font data storage unit 13 to the printer header 17. The printer header 17 may generate predetermined print data based on the print data and the print font data and output the print data to the printer header 17.

The printer header 17 prints a predetermined image based on the print data output from the print data output unit 15 and the print font data.

<< Printing inspection machine >>
The print inspection machine 20 is a device that inspects the printing of characters printed by a printer. As shown in FIG. 1, the print inspection machine 20 is connected to the image pickup device 91. The image pickup apparatus 91 captures the characters printed by the printer 10 and transmits the captured image to the print inspection machine 20. Then, the print inspection machine 20 inspects whether or not the characters are correctly printed based on the received captured image or the like.

The print inspection machine 20 is also connected to the display 93. Various information such as inspection results are displayed on the display 93. Further, the display 93 has an input function such as a touch panel, and may be used as an operation panel of the print inspection machine 20.

As shown in FIG. 1, the print inspection machine 20 includes a communication unit 21, a dictionary data registration unit 23, an item storage unit 25, and a dictionary data storage unit 27. Further, the print inspection machine 20 includes a captured image input unit 31, a captured image storage unit 33, an expected value generation unit 35, an inspection image storage unit 37, a matching execution unit 39, and an inspection result output unit 41.

The captured image input unit 31 is a functional block that receives captured image data transmitted from the image pickup device 91. The captured image input unit 31 outputs the received captured image data to the captured image storage unit 33. The captured image storage unit 33 stores the captured image data output from the captured image input unit 31. The captured image storage unit 33 has, for example, a non-volatile memory. Alternatively, the captured image storage unit 33 may also have a volatile memory for temporarily holding the captured image.

In the learning phase for creating dictionary data, the captured image storage unit 33 outputs the captured image data to be stored or held to the dictionary data registration unit 23. On the other hand, at the time of print inspection, the captured image storage unit 33 outputs the captured image data to the matching execution unit 39.

The communication unit 21 is connected to the communication unit 19 of the printer 10 via the LAN 95. The communication unit 21 receives the print data and the print font data transmitted from the printer 10 and outputs the print data to the dictionary data registration unit 23.

The dictionary data registration unit 23 is a functional block for creating dictionary data for print inspection. The dictionary data registration unit 23 extracts character image data of each character from the captured image data of the image for creating dictionary data based on the print data, and associates the extracted character image data with the corresponding character to make a dictionary. Register in the data. Further, the dictionary data registration unit 23 may register the character image data in association with the bitmap data of the corresponding character. Further, the dictionary data registration unit 23 may register a plurality of character image data for one character.

Further, the dictionary data registration unit 23 stores the print data output from the communication unit 21 in the item storage unit 25. The print data stored in the learning phase is the print data of the image for creating dictionary data, but the print data stored at the time of the print inspection is the print data of the predetermined image to be printed on the product. The process related to dictionary data registration will be described in detail later.

The dictionary data registration unit 23 may perform image processing such as noise removal and filter processing such as contraction / expansion / contour enhancement / linear correction / gamma correction. Various information such as parameters related to image processing may be received from, for example, a printer or an external device, or may be manually input by an operator. Information regarding image processing may be received from the printer 10 together with print data, for example.

The expected value generation unit 35 is a functional block that reads out character image data of print data and dictionary data, respectively, and generates image data for print inspection based on these. For example, the expected value generation unit 35 reads the character image data of the characters included in the print data and associates each character with the coordinates. Further, the expected value generation unit 35 adjusts the size of the corresponding character image data based on the size data of each character. Then, the expected value generation unit 35 may store these data in the inspection image storage unit 37 as print inspection image data. Further, the expected value generation unit 35 may generate print inspection image data based on these data and store it in the inspection image storage unit 37.

The matching execution unit 39 compares the print inspection image data stored in the inspection image storage unit 37 with the captured image data of the image printed on the product to be inspected stored in the captured image storage unit 33. , Determine if the characters are printed correctly. The matching execution unit 39 determines, for example, that if the captured image data and the image data for print inspection match, it is determined that they are printed correctly, and if not, it is determined that they are not printed correctly. Alternatively, the matching execution unit 39 may perform a print inspection by dividing it into a plurality of times for each one character or two characters, for example.

The matching execution unit 39 may perform a print inspection after performing image processing on the captured image data. The image processing performed here is the same as the dictionary data registration unit 23 already described. Therefore, the matching execution unit 39 and the dictionary data registration unit 23 may be the same functional block.

The matching execution unit 39 performs a print inspection for each product, and outputs each determination result (inspection result) to the inspection result output unit 41.

The inspection result output unit 41 outputs the inspection result output from the matching execution unit 39 to the display 93, and each inspection result is displayed on the display 93. Each inspection result may be stored in an inspection result storage unit (not shown).

<Creation of dictionary data>
Next, a method for creating dictionary data will be specifically described. In the following, a case will be described in which the character image data of each character included in the character string of the block is registered in the dictionary data for each block that divides a plurality of characters of the image for creating dictionary data.

FIG. 3 is a flowchart showing an example of a dictionary creating method according to the first embodiment of the present invention. At the time of creating the dictionary data, the processes of steps S10 to S50 of FIG. 3 are performed. First, in step S10, the print inspection machine 20 receives the print font data of the dictionary data creation image from the printer 10.

Then, in step S20, the print inspection machine 20 receives the print data of the character string included in one block that divides the plurality of characters of the dictionary data creation image from the printer 10. Taking FIG. 2 as an example, the character string "year, month, day, hour, and minute" consisting of a plurality of characters from the left end of the uppermost row is set as one block, and the print inspection machine 20 receives print data related to this character string from the printer 10. The dictionary data registration unit 23 temporarily holds the received print data in the internal memory of the dictionary data registration unit 23.

In step S30, the dictionary data registration unit 23 sets the characters "year", "month", "day", "hour", and "minute" included in the character string of this block based on the print data received in step S20. Extract image data.

Then, in step S40, the dictionary data registration unit 23 registers the character image data of each character extracted in step S30 in the dictionary data and stores it in the dictionary data storage unit 27.

In step S50, it is determined whether or not the character image data has been registered for all the blocks. If the character image data has not been registered for all the blocks (No), the process returns to step S20, and for example, processing is performed for the block including the character string “manufacturing-specific symbol” in FIG. The processes of steps S20 to S50 are sequentially performed until the character image data is registered for all the blocks, that is, for all the characters included in the dictionary data creation image.

Then, when the character image data for all the blocks is registered (Yes), the dictionary data creation process is completed.

Here, the case of registering the character image data for each block has been described, but the print inspection machine 20 receives the print data for all the characters included in the image for creating dictionary data at once, and all the characters. The character image data may be registered.

Further, the dictionary data registration unit 23 may perform the processes of steps S20 to S50 on a plurality of captured images of the dictionary data creation image. As a result, a plurality of character image data are registered for the same character.

Further, the print inspection machine 20 generates print inspection image data of the dictionary data creation image based on the created dictionary data and the print data received for the dictionary data creation, and performs a print inspection on the dictionary data creation image. You may. Then, the print inspection machine 20 may feed back the inspection result for the dictionary data creation image to the dictionary data.

Then, the print inspection machine 20 receives the print data for the product package and the label, and inspects the print of the product package and the label based on the created dictionary data.

<Main effects of this embodiment>
According to the present embodiment, the print inspection machine 20 extracts character image data of each character from the captured image data of the dictionary data creation image based on the print data received from the printer 10. The print inspection machine 20 registers each character image data in the dictionary data in association with the corresponding character.

According to this configuration, the dictionary data is automatically created in the print inspection machine 20, so that the time for creating the dictionary data for print inspection can be shortened. Further, this makes it possible to improve the operating rate of the printing inspection machine 20.

Further, according to the present embodiment, the print data includes the size of characters. According to this configuration, the size of the character image data registered in the dictionary data can be adjusted, so that accurate print inspection image data can be generated. This makes it possible to improve the accuracy of the print inspection.

Further, according to the present embodiment, the dictionary data registration unit 23 registers a plurality of character image data for one character. According to this configuration, character image data having slightly different shapes are registered for the same character, so that the accuracy of the print inspection can be ensured even if the characters to be printed vary.

Further, according to the present embodiment, the print inspection machine 20 registers the character image data of the characters included in the character string of each block in the dictionary data while sequentially receiving the print data for each block. According to this configuration, the load on the dictionary data registration unit 23 can be suppressed.

(Embodiment 2)
Next, the second embodiment will be described. The size of the character image data registered in the dictionary data may differ from the actual printed character size. If the print inspection is performed in such a situation, the accuracy of the print inspection is lowered. Therefore, in the present embodiment, a printing inspection machine capable of calibrating the character image data registered in the dictionary data storage unit 27 will be described. In the following, the description of the same parts as those in the above-described embodiment will be omitted in principle.

FIG. 4 is a block diagram showing an example of the configuration of the printer and the print inspection machine according to the second embodiment of the present invention. The printer 10 of FIG. 4 is the same as that of FIG. The print inspection machine 20 has a configuration in which a calibration pattern data storage unit 51 and a calibration data storage unit 53 are added to the print inspection machine shown in FIG. 1.

The calibration pattern data storage unit 51 stores the calibration pattern data received from the printer 10. FIG. 5 is a diagram showing an example of a calibration pattern. The calibration pattern data includes a calibration pattern for calibrating the character image data and size data of the calibration pattern.

In the calibration pattern of FIG. 5, dots "." Are printed at each position near the four corners of the printed image. The calibration pattern is not limited to such a pattern. The calibration pattern data in this case includes, for example, information such as the coordinates on which each dot is printed and the distance between the dots as size data.

The calibration data storage unit 53 stores the calibration data of the character image data generated by the dictionary data registration unit 23. The method of generating calibration data will be described later.

<Calibration>
Next, a specific example of calibration will be described. FIG. 6 is a flowchart showing an example of a method of generating calibration data. At the time of generating the calibration data, the processes of steps S110 to S140 of FIG. 6 are performed. First, in step S110, the print inspection machine 20 receives the calibration pattern data from the printer 10. The print inspection machine 20 temporarily holds the received calibration pattern data in the internal memory. The time when the calibration pattern data is received may be immediately before the calibration is performed or when the dictionary data is created. Further, the calibration pattern data storage unit may store a plurality of patterns of calibration pattern data.

Next, in step S120, the calibration pattern is printed by the printer 10. Further, in step S130, the printed calibration pattern is imaged by the image pickup device 91, and the print inspection machine 20 receives the image pickup image data from the image pickup device 91.

In step S140, the dictionary data registration unit 23 calculates the ratio between the size of the calibration pattern included in the calibration pattern data and the size of the calibration pattern in the captured image data, and obtains the calibration data of the character image data. Generate. Then, the dictionary data registration unit 23 stores the generated calibration data in the calibration data storage unit 53. This completes the process related to the calibration data generation.

The expected value generation unit 35 calibrates the size of the character image data at the time of generating the image data for print inspection based on the generated calibration data. Then, the matching execution unit 39 performs a print inspection using the calibrated print inspection image data.

As a result, the character size of the image data for print inspection can be matched with the character size of the captured image data of the product package or the like, so that the accuracy of the print inspection can be improved.

(Embodiment 3)
Next, the third embodiment will be described. The printed image should be printed at a predetermined position, but it may be printed at a position different from the predetermined position. In this case, the print inspection machine 20 that does not know that the print position is deviated cannot correctly extract the character image data and cannot create accurate dictionary data. Further, at the time of printing inspection, the accuracy of printing inspection is lowered. Therefore, in the present embodiment, a printing inspection machine capable of correctly extracting character image data in the learning phase and ensuring the accuracy of printing inspection at the time of printing inspection will be described even when the printing positions are different.

FIG. 7 is a diagram showing an example of a printed image according to the third embodiment of the present invention. FIG. 7A shows a case where the printing position is correct. FIG. 7B shows a case where the print position is deviated. FIG. 7C shows a state in which the deviation of the print position is corrected.

As shown in FIG. 7, a star-shaped positioning pattern for guiding the print position of the printed image is printed on the left side of the printed image. The dictionary data registration unit 23 positions the image for creating dictionary data in the captured image data based on this positioning pattern. The positioning pattern is transmitted from the printer 10 to the print inspection machine 20 by communication via the LAN 95, and is registered in the memory in the print inspection machine 20. The positioning pattern may be included in the font data for printing, or may be provided with data for printing the positioning pattern.

For example, the coordinates of each character included in the print data are set to a value with the positioning pattern as the origin. Further, the dictionary data registration unit 23 detects the positioning pattern from the captured image data. Then, the dictionary data registration unit 23 may register the position of the detected positioning pattern at the origin and extract the character image data of each character based on the print data. In FIG. 7A, since the print position is not deviated, the position of the origin is not deviated either. On the other hand, in FIG. 7B, since the printing position is deviated, the position of the origin is also deviated. Therefore, as shown in FIG. 7C, the position of the detected positioning pattern is registered as the origin.

Here, the printing position of the image for creating dictionary data has been described, but the same applies to the printing inspection of a product package or the like.

According to this embodiment, the print position of the print image such as the image for creating dictionary data is guided based on the positioning pattern. According to this configuration, the character image data can be correctly extracted in the learning phase, and the accuracy of the print inspection can be ensured at the time of the print inspection.

In each embodiment, each of the above functional blocks may be configured by a circuit or software. Further, some functional blocks may be configured by a circuit, and other functional blocks may be configured by software. Furthermore, a part or all of each functional block is configured by an integrated circuit such as a CPU or FPGA, and a program stored in the internal or external memory of the CPU or FPGA is read out to execute the operation of each functional block. You may do it.

The present invention is not limited to the above-described embodiment, and includes various modifications. For example, the above-described embodiments have been described in detail in order to explain the present invention in an easy-to-understand manner, and are not necessarily limited to those having all the described configurations.

Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. .. Further, it is possible to add, delete, or replace a part of the configuration of each embodiment with another configuration. It should be noted that each member and the relative size described in the drawings are simplified and idealized in order to explain the present invention in an easy-to-understand manner, and may have a more complicated shape in mounting.

10 ... Printer, 20 ... Print inspection machine, 21 ... Communication unit, 23 ... Dictionary data registration unit, 25 ... Item storage unit, 27 ... Dictionary data storage unit, 31 ... Captured image input unit, 35 ... Expected value generation unit, 39 ... Matching execution unit, 51 ... Calibration pattern data storage unit, 53 ... Calibration data storage unit, 91 ... Image pickup device, 95 ... LAN

Claims (5)

It is a printing inspection machine that inspects the printing of characters printed by a printer.
The communication unit connected to the printer and
An image capture image input unit that receives the image image data of the printed characters, and
A dictionary data registration unit that creates dictionary data for print inspection, and
An expected value generator that generates image data for print inspection,
Equipped with
The communication unit obtains the print font data of the dictionary data creation image, the characters included in the dictionary data creation image, the size data of the characters, and the coordinates of each of the characters in the dictionary data creation image. The included print data and the calibration pattern data are received from the printer, and the data is received.
The dictionary data registration unit calculates the ratio between the size of the calibration pattern included in the calibration pattern data and the size of the calibration pattern in the captured image data, and generates the calibration data of the character image data. death,
The expected value generation unit generates image data for print inspection from the character size data based on the calibration data.
Based on the print data, the dictionary data registration unit extracts character image data of each of the characters from the captured image data of the image for creating dictionary data, and uses each of the character image data as the corresponding character. Registered in the dictionary data in association with
Printing inspection machine. In the printing inspection machine according to claim 1,
The dictionary data registration unit registers a plurality of the character image data for one character.
Printing inspection machine. In the printing inspection machine according to claim 1,
The communication unit sequentially receives the print data of the character string for each block that divides the plurality of characters of the dictionary data creation image.
The dictionary data registration unit registers the character image data of each character included in the character string of each block in the dictionary data.
Printing inspection machine. In the printing inspection machine according to claim 1,
The print font data includes a positioning pattern that guides the print position of the dictionary data creation image.
The dictionary data registration unit positions the image for creating dictionary data in the captured image data based on the positioning pattern.
Printing inspection machine. In the printing inspection machine according to claim 1,
The communication unit is connected to the printer by a LAN (Local Area Network).
Printing inspection machine.

Images