JP5834866B2 - Image processing apparatus, image generation method, and computer program - Google Patents

Description

  The present invention relates to an apparatus and method for processing a two-dimensional barcode.

  In recent years, two-dimensional barcodes such as QR (Quick Response) codes have become widespread. QR codes are printed on various printed materials such as flyers, brochures, and books.

  The QR code includes an error correction code so that it can be read accurately even if a portion becomes dirty or damaged.

  In addition, a technique for repairing a damaged barcode has been proposed. According to the method described in Patent Document 1, whether the error detection rate when the original information is extracted from the code image in the read image obtained by reading the sheet on which the code image is formed is equal to or higher than a predetermined value. to decide. If it is determined that the value is equal to or greater than the predetermined value, the code image is reproduced from the extracted original information and replaced with the code image in the read image.

  In addition, the following technologies have been proposed. Patent Document 2 proposes a technique for inserting an image into a two-dimensional barcode. Patent Document 3 proposes a technique for generating one two-dimensional barcode by superimposing two two-dimensional barcodes.

JP 2009-151700 A JP 2007-331884 A JP 2008-171130 A

  By the way, a two-dimensional barcode may be attached to an existing document. Depending on the position where the 2D barcode is attached, it may overlap with a part of the object in the document.

  As described above, a two-dimensional barcode having an error correction code has been put into practical use. Therefore, there are cases where the two-dimensional barcode can be read even if the two-dimensional barcode overlaps a part of the object. However, there are cases where the two-dimensional barcode cannot be read even if an error correction code is used depending on the way of overlapping. Even if the techniques described in Patent Documents 1 to 3 are used, this problem cannot be solved.

  The present invention has been made in view of such problems, and it is an object of the present invention to more suitably add a two-dimensional barcode to an image than before.

An image processing apparatus according to an aspect of the present invention generates a second image by overlaying a first image including one or more objects with a two-dimensional barcode including a symbol for specifying its orientation. An image processing apparatus that, when any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, overlaps the two-dimensional barcode at the predetermined position. If it is determined by the analysis enable / disable determining means that determines whether or not the two-dimensional barcode can be analyzed, and the analysis enable / disable determining means that the two-dimensional barcode cannot be analyzed, Rotating and reducing the two-dimensional barcode while leaving a portion overlapping one or more objects existing at the predetermined position; Ku is by overlaying by reducing the change the relative position between the object or the object in the first image to generate the second image, an image generating unit, wherein the symbol is said one or possess more determination means for determining whether or not overlap any object, wherein the image generation means, by said determining means and said symbol overlap to any crab of the one or more objects If determined, the second image is generated by superimposing the two-dimensional barcode on the first image so that the symbol does not overlap any of the one or more objects.

  Preferably, the analysis availability determination unit determines whether or not the two-dimensional barcode can be analyzed by simulating and analyzing a state in which the two-dimensional barcode is superimposed on the predetermined position.

  Alternatively, the image generation unit generates the second image by superimposing the two-dimensional barcode on the first image by changing the relative position so that the area of the portion is reduced. To do.

  Alternatively, the analysis enable / disable determining means may convert the two-dimensional barcode based on an overlapping portion ratio that is a ratio of the area of the portion to the entire area of the two-dimensional barcode and an error correction rate of the two-dimensional barcode. It is determined whether or not analysis is possible.

  Alternatively, the image generating means superimposes the two-dimensional barcode on the first image by changing the relative position so that the overlapping portion ratio is less than the error correction rate. Generate a second image.

  Alternatively, the image generation means rotates the two-dimensional barcode so that the symbol does not overlap any of the one or more objects, and if the two-dimensional barcode overlaps at any angle, the two-dimensional The second image is generated by reducing or moving the barcode and overlaying the two-dimensional barcode on the first image.

  Alternatively, when the four-dimensional barcode is surrounded by the one or more objects, the image generating means reduces the two-dimensional barcode and superimposes the two-dimensional barcode on the first image. A second image is generated.

An image processing apparatus according to another aspect of the present invention provides a second image by overlaying a first image including one or more objects with a two-dimensional barcode including a symbol for specifying its orientation. When any one of the one or a plurality of objects is present at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is displayed at the predetermined position. When determining whether the two-dimensional bar code can be analyzed even if it is overlapped, and when determining whether the two-dimensional bar code cannot be analyzed by the analysis enable / disable determining means while leaving the portion overlapping the objects present in the predetermined position of the one or more objects, by rotating the two-dimensional bar code, reduced Or by overlaying the first image by reducing the change the relative position between the object or the object, to generate the second image has an image generating unit, wherein the image generation The means rotates the two-dimensional barcode so that the symbol does not overlap any of the one or more objects, and further reduces the two-dimensional barcode when the symbol overlaps even if rotated at any angle. Alternatively, the second image is generated by moving and superimposing the two-dimensional barcode on the first image .

  According to the present invention, it is possible to add a two-dimensional barcode to an image more suitably than in the past.

1 is a diagram illustrating an example of an overall configuration of a network system including an image forming apparatus. 2 is a diagram illustrating an example of a hardware configuration of an image forming apparatus. FIG. 1 is a diagram illustrating an example of a functional configuration of an image forming apparatus according to a first embodiment. It is a figure which shows the example of a manuscript image, the image for superimposition, and a temporary composite image. It is a figure for demonstrating the example of the process of a change of the position of a two-dimensional barcode. It is a flowchart explaining the example of the whole process flow of the image synthesis | combination in 1st embodiment. It is a figure which shows the example of a functional structure of the image forming apparatus in 2nd embodiment. It is a figure for demonstrating the example of the process of a change of the position of the two-dimensional barcode in 2nd embodiment. It is a flowchart explaining the example of the flow of the whole process of the image synthesis | combination in 2nd embodiment. It is a figure for demonstrating the modification of the process of a two-dimensional barcode adjustment. It is a figure which shows the example which the object crossed the two-dimensional barcode. It is a figure for demonstrating the modification of the process of a two-dimensional barcode adjustment. It is a figure for demonstrating the modification of the process of a two-dimensional barcode adjustment. It is a figure for demonstrating the modification of the process of a two-dimensional barcode adjustment. It is a figure for demonstrating the example of the range which can move a two-dimensional barcode. It is a figure which shows the example of the situation without the range which can move a two-dimensional barcode. It is a figure for demonstrating the modification of the process of a two-dimensional barcode adjustment. It is a flowchart explaining the example of the flow of a symbol adjustment process. It is a flowchart explaining the example of the flow of a movement reduction process. It is a figure which shows the example which moves or divides | segments a two-dimensional barcode into several small two-dimensional barcodes.

[First embodiment]
FIG. 1 is a diagram illustrating an example of the overall configuration of a network system including an image forming apparatus 1. FIG. 2 is a diagram illustrating an example of a hardware configuration of the image forming apparatus 1. FIG. 3 is a diagram illustrating an example of a functional configuration of the image forming apparatus 1 according to the first embodiment.

  In FIG. 1, an image forming apparatus 1 is an apparatus generally called an MFP (Multi Function Peripherals) or a multifunction peripheral, and is an apparatus that integrates functions such as copying, PC printing, fax, scanner, and document server.

  The PC print function is a function for receiving image data from a terminal device such as a personal computer and printing an image on paper. It may also be called “network printer function” or “network printing function”.

  The document server function is a function for providing and managing a storage area called a “personal box” or “box” corresponding to a folder or directory in a personal computer for each user. Sometimes called “box function”. The user can store image data or the like in the user box in units of files.

  The image forming apparatus 1 can communicate with a device such as the terminal device 2 via the communication line NW.

  As shown in FIG. 2, the image forming apparatus 1 includes a CPU (Central Processing Unit) 10a, a RAM (Random Access Memory) 10b, a ROM (Read Only Memory) 10c, a mass storage device 10d, a scan unit 10e, and a printing unit 10f. , A network interface 10g, an operation panel 10h, a facsimile unit 10i, an image processing circuit 10j, an automatic document feeder 10k, and the like.

  The network interface 10g communicates with a device such as the terminal device 2 via a communication line NW using a protocol such as TCP / IP (Transmission Control Protocol / Internet Protocol). For example, a network interface card (NIC) is used as the network interface 10g.

  The operation panel 10h includes a key input unit and a touch panel display.

  The key input unit is a so-called hardware key, and includes a numeric keypad, a start key, a stop key, a function key, and the like.

  The touch panel display includes a screen for giving a message or an instruction to the user, a screen for inputting a processing type and processing conditions desired by the user, a screen showing a result of processing executed by the CPU 10a and the like. Is displayed. The user can input information and commands to the image forming apparatus 1 by operating the key input unit or the touch panel display while viewing these screens.

  The image processing circuit 10j performs image processing by processing image data. The image processing circuit 10j can be configured by an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA).

  The automatic document feeder 10k is an ADF (Auto Document Feeder), and conveys documents set on the document feed tray one by one to a predetermined position on the platen glass of the scan unit 10e, and the document by the scan unit 10e. Is read out to the document discharge tray.

  The scan unit 10e reads an image composed of a photograph, a character, a picture, a chart and the like written on a document set on the platen glass and generates image data.

  The facsimile unit 10i is a device for exchanging image data with a fax terminal using a protocol such as G3 via a public telephone line.

  In addition to the image read by the scan unit 10e, the printing unit 10f prints an image indicated by image data received from the terminal device 2 or a fax terminal on a sheet.

  Software such as an operating system and middleware for realizing the above-described functions is installed in the ROM 10c or the mass storage device 10d.

  Further, an image including an object such as a character string, an illustration, or a chart (hereinafter referred to as “document image”) is printed on the ROM 10c or the mass storage device 10d with a two-dimensional barcode. Software 1SW is installed.

  According to the software 1SW, the document acquisition unit 101, the two-dimensional barcode acquisition unit 102, the temporary image synthesis unit 103, the first two-dimensional barcode analysis unit 104, the preferred composite image generation unit 105, and the like illustrated in FIG. 3 are realized. The According to these functions, even if the two-dimensional barcode overlaps an object in the document image, a printed matter can be generated without changing the position of the two-dimensional barcode.

  Software modules constituting these software are loaded into the RAM 10b as necessary and executed by the CPU 10a.

  Returning to FIG. 1, the terminal device 2 is a client for receiving services such as printing by the image forming apparatus 1. A driver for controlling the image forming apparatus 1 is installed in the terminal device 2. As the terminal device 2, a personal computer, a smartphone, a PDA (Personal Digital Assistant), or the like is used.

  FIG. 4 is a diagram illustrating an example of the document image 51, the superimposing image 52, and the temporary composite image 53. FIG. 5 is a diagram for explaining an example of processing for changing the position of the two-dimensional barcode 52N.

  Next, processing for generating printed matter by each unit of the image forming apparatus 1 illustrated in FIG. 3 will be described with reference to FIGS. 4 to 5.

  For example, the document acquisition unit 101 acquires the image data 61 of the document image to be printed as follows.

  The user prepares a sheet on which a document image is written. Then, a predetermined command is input to the image forming apparatus 1.

  Then, the document acquisition unit 101 causes the scan unit 10e to scan the original surface (reading surface) of the paper and generate image data. Then, this image data is acquired as image data 61. Hereinafter, a case where the image data 61 of the document image 51 is obtained by the document acquisition unit 101 will be described as an example. As shown in FIG. 4A, the document image 51 is a document image composed of a plurality of objects 51J. Further, the document image 51 includes an area where the object 51J is not arranged.

  The two-dimensional barcode acquisition unit 102 acquires two-dimensional barcode image data 62 to be printed on the paper together with the original image 51. The acquisition method is basically the same as the acquisition method of the image data 61 by the document acquisition unit 101.

  That is, the user prepares a sheet on which a two-dimensional barcode is written. Then, a predetermined command is input to the image forming apparatus 1.

  Then, the two-dimensional barcode acquisition unit 102 causes the scan unit 10e to scan the original surface of the paper and generate image data. Then, this image data is acquired as image data 62. Hereinafter, a case where the image data 62 of the superimposition image 52 is obtained by the two-dimensional barcode acquisition unit 102 will be described as an example. As shown in FIG. 4B, the superimposing image 52 is an image including a two-dimensional barcode 52N. The pixels other than the two-dimensional barcode 52N are so-called transparent pixels used in a transparent GIF (Graphics Interchange Format) or the like. The transmittance is 100%. The two-dimensional barcode 52N is composed of black cells and colorless cells. Colorless cells also consist of transparent pixels. The transmittance is 100%. Hereinafter, a case where a QR (Quick Response) code is used as the two-dimensional barcode will be described as an example. QR code is a registered trademark.

  The document image 51 and the superimposing image 52 are both rectangular. Further, the vertical length of the original image 51 and the vertical length of the superimposing image 52 are equal, and the horizontal length of the original image 51 and the horizontal length of the superimposing image 52 are also equal.

  Based on the image data 61 and the image data 62, the temporary image synthesis unit 103 generates image data of a synthesized image in which the superimposing image 52 is exactly superimposed on the document image 51 as shown in FIG. Whether or not this composite image is printed on paper is not determined at this time. That is, this composite image is a simulated temporary image. Hereinafter, this synthesized image is referred to as “temporary synthesized image 53”. The image data of the temporary composite image 53 is referred to as “image data 63”.

  The first two-dimensional barcode analysis unit 104 detects a two-dimensional barcode 52N from the temporary composite image 53 based on the image data 63. Then, the character string shown in the two-dimensional barcode 52N is determined by analyzing the two-dimensional barcode 52N. This process can be performed using existing software (so-called QR code reader) for analyzing the QR code.

  Specifically, the first two-dimensional barcode analysis unit 104 searches the temporary composite image 53 for three position detection patterns (sometimes referred to as “cutout symbols”). Then, an image of a rectangular area including each of the three position detection patterns at the corner is detected as a two-dimensional barcode 52N. Then, the two-dimensional barcode 52N is analyzed.

  However, as shown in FIG. 4C, a part of the two-dimensional barcode 52N may overlap with any object 51J in the document image 51. In this case, the character string may not be discriminated even by analyzing the two-dimensional barcode 52N.

  If the character string can be determined, the image data 63 is sent to the printing unit 10f together with a print command. Then, the temporary composite image 53 is printed on the paper by the printing unit 10f based on the image data 63.

  On the other hand, when the character string cannot be discriminated, a process for obtaining a composite image including the discriminable two-dimensional barcode 52N is performed by the suitable composite image generation unit 105. Hereinafter, the object 51J overlapped with the two-dimensional barcode 52N is referred to as “object 51JN”.

  The preferred composite image generation unit 105 includes a two-dimensional barcode position changing unit 301 and a second two-dimensional barcode analysis unit 302.

  The two-dimensional barcode position changing unit 301 regenerates image data of a composite image in which the position of the two-dimensional barcode 52N is changed so that the area where the two-dimensional barcode 52N and the object 51JN overlap is small. For example, as shown in FIG. 5A, when the lower left part of the two-dimensional barcode 52N overlaps with the upper right part of the object 51JN, as shown in FIG. 5B, the two-dimensional barcode 52N Is generated again by moving a predetermined number of pixels (for example, 3 pixels each) to the right and upward. However, the two-dimensional barcode 52N is moved so that the overlapping area is not zero as much as possible. Hereinafter, the regenerated composite image is referred to as “composite image 54”, and the image data of the composite image 54 is referred to as “image data 64”.

  The second two-dimensional barcode analysis unit 302 detects the two-dimensional barcode 52N from the composite image 54 based on the image data 64. Then, the character string shown in the two-dimensional barcode 52N is determined by analyzing the two-dimensional barcode 52N. These processing methods are the same as the processing methods in the first two-dimensional barcode analysis unit 104.

  If the character string can be determined, the latest image data 64 is sent to the printing unit 10f. Then, the composite image 54 is printed on a sheet by the printing unit 10f based on the image data 64.

  On the other hand, if the character string cannot be determined, the two-dimensional barcode position changing unit 301 further moves the position of the two-dimensional barcode 52N by a predetermined number of pixels as shown in FIG. Image data 64 is regenerated by reducing the overlap area with the object 51JN. The second two-dimensional barcode analysis unit 302 detects the two-dimensional barcode 52N from the latest composite image 54 based on the latest image data 64 and tries to determine the character string. The position of the two-dimensional barcode 52N is gradually changed until the discrimination is successful, and the image data 64 is generated again. If the determination is successful, the latest composite image 54 is printed by the printing unit 10f based on the latest image data 64.

  FIG. 6 is a flowchart for explaining an example of the overall processing flow of image synthesis in the first embodiment.

  Next, the overall processing flow of the image forming apparatus 1 according to the first embodiment will be described with reference to the flowchart shown in FIG. 6 by taking as an example the case where a composite image obtained by superimposing the superimposing image 52 on the original image 51 is printed. The description will be given with reference.

  The image forming apparatus 1 acquires the image data 61 of the document image 51 by the scan unit 10e (# 701) and the image data 62 of the superimposing image 52 (# 702).

  The image forming apparatus 1 generates the image data 63 of the temporary composite image 53 by superimposing the superimposing image 52 on the document image 51 (# 703). Then, by detecting and analyzing the two-dimensional barcode 52N from the provisional composite image 53, the character string indicated in the two-dimensional barcode 52N is determined (# 704).

  If it can be determined (Yes in # 705), the image forming apparatus 1 prints the temporary composite image 53 on the paper without changing the position of the two-dimensional barcode 52N (# 709).

  On the other hand, if it cannot be determined (No in # 705), the image forming apparatus 1 sets the two-dimensional barcode 52N on the object 51J that overlaps the two-dimensional barcode 52N (that is, as described in FIG. 5). The composite image 54 is generated by moving the object 51JN) so as to reduce the overlapping area (# 706). Then, by detecting and analyzing the two-dimensional barcode 52N from the composite image 54, the character string indicated in the two-dimensional barcode 52N is determined (# 707). If it is still impossible to discriminate (No in # 708), the composite image 54 is separated from the object 51JN by a predetermined distance until the character string of the two-dimensional barcode 52N is successfully identified. The process of generating and the process of analysis are repeated (# 706, # 707). Then, the composite image 54 when it can be determined is printed on paper (# 709).

[Second Embodiment]
FIG. 7 is a diagram illustrating an example of a functional configuration of the image forming apparatus 1 according to the second embodiment. FIG. 8 is a diagram for explaining an example of processing for changing the position of the two-dimensional barcode 52N in the second embodiment.

  In the first embodiment, a temporary composite image 53 or a composite image 54 is obtained, and an attempt is made to determine the character string indicated by the two-dimensional barcode 52N in the temporary composite image 53. If it can be determined, the temporary composite image 53 or the composite image 54 is regarded as suitable and printed on paper. In the second embodiment, it is checked whether or not it is suitable by a method other than checking whether or not a character string can be discriminated.

  The hardware configuration of the image forming apparatus 1 is the same as that of the first embodiment, as shown in FIG. However, software 1SW2 is installed in the ROM 10c or the mass storage device 10d in place of the software 1SW.

  According to the software 1SW2, the document acquisition unit 121, the two-dimensional barcode acquisition unit 122, the temporary image synthesis unit 123, the damage rate calculation unit 124, the error correction rate detection unit 125, the analysis availability determination unit 126, and the preferred synthesis illustrated in FIG. An image generation unit 127 and the like are realized.

  Hereinafter, the process of generating printed matter by the document acquisition unit 121 or the preferred composite image generation unit 127 will be described with reference to FIG. The description overlapping with the first embodiment is omitted.

  The document acquisition unit 121, the two-dimensional barcode acquisition unit 122, and the temporary image synthesis unit 123 are the document acquisition unit 101, the two-dimensional barcode acquisition unit 102, and the temporary image synthesis unit 103 according to the first embodiment (see FIG. 3). ). That is, the document acquisition unit 121 performs processing for acquiring the image data 61 of the document image 51 (see FIG. 4). The two-dimensional barcode acquisition unit 122 performs processing for acquiring the image data 62 of the superimposition image 52. The temporary image synthesis unit 123 performs processing for generating image data 63 of the temporary synthesized image 53.

  By the way, the two-dimensional barcode 52N in the temporary composite image 53 may be damaged (missed) by being overlaid on any of the objects 51J. As in the examples of FIGS. 4 and 5, there is a case where the object 51JN is damaged by being overlapped.

  The breakage rate calculation unit 124 calculates the ratio of the two-dimensional barcode 52N in the temporary composite image 53 that is overlapped with the object 51J as follows. Hereinafter, this ratio is referred to as “breakage rate Rk”.

  The breakage rate calculation unit 124 extracts the two-dimensional barcode 52N from the temporary composite image 53 by searching for the three position detection patterns. Then, the entire area Sz of the two-dimensional barcode 52N is obtained. The area Sz can also be obtained from the superimposition image 52.

  Further, the breakage rate calculation unit 124 obtains the area Sc of the portion 53C where the two-dimensional barcode 52N and the object 51JN overlap. The area Sc can be obtained by detecting a portion 53C where the two overlap each other from the provisional composite image 53 (see FIG. 8A). Alternatively, the area and position occupied by the object 51JN in the document image 51 and the area and position occupied by the two-dimensional barcode 52N in the superimposing image 52 are calculated, and the two areas are overlapped based on both positions. it can.

Then, the breakage rate calculation unit 124 calculates the breakage rate Rk by the following equation (1).
Breakage rate Rk = Area Sc / Area Sz (1)
The error correction rate detection unit 125 detects the error correction rate Ra by analyzing a cell at a specific position of the two-dimensional barcode 52N. In general, QR codes indicate several error correction levels as error correction rates. Therefore, the error correction rate detection unit 125 can detect the error correction rate by detecting the error correction level.

  The analysis enable / disable determining unit 126 determines whether the two-dimensional barcode 52N in the temporary composite image 53 is a character string that can be determined, the damage rate Rk calculated by the damage rate calculating unit 124, and the error correction. The determination is made based on the error correction rate Ra detected by the rate detection unit 125. Specifically, as shown in FIG. 8, if the damage rate Rk is less than the error correction rate Ra, it is determined that the character string can be determined. If the error correction rate Ra is less than the breakage rate Rk, it is determined that the character string cannot be determined. When the damage rate Rk and the error correction rate Ra are the same rate, it may be determined that the character string can be determined or not. Which one should be determined may be determined in advance.

Alternatively, the analysis availability determination unit 126 may increase the determination reference in order to increase the certainty of the analysis of the two-dimensional barcode 52N. For example, if the following equation (2) is satisfied, it may be determined that the character string can be determined, and if it is not satisfied, it may be determined that it is impossible.
Ra ≧ α · Rk + β (2)
However, “α” is a coefficient of 1 or more. “Β” is a number of 0 or more.

  If the analysis enable / disable determining unit 126 determines that the character string can be determined, the image data 63 is sent to the printing unit 10f together with a print command. Then, the temporary composite image 53 is printed on the paper by the printing unit 10f based on the image data 63. That is, as shown in FIG. 8B, the position of the two-dimensional barcode 52N is not changed.

  On the other hand, when the analysis possibility determination unit 126 determines that the character string cannot be determined, a process for obtaining a composite image including the two-dimensional barcode 52N in a state where the character string can be determined is preferable. This is performed by the composite image generation unit 127.

  The suitable composite image generation unit 127 calculates the area of the portion 53C where the two-dimensional barcode 52N and the object 51JN overlap when the breakage rate Rk is less than the error correction rate Ra or the expression (2) is satisfied. Then, the position of the two-dimensional barcode 52N is changed as shown in FIG. 8C so that the area of the portion 53C is equal to or less than the calculated area, and the image data of the composite image is generated again. The method of changing the position is the same as in the first embodiment. Hereinafter, the regenerated composite image is referred to as “composite image 55”, and the image data of the composite image 55 is referred to as “image data 65”.

  Then, the image data 65 is sent to the printing unit 10f together with a print command, and the composite image 55 is printed on a sheet by the printing unit 10f based on the image data 65.

  FIG. 9 is a flowchart for explaining an example of the overall processing flow of image synthesis in the second embodiment.

  Next, the overall processing flow of the image forming apparatus 1 according to the second embodiment will be described with reference to a flowchart shown in FIG. 9, taking as an example a case where a composite image obtained by superimposing a superimposing image 52 on a document image 51 is printed. The description will be given with reference.

  The image forming apparatus 1 acquires the image data 61 of the document image 51 and the image data 62 of the superimposing image 52 as in Steps # 701 to # 703 of the first embodiment, and the image data 63 of the temporary composite image 53. Are generated (# 711 to # 713).

  The image forming apparatus 1 detects the error correction rate Ra (# 714) and calculates the damage rate Rk (# 715). Then, based on the error correction rate Ra and the damage rate Rk, it is determined whether or not the two-dimensional barcode 52N in the provisional composite image 53 can be distinguished (# 716).

  If the character can be identified (Yes in # 717), the image forming apparatus 1 prints the temporary composite image 53 on a sheet (# 719).

  On the other hand, if the character cannot be identified (No in # 717), the image forming apparatus 1 positions the two-dimensional barcode 52N so that the two-dimensional barcode 52N can be identified. By changing (see FIG. 8C), the image data 64 of the composite image 54 is generated (# 718). Then, the composite image 54 is printed on paper (# 719).

  If the breakage rate Rk is zero, the processes of steps # 716 to # 718 may be skipped and the temporary composite image 53 may be printed (# 719). Further, the damage rate Rk may be calculated prior to step # 714 (# 715), and if the damage rate Rk is zero, step # 714 may also be skipped.

[Modification]
<1> First Countermeasure in Case where Position Detection Pattern Overlaps Object FIG. 10 is a diagram for explaining a modification of the adjustment process of the two-dimensional barcode 52N. FIG. 11 is a diagram illustrating an example in which an object 51JN crosses a two-dimensional barcode 52N.

  In the first embodiment and the second embodiment, the case where three position detection patterns of the two-dimensional barcode 52N in the temporary composite image 53 are searched has been described as an example. That is, in the first embodiment and the second embodiment, although a part of the two-dimensional barcode 52N overlaps the object 51JN, no position detection pattern overlaps the object 51JN. However, at least one of the three position detection patterns may overlap the object 51JN. In this case, the two-dimensional barcode 52N may not be correctly detected from the temporary composite image 53.

  Therefore, the image forming apparatus 1 performs the following process so that no position detection pattern overlaps the object 51JN.

  As shown in FIG. 10A, when at least one position detection pattern 52Np of the two-dimensional barcode 52N overlaps the object 51JN, the image forming apparatus 1 centers the position detection pattern 52Np in the middle of the position detection pattern 52Np. As shown in FIG. 10B, the image data 63 of the temporary composite image 53 is regenerated by rotating it 90 degrees clockwise. If at least one position detection pattern 52Np still overlaps the object 51JN, the image data 63 of the temporary composite image 53 is regenerated by rotating it 90 degrees clockwise as shown in FIG. In the example of FIG. 10C, since no position detection pattern 52Np overlaps the object 51JN, the first two-dimensional barcode analysis unit 104 (see FIG. 3) and the damage rate calculation unit 124 (see FIG. 7) The processing is executed using the image data 63 at this time. If at least one position detection pattern 52Np still overlaps the object 51JN after being rotated 90 degrees clockwise and twice, the image data 63 of the temporary composite image 53 is further rotated 90 degrees clockwise. Regenerate.

  Note that the object 51JN may cross the center of the two-dimensional barcode 52N as shown in FIG. 11, but none of the three position detection patterns 52Np overlaps the object 51JN even when crossing or longitudinally crossing. Can generate a composite image by the method of the first embodiment or the second embodiment.

<2> Second Countermeasure in Case where Position Detection Pattern Overlaps Object FIG. 12 is a diagram for explaining a modification of the adjustment process of the two-dimensional barcode 52N.

  In the case where the preferred temporary composite image 53 cannot be obtained by the method <1> described above, that is, at least one position even if the two-dimensional barcode 52N is rotated 90 degrees, 180 degrees, and 270 degrees clockwise. When the detection pattern 52Np overlaps the object 51JN, the image forming apparatus 1 generates the image data 63 of the temporary composite image 53 by the following method.

  For example, as shown in FIG. 12A, when two or more position detection patterns 52Np overlap with the object 51JN, the image forming apparatus 1 faces the outside of the object 51JN as shown in FIG. The two-dimensional barcode 52N is moved to a position where no position detection pattern 52Np overlaps, and the image data 63 of the temporary composite image 53 is generated again. Alternatively, the two-dimensional barcode 52N is moved to the position adjacent to the object 51JN toward the outside of the object 51JN, and the image data 63 of the temporary composite image 53 is generated again.

  Alternatively, as illustrated in FIG. 12C, the image forming apparatus 1 transfers the two-dimensional barcode 52N to a position where only one part obtained by dividing the two-dimensional barcode 52N into 4 × 2 parts overlaps the object 51JN. Move. Then, as shown in FIG. 12D, the two-dimensional barcode 52N is rotated by the method <1> described above (see FIG. 10) until one of the three position detection patterns does not overlap the object 51JN. Thus, the image data 63 of the temporary composite image 53 is generated again.

<3> Third Countermeasure in Case where Position Detection Pattern Overlaps Object FIG. 13 is a diagram for explaining a modification of the adjustment process of the two-dimensional barcode 52N.

  If a suitable temporary composite image 53 cannot be obtained by the above method <1>, the image data 63 of the temporary composite image 53 may be generated by the following method.

  For example, as shown in FIG. 13A, when at least one position detection pattern 52Np overlaps the upper part of the object 51JN, the image forming apparatus 1 uses the two-dimensional barcode 52N as shown in FIG. The image data 63 of the temporary composite image 53 is generated again by reducing the image upward.

  However, the two-dimensional barcode 52N is reduced so as to correspond to the reading resolution of the reading device that scans the printed matter of the composite image. That is, when the minimum unit of reading of this reading apparatus is 2 dots, the two-dimensional barcode 52N is reduced so that the size of one cell is 2 dots or more. Since the QR code is generally recommended to be 4 dots or more, it is preferable to reduce the two-dimensional barcode 52N so that the size of one cell is 4 dots or more. Of course, if the minimum unit of reading of this reading apparatus is 1 dot, the size of one cell may be reduced to 1 dot.

<4> Fourth Countermeasure in Case where Position Detection Pattern Overlaps Object FIG. 14 is a diagram for explaining a modification of the process of adjusting the two-dimensional barcode 52N.

  If a suitable temporary composite image 53 cannot be obtained by the above method <1>, the image data 63 of the temporary composite image 53 may be generated by the following method.

  When only one position detection pattern 52Np does not overlap the object 51JN, the image forming apparatus 1 moves the two-dimensional barcode 52N in the direction of the position detection pattern 52Np to generate image data 63 of the temporary composite image 53. Try again. For example, when only the upper left position detection pattern 52Np does not overlap the object 51JN as shown in FIG. 14A, the upper left direction is reached to the position where the three position detection patterns 52Np appear as shown in FIG. The two-dimensional barcode 52N is moved to regenerate the image data 63 of the temporary composite image 53.

<5> Range of Movement of Two-dimensional Barcode FIG. 15 is a diagram for explaining an example of a movable range of the two-dimensional barcode 52N.

  According to the countermeasures <1>, <2>, and <4> described above in addition to the first embodiment and the second embodiment, the two-dimensional barcode 52N is moved in either direction to temporarily The image data 63 of the composite image 53 is regenerated. However, for example, another object 51J may exist in the moving direction as indicated by an arrow in FIG. Therefore, the image forming apparatus 1 limits the movable range of the two-dimensional barcode 52N to a range up to immediately before the other object 51J, as indicated by a two-dot chain line in FIG.

  When it can be moved in a plurality of directions, it may be preferentially moved in a predetermined direction, or a direction may be selected at random and moved.

  Similarly, when generating and regenerating the image data 64 and 65 of the composite image 54, the movable range of the two-dimensional barcode 52N may be limited.

  Note that a range designated by the user may be used as the movable range. Alternatively, a movable range may be set based on specific specifications.

<6> First Countermeasure in Case where Movement of Two-Dimensional Barcode is Impossible FIG. 16 is a diagram illustrating an example of a situation where there is no movable range of the two-dimensional barcode 52N.

  As shown in FIG. 16, the two-dimensional barcode 52N may not only overlap the object 51JN but may be surrounded by one or more other objects 51J. In this case, there is almost no movable range of the two-dimensional barcode 52N.

  Therefore, the image forming apparatus 1 can obtain a preferable result even when there is no movable range and when the image data 63 of the temporary composite image 53 is regenerated by moving the two-dimensional barcode 52N within the movable range. If not, the following process may be performed.

  The image forming apparatus 1 regenerates the image data 63 of the temporary composite image 53 by appropriately moving the two-dimensional barcode 52N after reducing it by the method <3> described above.

  Alternatively, the image forming apparatus 1 increases the error correction level by increasing the error correction level, regenerates the two-dimensional barcode 52N, and regenerates the image data 63 of the temporary composite image 53.

  The two-dimensional barcode 52N can be regenerated as follows. The image forming apparatus 1 determines the character string and the error correction level indicated in the two-dimensional barcode 52N based on the image data 62. Then, a two-dimensional barcode 52N indicating the determined character string is regenerated at an error correction level higher than the determined error correction level.

  A method for increasing the error correction rate can also be used when generating and regenerating the image data 64 and 65 of the composite image 54.

<7> Second Countermeasure in Case where Movement of Two-Dimensional Barcode is Impossible FIG. 17 is a diagram for explaining a modification of the adjustment process of the two-dimensional barcode 52N.

  When there is no movable range, and when a preferable result is not obtained even if the two-dimensional barcode 52N is moved within the movable range and the image data 63 of the temporary composite image 53 is generated again, the image forming apparatus 1 May process the object 51JN as follows.

  For example, when the two-dimensional barcode 52N overlaps the object 51JN as shown in FIG. 17A, the image forming apparatus 1 does not use the two-dimensional barcode 52N but the object 51JN as shown in FIG. The image data 63 of the temporary composite image 53 may be regenerated by moving the image.

  Alternatively, as shown in FIG. 17C, the object 51JN may be reduced, and the image data 63 of the temporary composite image 53 may be generated again. As described in <3> above, the two-dimensional barcode 52N may be reduced as shown in FIG.

  FIG. 18 is a flowchart illustrating an example of the flow of symbol adjustment processing. FIG. 19 is a flowchart illustrating an example of the flow of the movement reduction process.

  Next, the overall processing flow of the image forming apparatus 1 when the above countermeasure is applied will be described with reference to the flowchart shown in FIG.

  As described in steps # 701 to 703 in FIG. 6 and steps # 711 to 713 in FIG. 9, the image forming apparatus 1 acquires the image data 61 of the document image 51 and the image data 62 of the image 52 for superimposition, and temporarily combines them. Image data 63 of the image 53 is generated. In the first embodiment and the second embodiment, a case has been described in which none of the three position detection patterns 52Np of the two-dimensional barcode 52N in the temporary composite image 53 overlaps the object 51J, but at least one overlaps. There is a case.

  Therefore, the image forming apparatus 1 adjusts so that no position detection pattern 52Np overlaps the object 51J during the processing of step # 703 or # 713, that is, when obtaining the temporary composite image 53 (symbol adjustment processing). I do. The symbol adjustment process is performed according to the procedure shown in the flowchart of FIG.

  In the image forming apparatus 1, when the portion that overlaps the object 51J is included in the two-dimensional barcode 52N and only one of the three position detection patterns 52Np overlaps the object 51J (# 721 in FIG. 18). Yes, Yes at # 722, Yes at # 723), the two-dimensional barcode 52N is rotated so that none of the three position detection patterns 52Np overlaps the object 51J (# 724).

  However, if any position detection pattern 52Np overlaps the object 51J even if it is rotated (Yes in # 725), the image forming apparatus 1 executes a movement reduction process (# 726).

  Also, when two or more of the three position detection patterns 52Np overlap the object 51J (Yes in # 721, Yes in # 722, No in # 723), the movement reduction process is executed (# 726).

  The movement reduction process is performed according to the procedure shown in the flowchart of FIG. The image forming apparatus 1 searches for the object 51J around the two-dimensional barcode 52N (# 731). If the object 51J is present in all directions, up, down, left, and right (Yes in # 732), the two-dimensional barcode 52N is reduced (# 735). As a result, a movable area can be secured, and the reduced two-dimensional barcode 52N is appropriately moved so that no position detection pattern 52Np overlaps the object 51J.

  On the other hand, if there is a movable direction (No in # 732), the image forming apparatus 1 moves the two-dimensional barcode 52N in that direction (# 733). At this time, the direction of movement is appropriately changed until no position detection pattern 52Np overlaps the object 51J. Nevertheless, if any position detection pattern 52Np overlaps the object 51J (Yes in # 734), the two-dimensional barcode 52N is reduced (# 735). Then, the reduced two-dimensional barcode 52N is appropriately moved so that no position detection pattern 52Np overlaps the object 51J.

  When the symbol adjustment process is completed, the image forming apparatus 1 executes the processes of steps # 704 to # 709 in FIG. 6 or the processes of steps # 714 to # 719 in FIG.

  However, in step # 706 or # 718, there are cases where the composite images 54 and 55 cannot be obtained so that the character string of the two-dimensional barcode 52N can be determined. In this case, the image forming apparatus 1 reduces the two-dimensional barcode 52N and obtains the composite images 54 and 55 again. Alternatively, the composite images 54 and 55 are obtained again by raising the error correction level of the two-dimensional barcode 52N.

  FIG. 20 is a diagram illustrating an example in which the two-dimensional barcode 52N is moved or divided into a plurality of small two-dimensional barcodes.

  According to the above-described embodiment and modification, it is possible to more suitably add a two-dimensional barcode to a document image than in the past. Moreover, it is not moved to a space away from the two-dimensional barcode (see FIGS. 20A and 20B) or divided into a plurality of small two-dimensional barcodes (FIG. 20A), (See (C)), the two-dimensional barcode is moved, rotated, or reduced as close to the original position as possible. Therefore, it is possible to add a two-dimensional barcode without significantly damaging the layout originally intended by the user.

  According to the embodiment and the modification described above, the document image 51 and the superimposing image 52 are obtained by scanning a sheet. However, it may be acquired by receiving these image data from the terminal device 2. Further, although the composite image is output by printing on paper, the image data of the composite image may be output by being transmitted to another device or recorded on a removable display or the like.

  In the above-described embodiment and modification, each function illustrated in FIGS. 3 and 6 is realized by executing the program by the CPU 10a, but may be realized only by the image processing circuit 10j.

  In the embodiment and the modification described above, the damage rate Rk is obtained by calculating the ratio of the area where the rectangular area inscribed in the object 51JN overlaps the two-dimensional barcode 52N to the entire area of the two-dimensional barcode 52N. However, you may obtain | require by calculating the ratio with respect to the number of the cells of the whole two-dimensional barcode 52N of the number of the cells which become indistinguishable by the colored pixel of the object 51JN.

  In the above-described embodiment and modification, the two-dimensional barcode 52N is appropriately rotated, reduced, or moved, but some editing may not be performed according to a preset restriction. Good. For example, if the setting that the size of the two-dimensional barcode is fixed is made, the two-dimensional barcode 52N may be adjusted by rotation and movement without performing reduction.

  In the above-described embodiment and modification, the QR code is taken as an example of the two-dimensional barcode 52N, but the present invention can also be applied to the case of using a two-dimensional barcode of another standard.

  In addition, the configuration of the entire image forming apparatus 1 or each unit, the processing content, the processing order, the configuration of the document image 51 or the superimposing image 52, and the like can be appropriately changed in accordance with the spirit of the present invention.

1 Image forming device (image processing device)
104 1st two-dimensional barcode analysis part (analysis possibility determination means)
105 preferred composite image generation unit (image generation means)
124 Damage rate calculation unit (analysis availability determination means)
125 Error correction rate detection unit (analysis availability determination means)
126 Analysis availability determination unit (analysis availability determination means)
127 preferred composite image generation unit (image generation means)
51 Original image (first image)
51J object 51JN object 52N Two-dimensional barcode 52Np Position detection pattern (symbol)
54 Composite image (second image)

Claims (12)

An image processing apparatus for generating a second image by overlaying a first image including one or more objects with a two-dimensional barcode including a symbol for specifying its orientation ,
When any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is analyzed even if the two-dimensional barcode is superimposed at the predetermined position. An analysis enable / disable determining means for determining whether or not
When the analysis enable / disable determining unit determines that the two-dimensional barcode cannot be analyzed, while leaving a portion overlapping the object existing at the predetermined position of the one or more objects, An image that generates the second image by rotating, reducing, or changing a relative position with the object, or reducing the object and superimposing the object on the first image. Generating means;
Determining means for determining whether the symbol overlaps any of the one or more objects;
I have a,
The image generation means may prevent the symbol from overlapping any of the one or more objects when the determination means determines that the symbol overlaps any of the one or more objects. Generating the second image by superimposing the two-dimensional barcode on the first image;
An image processing apparatus. The analysis enable / disable determining means determines whether or not the two-dimensional barcode can be analyzed by simulating and analyzing a state in which the two-dimensional barcode is superimposed on the predetermined position.
The image processing apparatus according to claim 1. The image generation means generates the second image by superimposing the two-dimensional barcode on the first image by changing the relative position so that the area of the portion is reduced.
The image processing apparatus according to claim 2. The analysis enable / disable determining unit analyzes the two-dimensional barcode based on an overlapping portion ratio that is a ratio of the area of the portion to an entire area of the two-dimensional barcode and an error correction rate of the two-dimensional barcode. To determine whether or not
The image processing apparatus according to claim 1. The image generating means changes the relative position so that the overlapping portion ratio is less than the error correction rate, and superimposes the two-dimensional barcode on the first image. Generate images,
The image processing apparatus according to claim 4. The image generation means rotates the two-dimensional barcode so that the symbol does not overlap any of the one or a plurality of objects, and if the two-dimensional barcode overlaps even if rotated at any angle Generating the second image by shrinking or moving and overlaying the two-dimensional barcode on the first image;
The image processing apparatus according to claim 1 . An image processing apparatus for generating a second image by overlaying a first image including one or more objects with a two-dimensional barcode including a symbol for specifying its orientation ,
When any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is analyzed even if the two-dimensional barcode is superimposed at the predetermined position. An analysis enable / disable determining means for determining whether or not
When the analysis enable / disable determining unit determines that the two-dimensional barcode cannot be analyzed, while leaving a portion overlapping the object existing at the predetermined position of the one or more objects, An image that generates the second image by rotating, reducing, or changing a relative position with the object, or reducing the object and superimposing the object on the first image. Generating means;
Have,
The image generation means rotates the two-dimensional barcode so that the symbol does not overlap any of the one or a plurality of objects, and if the two-dimensional barcode overlaps even if rotated at any angle Generating the second image by reducing or moving and overlaying the two-dimensional barcode on the first image;
An image processing apparatus. When the four-dimensional barcode is surrounded by the one or more objects, the image generation means reduces the two-dimensional barcode and superimposes the two-dimensional barcode on the first image. Generate an image of
The image processing apparatus according to claim 1. An image generation method for generating a second image by overlaying a first image including one or more objects with a two-dimensional barcode including a symbol for specifying its own orientation ,
When any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is analyzed even if the two-dimensional barcode is superimposed at the predetermined position. To determine whether or not
Determining whether the symbol overlaps any of the one or more objects;
When it is determined that the two-dimensional barcode cannot be analyzed, the two-dimensional barcode is rotated while leaving a portion overlapping the object existing at the predetermined position among the one or more objects. Reducing or changing the relative position of the object or reducing the object, and determining that the symbol overlaps one or more of the objects, Generating the second image by overlaying the two-dimensional barcode on the first image so as not to overlap any of the one or more objects .
An image generation method characterized by the above. An image generation method for generating a second image by overlaying a first image including one or more objects with a two-dimensional barcode including a symbol for specifying its own orientation ,
When any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is analyzed even if the two-dimensional barcode is superimposed at the predetermined position. To determine whether or not
When it is determined that the two-dimensional barcode cannot be analyzed, the two-dimensional barcode is rotated while leaving a portion overlapping the object existing at the predetermined position among the one or more objects. Reduce, or change the position relative to the object or reduce the object, and rotate the two-dimensional barcode so that the symbol does not overlap any of the one or more objects If the two-dimensional barcode overlaps even if rotated at any angle, the second image is generated by further reducing or moving the two-dimensional barcode and overlaying the two-dimensional barcode on the first image. To
An image generation method characterized by the above. A computer program used in a computer for generating a second image by superimposing a two-dimensional barcode including a symbol for specifying its orientation on a first image including one or more objects,
When any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is analyzed even if the two-dimensional barcode is superimposed at the predetermined position. Causing the computer to execute a process of determining whether or not
Causing the computer to execute a process of determining whether the symbol overlaps one of the one or more objects;
When it is determined that the two-dimensional barcode cannot be analyzed, the two-dimensional barcode is rotated while leaving a portion overlapping the object existing at the predetermined position among the one or more objects. Reducing or changing the relative position of the object or reducing the object, and determining that the symbol overlaps one or more of the objects, Causing the computer to execute a process of generating the second image by superimposing the two-dimensional barcode on the first image so as not to overlap any one or more objects .
A computer program characterized by the above. A computer program used in a computer for generating a second image by superimposing a two-dimensional barcode including a symbol for specifying its orientation on a first image including one or more objects,
When any one of the one or more objects exists at a predetermined position where the two-dimensional barcode is superimposed, the two-dimensional barcode is analyzed even if the two-dimensional barcode is superimposed at the predetermined position. Causing the computer to execute a process of determining whether or not
When it is determined that the two-dimensional barcode cannot be analyzed, the two-dimensional barcode is rotated while leaving a portion overlapping the object existing at the predetermined position among the one or more objects. Reduce, or change the position relative to the object or reduce the object, and rotate the two-dimensional barcode so that the symbol does not overlap any of the one or more objects If the two-dimensional barcode overlaps even if rotated at any angle, the second image is generated by further reducing or moving the two-dimensional barcode and overlaying the two-dimensional barcode on the first image. Causing the computer to execute processing to
A computer program characterized by the above.

Images