JP7147530B2 - Reading device, image forming device, authentication system and reading method - Google Patents

Description

The present invention relates to a reader, an image forming apparatus, an authenticity determination system, and a reading method.

In the past, due to the growing awareness of document security, such as guaranteeing the originality of documents and judging their authenticity, we embedded invisible information in documents and read the invisible information with invisible light such as infrared light to guarantee the originality of documents. Invisible reading technology for authenticity determination and forgery prevention is known.

Japanese Patent Application Laid-Open No. 2002-200001 discloses a technique of performing invisible reading with a scanner (reading device) such as a copier and displaying/printing the result.

However, although conventional reading devices can read invisible images (NIR (near infrared) images), they are configured to disclose only the processed results to the user. There was a problem that there was no means to judge the validity of the judgment result.

The present invention has been made in view of the above, and an object of the present invention is to enable a user to judge the validity of the judgment result of the authentication, and to improve the accuracy of the authentication.

In order to solve the above-described problems and achieve the object, the present invention provides a reading device for reading by receiving light from an object illuminated by a light source with an imaging device, and reading the object as a visible image. a control means for controlling a reading operation and a second reading operation for reading the subject with an invisible image; a correcting means for performing a correction such that at least the invisible image for authenticity determination can be identified ; and notification means for notifying the corrected invisible image to the outside.

According to the present invention, by notifying the operator of the invisible image itself (raw data), which is intermediate information, instead of the final judgment result, the user can judge the validity of the judgment result of the authenticity judgment. It is possible to improve the accuracy of authenticity determination.

FIG. 1 is a diagram illustrating an example configuration of an image forming apparatus according to a first embodiment. FIG. 2 is a cross-sectional view exemplifying the structure of the image reading unit. FIG. 3 is a block diagram showing electrical connection of each part constituting the image reading section. FIG. 4 is a flowchart schematically showing the flow of image reading processing. FIG. 5 is a diagram for explaining the action and effect of image reading processing in the image reading unit. FIG. 6 is a block diagram of a configuration of an image notification unit of an image reading unit according to the second embodiment; FIG. 7 is a flowchart schematically showing the flow of image notification processing. FIG. 8 is a block diagram of a configuration of an image correction unit of an image reading unit according to the third embodiment; FIG. 9 is a flowchart schematically showing the flow of image reading processing when there are area extraction processing and variable magnification processing. FIG. 10 is a diagram for explaining actions and effects of image reading processing in the image reading unit. FIG. 11 is a block diagram showing electrical connection of each part constituting the image forming apparatus according to the fourth embodiment. FIG. 12 is a flowchart schematically showing the flow of image reading processing when authenticating a printed image. FIG. 13 is a block diagram of a configuration of an image correction unit of an image reading unit according to the fifth embodiment; FIG. 14 is a diagram schematically showing configurations of an image reading unit and an ADF according to the sixth embodiment; FIG. 15 is a flow chart schematically showing the flow of image reading processing in a configuration using the ADF. FIG. 16 is a diagram illustrating a configuration for integrally notifying a visible image and an invisible (NIR) image in an image reading unit according to the seventh embodiment; FIG. 17 is a flowchart schematically showing the flow of image reading processing when notifying a visible image and an invisible (NIR) image together. FIG. 18 is a block diagram showing electrical connection of each part constituting the image forming apparatus according to the eighth embodiment. FIG. 19 is a flowchart schematically showing the flow of image reading processing when reading a visible image and an invisible (NIR) image at the same time. FIG. 20 is a diagram schematically showing configurations of an image reading unit and an ADF according to the ninth embodiment; FIG. 21 is a block diagram showing electrical connection of each part that constitutes the image forming apparatus. FIG. 22 is a flow chart schematically showing the flow of image reading processing when both visible images on the front and back or an invisible (NIR) image on the front and a visible image on the back are simultaneously read. FIG. 23 is a block diagram of a configuration of an image correction unit of an image reading unit according to the tenth embodiment; FIG. 24 is a flowchart schematically showing the flow of image reading processing when synthesizing a visible image and an NIR image into one image. 25A and 25B are diagrams for explaining actions and effects of image reading processing in the image reading unit. FIG. 26 is a block diagram of a configuration of an image correction unit of an image reading unit according to the eleventh embodiment; 27A and 27B are diagrams for explaining the action and effect of the invisible image contrast adjustment processing in the contrast adjustment unit. 28A and 28B are diagrams for explaining the action and effect of the visible image contrast adjustment processing in the contrast adjustment unit. FIG. 29 is a block diagram of a configuration of an image correction unit of an image reading unit according to the twelfth embodiment; 30A and 30B are diagrams for explaining the action and effect of the line drawing process on the invisible image. FIG. 31 is a flowchart schematically showing the flow of image reading processing including contrast adjustment processing or line drawing processing. FIG. 32 is a block diagram showing the electrical connection of each part constituting the authenticity determination system according to the thirteenth embodiment. 33 is a diagram illustrating a configuration of an image notification unit of an image reading unit according to the fourteenth embodiment; FIG. 34A and 34B are diagrams for explaining the action and effect when the invisible/visible image and the authenticity determination result are notified integrally. FIG. 35 is a block diagram showing the electrical connection of each part constituting the authenticity determination system according to the fifteenth embodiment. FIG. 36 is a diagram for explaining actions and effects when image information is stored in an external storage (cloud). FIG. 37 is a diagram for explaining actions and effects when both visible and invisible images are stored in an external storage (cloud). 38A and 38B are diagrams for explaining actions and effects when an access key to image information is encrypted in the authenticity determination system according to the sixteenth embodiment.

Embodiments of a reader, an image forming apparatus, an authenticity determination system, and a reading method will be described in detail below with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a diagram showing an example configuration of an image forming apparatus 100 according to the first embodiment. In FIG. 1, an image forming apparatus 100 is generally called a multifunction machine having at least two functions out of a copy function, a printer function, a scanner function and a facsimile function.

The image forming apparatus 100 has an image reading section 101 and an ADF (Automatic Document Feeder) 102 which are reading devices, and an image forming section 103 below them. In order to explain the internal configuration of the image forming unit 103, the external cover is removed to show the internal configuration.

The ADF 102 is a document support unit that positions a document, whose image is to be read, at a reading position. The ADF 102 automatically conveys the document placed on the placing table to the reading position. The image reading unit 101 reads a document conveyed by the ADF 102 at a predetermined reading position. Further, the image reading unit 101 has a contact glass as a document supporting portion on which a document is placed on its upper surface, and reads the document on the contact glass as a reading position. Specifically, the image reading unit 101 is a scanner having an internal light source, an optical system, and an image sensor such as a CCD (Charge Coupled Device). .

The image forming unit 103 prints the document image read by the image reading unit 101 . The image forming section 103 has a manual feed roller 104 for manually feeding recording paper, and a recording paper supply unit 107 for supplying recording paper. The recording paper supply unit 107 has a mechanism for feeding recording paper from a multistage recording paper feed cassette 107a. The supplied recording paper is sent to the secondary transfer belt 112 via the registration roller 108 .

The toner image on the intermediate transfer belt 113 is transferred in the transfer unit 114 to the recording paper conveyed on the secondary transfer belt 112 .

The image forming unit 103 includes an optical writing device 109, tandem image forming units (Y, M, C, and K) 105, an intermediate transfer belt 113, the secondary transfer belt 112, and the like. An image written by the optical writing device 109 is formed as a toner image on the intermediate transfer belt 113 by an image forming process by the image forming unit 105 .

Specifically, the image forming unit (Y, M, C, K) 105 has four rotatable photoreceptor drums (Y, M, C, K), and a charging roller is provided around each photoreceptor drum. , a developer, a primary transfer roller, a cleaner unit, and an imaging element 106, which includes an eraser. An image forming element 106 functions on each photoreceptor drum, and an image on the photoreceptor drum is transferred onto an intermediate transfer belt 113 by each primary transfer roller.

The intermediate transfer belt 113 is stretched by a driving roller and a driven roller in a nip between each photosensitive drum and each primary transfer roller. The toner image primarily transferred to the intermediate transfer belt 113 is secondarily transferred onto the recording paper on the secondary transfer belt 112 by the secondary transfer device as the intermediate transfer belt 113 runs. The recording paper is conveyed to the fixing device 110 by running the secondary transfer belt 112, and the toner image is fixed on the recording paper as a color image. After that, the recording paper is discharged to a paper discharge tray outside the machine. In the case of double-sided printing, the reversing mechanism 111 reverses the front and back of the recording paper, and the reversed recording paper is sent onto the secondary transfer belt 112 .

Note that the image forming unit 103 is not limited to forming an image by the electrophotographic method as described above, and may form an image by an inkjet method.

Next, the image reading unit 101 will be described.

FIG. 2 is a cross-sectional view showing an exemplary structure of the image reading unit 101. As shown in FIG. As shown in FIG. 2, the image reading section 101 has a sensor substrate 10 having an image sensor 9 as an imaging element, a lens unit 8, a first carriage 6 and a second carriage 7 inside a main body 11 . The image sensor 9 is, for example, a CCD or CMOS image sensor. The first carriage 6 has a light source 2 which is an LED (Light Emitting Diode) and a mirror 3 . The second carriage 7 has mirrors 4,5. Further, the image reading unit 101 has a contact glass 1 and a reference white plate 13 on its upper surface.

In the reading operation, the image reading unit 101 emits light upward from the light source 2 while moving the first carriage 6 and the second carriage 7 from the standby position (home position) in the sub-scanning direction (direction A). The first carriage 6 and the second carriage 7 form an image of the reflected light from the document 12 on the image sensor 9 via the lens unit 8 .

When the power is turned on, the image reading unit 101 reads reflected light from the reference white plate 13 to set a reference. That is, the image reading unit 101 moves the first carriage 6 directly below the reference white plate 13 , turns on the light source 2 , and forms an image of the reflected light from the reference white plate 13 on the image sensor 9 to perform gain adjustment. conduct.

FIG. 3 is a block diagram showing the electrical connection of each part forming the image reading unit 101. As shown in FIG. As shown in FIG. 3, the image reading unit 101 includes, in addition to the image sensor 9 and the light source 2 described above, a signal processing unit 21, an image correction unit 22 functioning as correction means, a control unit 23 functioning as control means, and a light source driving unit. It includes a section 24, an image notification section 25 functioning as notification means, and an image notification control section 26 functioning as notification control means.

The light source 2 is configured for visible/near infrared (NIR). The light source driving section 24 drives the light source 2 .

The image sensor 9 reads reflected light from an object and outputs RGB signals when reading a visible image, and outputs NIR signals when reading an invisible image. Since the color filter of a general image sensor has the characteristic of transmitting NIR light, NIR signals appear in each of the RGB outputs when reading an invisible image. In the present embodiment, for the sake of explanation, the R-output NIR signal is used.

The signal processing section 21 has a gain control section (amplifier), an offset control section, and an A/D conversion section (AD converter). The signal processing unit 21 performs gain control, offset control, and A/D conversion on the image signal (RGB) output from the image sensor 9, converts it into digital data, and outputs it to the image correction unit 22 in the subsequent stage. do.

The image correction unit 22 performs various corrections including shading correction, and outputs corrected data to the image notification unit 25 .

The image notification unit 25 outputs the image to a display or the like so that the operator can easily check the image.

The image notification control unit 26 controls image notification conditions for the image notification unit 25 according to externally designated notification conditions and the like.

The control unit 23 selectively controls the visible image mode or the invisible (NIR) image mode, and controls the light source driving unit 24, the image sensor 9, the signal processing unit 21, the image correction unit 22, and the image notification control unit 26. Control settings. The control unit 23 selectively controls a visible image mode (first reading operation) or an invisible (NIR) image mode (second reading operation), and controls settings of each unit according to the mode.

Next, the flow of image reading processing controlled by the control unit 23 will be described. The image reading operation controlled by the control unit 23 is controlled to switch various settings depending on whether the visible image mode or the NIR image mode is selected. The control to be switched is image sensor mode (for visible/NIR), signal processing mode (for visible/NIR), light source mode (visible light/NIR light), and image correction (for visible/NIR).

FIG. 4 is a flowchart schematically showing the flow of image reading processing. As shown in FIG. 4, the controller 23 first determines whether the visible image mode is specified (step S1).

If the visible image mode is specified (Yes in step S1), the control unit 23 proceeds to step S2. In step S2, the controller 23 switches the mode of the image sensor 9 to the "visible mode".

Next, the control unit 23 switches the mode of the signal processing unit 21 to the “visible mode” (step S3), switches the mode of the light source 2 to the “visible mode” (step S4), and sets the image correction unit 22 is executed to set the "visible mode" (step S5).

After that, in step S6, the control unit 23 executes image reading.

In the following step S7, the control section 23 causes the image notification section 25 to display the read image on the display.

On the other hand, when the NIR image mode is designated (No in step S1), the control unit 23 proceeds to step S8. In step S8, the controller 23 switches the mode of the image sensor 9 to the "NIR mode".

Next, the control unit 23 switches the mode of the signal processing unit 21 to the "NIR mode" (step S9), switches the mode of the light source 2 to the "NIR mode" (step S10), and sets the image correction unit 22 to switch the mode to the "NIR mode" (step S11).

After that, in step S6, the control unit 23 executes image reading.

In the following step S7, the control section 23 causes the image notification section 25 to display the read image on the display.

That is, in the image reading process of the present embodiment, reading of the target document is started after setting each mode, and the image read in either the visible image mode or the NIR image mode is displayed on the display.

For example, in the case of the visible image mode, it is used to confirm the content (information) written in the document. On the other hand, the NIR image mode is used when authenticating a document.

As described above, by switching the light emission of the light source between the visible reading and the NIR reading, the visible image and the invisible image can be selectively read, and the authentication can be determined by reading the invisible image.

Next, functions and effects of image reading processing in the image reading unit 101 will be described.

In recent years, technology for embedding invisible information (latent image) has enabled invisible information to be embedded not only in identification cards but also in various documents such as seal registration forms, resident cards, and tax payment certificates. This enhances document security. The embedding of invisible information is designed so that, for example, when the document is copied by a copier, the embedded information disappears.

Here, FIG. 5 is a diagram for explaining actions and effects of image reading processing in the image reading unit 101. FIG. FIG. 5A shows an example of a certificate (original) as a document in which invisible (NIR) information is embedded. The net information of the certificate (certification content, identification number, issue date, issuer, etc.) is printed as visible information. On the other hand, in the lower right part of the certificate, the character "correct" surrounded by a circle is embedded as invisible information so that it cannot be visually recognized. This invisible information functions as an authenticity determination mark, and authenticity is determined based on the presence or absence of this mark.

FIG. 5(b) shows an image obtained by scanning the certificate of FIG. 5(a) in visible image mode. In visual image mode, the visual information on the certificate is read and the operator can verify the net information contained in the certificate. However, since the invisible information "correct" is printed as invisible information, the information disappears without being read on the image.

On the other hand, FIG. 5(c) shows an image obtained by reading the certificate of FIG. 5(a) in the NIR image mode. In the NIR image mode, in contrast to the visible image mode, the visible information, which is the net information of the certificate, is not read, but only the characters of "correct", which is the invisible information, are read, and the operator is written on the certificate. The authenticity judgment mark can be confirmed. At this time, if the certificate is genuine or original, the authenticity judgment mark is read, so it is judged to be genuine (genuine). It is judged as a counterfeit (counterfeit) because it cannot be seen.

As described above, according to the present embodiment, not the final judgment result, but the NIR image itself (raw data), which is intermediate information, is notified to the operator side. can be determined by the user.

The invisible embedding technology may be one using visible colorants (CMYK) or one using invisible ink (transparent in the visible range, absorbing in the NIR range). Any method may be used.

In addition, in the present embodiment, image reading in the NIR (near infrared) region is described as an example of invisible reading. It is known that the Si image sensor 9 itself also has quantum sensitivity. Therefore, by using this wavelength region, it can be used in a highly sensitive state, and invisible reading can be performed efficiently.

In the conventional reader, it is difficult to improve the accuracy of authenticity determination because only the final result of analyzing the read NIR image is notified to the operator. According to this embodiment, not the final result but the NIR image itself (raw data), which is intermediate information, is notified to the operator side, so that the user can judge the validity of the judgment result of the authenticity judgment. can be done.

Further, according to the present embodiment, since the second reading operation is a reading operation in the infrared region, invisible reading can be efficiently performed.

(Second embodiment)
Next, a second embodiment will be described.

The image reading unit 101 of the second embodiment differs from the first embodiment in that the accuracy of authenticity determination is enhanced by storing images. Hereinafter, in the description of the second embodiment, the description of the same portions as those of the first embodiment will be omitted, and the portions different from those of the first embodiment will be described.

In the first embodiment, the user can judge the validity of the result of authenticity determination by human judgment (eyes). Yes, it is not suitable for checking by multiple people.

Therefore, in the second embodiment, the accuracy of authenticity determination is improved by notifying the user after temporarily storing the NIR image used for authenticity determination.

FIG. 6 is a block diagram showing the configuration of the image notification section 25 of the image reading section 101 according to the second embodiment. As shown in FIG. 6A, the image notification unit 25 displays the input image in real time, and the operator A judges the authenticity of the image, which is the same as in the first embodiment. In addition, the image notification unit 25 shown in FIG. 6A includes an image storage unit 25a functioning as storage means for temporarily storing the read invisible image.

With such a configuration, when the operator B performs authenticity determination, the operator B issues a notification instruction to the image notification control unit 26, calls up the image stored in the image storage unit 25a at the timing of the notification instruction, and displays the image on the operator B side. to notify.

The image notification unit 25 shown in FIG. 6B includes an image storage unit 25b that functions as storage means for storing the read invisible image.

With such a configuration, when the operators A and B perform authenticity determination, both the operators A and B instruct the image notification control unit 26 to notify, and the image is stored in the image storage unit 25b at the timing of the notification instruction. This image is called up and notified to the operators A and B side.

As described above, by configuring the read NIR image to be temporarily stored and then notified, it is possible to determine authenticity at any timing, and multiple checks such as authenticity determination by multiple people can be performed. Therefore, accuracy of authenticity determination can be improved.

FIG. 7 is a flowchart schematically showing the flow of image notification processing. As shown in FIG. 7, when retrieving an image from the image storage unit, the image notification control unit 26 first confirms whether or not there is an image notification instruction from the operator (step S21).

When the image notification control unit 26 determines that there is an image notification instruction (Yes in step S21), it calls up the NIR image from the image storage units 25a and 25b (step S22), and notifies (displays) the image on the display (step S23). . After that, the operator performs authenticity determination using the NIR image.

As described above, according to the present embodiment, it is possible to improve accuracy of authenticity determination by multiple checks by multiple people or multiple times.

(Third Embodiment)
Next, a third embodiment will be described.

The image reading unit 101 of the third embodiment differs from the first and second embodiments in that it facilitates authenticity determination regardless of the embedding position of invisible information. Hereinafter, in the description of the third embodiment, the description of the same parts as those in the first to second embodiments will be omitted, and the parts different from those in the first to second embodiments will be omitted. I will explain the parts.

As described in the first embodiment, when reading invisible embedded information in various media including general documents, there are cases where the position of the invisible embedded information is known. There are cases where it is not known whether or not there is.

Therefore, in this embodiment, by changing the image notification method depending on whether the position of the invisible information is known or unknown, the authentication can be easily determined regardless of whether the position of the invisible information is known or unknown.

FIG. 8 is a block diagram showing the configuration of the image correction section 22 of the image reading section 101 according to the third embodiment. As shown in FIG. 8 , the image correction section 22 includes an area extraction section 31 and a scaling section 32 .

The area extracting section 31 extracts an image area specified in a mode determined by an external instruction. A scaling unit 32 scales the image area extracted by the area extracting unit 31 . Enlargement, reduction, and equal magnification (no magnification change) can be selected for the magnification change, but enlargement and equal magnification are used substantially for authenticity determination. A variable magnification condition is also specified in the mode determined by the external instruction.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 9 is a flowchart schematically showing the flow of image reading processing when there are area extraction processing and variable magnification processing. Note that the processing of steps S1 to S11 is the same as the processing described with reference to FIG. 4, so description thereof will be omitted. The difference from the flowchart explained in FIG. 4 is that the area extraction process and the variable magnification process are included between the reading process (step S6) and the image notification process (step S7).

After reading the image (step S6), the control unit 23 determines whether the image is partially displayed (step S21).

When the control unit 23 determines that the display is partial (Yes in step S21), the control unit 23 controls the image correction unit 22 to perform area extraction (specified area) and variable magnification (enlargement) (step S22). For example, when the position of the invisible information is known, only a part of the image is required, so the corresponding area of the image is extracted and enlarged for display.

On the other hand, when the control unit 23 determines that the partial display is not performed (No in step S21), the control unit 23 controls the image correction unit 22 to perform region extraction (whole) and variable magnification (same size) (step S23). For example, when the position of the invisible information is unknown, it is necessary to find the invisible information from the entire image, so the entire image is displayed at the same size as the extraction target.

10A and 10B are diagrams for explaining the action and effect of image reading processing in the image reading unit 101. FIG. FIG. 10(a) shows an example of a document (original) in which invisible (NIR) information is embedded. The net information of the certificate (certification content, identification number, issue date, issuer, etc.) is printed as visible information. On the other hand, in the lower right part of the certificate, the character "correct" surrounded by a circle is embedded as invisible information, so that it cannot be recognized by the naked eye. This invisible information functions as an authenticity determination mark, and authenticity is determined based on the presence or absence of this mark.

FIG. 10(b) shows an example in which the position of invisible information is unknown. In this case, since the operator does not know the position of the invisible information, it is necessary to find where the authenticity determination mark is located in the image. Therefore, by displaying the entire image as an extraction target at the same size, the invisible information can be easily found from the entire image, thereby facilitating authenticity determination.

On the other hand, FIG. 10(c) shows an example in which the position of the invisible information is known. In this case, since the operator knows where the invisible information is located, there is no need to search for where the authenticity determination mark is located in the image. However, if the pattern of the authenticity determination mark is complicated, it is necessary to examine the pattern closely (Fig. 10(c) shows an example in which the circle marks are not continuous lines but chain lines). Therefore, by extracting only the relevant area of the image and displaying that part in an enlarged manner, it is possible to identify complicated patterns and facilitate authenticity determination.

As described above, according to the present embodiment, it is possible to easily determine authenticity even when the printing location of the invisible embedded information is unknown.

Further, even when a fine pattern of invisible embedded information is determined, authenticity determination can be facilitated.

(Fourth embodiment)
Next, a fourth embodiment will be described.

The image forming apparatus 100 of the fourth embodiment differs from the first to third embodiments in that it is configured to perform authenticity determination on a printed image. Hereinafter, in the description of the fourth embodiment, the description of the same parts as those of the first to third embodiments will be omitted, and the parts different from those of the first to third embodiments will be omitted. I will explain the parts.

So far, we have discussed displaying the scanned NIR image on a display to determine authenticity. There is a problem that image handling for authenticity determination is not practical, such as the need to prepare a stand.

Therefore, in the present embodiment, a printed image obtained by printing a read NIR image is used for authentication judgment, thereby improving handling of the image and further facilitating authenticity judgment.

FIG. 11 is a block diagram showing electrical connection of each part constituting the image forming apparatus 100 according to the fourth embodiment. FIG. 11(a) shows electrical connection of each part constituting the image forming apparatus 100. FIG. 3 described in the first embodiment is different in that the image notification unit 25 notifies by a printed image (paper medium) via the image forming unit 103 instead of the display display.

FIG. 11B is a block diagram showing an example of the configuration of the image notification section 25. As shown in FIG. As shown in FIG. 11B, the image notification section 25 includes an image printing section 25c. The image printing unit 25 c prints the input image by the image forming unit 103 under the control of the image notification control unit 26 .

According to the present embodiment, when authenticity determination is performed using a printed image, multiple checks can be performed simply by handing over the printed image even when a plurality of people check the printed image. In addition, since the printed image itself serves as evidence (basis for judgment), it is sufficient to hand over the printed image as it is even in the case where the customer requests the evidence.

FIG. 11C is a block diagram showing another example of the configuration of the image notification section 25. As shown in FIG. As shown in FIG. 11C, the image notification section 25 includes an image printing section 25d and an image storage section 25a. The image printing unit 25 d prints the input invisible image by the image forming unit 103 under the control of the image notification control unit 26 . The fact that the operator determines the authenticity of the printed image is the same as in FIG. 11B, and this facilitates multiple checks as described above.

Further, the image storage unit 25a stores the inputted invisible image at the same time as printing. As a result, the invisible image stored in the image storage unit 25a can be displayed on the display at an arbitrary timing, so that another operator can judge the authenticity of the image. In this case, the operator may judge authenticity based on both the printed image and the display, and the printed image may be handed over to the customer as evidence.

FIG. 12 is a flowchart schematically showing the flow of image reading processing when authenticating a printed image. Note that the processing of steps S1 to S6, steps S8 to S11, and steps S21 to S23 is the same as the processing described with reference to FIG. 9, so description thereof will be omitted. The difference from the flowchart explained in FIG. 9 is that the image notification (display) (step S7) is changed to the image notification (printing) (step S31).

As described above, according to the present embodiment, it is possible to easily perform multiple checks for authenticity determination.

(Fifth embodiment)
Next, a fifth embodiment will be described.

The image reading unit 101 of the fifth embodiment differs from the first to fourth embodiments in that the invisible (NIR) image is monochromeized. Hereinafter, in the description of the fifth embodiment, the description of the same parts as those of the first to fourth embodiments will be omitted, and the parts different from those of the first to fourth embodiments will be omitted. I will explain the parts.

Up to now, the explanation has been given with a configuration that uses RGB even for invisible images, but since NIR images do not have the concept of color in the first place, it is more natural to treat them as monochrome data. In addition, handling the NIR image as a color image causes problems such as an increase in file size and a problem of slow display in the image notification unit 25 .

Therefore, in the present embodiment, by converting the invisible image into monochrome image data, the image file size is minimized and image notification is speeded up.

FIG. 13 is a block diagram showing the configuration of the image correction section 22 of the image reading section 101 according to the fifth embodiment. As shown in FIG. 13A, the image correction section 22 includes a monochrome conversion section 41 and a selector (SEL) 42 in addition to an area extraction section 31 and a scaling section 32 .

The monochrome conversion unit 41 converts RGB data into monochrome data.

A selector 42 selects between the RGB data and the converted monochrome data. More specifically, the selector 42 is controlled by the controller 23 to select either RGB data or monochrome data according to an external instruction.

FIG. 13(b) shows the image path for the NIR image mode. As shown in FIG. 13B, in the case of the NIR image mode, the monochrome conversion unit 41 is enabled, and the subsequent selector 42 selects monochrome data (NIR image). After the selector 42, the data is sent as monochrome data (single-channel data), and the file size of the image can be reduced to about 1/3 of that of the RGB image. In addition, since the file size is reduced, the time required for the image notification unit 25 to notify the image to the outside is shortened, and the speed of notification can be increased.

As described above, according to the present embodiment, by making the invisible image monochrome, it is possible to perform image notification to the outside at high speed or at low cost.

(Sixth embodiment)
Next, a sixth embodiment will be described.

The image forming apparatus 100 of the sixth embodiment differs from the first to fifth embodiments in that it is configured to increase the productivity of authenticity determination. Hereinafter, in the description of the sixth embodiment, the description of the same parts as those of the first to fifth embodiments will be omitted, and the parts different from those of the first to fifth embodiments will be omitted. I will explain the parts.

Image forming apparatus 100 of the present embodiment has ADF 102 that continuously conveys a plurality of originals to a reading position. By combining the image reading unit 101 and the ADF 102, it is possible to increase the productivity of authenticity determination.

FIG. 14 is a diagram schematically showing configurations of an image reading unit 101 and an ADF 102 according to the sixth embodiment. Since the configuration of the image reading unit 101 is the same as that of FIG. 2, the description is omitted.

ADF 102 feeds a plurality of documents 12 placed on document tray 51 one by one to transport path 53 by pickup roller 52 . The document 12 sent to the transport path 53 has an image read by the image reading unit 101 at the scanner reading position (light source irradiation position) 54 . Here, the reading position 54 is a position where the light from the light source 2 is irradiated. The document 12 whose image has been read is output to the discharge tray 55 . The above operation is continuously performed until all the originals 12 are discharged. As described above, by using the ADF 102 even when there are a plurality of documents, it is possible to increase the productivity of reading, that is, the productivity of authenticity determination.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 15 is a flowchart schematically showing the flow of image reading processing in a configuration using the ADF 102. As shown in FIG. Note that the processes of steps S1 to S6, steps S8 to S11, steps S21 to S23, and step S31 are the same as those described with reference to FIG. 12, so description thereof will be omitted. The difference from the flowchart described in FIG. 12 is that a branch (step S41) is added to determine whether or not all originals (documents) have been read after image notification.

When the control unit 23 determines that reading of all originals (documents) has been completed (Yes in step S41), it ends the reading operation and proceeds to step S21. On the other hand, if the control unit 23 determines that reading of all originals (documents) has not been completed (No in step S41), the process returns to step S6 to perform reading again, and reading of all originals (documents) is completed. Read operation is performed until It should be noted that the reading in step S6 includes the operation of conveying the original (document) by the ADF 102 .

Further, in FIG. 15, the image notification is performed after all reading is completed, but the configuration is not limited to this, and the image notification may be performed for each reading.

As described above, according to the present embodiment, it is possible to improve the productivity of authenticity determination.

(Seventh embodiment)
Next, a seventh embodiment will be described.

The image reading unit 101 of the seventh embodiment differs from the first to sixth embodiments in that it is configured to integrally notify a visible image and an invisible (NIR) image. Hereinafter, in the description of the seventh embodiment, the description of the same parts as those of the first to sixth embodiments will be omitted, and the parts different from those of the first to sixth embodiments will be omitted. I will explain the parts.

Until now, only invisible images have been used for authenticity determination, but invisible images are used only for authenticity determination, and it is not always possible to identify individual documents. For example, in a case where an image output from the image notification unit 25 is stored as evidence (both paper and electronic data) for confirmation at a later date, individual identification of the evidence cannot be performed. , there arises a problem that the operator does not know which document has been authenticated.

Therefore, in the present embodiment, the visible image and the NIR image are collectively notified so that the operator can know which document has been authenticated.

FIG. 16 is a diagram illustrating a configuration for integrally notifying a visible image and an invisible (NIR) image in the image reading unit 101 according to the seventh embodiment.

FIG. 16 is a block diagram showing the configuration of the image notification unit 25. As shown in FIG. The image notification unit 25 shown in FIG. 16 serially connects the image storage unit 25b shown in FIG. 6B and the image printing unit 25e. The image storage unit 25b stores a visible image (RGB) and an NIR image input at arbitrary timing, and outputs the visible image and the NIR image to the image printing unit 25e when the two images are ready.

The image printing unit 25e prints the visible image and the NIR image with the image forming unit 103 and notifies the outside. Also, the image output from the image storage unit 25b is output for display and notified to the outside as a display image in the same manner as described with reference to FIG. 11(c).

FIG. 16(b) shows an example of an image output from the image notification section 25. As shown in FIG. The output from the image notification unit 25 consists of a visible image for individual identification and an invisible image for authenticity determination, which are integrally printed or displayed on a display. By integrally notifying the invisible image for authenticity determination and the individual identification information in this way, it is possible to improve the function as evidence and facilitate information management. Also, when outputting as a print image from the image notification unit 25, as shown in FIG. 16C, the front side is printed as a visible image and the back side is printed as an invisible image, thereby physically managing it as one piece of evidence. information management can be further facilitated.

Note that the visible image and the invisible image do not necessarily have to be read at the same time. For example, the invisible image may be read after the visible image is read (or vice versa). However, considering the actual operation of adding individual identification information to evidence, it is desirable that the time difference between visible reading and invisible reading is as small as possible.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 17 is a flowchart schematically showing the flow of image reading processing when notifying a visible image and an invisible (NIR) image together. Note that the processes of steps S2 to S5, steps S8 to S11, steps S21 to S23, steps S31, and S41 are the same as those described with reference to FIG. 15, and thus description thereof is omitted. The difference from the flowchart described in FIG. 15 is that visible image reading and invisible image reading are sequentially performed, and the visible/invisible image integrated mode is employed.

As shown in FIG. 17, the control unit 23 first determines whether the visible/invisible image combination mode is specified (step S51).

If the visible/invisible image combination mode is specified (Yes in step S51), the control unit 23 executes the reading of the visible image after executing the processes of steps S2 to S5 (step S52). After executing the processes of steps S8 to S11, the control unit 23 reads the invisible image (step S53).

If the visible/invisible image combination mode is not specified (No in step S51), the control unit 23 selects the visible/invisible image mode, and proceeds to the image reading flow shown in FIG.

Although FIG. 17 shows an example in which the invisible image is read after the visible image is read, the order may be reversed. In addition, although FIG. 17 shows a configuration in which image notification is performed after the visible/invisible image is read, the configuration is not limited to this, and image notification may be performed for each reading.

As described above, according to the present embodiment, the image notification unit 25 inputs the corrected visible image and the invisible image, and notifies the visible image and the invisible image integrally. Easy to manage.

Further, according to the present embodiment, the image notification unit 25 prints the visible image and the invisible image on the first surface and the second surface of the print image, respectively, and thereby performs information management for authenticity determination. It can be made even easier.

(Eighth embodiment)
Next, an eighth embodiment will be described.

The image forming apparatus 100 of the eighth embodiment differs from the first to seventh embodiments in that it is configured to simultaneously read a visible image and an invisible (NIR) image. Hereinafter, in the description of the eighth embodiment, the description of the same parts as those of the first to seventh embodiments will be omitted, and the parts different from those of the first to seventh embodiments will be omitted. I will explain the parts.

In the seventh embodiment, a visible image and an invisible (NIR) image are sequentially read, and the results are notified integrally. There is a problem that the operation (instruction) for reading is complicated.

Therefore, in this embodiment, the operability for the operator is improved by adopting a configuration in which the visible image and the NIR image are read at the same time.

FIG. 18 is a block diagram showing electrical connection of each part constituting the image forming apparatus 100 according to the eighth embodiment. FIG. 18(a) shows a configuration for simultaneously reading a visible image and an NIR image. In the configuration shown in FIG. 3, the image sensor 9 outputs either RGB or NIR image signals. On the other hand, in the image forming apparatus 100 shown in FIG. 18A, the image sensor 9 reads the reflected light from the subject and outputs the RGB image signal and the NIR image signal at once.

The RGB image signal and the NIR image signal output from the image sensor 9 are output to the image notification section 25 via the signal processing section 21 and the image correction section 22 .

FIG. 18B is a diagram showing the configuration of the image sensor 9. As shown in FIG. As shown in FIG. 18(b), the image sensor 9 has NIR pixel rows in addition to RGB pixel rows so that RGB and NIR images can be read at once.

FIG. 18C is a diagram showing the configuration of the image notification unit 25. As shown in FIG. As shown in FIG. 18(c), the RGB image signal and the NIR image signal are input to the image storage unit 25b at once.

As described above, the operability for the operator can be improved by adopting a configuration in which the visible image and the NIR image are read at the same time.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 19 is a flowchart schematically showing the flow of image reading processing when reading a visible image and an invisible (NIR) image at the same time. Note that the processing of steps S21 to S23, step S31, step S41, and step S51 is the same as the processing described with reference to FIG. 17, so description thereof will be omitted. The difference from the flowchart described in FIG. 17 is that when the visible/invisible image combination mode is selected, each setting of the image sensor 9, the signal processing unit 21, the light source 2, and the image correction unit 22 is changed to the visible (RGB) image and the invisible image. (NIR) images are set to be read at the same time.

As shown in FIG. 19, when the visible/invisible image combination mode is designated (Yes in step S51), the control unit 23 proceeds to step S61. In step S61, the control unit 23 switches the mode of the image sensor 9 to the "visible & NIR mode".

Next, the control unit 23 switches the mode of the signal processing unit 21 to the “visible & NIR mode” (step S62), switches the mode of the light source 2 to the “visible & NIR mode” (step S63), The mode switching of the correction unit 22 is executed to set the "visible & NIR mode" (step S64).

After that, in step S65, the control unit 23 simultaneously reads the visible (RGB) image and the invisible (NIR) image.

As described above, according to the present embodiment, it is possible to improve the productivity of authenticity determination while facilitating information management.

(Ninth embodiment)
Next, a ninth embodiment will be described.

The image forming apparatus 100 of the ninth embodiment differs from the first to eighth embodiments in that it is configured to simultaneously read both visible and invisible (NIR) images on the front and back. Hereinafter, in the description of the ninth embodiment, the description of the same parts as those of the first to eighth embodiments will be omitted, and the parts different from those of the first to eighth embodiments will be omitted. I will explain the parts.

In the eighth embodiment, by using the image sensor 9 with an additional NIR pixel row, a configuration is shown in which a visible image and an invisible (NIR) image are read simultaneously. However, in this case, it can be handled only when the visible image and the NIR image are on the same surface. Unreadable.

Therefore, in the present embodiment, the NIR image is read from the front side and the visible image is read from the back side, so that even if the visible image and the NIR image are not on the same side, they can be read at the same time.

FIG. 20 is a diagram schematically showing configurations of an image reading unit 101 and an ADF 102 according to the ninth embodiment. The ADF 102 is different from the ADF 102 shown in FIG. 14 in that it has a one-pass transport path 53 and has a contact-image-sensor (CIS) 61 in the transport path 53 . Here, it is assumed that the image reading unit 101 side has the visible image mode and the NIR image mode, and the CIS 61 side of the ADF 102 has only the visible image mode.

ADF 102 feeds a plurality of documents 12 placed on document tray 51 one by one to transport path 53 by pickup roller 52 . The NIR image of the surface of the document 12 sent to the transport path 53 is read by the image reading section 101 at the scanner reading position (light source irradiation position) 54 . After that, the document 12 is conveyed toward the discharge tray 55 . The RGB image of the back surface of the document 12 conveyed toward the paper discharge tray 55 is read by the CIS 61 located in the middle of the conveying path 53 .

As described above, the NIR image is read from the front side and the visible image is read from the back side, so that the visible image and the NIR image can be read at the same time even if the visible image and the NIR image are not on the same side.

In FIG. 20, the image reading unit 101 reads the NIR image and the CIS 61 reads the RGB image, but the relationship may be reversed. Further, the CIS 61 may be a reduction optical system for reading, or conversely, the reduction optical system on the image reading unit 101 side may be the CIS.

FIG. 21 is a block diagram showing the electrical connection of each part forming the image forming apparatus 100. As shown in FIG. FIG. 21(a) shows a configuration for simultaneously reading visible images on the front and back, or an invisible (NIR) image on the front and a visible image on the back. The difference from the configuration shown in FIG. 18 is that a CIS 61 (light source is visible light) for reading the back side of the document is added to the configuration (the light source 2 and the image sensor 9) for reading the front side of the document.

CIS 61 is controlled by control unit 23 and light source driving unit 24 . That is, the operation of the CIS 61 is controlled according to the image mode.

The output of the CIS 61 is only a visible image, which is an RGB output. The RGB (NIR) image on the image reading unit 101 side and the RGB image on the CIS 61 side are output to the image notification unit 25 via the signal processing unit 21 and the image correction unit 22, respectively.

FIG. 21B is a diagram showing the configuration of the image notification unit 25. As shown in FIG. As shown in FIG. 21B, the RGB (NIR) image signal for the front side and the RGB image signal for the back side are input to the image storage unit 25b at once. In this case, the RGB image of the back surface and the NIR image of the front surface are output from the image storage unit 25b and printed or displayed on the display.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 22 is a flow chart schematically showing the flow of image reading processing when both visible images on the front and back or an invisible (NIR) image on the front and a visible image on the back are simultaneously read. Note that the processing of steps S8 to S11, steps S21 to S23, step S31, step S41, step S51, and step S53 is the same as the processing described with reference to FIG. 17, and thus description thereof will be omitted. The difference from the flowchart explained in FIG. 17 is that the visible image reading and the invisible image reading are executed in parallel, and the visible/invisible image combined mode is employed.

As shown in FIG. 22, when the visible/invisible image combination mode is specified (Yes in step S51), the control unit 23 reads the invisible image on the front surface of the document after executing the processes in steps S8 to S11. Execute (step S53).

At the same time, if the visible/invisible image combination mode is specified (Yes in step S51), the control unit 23 sets the CIS 61 to the visible (RGB) setting for the back side of the document (step S71). is read (step S72).

Note that there is no particular limitation on the timing relationship between front side reading (NIR) and back side reading (RGB).

As described above, according to the present embodiment, even when visible information and invisible information are on different sides, information management can be facilitated, and the productivity of authenticity determination can be increased.

(Tenth embodiment)
Next, a tenth embodiment will be described.

The image reading unit 101 of the tenth embodiment is different from the first to ninth embodiments in that it synthesizes a visible image and an NIR image into one image. Hereinafter, in the description of the tenth embodiment, the description of the same parts as those of the first to ninth embodiments will be omitted, and the parts different from those of the first to ninth embodiments will be omitted. I will explain the parts.

In the eighth embodiment and the ninth embodiment, a configuration is shown in which the visible image and the NIR image are notified integrally. There is a problem that it takes time to be

Therefore, in the present embodiment, the visible image and the NIR image are combined into one image (frame) to shorten the image notification time.

FIG. 23 is a block diagram showing the configuration of the image correction section 22 of the image reading section 101 according to the tenth embodiment. As shown in FIG. 23A, the image correction unit 22 includes an area extracting unit 31, a scaling unit 32, a monochrome converting unit 41, a selector (SEL) 42, and an image synthesizing unit that functions as synthesizing means. A portion 71 is provided.

For example, when an external instruction is received to integrally notify the front and back visible images and NIR images, the control unit 23 enables image synthesis in the image synthesis unit 71 . The image synthesizing unit 71 synthesizes the visible image and the NIR image into one image (frame) under the control of the control unit 23 .

FIG. 23(b) shows effective image paths when synthesizing a visible image and an NIR image into one image (frame). As shown in FIG. 23B, when the visible image and the NIR image are synthesized into one image (frame), the image synthesizing unit 71 converts the NIR image included in the front side read image through the monochrome conversion unit 41. get. On the other hand, the image synthesizing unit 71 obtains the RGB image, which is the read image on the back side, as it is.

The image synthesizing unit 71 synthesizes the input NIR image and RGB image to generate a new RGB image. The image synthesizing section 71 outputs the generated RGB image to the subsequent image notification section 25 via the area extracting section 31 and the scaling section 32 . At this time, when viewed from the image notification unit 25 in the subsequent stage, only the RGB image is notified (not shown). In this case, only RGB images need to be notified, and the operation of the image notification unit 25 is basically unchanged. It should be noted that the invalid RGB image path output from the image synthesizing unit 71 is a path for outputting front and back images of visible images.

As described above, by synthesizing the visible image and the NIR image into one image (frame), the image notification time can be shortened and speeded up.

In this embodiment, a case is described in which region extraction and scaling are performed after image synthesis, but image synthesis may be performed after region extraction and scaling.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 24 is a flowchart schematically showing the flow of image reading processing when synthesizing a visible image and an NIR image into one image. Note that the processing of steps S8 to S11, steps S21 to S23, steps S31, steps S41, steps S51, steps S53, and steps S71 to S72 is the same as the processing described with reference to FIG. 22, so description thereof is omitted. do. The difference from the flowchart described in FIG. 22 is that whether or not to combine the visible image and the invisible image after reading is completed is added.

As shown in FIG. 24, when the control unit 23 determines that reading of all originals (documents) is completed (Yes in step S41), it determines whether to enable image composition in the image composition unit 71 (step S81). ). When the control unit 23 receives an external instruction to integrally notify the front and back visible images and the NIR images, the control unit 23 determines to enable image composition in the image composition unit 71 (Yes in step S81), and the image composition unit 71 to enable image synthesis in (step S82).

On the other hand, if the control unit 23 has not received an external instruction to integrally notify the front and back visible images and the NIR images, it determines that the image synthesis in the image synthesis unit 71 is not enabled (No in step S81), The image composition in the image composition section 71 is disabled (step S83).

Here, FIGS. 25A and 25B are diagrams for explaining actions and effects of image reading processing in the image reading unit 101. FIG. FIG. 25(a) is an example of a visible image (RGB) and an invisible image (NIR) input to the image synthesizing section 71. FIG.

FIG. 25(b) is an example of a composite image. The example shown in FIG. 25(b) is an example in which the RGB image is overwritten with an enlarged authenticity mark of the NIR image, and the NIR image portion is treated as a black and white pattern. By synthesizing the RGB image and the NIR image into a single image of the same surface in this manner, the data volume handled by the image notification unit 25 can be reduced, so that image notification can be speeded up.

Also, FIG. 25(c) is another example of a composite image. The example shown in FIG. 25(c) is an example in which the NIR image authenticity mark is combined with the blank area of the RGB image, and the NIR image portion is treated as a black and white image as in FIG. 25(b). By laying out and synthesizing the NIR image in an area different from the area where the context of the RGB image exists in this way, it is possible to speed up the image notification while maintaining the visibility of the visible information.

In the present embodiment, the NIR image portion is treated as a black and white image, but the visibility of the invisible information can be improved by synthesizing the image with a color different from that of the visible image.

As described above, according to the present embodiment, image notification to the outside can be performed at high speed while facilitating information management.

Further, according to the present embodiment, the visibility of visible information can be maintained by laying out the visible image and the invisible image in separate areas on the same surface.

Furthermore, according to this embodiment, the visibility of invisible information can be improved by making the color of the invisible image different from that of the visible image.

(Eleventh embodiment)
Next, an eleventh embodiment will be described.

The image reading unit 101 of the eleventh embodiment differs from the first to tenth embodiments in that the contrast of the invisible image is adjusted to further improve the authenticity determination accuracy. Hereinafter, in the description of the eleventh embodiment, the description of the same parts as those of the first to tenth embodiments will be omitted, and the parts different from those of the first to tenth embodiments will be omitted. I will explain the parts.

The invisible embedding technique shown in FIG. 5 of the first embodiment, the so-called latent image technique, can embed information that cannot be visually recognized. , is devised to be inconspicuous to the naked eye. Therefore, even if the read invisible image is viewed, the contrast may not be sufficient, which may make it difficult to determine authenticity. In addition, the density of the image read by the reading device may be low, and in that case, there is also the problem that authenticity determination becomes difficult.

Therefore, in the present embodiment, by correcting the contrast of the image, it is possible to maintain the authenticity determination accuracy even when the contrast of the invisible image is insufficient.

FIG. 26 is a block diagram showing the configuration of the image correction section 22 of the image reading section 101 according to the eleventh embodiment. As shown in FIG. 26, the image correction unit 22 includes an area extraction unit 31, a scaling unit 32, a monochrome conversion unit 41, a selector (SEL) 42, an image synthesis unit 71, and a contrast adjustment unit 72. It has

A contrast adjuster 72 adjusts the contrast of the visible image and the invisible (NIR) image. Specifically, the contrast adjustment unit 72 performs contrast enhancement processing and binarization processing for NIR images, or contrast suppression processing (integration processing) for visible images.

Here, FIG. 27 is a diagram for explaining the action and effect of the invisible image contrast adjustment processing in the contrast adjustment unit 72. As shown in FIG. FIG. 27(a) shows an invisible read image before adjustment. FIG. 27(b) shows an invisible image after contrast adjustment, and it can be seen that the authenticity determination mark can be more clearly identified in the image of FIG. 27(a) by performing contrast enhancement processing. Also, FIG. 27(c) shows an invisible image when the contrast is adjusted by binarization, and it can be seen that the authenticity determination mark can be clearly identified in the image of FIG. 27(a). An appropriate value is set in advance for the binarization threshold. By performing contrast enhancement processing by binarization processing, it is possible to easily maintain accuracy in authenticity determination.

Although the contrast of the invisible image is adjusted in FIG. 27, considering that the contrast is relative to the visible image, the same effect can be obtained by changing the contrast of the visible image.

Here, FIG. 28 is a diagram for explaining the action and effect of the visible image contrast adjustment processing in the contrast adjustment unit 72. As shown in FIG. FIG. 28(a) shows an image in which a visible image before adjustment and an invisible read image are synthesized in one frame. FIG. 28(b) shows an image in which the contrast is adjusted so as to suppress the contrast of the visible image. It can be seen that they are clearly identifiable. Note that contrast suppression processing can be easily realized by using an integration filter. By performing the contrast suppression processing by the integration filter processing, it is possible to easily maintain the authenticity determination accuracy.

As described above, according to the present embodiment, by performing the contrast enhancement process on the invisible image, it is possible to maintain the authenticity determination accuracy even when the invisible image has a light density.

Further, according to the present embodiment, by performing contrast suppression processing for suppressing the contrast of a visible image, it is possible to maintain the authenticity determination accuracy even when the invisible image is composed of dots (knitting points).

(Twelfth embodiment)
Next, a twelfth embodiment will be described.

The image reading unit 101 of the twelfth embodiment differs from those of the first to eleventh embodiments in that it performs line drawing processing on an invisible image. Hereinafter, in the description of the twelfth embodiment, the description of the same parts as those of the first to eleventh embodiments will be omitted, and the parts different from those of the first to eleventh embodiments will be omitted. I will explain the parts.

In the eleventh embodiment, the contrast of an invisible image was explained as an example. However, in the invisible embedding (latent image) technique, the invisible image is composed of dots (halftone dots), so that it may be visually inconspicuous ( The density is equivalently lowered to the human eye), and in that case, there is also the problem of difficulty in determining authenticity.

Therefore, in the present embodiment, by correcting the dots of the image to form a line drawing, it is possible to maintain the authenticity determination accuracy even when the invisible image is dots (halftone dots).

FIG. 29 is a block diagram showing the configuration of the image correction section 22 of the image reading section 101 according to the twelfth embodiment. As shown in FIG. 26, the image correction unit 22 includes an area extraction unit 31, a scaling unit 32, a monochrome conversion unit 41, a selector (SEL) 42, an image synthesis unit 71, and a contrast adjustment unit 72. In addition, a line drawing section 73 is provided.

The line-drawing unit 73 performs line-drawing processing for recognizing dots and connecting them. In the present embodiment, the line drawing unit 73 is arranged on the NIR image input side in order to process the invisible image, but it may also be arranged on the visible image side.

30A and 30B are diagrams for explaining the action and effect of the line drawing process on the invisible image. FIG. 30(a) shows an invisible read image before processing. Since the authenticity judgment mark "true in a circle" is composed of dots (halftone dots), it is difficult to identify the mark only by this mark. FIG. 30(b) shows an image that has been subjected to the line drawing process, and each dot is connected to form a continuous smooth image, so that the authenticity determination mark can be clearly identified compared to FIG. 30(a). I know you can.

In this embodiment, in a sense, the pattern of the authentication mark is changed, but it is assumed that changing the pattern in advance does not pose any problem in the authentication.

Next, the flow of image reading processing controlled by the control unit 23 will be described.

FIG. 31 is a flowchart schematically showing the flow of image reading processing including contrast adjustment processing or line drawing processing. Note that the processes of steps S8 to S11, steps S21 to S23, steps S31, steps S41, steps S51, steps S53, steps S71 to S72, and steps S81 to S83 are the same as those described with reference to FIG. , the description of which is omitted. The difference from the flowchart described in FIG. 24 is that whether or not to perform the contrast adjustment process or the line drawing process after reading is completed is added.

As shown in FIG. 31, when the control unit 23 determines that reading of all originals (documents) is completed (Yes in step S41), the contrast adjustment processing in the contrast adjustment unit 72 or the line drawing processing in the line drawing unit 73 is performed. It is determined whether to enable it (step S91). If the control unit 23 determines to enable the contrast adjustment process or the line drawing process (Yes in step S91), it enables the contrast adjustment process or the line drawing process (step S92).

On the other hand, the control unit 23 determines not to enable contrast adjustment processing or line drawing processing (No in step S91), and disables contrast adjustment processing or line drawing processing (step S93).

In FIG. 31, any one of contrast adjustment (invisible image), contrast adjustment (visible image), and line drawing processing is selected, but these processing may be used in combination.

As described above, according to the present embodiment, it is possible to maintain the authenticity determination accuracy even when the invisible image is composed of dots (knitting points).

(Thirteenth Embodiment)
Next, a thirteenth embodiment will be described.

The thirteenth embodiment differs from the first to twelfth embodiments in that the primary determination of authenticity is performed within the device. Hereinafter, in the description of the thirteenth embodiment, the description of the same parts as those of the first to twelfth embodiments will be omitted, and the parts different from those of the first to twelfth embodiments will be omitted. I will explain the parts.

So far, we have described a configuration that allows confirmation of the validity of authenticity determination by visual confirmation. However, when confirming the validity of the authenticity determination, there is a problem that the determination work takes time because the authenticity determination itself is also performed at the same time.

Therefore, in the present embodiment, a configuration is adopted in which the primary determination of authenticity determination is performed within the device, thereby shortening the time required for the determination work.

FIG. 32 is a block diagram showing the electrical connection of each part constituting the authenticity determination system 200 according to the thirteenth embodiment. The authenticity determination system 200 shown in FIG. 32( a ) includes an authenticity determination section 91 that functions as an authenticity determination means that performs authenticity determination between the image correction section 22 and the image notification section 25 .

The authenticity determination unit 91 performs authenticity determination by detecting the presence or absence of the authenticity determination mark (the circle is positive) in the NIR image output from the image correction unit 22 . The authenticity determination section 91 outputs the authentication determination result to the image notification section 25 .

The image notification unit 25 also notifies the result of authenticity determination together with the image information described so far.

The control unit 23 controls the presence/absence of execution of authenticity determination, the determination method, and the determination conditions in the authenticity determination unit 91 according to the image mode.

Components other than the authenticity determination unit 91 are the same as those of the image reading unit 101 or the image forming apparatus 100 described above. calling.

FIG. 32(b) shows an authenticity determination system 200 using an image sensor 9 capable of simultaneously acquiring an RGB image and an NIR image. The difference from the authenticity determination system 200 shown in FIG. 32A is that in FIG. The only difference is that it has been replaced with an image sensor 9 that can be acquired.

Also, the authentication result obtained by the authentication system 200 (notified externally) is treated as the primary determination result. This is because the results are not necessarily valid when considering forgery, falsification, and the like. Therefore, the final determination result is determined from the primary determination result obtained by the authenticity determination system 200 and the validity determination based on the NIR image notified from the image notification unit 25 .

As described above, the primary determination of authenticity determination is performed within the device, and the authenticity determination is performed together with the notified NIR image, so that the time required for the determination work can be shortened.

As described above, according to the present embodiment, it is possible to shorten the authenticity determination work.

(14th embodiment)
Next, a fourteenth embodiment will be described.

The authenticity determination system 200 of the fourteenth embodiment differs from the first to thirteenth embodiments in that the invisible/visible image and the authenticity determination result are collectively notified. Hereinafter, in the description of the fourteenth embodiment, the description of the same parts as those of the first to thirteenth embodiments will be omitted, and the parts that differ from the first to thirteenth embodiments will be omitted. I will explain the parts.

Although the authenticity determination system 200 is shown in the thirteenth embodiment, from the viewpoint of information management, storing the authentication results as evidence separately from the NIR images poses a problem that subsequent information management becomes difficult.

Therefore, in the present embodiment, information management as evidence is facilitated by integrally notifying the NIR image and the authenticity determination result.

FIG. 33 is a diagram showing the configuration of the image notification section 25 of the image reading section 101 according to the fourteenth embodiment. The image notification unit 25 of the image reading unit 101 shown in FIG. 33 includes a notification image generation unit 25f functioning as an information synthesizing unit between the image storage unit 25b and the image printing unit 25e.

As shown in FIG. 33, the image notification unit 25 receives the visible image, the NIR image, and the authentication result. The input image is stored in the image storage unit 25b and output as an RGB image and an NIR image to the subsequent notification image generation unit 25f. Further, the authentication result is also stored in the image storage unit 25b and output to the subsequent notification image generation unit 25f.

The notification image generation unit 25f synthesizes images by adding authenticity determination results to the input NIR images. The notification image generation unit 25f outputs the synthesized NIR image (notification image (NIR)) to the image printing unit 25e. The image printing unit 25e visibly prints the combined NIR image (notification image (NIR)) or displays it on the display.

As described above, information management can be facilitated by integrally notifying the NIR image and the authentication result as an image.

In addition, in FIG. 33, although it was described that the NIR image is combined with the authenticity determination result, the authenticity determination result may be combined with the visible image.

34A and 34B are diagrams for explaining the action and effect when the invisible/visible image and the authenticity determination result are notified integrally. FIG. 34A shows an example of a visible image (RGB) and an invisible image (NIR) input to the image notification unit 25, and an authentication result.

FIG. 34B is an example of a composite image, in which the RGB image is combined with the NIR image authentication mark, and the image is overwritten with the authenticity determination result. The part is treated as a black and white pattern.

By synthesizing the image and the authenticity judgment result in this manner to form a single image of the same surface, subsequent information management is facilitated. If the original is a forgery, the authenticity mark does not exist, and the result of the authenticity determination is notified by synthesizing false characters.

Further, FIG. 34(c) is another example of a synthesized image, an example in which the authentication result is synthesized in the margin area of the authentication mark of the RGB image or the NIR image, and the NIR image portion and the authentication determination The results are treated as black-and-white images in the same manner as above. In this way, by laying out and synthesizing the authenticity determination result in an area different from the area where the image context exists, it is possible to maintain the visibility of the image information. can be played).

Further, in the above example, the authentication result portion is treated as a black and white image, but by synthesizing images in a color different from that of the visible/invisible image, the visibility of the authentication result can be improved.

As described above, according to the present embodiment, it is possible to facilitate information management while shortening the authenticity determination work.

(15th embodiment)
Next, a fifteenth embodiment will be described.

The authenticity determination system 200 of the fifteenth embodiment differs from the first to fourteenth embodiments in that image information is stored in an external storage (cloud). Hereinafter, in the description of the fifteenth embodiment, the description of the same parts as those of the first to fourteenth embodiments will be omitted, and the parts different from those of the first to fourteenth embodiments will be omitted. I will explain the parts.

Until now, we have assumed that image information to be notified to the outside will be stored as evidence in local storage capacity and printed paper, but in reality, it is said that a huge storage capacity and a space to store a large amount of printed paper are required. There's a problem.

Therefore, in the present embodiment, image information, which has a particularly large capacity, is stored in an external storage and only the access key thereof is notified to the outside, thereby facilitating evidence storage.

FIG. 35 is a block diagram showing the electrical connection of each part constituting the authenticity determination system 200 according to the fifteenth embodiment. FIG. 35(a) shows a configuration for storing image information in an external storage (cloud). The authenticity determination system 200 shown in FIG. 35( a ) is connected to an external storage (cloud) 92 from the image notification section 25 .

The external storage (cloud) 92 functions as storage means, and is storage on a network such as cloud. Authenticity determination system 200 includes external storage (cloud) 92 .

FIG. 35(b) is a diagram showing the configuration of the image notification unit 25. As shown in FIG. As shown in FIG. 35(b), the image notification unit 25 receives the visible image, the NIR image, and the authentication result. The input image is stored in the image storage unit 25b, and is output to the subsequent notification image generation unit 25f as an RGB image and an NIR image. Further, the authentication result is also stored in the image storage unit 25b and output to the subsequent notification image generation unit 25f.

The notification image generation unit 25f synthesizes images by adding authenticity determination results to the input NIR images. The notification image generation unit 25f outputs the combined NIR image (notification image (NIR)) to the image printing unit 25e. The image printing unit 25e visibly prints the combined NIR image (notification image (NIR)) or displays it on the display.

In addition, the notification image generator 25f outputs storage images (RGB, NIR) to the external storage (cloud) 92. FIG. The image for storage (RGB, NIR) output from the notification image generator 25f is different from the notification image (RGB, NIR) similarly output from the notification image generator 25f. Specifically, while the notification image is an image obtained by synthesizing the authenticity determination result and the like, the storage image is image information before synthesis.

As a result, the operator is immediately notified of the result of authenticity determination by means of a notification image, and when a validity determination is required, the image for storage in the external storage (cloud) 92 is called to confirm the validity of the authenticity determination. Such operation is also possible. Access information (access key) to the external storage (cloud) 92 is generated by the notification image generation unit 25f, and is notified in the notification image together with the authentication result.

36A and 36B are diagrams for explaining actions and effects when image information is stored in the external storage (cloud) 92. FIG. In FIG. 36 , the upper part shows the notification image, and the lower part shows the image stored in the external storage (cloud) 92 .

FIG. 36(a) is an example in which a visible (RGB) image and the authenticity determination result are synthesized as a notification image, and an invisible (NIR) image is used as a storage image. The notification image shown in FIG. 36A is different from the image explained in FIG. The point is that it is synthesized.

The operator sees the notified visible information and the result of authenticity determination, recognizes it as the primary result of authenticity determination of a specific individual (document), and uses the attached access key as necessary. The workflow is such that the external storage (cloud) 92 is accessed, the stored invisible image is checked, and the validity is confirmed. In this case, since the visible image (individual identification information) is first notified together with the authentication result and the access key, information management is facilitated.

FIG. 36(b) is an example in which an invisible image (NIR) and the authenticity determination result are synthesized as a notification image, and a visible image (RGB) is used as a storage image. The NIR image here is obtained by extracting and enlarging the authenticity determination mark.

In this case, the operator sees the notified invisible information and the authenticity determination result, recognizes the primary result of the authenticity determination, and makes a validity determination. Next, access the external storage (cloud) 92 using the access key added together as needed, check the stored visible image, and identify the document to which the result belongs. It becomes a workflow of doing. In this case, since the NIR information is first notified together with the result of authenticity determination and the access key, it is possible to confirm the validity of the authenticity determination in real time.

FIG. 36(c) is an example in which the notification image is only the authenticity determination result, and the storage image is a visible (RGB) image and an invisible (NIR) image.

In this case, the operator sees the notified authentication result, recognizes the primary result of the authentication, and accesses the external storage (cloud) 92 using the access key attached together as necessary. Then, the stored visible image and NIR image are confirmed, and the validity confirmation and individual identification of which document the result belongs to are performed. In this case, since only the result of authenticity determination and the access key are notified, the primary determination of authenticity can be made early.

As described above, image information is stored in the external storage (cloud) 92 and only its access key is externally notified, thereby facilitating evidence storage while maintaining the accuracy and validity of authenticity determination. can.

FIG. 37 is a diagram for explaining actions and effects when both visible and invisible images are stored in the external storage (cloud) 92. FIG. In FIG. 37 , the upper part shows the notification image, and the lower part shows the image stored in the external storage (cloud) 92 .

FIG. 36 shows an example in which either or both of the visible image and the invisible image that are not included in the notification image are stored in the external storage (cloud) 92, but from the viewpoint of storage reliability of evidence, the notification image However, it is desirable to store both visible and invisible images.

FIG. 37A shows an example in which the individual identification information extracted from the visible (RGB) image, the authentication result, and the access key are combined with the notification image. Storage images are both visible (RGB) and invisible (NIR) images.

The operator's workflow is the same as that explained in FIG. 36(a), but since both the RGB image and the NIR image are stored in the external storage (cloud) 92, storage reliability can be improved.

Note that the notification image in FIG. 37(a) is an example in which the individual identification information extracted from the RGB image is described. Therefore, RGB images can be processed.

FIG. 37(b) is an example in which the individual identification information extracted from the visible (RGB) image, the authenticity determination result, the access key, and the authenticity determination mark extracted and enlarged from the NIR image are combined with the notification image. Storage images are both visible (RGB) and invisible (NIR) images.

The workflow of the operator is basically the same as that of FIG. 37(a), but since the authenticity determination mark is also notified, the validity check is also performed at the same time. Since both the RGB image and the NIR image are stored in the external storage (cloud) 92, storage reliability can be improved.

Note that the notification image in FIG. 37B is also an example in which the individual identification information extracted from the RGB image is described. Processing is possible.

As described above, by always storing both the visible image and the invisible image in the external storage (cloud) 92, the storage reliability of the evidence can be improved.

As described above, according to the present embodiment, it is possible to facilitate storage of evidence for authenticity determination.

(16th embodiment)
Next, a sixteenth embodiment will be described.

The authenticity determination system 200 of the sixteenth embodiment differs from the first to fifteenth embodiments in that an access key to image information is encrypted. Hereinafter, in the description of the sixteenth embodiment, the description of the same parts as those of the first to fifteenth embodiments will be omitted, and the parts different from those of the first to fifteenth embodiments will be omitted. I will explain the parts.

So far, an example has been shown in which an access key is used to access the external storage (cloud) 92 to obtain image information. be.

Therefore, in the present embodiment, the access key is encrypted and notified to the outside so that the evidence can be stored securely.

FIG. 38 is a diagram for explaining actions and effects when encrypting an access key to image information in the authenticity determination system 200 according to the sixteenth embodiment.

FIG. 38 shows examples of encrypted access keys. FIG. 38(a) shows a one-dimensional encryption code (example: barcode), and FIG. 38(b) shows a two-dimensional encryption code (example: QR code (registered trademark) )). Since code symbols such as bar codes and QR codes are already widely used encryption methods, encryption can be easily performed by using them.

As described above, by encrypting and notifying the access key, secure evidence storage becomes possible.

As described above, according to the present embodiment, access information is encrypted, so that evidence can be stored securely.

In each of the above-described embodiments, an example in which the image forming apparatus of the present invention is applied to a multifunctional machine having at least two functions out of a copy function, a printer function, a scanner function, and a facsimile function will be described. It can be applied to any image forming apparatus such as a machine, a printer, a scanner, a facsimile, and the like.

Furthermore, in each of the above embodiments, the reader of the present invention is applied to a multifunction machine, but the present invention is not limited to this, and can be applied to various fields such as inspection in the FA field. is possible.

Further, the reading device of the present invention can also be applied to a bill reading device for the purposes of distinguishing bills and preventing forgery. Furthermore, the reading device of the present invention can be applied to a device that reads visible images and invisible images and performs some processing in the next process.

22 correction means 23 control means 25 notification means 25a, 25b storage means 25f information synthesizing means 26 notification control means 71 synthesizing means 91 authenticity determination means 92 storage means 100 image forming device 101 reading device 102 document supporting section 103 image forming section 200 authenticity determination system

Japanese Patent No. 4821372

Claims (35)

In a reading device that receives and reads light from an object illuminated by a light source with an imaging device,
a control means for controlling a first reading operation of reading the subject with a visible image and a second reading operation of reading the subject with an invisible image;
a correction means for performing a correction such that at least the authentication image, which is the invisible image, can be identified ;
notification means for notifying the outside of at least the corrected invisible image;
A reading device comprising: Notification control means for controlling notification conditions of the notification means;
2. The reader of claim 1, comprising: a. The notification means has storage means for storing at least the invisible image,
The notification control means controls to externally notify the image stored in the storage means at any timing;
3. The reading device according to claim 2 , wherein: The correction means outputs an image of the entire surface of the subject to the notification means.
4. The reader according to any one of claims 1 to 3 , characterized in that: The correction means outputs an enlarged image of a part of the entire surface of the subject to the notification means.
5. The reader according to any one of claims 1 to 4 , characterized in that: The notification means notifies the invisible image to the outside as a printed image.
6. The reader according to any one of claims 1 to 5 , characterized in that: The second reading operation is a reading operation in the infrared region,
7. The reader according to any one of claims 1 to 6 , characterized in that: The correction means monochromeizes the invisible image.
8. The reader according to any one of claims 1 to 7 , characterized in that: The second reading operation is capable of continuously reading the invisible image of the subject.
9. The reading device according to any one of claims 1 to 8 , characterized in that: The notification means receives the corrected visible image and the invisible image, and notifies the visible image and the invisible image integrally.
10. The reader according to any one of claims 1 to 9 , characterized in that: The notification means prints the visible image and the invisible image on the first surface and the second surface of a print image, respectively, and notifies them.
11. The reader according to claim 10 , characterized in that: The control means simultaneously performs the first reading operation and the second reading operation;
2. The reader according to claim 1 , wherein: The first reading operation is an operation of reading the first surface of the subject,
The second reading operation is an operation of reading the second surface of the subject.
13. The reading device according to claim 12 , wherein: The notifying means comprises synthesizing means for synthesizing the visible image read by the first reading operation and the invisible image read by the second reading operation on the same surface.
14. The reader according to claim 12 or 13 , characterized in that: The synthesizing means lays out the visible image and the invisible image in separate areas on the same surface.
15. The reader according to claim 14 , characterized in that: The synthesizing means makes the color of the invisible image different from that of the visible image,
16. The reader according to claim 14 or 15 , characterized in that: The correction means performs contrast enhancement processing on the invisible image.
17. The reading device according to any one of claims 1 to 16 , characterized in that: The contrast enhancement processing is binarization processing,
18. The reader according to claim 17 , characterized by: The correction means performs a contrast suppression process that suppresses the contrast of the visible image.
19. A reader according to any one of claims 1 to 18 , characterized in that: The contrast suppression processing is integral filtering,
20. The reading device according to claim 19 , characterized in that: The correction means performs a line drawing process that connects the dots of the invisible image.
21. The reading device according to any one of claims 1 to 20 , characterized in that: a reading device according to any one of claims 1 to 21 ;
a document support unit for positioning a document whose image is to be read by the reading device at a reading position of the reading device;
an image forming unit;
An image forming apparatus comprising: a reading device according to any one of claims 1 to 21 ;
authenticity determination means for determining whether or not the subject is authentic using the invisible image;
with
The authenticity determination result determined by the authenticity determination means is notified to the outside by the notification means.
An authenticity determination system characterized by: The notification means comprises information synthesizing means for performing image synthesizing for laying out the invisible image or the visible image and the authenticity determination result on the same surface,
The notification means notifies the invisible image and the authentication result.
24. The authenticity determination system according to claim 23 , characterized by: The information synthesizing means synthesizes the invisible image and the authentication result, and lays out the invisible image and the authentication result in separate areas on the same surface.
25. The authenticity determination system according to claim 24 , characterized by: The information synthesizing means changes the color of the authentication result with respect to the invisible image,
26. The authenticity determination system according to claim 24 or 25 , characterized in that: The information synthesizing means makes the color of the authenticity determination result different for the visible image,
27. The authenticity determination system according to claim 26 , characterized by: storage means for storing the visible image or the invisible image on a network;
The authenticity determination means generates access information to the storage means,
The notification means notifies the visible image or the invisible image to the outside by notifying the access information.
28. The authenticity determination system according to any one of claims 23 to 27 , characterized in that: The notification means integrally notifies the authentication result, the access information, and the individual identification information.
29. The authenticity determination system according to claim 28 , characterized by: The notification means integrally notifies the authentication result, the access information, and the invisible image or a part thereof;
29. The authenticity determination system according to claim 28 , characterized by: The notification means integrally notifies the authentication result and the access information.
29. The authenticity determination system according to claim 28 , characterized by: the notification means stores both the visible image and the invisible image in the storage means;
The authenticity determination system according to any one of claims 28 to 31 , characterized in that: the access information is encrypted;
33. The authenticity determination system according to any one of claims 28 to 32 , characterized in that: the access information is a code symbol,
34. The authenticity determination system according to claim 33 , characterized by: A reading method in a reading device in which light from a subject illuminated by a light source is received by an imaging element and read,
a control step of controlling a first reading operation of reading the subject with a visible image and a second reading operation of reading the subject with an invisible image;
a correction step of performing a correction such that at least the authentication image, which is the invisible image, can be identified ;
a notification step of notifying the outside of at least the corrected invisible image;
A reading method comprising:

Images