JP7268764B1 - Image processing device, image processing method and image processing program - Google Patents

Abstract

An object of the present disclosure is to provide an image processing device, an image processing method, and an image processing program capable of improving examination efficiency. An image processing apparatus (information processing apparatus 100) processes an application document having at least one attribute of an application form including application information of the applicant among application documents submitted by the applicant and certification documents of the applicant. and an application information acquiring unit 11 for acquiring application image data, which is image data of the application image data, determines the attribute of the application document indicated by the application image data, and performs image processing on the application image data according to the attribute. and an image processing unit 30 for generating examination image data used for examination of the content of the application information. [Selection drawing] Fig. 2

Description

The present disclosure relates to an image processing device, an image processing method, and an image processing program.

Conventionally, when an application is made to a local government, for example, the local government receives the application documents from the applicant and examines whether or not there are any deficiencies in the content of the application documents. For example, the local government receives multiple types of documents such as a copy of the identity verification document and certification documents for confirming the contents of the application together with the application form from the applicant, and compares these multiple documents to check whether there are any deficiencies in the contents of the application. I'm doing a review. A similar process is also carried out when applying for services to private companies. At this time, since these multiple types of application documents are paper media, the efficiency of confirmation work of application information and input work of confirmation results may be reduced. Therefore, in some cases, for example, as preprocessing for examination, application documents are read with a scanner or the like, and the written characters are automatically converted into data and stored in a storage device (for example, Patent Document 1).

JP 2018-101327 A

However, the application documents to be examined include application forms and personal identification documents, and the format and printing mode on paper may differ depending on the documents. Therefore, even if the application documents are simply converted into image data, it takes time and effort to display the necessary application document data for each item to be checked, and the examination efficiency may not be improved.
Therefore, an object of the present disclosure is to provide an image processing device, an image processing method, and an image processing program capable of improving examination efficiency.

In order to achieve the above object, an image processing apparatus according to an aspect of the present disclosure provides at least one of an application form including application information of an applicant among application documents submitted by an applicant and certification documents of the applicant. an image acquisition unit that acquires application image data, which is image data of an application document of an attribute, and determines whether the attribute of the application document indicated by the application image data is the application form or the certification document. an image processing unit that performs image processing on the application image data in accordance with the attribute and generates image data for examination used for examination of the content of the application information, wherein the image processing unit is configured to process the image As the process, a process of extracting a specific image area from the image area of the application image data and generating new image data including the specific image area as the examination image data can be executed, and the attribute determination result can be executed. further, the image processing unit determines whether or not to execute the image processing based on A certificate image area indicating the certificate document is cut out from the image area as the specific image area, and certificate image data including image information in the certificate image area is used as the new image data to be the image data for examination. classify the type of the certificate based on the image information included in the certificate image data; and based on the type of the classified certificate or the attribute of the application document, An item indicating the item of the image information to be examined from a setting file stored in a predetermined storage area by extracting the position information of the examination image area including the image information to be examined from within the image area. Acquiring linking information linking a region and a content region indicating the content of the image information, extracting position information of a region including the item region and the content region as primary extraction information based on the linking information, The position information of the content area obtained by removing the position information of the item area from the primary extraction information is extracted as the position information of the examination image area, and the linking information includes the position information of the content area based on the item area. The top, bottom, left, and right positions and the size of the content area are included .

Further, in order to achieve the above object, an image processing method according to one aspect of the present disclosure is an image processing method executed by a computer, which includes application information of the applicant among the application documents submitted by the applicant. Obtaining application image data, which is image data of the application document having at least one attribute of the application form and the certification document of the applicant, and acquiring the application image data, wherein the attribute of the application document indicated by the application image data is the application form or the certification determining which of the documents it is, performing image processing on the application image data according to the attribute to generate examination image data used for examination of the content of the application information, and performing the image processing, A process of extracting a specific image area from the image area of the application image data and generating new image data including the specific image area as the image data for examination can be executed, and based on the determination result of the attribute determining whether or not to perform image processing, and further, as the image processing, when the attribute of the application document indicated by the application image data is the certification document, the certification is performed from the image area of the application image data; A certificate image area showing a document is cut out as the specific image area, certificate image data including image information in the certificate image area is generated as the new image data to be the examination image data, and the certification is performed. Classifying the type of the certificate based on the image information contained in the document image data, and based on the type of the classified certificate or the attribute of the application document, within the image area of the image data for examination, The position information of the examination image area including the image information to be examined is extracted, and the item area indicating the item of the image information to be examined and the image information from the setting file stored in the predetermined storage area. obtains the linking information linking the content area indicating the content of the item area and the content area based on the linking information, extracts the position information of the area including the item area and the content area as the primary extraction information, and The position information of the content area excluding the position information of the item area is extracted as the position information of the examination image area, and the linking information includes the top, bottom, left, and right positions of the content area with respect to the item area. and the size of the content area .

In addition, in order to achieve the above object, an image processing program according to an aspect of the present disclosure includes at least an application form including application information of the applicant among the application documents submitted by the applicant and the certification documents of the applicant. Obtaining application image data that is image data of an application document with one attribute, and determining whether the attribute of the application document indicated by the application image data is the application form or the certification document. performing image processing on the application image data in accordance with the attribute to generate examination image data used for examination of the contents of the application information; extracting a specific image area from the image data and generating new image data including the specific image area as the image data for examination, and executing the image processing based on the result of determination of the attribute Further, as the image processing, when the attribute of the application document indicated by the application image data is the certificate, certification indicating the certificate from the image area of the application image data extracting a document image area as the specific image area and generating certificate image data including image information in the certificate image area as the new image data to be the examination image data; classifying the type of the certificate based on the image information contained in the data, and based on the type of the classified certificate or the attribute of the application document, the examination within the image area of the image data for examination; extracting the position information of the examination image area including the image information to be examined, and from the setting file stored in the predetermined storage area, the item area indicating the item of the image information to be examined and the image information obtains the linking information linking the content area indicating the content of the item area and the content area based on the linking information, extracts the position information of the area including the item area and the content area as the primary extraction information, and extracting the position information of the content area excluding the position information of the item area as the position information of the examination image area ; It is characterized by including the top, bottom, left, and right positions of the content area and the size of the content area .

According to the present disclosure, it is possible to provide an image processing device, an image processing method, and an image processing program capable of improving examination efficiency.

1 is a schematic diagram showing a configuration example of an information processing system including an image processing device according to an embodiment of the present disclosure; FIG. 1 is a schematic functional block diagram showing an example of functional configuration of an information processing system including an image processing device according to an embodiment of the present disclosure; FIG. FIG. 4 is a schematic diagram showing an example of image data representing an application form among application image data according to an embodiment of the present disclosure; FIG. 4 is a schematic diagram showing an example of image data showing a certificate among application image data according to an embodiment of the present disclosure; FIG. 4 is a schematic diagram showing an example of image division processing by an image processing device according to an embodiment of the present disclosure; FIG. 5 is a diagram showing an example of an examination image area extracted from certificate image data in the image processing device according to an embodiment of the present disclosure; FIG. 5 is a diagram showing an example of an examination image area extracted from application image data representing an application in the image processing device according to an embodiment of the present disclosure; FIG. 4 is a schematic diagram showing an example of certificate image data generated by image division processing in one embodiment of the present disclosure; FIG. 4 is a diagram showing an example of an examination screen and examination image data displayed on a display screen of a display device in an embodiment of the present disclosure; FIG. 4 is a diagram showing an example of an examination screen displayed on a display screen of a display device and a plurality of pieces of image data for examination in an embodiment of the present disclosure; 1 is a schematic diagram showing an example of a hardware configuration of an information processing device according to an embodiment of the present disclosure; FIG. 4 is a flowchart describing an image processing method executed by an image processing device according to an embodiment of the present disclosure;

Embodiments of the present disclosure will be described below with reference to the drawings. However, the embodiments described below are merely examples, and are not intended to exclude various modifications and application of techniques not explicitly described below. The present disclosure can be implemented in various modifications (for example, by combining each embodiment) without departing from the gist of the disclosure. In addition, in the description of the drawings below, the same or similar parts are denoted by the same or similar reference numerals.

Further, the following image processing apparatus is realized by cooperation between hardware, which is an information processing terminal device such as a general-purpose computer, and software, which is a computer program. The computer program can be read by one or a plurality of processors included in the image processing apparatus, and installed in the hard disk causes the processors to function as respective units of the image processing apparatus.

An image processing apparatus according to the present embodiment, and an image processing method and an image processing program executed by the image processing apparatus will be described below with reference to FIGS. 1 to 12. FIG.

1. Overall Configuration of Information Processing System As shown in FIG. 1, an information processing system 1 is used as an application information processing system for acquiring application information applied by an applicant and examining the content of the application. FIG. 1 shows, as an example of an information processing system 1, an application information processing system as an internal system of a local government that accepts application procedures from applicants and obtains examination results by examiners. The information processing system 1 may be a system of a company or the like that has received a request from a local government, or may be an internal system of a company that accepts application procedures (application procedures) from service applicants.
The information processing system 1 is connected to a system of a printing department inside or outside the local government, and can create printed matter such as a letter of notice according to the output from the information processing system 1 by a printing device. Further, the information processing system 1 may be connected to a bank system to make a transfer or the like according to the examination.

FIG. 2 is a schematic functional block diagram showing an example of the functional configuration of the information processing system 1. As shown in FIG.
As shown in FIG. 2 , an information processing system 1 that is an application information processing system includes an information processing device 100 . The information processing device 100 functions as an application information processing device for acquiring application information applied by an applicant and examining the content of the application. In this embodiment, the information processing device 100 includes an image processing section 30 . As a result, it functions as an image processing apparatus that converts paper media application documents into image data, performs image processing, and generates image data suitable for examination. That is, the information processing device 100 corresponds to the image processing device according to this embodiment.

When accepting application procedures from applicants, local governments and companies that are screening organizations accept paper application documents by mail or by visiting the screening organization, or send applicants via the Internet. Application documents can be accepted from In this embodiment, as an example, the system configuration and the information processing apparatus 100 will be described in the case where the applicant submits the paper medium application documents by mail, visiting the local government, or the like.

2. Functional Configuration of Information Processing Apparatus As shown in FIG. 2, an information processing apparatus 100 (an example of an image processing apparatus) is, for example, a computer. Each functional block shown in FIG. 2 is implemented by executing necessary programs by the processor 101 of the arithmetic device 10 described later with reference to FIG.

The information processing device 100, which is an image processing device according to the present embodiment, includes an application information acquisition unit 11, a storage unit 12, an examination unit 13, a display data output unit 14, a data output unit 15, an image processing unit 30, an examination image storage unit. 31. The information processing apparatus 100 is also connected to a reading device 51 such as a scanner, an input device 52 such as a keyboard and a mouse, a display device 53 such as a liquid crystal display, and an OCR examination server 54, which are external devices. The OCR examination server 54 is a server device that examines application content based on the results of OCR (Optical Character Recognition) processing of image data generated by the information processing device 100 (particularly, the image processing unit 30). Note that the reading device 51 , the input device 52 and the display device 53 may be provided as part of the information processing device 100 . Also, the functions of the OCR examination server 54 may be implemented as functional blocks of the information processing apparatus 100 .

Also, the OCR engine in the OCR examination server 54 may be an AI-OCR engine to which AI technology is applied. The AI-OCR engine can improve the precision of character recognition and layout analysis of image data (identification of recognition range) by deep learning. When using an AI-OCR engine, the OCR examination server 54 is preferably a cloud server provided in an open network environment (cloud environment). This allows the AI-OCR engine to learn from a large amount of data and improve the accuracy of OCR processing results.
Each functional block will be described below.

[Application information acquisition unit]
An application information acquisition unit (an example of an image acquisition unit) 11 is an interface that acquires application image data obtained by converting application documents from applicants into electronic data. As shown in FIG. 2, the information processing apparatus 100 is connected to a reading device 51 such as a scanner that reads application documents in which application information is entered, converts the application documents into electronic data, and creates application image data. .

The application image data is image data of paper-based application documents (application forms, certificates, etc.) submitted by the applicant, and includes the applicant's application information.
The application documents submitted by the applicant are classified into multiple types of attributes. Attributes of application documents in the present embodiment include, for example, an application form including information on the applicant (in which application information is entered) and certification documents attached to the application form. Here, the applicant may include not only the applicant himself/herself but also the applicant's family members. The certification document is, for example, a copy of the identity verification document of the applicant (applicant, applicant's family, etc.) or a certification document for confirming the content of the application.
The certification documents will be treated as attachments to the application form. Attached documents may include various forms such as bills and order forms in addition to the above-mentioned certification documents.

When the application image data is generated by reading the application documents with the reading device 51 such as a scanner, the application image data includes the applicant's application information as image information.
As described above, in the present embodiment, the application information acquisition unit 11 obtains the application image data from at least one of the application form including the applicant's application information among the application documents submitted by the applicant and the certification documents of the applicant. Obtain the application image data, which is the image data of the attribute application document.

3 and 4 are diagrams showing an example of application image data acquired by the application information acquisition unit 11. FIG. Specifically, FIG. 3 is an example of application form read image data, which is image data of an application form read by the reading device 51 among the application image data. The application form read image data 71 is image data of the application form itself read by the reading device 51 (scanner or the like), and is formed of an application form image area 710 showing the content of the application form as image information.

In this example, the application form image area 710 includes an application item area including image information indicating the type of various information regarding the applicant and application content, and an application content area including image information indicating the content of the various information. . For example, in FIG. 3, an application item area 711, which is an example of an application item area, contains image information of a character string "name" indicating the type of information about the applicant. An application content area 712 , which is an example of the application content area, contains image information of a character string “Japan Taro” indicating the content of information about the applicant and corresponding to the application item area 711 . ing. In this example, the application item area is associated with one or more application content areas.

FIG. 4 is an example of certificate read image data, which is the image data of the certificate read by the reading device 51 in the application image data. The certificate read image data 72 is image data obtained by reading a copy (printed matter) of the certificate submitted by the applicant as a paper medium with the reading device 51 (scanner or the like). Therefore, the certificate read image data 72 is formed to include a certificate image area 720 showing the content of the certificate as image information and a background image area 721 . A background image area 721 is an image area showing a blank portion where no certificate is placed when the certificate is printed by a predetermined printing device (printer, copier, etc.).

In addition, the certificate documents that the applicant submits as attachments to the application form are not limited to one type, and may be of multiple types. At this time, the applicant may print multiple types of certificates on a single sheet of printing paper using a printing device. In other words, one certificate read image data 72 may include a plurality of certificate image areas 720 . In this example, the certificate read image data 72 includes a plurality of certificate image areas 720 (certificate image areas 720a and 720b). In FIG. 4, a certificate image area 720a is a certification image area showing the contents of a health insurance card as image information, and a certificate image area 720b is a certification image area showing the contents of a driver's license as image information.

In this example, the certificate image area 720 includes a type area including image information indicating the type of the certificate, a certification item area including image information indicating the type of various information regarding the applicant and the content of the certification, and the various types of information. and a certified content area containing image information indicative of the content. For example, in FIG. 4, the type area 722, which is an example of the type area, contains image information of character strings such as "health insurance card" and "driver's license" indicating the type of the certificate. A certification item area 723, which is an example of the certification item area, includes image information of a character string "name" indicating the type of information about the applicant. A certification content area 724, which is an example of the certification content area, contains the content of information about the applicant, and the content of information corresponding to the certification item area 723 (in this example, information indicating the "name" of the applicant). The image information of the character string "Japan Taro" shown is included. In this example, the certification item area is associated with one or more application content areas.

Note that the certificate image area 720 actually includes a wide variety of certification item areas and corresponding certification content areas. In this example, to facilitate understanding, only the certification item area 723 and the certification content area 724, which are a part of many lighting item areas and certification content areas, are illustrated, and other certification item areas and certification content areas are illustrated. Illustration is omitted.

The application image data according to the present embodiment has been described above with specific examples.
In the following description, the application item area (for example, the application item area 711) in the application form image area 710 and the certification item area (for example, the certification item area 723) in the certificate image area 720 are collectively referred to simply as "item area." may be described as Further, the application content area (for example, the application content area 712) in the application form image area 710 and the certification content area (for example, the certification content area 724) in the certificate image area 720 may be collectively referred to simply as "content area". be.

Returning to FIG. 2 , when the application image data is generated in the reading device 51 , the generated application image data is output to the application information acquisition unit 11 . The application information acquisition unit 11 acquires the application image data input from the reading device 51 and outputs the data to the storage unit 12 . As a result, the application image data (for example, the application form read image data 71 and the certificate read image data 72) are stored in the storage unit 12 .

Note that the application image data acquired by the application information acquisition unit 11 is not limited to the data output from the reading device 51 . For example, the reading device 51 may output application image data to the storage unit 12 , and the application information acquisition unit 11 may acquire the application image data stored in the storage unit 12 .
Alternatively, the application image data may be output from, for example, a computer device (not shown) for image data acquisition connected to the information processing device 100 and acquired by the application information acquisition unit 11 . The computer device for image acquisition may be connected to a reading device such as a scanner that reads application documents, creates application image data, and outputs the application image data in the same manner as the reading device 51 . When the computer device for image acquisition acquires the application image data output from the reading device, it outputs the acquired application image data to the information processing device 100 . As a result, the application information acquisition unit 11 can acquire the application image data from the image acquisition computer device. The application image data output by the image acquisition computer device may be stored in the storage unit 12 and the application information acquisition unit 11 may read the application image data from the storage unit 12 .
In this way, the information processing device 100 (in particular, the application information acquisition unit 11) may be configured not to be connected to the reading device 51 (not integrated with the reading device 51 but to be independent).

[Memory part]
The storage unit 12 stores the application image data acquired by the application information acquiring unit 11 and the applicant information indicating the applicant in association with each other.
The storage unit 12 also stores information input by an examiner or the like who examines application documents through an input device 52 such as a keyboard. For example, as will be described later, the examination unit 13 performs examinations such as "Please check and enter the name on the identity verification document" and "Please check if the name on the identity verification document matches the application form". The examination screen 61 displaying the items is displayed on the display device 53, and the person in charge of examination is made to input the examination result by inputting characters, selecting a checklist, or the like. The storage unit 12 stores information indicating examination results input by the examiner via the input device 52 . The storage unit 12 also stores attribute information (for example, information indicating an applicant) corresponding to each application data input via the input device 52 .
The storage unit 12 also stores various information referred to in image processing in the image processing unit 30 . The storage unit 12 also stores the application image data and the applicant information indicating the applicant in association with the examination image data generated by the image processing unit 30 . As a result, in the information processing device 100, it is possible to determine which applicant's examination item the examination image data is related to, and from which application image data the examination image data is generated. can be specified.

[Examination Department]
The examination unit 13 generates an examination screen displaying examination items for examining the contents of the application image data, that is, the contents of the application documents, and displays the examination screen and the examination image data based on the application image data. 53, and acquires the examination result and stores it in the storage unit 12. FIG. Since the confirmation of the contents of the application documents is performed by the person in charge of examination by visually checking the examination screen and examination image data, the examination by this function is also called visual examination.
More specifically, the examination unit 13 generates electronic data (examination screen data) of the examination screen 61, and at the time of examination, information (for example, information input by the examination person through the input device 52) Acquire the input data that acquires the examination result).

Further, the examination section 13 synthesizes the electronic data of the examination screen and the input data corresponding to the inputted examination result, and causes the display device 53 to display them. The examination unit 13 generates display screen data of an examination screen in which the corresponding radio button is selected and displayed on the examination screen according to the position of the cursor when the radio button is checked using, for example, a mouse. Similarly, the examination unit 13 may generate display screen data of an examination screen in which check marks are displayed in check boxes or characters and numbers are input and displayed in text boxes.
The examination unit 13 acquires input data (information input from the input device 52) corresponding to examination results for each examination item. The examination unit 13 acquires input data corresponding to examination results for all examination items for one piece of examination image data, and generates examination data for one piece of examination image data (that is, one applicant).
The examination unit 13 associates the examination data with each application image data (each applicant) and outputs the data to the storage unit 12 for storage.

[Image processing section]
The image processing unit 30 performs image processing on the application image data to generate examination image data used for examination of the content of the application information (application image data) in the examination unit 13 . For example, the image processing unit 30 generates, from the application image data, image data (examination image data for visual examination) that the examination unit 13 displays along with the examination screen on the display device 53 as examination image data. Further, the image processing unit 30 can generate image data (examination image data for automatic examination, which will be described later) to be output to the OCR examination server 54 from the application image data.
The image processing unit 30 outputs the generated image data for examination to the examination image storage unit 31 and stores it. The configuration of the image processing unit 30 and details of the examination image data will be described later.
Note that generation of examination image data in the image processing unit 30 is not limited to generation of new image data based on application image data as described above. For example, adding information corresponding to the application document indicated by the application image data to the application image data and storing it in the examination image storage unit 31 also corresponds to generation of the examination image data. In other words, the application image data to which the information is added may be treated as the examination image data.

[Examination image storage unit]
The examination image storage unit 31 stores examination image data generated by the image processing unit 30 . Specifically, the examination image storage unit 31 is a predetermined storage area for storing examination image data in a file format. When the image data for examination is generated, the image processing section 30 outputs the image data for examination to the examination image storage section 31 for storage.
At this time, the image processing unit 30 also generates storage destination data indicating the storage destination (for example, directory, folder) of the examination image data in the examination image storage unit 31, and the application image data acquired by the application information acquisition unit 11 and It is stored in the storage unit 12 in association with at least one of the applicant information. The storage destination data may be, for example, a file path or a URL (Uniform Resource Locator). As a result, for example, the examination unit 13 can acquire the examination image data corresponding to the application image data when generating the examination screen, and display the examination screen and the examination image data side by side on the display device 53 .

[Display data output unit]
The display data output unit 14 outputs the display data generated by the examination unit 13 and the examination image data generated by the image processing unit 30 to the display device 53 .

[Data output section]
The data output unit 15 outputs the examination data corresponding to the application image data stored in the storage unit 12 to the outside of the information processing device 100 according to an instruction from the input device 52 . Examination data includes, for example, a list of the details of procedures applied by applicants (for example, procedures for receiving benefits, etc.) and examination results (for example, approval or rejection) of the application details of each applicant. The data output unit 15 may output examination data for one or more specified applicants, or may collectively output all examination data stored in the storage unit 12 .
Further, the data output unit 15 outputs the input image data for examination to the outside of the information processing apparatus 100 in response to the image data for examination being input from the image processing unit 30 . Note that the data output unit 15 may read the examination image data stored in the examination image storage unit 31 and output it to the outside of the information processing apparatus 100 .

The data output unit 15 functions as a communication interface or an external interface, and outputs examination data to a computer connected via a network 9 such as the Internet or a LAN (Local Area Network), other external storage devices, or external storage media. do.
The data output unit 15 can output the examination data to a predetermined computer or the like in the municipality connected via LAN, for example. The data output unit 15 can also output the examination data to a predetermined external computer or the like connected via the Internet. For this reason, the information processing system 1 may be operated inside the local government, or may be operated by an external company that undertakes examinations from the local government. When the information processing system 1 is operated by an external company, the company receives the application form, prepares the application data, examines it, prepares the examination data, etc., and transmits the examination data, or both the application data and the examination data, to the Internet. can be sent to municipalities via

The data output unit 15 can also output the image data for examination to an OCR examination server 54, which is a server device connected via the Internet, for example. As a result, the OCR examination server 54 uses the OCR technology to read the character information of the image information of the examination image data (contents of the application form and certificate), , certification documents, etc.), i.e. an automated review.
In other words, the information processing apparatus 100 can perform two types of examination, the visual examination and the automatic examination, as the examination of the contents of the application documents.

In this embodiment, the connection between the information processing device 100 and the OCR examination server 54 is not essential, and the information processing device 100 may or may not be connected to the OCR examination server 54 . In other words, the information processing apparatus 100 may be configured to be able to execute only visual inspection without executing automatic inspection. Therefore, the image processing unit 30 should generate at least image data for visual inspection. Further, when the information processing device 100 and the OCR examination server 54 are connected, all the examinations related to the content of the application from the applicant may be automatically examined by the OCR examination server 54 . Also, part of the examination of the application content may be automatically examined by the OCR examination server 54, and the rest of the examination may be visually examined by the function of the examination section 13. FIG. Further, when the information processing device 100 is capable of executing both visual inspection and automatic inspection, for example, inspection type data indicating whether to execute visual inspection or automatic inspection is stored in the storage unit 12, and the inspection type data It may be configured to be switchable between visual inspection and automatic inspection based on.

(1.1) Image Processing in Image Processing Section Next, in the information processing apparatus 100, which is the image processing apparatus according to the present embodiment, details of image processing executed by the image processing section 30 and a functional configuration for executing the image processing will be described. , will be described in detail with reference to FIGS.
As shown in FIG. 2, the image processing unit 30 includes a document determination unit 301 that determines the attributes of the application document indicated by the application image data, and divides the application image data according to the attribute of the application document indicated by the application image data. an area extracting unit 303 for extracting an area including image information to be examined from among the image information included in the application image data; and an extracted area for the application image data or from the application image data and a region dividing unit 304 for dividing the generated image data. Although the details will be described later, the region dividing unit 304 is not an essential component in the information processing apparatus 100, and the image processing unit 30 may not have the region dividing unit 304. FIG.

(Document Judging Department)
The document determination unit 301 reads application image data from the storage unit 12 and performs image recognition on the read application image data to determine the attribute of the application document indicated by the application image data. Here, an example of image recognition processing executed by the document determination unit 301 will be described.
The document determination unit 301 performs image recognition processing using, for example, application image data and image data of a template of an application document (image data for determination). As the determination image data, template image data of a plurality of types of application documents (for example, an application form, an insurance card, a driver's license, etc.) that are expected to be submitted as application documents are used. The document determination unit 301 compares the application image data and the determination image data, and derives a model similar to the application document indicated by the application image data. This makes it possible to determine the attribute of the application document indicated by the application image data.

In the image recognition process, the document determining unit 301 derives an application template as a template similar to the application document indicated by the application image data (for example, the read application image data 71). ”. In addition, when the document determination unit 301 derives a model of a driver's license or an insurance card as a template similar to the application document indicated by the application image data (for example, the certificate read image data 72), the attribute of the application document is "certified". document”. Even when the application image data includes images of a plurality of certification documents as application documents, the document determination unit 301 can determine the attribute (“certificate document”) by image recognition processing.

The judgment image data may include template image data of attached documents (invoices, order forms, etc.) other than certificates. As a result, even when the application document indicated by the application image data is an attached document other than a certificate, the document determination unit 301 can determine the attribute of the application document. Note that the image recognition processing executed by the document determination unit 301 to determine the attribute of the application document is not limited to the above-described processing. The document determination unit 301 recognizes and detects the characteristics of image information (characters, patterns, symbols, etc.) from the image in the application image data using a known image recognition technology (for example, pattern recognition technology, etc.). It is possible to determine the attributes of the application documents shown.

Although details will be described later, the form of the application image data differs depending on the attribute of the application document. Therefore, when the image data for examination is generated in the image processing section 30, it is important to perform image processing according to the attributes of the application documents.
For example, the application form read image data 71 (see FIG. 3) is generated by converting the original application form submitted by the applicant into image data, as described above. Therefore, the application form read image data 71 almost does not include an image area other than the application document. On the other hand, the certificate read image data 72 (see FIG. 4) is generated by converting a copy of the personal identification document submitted by the applicant into image data.

For this reason, the certificate read image data 72 may include a blank portion (background image area 721) at the time of printing to create the copy, or the application document, which is image information, may be slanted. Further, the certificate read image data may include a plurality of certificates as image information.
For example, at the time of examination, when the application form read image data 71 and certificate read image data 72 are displayed on the display device 53 side by side with the examination screen 61 , the person in charge of examination can see the image area corresponding to the examination items on the examination screen 61 (for example, , an image area containing image information related to the applicant's "name"), it is necessary to adjust the position and inclination of the image by operating the input device 52 such as a mouse. Further, when the certificate read image data includes a plurality of certificates, there may arise a problem that it is difficult to know which certificate to refer to. Due to these factors, examination efficiency may be reduced. Therefore, in the information processing apparatus 100, it is necessary to perform control to determine execution of appropriate image processing according to the attribute of the application document indicated by the application image data.

In this embodiment, the document determination unit 301 determines the attribute of the application document indicated by the application image data. That is, the image processing unit 30 determines the attribute of the application document indicated by the application image data in the document determination unit 301, performs image processing on the application image data according to the determined attribute, and generates examination image data. . Thereby, the image processing section 30 can perform subsequent image processing based on the attributes of the application documents. Therefore, the information processing apparatus 100, which is an image processing apparatus according to the present embodiment, can appropriately process application image data representing various application documents having different formats and printing modes on paper according to the attributes of the application documents. As a result, it is possible to reduce the trouble of displaying the required application document data for each item to be checked and improve the examination efficiency.
Specifically, by performing image processing on the application image data according to the attribute determined by the document determination unit 301, an image for examination suitable for examination of the application content (visual examination, automatic examination) from the application image data is obtained. Generates data and extracts information (positional information of an image area for examination described later) for improving the visibility of the image data for examination on the display device 53 and the reading accuracy of character information on the OCR examination server 54 It is possible to Therefore, it is possible to reduce the trouble of displaying the necessary application document data for each item to be checked, and improve the examination efficiency.

For example, in this embodiment, the document determination unit 301 determines whether to divide the application image data based on the determined attribute. For example, the document determination unit 301 determines whether or not to divide the application image data according to the determined attribute type. In other words, the document determination unit 301 determines whether or not to perform subsequent image processing (image division processing) based on the attribute of the application document. As a result, the information processing apparatus 100, which is the image processing apparatus according to the present embodiment, performs control to determine appropriate image processing according to the attributes of application documents, and can reliably improve examination efficiency. Specifically, when the attribute of the application document indicated by the application image data is a certificate (when the application image data is certificate read image data), the document determination unit 301 determines to divide the application image data. do. As a result, the information processing apparatus 100 performs image division processing (cutting out a certificate image area 720 described later, tilt correction, etc.) on the certificate read image data, and displays it on the display device 53 side by side with the examination screen 61 . image data suitable for examination can be generated. The document determination unit 301 outputs the application image data to the document division unit 302 when the attribute of the application document indicated by the application image data is certificate (certificate read image data).

Further, when the attribute of the application document indicated by the application image data is a certificate (certificate read image data), the document determination unit 301 stores the application image data, that is, the certificate read image data itself, in the examination image storage unit 31. It may be output and stored as image data for examination. At this time, the document determination unit 301 associates the certificate read image data with information indicating the attribute (certificate document) of the application document corresponding to the certificate read image data, and stores the information in the examination image storage unit 31. may As a result, the certificate read image data to which the attribute of the application document is assigned can be treated as examination image data that can be displayed on the display device 53 by the examination section 13 .
Further, when the attribute of the application document indicated by the application image data is not the certificate but the application form (read application image data), the document determination unit 301 converts the application image data, that is, the application form read image data itself into the examination image. It may be output to the storage unit 31 and stored as image data for examination. At this time, the document determination unit 301 associates the read image data of the application form with information indicating the attribute of the application document (application form) corresponding to the read image data of the application form, and stores the information in the examination image storage unit 31. may As a result, the application image data that does not require image division processing, that is, the application form read image data to which the attributes of the application documents are added can be treated as the examination image data that can be displayed on the display device 53 by the examination section 13 .

In other words, the document determination unit 301 adds information indicating the attribute of the application document (application form or certificate) included in the application image data (application form read image data, certificate read image data) to the application image data, for example. , may be stored in the examination image storage unit 31 . For example, the information indicating the attribute of the application document may be an identification code (number or character string) indicating the attribute (application form, certificate) of the application document indicated by the application image data. It can also be a file name.

In this way, when the document determination unit 301 determines the attribute of the application document indicated by the application image data, it assigns (associates) the information (identification code or file name) indicating the attribute to the application image data, It may be stored in the examination image storage unit 31 . As a result, the examination unit 13 can acquire the application image data as the examination image data from the examination image storage unit 31 based on the information indicating the attributes given to the application image data, thereby improving the examination efficiency. can be improved. In the image processing unit 30, the document dividing unit 302 and the area extracting unit 303, which perform image processing subsequent to the above attribute determination by the document determining unit 301, perform the application image to which the information indicating the above attribute is added from the examination image storage unit 31. It is possible to acquire data (image data for examination) and perform appropriate image processing according to the attributes indicated by the application image data.

In addition, the document determination unit 301 outputs information (identification code or file name) indicating the attributes given to the application image data to the storage unit 12, and the application information acquisition unit 11 acquires the information indicating the attributes. It may be stored in the storage unit 12 in association with the application image data and the applicant information indicating the applicant. In other words, in the information processing apparatus 100, the application image data stored in the storage area (storage unit 12, examination image storage unit 31) and to which the information indicating the attribute is added may be handled as the examination image data.

(Document dividing section)
Returning to FIG. 2, the document dividing unit 302 divides the application image data input from the document determining unit 301 to generate examination image data. Specifically, the document dividing unit 302 performs image dividing processing on the certificate read image data, and divides the image area in the certificate read image data 72 into a certificate image area 720 indicating the certificate and a certificate image area 720 indicating the certificate. Divide into image regions other than As a result, the document dividing unit 302 generates certificate image data (certificate image data 8 described later) formed in the certificate image area 720 as image data for examination.

Here, an example of image division processing, which is image processing executed by the document division unit 302, will be described with reference to FIG. FIG. 5 is a schematic diagram showing an example of generation of certificate image data in the information processing apparatus 100, which is the image processing apparatus according to this embodiment. In this example, a method of generating certificate image data by performing image division processing on certificate read image data 72 will be described.

First, cutout processing in image division processing will be described. The document dividing unit 302 cuts out a certificate image area 720 (certificate image areas 720a and 720b) representing the certificate from the image area of the application image data (certificate read image data 72) whose attribute is "certificate", Certificate image data 8 including the image information in the certificate image area 720 is generated as image data for examination.

That is, the document dividing unit 302 can generate image data from which an image area not related to examination (for example, the background image area 721) is removed as image data for examination. Therefore, it is possible to reduce the burden of image adjustment work (mouse operation, etc. for adjusting the position of the image, etc.) by the person in charge of examination. Therefore, the information processing apparatus 100, which is an image processing apparatus according to this embodiment, can improve examination efficiency.

The document dividing unit 302 performs image recognition on the certificate read image data 72 to distinguish between the certificate image area 720 and other areas (for example, the background image area 721), and separates the certificate read image data. Locate the certificate image area 720 in the area within 72 .

The document dividing unit 302 extracts the outer periphery (contour) of the certificate image area 720 by performing edge detection as image recognition, for example, and divides the image area in the certificate read image data 72, which is the application image data, into the certificate image. The certificate image area 720 may be extracted by dividing the area 720 and the background image area 721 . Note that "division" here means "recognition of boundaries" rather than physical separation (cutting out) of image data.

Note that the image recognition processing for determining (position specifying) the certificate image area 720 is not limited to edge detection. For example, the document dividing unit 302 determines whether the image area in the certificate read image data 72 is foreground/background, and divides the foreground image area into a certificate image area 720 and the background image area into a background image area 721 which is a margin. can be determined as In addition to this, the document dividing unit 302 can determine the certificate image area 720 by various known image recognition techniques.

After generating the certificate image data 8, the document dividing unit 302 outputs the generated certificate image data 8 to the examination image storage unit 31 for storage. As a result, the examination unit 13 can display the examination screen 61 and the certificate image data 8 side by side on the display device 53 .

The document dividing unit 302 also separates a plurality of certificate image areas 720 included in the image area of the certificate read image data to generate a plurality of certificate image data 8 . As a result, images of a plurality of certificate documents included in one certificate read image data can be displayed on the display device 53 as separate image data for examination. Therefore, compared with the case where the image information of a plurality of certificates is displayed on the display device 53 as one certificate read image data, the image adjustment work load of the person in charge of examination can be reduced. Therefore, the information processing apparatus 100, which is an image processing apparatus according to this embodiment, can improve examination efficiency.

In this example, the image area in the certificate read image data 72 includes two certificate image areas 720 (certificate image areas 720a and 720b). The document dividing unit 302 separately cuts out the certificate image areas 720a and 720b from the image area in the certificate read image data 72 in the cutout process. Thereby, separate certificate image data 8a and 8b can be generated from a plurality of certificate documents included in one certificate read image data. The document dividing unit 302 determines the positions of all of the plurality of certificate image areas 720 included in the image areas in the certificate read image data 72 by repeatedly executing the discrimination of the certificate image areas 720 by, for example, the image recognition described above. It can be extracted (identified) and cut out from the certificate read image data 72 .

In this way, when the image area of the certificate read image data includes a plurality of certificate image areas 720, the document dividing unit 302 divides the certificate image areas 720 included in the image area of the certificate read image data. can be cut out separately to generate a plurality of certificate image data. In addition, the document dividing unit 302 separately cuts out a plurality of certificate image regions 720 included in the image region of the certificate read image data, and one of the plurality of cut out certificate image regions 720 ( Certificate image data may be generated for a specific certificate image area 720 .
In other words, the document dividing unit 302 can generate one or more pieces of certificate image data by separately cutting out a plurality of certificate image areas included in the image area of the application image data.

When the image area of the certificate read image data includes a plurality of certificate image areas 720, the document dividing unit 302 selects a specific (for example, one) certificate image area 720 ( For example, the certificate image data 8a may be generated by cutting out the certificate image area 720a). In other words, it is not necessary to cut out all of the plurality of certificate image areas 720 included in the image area of the certificate read image data.
In this example, the image area of the certificate read image data includes a plurality of certificate image areas 720 . is included (for example, only the certificate image area 720a is included), the document dividing unit 302 cuts out the certificate image area 720 from the image area of the certificate read image data, and extracts the certificate image data 8a. should be generated.

Next, tilt correction processing in image division processing will be described. For example, when printing, the document is supplied (placed) to the printing machine in a state in which the document is tilted (for example, the original document is rotated horizontally with respect to the outer periphery of the document placement surface (document setting section) of the printing machine). may be At this time, as shown in FIG. 5, a certificate image area 720 (certificate image area 720b in this example) showing the certificate is tilted. Therefore, the document dividing unit 302 corrects the inclination of the generated certificate image data 8 . As a result, when the image data for examination (certificate image data 8) is displayed on the display device 53, the certificate indicated by the certificate image data 8 faces the person to be examined. Therefore, the visibility of the image information of the certificate contained in the certificate image data 8 is improved. Therefore, the information processing apparatus 100, which is an image processing apparatus according to this embodiment, can improve examination efficiency.

The document dividing unit 302 reads the image information in the certificate image data 8 by image recognition, for example, and when the inclination of the image information is detected, rotates and corrects the certificate image data so as to align the image information. You may
Note that the document dividing unit 302 may perform tilt correction processing before cutting out the certificate image area 720 from the certificate read image data 72 to correct the tilt. Inclination correction may be performed on the document image data 8 .
When performing tilt correction on the certificate image area 720, the document dividing unit 302 detects the tilt of the certificate image area 720 in the certificate read image data 72, and corrects the tilt if it occurs. Then, the image area in the certificate read image data 72 is cut out. For example, the document dividing unit 302 derives the inclination angle of the outer edge 720c of the certificate image area 720 with respect to the outer edge of the image area in the certificate read image data 72 (for example, the outer edge of the document placement surface of the printing press), The certificate image area 720 may be rotated based on the tilt angle. Thereby, the inclination of the certificate image area 720 can be corrected.

Further, the document dividing unit 302 may detect a character string from an image area within the certificate image area 720 and calculate the inclination angle of the certificate image area 720 from the inclination of the character string. A character string to be detected may be a plurality of characters or a single character. Note that the document dividing unit 302 calculates an inclination angle based on the inclination of the character string for the certificate image data 8 generated by extracting from the certificate read image data 72, and divides the certificate image data 8 based on the inclination angle. tilt correction may be performed.

Further, the document dividing unit 302 classifies the type of certificate indicated by the generated certificate image data 8 (for example, insurance card, driver's license, etc.). As a result, it is possible to perform image processing according to the type of certificate in subsequent processing. For example, the document dividing unit 302 classifies the type of certificate based on the type area 722 in the certificate image data 8 .
The document dividing unit 302 may specify the position of the type area 722 in the certificate image data 8 by image recognition, for example, and extract image information (for example, character information) indicating the type of the certificate. Determination image data (template image of the application document) used by the document determination unit 301 to determine the attribute of the application document may be used to specify the position of the type area 722 .

Based on the image information (“health insurance card”, “driver’s license”) included in the type area 722, the document dividing unit 302 classifies the type of the certificate indicated by the certificate image data 8a into “health insurance card”, The type of certificate indicated by the certificate image data 8b may be classified as "driver's license".

After classifying the certificate type indicated by the certificate image data 8 , the document dividing unit 302 outputs the type of the certificate to the storage unit 12 . As a result, the type of certificate indicated by the certificate image data 8 is stored in the storage unit 12 in association with at least one of the application image data obtained by the application information obtaining unit 11 and the applicant information indicating the applicant. Further, the document dividing section 302 may output the type of the certificate indicated by the classified certificate image data 8 to the area extracting section 303 that performs subsequent image processing (area extracting processing).

(Area extractor)
Returning to FIG. 2, the area extracting unit 303 extracts the position information of the image area (examination image area) containing the image information to be examined regarding the content of the application document within the image area of the examination image data. . In this embodiment, the image information (examination image information) to be examined among the image information in the image data for examination differs depending on the content of examination (application content of the applicant).
The information processing apparatus 100, which is an image processing apparatus according to the present embodiment, performs area extraction processing in advance in the image processing unit 30 to extract the positions of item areas and content areas corresponding to the item areas in the examination image data. As a result, it is possible to easily specify the image area to be examined when visual examination or automatic examination is performed, and to improve examination efficiency.

In this embodiment, the area extraction unit 303 can execute primary extraction processing and secondary extraction processing as the area extraction processing for extracting the position of the examination image area. Here, an example of region extraction processing (primary extraction processing, secondary extraction processing) will be described using FIGS. 6 to 8 while referring to FIGS. 3 and 5. FIG. FIG. 6 is a diagram showing an example of an examination image area extracted in the primary extraction process. FIG. 7 is a diagram showing an example of the examination image area extracted in the secondary extraction process. FIG. 8 is a diagram showing in more detail the image information contained in the certificate image data 8b.

(Primary extraction process)
In the visual examination displayed on the examination screen 61, the image information (visual examination image information) of the examination image data corresponding to the examination items (questions for examining the content of the application documents) displayed on the examination screen is sent to the examiner. A person visually checks.
Therefore, the region extracting unit 303 extracts the position information of the item region indicating the item of the visual examination image information and the position information of the visual content region indicating the content of the visual examination image information as the position information of the visual examination image region including the visual examination image information. to extract As a result, the examination section 13 can display the examination image data on the display device 53 in such a manner that the examination image area corresponding to the examination item can be easily visually recognized during the visual examination. In addition, since the item area is included in the inspection image area, the person in charge of inspection can easily associate the inspection item with the visual inspection image information. Therefore, examination efficiency can be improved.

The area extracting unit 303 also extracts information including the coordinates of the visual examination image area within the image area of the image data for examination as the position information of the visual examination image area. As a result, the position of the visual examination image area can be specified with higher accuracy in the examination image data, and the visibility of the visual examination image area on the display device 53 can be further improved.

Here, the extraction of the position information of the visual inspection image area will be specifically described. First, an example of extracting the position information of the visual inspection image area from the certificate image data 8 will be described.
FIG. 6(a) is a diagram showing a part of the image area of the certificate image data 8a shown in FIG. For example, the area extracting unit 303 performs visual inspection including visual inspection image information (here, the name indicated by the applicant's identity verification document, health insurance card) in the image area of the certificate image data 8a, which is the image data for inspection. The position information of the image area 80a is extracted. Specifically, in the primary extraction process, the area extraction unit 303 extracts the position information of the certification item area 723 and the position information of the certification content area 724 in the image area of the certificate image data 8a as the position information of the visual inspection image area 80a. to extract

6(b) is a diagram showing an excerpt from the image area of the certificate image data 8b shown in FIG. For example, the area extracting unit 303 extracts visual inspection image information (here, the name indicated by the driver's license, which is the identity verification document of the applicant) in the image area of the certificate image data 8b, which is the image data for inspection. The position information of the examination image area 80b is extracted. Specifically, in the primary extraction process, the area extraction unit 303 extracts the position information of the certification item area 723 and the position information of the certification content area 724 in the image area of the certificate image data 8b as the position information of the visual inspection image area 80b. to extract

The application documents indicated by the image data for examination are classified into standard documents, semi-standard documents, and non-standard documents according to the regularity of arrangement (format) of items to be described. A standard document is a document with a fixed format, a semi-standard document is a document with a highly regular format although the format is not fixed, and an atypical document is a document with a low regularity of format.

The certificate image data 8a is classified by the document dividing unit 302 as having a document type of "insurance card", and corresponds to a semi-standard document. The area extracting unit 303 extracts the coordinates of the visual inspection image area 80a within the image area of the certificate image data 8a by the process corresponding to the semi-standard document in the primary extraction process.

Specifically, the area extraction unit 303 extracts the feature amount of the certificate image data 8a by a known image recognition technique, and extracts the coordinate information of the certification item area 723 in the certificate image data 8a based on the feature amount. do. Further, the area extraction unit 303 acquires link information between the certification item area 723 and the certification content area 724 from the setting file. The setting file is stored in, for example, the examination image storage unit 31, and the linking information includes the position of the content area (top, bottom, left, and right) and the size of the content area (width direction and height direction) with reference to the certification item area 723. pixels). The area extraction unit 303 extracts the coordinates of the certification content area 724 based on the linking information. As a result, the area extraction unit 303 can extract the coordinates of the visual inspection image area 80a in the certificate image data 8a. The region extraction unit 303 causes the storage unit 12 to store the coordinates of the extracted visual inspection image region 80a.

The certificate image data 8b is classified as a "driver's license" by the document dividing unit 302, and corresponds to a standard document. The area extracting unit 303 extracts the coordinates of the visual inspection image area 80b within the image area of the certificate image data 8b by the process corresponding to the standard document in the primary extraction process.

Since the standard document has a fixed format as described above, the coordinate information of the certification item area and the certification content area of the certificate image data 8b is stored in the storage unit 12 in advance. Area extracting section 303 extracts the coordinate information of certification item area 723 and certification content area 724 from storage section 12 when the document type input from document dividing section 302 is “driver's license”. Thereby, the area extracting section 303 can extract the coordinate information of the visual inspection image area 80b. The region extraction unit 303 causes the storage unit 12 to store the coordinates of the extracted visual inspection image region 80b. Note that the area extraction unit 303 may extract the coordinates of the visual inspection image area 80b by performing a known image recognition process on the standard document.

Next, an example of extracting the position information of the visual examination image area from the application form read image data 71 of the examination image data will be described.
FIG. 6C is a diagram showing a part of the image area of the application form read image data 71 shown in FIG. For example, the area extracting unit 303 extracts the position information of the visual examination image area 80c including the visual examination image information (here, the name written by the applicant) in the image area of the application form read image data 71, which is the image data for examination. to extract Specifically, in the primary extraction process, the region extraction unit 303 extracts the position information of the application item region 711 and the position of the application content region 712 within the image region of the application form read image data 71 as the position information of the visual examination image region 80c. Extract information.

The application form read image data 71 has been determined by the document determination unit 301 to have a document attribute of "application form", and corresponds to an atypical document. The area extracting unit 303 extracts the coordinates of the visual examination image area 80c within the image area of the application form read image data 71 by the process corresponding to the irregular document in the primary extraction process.
Specifically, the area extracting unit 303 reads the image information of the application form read image data 71 as character information by character recognition technology (for example, OCR) for the image data, and extracts the character information and the predetermined condition (item area). , the pattern of positional information in which the item area may exist in the read application form image data 71, etc.). Thereby, the area extracting section 303 can extract the coordinate information of the visual inspection image area 80c. The region extraction unit 303 causes the storage unit 12 to store the coordinates of the extracted visual inspection image region 80c. It should be noted that the application form indicated by the application form read image data 71 may be a standard document with a fixed format. In this case, the coordinates of the visual inspection image area 80c within the image area of the application form read image data 71 can be extracted by the process corresponding to the above-described standard document.

In this way, in the primary extraction process, the area extracting unit 303 performs visual examination including visual image information to be examined within the image area of the examination image data (certificate image data 8, application read image data 71). The position information of the image area 80 is extracted. In addition, the area extracting unit 303 extracts the position information of the item area (certification item area 723, application item area 711) indicating the items of the visual image information as the position information of the visual inspection image area 80, and the content indicating the content of the image information. The location information of the area (certification content area 724, application content area 712) is extracted.
Further, the area extraction unit 303 extracts information including the coordinates of the visual inspection image area 80 within the image area of the image data for inspection as the position information of the visual inspection image area 80 .
As a result, the information processing apparatus 100, which is the image processing apparatus according to the present embodiment, can improve the visibility of the visual inspection image area 80 corresponding to the inspection items of the inspection screen 61 on the display device 53, and improve the inspection efficiency. can be done.

(Secondary extraction processing)
In the secondary extraction process, the area extracting unit 303 extracts the position information of the automatic examination image area including the image information to be automatically examined within the image area of the examination image data.
In the automatic examination by the OCR examination server 54, OCR processing is performed on the image information in the content area of the image data for examination, and the processing result is output as digital data (for example, text data). Screening will be conducted according to the screening program. For example, in the OCR examination server 54, the image information "Taro Japan" in the certification content area 724 of the certificate image data 8b and the image information "Taro Japan" in the application content area 712 in the application form read image data 71 are converted into text data by OCR processing. Convert to Further, for example, in the automatic examination program, the text data of the certification content area 724 and the application content area 712 are compared to determine whether or not they match, and the name indicated on the application form and the name indicated on the driver's license are compared. match.

In the secondary extraction process, the area extracting unit 303 extracts the position information of the content area indicating the content of the automatic examination image information to be automatically examined as the position information of the automatic examination image area in the examination image data. As a result, image areas (item areas) that are not subject to automatic review are removed, and only image areas (content areas) that are subject to automatic review in the OCR review server 54 can be output to the OCR review server 54 . Therefore, compared with the case where the OCR processing is performed on the entire examination image data such as the application form read image data 71 and the certificate image data 8, the reading accuracy of the character information in the OCR processing is improved, and the efficiency of the automatic examination is improved. and accuracy can be improved.

Further, the area extraction unit 303 extracts information including the coordinates of the automatic examination image area within the image area of the image data for examination as the position information of the automatic examination image area. As a result, the position of the automatic examination image area is specified with higher accuracy in the examination image data, and in the OCR examination server 54, the reading accuracy of character information in OCR processing is further improved, and the efficiency and accuracy of automatic examination are improved. It can be improved further.

In the secondary extraction process, the area extraction unit 303 extracts the position information of the content area excluding the position information of the item area from the visual inspection image area 80 extracted in the primary extraction process as the position information of the automatic inspection image area. Here, secondary extraction processing will be described as an example of processing for extracting the position information of the content area. can be directly extracted. Further, for example, when the content region is extracted from the examination image data by image recognition processing using AI technology (AI image processing) as will be described later, processing for directly extracting the content region can be performed. Due to the characteristics of AI image processing, extraction accuracy may be improved by directly extracting the content area from the image data for examination. As described above, in the present disclosure, the area extraction process in which the image processing unit 30 (area extraction unit 303) extracts the position of the examination image area can be a process composed of the primary extraction process and the secondary extraction process as described above. Alternatively, a process of directly extracting the content area from the image data for examination may be used.
Here, the secondary extraction processing will be specifically described below.

For example, the area extracting section 303 extracts the position information excluding the position information of the certification item area 723 from the visual inspection image area 80a shown in FIG. 6(a). This makes it possible to extract the position information including the coordinates of the automatic examination image area 81a formed in the certification content area 724 of the certificate image data 8a as shown in FIG. 7(a). The region extracting unit 303 also extracts position information excluding the position information of the certification item region 723 from the visual inspection image region 80b shown in FIG. 6B. This makes it possible to extract the position information including the coordinates of the automatic examination image area 81b formed in the certification content area 724 of the certificate image data 8b as shown in FIG. 7(b).

Further, the area extracting unit 303 extracts the position information of the application item area 711 from the visual inspection image area 80c shown in FIG. 6(c). This makes it possible to extract the position information including the coordinates of the automatic examination image area 81c formed in the application content area 712 of the application form read image data 71 as shown in FIG. 7(c).

In this way, in the secondary extraction process, the area extracting unit 303 extracts the content area (certification content) indicating the content of the automatic examination image information to be automatically examined as the position information of the automatic examination image area 81 in the examination image data. The location information of the area 724 and the application content area 712) is extracted. As a result, the reading accuracy of character information in OCR processing can be improved, and the efficiency and accuracy of automatic examination can be improved.
It should be noted that if the information processing apparatus 100 is not connected to the OCR examination server 54, the area extracting section 303 does not need to perform the secondary extraction process. In other words, in the information processing apparatus 100, the region extracting unit 303 may have a configuration capable of executing at least the primary extraction process.

Note that the coordinate information of the examination image areas (the visual examination image area 80 and the automatic examination image area 81) extracted by the area extraction unit 303 is the coordinate information (X , Y). It may also consist of coordinate information (X, Y) of one corner (for example, upper left corner) of the examination image area and size information of the examination image area based on the corner. The size information may include width W (the number of pixels in the width direction) and height H (the number of pixels in the height direction).

FIG. 8 is a schematic diagram showing in more detail the image area of the certificate image data 8b. In the image area of the certificate image data 8b representing a driver's license, a plurality of certification item areas 723 (certification item areas 723a to 723f) are included. In the image area of the certificate image data 8b, there are a plurality of certification content areas 724 (certification content areas 724a to 724f) as certification content areas containing image information indicating the content of the type of information indicated by the certification item area. included. The certification item areas 723a, 723b, 723c, 723d, 723e, and 723f respectively correspond to the certification content areas 724a, 724b, 724c, 724d, 724e, and 724f.

In the region extracting process, the region extracting unit 303 extracts a certification item region 723 (certification item regions 723a to 723f) and a certification content region 724 (certification content regions 724a to 724f) in the image region of the certificate image data 8b. Regions can be extracted as visual inspection image regions. In other words, the area extracting unit 303 can extract position information of a plurality of visual inspection image areas from the inspection image data by repeatedly executing the coordinate information extraction process described above. As a result, when the visual inspection is displayed on the display device 53, the visibility of the corresponding visual inspection image area for each of the plurality of inspection items displayed on the inspection screen 61 as the inspection progresses can be improved. can.

(Area dividing part)
Based on the position information (coordinate information) of the examination image area extracted by the area extracting unit 303, the area dividing unit 304 cuts out the examination image area from the image area of the examination image data, and extracts the examination image area as new examination image data. Generate segmented image data formed in the examination image area.
For example, the area dividing unit 304 cuts out the automatic examination image area 81 from the image area of the examination image data based on the position information (coordinate information) of the automatic examination image area 81 extracted by the area extraction unit 303, and creates a new image area. Region-divided image data formed in the automatic examination image area 81 is generated as image data for examination. The region division unit 304 stores the generated region division image in the examination image storage unit 31 .
As a result, the data output unit 15 outputs the segmented image to the OCR examination server 54 . In this case, the OCR examination server 54 may treat the area-divided image including the automatic examination image area 81 as the object of OCR processing, and there is no need to extract the automatic examination image area 81 from the examination image data. As a result, the reading accuracy of character information in OCR processing is improved, and the efficiency and accuracy of automatic examination are further improved.

Further, the area dividing unit 304 cuts out the visual inspection image area 80 from the image area of the image data for inspection based on the position information (coordinate information) of the visual inspection image area 80 extracted by the area extracting unit 303, and creates a new image area. Area-divided image data formed in the visual inspection image area 80 may be generated as the image data for inspection. In this case, the examination section 13 can cause the display device 53 to display only the visual examination image area 80 of the image data for examination together with the examination screen. As a result, the visibility of the image information to be examined can be further improved, and examination efficiency can be further improved.

Regardless of whether or not the information processing apparatus 100 is connected to the OCR examination server, the region dividing section 304 is not an essential component of the image processing section 30 . In other words, generation of segmented image data is not essential. For example, the information processing apparatus 100 combines the image data for examination (for example, the application form read image data 71 and the certificate image data 8) with the position information (coordinates) of the automatic examination image area 81 extracted by the area extraction unit 303. to the OCR examination server 54, automatic examination can be performed with high efficiency and high accuracy.
Note that if the image processing section 30 has the area dividing section 304 , only the visual inspection image area 80 may be cut out and the cut out visual inspection image area 80 may be stored in the examination image storage section 31 . In this case, the examination section 13 may be configured to display the clipped visual examination image region 80 on the display device 53 .

As described above, the image processing unit 30 performs image processing to generate at least examination image data (certificate image data 8 and area-divided image by automatic examination image area 81) used for visual examination based on the application image data. It is generated and stored in the examination image storage unit 31 . As a result, the examination section 13 can display the image data for examination on the display device 53 together with the examination screen. Note that the process of storing (storing) the application image data representing the application form in the examination image storage unit 31 by the document determination unit 301 also corresponds to the generation of examination image data.

FIG. 9 shows an example of an examination screen 61 displayed on the display screen of the display device 53. As shown in FIG. An inspection screen 61 and image data for inspection are displayed on the display screen of the display device 53 during visual inspection. The examination screen 61 displays examination items (questions) for examination image data. In this example, the certificate image data 8b is displayed as the examination image data corresponding to the examination item (the name on the personal identification document). As described above, the image processing unit 30 (particularly, the area extracting unit 303) extracts the position information of the visual inspection image area 80 (in this example, the visual inspection image area 80b) by primary extraction processing, and stores it in the storage unit 12. do. Specifically, in the storage unit 12, the position information of the visual inspection image area 80 is stored in association with the data indicating the storage destination of the inspection image data and the inspection item. Therefore, when the examination screen 61 is displayed, the examination section 13 can specify the position of the visual examination image area 80 in the examination image data and display the visual examination image area 80 in a highly visible manner. . As a result, the information processing apparatus 100, which is the image processing apparatus according to the present embodiment, can improve examination efficiency.

In this example, the examination section 13 causes the display device 53 to enlarge and display a visual examination image area 80 including image information corresponding to examination items on the examination screen 61 . The display mode of the visual inspection image area 80 is not limited to enlarged display, and may be emphasized display (display in which the display mode (color, font, outer frame, etc.) is different from other image areas).

Further, as shown in FIG. 10, the examination unit 13 displays a plurality of types of examination image data corresponding to examination items (the name of the identity verification document and the name of the application form) related to the plurality of application documents on the display device 53. image data can be displayed. In this example, the certificate image data 8b and the application form read image data 71 are displayed as the examination image data corresponding to the examination item. Also in this case, the visual inspection image area 80 (in this example, the visual inspection image areas 80b and 80c) can be displayed in a highly visible manner (for example, enlarged display). As a result, the information processing apparatus 100, which is the image processing apparatus according to the present embodiment, can further improve examination efficiency.

(1.2) Hardware Configuration of Information Processing Apparatus FIG. 11 is a schematic diagram showing an example of the hardware configuration of the functional units of the information processing apparatus 100 . As shown in FIG. 11 , the information processing system 1 is implemented by an arithmetic device 10 . The arithmetic device 10 is an information processing device (computer) including a processor 101 , a ROM (Read Only Memory) 102 , a RAM (Random Access Memory) 103 and an auxiliary storage device (memory) 104 .
A reading device 51 , an input device 52 , a display device 53 , and an external storage medium 57 are connected to the computing device 10 via an external interface (I/F) 105 , for example. An external interface (I/F) 105 is, for example, a USB (Universal Serial Bus) port.

Another computer 55 may be connected to the computing device 10 via, for example, a communication interface (I/F) 106 and a network 108 . A communication interface (I/F) 106 is, for example, a LAN (Local Area Network) port, a wireless LAN interface, or the like.
Here, the reading device 51, the input device 52 and the display device 53 are the reading device 51, the input device 52 and the display device 53 connected to the information processing device 100 shown in FIG. The reading device 51 , the input device 52 , the display device 53 and the computer 55 also have a user interface (not shown) for connecting with the computing device 10 . Here, the application information acquisition unit 11, the storage unit 12, the examination unit 13, the image processing unit 30, and the examination image storage of the information processing apparatus 100 are performed by cooperation of the hardware resources of each unit of the arithmetic device 10 with a predetermined program. Each function of the unit 31, the display data output unit 14, and the data output unit 15 is constructed.

The processor 101 is a processor that controls the information processing apparatus 100 as a whole. Processor 101 reads a program stored in ROM 102 via bus 107 and controls information processing apparatus 100 according to the program. The processor 101 controls the information processing apparatus 100 so that the information processing apparatus 100 performs examination processing such as outputting a predetermined examination screen.
The ROM 102 stores an image processing program for executing image processing for generating examination image data, and a program for executing an application information processing method for receiving an application procedure and obtaining examination results by an examiner.
The RAM 103 temporarily stores calculation data, various data input by the examiner via the input device 52, and the like.

The auxiliary storage device 104 is backed up by, for example, a battery (not shown), and retains the storage state even when the power of the information processing system 1 is turned off. The auxiliary storage device 104 stores the image data of the application documents input from the reading device 51 via the external interface 105 . Further, the auxiliary storage device 104 stores various data inputted via the external interface 105 and the communication interface 106 in addition to the input data inputted by the examiner from the input device 52 .

The reading device 51 converts the application documents into electronic data (image data) and inputs the image data to the computing device 10 via the external interface 105 . The reading control by the reading device 51 may be performed by the arithmetic device 10 of the information processing system 1 executing a program, or may be controlled by another device.

The input device 52 is a voice input device such as a keyboard, a card reader, a pointing device, or a microphone.
The display device 53 is, for example, a liquid crystal display (LCD) or an organic EL display (OELD: Organic Electro-Luminescence Display), and receives and displays various data from the arithmetic device 10 via the external interface 105 . The display device 53 is based on, for example, each data read into the memory of the arithmetic device 10, data obtained as a result of executing a program, etc., and image data of application documents obtained by scanning by the reading device 51. Image data for examination, data output in the course of examination by the examination section 13, and the like are displayed.

The external storage medium 57 is, for example, an optical disk such as a CD (Compact Disk), a DVD (Digital Versatile Disk) or a Blu-ray Disc (registered trademark), a semiconductor memory such as a flash memory, or a portable hard disk drive. The external storage medium 57 may store examination data output from the information processing device 100 .

The computer 55 is connected to the computing device 10 via the network 108 via the communication interface 106 . The computer 55 includes a display device and an input device (not shown), inputs commands and input data based on operator's operations to the arithmetic device 10 via the input device via the network 108, and receives various data from the arithmetic device 10. can be displayed on the display device. Network 108 may be either a wired network or a wireless network. If the network 108 is a wireless network such as a wireless LAN, Bluetooth (registered trademark), mobile communication network, or the like, the information processing apparatus 100 can receive commands in real time from remote reviewers, It is possible to display the execution status of programs and the like and acquired data to the user. For example, if the computer 55 is a computer of a local government and the information processing device 100 is a computer of a company entrusted with the examination by the local government, the examination data is output from the information processing system 1 and sent to the local government through the network 108. It is sent to computer 55 .

(1.3) Image Processing Method An example of an information processing method according to this embodiment will be described below with reference to FIG. FIG. 12 is a flowchart illustrating an example of an image processing method according to this embodiment.
When the application information acquisition unit 11 acquires the application image data from the reading device 51 and stores it in the storage unit 12, the document determination unit 301 of the image processing unit 30 reads out the application image data from the storage unit 12 (step S101). For example, the document determination unit 301 reads out application image data (application image data for which corresponding examination image data has not yet been generated) to which storage destination data indicating the storage destination of examination image data is not linked.
Next, the document determination unit 301 determines the attribute of the application document indicated by the read application image data (step S102).
Subsequently, the document determination unit 301 determines whether or not to divide the application image data based on the attributes determined in step S102 (step S103). The document determining unit 301 determines to divide the application image data and outputs the application image data to the document dividing unit 302 when the determined attribute is “certificate document”. Document determination unit 301 stores the application image data in examination image storage unit 31 and further outputs it to area extraction unit 303 when the determined attribute is not “certificate document”, that is, “application form”.

Based on the input of the application image data, the document dividing section 302 of the image processing section 30 cuts out the certificate image data 8 from the application image data (step S104).
Subsequently, the document dividing unit 302 corrects the skew of the certificate image data 8 (step S105), then classifies the type of the certificate indicated by the certificate image data 8 (step S106), and the image processing unit 30 Attributes of the certificate image data are output to the area extraction unit 303 .

Based on the input of the type of certificate from the document dividing unit 302 or the input of the application image data from the document determining unit 301 (NO in step S103), the area extracting unit 303 extracts the image data within the image area of the examination image data. The position information of the examination image area (visual examination image area 80, automatic examination image area 81) is extracted (step S107). The region extraction unit 303 outputs the position information of the examination image region to the region dividing unit 304 when storing the position information of the examination image region in the storage unit 12 . Based on this, the region division unit 304 cuts out the examination image region from the examination image data and stores it in the examination image storage unit 31 .

As described above, in the image processing method according to the present embodiment, the application document including the application information of the applicant among the application documents submitted by the applicant and the application document having at least one attribute of the above-mentioned certificate document of the applicant Application image data, which is image data, is obtained (step S101), the attribute of the application document indicated by the application image data is determined (step S102), and image processing is performed on the application image data according to the attribute. Image data for examination to be used for examination of the content of the application information is generated (steps S103, S104, S108). As a result, for example, it is possible to control image processing such as determining whether or not to divide the application image data based on the attributes of the application document indicated by the application image data (step S104). The image data for examination can be generated by the corresponding image processing, and the examination efficiency can be improved.

(1.4) Image Processing Program An image processing program executed by the information processing apparatus 100, which is the image processing apparatus according to the present embodiment, will be described. The information processing apparatus 100 performs image processing according to a program that causes a computer to execute at least the following operations (a) to (c). The following programs are non-temporarily recorded on a recording medium such as a hard disk drive or memory, or an optical disc such as a DVD disc or Blu-ray (registered trademark). The following programs may be distributed via the Internet. Furthermore, the following programs may be recorded on a cloud server and executed via the Internet.

(a) Application image data that is image data of application documents with at least one of the attributes of the application form containing the application information of the applicant and the certification documents of the applicant among the application documents submitted by the applicant (application form reading Acquisition of image data 71 and certificate read image data 72) (b) Determining whether or not to divide the application image data based on the attribute of the application document indicated by the application image data (c) Application document Image processing is performed on the application image data according to the attributes of the application image data to generate examination image data used for examination of the content of the application information (for example, saving the application form read image data 71 to the examination image storage unit 31, certification At least one of clipping of the document image area 720 and clipping of the examination image area (visual examination image area 80, automatic examination image area 81) is performed.

(1.5) Modification In the information processing apparatus 100 described above, the image processing in the image processing section 30 may be performed using AI technology. For example, the image processing unit 30 may have a trained model capable of classifying the attributes of application documents indicated by application image data into either an application form or a certificate. Thereby, the image processing unit 30 can input the application image data to the learning model and determine the attribute of the document indicated by the application image data based on the classification result. As a result, attribute determination accuracy can be improved.

Further, the image processing unit 30 may have a learned model capable of extracting and correcting the certificate image data 8 based on the application image data representing the certificate and classifying the types of the certificate. As a result, the image processing unit 30 can input the application image data representing the certificate to the learning model, and acquire the certificate image data 8 as an output result. As a result, the generation of the certificate image data 8 and the accuracy of the type classification can be improved.

Further, the image processing section 30 may have a trained model capable of extracting the position information (coordinate information) of the examination image area from the examination image data. As a result, the image processing unit 30 can input the examination image data to the learning model, and acquire the position information (coordinate information) of the examination image area as an output result. Thereby, the accuracy of extracting the position information can be improved. In addition, when extracting the position information using the learned model, the position information of the automatic examination image area 81 can be extracted without the procedure for extracting the visual examination image area 80 (without executing the primary extraction process). can be done. That is, the image processing unit 30 determines the position of the content area (application content area 712, certification content area 724) indicating the content of the image information to be examined (automatic examination image information) as the position information of the automatic examination image area 81. Information can be extracted.
In this way, the image processing unit 30 can improve the accuracy of image processing by using AI technology, and as a result, can improve the efficiency of examination.

Note that the image processing unit 30 extracts the position information of the content area (the application content area 712 and the certification content area 724) from the examination image data (for example, the application form read image data 71 and the certificate image data 8) without using the trained model. may be directly extracted (extracted without executing the primary extraction process). For example, if the application document (certificate, application document) indicated by the application image data is a standard document, the area extraction unit 303 may extract only the coordinate information of the content area stored in the storage unit 12 in advance. . Also, if the application document indicated by the application image data is a semi-standard document, the coordinate information of the content area may be set in the setting file, and the area extraction unit 303 may extract the coordinate information of the content area from the setting file. Further, the area extraction unit 303 may extract the content area from the examination image data by image recognition processing. For example, the area extracting unit 303 compares the image data for examination (for example, the application form read image data 71 and the certificate image data 8) with the image data (image data for determination) of the model (template) of the application document. The coordinates of the image area of the image data for examination corresponding to the content area in the image may be obtained and extracted as the position information of the content area in the image data for examination.

In the information processing apparatus 100 described above, the image processing unit 30 (region extracting unit 303) generates a proof generated from the application form read image data 71 after the attribute determination of the application document and the certificate read image data 72 as examination image data. Although the position information (coordinates) of the image area for examination (at least the visual examination image area 80) is extracted using the document image data 8, the present disclosure is not limited to this.
For example, the image processing unit 30 (area extracting unit 303) uses the application image data (application form read image data 71, certificate read image data 72) after attribute determination of the application document to determine the position of the image area for examination. Information may be extracted. That is, in the information processing apparatus 100 of the present disclosure, without generating examination image data (certificate image data 8) as new image data from the application image data, the application image data to which the attribute of the application document is attached is examined. The position information of the image area for examination may be extracted using the image data for examination.
In this way, the information processing apparatus 100 of the present disclosure only needs to be able to determine at least the attribute of the application document indicated by the application image data. The position information of the image area for inspection (at least the visual inspection image area 80) may be extracted. In other words, the image processing unit 30 in the information processing apparatus 100 only needs to be able to read out the application image data (step S101 above) and determine the attribute of the application document indicated by the application image data (step S102 above). Furthermore, the extraction of the image area for examination (step S107 above) may be executed. Further, a combination of application image data to which information indicating the attribute of the application document is added and the position information of the image area for examination may be treated as the image data for examination.

In this case, for example, the area extraction section 303 of the image processing section 30 may obtain the coordinates of the visual inspection image area 80 in the certificate image area 720 in the certificate read image data 72 . The area extracting unit 303 extracts the coordinates of each of the four corners in the rectangular visual inspection area from the image area of the certificate read image data 72 by various known image recognition techniques, for example, and converts the coordinates into the application image data ( It may be stored in the storage unit 12 in association with the certificate read image data 72). For the application form read image data 71, the coordinates of the visual inspection image area 80 may be obtained as described above. In this case as well, the examination unit 13 determines the position (coordinate ) can be specified, and the visual inspection image area can be displayed on the display device 53 in a highly visible manner. Therefore, examination efficiency can be improved.
Similarly, the image processing unit 30 may extract the position information (coordinates) of the automatic examination image area 81 from the application image data to which the information indicating the attributes of the application documents has been added, and may further divide the area. Image data may be generated. In this case as well, the OCR examination server 54 uses a combination of the application image data output from the information processing device 100 and the position information of the automatic examination image area 81, or uses the area-divided image data to perform highly efficient and accurate processing. Automatic examination can be performed.

Although the present disclosure has been described in terms of embodiments, the scope of the present disclosure is not limited to the illustrated and described exemplary embodiments, and effects equivalent to those for which the present disclosure is intended. Also includes all embodiments. Furthermore, the scope of the present disclosure is not limited to the combination of inventive features defined by the claims, but may be defined by any desired combination of the particular features of each and every disclosed feature.

1 information processing system 9 network 11 application information acquisition unit 12 storage unit 13 examination unit 14 display data output unit 15 data output unit 30 image processing unit 31 examination image storage unit 51 reading device 52 input device 53 display device 54 OCR examination server 100 information Processing device 301 Document determining unit 302 Document dividing unit 303 Region extracting unit 304 Region dividing unit

Claims (10)

an image acquisition unit for acquiring application image data, which is image data of at least one of the attributes of the application form including the applicant's application information and the said applicant's certificate among the application documents submitted by the applicant; ,
determining whether the attribute of the application document indicated by the application image data is the application form or the certificate, performing image processing on the application image data according to the attribute, and processing the application information; and an image processing unit that generates examination image data used for examination of the contents of
The image processing unit
As the image processing, a process of extracting a specific image area from the image area of the application image data and generating new image data including the specific image area as the examination image data can be executed. determining whether to execute the image processing based on the determination result ;
Furthermore, the image processing unit
When the attribute of the application document indicated by the application image data is the certificate, a certificate image area indicating the certificate is cut out from the image area of the application image data as the specific image area, and the examination is performed. generating certificate image data including image information in the certificate image area as the new image data to be image data for the certificate;
classify the type of the certificate based on the image information included in the certificate image data, and classify the type of the certificate or the attribute of the application document into the image area of the image data for examination; In, extracting the position information of the examination image area containing the image information to be examined,
obtaining, from a setting file stored in a predetermined storage area, linking information linking an item area indicating an item of image information to be examined and a content area indicating the content of the image information; location information of an area including the item area and the content area is extracted as primary extraction information based on the information, and location information of the content area obtained by removing the location information of the item area from the primary extraction information is used as the examination image area. is extracted as the location information of
The image processing apparatus , wherein the linking information includes vertical and horizontal positions of the content area with respect to the item area, and a size of the content area. The image processing includes boundary recognition processing for recognizing a boundary between the certificate image area in the image area of the application image data and an image area other than the certificate image area,
2. The image processing unit according to claim 1, wherein the image processing unit determines whether or not to execute the boundary recognition process based on a determination result of the attribute of the application document indicated by the application image data. Image processing device. The image processing unit
When the attribute of the application document indicated by the application image data is the certificate, the boundary recognition processing is executed to set the certificate image area from the image area of the application image data as the specific image area. 3. The image processing apparatus according to claim 2, wherein the certificate image data is generated as the new image data that is clipped and becomes the examination image data. The image processing unit
4. The image processing apparatus according to claim 3, wherein a plurality of the certificate image areas included in the image area of the application image data are separately cut out to generate one or a plurality of the certificate image data. 5. The image processing apparatus according to claim 3, wherein the image processing unit corrects a tilt of the certificate image data. The image processing unit
6. The image according to any one of claims 1 to 5 , wherein information including the coordinates of the examination image area within the image area of the examination image data is extracted as the position information of the examination image area. processing equipment. The image processing unit
Based on the extracted position information, the examination image area is cut out from within the image area of the examination image data, and area-divided image data formed in the examination image area is generated as the new examination image data. The image processing apparatus according to any one of claims 1 to 6 , characterized by: An examination image data storage unit that stores the examination image data,
The image processing apparatus according to any one of claims 1 to 7 , wherein the image processing unit stores the generated examination image data in the examination image data storage unit. A computer-implemented image processing method comprising:
Acquiring application image data, which is image data of at least one attribute of the application form including the applicant's application information and the certification document of the applicant among the application documents submitted by the applicant,
determining whether the attribute of the application document indicated by the application image data is the application form or the certificate, and performing image processing on the application image data according to the attribute to perform the application information; Generate image data for examination used for examination of the contents of
As the image processing, a process of extracting a specific image area from the image area of the application image data and generating new image data including the specific image area as the examination image data can be executed. determining whether to execute the image processing based on the determination result ;
Furthermore, as the image processing,
When the attribute of the application document indicated by the application image data is the certificate, a certificate image area indicating the certificate is cut out from the image area of the application image data as the specific image area, and the examination is performed. generating certificate image data including image information in the certificate image area as the new image data to be image data for the certificate;
classify the type of the certificate based on the image information included in the certificate image data, and classify the type of the certificate or the attribute of the application document into the image area of the image data for examination; In, extracting the position information of the examination image area containing the image information to be examined,
obtaining, from a setting file stored in a predetermined storage area, linking information linking an item area indicating an item of image information to be examined and a content area indicating the content of the image information; location information of an area including the item area and the content area is extracted as primary extraction information based on the information, and location information of the content area obtained by removing the location information of the item area from the primary extraction information is used as the examination image area. is extracted as the location information of
The image processing method, wherein the linking information includes vertical and horizontal positions of the content area with respect to the item area and a size of the content area. Acquiring application image data, which is image data of at least one attribute of an application form containing application information of the applicant and the certification documents of the applicant among the application documents submitted by the applicant;
Determining whether the attribute of the application document indicated by the application image data is the application form or the certification document;
performing image processing on the application image data according to the attribute to generate examination image data used for examination of the contents of the application information;
As the image processing, a process of extracting a specific image area from the image area of the application image data and generating new image data including the specific image area as the examination image data can be executed. determining whether to execute the image processing based on the determination result;
Furthermore, as the image processing,
When the attribute of the application document indicated by the application image data is the certificate, a certificate image area indicating the certificate is cut out from the image area of the application image data as the specific image area, and the examination is performed. generating certificate image data including image information in the certificate image area as the new image data to be image data for the certificate;
classify the type of the certificate based on the image information included in the certificate image data, and classify the type of the certificate or the attribute of the application document into the image area of the image data for examination; Extracting the position information of the examination image area containing the image information to be examined in the above;
obtaining, from a setting file stored in a predetermined storage area, linking information linking an item area indicating an item of image information to be examined and a content area indicating the content of the image information; location information of an area including the item area and the content area is extracted as primary extraction information based on the information, and location information of the content area obtained by removing the location information of the item area from the primary extraction information is used as the examination image area. extracting as location information of
on the computer , and
The image processing program, wherein the linking information includes the vertical and horizontal positions of the content area with respect to the item area and the size of the content area.

Images