JP4486995B2 - Image processing system - Google Patents

Description

  The present invention relates to an image processing system and an image processing method for determining the degree of similarity between input image data and registered image data registered in advance and performing control according to the determination result.

  Conventionally, the input image data obtained by reading a document image with a scanner is compared with a registered image registered in advance to determine the degree of similarity between them, and it is determined that the image is similar to the registered image. In addition, a technique for prohibiting processing (for example, copying) on the input image data is used.

  As a method for determining the similarity, for example, a keyword is extracted from an image using an OCR (Optical Character Reader) or the like and matching is performed based on the keyword, or the target image is limited to a form image having a ruled line, and matching based on ruled line characteristics is performed. And a method of determining based on the input image data and the color distribution of the registered image are known.

  Further, Patent Document 1 generates a descriptor that is selected so as to be invariant to distortion caused by digitization of the document from the characteristics of the input document and a difference between the input document and a matching document in the document database, A technique for matching an input document with a document in the document database by using this descriptor and a descriptor database that indicates a list of documents including a feature in which the descriptor is extracted and the descriptor is extracted is disclosed. In this technique, when the descriptor database is scanned, the voting results for each document in the document database are totaled, and a document having the maximum number of votes or a document whose number of votes exceeds a certain threshold value is regarded as a consistent document. ing.

Further, as a technique for controlling processing on input image data in accordance with the similarity determination result, for example, based on a pattern detected from input image data in order to cope with counterfeit bills and securities by a color image forming apparatus. An image forming apparatus that determines whether input image data is image data of banknotes, securities, or the like (registered image) and determines that the input image data is image data of a registered image. There are known techniques for adding a specific pattern to an image to be output so that the image can be specified, painting a copy image, or prohibiting a copy operation.
JP 7-282088 (released on October 27, 1995)

  However, in the above conventional technique, when it is determined that the input image data is similar to the registered image, the processing content for the input image data is limited (addition of a specific pattern, painting of a copy image, prohibition of copying operation, etc.) However, the processing content for the input image data is set to be constant (addition of a specific pattern, painting of a copied image, or prohibition of copying operation) depending on whether or not it is similar to a registered image. Is low and is not easy to use.

  For example, in recent offices of companies and the like, there are many cases where a multifunction machine having a copy function, a fax function, a filing function, an electronic distribution function, and the like is installed. Also, these multifunction devices are often shared by a plurality of users or a plurality of groups. In such a case, it is often desirable to perform processing (copying, fax transmission, filing, electronic distribution, etc.) on a document (input image data) according to a predetermined processing rule determined for each user or group. In addition, there are cases where it is desired to perform a predetermined process according to the type of document on the document.

  However, in the above-described conventional technique, when it is determined that the document is similar to the registered image, only the processing for the document is considered, and collation is performed with the user, the group to which the user belongs, the type of the document, or the like. The processing content cannot be set according to the result. For this reason, every time processing such as copying, fax transmission, filing, electronic distribution, etc. is performed on the original, it is necessary for the user to set the processing contents in detail, which is very troublesome.

  In the conventional technique, it is necessary to store a registered image or a feature amount of the registered image in a memory in the image processing apparatus. However, since the storage capacity of the memory of the image processing apparatus is limited, the number of images that can be registered is limited. For this reason, in particular, when one image processing apparatus is shared by a plurality of users or a plurality of groups, the number of images that can be registered per person or per group is reduced.

  In addition, when the number of registered images increases and the storage capacity becomes insufficient, it is possible to change the storage capacity by replacing the memory. It is actually difficult to exchange with other memories.

  The present invention has been made in view of the above-described problems, and an object thereof is to set processing contents for input image data by a user in an image processing apparatus that determines the similarity between input image data and a registered image. In addition to reducing the burden, it is intended to prevent the memory capacity of the memory provided in the image processing apparatus from becoming insufficient even when the number of registered images increases.

  In order to solve the above problems, the first image processing apparatus of the present invention can communicate with an input data acquisition unit that acquires input image data and a feature amount extraction unit that extracts the feature amount of the input image data. The information acquisition unit for acquiring the feature amount of the registered image from the information storage device connected to the input image data is compared with the feature amount of the registered image by comparing the feature amount of the input image data with the feature amount of the registered image. An image processing apparatus comprising: a similarity determination unit that determines whether or not a control unit is configured to control an operation of a processing unit that performs processing on the input image data according to a determination result of the similarity determination unit; The information acquisition unit acquires processing rule information indicating processing content to be applied to input image data determined to be similar to the registered image from the information storage device, and the control unit performs the processing In the department It is characterized in that control based on the processing content for the input image data determined to be similar to the reference image in the processing rule information corresponding to the registered image.

  In order to solve the above problems, the second image processing apparatus of the present invention includes an input data acquisition unit that acquires input image data, and a feature amount extraction unit that extracts the feature amount of the input image data. An image processing apparatus comprising: an information transmission unit configured to transmit a feature amount of input image data extracted by the feature amount extraction unit to an information storage device connected to be communicable; and the input image from the information storage device An information acquisition unit that acquires processing rule information indicating processing content to be applied to data, and a control unit that controls the operation of the processing unit that performs processing on the input image data based on the processing rule information. It is characterized by being.

  The processing unit may be provided inside the image processing apparatus, or may be connected to the image processing apparatus so as to be communicable. In addition, the processing unit, for example, for input image data, copying, printing, electronic distribution, facsimile transmission, filing, image correction, scaling, rotation, movement, trimming, composition of other images, conversion of data format , Any one of the encoding processes or a combination of any two or more of the above processes may be performed. Further, the input data acquisition unit may acquire input image data by reading a document with a scanner, for example, and an input created by inputting necessary items using software as a format of electronic data The image data may be acquired, or the input image data directly created as electronic data may be acquired, and transmitted from another device communicably connected to the image processing device. The input image data may be acquired. The information storage device may be, for example, a device that is detachably attached to the image processing device, or a device that is communicably connected via a wired or wireless connection.

  According to the first image processing apparatus, the input data acquisition unit acquires the input image data, the feature amount extraction unit extracts the feature amount of the input image data, and the information acquisition unit is connected to be communicable. The feature amount of the registered image is acquired from the storage device, and the similarity determination unit compares the feature amount of the input image data with the feature amount of the registered image to determine whether or not the input image data is similar to the registered image. The information acquisition unit acquires processing rule information indicating processing contents to be applied to the input image data determined to be similar to the registered image from the information storage device, and the control unit in the processing unit The processing content for the input image data determined to be similar to the registered image is controlled based on the processing rule information corresponding to the registered image.

  According to the second image processing apparatus, the input data acquisition unit acquires the input image data, the feature amount extraction unit extracts the feature amount of the input image data, and the information transmission unit extracts the feature amount of the input image data. Is transmitted to the information storage device connected to be communicable. Then, the information acquisition unit acquires processing rule information indicating the processing content to be applied to the input image data from the information storage device, and the control unit inputs the operation of the processing unit that performs processing on the input image data. Control is performed based on processing rule information corresponding to a registered image determined to be similar to image data.

  Thus, according to the first and second image processing devices, processing corresponding to the registered image stored in the information storage device is performed on the input image data determined to be similar to the registered image. Since it can control based on rule information, the setting operation of the processing content with respect to input image data by a user can be simplified, and a user's convenience can be improved. Further, since the feature amount and the processing rule information of the registered image can be stored in the information storage device, the image processing device can be compared with the case where the information is stored in the storage means provided in the image processing device. The storage capacity required for the storage means provided in the can be reduced. Further, for example, the feature amount of the registered image and the processing rule information can be distributed and stored in a plurality of information storage devices. In this case, for example, the feature amount and processing rule of the registered image stored in each information storage device can be set according to the needs of the user who owns or uses the information storage device.

  Further, any one of the image processing apparatuses described above includes a display unit that displays information and an instruction input unit that receives an instruction input from a user, and the control unit displays the processing content indicated in the processing rule information. It is possible to display on the display unit, and when the instruction input unit receives an instruction to execute a process based on the processing content, the processing unit may execute a process based on the processing content with respect to the input processing data. Good.

  According to said structure, the process content based on process rule information is shown to a user, and the process based on the said process content is performed according to a user's execution instruction. Therefore, it is possible to prevent the processing not conforming to the user's wish from being performed on the input image data.

  In the first image processing apparatus, the processing rule information acquired from the information storage device for the feature amount of the second registered image and the input image data determined to be similar to the second registered image. Regardless of whether the information storage unit stores the common processing rule information indicating the processing content to be applied, the similarity determination unit compares the feature amount of the input image data with the feature amount of the second registered image. It is determined whether or not the input image data is similar to the second registered image, and the control unit processes the input image data determined to be similar to the second registered image in the processing unit. May be configured to be controlled based on the common processing rule information corresponding to the second registered image.

  According to the above configuration, the input image data determined to be similar to the second registered image is based on the processing content set in the common processing rule information regardless of the processing rule information acquired from the information processing apparatus. Processing can be performed.

  In the second image processing apparatus, the processing rule information acquired from the information storage device for the feature amount of the second registered image and the input image data determined to be similar to the second registered image. Regardless of the information storage unit storing the common processing rule information indicating the processing content to be applied, the feature amount of the input image data is compared with the feature amount of the second registered image, and the input image data is A similarity determination unit that determines whether or not the image is similar to the second registered image, and the control unit determines a processing content for the input image data determined to be similar to the second registered image in the processing unit. The control may be based on the common processing rule information corresponding to the second registered image.

  According to said structure, with respect to input image data determined to be similar to the second registered image, the predetermined processing content defined in the common processing rule information regardless of the processing rule information acquired from the information processing device Processing based on can be performed.

  In the second image processing apparatus, the processing rule information acquired from the information storage device for the feature amount of the second registered image and the input image data determined to be similar to the second registered image. Regardless of whether the information storage unit stores common processing rule information indicating the processing content to be applied, the information transmission unit transmits the feature amount of the input image data to the information storage device before transmitting the information storage unit. The feature amount of the second registered image and the common processing rule information stored in the unit may be transmitted to the information storage device.

  According to the above configuration, in the information storage device, it is possible to determine not only whether the input image data is similar to the registered image but also whether the input image data is similar to the second registered image. become. Therefore, by configuring the information storage device to determine the processing rule information to be transmitted to the image processing device based on the similarity determination result for the registered image and the second registered image, the processing content for the input image data is set to the registered image and the second image. Control can be performed based on the similarity determination result for the registered image.

  Further, in any one of the configurations described above, an authentication storage unit that stores identification information of a user who is permitted to execute an editing process on information stored in the information storage unit, and an instruction input unit that receives a user's instruction input Based on the information input via the instruction input unit and the identification information stored in the authentication storage unit, the information is stored in the information storage unit for the user who has input to the instruction input unit. It is good also as a structure provided with the user authentication part which judges whether the edit with respect to information is permitted.

  According to the above configuration, it is possible to prevent the feature amount of the second registered image and the common processing rule information from being arbitrarily edited by an unspecified number of users.

  In any of the above-described configurations, the processing content indicated in the common processing rule information may be configured to prohibit or restrict execution of processing on input image data.

  According to said structure, execution of the process with respect to the input image data determined to be similar to a 2nd registration image can be prohibited or restrict | limited.

  A first information storage device of the present invention includes a storage unit that stores a feature amount of a registered image and processing rule information indicating processing contents to be applied to input image data determined to be similar to the registered image. And a data transmission unit for transmitting the feature amount of the registered image and the processing rule information corresponding to the registered image to the first image processing apparatus.

  According to the above configuration, the storage unit stores the feature amount of the registered image and the processing rule information indicating the processing content to be applied to the input image data determined to be similar to the registered image. The unit transmits the feature amount of the registered image and the processing rule information corresponding to the registered image to the first image processing apparatus.

  Thereby, in the first image processing apparatus, it is determined whether the input image data is similar to the registered image, and processing for the input image data determined to be similar is processed rule information corresponding to the registered image. Can be controlled based on Therefore, it is possible to simplify the setting operation of the processing content for the input image data by the user and to improve the convenience for the user. Further, the storage capacity required for the storage unit provided in the image processing apparatus can be reduced as compared with the case where the feature amount of the registered image and the processing rule information are stored in the storage unit provided in the image processing apparatus.

  The second information storage device of the present invention includes a data acquisition unit that acquires a feature amount of input image data from the second image processing device, a feature amount of a registered image, and an input determined to be similar to the registered image. A storage unit for storing processing rule information indicating processing contents to be applied to the image data, a feature amount of the input image data and a feature amount of the registered image are compared, and the input image data is stored in the registered image. Similarity determination unit that determines whether or not they are similar, and data that transmits the processing rule information corresponding to the registered image to the image processing device when it is determined that the input image data is similar to the registered image And a transmission unit.

  According to said structure, a memory | storage part memorize | stores the feature-value of a registration image, and the process rule information which shows the process content which should be applied with respect to the input image data determined to be similar to the said registration image. Then, the data acquisition unit acquires the feature amount of the input image data from the second image processing device, and the similarity determination unit compares the feature amount of the input image data with the feature amount of the registered image to obtain the input image data. It is determined whether or not the image is similar to the registered image. Then, when it is determined that the input image data is similar to the registered image, the data transmitting unit transmits the processing rule information corresponding to the registered image to the second image processing apparatus.

  Thereby, the process in the image processing apparatus for the input image data determined to be similar to the registered image can be controlled based on the processing rule information corresponding to the registered image. Therefore, it is possible to simplify the setting operation of the processing content for the input image data by the user and to improve the convenience for the user. Further, the storage capacity required for the storage unit provided in the image processing apparatus can be reduced as compared with the case where the feature amount of the registered image and the processing rule information are stored in the storage unit provided in the image processing apparatus.

  In addition, the data acquisition unit is common to indicate the processing content to be applied to the feature amount of the second registered image and the input image data determined to be similar to the second registered image regardless of the processing rule information. Processing rule information is acquired from the image processing device, and the similarity determination unit compares the feature amount of the input image data with the feature amount of the second registered image acquired by the data acquisition unit to obtain the input image data. It is determined whether or not the second registered image is similar, and when the input image data is determined to be similar to the second registered image, the data transmission unit adds the second registered image to the second registered image. The corresponding common processing rule information may be transmitted to the image processing apparatus as processing rule information applied to the input data.

  According to the above configuration, it is possible to cause the image processing apparatus to perform processing based on the predetermined processing content defined in the common processing rule information for the input image data determined to be similar to the second registered image. . Further, the processing in the image processing apparatus can be simplified as compared with the case where the similarity determination for the second registered image is performed in the image processing apparatus.

  In any one of the information storage devices described above, the feature amount of the registered image stored in the storage unit, the processing rule information corresponding to the registered image, and the processing rule information stored in the storage unit are changed. A registration information acquisition unit that acquires at least one of the change information for the information and a registration processing unit that controls information to be stored in the storage unit based on the information acquired by the registration information acquisition unit Good.

  According to said structure, the information memorize | stored in the said memory | storage part based on the information which the registration information acquisition part acquired can be added or changed. Therefore, it is possible to appropriately set the processing content for the input image data similar to the registered image in response to a request from a user who owns or uses the information storage device.

  In order to solve the above problems, an image processing system of the present invention includes an input data acquisition unit that acquires input image data, and an image processing apparatus that includes a control unit that controls the processing content of the input image data, and registration An image processing system including an information storage device including a storage unit that stores a feature amount of an image, a feature amount extraction unit that extracts a feature amount of the input image data, a feature amount of the input image data, and the above A similarity determination unit that compares the feature amount of a registered image and determines whether the input image data is similar to the registered image, provided in at least one of the image processing device and the information storage device In addition to the feature amount of the registered image, the storage unit stores processing rule information indicating the processing content to be applied to the input image data determined to be similar to the registered image. Cage, the control unit has a processing for the input image data determined to be similar to the registration images and controls based on the processing rule information corresponding to the registered image.

  According to the above configuration, the input data acquisition unit acquires the input image data, the feature quantity extraction unit extracts the feature quantity of the input image data, and the similarity determination unit uses the feature quantity of the input image data and the feature quantity of the registered image. To determine whether the input image data is similar to the registered image. Further, the storage unit stores the feature amount of the registered image and processing rule information indicating the processing content to be applied to the input image data determined to be similar to the registered image, and the control unit stores the registered image. Is controlled based on processing rule information corresponding to the registered image.

  Accordingly, the process for the input image data determined to be similar to the registered image can be controlled based on the processing rule information corresponding to the registered image stored in the information storage device. It is possible to simplify the operation of setting the processing content for the input image data and improve the convenience for the user. Further, since the feature amount and the processing rule information of the registered image can be stored in the information storage device, the image processing device can be compared with the case where the information is stored in the storage means provided in the image processing device. The storage capacity required for the storage means provided in the can be reduced. Further, for example, the feature amount of the registered image and the processing rule information can be distributed and stored in a plurality of information storage devices. In this case, for example, the feature amount and processing rule of the registered image stored in each information storage device can be set according to the needs of the user who owns or uses the information storage device.

  The image processing apparatus includes a personal authentication information acquisition unit that acquires personal authentication information of the user, and stores a personal authentication information storage unit that stores the user ID and the user personal authentication information in association with each other. The personal authentication information acquired by the authentication information acquisition unit is compared with the personal authentication information stored in the personal authentication information storage unit, and the user ID corresponding to the personal authentication information acquired by the personal authentication information acquisition unit is detected. A personal authentication processing unit is provided in at least one of the image processing device and the information storage device, and the control unit has a user ID corresponding to the personal authentication information acquired by the personal authentication information acquisition unit. After the detection, a configuration for controlling the processing for the input image data determined to be similar to the registered image based on the processing rule information corresponding to the registered image. It may be.

  According to said structure, when the user who input input image data is a user registered previously, the process based on the process rule information registered previously can be performed.

  Further, at least a part of the processing rule information is individual processing rule information set individually for each user, and the storage unit converts the individual processing rule information into a user ID of a user corresponding to the individual processing rule information. The registered image is determined to be similar to the input image data in the individual processing rule information corresponding to the user ID detected by the personal authentication processing unit. The processing on the input processed image data may be controlled based on the individual processing rule information corresponding to the above.

  According to said structure, the user who input input image data can be specified, and the process with respect to input image data can be controlled based on the individual process rule information corresponding to the said user.

  The personal authentication information may be biometric information. According to said structure, a user's authentication process can be performed more accurately. In addition, since it is not necessary for the user to memorize a personal identification number or a password, the convenience for the user can be further improved.

  In order to solve the above problems, an image processing method of the present invention includes an input data acquisition unit that acquires input image data, and an image processing apparatus that includes a control unit that controls processing content for the input image data, and registration An image processing method in an image processing system including an information storage device including a storage unit that stores a feature amount of an image, the feature amount extracting step for extracting a feature amount of the input image data, and the input image data A similarity determination step of comparing the feature amount of the registered image with the feature amount of the registered image to determine whether the input image data is similar to the registered image, and the registered image stored in the storage unit Processing rule acquisition step in which the image processing device acquires processing rule information indicating processing content to be applied to the input image data determined to be similar to the information storage device, and The processing for the input image data determined to be similar to the serial register image is characterized by comprising a processing control step of controlling, based on the processing rule information corresponding to the registered image.

  According to the above method, the feature amount of the input image data acquired by the input data acquisition unit of the image processing device is extracted in the feature amount extraction step, and the feature amount of the input image data and the storage unit of the information storage device in the similarity determination step Is compared with the feature quantity of the registered image stored in the table, and it is determined whether or not the input image data is similar to the registered image. In addition, the image processing apparatus stores processing rule information indicating processing contents to be applied to the input image data determined to be similar to the registered image stored in the storage unit in the processing rule acquisition step. Obtain from the device. Then, in the process control step, the process for the input image data determined to be similar to the registered image is controlled based on the process rule information corresponding to the registered image.

  As a result, the processing for the input image data determined to be similar to the registered image can be controlled based on the processing rule information corresponding to the registered image stored in the storage unit of the information storage device. Therefore, it is possible to simplify the setting operation of the processing content for the input image data by the user and to improve the convenience for the user. Further, since the feature amount and the processing rule information of the registered image can be stored in the information storage device, the image processing device can be compared with the case where the information is stored in the storage means provided in the image processing device. The storage capacity required for the storage means provided in the can be reduced. Further, for example, the feature amount of the registered image and the processing rule information can be distributed and stored in a plurality of information storage devices. In this case, for example, the feature amount and processing rule of the registered image stored in each information storage device can be set according to the needs of the user who owns or uses the information storage device.

  An image forming apparatus of the present invention includes any one of the above-described image processing apparatuses and an image output unit that forms an image corresponding to input image data on a recording material. An image transmission apparatus according to the present invention includes any one of the above-described image processing apparatuses and a transmission apparatus that transmits input image data to another apparatus that is communicably connected. The image reading apparatus of the present invention includes an image input apparatus that reads an original image and acquires input image data, and any one of the image processing apparatuses described above.

  According to the image forming apparatus, the image transmitting apparatus, and the image reading apparatus, the processing for the input image data determined to be similar to the registered image is performed on the registered image stored in the storage unit of the information storage device. Since control can be performed based on the corresponding processing rule information, it is possible to simplify the setting operation of the processing content for the input image data by the user and improve the convenience for the user. Further, since the feature amount and the processing rule information of the registered image can be stored in the information storage device, the image processing device can be compared with the case where the information is stored in the storage means provided in the image processing device. The storage capacity required for the storage means provided in the can be reduced. Further, for example, the feature amount of the registered image and the processing rule information can be distributed and stored in a plurality of information storage devices. In this case, for example, the feature amount and processing rule of the registered image stored in each information storage device can be set according to the needs of the user who owns or uses the information storage device.

  The image processing apparatus may be realized by a computer. In this case, a program that causes the image processing apparatus to be realized by the computer by causing the computer to operate as each unit, and a computer reading that records the program. Possible recording media are also included in the scope of the present invention.

  As described above, in the first image processing apparatus of the present invention, the processing rule information indicating the processing content to be applied to the input image data determined by the information acquisition unit to be similar to the registered image. Is acquired from the information storage device, and the control unit controls processing for input image data determined to be similar to the registered image based on the processing rule information corresponding to the registered image.

  The second image processing apparatus of the present invention includes an information transmission unit that transmits the feature amount of the input image data extracted by the feature amount extraction unit to an information storage device that is communicably connected, and the information storage device. The information acquisition part which acquires the process rule information which shows the processing content which should be applied with respect to the said input image data, and the control part which controls the process with respect to the said input image data based on the said process rule information are provided.

  The first information storage device of the present invention stores a feature amount of a registered image and processing rule information indicating processing contents to be applied to input image data determined to be similar to the registered image. A data transmission unit that transmits the feature amount of the registered image and the processing rule information corresponding to the registered image to the image processing apparatus.

  Further, the second information storage device of the present invention includes a data acquisition unit that acquires the feature amount of the input image data from the image processing device, the feature amount of the registered image, and the input image data determined to be similar to the registered image. A storage unit for storing processing rule information indicating the processing content to be applied to the image, and comparing the feature amount of the input image data with the feature amount of the registered image, so that the input image data is similar to the registered image. A similarity determination unit that determines whether the input image data is similar to the registered image, and a data transmission unit that transmits the processing rule information corresponding to the registered image to the image processing device And.

  An image processing system according to the present invention stores an image processing apparatus including an input data acquisition unit that acquires input image data, a control unit that controls processing content of the input image data, and a feature amount of a registered image. An image processing system including an information storage device including a storage unit, wherein a feature amount extraction unit that extracts a feature amount of input image data is compared with a feature amount of the input image data and the feature amount of the registered image A similarity determination unit that determines whether the input image data is similar to the registered image is provided in at least one of the image processing device and the information storage device, and the storage unit In addition to the feature amount of the registered image, processing rule information indicating the processing content to be applied to the input image data determined to be similar to the registered image is stored, and the control unit It is controlled on the basis of the processing for the input image data determined to be similar to the recorded image in the processing rule information corresponding to the registered image.

  An image processing method according to the present invention stores an image processing apparatus including an input data acquisition unit that acquires input image data, a control unit that controls processing content of the input image data, and a feature amount of a registered image. An image processing method in an image processing system including an information storage device including a storage unit, the feature amount extracting step for extracting the feature amount of the input image data, the feature amount of the input image data, and the registered image A similarity determination step for determining whether or not the input image data is similar to the registered image by comparing with the feature amount, and determining that the input image data is similar to the registered image stored in the storage unit Processing rule acquisition process in which the image processing device acquires processing rule information indicating the processing content to be applied to the input image data obtained from the information storage device, and similar to the registered image The processing for the input image data determined as that and a processing control step of controlling, based on the processing rule information corresponding to the registered image.

  Therefore, the process for the input image data determined to be similar to the registered image can be controlled based on the processing rule information corresponding to the registered image stored in the information storage device. It is possible to simplify the operation of setting the processing content for the input image data and improve the convenience for the user. Further, since the feature amount and the processing rule information of the registered image can be stored in the information storage device, the image processing device can be compared with the case where the information is stored in the storage means provided in the image processing device. The storage capacity required for the storage means provided in the can be reduced.

[Embodiment 1]
An embodiment of the present invention will be described. In the present embodiment, an example in the case where the present invention is applied to a digital color multifunction peripheral (MFP) will be described.

(1-1. Configuration of Digital Color Multifunction Machine 1)
FIG. 2 is a perspective view of a digital color multifunction peripheral (image processing apparatus, image forming apparatus, image reading apparatus) 1 according to the present embodiment, and FIG. 3 is a block diagram showing a schematic configuration of the digital color multifunction peripheral 1. The digital color multifunction peripheral 1 has a copy function, a printer function, a facsimile transmission function, a scanner function, a scan to e-mail function, and the like.

  As shown in FIGS. 2 and 3, the digital color multifunction peripheral 1 includes a color image input device 2, a color image processing device 3, a color image output device 4, a communication device 5, an operation panel 6, a card reader 91, and the like. Yes.

  The color image input device (image reading device) 2 is composed of a scanner unit (not shown) having a device that converts optical information into an electrical signal, such as a CCD (Charge Coupled Device), for example, and a reflected light image from a document. Are output to the color image processing apparatus 3 as analog signals of RGB (R: red, G: green, B: blue).

  The color image processing apparatus 3 includes an A / D conversion unit 11, a shading correction unit 12, a document matching processing unit 13, an input tone correction unit 14, a region separation processing unit 15, a color correction unit 16, and a black generation and under color removal unit 17. A spatial filter processing unit 18, an output tone correction unit 19, and a tone reproduction processing unit 20. An analog signal output from the color image input device 2 to the color image processing device 3 is converted into an A / D conversion unit 11, a shading correction unit 12, a document matching processing unit 13, and an input tone correction unit in the color image processing device 3. 14, the region separation processing unit 15, the color correction unit 16, the black generation and under color removal unit 17, the spatial filter processing unit 18, the output gradation correction unit 19, and the gradation reproduction processing unit 20 are sent in this order, and CMYK digital color The signal is output to the color image output device 4 as a signal.

  The A / D (analog / digital) converter 11 converts RGB analog signals into digital signals.

  The shading correction unit 12 performs a process for removing various distortions generated in the illumination system, the imaging system, and the imaging system of the color image input apparatus 2 on the digital RGB signal sent from the A / D conversion unit 11. Is. Further, the shading correction unit 12 performs a process of converting color balance adjustment and a signal such as a density signal that can be easily handled by the image processing system employed in the color image processing apparatus 3.

  The document matching processing unit 13 extracts the feature amount of the input image data. Also, similarity determination processing (processing for determining whether there is similarity / no similarity; processing for matching; matching processing) between the input image data and the registered image is performed. In addition, when there is a registered image determined to be similar, execution of processing on the input image data based on a processing rule (a common processing rule or an individual processing rule described later) registered in association with the registered image Limit. Also, a registration process is performed in which the index of the input image data, the feature amount of the input image data, and the processing rule for the input image data are registered in association with each other. Further, the document matching processing unit 13 outputs the input RGB signal as it is to the input tone correction unit 14 at the subsequent stage. Details of the document collation processing unit 13 will be described later.

  The input tone correction unit 14 performs image quality adjustment processing such as removal of background color (background color density component: background density) and contrast on the RGB signal from which various distortions have been removed by the shading correction unit.

  The region separation processing unit 15 separates each pixel in the input image into one of a character region, a halftone dot region, and a photo region from the RGB signal. Based on the separation result, the region separation processing unit 15 generates a region identification signal indicating which region the pixel belongs to, the color correction unit 16, the black generation and under color removal unit 17, the spatial filter processing unit 18, and the gradation reproduction. The output signal is output to the processing unit 20, and the input signal output from the input tone correction unit 14 is output to the subsequent color correction unit 16 as it is.

  The color correction unit 16 performs a process of removing color turbidity based on spectral characteristics of CMY (C: cyan, M: magenta, Y: yellow) color materials including unnecessary absorption components in order to realize faithful color reproduction. Is.

  The black generation and under color removal unit 17 generates black (K) signals from the CMY three-color signals after color correction, and subtracts the K signals obtained by black generation from the original CMY signals to generate new CMY signals. The process to generate is performed. As a result, the CMY three-color signal is converted into a CMYK four-color signal.

  The spatial filter processing unit 18 performs spatial filter processing using a digital filter on the image data of the CMYK signal input from the black generation and under color removal unit 17 to correct the spatial frequency characteristics. As a result, blurring of the output image and deterioration of graininess can be reduced. Similar to the spatial filter processing unit 18, the gradation reproduction processing unit 20 also performs predetermined processing on the image data of the CMYK signal based on the region identification signal.

  For example, the region separated into characters by the region separation processing unit 15 has a high frequency enhancement amount in the sharp enhancement processing in the spatial filter processing by the spatial filter processing unit 18 in order to improve the reproducibility of black characters or color characters. Increased. At the same time, the tone reproduction processing unit 20 selects binarization or multi-value processing on a high-resolution screen suitable for high-frequency reproduction.

  Further, with respect to the region separated into halftone dot regions by the region separation processing unit 15, the spatial filter processing unit 18 performs low-pass filter processing for removing the input halftone component. The output tone correction unit 19 performs an output tone correction process for converting a signal such as a density signal into a halftone dot area ratio that is a characteristic value of the color image output device 4. Then, gradation reproduction processing (halftone generation) is performed so that the image is finally separated into pixels and each gradation is reproduced. For the region separated into photographs by the region separation processing unit 15, binarization or multi-value processing is performed on the screen with an emphasis on gradation reproducibility.

  The image data subjected to the above-described processes is temporarily stored in a storage device (not shown), read out at a predetermined timing, and input to the color image output device 4.

  The color image output device 4 outputs the image data input from the color image processing device 3 onto a recording material (for example, paper). The configuration of the color image output device 4 is not particularly limited, and for example, a color image output device using an electrophotographic method or an inkjet method can be used.

  The communication device 5 is composed of a modem or a network card, for example. The communication device 5 performs data communication with other devices (for example, personal computers, server devices, other digital multifunction peripherals, facsimile devices, etc.) connected to the network via a network card, a LAN cable, or the like.

  When the image data is transmitted, the communication device 5 performs the transmission procedure with the other party and secures a state in which the image data can be transmitted. Then, the communication device 5 compresses the image data (image data read by the scanner) in a predetermined format. ) Is read from the memory, and necessary processing such as changing the compression format is performed, and then sequentially transmitted to the other party via the communication line.

  Further, when receiving the image data, the communication device 5 performs a communication procedure and receives the image data transmitted from the other party and inputs it to the color image processing device 3. The received image data is subjected to predetermined processing such as expansion processing, rotation processing, resolution conversion processing, output gradation correction, gradation reproduction processing, and the like by the color image processing apparatus 3 and is output by the color image output apparatus 4. The received image data may be stored in a storage device (not shown), and the color image processing device 3 may read it out as necessary to perform the predetermined processing.

  The operation panel 6 includes, for example, a display unit such as a liquid crystal display and setting buttons (none of which are shown), and information corresponding to an instruction from a main control unit (not shown) of the digital color multifunction peripheral 1 is described above. While displaying on a display part, the information input from a user via the said setting button is transmitted to the said main control part. The user requests processing of input image data via the operation panel 6 (for example, processing mode (copying, printing, electronic distribution, facsimile transmission, filing, image data correction, editing, etc.), processing number (number of copies, number of copies). , Input image data transmission destination, etc.) can be input. The main control unit includes, for example, a CPU (Central Processing Unit) and the like, and is based on programs and various data stored in a ROM (not shown) and the like, information input from the operation panel 6, and the like. To control the operation.

  The card reader 91 includes a card insertion slot 92 as shown in FIG. Then, the information stored in the card (external storage device) 93 inserted in the card insertion slot 92 is read and the information is transmitted to and written in the card 93. The details of the card 93 will be described later. As the card 93, for example, an IC card, a memory card, an optical card, or the like can be used. In this embodiment, the case where the card 93 is used as an external storage device will be mainly described. However, the external storage device is not necessarily limited to a card-type storage device. For example, a tape system such as a magnetic tape or a cassette tape, a disk system including a magnetic disk such as a floppy (registered trademark) disk / hard disk, an optical disk such as a CD-ROM / MO / MD / DVD / CD-R, or a mask ROM / An external storage device such as a semiconductor memory system such as EPROM / EEPROM / flash ROM may be used. Further, the card reader 91 and the card insertion slot 92 are configured to write and read information to and from the external storage device according to the external storage device used so that the reading and writing to the external storage device can be performed appropriately. What is necessary is just to change suitably. Further, a portable terminal device such as a mobile phone or a PDF may be connected to the digital color multifunction peripheral 1 via a wired or wireless communication so that a memory provided in these terminal devices may be used as an external storage device.

  The external storage device is not limited to a portable external storage device. For example, an external device such as a personal computer or a server device that is communicably connected to the digital color multifunction peripheral 1 via a network may be used as the external storage device. . In this case, the card reader 91 may be omitted, and information transmission between the digital color multifunction peripheral 1 and the external storage device may be performed via the communication device 5.

(1-2. Configuration of Document Collation Processing Unit)
Next, details of the document matching processing unit 13 will be described. The document matching processing unit 13 according to the present embodiment extracts a plurality of feature points from input image data, determines a set of local feature points for each extracted feature point, and features points from the determined sets. As a quantity that characterizes each selected subset, an invariant for geometric transformation is obtained based on a plurality of combinations of feature points in the subset, and the obtained invariants are combined. By calculating a hash value and voting for a registered image corresponding to the calculated hash value, a search for a registered image similar to the input image data and a determination process of similarity to the registered image (judgment of similarity / no similarity) I do.

  FIG. 1 is a block diagram illustrating a schematic configuration of the document matching processing unit 13 and the card 93. As shown in this figure, the document matching processing unit 13 includes a feature point calculation unit 31, a feature amount calculation unit 32, a voting processing unit 33, a similarity determination processing unit 34, a registration processing unit 35, a control unit 7, and a memory 8. I have.

  The control unit 7 controls the operation of each unit of the document matching processing unit 13 in accordance with an instruction input from the user input from the operation panel 6 or the communication device 5. The control unit 7 may be provided in a main control unit for controlling the operation of each unit of the digital color multifunction peripheral 1, and is provided separately from the main control unit. It may control the operation of the processing unit 13.

  In addition, when it is determined that there is similarity (input image data is image data of a registered image) as a result of the similarity determination processing by the document matching processing unit 13, the control unit 7 associates the memory with the registered image. 8 or based on the processing rules registered in the memory 95 of the card 93, the processing for the input image data is executed. Details of this processing will be described later.

  The memory 8 stores various data used for processing of each unit of the document collation processing unit 13, processing results of each unit, and the like. The memory 8 includes a hash table 101, a common processing table 102, and an individual processing table 103.

  The hash table 101 is a table (storage unit) that stores a registered image index (identification information for identifying a registered image) and a hash value (feature amount) of the registered image in association with each other.

  The common processing table 102 is a table (storage unit) that stores a registered image index registered as a common processed image (second registered image) and a common processing rule for the common processed image in association with each other. Here, the common processing rule is inserted in the card reader 91, the user who has input the input image data, the group to which the user belongs, when it is determined that the input image data is similar to the common processing image. This is a processing rule that is commonly applied to the input image data regardless of conditions such as cards.

  The contents of the common processing rule are not particularly limited. For example, (i) execution of copying, filing, electronic distribution, fax transmission, etc. is prohibited. (Ii) User authentication is performed to a specific user. (Iii) A part of the input image data is painted out and output. (Iv) A predetermined image (for example, an image for specifying a user or a multifunction peripheral) is input to the input image data. In addition, a processing rule can be applied such that an image indicating that the processing is restricted (or prohibited) is added or superimposed and output. Note that when a predetermined image is added as in (iv) above, an image that is visible to the user may be added, or an invisible image (for example, an image that can be confirmed by a predetermined method) may be added.

  The individual processing table 103 includes an index of a registered image registered as an individual processed image (registered image) read from the card 93 and an individual processing rule for input image data determined to be similar to the individual processed image. It is the table (memory | storage part) which matches and memorize | stores. Here, the individual processing rule is processing content to be applied to the input image data when it is determined that the input image data is similar to the individual processing image. The individual processing rules are stored in the memory 95 of the card 93 so that the user can add or change registered contents as necessary.

  The contents of the individual processing rules are not particularly limited, but for example, (1) transmitted to a predetermined electronic distribution destination mail address, (2) stored in a predetermined folder, (3) a predetermined file Convert to format (for example, PDF, JPEG, TIFF), (4) Output in predetermined resolution, color or monochrome, gradation (24 bits, 8 bits, 1 bit, etc.) (image formation, data transmission, filing, etc.) (5) Perform predetermined halftone processing (simple binary, dither matrix, error diffusion processing, etc.), (6) Perform compression (for example, JPEG compression) at a predetermined compression rate, (7) Predetermined processing Copy according to the conditions (from one side to one side, from one side to both sides, from both sides to both sides, from both sides to one side, convert to Nin1, select a predetermined paper size, etc.), (8) predetermined number of copies or 1 Sheet (9) Send a facsimile to a predetermined destination, (10) Send the read image data via IrDA (infrared communication) or Bluetooth, (11) OCR Perform processing, (12) perform encryption, (13) perform document skew correction (skew correction), or top-and-bottom correction, and (14) erase specific colors and output (image formation, data transmission, filing) Etc.) (for example, output is performed by removing the blue format part from the written form (when the format including the frame and characters is printed in blue), etc.).

  Although details will be described later, in this embodiment, when it is determined that the input image data is similar to both the common processed image and the individual processed image, that is, the similarity of the input image data to the common processed image When the similarity between the input image data and the individually processed image is equal to or greater than the similarity determination threshold value, the processing is performed based on the common processing rule. However, the present invention is not limited to this. For example, the processing may be performed based on the processing rule corresponding to the higher similarity between the common processing image and the individual processing image. When it is determined that the input image data is similar to both the common process image and the individual process image, the process may be performed based on the individual process rule.

  As shown in FIG. 1, the card 93 includes a registration processing unit 94 and a memory 95.

  The memory 95 is a memory that stores various data related to the card 93 (for example, a card ID, a user ID, a group ID to which the user belongs, various control data, and the like). The memory 95 includes a hash table 96 and an individual processing table 97.

  In the hash table 96, an index of a registered image registered as an individual processed image and a hash value (feature amount) for each feature point of the registered image are stored in association with each other.

  In the individual processing table 97, an index of a registered image registered as an individual processed image and an individual processing rule for the registered image are stored in association with each other.

  The registration processing unit 94 writes information to the memory 95 and reads information from the memory 95. For example, the registration processing unit 94 stores the hash value received from the digital color multifunction peripheral 1 and the index representing the registered image in the hash table 96 in association with each other. Also, the index of the registered image and the individual processing rule for the registered image are stored in the individual processing table 97 in association with each other. Further, these pieces of information stored in the memory 95 are read out as appropriate and sent to the digital color multifunction peripheral 1.

  The feature point calculation unit 31 extracts a connected part of a character string or a ruled line, and calculates the center of gravity of the connected part as a feature point. However, the configuration of the feature point calculation unit 31 is not limited to this. For example, the feature points of the image may be calculated by various conventionally known methods.

  FIG. 4 is a block diagram illustrating a schematic configuration of the feature point calculation unit 31. As shown in this figure, the feature point calculation unit 31 includes an achromatic processing unit 41, a resolution conversion unit 42, an MTF processing unit 43, a binarization processing unit 44, and a centroid calculation unit 45.

  When the image data (RGB signal) input from the shading correction unit 12 is a color image, the achromatic processing unit 41 is achromatic and converts the image data into a lightness signal or a luminance signal. .

  For example, the achromatic processing unit 41 converts the RGB signal into the luminance signal Y by the following equation (1).

Yi = 0.30Ri + 0.59Gi + 0.11Bi (1)
Here, Y is a luminance signal of each pixel, R, G, and B are each color component in the RGB signal of each pixel, and the subscript i is a value assigned to each pixel (i is an integer of 1 or more). It is.

Alternatively, the RGB signal may be converted into a CIE 1976 L ^* a ^* b ^* signal (CIE: Commission International de l'Eclairage, L ^* : brightness, a ^* , b ^* : chromaticity).

  The resolution conversion unit 42 performs a scaling process on the input image data. For example, when the input image data is optically scaled by the color image input device 2, the resolution conversion unit 42 scales the input image data again so that the predetermined resolution is obtained. Further, the resolution conversion unit 42 may perform resolution conversion for lowering the resolution than the resolution read at the same magnification in the color image input device 2 in order to reduce the processing amount in each processing unit in the subsequent stage. (For example, image data read at 600 dpi (dot per inch) is converted to 300 dpi).

  An MTF (modulation transfer function) processing unit 43 is used to absorb (adjust) that the spatial frequency characteristics of the color image input device 2 are different for each model. In the image signal output by the CCD, MTF degradation occurs due to optical parts such as lenses and mirrors, aperture aperture of the light receiving surface of the CCD, transfer efficiency and afterimage, integration effects due to physical scanning, and scanning unevenness. ing. Due to the deterioration of the MTF, the read image is blurred. The MTF processing unit 43 performs a process of repairing the blur caused by the deterioration of the MTF by performing an appropriate filter process (enhancement process). Further, it is also used to suppress high-frequency components that are not necessary for the feature point extraction processing in the latter-stage gravity center calculation unit 45. That is, enhancement and smoothing processing is performed using a mixing filter (not shown). FIG. 5 shows an example of the filter coefficient in this mixed filter.

  The binarization processing unit 44 binarizes the image data by comparing the achromatic image data (brightness value (brightness signal) or brightness value (brightness signal)) with a preset threshold value. .

  The center-of-gravity calculation unit 45 performs labeling (labeling processing) on each pixel based on the image data binarized by the binarization processing unit 44 (for example, represented by “1” and “0”). I do. Then, a connected area where pixels with the same label are connected is specified, and the center of gravity of the specified connected area is extracted as a feature point. Further, the extracted feature points are output to the feature amount calculation unit 32. FIG. 6 is an explanatory diagram showing an example of the connected area extracted from the input image data and the center of gravity of the connected area, and shows the connected area and the center of gravity corresponding to the character string “A”. FIG. 7 is an explanatory diagram illustrating an example of each center of gravity (feature point) of a plurality of connected regions extracted from a character string included in input image data. The feature points can be represented by coordinate values (x coordinate, y coordinate) in the binary image.

  The feature amount calculation unit 32 includes a feature point extraction unit 32a, an invariant calculation unit 32b, and a hash value calculation unit 32c. The feature point calculated by the feature point calculation unit 31 is used to rotate and parallelize a document image. A feature amount (hash value and / or invariant) that is an invariable amount with respect to geometric deformation such as movement, enlargement, reduction, and parallel movement is calculated.

  As shown in FIG. 8, the feature point extraction unit 32a sets one feature point as a target feature point, and sets a predetermined number of feature points in the vicinity of the target feature point in order from the closest distance from the target feature point (here 4 points) are extracted as peripheral feature points. In the example of FIG. 8, when the feature point a is the target feature point, the four feature points b, c, d, and e are extracted as the peripheral feature points, and when the feature point b is the target feature point, Four points of feature points a, c, e, and f are extracted as peripheral feature points.

  Further, the feature point extraction unit 32a extracts a combination of three points that can be selected from the four peripheral feature points extracted as described above. For example, as shown in FIGS. 9A to 9C, when the feature point a shown in FIG. 8 is the feature point of interest, three of the peripheral feature points b, c, d, and e are selected. Combinations, that is, combinations of peripheral feature points b, c, d, peripheral feature points b, c, e, and peripheral feature points b, d, e are extracted.

  Next, the invariant calculation unit 32b calculates an invariant (one of feature quantities) Hij with respect to geometric deformation for each extracted combination. Here, i is a number indicating the feature point of interest (i is an integer equal to or greater than 1), and j is a number indicating a combination of three peripheral feature points (j is an integer equal to or greater than 1). In the present embodiment, the ratio of two of the lengths of the line segments connecting the peripheral feature points is set as the invariant Hij. The length of the line segment may be calculated based on the coordinate value of each peripheral feature point. For example, in the example of FIG. 9A, if the length of the line segment connecting the feature point c and the feature point d is A11 and the length of the line segment connecting the feature point c and the feature point b is B11, The variable H11 is H11 = A11 / B11. In the example of FIG. 9B, if the length of the line segment connecting the feature point c and the feature point b is A12 and the length of the line segment connecting the feature point b and the feature point e is B12, The variable H12 is H12 = A12 / B12. In the example of FIG. 9C, if the length of the line segment connecting the feature point d and the feature point b is A13 and the length of the line segment connecting the feature point b and the feature point e is B13, The variable H13 is H13 = A13 / B13. In this way, invariants H11, H12, and H13 are calculated in the examples of FIGS. 9A to 9C.

Next, the hash value calculation unit 32c calculates a remainder value of (Hi1 × 10 ² + Hi2 × 10 ¹ + Hi3 × 10 ⁰ ) / D as a hash value (one of feature amounts) Hi and stores it in the memory 8. . Note that D is a constant set in advance according to how much the range of values that the remainder can take is set.

  Note that the method for calculating the invariant Hij is not particularly limited. For example, the cross ratio of five points in the vicinity of the feature point of interest, or the double ratio of five points extracted from the neighboring n points (n is an integer of n ≧ 5). The value calculated based on the arrangement of m points extracted from n points in the vicinity (m is an integer of m <n and m ≧ 5) and the cross ratio of the five points extracted from m points, etc. The invariant Hij may be used. The cross ratio is a value obtained from four points on a straight line or five points on a plane, and is known as an invariant with respect to projective deformation which is a kind of geometric transformation.

  Also, the formula for calculating the hash value Hi is not limited to the above formula (2), and other hash functions may be used.

  Further, each part of the feature quantity calculation unit 32, after completing the extraction of the peripheral feature points for one target feature point and the calculation of the hash value Hi, changes the target feature point to another feature point, A hash value is calculated, and hash values for all feature points are calculated.

  In the example of FIG. 8, when the extraction of the peripheral feature points and the hash value when the feature point a is the target feature point is finished, the peripheral feature points and the hash value are extracted when the feature point b is the target feature point. I do. In the example of FIG. 8, when the feature point b is the target feature point, four feature points a, c, e, and f are extracted as the peripheral feature points. Then, as shown in FIGS. 10A to 10C, a combination of three points selected from these peripheral feature points a, c, e, and f (peripheral feature points a, e, f, and peripheral points) Feature points c, e, f, peripheral feature points a, c, f) are extracted, and a hash value Hi is calculated for each combination and stored in the memory 8. Then, this process is repeated for each feature point, and a hash value when each feature point is a feature point of interest is obtained and stored in the memory 8.

  The invariant calculation method when the feature point a is the feature point of interest is not limited to the above method. For example, as shown in FIGS. 24A to 24D, when the feature point a shown in FIG. 8 is the feature point of interest, three of the peripheral feature points b, c, d, and e are selected. Combinations, that is, peripheral feature points b, c, d, peripheral feature points b, c, e, peripheral feature points b, d, e, peripheral feature points c, d, e are extracted, and each extracted combination , An invariant (one of feature quantities) Hij for the geometric deformation may be calculated.

Further, when the feature point b shown in FIG. 8 is set as the feature point of interest, as shown in FIGS. 25 (a) to 25 (d), four peripheral feature points of feature points a, c, e, and f are used. A combination of three points (peripheral feature points a, e, f, peripheral feature points a, c, e, peripheral feature points a, f, c, peripheral feature points e, f, c) from You may make it calculate the invariant Hij with respect to geometric deformation about each combination. In this case, the remainder of (Hi1 × 10 ³ + Hi2 × 10 ² + Hi3 × 10 ¹ + Hi4 × 10 ⁰ ) / D may be calculated as a hash value and stored in the memory 8.

  In the above example, the line segment connecting the peripheral feature point closest to the target feature point and the second closest peripheral feature point is Aij, and the peripheral feature point closest to the target feature point and the third closest peripheral feature point are connected. The line segment is set as Bij. However, the present invention is not limited to this. For example, the line segment used for calculation of the invariant Hij may be selected by an arbitrary method such as selecting the line segment connecting the peripheral feature points as a reference. Good.

  When registering the input image data as a common processing image, the feature amount calculation unit 32 registers the hash value (feature amount) for each feature point of the input image data calculated as described above as a registration processing unit 35. Send to.

  The registration processing unit 35 sequentially registers a hash value for each feature point calculated by the feature amount calculation unit 32 and an index (document ID) representing a document (registered image) in the hash table 101 provided in the memory 8. (See FIG. 11A). If the hash value is already registered, the document ID is registered in association with the hash value. Document IDs are sequentially assigned numbers without duplication. When the number of documents registered in the hash table 101 exceeds a predetermined value (for example, 80% of the number of documents that can be registered), the old document ID may be searched and sequentially deleted. . The deleted document ID may be used again as the document ID of a new registered image. Further, when the calculated hash values are the same value (H1 = H5 in the example of FIG. 11B), these may be combined and registered in the hash table 101.

  In addition, the registration processing unit 35 stores the index of the registered image to be registered as the common processing image and the common processing rule for the registered image in the common processing table 102 in association with each other. The common processing rule is set by the control unit 7 in accordance with, for example, an instruction input from the user acquired through the operation panel 6 or the communication device 5.

  Further, when registering the input image data as an individual processed image, the feature amount calculation unit 32 uses the card reader 91 to calculate the hash value (feature amount) for each feature point of the input image data calculated as described above. To the card 93 via

  The registration processing unit 94 of the card 93 sequentially registers the hash value received via the card reader 91 and the index representing the registered image in a hash table 96 provided in the memory 95. The registration method is the same as the registration method for the hash table 101. In addition, the registration processing unit 94 stores the index of the registered image and the individual processing rule for the registered image in the individual processing table 97 in association with each other. The individual processing rules are set by the control unit 7 in accordance with, for example, an instruction input from the user acquired through the operation panel 6 or the communication device 5.

  In addition, when performing the collation process (similarity determination process) for determining whether or not the input image data is the image data of a registered image that has already been registered, the feature amount calculation unit 32 calculates the input image calculated as described above. A hash value for each feature point of the data is sent to the voting processing unit 33.

  In this embodiment, before performing the voting process, the contents registered in the hash table 96 of the card 93 are read out and stored in the hash table 101 of the memory 8 and registered in the individual processing table 97 of the card 93. The stored contents are read out and stored in the individual processing table 103 of the memory 8. For example, a hash table for storing the contents read from the hash table 96 of the card 93 may be provided in the memory 8 separately from the hash table 101. The information read from the card 93 and stored in the memory 8 may be deleted when the card 93 is removed from the card reader 91 or when the processing on the input image data is completed.

  The voting processing unit 33 compares the hash value of each feature point calculated from the input image data with the hash value registered in the hash table 101 (the hash value of the common processing image and the hash value of the individual processing image), and the same hash Vote for registered images with values. In other words, for each registered image, the number of times the same hash value as the hash value of the registered image is calculated from the input image data is counted, and the count value is stored in the memory 8. FIG. 12 is a graph showing an example of the number of votes for registered images ID1, ID2, and ID3.

  The similarity determination processing unit 34 reads the voting result (the index of each registered image and the number of votes for each registered image; similarity) of the voting processing unit 33 from the memory 8 and obtains the maximum number of votes and the maximum number of votes obtained. Extract image index. Then, the extracted maximum number of votes is compared with a predetermined threshold value to determine similarity (whether or not the input image data is image data of a registered image), and a determination signal indicating the determination result is transmitted to the control unit 7. Send to. That is, if the maximum number of votes is greater than or equal to a predetermined threshold, it is determined that there is similarity (the input image data is image data of a registered image), and if it is less than the threshold, there is no similarity. (The input image data is not image data of a registered image).

  Alternatively, the similarity determination processing unit 34 calculates the similarity by dividing and normalizing the number of votes obtained for each registered image by the total number of votes (the total number of feature points extracted from the input image data). The similarity may be determined by comparing with a predetermined threshold value (for example, 80% of the total number of votes).

  In addition, the similarity determination processing unit 34 normalizes the number of votes obtained for each registered image by dividing by the number of registered hash values (maximum registered number) for the registered image having the largest number of registered hash values. The degree of similarity may be determined by calculating the degree and comparing the degree of similarity with a predetermined threshold (for example, 80% of the total number of votes). That is, if the calculated similarity is equal to or greater than the threshold value TH2, it is determined that “there is similarity”, and if it is less than the threshold value TH2, it is determined that “there is no similarity”. In this case, the total number of hash values extracted from the input image data may be larger than the maximum registered number (particularly when at least a part of the original and / or registered image has a handwritten part). The calculated value of similarity may exceed 100%.

  Further, the threshold TH2 for determining similarity may be constant for each registered image, or different thresholds may be used for the common processed image and the individual processed image. Further, it may be set for each registered image according to the importance of each registered image. The importance of the registered image depends on the registered image, for example, the importance is maximized for banknotes, securities, confidential documents, confidential documents, etc., and the importance is lower for banknotes, etc. May be set step by step. In this case, a weighting coefficient corresponding to the importance of the registered image is stored in the memory 8 in association with the index of the registered image, and the similarity determination processing unit 34 corresponds to the registered image that has obtained the maximum number of votes. The similarity may be determined using the threshold value TH2.

  Further, when determining the similarity, the threshold value TH2 is kept constant, while the similarity is determined by multiplying the number of votes for each registered image (the number of votes of each registered image) by the weighting coefficient of each registered image. Good. In this case, the memory 8 stores a weighting coefficient according to the importance of each registered image or a condition such as whether the image is a common processed image or an individual processed image in association with the index of each registered image. The degree determination processing unit 34 may calculate the number of corrected votes obtained by multiplying the number of votes of each registered image by the weighting coefficient of the registered image, and determine the similarity based on the number of corrected votes. For example, the maximum correction vote number may be compared with the threshold value TH2, or the maximum correction vote number normalized with the total number of votes may be compared with the threshold value TH2, and the maximum correction vote number is normalized with the maximum registration number. This may be compared with the threshold value TH2. In this case, for example, the weighting factor may be set to a value larger than 1, and to become a larger value as the importance of the registered image becomes higher.

  In this embodiment, one hash value is calculated for one feature point (attention feature point). However, the present invention is not limited to this, and a plurality of one feature point (attention feature point) may be calculated. A hash value may be calculated. For example, 6 points are extracted as the peripheral feature points of the feature point of interest, and for each of the 6 combinations obtained by extracting 5 points from these 6 points, 3 points are extracted from 5 points to obtain an invariant and a hash value is calculated. You may use the method to do. In this case, six hash values are calculated for one feature point.

  When there is a registered image determined to be similar in the similarity determination processing unit 34, the control unit 7 is based on a processing rule (common processing rule or individual processing rule) stored in association with the registered image. Process the input image data.

(1-3. Processing in the digital color multifunction peripheral 1)
Next, processing in the digital color multifunction peripheral 1 will be described with reference to flowcharts shown in FIGS. FIG. 13 is a flowchart showing a common process flow for the case where the similarity determination process (collation process) is performed and the case where the registration process is performed. FIG. 14 is a flowchart showing the flow of registration processing. FIG. 15 is a flowchart showing the flow of similarity determination processing (collation processing).

  When the card 93 is inserted into the card reader 91, the control unit 7 determines whether or not the inserted card 93 has been initialized (S1). The initial setting includes a process of setting storage areas for the hash table 96 and the individual processing table 97 in the memory 95.

  When it is determined that the initial setting is not made in S1, the control unit 7 performs the initial setting of the card 93 via the card reader 91 (S2). It may be possible to inquire the user whether or not to perform the initial setting via the display unit of the operation panel 6 and execute the initial setting when an instruction to execute the initial setting is received from the user.

  On the other hand, if it is determined in S1 that the initial setting has been completed, the control unit 7 reads information stored in the hash table 96 and the individual processing table 97 of the card 93 (S3). The control unit 7 stores information stored in the hash table 96 in the hash table 101 of the memory 8, and stores information stored in the individual processing table 97 in the individual processing table 103 of the memory 8.

  After the processing of S2 or S3 is completed, the control unit 7 acquires input image data and a processing request (instruction input) input from the user via the operation panel 6 or the communication device 5 (S4, S5). . Note that the input image data may be acquired by reading a document image with the color image input device 2, input image data transmitted from an external device may be acquired with the communication device 5, or from various recording media. Input image data may be read and acquired.

  Next, the control unit 7 controls each unit of the document matching processing unit 13 to perform a feature point calculation process (S6) and a feature amount calculation process (S7) on the input image data acquired in S4.

  Next, the control unit 7 determines whether or not the process requested by the process request is a registration process (S8). If it is a registration process, the registration process shown in FIG. 14 is performed (S9). If it is not a registration process, a similarity determination process (collation process) shown in FIG. 15 is performed (S10).

  Next, the flow of processing when performing registration processing will be described with reference to FIG. When it is determined that the registration process is to be performed in the process of S8 illustrated in FIG. 13, the control unit 7 determines whether the registration is a common process image (S11). This determination may be made based on a processing request from the user input via the operation panel 6 or the communication device 5, for example.

  If it is determined that the registration is a common process image, the control unit 7 determines the document ID of the input image data (image registered as a common process image) acquired in S4, and the feature amount extracted from the input image data. Are associated with each other and registered in the hash table 101 of the memory 8 (S12).

  Further, a common processing rule input from the user via the operation panel 6 or the communication device 5 is acquired (S13). Then, the document ID of the image to be registered as a common processing image and the common processing rule for this image are registered in the common processing table 102 of the memory 8 (S14). Then, it is determined whether or not the process based on the common process rule is to be executed (S15). If it is determined to be executed, the process based on the common process rule is executed (S16), and the operation is terminated. If it is determined not to execute in S15, the operation is terminated as it is.

  Note that the registration and change (editing) of the common process image and the common process rule can be executed only by a predetermined user (for example, a security officer or administrator at a company, a store, etc.). Good. In this case, for example, user information of a user who is permitted to execute registration and change (editing) of the common process image and the common process rule is stored in the memory (authentication storage unit) 8, and registration of the common process image is requested. Then, the control unit (authentication processing unit) 7 performs user authentication based on the user information, and when the user authentication is successful, the processes of S12 to S16 may be performed.

  On the other hand, if it is determined in S11 that the image is not a common process image registration, the control unit 7 determines that the image is an individual process image registration, and the input image data (image registered as an individual process image) acquired in S4. The document ID and the feature amount extracted from the input image data are associated with each other and registered in the hash table 96 of the card 93 (S17). Further, the information stored in the hash table 96 is stored in the hash table 101 of the memory 8 and the hash table 101 is updated.

  Moreover, the individual process rule input from the user via the operation panel 6 or the communication apparatus 5 is acquired (S18). For example, the control unit 7 displays selectable processing modes (copying, filing, electronic distribution, etc.) on the display unit of the operation panel 6 and allows the user to select a desired processing mode. When copying is selected, the type of recording material to be used (paper feed tray to be used), the number of copies, the necessity of image processing such as enlargement / reduction / rotation / translation, and the recording material after copying are discharged. An instruction input from a user regarding a tray or the like is received. When electronic distribution is selected, an input of a distribution destination mail address from the user is accepted. When filing is selected, the location of the folder storing the image data is displayed on the display unit of the operation panel 6 in a tree structure, for example, and a folder selection instruction (path designation) by the user is accepted. In this case, the folder for storing the image data may be a memory such as a hard disk provided in the digital color multifunction peripheral 1, or a memory provided in an external device such as a server connected to the digital color multifunction peripheral 1 so as to be communicable. It may be.

  Then, the document ID of the input image data (image registered as an individual processed image) acquired in S4 is associated with the individual processing rule for the input image data and registered in the individual processing table 97 of the card 93 (S19). Further, the information stored in the individual processing table 97 is stored in the individual processing table 103 of the memory 8 and the individual processing table 103 is updated. FIG. 16 is an explanatory diagram showing an example of information registered in the individual processing table 97 and stored in the individual processing table 103. Examples of processing rules when electronic distribution is performed and when filing is performed are shown. ing. As shown in this figure, when electronic distribution is performed, the processing mode is the electronic distribution mode, and the mail address of the distribution destination is recorded as an individual processing rule in association with the document ID. When filing is performed, the processing mode is filing of image data, and the path to the storage folder is recorded in association with the document ID as an individual processing rule.

  Then, in response to an instruction input from the user via the operation panel 6 or the communication device 5, it is determined whether or not to execute the process based on the individual process rule acquired in S18 (S20). After the execution (S21), the operation is terminated. If not, the operation is terminated as it is.

  Next, the flow of processing when similarity determination processing (collation processing) is performed will be described with reference to FIG. When it is determined that the requested process in the process of S8 illustrated in FIG. 13 is not a registration process, the control unit 7 performs a similarity determination process. In this case, the control unit 7 controls the voting processing unit 33 to perform voting processing based on the feature amount calculated by the feature amount calculating unit 32 in S7 (S31). Moreover, the control part 7 controls the similarity determination process part 34, and performs a similarity determination process based on the vote result of the voting process part 33 (S32).

  Next, based on the result of the similarity determination process, the control unit 7 determines whether or not the input image data acquired in S4 is similar to the common process image (S33). If it is determined that the image is similar to the common process image, the process is executed based on the common process rule corresponding to the common process image registered in the common process table 102 (S34), and the operation ends.

  On the other hand, when it is determined in S33 that the input image data acquired in S4 is not similar to the common processed image, the control unit 7 determines whether or not the input image data is similar to the individual processed image ( S35).

  If it is determined that the image is similar to the individual processing image, the control unit 7 performs processing on the input image data based on the individual processing rule corresponding to the individual processing image stored in the individual processing table 103. It is determined whether or not (S36). For example, the control unit 7 displays an individual processing rule corresponding to a registered image determined to be similar on the display unit of the operation panel 6 or a display unit of an external device connected to be communicable, and the individual processing rule The user is inquired whether or not to execute the processing based on it. Then, when there is an execution instruction from the user, it is determined that the processing based on the individual processing rule is performed. And when it is judged that the process based on the said individual process rule is performed, the control part 7 performs the said process (S37), and complete | finishes operation | movement.

  On the other hand, if it is determined in S36 that the process based on the individual process rule is not performed, the control unit 7 determines whether or not to change the individual process rule stored in the individual process table 103 (S38). ). This determination is made based on an instruction from the user input via the operation panel 6 or the communication device 5, for example. If it is determined that the individual processing rule is changed and not executed, the execution of the process is canceled (S39), and the operation ends.

  On the other hand, if it is determined in S38 that the individual processing rule is to be changed, the control unit 7 acquires information regarding the change contents of the individual processing rule input from the user via the operation panel 6 or the communication device 5 (S40). Then, the control unit 7 is registered in the individual processing table 97 of the card 93 as to whether or not to register the acquired change contents based on an instruction from the user input via the operation panel 6 or the communication device 5. It is determined whether or not to change the individual processing rule for the registered image (registered image determined to be similar) (S41).

  When it is determined that the acquired change content is to be registered, the control unit 7 individually associates the document ID of the registered image (registered image determined to be similar) with the changed individual processing rule. Register in the processing table 97 (S42). That is, the individual processing rule corresponding to the registered image registered in the individual processing table 97 is changed. Further, the information stored in the individual processing table 97 is stored in the individual processing table 103 of the memory 8 and the individual processing table 103 is updated.

  If it is determined that the acquired change content is not registered, the control unit 7 associates the document ID of the registered image (registered image determined to be similar) with the changed individual processing rule. Individual processing rules are temporarily stored in the individual processing table 103. This is because the process based on the individual process rule is executed in S43 in the subsequent stage.

  And after performing the process of S41 or S42, the control part 7 performs a process based on the individual process rule stored in the individual process table 97 after a change (S43), and complete | finishes operation | movement.

  On the other hand, if it is determined in S35 that the image is not similar to the individual processed image, that is, if it is determined that the input image data is not similar to the common processed image or the individual processed image, the control unit 7 It is determined whether or not to set an individual processing rule for data (S44). This determination is made based on an instruction from the user input via the operation panel 6 or the communication device 5. If it is determined that the individual processing rule is not set, the control unit 7 cancels the processing for the input image data (S39) and ends the operation.

  On the other hand, when it is determined in S44 that the individual processing rule is set, the control unit 7 acquires the individual processing rule input from the user via the operation panel 6 or the communication device 5 (S45). Then, based on an instruction input from the user, it is determined whether or not to register the acquired individual processing rule (S46). If it is determined to be registered, the control unit 7 sends the document ID of the input image data (image registered as an individual processed image) acquired in S4 and the feature amount extracted from the input image data to the card 93. The document ID and the feature amount are associated with each other and registered in the hash table 96 of the card 93 (S47). Further, the document ID of the input image data acquired in S4 and the individual processing rule acquired in S45 are sent to the card 93, and the document ID and the individual processing rule are associated with each other and registered in the individual processing table 97 of the card 93. (S48). Further, the information stored in the individual processing table 97 is stored in the individual processing table 103 of the memory 8 and the individual processing table 103 is updated.

  If it is determined not to register in S46, the control unit 7 associates the document ID of the registered image (registered image determined to be similar) with the changed individual processing rule, and the individual processing table. 103 is temporarily stored. Thereafter, or after performing the process of S48, the control unit 7 executes the process based on the individual process rule acquired in S45 and stored in the individual process table 103 (S49), and ends the operation.

  As described above, in the present embodiment, the hash table 96 that stores the document ID of a registered image (individually processed image) and the feature amount of the registered image in the memory 95 of the card 93 is provided. Also, the memory 95 of the card 93 is provided with an individual processing table 97 for storing a document ID of a registered image (individually processed image) and an individual processing rule for the registered image in association with each other. When it is determined that the input image data is similar to the registered image registered in the hash table 96 of the card 93, the input image data is processed based on the individual processing rule corresponding to the registered image.

  As a result, registered images can be distributed and registered on a plurality of cards 93, so that even if the number of registered images used in the digital color multifunction peripheral 1 increases, the memory capacity of the digital color multifunction peripheral 1 is increased. Can be prevented. Further, the user can arbitrarily register a registered image, a feature amount of the registered image, and a processing rule for input image data similar to the registered image in the card 93 possessed by the user. Processing content setting operations can be simplified. That is, it is not necessary to perform an operation of inputting detailed setting items one by one every time processing is performed on the input image data, so that convenience for the user can be improved.

  In the present embodiment, the memory 8 of the digital color multifunction peripheral 1 is provided with the hash table 101 that stores the document ID of the registered image registered as the common processed image and the feature amount of the registered image in association with each other. . In addition, the memory 8 is provided with a common processing table 102 that stores a document ID of a common processing image and a common processing rule for the common processing image in association with each other. When it is determined that the input image data is similar to the common processed image, the input image data is processed based on the common processing rule corresponding to the common processed image.

  As described above, by storing the document ID, the feature amount, and the common processing rule of the registered image registered as the common processing image in the memory 8 of the digital color multifunction peripheral 1, it is determined that the image is similar to the common processing image. Regardless of the inserted card or the information stored in the card, the processing based on the common processing rule can be reliably performed on the input image data.

  In this embodiment, before the similarity determination process is performed, the hash table 96 and the individual processing table 97 of the card 93 are read out and temporarily stored in the memory 8 of the digital color multifunction peripheral 1. Although the similarity determination process is performed on the processed image and the individual processed image, the present invention is not limited to this. For example, the similarity determination process for the common process image and the individual process image may be performed in the card 93.

  FIG. 17 is a block diagram illustrating a configuration example of the document collation processing unit 13 and the card 93 of the digital color multifunction peripheral 1 when the similarity determination process for the common process image and the individual process image is performed on the card 93.

  In the example shown in this figure, the card 93 includes a voting processing unit 98 and a similarity determination processing unit 99 in addition to the configuration shown in FIG. The configurations and functions of the voting processing unit 98 and the similarity determination processing unit 99 are substantially the same as the configurations and functions of the voting processing unit 33 and the similarity determination processing unit 34 provided in the document matching processing unit 13 shown in FIG. . Further, in the example shown in this figure, the individual processing table 103 provided in the memory 8 of the document collation processing unit 13 in the configuration shown in FIG. 1 is omitted.

  18 is a flowchart showing the flow of processing in the configuration shown in FIG. FIG. 19 is a flowchart showing the flow of processing when registration processing is performed in the configuration shown in FIG. FIG. 20 is a flowchart showing the flow of processing when processing according to the individual processing rule is performed in the configuration shown in FIG. In the example of FIGS. 18 to 20, as a common processing rule, when it is determined that the input image data is similar to the common processing image, a processing rule for prohibiting execution of processing on the input image data is provided. Is set.

  As shown in FIG. 18, when the card 93 is inserted into the card reader 91, the control unit 7 determines whether or not the inserted card 93 has been initialized (S51). The initial setting includes a process of setting storage areas of the hash table 96, the individual processing table 97, and the common processing table 104 in the memory 95.

  If it is determined in S51 that the initial setting has not been made, the control unit 7 performs the initial setting of the card 93 via the card reader 91 (S52). Note that the user may be inquired about whether or not to perform the initial setting via the display unit of the operation panel 6, and the initial setting may be executed when the initial setting is input from the user.

  On the other hand, when it is determined in S1 that the initial setting has been completed, or after the initial setting in S2, the control unit 7 reads and reads information stored in the hash table 101 and the common processing table 102 of the memory 8. The information is written into the hash table 96 and the common processing table 104 of the card 93 (S53). Note that the control unit 7 stores information stored in the hash table 101 in the hash table 96 of the card 93 and stores information stored in the common processing table 102 in the common processing table 104 of the card 93.

  Next, the control unit 7 acquires input image data and a processing request (instruction input) input from the user via the operation panel 6 or the communication device 5 (S54, S55).

  Next, the control unit 7 controls each unit of the document matching processing unit 13 to perform the feature point calculation process (S56) and the feature amount calculation process (S57) on the input image data acquired in S54. Then, the feature amount calculated in S57 is sent to the card 93.

  Next, the control unit 7 controls the voting processing unit 98 and the similarity determination processing unit 99 of the card 93 to perform voting processing and similarity determination processing based on the feature amount calculated in S57 (S58, S59). . The voting processing unit 98 and the similarity determination processing unit 99 may be controlled by a control unit (not shown) provided in the card 93.

  Next, the control unit 7 determines whether or not the input image data is determined to be similar to the common process image (S60). If it is determined that the image is similar to the common process image, the process ends without performing the process on the input image data.

  On the other hand, when it is determined in S60 that the image is not similar to the common process image, the control unit 7 determines whether or not the process requested by the process request is a registration process (S61). If it is a registration process, the registration process shown in FIG. 19 is performed (S62). If it is not a registration process, a process according to the individual process rule shown in FIG. 20 is performed (S63).

  Next, the flow of processing when performing registration processing will be described with reference to FIG. When it is determined that the registration process is performed in the process of S61 illustrated in FIG. 18, the control unit 7 extracts the document ID of the input image data (image for registering the individual process rule) acquired in S54 and the input image data. The obtained feature values are associated with each other and registered in the hash table 96 of the card 93 (S71). Moreover, the individual process rule input from the user via the operation panel 6 or the communication apparatus 5 is acquired (S72).

  Then, the document ID of the input image data (image registered as the individually processed image) acquired in S54 is associated with the individual processing rule for the input image data and registered in the individual processing table 97 of the card 93 (S73).

  Then, in response to an instruction input from the user via the operation panel 6 or the communication device 5, it is determined whether or not to execute the process based on the individual process rule acquired in S72 (S74). After the execution (S75), the operation is terminated. When the operation is not performed, the operation is terminated as it is.

  Next, the flow of processing when processing according to the individual processing rules is performed will be described with reference to FIG. When it is determined that the requested process in the process of S61 illustrated in FIG. 18 is not a registration process, the control unit 7 determines whether the input image data is similar to the individual processed image (S81).

  If it is determined that the image is similar to the individual processed image, the control unit 7 determines whether or not to process the input image data based on the individual processing rule corresponding to the registered image (S82). For example, the control unit 7 displays an individual processing rule corresponding to a registered image determined to be similar on the display unit of the operation panel 6 or a display unit of an external device connected to be communicable, and the individual processing rule The user is inquired whether or not to execute the processing based on it. Then, when there is an execution instruction from the user, it is determined that the processing based on the individual processing rule is performed. And when it is judged that the process based on the said individual process rule is performed, the control part 7 performs the said process (S83), and complete | finishes operation | movement.

  On the other hand, when it is determined in S82 that the processing based on the individual processing rule is not performed, the control unit 7 determines whether or not to execute the registered individual processing rule (S84). This determination is made based on an instruction from the user input via the operation panel 6 or the communication device 5, for example. If it is determined that the individual processing rule is not changed and executed, the processing based on the individual processing rule is canceled (S85), and the operation ends.

  On the other hand, if it is determined in S38 that the individual processing rule is to be changed, the control unit 7 acquires information regarding the change contents of the individual processing rule input from the user via the operation panel 6 or the communication device 5 (S86). Then, the control unit 7 is registered in the individual processing table 97 of the card 93 as to whether or not to register the acquired change contents based on an instruction from the user input via the operation panel 6 or the communication device 5. It is determined whether or not to change the individual processing rule for the registered image (registered image determined to be similar) (S87).

  When it is determined that the acquired change content is to be registered, the control unit 7 individually associates the document ID of the registered image (registered image determined to be similar) with the changed individual processing rule. Register in the processing table 97 (S88). That is, the individual processing rule corresponding to the registered image registered in the individual processing table 97 is updated.

  And after performing the process of S87 or S88, the control part 7 performs a process based on the individual process rule after a change (S89), and complete | finishes operation | movement.

  On the other hand, when it is determined in S81 that the image is not similar to the individual processed image, that is, when it is determined that the input image data is not similar to the common processed image or the individual processed image, the control unit 7 It is determined whether or not an individual processing rule for data is set (S91). This determination is made based on an instruction from the user input via the operation panel 6 or the communication device 5. If it is determined that the individual processing rule is not set, the control unit 7 cancels the processing for the input image data (S85) and ends the operation.

  When it is determined in S90 that the individual processing rule is set, the control unit 7 acquires the individual processing rule input from the user via the operation panel 6 or the communication device 5 (S91). Then, based on an instruction input from the user, it is determined whether or not to register the acquired individual processing rule (S92). If it is determined to be registered, the control unit 7 sends the document ID of the input image data (image to be registered as an individual processed image) acquired in S54 and the feature amount extracted from the input image data to the card 93. The document ID and the feature amount are associated with each other and registered in the hash table 96 of the card 93 (S93). Further, the document ID of the input image data acquired in S4 and the individual processing rule acquired in S45 are sent to the card 93, and the document ID and the feature amount are associated with each other and registered in the individual processing table 97 of the card 93. (S94).

  Then, after determining not to register in S92 or performing the process of S94, the control unit 7 executes a process based on the individual process rule acquired in S91 (S95) and ends the operation.

  In the configuration shown in FIG. 17, when a card 93 having a voting processing unit 98 and a similarity determination processing unit 99 is inserted, similarity determination processing is performed on the card 93, and the voting processing unit 98 and similar When a card 93 that does not include the degree determination processing unit 99 is inserted, the similarity determination processing may be performed by the voting processing unit 33 and the similarity determination processing unit 34 of the document matching processing unit 13.

  In the configuration shown in FIG. 17, the similarity determination process for the common process image may be performed by the digital color multifunction peripheral 1, and the similarity determination process for the individual process image may be performed by the card 93.

  In the present embodiment, the common process image and the common process rule are registered in the hash table 101 and the common process table 102 of the memory 8, but the present invention is not limited to this. For example, the common processing image and the common processing rule may be stored in the hash table 96 and the common processing table 104 of the card 93. In this case, as shown in FIG. 21, the voting processing unit 33, the similarity determination processing unit 34, the registration processing unit 35, the hash table 101, and the common processing table 102 provided in the document matching processing unit 13 of FIG. 17 are omitted. May be.

  In addition, when the common process image and the common process rule are stored in the hash table 96 and the common process table 104 of the card 93, the registration of the common process image and the common process rule or the change of the registered contents of these information is performed in advance. A configuration that can be executed only by a specified specific user (for example, a security officer or administrator at a company, a store, or the like) is also possible. In this case, for example, information (for example, a user ID, a personal identification number, a password, etc.) specifying the owner of the card 93 is written in the memory 95 of the card 93 and is provided in the digital color multifunction peripheral 1 or the card 93. A user authentication unit (not shown) performs user authentication based on the above information, and when the user authentication is successful, registration of the common processing image and the common processing rule or change of registered contents of these information is permitted. May be. Similarly, registration and change of individual processing rules may be permitted only when user authentication is successful.

  In this embodiment, the common process image and the individual process image are registered. However, the present invention is not limited to this. For example, the common process image is not registered, and only the individual process image is registered. It is good also as a structure to keep.

  In the present embodiment, the case where the present invention is applied to the digital color multifunction peripheral 1 has been described. However, the application target of the present invention is not limited to this. For example, the present invention may be applied to a monochrome multifunction device. Further, the present invention is not limited to a multifunction machine, and may be applied to, for example, a single facsimile communication apparatus, a copying machine, an image reading apparatus, or the like.

  FIG. 22 is a block diagram showing a configuration example when the present invention is applied to a flatbed scanner (image reading apparatus, image processing apparatus) 1 ′.

  As shown in this figure, the flatbed scanner 1 ′ includes a color image input device 2, a color image processing device 3 ′, an operation panel 6, and a card reader 91. The color image processing device 3 ′ includes an A / D conversion unit 11, a shading correction unit 12, and a document collation processing unit 13, to which a color image input device 2 is connected, and the image reading device 1 ′ as a whole. Is configured. The functions of the A / D conversion unit 11, the shading correction unit 12, the document collation processing unit 13, and the card reader 91 in the color image input device (image reading unit) 2 are the same as those of the digital color multifunction peripheral 1 and the card reader 91 described above. The description is omitted here since it is substantially the same.

  In addition, as described above, the external storage device uses, for example, an external device such as a personal computer or a server device that is communicably connected to the digital color multifunction peripheral 1 via a network as the external storage device. Also good. In this case, the card reader 91 may be omitted, and information transmission between the digital color multifunction peripheral 1 and the external storage device may be performed via the communication device 5.

  23 shows a server device 50 used as an external storage device in place of the card 93, and multifunction peripherals (MFPs) A, B,..., Printer A connected to the server device 50 through a network. , B, ..., facsimile A, B, ..., computers A, B, ..., digital cameras A, B, ..., scanners A, B, ... 1 is an explanatory diagram showing a configuration of a system 100. FIG. In the configuration shown in this figure, the server device 50 has the same configuration as the card 93 having any one of the configurations described above. Each of the devices connected to the server device 50 via a network includes a document matching processing unit 13. That is, each of the MFPs (MFPs) A and B, printers A and B, facsimiles A and B, computers, digital cameras A and B, and scanners A and B can function as the image processing apparatus of the present invention. The configuration of the image processing system 100 is not limited to this. For example, the server device 50, a multifunction device, a printer (image forming device), a facsimile, a computer, a digital camera (image reading device), a scanner (image reading device). ) May be included.

  Also, the individual processing table for each user is stored in the server device 50, the digital color multifunction peripheral 1 transmits the user's personal authentication information and input image data to the server device 50, and the server device 50 is the digital color multifunction peripheral. Among registered individual processing rules stored in the individual processing table corresponding to the personal authentication information received from 1, the registered image determined to be similar to the input image data received from the digital color multifunction peripheral 1 These individual processing rules may be returned to the digital color multifunction peripheral 1. FIG. 26 is a block diagram illustrating a configuration example of an image processing system 100a including the server device 50 and the digital color multifunction peripheral 1 when performing such processing.

  In the example shown in FIG. 26, the document collation processing unit 13 of the digital color multifunction peripheral 1 includes a personal authentication information acquisition unit 112 in addition to the configuration of the document collation processing unit 13 in FIG. The server device 50 includes a control unit 121, a registration processing unit 122, a voting processing unit 123, a similarity determination processing unit 124, and a memory 125. That is, in the example shown in this figure, the digital color multifunction peripheral 1 calculates the feature amount of the input image data and transmits it to the server device 50, so that the server device 50 performs the registration process, the voting process, and the similarity determination process. It has become.

The personal authentication information acquisition unit 112 acquires user personal authentication information. For example,
As shown in FIG. 27, a fingerprint reading unit 111 is provided on the operation panel 6, and the fingerprint information (biometric authentication information) of the user is read by the fingerprint reading unit 111 and input to the personal authentication information acquisition unit 112. The personal authentication information is not limited to fingerprint information, and information (biometric authentication information) such as an iris, a voiceprint, and a vein pattern may be used (so-called biometric authentication). Further, a password, a personal identification number, or the like input by the user via the operation panel 6 may be used as the personal authentication information, or the personal authentication information may be read from a card or the like on which the user's personal authentication information is recorded. In addition, authentication processing may be performed using a plurality of personal authentication information. For example, a plurality of types of personal authentication information (for example, fingerprints, irises, voiceprints, vein patterns, passwords, passwords, etc.) may be stored so that authentication processing can be performed using any type of personal authentication information. (For example, when authentication processing based on one type of personal authentication information is not successful, other types of personal authentication information can be used). Alternatively, authentication processing may be performed using a combination of a plurality of types of personal authentication information (for example, authentication processing is performed using both fingerprint information and a password).

  The control unit 121 of the server device 50 controls the operation of each unit provided in the server device 50 and access to the memory 125.

  The memory 125 stores a personal authentication table 126, a common processing table 127, an individual processing table group 128, and a hash table 129.

  The personal authentication table 126 is a table that stores user IDs and personal authentication information in association with each other.

  The common processing table 127 stores an index of a registered image registered as a common processing image and a common processing rule for the common processing image in association with each other.

  In the individual processing table group 128, an individual processing table for each user is stored in association with the user ID. In each individual table for each user, an index of a registered image registered as an individual processed image and an individual processing rule for the registered image are stored in association with each other.

  In the hash table 129, the index of the registered image registered as the individual processed image and the registered image registered as the common processed image, and the hash value (feature amount) for each feature point of these registered images are stored in association with each other. Is done.

  When registering the common processing image, the registration processing unit 122 stores the hash value received from the digital color multifunction peripheral 1 in association with the index representing the registered image in the hash table 129 and stores the index of the registered image. The common processing rule for the registered image is associated and stored in the common processing table 127. When registering an individual processed image, the hash value received from the digital color multifunction peripheral 1 and an index representing the registered image are stored in the hash table 129 in association with each other, and the index of the registered image and the registered image are stored. The individual processing rules are associated with each other and stored in the individual processing table of the user corresponding to the personal authentication information received from the digital color MFP 1.

  The configurations and functions of the voting processing unit 123 and the similarity determination processing unit 124 are substantially the same as the configurations and functions of the voting processing unit 33 and the similarity determination processing unit 34 provided in the document matching processing unit 13 shown in FIG. .

  Next, the flow of processing in the image processing system 100a shown in FIG. 26 will be described. First, FIG. 28 is a flowchart showing the flow of registration processing in the image processing system 100a.

  First, the personal authentication information acquisition unit 112 acquires user fingerprint information (personal authentication information) from the fingerprint reading unit 111 (S101), and the feature point calculation unit 31 acquires input image data from the shading correction unit 12 (S102). The control unit 7 acquires a processing rule input from the operation panel 6 or an external device (S103). This processing rule includes information indicating whether to register as a common processing rule or as an individual processing rule.

  Next, the control unit 7 controls the feature point calculation unit 31 and the feature amount calculation unit 32 to perform a feature point calculation process (S104) and a feature amount calculation process (S105) on the input image data acquired in S102.

  Next, the control unit 7 causes the server device 50 to transmit the personal authentication information acquired in S101, the processing rule acquired in S103, and the feature amount calculated in S105 to the server device 50 (S106).

  When the control unit 121 of the server device 50 receives the personal authentication information, the processing rule, and the feature amount transmitted from the digital color multifunction peripheral 1 (S111), it performs personal authentication processing (S112). It is determined whether or not the transmitted personal authentication information is registered in the personal authentication table 126, that is, whether or not the user operating the digital color multifunction peripheral 1 is a registered user (S113).

  If it is determined that the user is a registered user, the process proceeds to S115. If the user is not a registered user, user registration is performed and then the process proceeds to S115 (S114). The user may be inquired as to whether or not to perform user registration, and the necessity of registration may be determined according to a user instruction.

  Thereafter, the control unit 121 controls the registration processing unit 122 to register the feature amount and the document ID received from the digital color multifunction peripheral 1 in the hash table 129 (S115).

  Further, the control unit 121 determines whether the processing rule received from the digital color multifunction peripheral 1 is a common processing rule or an individual processing rule (S116). In the case of the individual processing rule, the user's individual processing table corresponding to the personal authentication information received from the digital color multifunction peripheral 1 among the individual processing tables of each user registered in the individual processing table group 128 is displayed. The document ID and the processing rule are registered in association with each other (S117). If it is a common processing rule, the document ID and the processing rule are registered in the common processing table 127 in association with each other (S118). Then, when the process of S117 or S118 is completed, the control unit 121 returns a registration completion notification indicating that the registration process is completed to the digital color multifunction peripheral 1 via a communication unit (not shown).

  When receiving the registration completion notification from the server device 50, the control unit 7 of the digital color multifunction peripheral 1 determines whether or not to execute processing based on the registered processing rule (S107). If the processing rule is not executed, the registration process is terminated. If the processing rule is to be executed, processing based on the processing rule is executed (S109), and the processing is terminated.

  In the example of FIG. 28, after the process rule registration process is completed, the process based on the individual process rule is executed as necessary. However, the present invention is not limited to this. For example, the registration process may be performed after executing the process based on the process rule to be registered, or the registration process and the process based on the process rule may be performed in parallel.

  Next, collation processing (similarity determination processing) in the image processing system 100a will be described with reference to the flowchart shown in FIG.

  First, when the personal authentication information acquisition unit 112 acquires user fingerprint information (personal authentication information) from the fingerprint reading unit 111 (S121), and the feature point calculation unit 31 acquires input image data from the shading correction unit 12 (S122). The control unit 7 controls the feature point calculation unit 31 and the feature amount calculation unit 32 to perform a feature point calculation process (S123) and a feature amount calculation process (S124) on the input image data acquired in S122.

  Thereafter, the control unit 7 causes the server device 50 to transmit the personal authentication information acquired in S121 and the feature amount calculated in S124 to the server device 50 (S125).

  When the control unit 121 of the server device 50 receives the personal authentication information and the feature amount transmitted from the digital color multifunction peripheral 1 (S131), the control unit 121 performs personal authentication processing (S132) and transmits the personal authentication information from the digital color multifunction peripheral 1. It is determined whether or not the personal authentication information is registered in the personal authentication table 126, that is, whether or not the user operating the digital color multifunction peripheral 1 is a registered user (S133). If it is determined that the user is a registered user, the process proceeds to S135. If the user is not a registered user, the process proceeds to S135 after performing user registration (S134). The user may be inquired as to whether or not to perform user registration, and the necessity of registration may be determined according to a user instruction.

  Next, the control unit 121 controls the voting processing unit 123 to perform voting processing (S135) and controls the similarity determination processing unit 124 to perform similarity determination processing based on the voting result of the voting processing unit 123. (S136).

  Next, the control unit 121 determines whether or not the input image data is similar to the common process image based on the result of the similarity determination process (S137). If it is determined that the image is similar to the common process image, the common process rule corresponding to the common process image registered in the common process table 127 is returned to the digital color multifunction peripheral 1 (S138).

  If it is determined in S137 that the input image data is not similar to the common processing image, the control unit 121 determines that the input image data is an individual for the user corresponding to the user, that is, the personal authentication information received in S131. It is determined whether or not the image is similar to the individual processing image registered in the processing table (S139).

  If it is determined that the image is similar to the individual processing image, the control unit 7 reads out the individual processing rule corresponding to the individual processing image from the individual processing table for the user in the individual processing table group 128 and performs digital color combination. It returns to the machine 1 (S140). On the other hand, if it is determined that the image is not similar to the individually processed image, it returns to the digital color multifunction peripheral 1 that the processing rule corresponding to the input image data is not registered (S141).

  When receiving the reply information from the server device 50 (S151), the control unit 7 of the digital color multifunction peripheral 1 determines whether or not a common processing rule is included in the reply information (S152). If a common processing rule is included, processing based on this common processing rule is executed (S153), and the operation ends.

  On the other hand, when the common processing rule is not included in the reply information, the control unit 7 determines whether or not the individual processing rule is included (S154). If the individual process rule is included, the control unit 7 determines whether or not to execute the process based on the individual process rule (S155). For example, the control unit 7 displays the content of the individual processing rule on the display unit of the operation panel 6 or a display unit of an external device connected to be communicable, and determines whether to execute processing based on the individual processing rule. Ask the user. Then, when there is an execution instruction from the user, it is determined that the processing based on the individual processing rule is performed.

  And when it is judged that the process based on the said individual process rule is performed, the control part 7 performs the said process (S156), and complete | finishes operation | movement.

  On the other hand, when it is determined in S155 that the process based on the individual processing rule is not performed, the control unit 7 determines whether or not to change and execute the individual processing rule received from the server device 50 (S157). This determination is made based on an instruction from the user input via the operation panel 6 or the communication device 5, for example. If it is determined that the individual processing rule is changed and not executed, the execution of the process is canceled (S158), and the operation ends.

  On the other hand, when it is determined in S157 that the individual processing rule is changed and executed, the control unit 7 acquires information regarding the change contents of the individual processing rule input from the user via the operation panel 6 or the communication device 5 (S159). ). Then, the control unit 7 determines whether or not to register the acquired change contents based on an instruction from the user input via the operation panel 6 or the communication device 5, that is, in the individual processing table group 128 of the server device 50. It is determined whether or not to change the individual processing rule for the registered image (registered image determined to be similar to the input image) registered in the individual processing table of the user (S160).

  When it is determined that the acquired change content is to be registered, the control unit 7 transmits the changed individual processing rule to the server device 50 via the communication device 5 (S161). When receiving the changed individual processing rule, the control unit 121 of the server device 50 updates the individual processing rule for the registered image in the individual processing table of the user corresponding to the personal authentication information received in S131 (not shown). ).

  Further, when it is determined in S160 that the change content is not registered, or after the individual processing rule is transmitted in S161, the control unit 7 executes processing based on the changed individual processing rule (S162) and ends the operation. .

  On the other hand, when it is determined in S154 that the individual information rule is not included in the reply information, the control unit 7 determines whether or not to set the individual processing rule for the input image data (S163). This determination is performed based on an instruction from the user input via the operation panel 6 or the communication device 5. If it is determined that the individual processing rule is not set, the control unit 7 cancels the processing for the input image data (S158) and ends the operation.

  If it is determined in S163 that an individual processing rule is set, the control unit 7 acquires an individual processing rule input from the user via the operation panel 6 or the communication device 5 (S164). Then, based on an instruction input from the user, it is determined whether or not to register the acquired individual processing rule (S165). If it is determined to register, the control unit 7 transmits the individual processing rule to be registered to the server device 50 via the communication device 5 (S166). Upon receiving the individual processing rule to be registered, the control unit 121 of the server device 50 controls the registration processing unit 122 to register the feature amount and the document ID received in S131 in the hash table 129 and the received in S131. The document ID and the individual processing rule are registered in association with each other in the individual processing table of the user corresponding to the personal authentication information (both not shown).

  If it is determined not to register in S165, or after the individual processing rule is transmitted in S166, the control unit 7 executes processing based on the individual processing rule acquired in S164 (S167), and ends the operation.

  In this way, in the image processing system 100a shown in FIG. 26, the individual processing rules for each user are registered in the server device 50, and user authentication is performed when processing the input image data in the digital multi-function peripheral 1. The individual processing rule for the user is read and executed. Thus, the user can use various functions using the similar image determination process with settings according to the user's needs without carrying the external storage device.

  The scanner includes a document table, an optical scanning unit, a CCD (charge coupled device), etc., and scans the document image placed on the document table by the optical scanning unit to read the document image and generate image data. To do. The digital camera includes an imaging lens, a CCD, and the like (image input device), and shoots a document image, a person, a landscape, and the like to generate image data. The scanner and the digital camera may have a function of performing predetermined image processing (for example, various correction processes) in order to appropriately reproduce the image. The printer prints an image based on image data generated by a computer, a scanner, and a digital camera on a sheet (recording paper). Further, the facsimile performs processing such as binarization processing, resolution conversion processing, and rotation on the image data read from the image input device, and transmits the image data compressed to a predetermined format to the other party. Then, the image data transmitted from the other party is decompressed, subjected to rotation processing, resolution conversion processing, and halftone processing according to the performance of the image output apparatus, and output as a page unit image. The multifunction machine has at least two of a scanner function, a facsimile transmission function, and a printing function (copying function, printer function). The computer edits image data read by a scanner or a digital camera, or creates a document using application software.

  In each of the above embodiments, the input image data may be digitized data obtained by converting data read by the scanner into a predetermined file format such as JPEG or PDF, or electronic data created by various application software. There may be.

  In each of the above embodiments, the registered image feature amount and the registered image document ID are stored, and the input image data feature amount and the registered image feature amount are compared to compare both images ( Although the similarity determination process is performed, the present invention is not limited to this. For example, electronic data created by various application software or electronic data obtained by converting data read by a scanner into a predetermined file format such as JPEG or PDF is stored in the server device and stored in the server device. The comparison processing (similarity determination processing) of both images may be performed by comparing these data and the input image data. In this case, the electronic data or digitized data is preferably stored for each file format and each electronic data.

  Any kind of application software can be used as the application software for creating the electronic data. For example, the application software may create data in a PDL (page description language) format. In this case, when performing the collation process, it may be used after being converted into a raster image (RGB data) by a RIP (raster image processor).

  The digitized data may be data in an encoded image format such as JPEG or GIF. In this case, for example, a decoding process is performed on these encoded image formats, and a collation process is performed after performing a color conversion process such as converting a YCC signal to an RGB signal as necessary. May be.

  The digitized data may be RDF format data. In the case of the PDF format, data of an object (text, figure, photo, etc.) is held as a tag, and as information about the object, for example, when the object is text, information such as font, number of points, color, display position, etc. When the object is a photograph, information such as the encoding method, size, and display position is held separately from the tag. Therefore, when the digitized data is RDF format data, for example, when the encoded image format is stored as the tag, a collation process is performed after performing a decoding process and converting it into an RGB signal. You just have to do it. In addition, a part other than the tag (for example, a vector data part such as a font) may be collated after being converted into RGB image data via RIP or the like.

  In each of the above embodiments, each unit (each block) included in the digital color multifunction peripheral 1, the card (external storage device) 93, and the server device 50 is realized by software using a processor such as a CPU. That is, the digital color multifunction peripheral 1, the card 93, and the server device 50 include a CPU (central processing unit) that executes instructions of a control program for realizing each function, a ROM (read only memory) that stores the program, and the program. A RAM (random access memory) to be developed, a storage device (recording medium) such as a memory for storing the program and various data, and the like are provided. An object of the present invention is to provide program codes (execution format program, intermediate code program, source program) of control programs for the digital color multifunction peripheral 1, the card 93, and the server device 50, which are software for realizing the functions described above, on a computer. The recording medium recorded so as to be readable is supplied to the digital color multifunction peripheral 1, the card 93, and the server device 50, and the computer (or CPU or MPU) reads and executes the program code recorded on the recording medium. Is done.

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the digital color multifunction peripheral 1, the card 93, and the server device 50 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Further, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  The blocks of the digital color multifunction peripheral 1, the card 93, and the server device 50 are not limited to those realized using software, and may be configured by hardware logic. A combination of hardware to be performed and arithmetic means for executing software for controlling the hardware and performing the remaining processing may be used.

  The image processing system (computer system) according to the present invention performs various processes such as an image input apparatus such as a flatbed scanner, a film scanner, and a digital camera, and the similarity determination process and the registration process by loading a predetermined program. The image forming apparatus may be a computer, an image display device such as a CRT display or a liquid crystal display that displays the processing result of the computer, and an image forming device such as a printer that outputs the processing result of the computer to paper or the like. Furthermore, a network card, a modem, or the like as communication means for connecting to a server or the like via a network may be provided.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  The present invention can be applied to an image processing apparatus that determines the similarity between input image data and a registered image and performs processing according to the determination result.

1 is a block diagram showing a schematic configuration of a document collation processing unit provided in an image processing apparatus according to an embodiment of the present invention and an external storage device connected to the image processing apparatus. 1 is a perspective view of an image processing apparatus according to an embodiment of the present invention. 1 is a block diagram illustrating a schematic configuration of an image processing apparatus according to an embodiment of the present invention. It is a block diagram which shows schematic structure of the feature point calculation part with which the image processing apparatus shown in FIG. 3 is equipped. It is explanatory drawing which shows an example of the filter coefficient of the mixing filter with which the MTF process part of the image processing apparatus shown in FIG. 3 is equipped. It is explanatory drawing which shows an example of the connection area | region extracted from input image data by the feature point calculation part of the image processing apparatus shown in FIG. 3, and the gravity center of this connection area | region. It is explanatory drawing which shows an example of each gravity center (feature point) of the some connection area | region extracted from the character string contained in input image data by the feature point calculation part of the image processing apparatus shown in FIG. It is explanatory drawing which shows an example of the attention feature point and peripheral feature point which are extracted when the feature-value calculation part of the image processing apparatus shown in FIG. 3 calculates a feature-value. (A)-(c) is explanatory drawing which shows an example of the combination of the attention feature point and surrounding feature point which are extracted when the feature-value calculation part of the image processing apparatus shown in FIG. 3 calculates a feature-value. . (A)-(c) is explanatory drawing which shows an example of the combination of the attention feature point and surrounding feature point which are extracted when the feature-value calculation part of the image processing apparatus shown in FIG. 3 calculates a feature-value. . (A) And (b) is explanatory drawing which shows an example of the index showing the hash value and input image data about each feature point registered into a hash table in the image processing apparatus shown in FIG. It is a graph which shows an example of the number of votes with respect to each registration image in the voting process part of the image processing apparatus shown in FIG. It is a flowchart which shows the flow of a process in the image processing apparatus and external storage device shown in FIG. It is a flowchart which shows the flow of the registration process in the image processing apparatus and external storage device shown in FIG. It is a flowchart which shows the flow of the similarity determination process in the image processing apparatus and external storage device shown in FIG. It is explanatory drawing which shows an example of the information registered into the external storage device shown in FIG. It is a block diagram which shows the modification of the external storage apparatus connected to the document collation process part with which the image processing apparatus concerning one Embodiment of this invention is equipped, and this image processing apparatus. FIG. 18 is a flowchart showing a flow of processing in the image processing apparatus and the external storage device shown in FIG. 17. It is a flowchart which shows the flow of the registration process in the image processing apparatus and external storage device shown in FIG. FIG. 18 is a flowchart showing a processing flow when processing based on an individual processing rule is performed in the image processing device and the external storage device shown in FIG. 17. It is a block diagram which shows the other modification of the external memory | storage device connected to the document collation process part with which the image processing apparatus concerning this Embodiment is equipped, and this image processing apparatus. It is a block diagram which shows the modification of the image processing apparatus concerning one Embodiment of this invention. It is explanatory drawing which shows the structural example of the image processing system concerning one Embodiment of this invention. (A)-(d) is description which shows an example of the combination of the attention feature point and peripheral feature point which are extracted when the feature-value calculation part of the image processing apparatus concerning one Embodiment of this invention calculates a feature-value. FIG. (A)-(d) is description which shows an example of the combination of the attention feature point and peripheral feature point which are extracted when the feature-value calculation part of the image processing apparatus concerning one Embodiment of this invention calculates a feature-value. FIG. It is explanatory drawing which shows an example of the image processing system concerning one Embodiment of this invention. It is explanatory drawing which shows an example of the image processing apparatus with which the image processing system shown in FIG. 26 is equipped. It is a flowchart which shows the flow of the registration process in the image processing system shown in FIG. It is a flowchart which shows the flow of the collation process in the image processing system shown in FIG.

Explanation of symbols

1 Digital color MFP (image processing device, image forming device, image reading device, image transmitting device)
1 'Flatbed scanner (image processing device, image reading device)
2 Color image input device (input data acquisition unit, image input device)
3,3 'color image processing device (image processing device)
4 color image output device (image output unit)
5 Communication devices (input data acquisition unit, information acquisition unit, information transmission unit)
6 Operation panel (display unit, instruction input unit)
7 Control unit (control unit, authentication processing unit)
8 Memory (information storage unit, authentication storage unit)
13 Document collation processing unit 31 Feature point calculation unit (feature amount extraction unit)
32 feature amount calculation unit (feature amount extraction unit)
33 Voting processing unit (similarity determining unit)
34 Similarity determination processing unit (similarity determination unit)
35 Registration processing unit 50 Server device (information storage device, external storage device)
91 Card reader (information acquisition unit, information transmission unit)
93 card (information storage device, external storage device)
94 Registration processing unit (data transmission unit, data acquisition unit, registration information acquisition unit, registration processing unit)
95 Memory (storage unit)
96 Hash table 97 Individual processing table 98 Voting processing unit (similarity determining unit)
99 Similarity determination processing unit (similarity determination unit)
100 Image Processing System 101 Hash Table 102 Common Processing Table 103 Individual Processing Table 111 Fingerprint Reading Unit (Personal Authentication Acquisition Unit)
112 personal authentication acquisition unit 121 control unit (control unit, authentication processing unit)
122 Registration processing unit 123 Voting processing unit (similarity determination unit)
124 similarity determination processing unit (similarity determination unit)
125 Storage Unit 126 Personal Authentication Table 127 Common Processing Table 128 Individual Processing Table Group 129 Hash Table

Claims (4)

An input data acquisition unit for acquiring input image data;
A feature amount extraction unit for extracting the feature amount of the input image data;
A similarity determination unit that compares the feature amount of the input image data with the feature amount of the registered image registered in advance to determine whether the input image data is similar to the registered image;
An image processing apparatus comprising: a control unit that controls an operation of a processing unit that performs processing on the input image data according to a determination result of the similarity determination unit ;
An image processing system comprising a portable information storage device detachably attached to the image processing device ,
The registered images include common processed images and individual processed images.
The information storage device stores individual processing rule information indicating a processing amount to be applied to input image data determined to be similar to the feature amount of the individual processing image and the individual processing image,
The image processing apparatus includes:
An information storage unit that stores common processing rule information indicating a feature amount of the common processing image and processing content to be applied to input image data determined to be similar to the common processing image;
An information transmission unit that reads information stored in the information storage device and transmits information to the information storage device;
A process of comparing the feature amount of the input image data with the feature amount of the common processing image to determine whether the input image data is similar to the common processing image, and the feature amount of the input image data and the individual image The image processing device or the information storage device includes a similarity determination unit that performs a process of comparing the feature amount of the processed image and determining whether the input image data is similar to the individual processed image.
The common processing image and the common processing rule information are set in common regardless of the user, and the individual processing image and the individual processing rule information are individually set for the user who owns the information storage device. And
The processing content shown in the common processing rule information prohibits or restricts execution of processing on input image data.
The control unit
If the similarity determination unit determines that the input image data is similar to the common processing image, the processing unit determines whether the input image data is similar to the individual processing image. The processing based on the common processing rule information is executed,
When the similarity determination unit determines that the input image data is not similar to the common processing image and similar to the individual processing image, the processing unit is based on the individual processing rule information. An image processing system characterized in that processing is executed . The processing unit performs copying, printing, electronic distribution, facsimile transmission, filing, image correction, scaling, rotation, movement, trimming, composition of other images, data format conversion, and encoding for input image data. The image processing system according to claim 1, wherein any one of the processes or a combination of any two or more of the processes is performed. The image processing apparatus includes:
A display for displaying information;
And an instruction input unit that receives an instruction input from the user,
When the similarity determination unit determines that the input image data is not similar to the common processing image and similar to the individual processing image, the control unit indicates the individual processing rule information. The processed content is displayed on the display unit, and when the instruction input unit receives an instruction to execute the processing based on the processing content, the processing unit executes the processing based on the processing content for the input image data. The image processing system according to claim 1 , wherein the image processing system is an image processing system . The image processing apparatus includes:
An authentication storage unit that stores identification information of a user who is permitted to execute an editing process on the common processing image and the common processing rule information stored in the information storage unit;
An instruction input unit for receiving user instruction input;
The information input through the instruction input unit is compared with the identification information stored in the authentication storage unit, and the information input through the instruction input unit and the identification information stored in the authentication storage unit are the but the information storage unit in the stored the common processing image and the common processing rules Ruyu over the authentication unit to allow editing of information to the user that only performs an input with respect to the instruction input unit when the matching The image processing system according to claim 1, further comprising: an image processing system according to claim 1 .

Images