JP5657483B2 - Image processing apparatus and image forming system - Google Patents

Description

  The present invention relates to an image processing apparatus that edits and outputs input image data, and an image forming system having the image processing apparatus.

  Conventional image processing apparatuses and image forming systems read document image data with a scanner and perform an editing process using an image area near a specific image as an editing area.

JP 2006-211477 A

  However, in the conventional image processing apparatus and image forming system, when an image pattern representing confidentiality or importance such as “confidential” is included in the editing target area, an image in the editing target area is displayed. There has been a case where an image in which an image pattern representing confidentiality or importance is lost is formed by editing.

  An image processing apparatus according to the present invention inputs an image input unit for inputting image data, a registration unit for registering a specific image pattern, and designation information for designating a specific area of the image data input by the image input unit. An editing area determining unit that determines an editing area in the image data based on the specific image pattern and the specific area, and outputs a determination result based on the determination result of the editing area determination unit And an image editing unit for performing an editing process on the image data.

  The image processing system of the present invention includes the image processing apparatus and an image forming unit that inputs the image data subjected to the editing process from the image processing apparatus and forms an image on a print medium.

  According to the image processing apparatus and the image forming system of the present invention, a specific image pattern that displays confidentiality and importance is registered in advance, and a specific image registered in advance in a specified specific area that is an object of editing processing It is determined whether or not a pattern is included. When a specific image pattern is included, the specific area is not edited. For this reason, there is an effect that a specific image pattern indicating confidentiality or importance is not lost.

FIG. 1 is a schematic functional block diagram showing the image forming system of FIG. 2 in Embodiment 1 of the present invention. FIG. 2 is a schematic configuration diagram showing the image forming system in Embodiment 1 of the present invention. FIG. 3 is a diagram showing an example of an area designation screen displayed on the display unit of the operation panel in FIG. FIG. 4 is a diagram showing an example of an area designation screen displayed on the display unit of the operation panel in FIG. FIG. 5 is a diagram showing an example of an area designation screen displayed on the display unit of the operation panel in FIG. FIG. 6 is a diagram showing an example of an area designation screen displayed on the display unit of the operation panel in FIG. FIG. 7 is a diagram showing an example of the specific area of FIG. 6 displayed on the display unit of the operation panel in FIG. FIG. 8 is a diagram showing an example of image data obtained by performing mask processing on the specific area of FIG. 7 displayed on the display unit of the operation panel in FIG. FIG. 9 is a flowchart showing the operation of the image forming system of FIG. 1 in Embodiment 1 of the present invention. FIG. 10 is a flowchart showing the processing of the step of determining the editing area in FIG. FIG. 11 is a schematic functional block diagram showing the image forming system of FIG. 2 in Embodiment 2 of the present invention. FIG. 12 is a diagram showing an example of the mask prohibition area displayed on the display unit of the operation panel in FIG. FIG. 13 is a diagram showing an example of a specific area displayed on the display unit of the operation panel in FIG. FIG. 14 is a diagram showing an example of image data subjected to mask processing displayed on the display unit of the operation panel in FIG. FIG. 15 is a flowchart showing the operation of the image forming system of FIG. 11 in Embodiment 2 of the present invention. FIG. 16 is a flowchart showing the process of the step of detecting the mask prohibited area in FIG.

  Modes for carrying out the present invention will become apparent from the following description of the preferred embodiments when read in light of the accompanying drawings. However, the drawings are only for explanation and do not limit the scope of the present invention.

(Configuration of Example 1)
FIG. 2 is a schematic configuration diagram showing the image forming system in Embodiment 1 of the present invention.

  The image forming system according to the first embodiment is, for example, a digital multi-function peripheral, and forms an image on a print medium (for example, paper) P based on the image processing apparatus 10 that processes input image data and the image data. And an image forming unit 70.

  The image forming apparatus 10 includes an image processing unit 10a, and a system bus 12 is connected to the image processing unit 10a. A scanner interface (hereinafter referred to as “I / F”) 13 connected to the image input unit 30, an external I / F 14 connected to the image forming apparatus 70, and an operation panel 40 are connected to the system bus 12. These and the image processing unit 10a can communicate with each other. The image processing unit 10a includes a read only memory (hereinafter referred to as “ROM”) 11a that is a nonvolatile memory that stores various programs and the like, and a random access memory (hereinafter referred to as “RAM”) 11b that is a volatile memory. And a central processing unit (hereinafter referred to as “CPU”) 20 that reads and executes a program stored in the ROM 11a into the RAM 11b.

  The image input unit 30 is, for example, a scanner, and includes a mounting table, an automatic document feeder, a light source, a light receiving element, and a signal processing unit (not shown). The image input unit 30 has a function of irradiating light from a light source onto a document placed on a mounting table or a document conveyed by an automatic document feeder, and a light receiving element receives the reflected light to read an image signal. doing. Further, the image input unit 30 has a function of performing signal processing such as analog / digital conversion (A / D conversion) on the read image signal, and generating and outputting digital image data. ing.

  The operation panel 40 is composed of a liquid crystal display (hereinafter referred to as “LCD”) or the like, and includes a display unit 41 for displaying image data, a numeric keypad and a selection key (not shown), a reading start button, a touch panel arranged on the LCD, and the like. And an operation unit 42 configured as described above. The operation panel 40 receives control signals such as an image reading start instruction and an image reading interruption instruction, and designation information (for example, an address) of an area instructed by the user by an operation of a user (hereinafter referred to as “user”). Has a function to input.

  The image forming unit 70 is, for example, an electrophotographic page printer. The image forming unit 70 inputs image data processed by the image processing unit 10 and forms and fixes a developer (for example, toner) image on the paper P. It has a function of forming an image.

  FIG. 1 is a schematic functional block diagram showing the image forming system of FIG. 2 in Embodiment 1 of the present invention.

  The configuration of the image processing system according to the first embodiment is as described in the description of FIG. In other words, the image forming system includes an image processing apparatus 10 that processes input image data and an image forming unit 70. The image forming apparatus 10 includes an image processing unit 10a, an image input unit 30, and an operation panel 40.

  The image processing unit 10 a includes a storage unit 11, a registration unit 21, an area designation unit 22, an editing area determination unit 23, and an image editing unit 24. The storage unit 11 includes a ROM 11a and a RAM 11b. The registration unit 21, the region specifying unit 22, the mask region determining unit 23 serving as an editing region determining unit, and the image editing unit 24 are stored in the registration unit 21, the region specifying unit 22, the mask region by the CPU 20 shown in FIG. Each function is realized by reading a program corresponding to the determination unit 23 and the image editing unit 24 to the RAM 11b and executing the program.

  The registration unit 21 has a function of writing and registering a specific image pattern input from the image input unit 30 in the RAM 11b based on a user instruction on the operation panel 40. The specific image pattern includes, for example, a mark for displaying confidential information. The area designating unit 22 displays the image data input by the image input unit 30 on the display unit 41 of the operation panel 40 and prompts the user to designate a specific area to be subjected to editing processing. The designation information is input and stored in the RAM 11b. Here, the editing process is, for example, a mask process, and a pixel corresponding to a mask area that is an editing area is replaced with an arbitrary mask image pattern (for example, black solid, white solid, paper background color, etc.). To paint. The designation information stored in the RAM 11b is input to the mask area determination unit 23.

  The mask area determining unit 23 determines whether or not the specific image specified by the registration unit 21 is included in the specific area specified by the area specifying unit 22. When the specific area includes a specific image pattern, the specific area designation information is invalidated. When the specific area does not include the specific image pattern, the specific area designation information is valid and the specific area is valid. Is determined as a mask area, and the determination result is output. The determination result is input to the image editing unit 24.

  The image editing unit 24 has a function of performing mask processing on image data corresponding to the mask area determined by the mask area determination unit 23 in the image data stored in the RAM 11 b of the storage unit 11. The edited image data is input to the image forming unit 70.

  The image forming unit 70 has a function of inputting image data edited by the image editing unit 24, performing gradation correction, and the like, and forming an image on the paper P with toner.

  3, 4, 5, and 6 are diagrams showing examples of area designation screens displayed on the display unit 41 of the operation panel 40 in FIG. 1.

  In FIG. 3, the input image data 50 is displayed on the display unit 41. A determination button 51 for determining the designation of the specific area, a cancel button 52 for canceling the designation, and an end button for ending the designation process for the specific area 53 is displayed. On the image data 50, an icon representing a user's finger or a touch pencil is displayed. When the user touches the upper left end point 55 of the designated rectangular area, the upper left end point 55 of the specific area is specified.

  In FIG. 4, the lower right point 56 is touched by the user. By this operation, the temporary specific area 57 is displayed. In FIG. 5, when the determination button 51 is pressed, the selected specific area is confirmed, and the confirmed specific area 58 is displayed.

  In FIG. 6, the same operation can be repeated to designate a plurality of specific areas 59 and 60. When the end button 53 is pressed, the specific area designating process is terminated.

  FIG. 7 is a diagram showing an example of the specific areas 58, 59, and 60 in FIG. 6 displayed on the display unit 41 of the operation panel 40 in FIG. Further, FIG. 8 is a diagram showing an example of image data 50 obtained by performing mask processing on the specific areas 58, 59, 60 of FIG. 7 displayed on the display unit 41 of the operation panel 40 in FIG.

  In FIG. 7, specific areas 58, 59, and 60 are displayed. The specific area 59 includes a specific image pattern 59a. The specific image pattern 59a is a pattern indicating “confidential” in the example of FIG. The specific areas 58 and 60 do not include a specific image pattern. As a result, the mask area determination unit 23 determines the specific areas 58 and 60 as mask areas. Since the specific area 59 includes the specific image pattern 59a, the mask area determination unit 23 invalidates the specification of the mask of the specific area 59.

  As a result, as shown in FIG. 8, the specific areas 58 and 60 are masked by the image editing unit 24 to become mask areas 58a and 60a, and the mask area 59 is not masked. Is displayed.

(Operation of Example 1)
FIG. 9 is a flowchart showing the operation of the image processing system of FIG. 1 in Embodiment 1 of the present invention.

  This process is started when the user gives an instruction to start registration of a specific image pattern using the operation unit 42 of the operation panel 40.

  In step S1, the registration unit 21 registers an image pattern to be masked in advance. The specific image pattern is an image composed of character strings and symbols indicating the confidentiality and importance of the document. For example, the specific image pattern is a specific image pattern 59a indicating “confidential” as shown in FIG. This specific image pattern 59a represents that the document of the image data 50 is “confidential”. Such specific image patterns include, for example, “Confidential” and “Handling Precautions” in addition to “Confidential”.

  As this specific image pattern, image data obtained by reading a specific document from the image input unit 30 may be used, or image data may be directly acquired from a network or a portable storage medium through the external I / F 14.

  In step S2, the image input unit 30 reads a document and acquires image data. In step S3, the storage unit 11 stores the image data in the RAM 11b.

  In step S4, the area specifying unit 22 displays the image data stored in the RAM 11b on the display unit 41 of the operation panel 40, and prompts the user to specify a specific area that is scheduled to be masked. Examples of area designation screens for prompting designation of specific areas are shown in FIGS.

  In step S <b> 5, the mask area determination unit 23 includes the specific image pattern registered in the registration unit 21 in the partial image of the image data corresponding to one or more specific areas specified by the area specification unit 22. Whether the specific area including the specific image pattern is invalidated, and the specific area not including the specific image pattern is determined as the mask area. An example in which the specific area and the specific image pattern are displayed is shown in FIG.

  In step S <b> 6, the image editing unit 24 masks the mask area determined by the mask area determining unit 23 with respect to the image data acquired by the image input unit 30. More specifically, the image editing unit 24 assigns pixels corresponding to the mask area determined by the mask area determining unit 23 to an arbitrary mask image pattern (for example, a black solid image) from the image data acquired by the image input unit 30. , White solid, paper background color, etc.). An example of image data subjected to mask processing is shown in FIG.

  In step S <b> 7, the image forming unit 70 inputs the image data edited by the image editing unit 34, forms an image on the paper P, and ends this processing.

  FIG. 10 is a flowchart showing the process of step S5 for determining the mask area in FIG.

  In the first embodiment, a known template matching method is used as a method for determining whether or not the specific area specified by the area specifying unit 22 includes the specific image pattern registered by the registration unit 21. Hereinafter, a method for determining a mask area will be described with reference to this flowchart.

  This process is a subroutine called in step S5 of FIG. 9, and this process is started by being called.

  In step S11, a partial image of the input image data corresponding to the specific area specified by the area specifying unit 22 is read. In step S12, the registration unit 21 reads a specific image pattern registered in the RAM 11b.

  In step S13, when the size of the image pattern is M × N, a similarity R that is a cross-correlation coefficient representing the similarity between the M × N size local region in the specific region image and the image pattern is calculated. The similarity R is calculated by the following formulas (1), (2), and (3).

  Here, I is the density value in the M × N local area of the image of the specific area, T is the density value of the specific image pattern, i is the x coordinate of the M × N local area in the specific area, and j is The y coordinate of the local area in the specific area is shown.

  The similarity R takes a value of −1 ≦ R ≦ 1, and takes a maximum value of 1 when the values match completely.

  In step S14, the similarity R is obtained for all M × N local regions in the specific region, and the maximum value among them is derived as the maximum similarity Rmax.

  In step S15, the maximum similarity Rmax and the threshold Th are compared. If the maximum similarity Rmax ≧ threshold Th (YES), it is determined that a specific image pattern is included in the specific area, and the process proceeds to step S16. When the maximum similarity Rmax <threshold Th (NO), it is determined that a specific image pattern is not included in the specific area, and the process proceeds to step S17. Here, since it is rare that the local region image in the specific region completely matches the specific image pattern, it is preferable to set the threshold value Th to a value that is regarded as a match when it is approximated to some extent. For example, in the first embodiment, the threshold Th is set to 0.8.

  In step S16, since the specific image pattern is included in the specific area, the specific area is invalidated and the process proceeds to step S19. In step S17, it is confirmed whether or not the determination processing in steps S12 to S15 has been performed for all specific image patterns registered in the registration unit 21. If determination processing has been performed for all specific image patterns (YES), the process proceeds to step S18. In step S17, when there is an undecided specific image pattern (NO), the process returns to step S12 to read a new specific image pattern.

  In step S18, since all the specific image patterns registered by the registration unit 21 are not included in the specific area, the specific area is determined as a mask area. In step S19, it is determined whether or not the mask area determination processing in steps S11 to S18 has been performed for all the specific areas. If the mask area determination process has been performed for all the specific areas (YES), this process ends. If there is an undetermined specific area (NO), the process returns to step S11, and a partial image of a new specific area is read. Through the above processing, all mask regions are determined, and the process returns to step S6 in FIG.

(Effect of Example 1)
According to the image processing apparatus 10 and the image forming system of the first embodiment, the registration unit 21 registers in advance a specific image pattern that displays confidentiality and importance. The area designation unit 22 designates a specific area, and the mask area determination unit 23 determines whether or not a specific image pattern registered in advance is included in the designated specific area. When the specific area includes a specific image pattern, the mask area determination unit 23 does not mask the specific area. For this reason, it is possible to prevent the loss of a specific image pattern indicating confidentiality or importance.

(Configuration of Example 2)
The configuration of the image forming system according to the second embodiment of the present invention is the same as that of the first embodiment, as shown in FIG.

  FIG. 11 is a schematic functional block diagram showing the image forming system in FIG. 2 according to the second embodiment of the present invention. Elements common to those in FIG. 1 showing the first embodiment are denoted by common reference numerals. Yes.

  In the image forming system of the second embodiment, a mask prohibition area detection unit 25 as a new edit prohibition area detection unit is newly added to the first embodiment, and the configuration of the mask area determination unit 23A is the mask of the first embodiment. This is different from the area determination unit 23.

  The mask prohibition area detection unit 25 compares the image data stored in the storage unit 11 with the specific image pattern registered in the registration unit, and the area containing the specific image pattern in the image data stored in the storage unit 11 is compared. It has a function of detecting as a mask prohibited area. The detected mask prohibition area is input to the mask area determination unit 23A.

  The mask area determining unit 23A has a function of determining a mask area to be masked with reference to the specific fixed area specified by the area specifying unit 22 and the mask prohibited area detected by the mask prohibited area detecting unit 25. ing. Information on the determined mask area is input to the image editing unit 24. Other configurations are the same as those of the first embodiment.

  12 and 13 are diagrams showing examples of mask prohibited areas displayed on the display unit 41 of the operation panel 40 in FIG. Further, FIG. 14 is a diagram showing an example of image data 50 subjected to mask processing displayed on the display unit 41 of the operation panel 40 in FIG.

  In FIG. 12, in the image data 50, an area 61 that matches a specific image pattern (confidential) 59a is detected as a mask prohibited area. In FIG. 13, specific areas 58, 59, and 60 are displayed. In FIG. 13, the specific area 59 and the mask prohibition area 61 partially overlap each other. The specific areas 58 and 60 do not overlap with the mask prohibition area 61. FIG. 14 shows an example of image data obtained by performing mask processing on the mask area. An area 59b obtained by decimating an overlapping area between the mask prohibition area 61 and the specific area from the specific area 59 in FIG. 13 and specific areas 58 and 60 that do not overlap with the mask prohibition area 61 shown in FIG. Edited image data 50b determined as 60a and subjected to the mask processing shown in FIG. 14 is generated.

(Operation of Example 2)
FIG. 15 is a flowchart showing the operation of the image forming system of FIG. 11 according to the second embodiment of the present invention, and steps common to the steps in FIG.

  In the flowchart of FIG. 15, steps S1 to S4 and steps S6 and S7 are the same as those in the first embodiment. Steps S21 and S22 are newly added as operations of the image forming system according to the second embodiment of the present invention.

  This process is started when the user gives an instruction to start registration of a specific image pattern using the operation unit 42 of the operation panel 40.

  As in the first embodiment, steps S1 to S3 are executed, a specific image pattern is registered, and image data is input and stored in the storage unit 11.

  In step S21 different from the first embodiment, the mask prohibition area detection unit 25 compares the image data stored in the storage unit 11 with the specific image pattern registered in the registration unit 21, and the specific image pattern in the image data. Whether or not is included is determined. When the specific image pattern is included in the image data, an area including the specific image pattern (confidential) 59a is detected as a mask prohibition area 61 as shown in FIG.

  Step S4 similar to that in the first embodiment is executed, and the specific areas 58, 59, and 60 are designated as shown in FIG.

  In step S22, as shown in FIG. 14, the mask area determining unit 23A includes the specific areas 58, 59, and 60 designated by the area designating part 22 and the mask prohibited area 61 detected by the mask prohibited area detecting unit 25. , When the specific areas 58, 59, 60 and the mask prohibition area 61 overlap, an area obtained by decimating an overlap portion between the mask prohibition area 61 and the specific area from the specific area 59 is determined as the mask area 59b. . Steps S6 and S7 similar to those in the first embodiment are executed, and the present process is terminated.

  FIG. 16 is a flowchart showing the process of step S21 for detecting the mask prohibited area in FIG.

  In the second embodiment, a known template matching method is used as a method for determining whether or not the image data stored in the storage unit 11 includes a specific image pattern registered in the registration unit 21. Hereinafter, a method for detecting a mask prohibited area will be described in accordance with this flowchart.

  This process is a subroutine of the process shown in FIG. 15, and is started by being called in step S21 of FIG.

  In step S31, the image data stored in the RAM 11b is read. In step S32, the specific image pattern registered by the registration unit 21 is read out. In step S33, if the size of the specific image pattern is M × N, the similarity R between the M × N size local region in the image data and the specific image pattern is calculated.

  In step S34, the similarity R is compared with a threshold Th (for example, threshold Th = 0.8). When the similarity R ≧ the threshold Th (YES), the local region of the image data matches the specific image pattern. The process proceeds to step S35. If similarity R <threshold Th (NO), the process proceeds to step S36.

  In step S35, since the local area of the image data matches the image pattern, the corresponding local area is stored in the RAM 11b as a mask prohibited area. In step S36, it is determined whether or not determination processing has been performed for all M × N local regions in the image data. When the determination process is performed for all M × N local regions (YES), the process proceeds to step S37. When there is an unprocessed local area (NO), the process returns to step S33, and the similarity R in the new local area is calculated.

  In step S37, it is determined whether or not determination processing has been performed for all the specific image patterns registered in the registration unit 21. When determination processing has been performed for all the specific image patterns (YES), this processing is performed. End and return to step 4 in FIG. If there is an undecided specific image pattern (NO), the process returns to step S32, and a new specific image pattern is read. Through the above processing, all mask prohibited areas are detected.

(Effect of Example 2)
According to the second embodiment, the mask prohibition area detection unit 25 detects a mask prohibition area from the image data, and the mask area determination unit 23A selects one of the mask prohibition areas among the specific areas specified by the area specification unit 22. Since the mask area is obtained by thinning out the area that overlaps the whole or the entire area, the mask area can be determined more precisely than in the first embodiment.

(Modification)
The present invention is not limited to the above-described embodiments, and various usage forms and modifications are possible. For example, the following forms (1) to (4) are available as usage forms and modifications.

  (1) In the first and second embodiments, as an image forming system, the image processing apparatuses 10 and 10A including the image processing units 10a and 10aA, the image input unit 30, and the operation panel 40, and the image forming unit 70 are provided. Although an example of an integrated digital multifunction peripheral has been described as an example, a personal computer with a scanner (hereinafter referred to as “PC”) is used as the image processing apparatuses 10 and 10A, and the PC and an image forming unit 70 such as a printer are used. May be connected via a network to form an image forming system.

  (2) In the first and second embodiments, a printer is described as an example of the image forming unit 70. However, a facsimile machine or an image data server may be used.

  (3) In the first and second embodiments, the scanner has been described as an example of the image input unit 30, but a storage medium such as a hard disk in which image data is stored may be used.

  (4) In the first and second embodiments, the mask process is described as an example of the editing process. However, the present invention is not limited to this, and may be a process such as a deletion process or a mosaic process.

DESCRIPTION OF SYMBOLS 10,10A Image processing apparatus 10a, 10aA Image processing part 11 Storage part 21 Registration part 22 Area designation part 23, 23A Mask area determination part 24 Image editing part 25 Mask prohibition area | region detection part 30 Image input part 40 Operation panel 40a Display part 40b Operation unit 70 Image forming unit

Claims (8)

An image input unit for inputting image data;
A registration unit for registering a specific image pattern;
An area designation unit for inputting designation information for designating a specific area of the image data input by the image input unit;
An editing area determination unit that determines an editing area in the image data and outputs a determination result based on the specific image pattern and the specific area;
An image editing unit that performs an editing process on the image data based on the determination result of the editing area determination unit;
An image processing apparatus comprising: An image processing apparatus according to claim 1 is provided.
A display unit for displaying the image data;
The area specifying unit is
An image processing apparatus, wherein the image data inputted by the image input unit is displayed on the display unit and the designation information for designating the specific area is inputted. The editing area determination unit
When the specific area includes the specific image pattern, the specification information of the specific area is invalidated, and when the specific area does not include the specific image pattern, the specific area 3. The image processing apparatus according to claim 1, wherein the specific information is determined to be valid, the specific area is determined as the editing area, and the determination result is output. The editing area determination unit
A similarity is derived by template matching between the image data of the specific area and the specific image pattern, and if the similarity is greater than a threshold, it is determined that the specific image pattern is included in the specific area When the designation information of the specific area is invalidated and the similarity is smaller than the threshold, it is determined that the specific image pattern is not included in the specific area and the designation information of the specific area is determined. 3. The image processing apparatus according to claim 1, wherein the specific region is determined as the editing region with the determination being effective, and the determination result is output. The image processing apparatus according to claim 1 or 2, further comprising:
In the image data input by the image input unit, an edit prohibited area detecting unit that detects an area including the specific image pattern as an edit prohibited area;
The editing area determination unit
When the specific region including a part or all of the editing prohibition region, the editing is not prohibited area portion of said specific region is determined as the editing area, and outputs the determined result Image processing device . The edit prohibited area detection unit
The similarity is derived by template matching between the image data input by the image input unit and the specific image pattern, and an area where the similarity is greater than a threshold is detected as the edit prohibited area. Item 6. The image processing apparatus according to Item 5. The editing process by the image editing unit includes:
The image processing apparatus according to claim 1, wherein the image processing apparatus is a filling process for filling the editing area. An image forming system including an image processing device and an image forming unit,
The image processing apparatus includes:
An image input unit for inputting image data;
A registration unit for registering a specific image pattern;
An area designation unit for inputting designation information for designating a specific area of the image data input by the image input unit;
An editing area determination unit that determines an editing area in the image data and outputs a determination result based on the specific image pattern and the specific area;
Based on the determination result of the editing area determination unit, and an image editing unit which performs an editing process on the image data,
The image forming unit includes:
An image forming system, wherein the image data subjected to the editing process is input to form an image on a print medium.

Images