JP2000216990A - Image processor, image processing method and storage medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prevent cases, where editing job is disable due to lack of an image that is used for a template by storing the reference relation information which shoes the reference relation between the prescribed template information and the input image information. SOLUTION: Full image frame information is retrieved from every page information on the template information to acquire the file name information from among object image information. Then the image information having the relevant file name is acquired from an HDD 103. The acquired input image information is combined with the watermark image information acquired from the HDD 103 with an exclusive OR operation to obtain the watermarked image information that is stored in an FDD 102. Then it is decided whether or not the generation of the watermarked image information and its storage in the FDD 102 are finished of full image frame information on the template information. When these operations are finished, the processed template information is added to the unprocessed template information and the input image information and then stored in the FDD 102.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to, for example, a technology for processing an image by handling an image file, and more particularly to a technology for performing an image editing process based on a user's selection.

[0002]

2. Description of the Related Art Conventionally, there is an image processing apparatus that stores input image information in a main storage unit, fits the image information into a template information window specified by a user, and outputs the template information. This window (Wi
The image information to be inserted into the (ndow) includes a material image always used for the template, an image to be printed out obtained by photographing with a digital camera or the like, and the like.

In the above image processing apparatus, input image information and template information can be stored in an external storage device, and the stored input image information and template information can be read into the image processing apparatus. so,
The template information can be edited and output. Of course, a material image or the like that is always used in a template can be stored in an external storage device separately from the template information.

[0004]

However, in the conventional image processing apparatus as described above, when re-editing or outputting using a material image, input image information, and template information stored in an external storage device, For example, if the user has mistakenly deleted the input image information or the material image, the input image information or the material image used together with the template information does not exist in the external storage device or the image processing device. Could not do the editing work.

[0005] Further, in the conventional image processing apparatus, using the template information and the material image information which are separately stored,
There is an advantage that editing such as adjustment of position and color can be performed for each material image, but on the other hand, for example, on the next day after the editing date, the same editing as the previous day is reproduced. It was very difficult.

Further, in the conventional image processing apparatus, the result image of the editing or the composition can be stored. However, at the time of the saving, the configuration is such that the result image itself is stored. If necessary, it was necessary to perform editing and synthesizing work again from the beginning.

Further, in a conventional image processing apparatus, when copyright information or the like is recorded as electronic watermark information with respect to template information or material image information, for example,
By editing and combining multiple material image information,
There is a possibility that the digital watermark information overlaps and cannot be recognized.

Therefore, an object of the present invention is to solve all or at least one of the above problems.
It is another object of the present invention to prevent an editing operation from being disabled because an image used for a template does not exist. Another object of the present invention is to make it possible to easily perform editing work on an image obtained after being synthesized with a template. It is another object of the present invention to be able to easily reproduce an edited image later. It is another object of the present invention to be able to easily add digital watermark information to an image after the synthesizing process. Another object of the present invention is to prevent the digital watermark information added to an image from being unrecognizable due to the image combining process. It is another object of the present invention to be able to easily reproduce the editing process from the template information for the editing process even when there is no target image for the editing process after the editing process. Another object of the present invention is to provide an apparatus, a method, and a recording medium that are optimal for transmitting an image via a network and performing a synthesis process of the image.

[0009]

For such a purpose,
According to a preferred embodiment of the present invention, an image editing unit that edits predetermined template information based on input image information, and an editing process in the image editing unit,
An image processing apparatus including a reference relation storage unit that stores reference relation information indicating a reference relation between the template information and the image information is disclosed. According to this configuration, it is possible to prevent the editing operation from being disabled because there is no image used for the template. Also, editing work can be easily performed on an image obtained after being synthesized with the template.

According to a preferred embodiment of the present invention, in the image processing apparatus, image input means for inputting the image information, and image information for storing the image information input by the image input means. Storage means, template information storage means for storing the template information, image output means for outputting the image information edited by the image editing means, and the image information edited by the image editing means, Storage means for storing the information together with the template information used therein. According to this configuration, the edited image can be easily reproduced later.

According to a preferred embodiment of the present invention, there is provided a digital watermark information storing means for storing predetermined digital watermark image information, and a digital watermark processing means for editing the image information edited by the image editing means. An image processing apparatus further includes a digital watermark information adding unit that adds image information, and a digital watermark information removing unit that removes the digital watermark image information from the image information to which the digital watermark image information has been added. According to this configuration, the digital watermark information can be easily added to the image after the synthesizing process.

According to a preferred embodiment of the present invention, input means for inputting a plurality of pieces of image information with a digital watermark, combining means for combining the plurality of pieces of image information, and When synthesizing image information, when the digital watermarks of the plurality of image information input by the input unit overlap, an image processing apparatus including control means for controlling each of the digital watermarks to be recognized is disclosed.
According to this configuration, it is possible to prevent the digital watermark information added to the image from becoming unrecognizable due to the image combining process.

According to a preferred embodiment of the present invention, there is provided an image editing means for editing input image information based on predetermined template information, and the template information in the editing processing by the image editing means. A reference relationship storage unit for storing reference relationship information indicating a reference relationship of the image information; and at least two pieces of image information edited based on the template information by the image editing unit to form one piece of image information An image processing apparatus is disclosed which includes a rendering unit that performs the image synthesis, and an image combination information storage unit that stores at least one of a position and a combination method of each piece of image information subjected to image combination by the rendering unit. . According to this configuration, even when there is no target image of the editing process after the editing process, the editing process can be easily reproduced from the template information of the editing process.

Still other objects and features of the present invention will become apparent from the following brief description of embodiments and drawings.

[0015]

Embodiments of the present invention will be described below with reference to the drawings.

(First Embodiment) The present invention provides, for example,
It is applied to an image processing apparatus 100 as shown in FIG. The image processing apparatus 100 has a function of performing processing on input image information based on template information specified by a user and outputting the processed image information.
It should be noted that the template information itself allows a user to register an image (material image or the like) desired by the user. Further, the image at this time may be, for example, an image held in the image processing apparatus 100 in advance, or an image input by a user.

Specifically, first, the image processing apparatus 100
Is a CPU 101 for controlling the operation of the entire apparatus, and a floppy disk (F) serving as an external storage device for storing various information.
DD) 102, a hard disk drive (HDD) 1 which is a main storage device for storing image information and template information
03, a RAM 104 for writing and reading various data during template information storage processing and print processing operation;
ROM 105 storing a processing program for template information storage processing and printing processing operation, keyboard 106 for inputting various data and instructions from a user, video RAM (VRAM) 107 for storing image display data, printer interface (printer I / F) ) 109, scanner interface (scanner I / F) 112, and network interface (network I / F)
114 are provided, and these are configured to exchange data with each other via a bus 111. VRAM
A CR 107 for displaying an image, an operation panel, or the like,
The printer I / F 109 is connected to a printer 110 for performing image print output, and the scanner I / F 109 is connected to the printer I / F 109.
A scanner 113 for inputting an image is connected to F112, and another image processing apparatus 200 is connected to the network I / F 114 via a network.

FIG. 2 shows the structure (data format) of the template information 300 used by the image processing apparatus 100. The template information 300 in the present embodiment is, for example, template image information shown in FIG. 3 described later.

The template information 300 includes, for example, an HD
D103 (or FDD 102), and as shown in FIG.
, And a plurality of page information 320a, 320b,... The header information 310 includes information 311 on the number of page information. For example, if the page information is 320
In the case of a and 320b, "2" is stored here.

Each of the page information 320a, 320b,... Has the same configuration, and stores information corresponding to each page of the print output. Specifically, for example, the page information 320b stores page number information 321, file name information 322 of output image information, and number information 323 of image frames (windows) included in the template. At the same time, for each image frame, the position information 32 of the image frame
4, hierarchy information 325, size information 326, attribute information 32
7, file name information 328 of the image information to be inserted, and new image frame number information 329 are stored. here,
Assume that the information of each of the two image frames 1 and 2 is stored as an example. In the present embodiment, the information indicated by “328” is “file name information”. However, the present invention is not limited to this, and may be any information indicating an image referred to by the template. For example, U
RL information or the like may be used.

The position information 324 of the image frame is information representing the coordinate position of the lower left corner of the image frame in coordinates with the origin at the lower left corner of the page. The image frame hierarchy information 325 is information represented by numerical information based on the frame present at the back of the page, and indicates that the larger the numerical value is, the more the image frame is output to the front. . The image frame size information 326 is information indicating the rectangular size of the image frame.

The attribute information 327 of the image frame is stored in the scanner 11
3 (information input device) is information indicating permission / non-permission for inserting the input image information input by the image input device. For example, if the image of “flower.BMP” indicated by the file name information 328 as shown in FIG. 2 is always registered as a material image used by the template and is not replaced with another image, the image frame Attribute information 327 is "not allowed"
And conversely, the image may be replaced with another image ("Hana.BM
In the case where an input image or the like may be used as a template instead of “P”), the attribute information 327 of the image frame is set to “permitted”.

The file name information 328 of the image information is information for indicating the reference relationship between the template information and the image information, and is stored in the HDD 1 where the image information to be inserted into the image frame exists.
03 (main storage device) or information indicating a file name for identifying a file on the FDD 102 (external storage device). As described above, URL information and the like can be used as the file name information 328. For example, when URL information is used, a file on a network can be referred to. If no image information is inserted into the image frame, the file name information 3 of the image information
28 is not set.

The new image frame number information 329 is used when the image information of the relevant image frame has already been synthesized with the image information of another image frame and the synthesized image information has been generated as new image information. The image frame number of the image information is set, and is used as image information synthesis information. For example, as shown in FIG. 2 above, when both the attribute information 327 of the image frame 1 and the image frame 2 are “non-permitted”, the image indicated by the file name information 328 of the image frame 1 and the image frame 2 (hereinafter, referred to) , "Image 1",
Since "image 2" is not edited together (because it is not replaced with another image), image 1 and image 2 may be combined into one image. Therefore, image 1 and image 2
Are combined and stored. Accordingly, when there is an overlapping area between the image 1 and the image 2, the amount of data to be stored can be reduced by the amount of data in the image area below the overlapping portion as compared with a case where the data is stored without being combined. it can. In order to carry out this operation, the image 1 and the image 2 are combined and regarded as the image 1 of the image frame 1. Set the information indicating that it was put together.

The new image frame number information 329 is not set if the image information of the image frame is not already combined with the image information of another image frame. Therefore, when the image frame number is set in the new image frame number information 329,
The image information of the image frame of the image frame number (image information before combining) is not used in the normal image frame display. When no image information is inserted into the image frame, the file name information 328 of the image information is not set.

FIG. 3 shows the result (output image) of processing the input image information based on the template information 300 shown in FIG. In the figure,
“410” indicates the image frame 1 of the template information 300, and “420” indicates the other image frame 2.
The images inserted into those image frames indicate image information input from the scanner 113 or the like.

FIG. 4 shows the principle of operation of digital watermarking. The image processing device has a digital watermark processing function. As used herein, the “digital watermark” refers to a process in which predetermined image information 440 (hereinafter, referred to as “watermark”) is added to the original image information 430 as shown in FIG. For example, image information 450 (hereinafter also referred to as “watermarked image information”) formed by mixing information indicating the attribution of the original image information is stored in a storage device. For example, means for preventing, and preferably making it impossible to effectively divert the image information by making it apparent that the image information has been diverted. Also,
The above-mentioned means in the present embodiment includes the watermarked image information 450 and the image information 4 mixed by a predetermined method.
It also includes means for removing the image information 40 and restoring the original image information 430.

Various methods are known for embedding a digital watermark. For example, a method of embedding visible image information as digital watermark information in a target image, or a method of orthogonally transforming digital watermark information is used. Embedded in the target image, or a method of embedding digital watermark information at the edge of the target image. In the present embodiment,
Either method is applicable.

The image processing apparatus 100 embeds watermark image information stored in the HDD 103 (main storage device) in advance in the original image information by performing an exclusive OR operation, thereby generating watermarked image information. . Further, the watermark image information is restored to the original image information by performing an exclusive OR operation on the watermark image information again from the watermarked image information.

The method of realizing the above-mentioned digital watermark is a method of synthesizing and mixing the watermark image information with the original image information by exclusive OR, but is not limited to this. Other image processing means may be used.

Hereinafter, the operation of the template information setting and saving processing and the printing processing executed by the image processing apparatus 100 configured as described above will be described with reference to FIGS.

First, steps S501 to S501 described below will be described.
The processing of 506 is performed by using the template information 3 shown in FIG.
00 is set (for example, a process of combining the template information and the input image information is set), and the process is executed for each page. In addition, when the number of input images does not fit in the template for one page and the next page is to be added, the processing of steps S501 to S506 is repeatedly executed.

Step S501: The image information obtained by the scanner 113 (image input device) is transmitted to the scanner I / F1.
12 is input. This input image information is
File name (for example, "flower.BMP" or "mountain.BMP"
) Are temporarily stored in the HDD 103. still,
Image information input via a network or FDD1
02 may be used as the input image information.

Step S502: In accordance with a user operation on the keyboard 106, corresponding template information (template information desired by the user) is stored in the HD.
Selection is made from template information stored in advance in D103.

Step S503: The image frame for which insertion of the input image information is permitted based on the attribute information of the image frame information of each page information included in the template information selected in step S502 (see FIG. 2). (Editable image frame)
Search for.

Step S504: Based on the result of the search in step S503, it is determined whether or not there is an image frame permitted to insert the input image information.

Step S505: As a result of the determination in step S504, if there is an image frame for which insertion of the input image information is permitted, the information of the image frame (specifically, FIG.
In order to insert the input image information stored in the HDD 103 in step S501, the file name of the input image information is set to the image file name information 328) shown in FIG. As a result, for example, as shown in FIG.
Image file name information 3 of image frame 1 of page information 320b
28, the file name of the input image information “flower.BM”
P "is stored.

Step S506: It is determined whether or not there is unprocessed input image information. If it is determined that the input image information is present, the process returns to step S503 to execute the processing of steps S503 to S505 for the next input image information. On the other hand, when the input image information does not exist, that is, for all input image information, steps S503 to S5
When the setting of the template information (setting of the file name of the input image to be inserted into each image frame of the template selected by the user) by step 05 is completed, the next step S507
Proceed to processing from.

Next, step S507 described below.
Are processing for saving template information and printing.

Step S507: When the user instructs to save the template information by operating the keyboard 106, the operation panel is displayed on the CRT 108,
The user is requested to select a storage method for the template information.

Step S508: When the user instructs the saving method of the template information in step S507, whether or not the instruction is an instruction for saving the template information in a saving method that allows all re-editing operations. Is determined. Above “Save method that allows all re-editing operations”
Is attribute information 327 of all image frames (see FIG. 2 above).
Is set to "permitted (editable)", and there is no setting for the new image frame number information 329, and any editing or designation of an image to be inserted or the like is performed for all image frames. Means a preservation method that can be performed. As a result of the determination in this step, if the instruction is to save template information in a storage method that allows all re-editing operations, the process proceeds to step S512 (FIG. 6).

Step S509: If the result of determination in step S508 is that there is no instruction to save template information in a saving method that allows all reediting operations, only reinsertion of input image information inserted in the image frame is performed. It is determined whether or not the instruction is to store template information in a storage method that allows an editing operation. The “storage method” refers to a state in which image information (material image or the like) is registered as described above,
This means a storage method in which an image can be inserted only into an image frame for which the attribute information 327 (see FIG. 2) of the image frame is set to “permitted (editable)”. If the result of the determination in this step is that the instruction is to store template information in a storage method that allows only reinsertion, step S518 (FIG. 6)
Proceed to processing from.

Step S510: If the result of determination in step S509 is that there is no instruction to save template information in a storage method that allows only reinsertion, an instruction is to save template information in a storage method that allows only reprinting. It is determined whether or not. The above "storage method that can only be reprinted"
This means a storage method in which an input image is stored in a state where it is inserted into an image frame of a template, and another image cannot be reinserted into the image frame. If the result of the determination in this step is that the instruction is to store template information in a storage method that allows only reprinting, the process proceeds to step S525 (FIG. 7).

Step S511: If the result of determination in step S510 is that the instruction is not an instruction to save template information in a storage method that allows only reprinting, it is determined whether the instruction is an instruction to print out the template information. If the result of this determination is that it is an instruction to print out template information, the flow proceeds to processing from step S534 (FIG. 7). still,
If the result of determination in this step is not an instruction to print out template information, that is, if none of the instructions in steps S508 to S511,
This processing ends.

Step S512: The instruction from the user is
If the instruction is to save template information in a saving method that allows all re-editing operations, the process proceeds to steps S512 to S512.
The processing in step S517 is executed. That is, first,
All image frame information is searched from each page information of the template information. Then, the following processes of steps S513 to S515 are sequentially performed on the image frame information.

Step S513: The file name information in the target image frame information is obtained, and the image information having the file name is obtained from the HDD 103.

Step S514: Convert watermark image information to HD
D103 (main storage device). The method of embedding the watermark image information may be a method of embedding the watermark image information in a target image so as to be inconspicuous to human eyes, or a method of embedding the watermark image information (visible Various methods can be applied, such as a method in which the digital watermark information is embedded in the target image. As an example, in the present embodiment, for example, a method is employed in which the watermark image information is embedded in the redundant portion by using orthogonal transformation of an image. According to this method, the watermark image information is embedded in the target image so as to be inconspicuous for human eyes.

Step S515: The input image information obtained in step S513 and the watermark image information obtained in step S514 (for example, the visible digital watermark information as described above) are synthesized by performing an exclusive OR operation. Generate watermarked image information. Then, the watermarked image information is stored in the FDD 102 (external storage device).

Step S516: It is determined whether or not the generation of the watermarked image information and the process of storing it in the FDD 102 have been completed for all the image frame information of the template information. If the result of this determination is that the processing has not been completed yet, the flow returns to step S513, and the processing returns to step S513 for the next image frame information
The processing from 513 to step S515 is executed.

Step S517: As a result of the determination in step S516, when the above-described processing for all the image frame information is completed, the template information after the processing is performed is
In addition to the template information before the processing or the input image described above, the image data is stored in the FDD 102 (external storage device).
After that, the process ends. Next, when the template information is taken into the image processing apparatus 100, another new image can be inserted into each image frame of the template information stored in this step.

Step S518: The instruction from the user is
If the instruction is to store template information in a storage method that allows an editing operation only for re-insertion of the input image information inserted in the image frame, steps S518 to S52
Following the execution of the processing of step S512, the above-described steps S512 to S512
The processing in step S517 is executed. That is, first,
The hierarchical information of all the image frame information is acquired from each page information of the template information.

Step S519: Attribute information of two consecutive image frame information is obtained in ascending order of the value of the hierarchical information obtained in step S518, and they are compared.

Step S520: Based on the result of the comparison in step S519, it is determined whether or not the two pieces of attribute information both prohibit the insertion of the input image information. If the result of this determination is that the insertion of the input image information has not been prohibited, the flow proceeds to step S524 described below.

Step S521: As a result of the discrimination in step S520, if both of the two pieces of attribute information do not permit the insertion of the input image information, the two image frames corresponding to them are combined and Create two image frames. That is, file name information of both image frames is acquired, and input image information having those file names is acquired from the HDD 103. Then, the input image information is combined to generate combined image information (rendering process), and the combined image information is stored in the HDD 103 (external storage device) as an image file.

Step S522: Further, the position information and the size information of the two image frames are obtained, and a minimum image frame including the two image frames is newly created.

Step S523: And step S5
In step S52, the file name of the composite image information in
The template information is set as the file name information of the image frame newly created in step 2. As described above, when both the attribute information 327 of the two image frames are “non-permitted”, the image information of the two image frames is combined into one, and set as new file name information. If there is an overlapping area in the image information of the frame, it is not necessary to save the data of the overlapping part extra, and thus the amount of data to be stored can be reduced. In addition, by combining a plurality of images, a process of inputting a plurality of images according to the template information can be performed at high speed.

Step S524: It is determined whether or not the processing of steps S519 to S523 has been completed for all the image frames. If the result of this determination is that the above processing has not been completed for all image frames, the process returns to step S519, and the process returns to step S51 for the next image frame.
Steps 9 to S523 are executed. On the other hand, if the processing has been completed, the process proceeds to step S512, and the subsequent processing steps are executed. Step S5
The processing from step 12 is the same as in the case where the saving of the template information is instructed by the saving method that allows all the re-editing operations, so that the detailed description is omitted.

Step S525: The instruction from the user is
If the instruction is to save the template information and the input image information in a storage method that can only be reprinted, the processing of steps S525 to S533 is executed for each page information of the template information, and Then, the processing of steps S512 to S517 described above is executed.
That is, first, the hierarchical information of each image frame of the page information is obtained, and the input image information corresponding thereto is stored in the HDD.
103. Incidentally, in step S533,
The processing of steps S512 to S517 described above may be executed.

Step S526: It is determined for each image frame whether or not the input image information has been acquired in the process of step S525, that is, whether or not the input image information corresponding to the image frame exists in the HDD 103. When the input image information is stored in the FDD 102, the FD
It is determined whether or not the corresponding input image information exists in D102. As a result of this determination, if input image information corresponding to the image frame to be determined exists in the HDD 103,
The process proceeds to step S529 described below.

Step S527: If the input image information does not exist in the HDD 103 as a result of the determination in step S526, the target image information is transmitted to the other image processing apparatus 200 via the network I / F 114. Is transmitted (image file name information of the image frame in step S525), and communication for requesting input image information is performed.

Step S528: It is determined whether or not the input image information has been obtained as a result of the communication in step S527. If the result of this determination is that it could not be obtained, the flow proceeds to step S530 described below.

Step S529: If the input image information can be obtained through communication as a result of the determination in step S528,
Alternatively, the input image information is H as a result of the determination in step S526.
If it exists in the DD 103, according to the contents of the layer information of the page information of the template information, the input image information is synthesized in ascending order of the value to generate output image information.

Step S530: It is determined whether or not the image synthesizing process in steps S526 to S529 has been completed for all the image frames. Step S5
If the result of determination in 28 is that input image information has not been sent from the other image processing apparatus 200, step S529
The determination processing in this step is executed as it is without performing the image synthesis processing in step (1). If the result of this determination is that image synthesis processing has not been completed for all image frames, step S
Returning to step S526, the process returns to step S526 for the next image frame.
Step S529 is executed.

Step S531: If the result of determination in step S530 is that image combining processing has been completed for all image frames, the output image file name generated in step S529 is added to the output image file name information of the target page information. The file name of the information is set, and it is stored in the HDD 103. At the same time, steps S514 and S5 described above are performed.
In a manner similar to the processing in step 15, the digital watermark information is synthesized.

Step S532: It is determined whether or not the saving of the output image information in steps S525 to S531 has been completed for all the page information. If the result of this determination is that the processing has not been completed, the flow returns to step S525, and the processing of steps S525 to S531 is executed for the next page information.

Step S533: As a result of the determination in step S532, when the storage of the output image information for all the page information is completed, the template information is also stored in the HDD 103 in the same manner as the processing in step S517 described above. I do. After that, the process ends.

Steps S534 to S540: If the instruction from the user is an instruction to print out the template information, steps S534 to S540 similar to steps S525 to S531 described above.
Following the execution of the processing of step S541, the processing of step S541 and step S542 is executed. That is, hierarchical information and input image information of each image frame are obtained based on each page information of the template information (step S534). If the input image information does not exist in the HDD 103 or the FDD 102 (step S535), the file name information of the input image information is sent to another image processing apparatus 200 via the network I / F 114, and the input image information is transmitted. The requested communication is performed (step S536). Network I / F11
If the input image information has been sent from another image processing apparatus 200 via Step 4 (Step S537), the output image information is generated by combining the input image information in ascending order of the contents of the hierarchical information described above (Step S537). S538). When the input image information is not sent from another image processing apparatus 200, the image information is not combined with the image frame. After the image synthesizing process is completed for all the image frames (step S539), the file name of the generated output image information is set as the output image file name of the page information (step S540).

Step S541: The output image information generated in step S538 is printed out from the printer 110 via the printer I / F 109.

Step S542: It is determined whether or not the print output of the output image information in steps S534 to S541 has been completed for all the page information. If the result of this determination is not complete, step S53
4 and return to steps S534 and S53 for the next page information.
The processing of step S541 is executed. On the other hand, when the print output of the output image information for all the page information ends, the process ends.

As described above, according to the present embodiment, when template information is stored in an external storage device or the like, information indicating a reference relationship with the image information used therein is added together with the template information. It becomes possible to save. Further, if the image information to be stored is stored in an external storage device or the like as information obtained by combining a plurality of pieces of image information among the stored image information into one image, the template information is stored in the external storage device or the like. In this case, the required storage capacity can be reduced. In addition, since the information indicating the reference relationship with the image information is linked to the template information in the image information after the collection, the template information can be easily used by using the template information as it is. Can perform editing work. Further, if the digital watermark image information is combined (added) with the stored image information and stored in an external storage device or the like, the image information is prevented from being diverted to other uses. can do. Further, when the stored template information is re-edited, it is possible to obtain necessary image information from another device through a network and generate output image information. As a result, it is possible to reliably prevent a situation in which editing work cannot be performed because image information is not stored in the storage device or the like.

(Second Embodiment) For example, when combining images to which digital watermark information has been added, or combining an image to which digital watermark information has been added and another image, and When digital watermark information is further added, there is a high possibility that the digital watermark information overlaps and cannot be recognized. This is particularly inconvenient when images input via a network are often added with digital watermark information in various forms, and such images are to be subjected to a synthesis process. . In view of the above, an object of the present embodiment is to prevent the digital watermark information from being superimposed due to the combination of the images, so that the digital watermark information cannot be recognized. By realizing this, the function of the image processing apparatus 100 according to the above-described first embodiment is further enhanced.
00 can be provided.

First, FIGS. 8A and 8B show the operation principle of digital watermarking and one of the features of the present embodiment.
FIG. 8 is a diagram for explaining a process of combining image information into which electronic watermarks are mixed;

Here, in the image processing apparatus 100, C
The PU 101 has an image processing function, a function of inserting a digital watermark, a function of deleting a digital watermark, a rendering control function, a function of synthesizing two digital watermarks, a function of obtaining a circumscribed rectangle of the digital watermark, and a plurality of functions. Has the function of determining the overlap of the circumscribed rectangles. Also, HD
D103 stores, in addition to information such as image information and template information, digital watermark information and information such as a position of the digital watermark and a combining method when two digital watermarks are combined.

The “digital watermark” is, for example, as shown in FIG. 8 (a), in order to prevent image information from being diverted to other uses. Image information 438a (hereinafter, also referred to as “watermarked image information”) formed by mixing image information 437a (hereinafter, also referred to as “watermark image information”) in the storage device Means means for visually disabling the image information or for clearly indicating the source of the image information. This means also includes means for removing the watermark image information 437a from the watermarked image information 438a in which the watermark image information 437a is mixed by a predetermined method, and restoring the original image information 436a.

The watermark information in the present embodiment is
It is assumed that luminance information to be changed for a region having a predetermined shape is included.

In the image processing apparatus 100, the CPU 103 preliminarily controls the HDD 103 for the original image information.
The watermark image information stored in (main storage device) is embedded by performing an exclusive OR operation to generate watermarked image information. Further, the watermark image information is restored to the original image information by performing an exclusive OR operation on the watermark image information again from the watermarked image information.

The method of realizing the above-mentioned digital watermark is a method of synthesizing and mixing the watermark image information with the original image information by exclusive OR, but is not limited to this. Image processing means may be used. However, if the watermarked image information is combined with each other by exclusive OR, the watermark image information cannot be recognized when the watermark image information of each image information overlaps. Thus, in the present embodiment, the above problem is solved by shifting the watermark image information and synthesizing the image information.

That is, as shown in FIG.
Conventionally, when two pieces of watermarked image information, that is, watermarked image information 438a in which watermark image information 437a is mixed and watermarked image information 438b in which watermark image information 437b is mixed, are combined, the resultant combination is obtained. In the image information 439, the watermark image information 437a and the watermark image information 437b overlap each other. Therefore, the watermark image information 437a and the watermark image information 437b could not be identified.

Therefore, as shown in FIG. 8 (b), there are two watermarked image information, that is, watermarked image information 438a mixed with watermark image information 437a and watermarked image information 438b mixed with watermark image information 437b. When synthesizing image information, first, watermarked image information 438a
Is separated into original image information 436a and watermark image information 437a, and the watermarked image information 438b is similarly separated into original image information 436b and watermark image information 437b.

Next, the original image information 436a and the original image information 436b are synthesized with each other to obtain synthesized image information 440. In addition, the watermark image information 437a and the watermark image information 437b are combined with each other to obtain the combined watermark image information 441. At this time, for example, the watermark image information 437a
By detecting each circumscribed rectangle of the watermark image information 437b and the watermark image information 437b, the watermark image information 437a and the watermark image information 437b are detected.
b should not overlap each other.

Then, the combined image information 440 and the combined watermark image information 441 are combined to obtain the combined image information 442.

By the image synthesizing process in the present embodiment as described above, the watermarked image information 437a mixed with the watermarked image information 438a and the watermarked image information 43
The watermarked image information 438a and the watermarked image information 438b can be combined with each other while the watermark image information 437b mixed in the image information 8b is held in an identifiable state.

Hereinafter, the operations of the template information storing process and the printing process executed by the image processing apparatus 100 configured as described above will be described with reference to FIGS. still,
Each of the step processes in the flowcharts shown in FIGS. 9 to 13 has portions common to the respective step processes in the flowcharts shown in FIGS. 5 to 7, and thus detailed description thereof will be omitted. In addition, as each step processing of the flowcharts shown in FIGS.
Each step process of the flowchart shown in FIG. 7 may be used.

First, steps S901 to S901 described below are performed.
The processing of step 906 is performed in steps S901 to S901 shown in FIG.
Similar to the process of 906, this is a process for setting the template information 300 shown in FIG.

Step S901: The image information obtained by the scanner 113 (image input device) is transmitted to the scanner I / F1.
12 is input. This input image information is
File name (for example, "flower.BMP" or "mountain.BMP"
) Are temporarily stored in the HDD 103. still,
Image information input via a network or FDD1
02 may be used as the input image information.

Step S902: In accordance with a user operation on the keyboard 106, corresponding template information (template information desired by the user) is stored in the HD.
Selection is made from template information stored in advance in D103.

Step S903: The image frame for which insertion of the input image information is permitted is performed according to the attribute information of the image frame information of each page information included in the template information selected in step S902 (see FIG. 2). (Editable image frame)
Search for.

Step S904: Based on the result of the search in step S903, it is determined whether or not there is an image frame permitted to insert the input image information.

Step S905: If the result of determination in step S904 is that there is an image frame permitting insertion of input image information, step S9 is performed on the information of the image frame.
At 01, a file name of the input image information is set in order to insert the input image information stored in the HDD 103. As a result, for example, as shown in FIG. 2, the file name “flower.BMP” of the input image information is stored for the image file name information 328 of the image frame 1 of the page information 320b.

Step S906: It is determined whether or not there is unprocessed input image information. If it is determined that the input image information is present, the process returns to step S903 to execute the processing of steps S903 to S905 for the next input image information. On the other hand, when the input image information does not exist, that is, for all input image information, steps S903 to S9 are performed.
When the setting of the template information in step 05 is completed, the process proceeds to the next step S907.

Next, step S907 described below.
Are processing for saving template information and printing.

Step S907: When the user instructs to save the template information by operating the keyboard 106, the operation panel is displayed on the CRT 108,
The user is requested to select a storage method for the template information.

Step S908: When the user instructs the saving method of the template information in step S907, whether or not the instruction is an instruction for saving the template information in a saving method that allows all re-editing operations. Is determined. If the result of this determination is that there is an instruction to save template information in a save method that allows all re-editing operations, the process proceeds to step S912 (FIG. 10).

Step S909: If the result of determination in step S908 is that there is no instruction to save template information in a saving method that allows all reediting operations, only reinsertion of input image information inserted in the image frame is performed. It is determined whether or not the instruction is to store template information in a storage method that allows an editing operation. If the result of this determination is that the instruction to save the template information in a save method that allows only re-insertion,
It proceeds to the processing from step S918 (FIG. 10).

Step S910: If the result of determination in step S909 is that there is no instruction to save template information in a storage method that allows only reinsertion, an instruction is to save template information in a storage method that allows only reprinting. It is determined whether or not. If the result of this determination is that the instruction is to store template information in a storage method that allows only reprinting, the process proceeds to step S925 (FIG. 11).

Step S911: If the result of determination in step S910 is that the instruction is not an instruction to save template information in a storage method that allows only reprinting, it is determined whether the instruction is an instruction to print out the template information. If the result of this determination is that it is an instruction to print out template information, the flow proceeds to processing from step S934 (FIG. 12).
If the result of determination in this step is that the instruction is not an instruction to print out template information, that is, step S908
If this is not an instruction in any of steps S911, the present process ends.

Steps S 912 to S 917: (see FIG. 10) As a result of the determination in step S 908 (see FIG. 9 above), the user's instruction indicates that the template information is stored in a storage method that allows all re-editing operations. If it was an instruction,
The following steps S912 to S917 are executed.

Step S912: First, all the image frame information in which nothing is set for the new image frame number 329 (see FIG. 2) of each page information of the template information is searched. Then, the following processing of steps S913 to S915 is performed on the image frame information.

Step S913: New image frame number information 32
9, file name information in the target image frame information for which nothing is set, and image information having the file name are obtained from the HDD 103.

Step S914: The watermark image information to which the luminance information is given is obtained from the HDD 103 (main storage device).

Step S915: The input image information acquired in step S913 and the watermark image information acquired in step S914 are combined by performing an exclusive OR operation to generate watermarked image information. Then, the watermarked image information is stored in the FDD 102 (external storage device).

Step S916: For all the image frame information obtained in step S912 (image frame information with the new image frame number 329 being “none”), the generation of watermarked image information and the process of storing it in the FDD 102 are performed. It is determined whether or not the process has been completed. If the result of this determination is that the processing has not been completed yet, the flow returns to step S912, and the processing of steps S912 to S915 is executed for the next image frame information.

Step S917: As a result of the determination in step S916, when the above-described processing for all the image frame information obtained in step S912 is completed, the template information is stored in the FDD 102 (external storage device). After that, the process ends.

Steps S918 to S924: (see FIG. 10) As a result of the determination in step S909 (see FIG. 5), an instruction from the user can perform an editing operation by only re-inserting the input image information inserted in the image frame. If it is an instruction to save the template information in an appropriate saving method, following execution of the processing of steps S918 to S924 as follows,
The processing of steps S912 to S917 described above is performed.

Step S918: First, the hierarchical information of all the image frame information in which nothing is set for the new image frame number 329 (see FIG. 2) of each page information of the template information is obtained.

Step S919: The attribute information of two consecutive image frame information is obtained in ascending order of the value of the hierarchical information obtained in step S918, and they are compared.

Step S920: Based on the result of the comparison in step S919, it is determined whether or not the two pieces of attribute information both prohibit the insertion of the input image information. If the result of this determination is that the insertion of the input image information has not been prohibited, the flow proceeds to step S924 described below.

Step S921: If the result of determination in step S920 is that both of the two pieces of attribute information prohibit the insertion of input image information, the two image frames corresponding to the two pieces of information are combined and Create two image frames. That is, file name information of both image frames is acquired, and input image information having those file names is acquired from the HDD 103. Then, the input image information is combined to generate combined image information (rendering process), and the combined image information is stored in the HDD 103 (external storage device) as an image file.

Step S922: Further, position information and size information of the two image frames are obtained, and a minimum image frame including the two image frames is newly created.

Step S923: and step S9
In step S92, the file name of the composite image information in
The template information is set as the file name information of the image frame newly created in step 2.

Step S924: Steps S919 to S9 are performed on all the image frame information to be processed (image frame information for which the new image frame number 329 is "none").
It is determined whether or not the process of 23 is completed. If the result of this determination is that the above processing has not been completed for all image frames, the process returns to step S919, and the processing of steps S919 to S923 is performed for the next image frame. On the other hand, if the processing has been completed, the process proceeds to step S912, and the subsequent processing steps are executed.
Note that the processing from step S912 is the same as in the case where saving of template information is instructed by a saving method that allows all re-editing operations, and thus detailed description thereof will be omitted.

Steps S925 to S933, S630 to S630
S634: (see FIG. 11) If the result of determination in step S910 (see FIG. 9 above) indicates that the user's instruction is to save template information in a saving method that allows only reprinting, the template The following step S9 is performed for each page information.
Steps S25 to S930 and steps S630 to S634 are performed, and after that, the same processing (step S933) as step S917 described above is performed.

Step S925: First, the hierarchical information of each image frame of the page information is obtained, and the corresponding input image information is obtained from the HDD 103.

Step S926: It is determined for each image frame whether or not the input image information has been acquired in the process of step S925, that is, whether or not the input image information corresponding to the image frame exists in the HDD 103. In addition, DD10
Also, it is determined whether or not the corresponding input image information exists in 2. As a result of this determination, if the input image information corresponding to the image frame to be determined exists in the HDD 103 or the FDD 102, the process proceeds to step S929 described later.

Step S927: As a result of the determination in step S926, the input image information is stored in the HDD 103 or the FDD 102.
If it does not exist, the information of the file name of the target image information is sent to the other image processing apparatus 200 via the network I / F 114 (image file name information of the image frame in step S925). Is transmitted, and communication for requesting input image information is performed.

Step S928: As a result of the communication in step S927, it is determined whether or not the input image information has been obtained from another image processing apparatus 200. If the result of this determination is that it cannot be obtained, the process proceeds to step S630, which will be described later, to obtain a substitute image to be inserted into the image frame.

Step S929: If the result of determination in step S928 is that input image information can be obtained through communication,
Alternatively, if the input image information exists in the HDD 103 as a result of the determination in step S926, or if the image frame information does not exist as a result of the determination in step S631 described below,
According to the contents of the hierarchical information of the page information of the template information, the input image information is synthesized in ascending order of the value to generate output image information.

Step S930: It is determined whether or not the image synthesis processing in steps S926 to S929 has been completed for all the image frames. Step S9
If the result of determination in 28 is that input image information has not been sent from another image processing apparatus 200, step S929.
, The determination processing of this step is executed as it is. If the result of this determination is that image synthesis processing has not been completed for all image frames, step S
Returning to step S926, steps S926 to S926 for the next image frame are performed.
Step S929 is executed.

Step S931: If the result of determination in step S930 is that image combining processing has been completed for all image frames, the output image file name generated in step S929 is compared with the output image file name information of the target page information. The file name of the information is set, and it is stored in the HDD 103. At the same time, steps S514 and S5 described above are performed.
In a manner similar to the processing in step 15, the digital watermark information is synthesized.

Step S932: It is determined whether or not the saving of the output image information in steps S925 to S931 has been completed for all the page information. As a result of the determination, if the processing has not been completed, the process returns to step S925, and the processing of steps S925 to S931 is performed on the next page information.

Step S933: If it is determined in step S932 that the saving of the output image information for all the page information is completed, the template information is also stored in the HDD 10.
Save to 3. After that, the process ends.

Step S630: As a result of the determination in step S928, if the input image information cannot be obtained by communication via the network, a substitute image frame for the image frame to be processed is obtained. As the substitute image here, for example, an image registered in advance to prevent a situation where no image fits in the image frame may be used, but in the present embodiment, step S919 is used. ~ S9
If it is not possible to acquire the combined image at 23, the original image before the combination is captured and the captured image is used as a substitute image. This can be performed because the original image before composition can be recognized by referring to the image frame number set for the new image frame number information 329 shown in FIG. Therefore, first, from each page information of the template information, the image frame information in which the image frame number of the image frame to be processed is set is searched.

Step S631: As a result of the search in step S630, it is determined whether or not there is image information in which the image frame number of the image frame to be processed is set. If it is determined that the image information does not exist, the process proceeds to step S930, and the subsequent processes are executed.

Step S632: If the image information is found as a result of the search in step S630, the network I / F 114 is used to take in the image information as substitute image information for the image information that could not be obtained in step S926 described above. From another image processing apparatus 200 via
Obtain the image information.

Step S634: As a result of the communication in step S632, if the substitute image information can be obtained, the processing in steps S653 to S662 (FIG. 13) described later in detail describes the order of the hierarchical information of the substitute image in ascending order. The image information is combined to generate alternative output image information. afterwards,
The process proceeds to step S929, and the subsequent processes are executed.

Steps S934-S942, S644-
S648: (see FIG. 12) If the result of determination in step S911 (see FIG. 9 above) indicates that the user's instruction is to print template information, the above-described steps S925 to S931, S630 are performed. Step S93 similar to S634
Following execution of the processing of Steps 4 to S940 and S644 to S648, Steps S941 and S942
Execute the processing of

Steps S934 to S940: First, as described above, hierarchical information and input image information of each image frame are obtained based on each edge information of the template information (step S934). If the input image information is HDD 103 or FD
If it does not exist in D102 (step S935),
Another image processing apparatus 2 via the network I / F 114
00, the file name information of the input image information is sent, and communication for requesting the input image information is performed (step S9).
36).

If the input image information is sent from another image processing apparatus 200 via the network I / F 114 (step S937), the input image information is synthesized in ascending order of the above-mentioned hierarchical information, and the output image is synthesized. Information is generated (step S938), and the process proceeds to step S939.

If the input image information is not sent from another image processing apparatus 200, the new image frame number information 329 is converted from each page information of the template information to obtain an alternative image frame for the image frame to be processed. Image frame information in which the image frame number of the target image frame is set (image frame information of the substitute image frame) is searched (step S644). As a result of this search, when the image frame information of the alternative image frame does not exist (step S645), the process proceeds to step S939 described later.

If image frame information of the substitute image frame exists (step S645), the file name information of the image information of the substitute image frame is sent to another image processing apparatus 200 via the network I / F 114, and Communication for requesting the image information is performed (step S646). As a result of this communication, if the image information of the substitute image frame has not been transmitted (step S647), step S939 described later.
Proceed to.

When the alternative image information is received from another image processing apparatus 200 via the network I / F 114, the alternative image information is generated by synthesizing the image information in ascending order of the hierarchical information value of the alternative image (see FIG. 9). Step S64
8). Thereafter, the process proceeds to step S938 described above, and the subsequent processes are executed.

Then, it is determined whether or not the image synthesizing process has been completed for all the image frames (step S939). When the process has been completed, the generated image is generated under the output image file name of the page information. The file name of the output image information is set (step S940).

Step S941: The output image information generated in step S938 is printed out from the printer 110 via the printer I / F 109.

Step S942: It is determined whether or not the printing of the output image information in steps S934 to S941 has been completed for all the page information. If the result of this determination is not complete, step S93
4 and return to steps S934 and S93 for the next page information.
Steps S941 and S644 to S648 are executed. On the other hand, when the print output of the output image information for all the page information ends, the process ends.

Steps S653 to S662: (see FIG. 13) In the processing of steps S653 to S662 shown in FIG. 13, images are synthesized by step S634 shown in FIG. 11 and step S648 shown in FIG. At that time,
In particular, a combining process for combining a watermarked image.

Step S653: First, when image synthesis processing is started with two pieces of image information as arguments, the given image information (hereinafter, referred to as “image information A” and “image information B”) is obtained. On the other hand, it is determined whether or not watermark image information (hereinafter, referred to as “watermark image information a” and “watermark image information b”) is mixed.

Step S654: If the result of determination in step S653 is that watermark image information has not been incorporated into each of image information A and image information B, image information A
And the image information B, and the synthesized image information is used as an output image result. After that, the process ends.

Step S655: On the other hand, step S65
If the watermark image information a and the watermark image information b are mixed in the image information A and the image information B respectively as a result of the determination of 3, the watermark image information a is first separated from the image information A, The original image information of the information A (hereinafter, referred to as “image information A ′”) and the watermark image information a are obtained, the watermark image information b is separated from the image information B, and the original image information of the image information B is obtained. (Hereinafter referred to as “image information B ′”) and watermark image information b.

Step S656: Next, the image information A 'and the image information B' are synthesized to obtain synthesized image information of the original image information.

Step S657: Next, a circumscribed rectangle of the watermark image information a (hereinafter, referred to as “circumscribed rectangle a ′”) is obtained, and a watermark image information b is also acquired by the circumscribed rectangle (hereinafter, “circumscribed rectangle b”). '").

Step S658: Next, it is determined whether or not there is an overlap when the circumscribed rectangle a 'and the circumscribed rectangle b' overlap each other.

Step S659: It is determined whether or not there is an overlap between the watermark image information a and the watermark image information b by the determination in step S658. As a result of this determination,
If there is no overlap between the watermark image information a and the watermark image information b, the process proceeds to step S661 described below.
Proceed to.

Step S660: If it is determined in step S659 that there is an overlap between the watermark image information a and the watermark image information b, the watermark image information is set so that the circumscribed rectangles a ′ and b ′ do not overlap each other. The position (the position of the watermark image information in the entire image) or the size of the watermark image information a and the watermark image information b is changed, and then the process proceeds to the next step S661. The process of combining the watermark image information a and the watermark image information b so that the circumscribed rectangle a ′ of the watermark image information a and the circumscribed rectangle b ′ of the watermark image information b do not overlap, for example, Any method such as moving the watermark image information, or moving or deforming the watermark image information based on the distance from the center of gravity of each other and the circumscribed rectangle may be used. Further, a method of changing the color of the overlapping portion of the watermark information may be used. In short, the method is not limited as long as the watermark information can be recognized.

Step S661: The watermark image information a and the watermark image information b are combined with each other to obtain the combined watermark image information.

Step S662: The combined image information obtained in step S656 and the combined watermark image information obtained in step S661 are combined, and the combined result is set as an output image result. After that, the process ends.

As described above, according to the present embodiment, when template information is stored in an external storage device or the like, it is possible to store image information used for the template information together with the template information. . In addition, by combining a plurality of pieces of image information among the above-mentioned stored image information and storing the combined image information as one piece of image information in an external storage device or the like, the storage required when template information is stored in the external storage device or the like. The capacity can be reduced. In particular, since information (image combining information) such as the position of the image information and the combining method is stored when the image information is combined, necessary image information is obtained from another device or the like via a network. Even in the case where the image information cannot be obtained, the necessary image information is restored by obtaining the image information before the synthesis of the required image information (alternative image information of the required image information) based on the image synthesis information, and output. Image information can be generated.

If the digital watermark image information is combined (added) with the stored image information and stored in an external storage device or the like, the image information can be used for other purposes. Can be prevented.

Further, when composing image information in which digital watermark image information is inserted, the image information is composed so that the digital watermark information of the image information is not superimposed and composed. It is possible to prevent the digital watermark image information inserted in the image information from becoming ineffective.

When the stored template information is re-edited, it is possible to obtain necessary image information from another device via a network and generate output image information.

An object of the present invention is to provide a storage medium storing program codes of software for realizing the functions of the host and the terminal of the first and second embodiments.
It is needless to say that the present invention is also achieved by supplying the data to a system or an apparatus, and reading and executing a program code stored in a storage medium by a computer (or CPU or MPU) of the system or the apparatus. In this case, the program code itself read from the storage medium realizes the functions of the above embodiments, and the storage medium storing the program code constitutes the present invention. ROM, floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, C
DR, a magnetic tape, a nonvolatile memory card, or the like can be used. The functions of each of the above-described embodiments are not only realized by executing the program code read by the computer, but also the OS or the like running on the computer is actually executed based on the instruction of the program code. It goes without saying that a case where some or all of the processing is performed and the functions of the above embodiments are realized by the processing is also included. Further, after the program code read from the storage medium is written to a memory provided in an extension function board inserted into the computer or a function extension unit connected to the computer, the function extension is performed based on the instruction of the program code. It goes without saying that the CPU or the like provided in the board or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above embodiments.

[0151]

As described above, according to the present invention, image editing means for editing predetermined template information and input image information, and the template information and the image information in the editing processing by the image editing means. And a reference relation storage unit that stores reference relation information indicating the reference relation of the template, it is possible to prevent the editing work from being disabled due to the absence of an image used for the template. Also, editing work can be easily performed on an image obtained after being synthesized with the template.

Further, image input means for inputting the image information, image information storage means for storing the image information input by the image input means, template information storage means for storing the template information, Image output means for outputting the image information edited by the image editing means, and storage means for storing the image information edited by the image editing means together with the template information used for the image information. In this case, the edited image can be easily reproduced later.

[0153] Further, in the case where a communication means for communicating image information with another device via the network is further provided, the image can be transmitted or obtained via the network. It is possible to provide an apparatus or a system that is optimal for performing the image synthesizing process.

Further, a digital watermark information storing means for storing predetermined digital watermark image information, and a digital watermark information adding means for adding the digital watermark image information to the image information edited by the image editing means. And a digital watermark information removing unit for removing the digital watermark image information from the image information to which the digital watermark image information is added. Can be easily added.

Further, input means for inputting a plurality of pieces of image information with a digital watermark, synthesizing means for synthesizing the plurality of pieces of image information, and input means for synthesizing the plurality of pieces of image information When the electronic watermarks of the plurality of pieces of image information that are input overlap, control means for controlling each of the electronic watermarks so that they can be recognized,
It is possible to prevent the digital watermark information added to the image from becoming unrecognizable by the image combining process.

Further, an image editing means for editing the input image information based on predetermined template information, and reference relation information indicating a reference relation between the template information and the image information in the editing processing by the image editing means. Reference storing means for storing the image information, rendering means for forming at least two pieces of image information edited by the image editing means based on the template information to form one piece of image information, With a configuration including an image combining information storage unit that stores at least one of the position of each piece of image information to be combined and the combining method, even when there is no target image of the editing processing after the editing processing. The editing process can be easily reproduced from the template information of the editing process. Further, when there is an overlapping area in each piece of image information, it is not necessary to save extra data of the overlapping part, so that the amount of data to be stored can be reduced. Furthermore, by combining a plurality of images, a process of inputting a plurality of images according to the template information can be performed at high speed.

Further, according to a configuration in which a processing program for implementing the above-described configuration is stored in a storage medium in a computer-readable manner, the storage medium is supplied to a system or an apparatus, and the computer or the computer of the system or the apparatus is provided. Or, a CPU or MPU) can read and execute the program code stored in the storage medium to provide a system or an apparatus having the above configuration and its effects.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a configuration of an image processing apparatus to which the present invention is applied in first and second embodiments.

FIG. 2 is a diagram for explaining a data structure of template information used in the image processing apparatus.

FIG. 3 is a diagram for explaining a state in which input image data is processed on the basis of the template information and printed out in the image processing apparatus.

FIG. 4 is a diagram for explaining a digital watermark processing function in the image processing apparatus.

FIG. 5 is a flowchart illustrating a template information saving process and a printing process executed by the image processing apparatus according to the first embodiment.

FIG. 6 shows an instruction to save template information in the above-described processing in a saving method that allows all re-editing operations or a saving method in which only an input image information inserted into an image frame can be edited. It is a flowchart for demonstrating the process of the case.

FIG. 7 is a flowchart for explaining a process when an instruction to save a storage method capable of only reprinting or an instruction to print out template information is issued in the above process.

FIG. 8 is a diagram for describing a digital watermark processing function in the image processing device according to the second embodiment.

FIG. 9 is a flowchart for explaining template information saving processing and printing processing executed by the image processing apparatus in the second embodiment.

FIG. 10 shows an instruction to save template information in a storage method in which all re-editing operations can be performed or a storage method in which only input image information inserted in an image frame can be edited in the above-described processing. It is a flowchart for demonstrating the process of the case.

FIG. 11 is a flowchart illustrating a process when an instruction to save a saving method that allows only reprinting is issued in the above process.

FIG. 12 is a flowchart illustrating a process when an instruction to print out template information is issued in the above process.

FIG. 13 is a flowchart illustrating a process of synthesizing image information in the above process.

[Explanation of symbols]

100 image processing apparatus 101 CPU (image processing means, means for inserting a digital watermark, means for deleting a digital watermark, rendering means,
Rendering control means, means for synthesizing two pieces of digital watermark image information, means for obtaining circumscribed rectangle information of digital watermark image information, means for determining overlapping of a plurality of circumscribed rectangle information) 102 FDD (external storage means) 103 HDD ( A template information storage unit, an image information storage unit, a digital watermark information storage unit, a reference relationship storage unit, and an image synthesis information storage unit that stores a position of the information when two pieces of digital watermark image information are synthesized, a synthesis method, and the like. RAM 105 ROM 106 Keyboard 107 VRAM 108 CRT 109 Printer I / F 110 Printer (image output means) 111 Bus 112 Scanner I / F 113 Scanner (image input means) 114 Network interface (communication means) 200 Other image processing apparatus

Claims (23)

[Claims] 1. An image editing means for editing predetermined template information and input image information, and reference relation information indicating a reference relation between the template information and the image information in an editing process by the image editing means. An image processing apparatus, comprising: a reference relationship storage unit for storing a reference relationship. 2. An image input unit for inputting the image information, an image information storage unit for storing the image information input by the image input unit, a template information storage unit for storing the template information, Image output means for outputting the image information edited by the image editing means; and storage means for storing the image information edited by the image editing means together with template information used for the image information. The image processing apparatus according to claim 1. 3. The image processing apparatus according to claim 1, further comprising a rendering unit configured to combine at least two pieces of image information edited by the image editing unit based on the template information to form one piece of image information. 3. The image processing device according to any one of 2. 4. The image processing apparatus according to claim 3, further comprising a rendering control unit that controls an operation of the rendering unit based on the template information. 5. The image processing apparatus according to claim 3, further comprising an image synthesizing storage unit configured to store at least one of a position and a synthesizing method of each of the image information subjected to the image synthesizing by the rendering unit. The image processing apparatus according to any one of claims 1 to 4. 6. An electronic watermark information storage unit for storing predetermined electronic watermark image information, and an electronic watermark information adding unit for adding the electronic watermark image information to the image information edited by the image editing unit. 6. The image processing apparatus according to claim 1, further comprising a digital watermark information removing unit configured to remove the digital watermark image information from the image information to which the digital watermark image information is added. 7. The image processing apparatus according to claim 1, further comprising a communication unit that communicates image information with another apparatus via a network. 8. The image processing apparatus according to claim 6, further comprising a digital watermark image information synthesizing unit that synthesizes at least two digital watermark image information. 9. The image processing apparatus according to claim 6, further comprising: circumscribing rectangle information acquiring means for acquiring circumscribing rectangle information of the digital watermark image information; and determining means for judging an overlap of the plurality of circumscribing rectangle information. 9. The image processing device according to any one of 8. 10. An editing step of editing predetermined template information and input image information, and a reference relation storage for storing reference relation information indicating a reference relation between the template information and the image information in the editing step. And an image processing method. 11. The image processing method according to claim 10, wherein the reference relation information includes information for identifying image information used for the template information. 12. The image processing method according to claim 10, wherein the reference relation information includes information indicating whether editing of the image information with respect to the template information is possible. . 13. The method according to claim 10, wherein the reference relation information is included in the template information.
3. The image processing method according to any one of 2. 14. The method according to claim 10, further comprising a rendering step of combining at least two pieces of image information edited based on template information in the editing processing to form one piece of image information. The image processing method according to any one of the above. 15. The image processing method according to claim 14, further comprising a rendering control step of controlling a processing operation in said rendering step based on said template information. 16. An image synthesizing information storing step of storing at least one of a position of the image information and a synthesizing method when the at least two pieces of image information are synthesized. The image processing method according to any one of the above. 17. A digital watermark information storing step of storing predetermined digital watermark image information; a digital watermark information adding step of adding the digital watermark image information to the edited image information; 17. The image processing method according to claim 10, further comprising: a digital watermark information removing step of removing the digital watermark image information from the image information to which the information has been added. 18. The image processing method according to claim 10, further comprising a communication step of communicating image information with another device via a network. 19. The image processing method according to claim 17, further comprising a digital watermark image information synthesizing step of synthesizing at least two pieces of the digital watermark image information. 20. The method according to claim 17, further comprising: a circumscribed rectangle information acquiring step of acquiring circumscribed rectangle information of the digital watermark image information; and a determining step of judging an overlap of the plurality of circumscribed rectangle information. 20. The image processing method according to any one of claims 19 to 19. 21. A storage medium for storing a program for realizing an image processing method when read and executed by a computer, wherein the image processing method edits predetermined template information based on input image information. A storage medium, comprising: an editing step; and a reference relation storing step of storing reference relation information indicating a reference relation between the template information and the image information in the editing step. 22. An input unit for inputting a plurality of pieces of image information containing a digital watermark, a combining unit for combining the plurality of pieces of image information, and the input unit when the combining unit combines the plurality of pieces of image information. An image processing apparatus comprising: a control unit that controls, when digital watermarks of the plurality of pieces of image information input by the user overlap each other, to recognize the respective digital watermarks. 23. An input step of inputting a plurality of pieces of image information containing a digital watermark, a combining step of combining the plurality of pieces of image information, and the input means when the combining means combines the plurality of pieces of image information. Controlling the electronic watermarks to be recognized when the digital watermarks of the plurality of pieces of image information input by the user overlap each other.