JP2737869B2 - Image processing method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing method .

[0002]

2. Description of the Related Art Conventionally, there has been an apparatus for synthesizing an image stored in a storage medium and displaying it on a monitor.

[0003]

[0004]

However, in the conventional image synthesizing apparatus described above, particularly when processing a color image, the data amount is large and is not suitable for high-speed processing. Furthermore, when giving instructions relating to synthesis interactively on the monitor
Then, if you want to display the result of synthesis and confirm it
In particular, the processing speed was not negligible. On the other hand, it has been conventional to compress and store data in order to reduce the capacity of a storage medium. However, in order to perform synthesis processing, it is necessary to use data that has been subjected to decryption processing. The time required for decoding the image and restoring the image cannot be ignored. In addition, when the image is compressed and decoded, the image quality may be degraded. When such compression and decoding is repeated, this deterioration may be visually recognized.

SUMMARY OF THE INVENTION The present invention has been made in view of the above-mentioned prior art, and is an image processing apparatus capable of performing high-speed processing even when synthesizing color image data and suppressing deterioration of image quality. It is intended to provide.

[0006]

In order to achieve the above object, one embodiment of the present invention has, for example, the following configuration. That is, the average of a plurality of pixels constituting a block
The image data includes representative color data.
A storage step of storing an image to be formed; and
Input instructions for combining multiple images stored
Instruction step, and according to the instruction in the instruction step,
Form a composite image using representative color data and output it to the display
And outputting to the display unit by the synthesizing step.
Of the synthesized image with higher resolution than the representative color data
And a supply step of outputting to the printing means .

[0007]

[0008]

Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

In this embodiment, a case where the present invention is applied to a color image processing apparatus will be described.

[Explanation of Configuration Diagram (FIG. 1)] FIG. 1 is a block configuration diagram of an image processing apparatus according to this embodiment.

In FIG. 1, reference numeral 101 denotes a control processing device for controlling the entire apparatus, which performs processing according to a program stored in 102. A keyboard 103 and a mouse 104 are one of pointing devices. These are connected to the control processing device 101. Reference numeral 105 denotes an image reading apparatus for reading an image, and the read image data is compression-encoded by a compression encoder 106 (the compression-encoded image data is hereinafter simply referred to as encoded data). ). Note that this compression encoder 10
Details of 6 will be described later. Reference numeral 108 denotes a decompression decoder for decoding the encoded data, and the decoded image data forms a permanent visible image (print output image) by the printing device 107. Reference numerals 109 and 110 denote image memories for storing encoded data formed by the compression encoder 106 via a system bus 118. A synthesizing unit 112 synthesizes an arbitrary area in the image memories 109 and 110 and outputs the synthesized area to the display device 113. The area to be synthesized is determined by the flag data stored in the image flag memory 111.

[Description of Compression Encoding (FIG. 4)] The compression encoder 106 will be described below with reference to FIG.

In FIG. 1, reference numeral 400 denotes a pixel block read by the image reading device 105. In this embodiment, the pixel block has 4 × 4 pixels. Each pixel has a color component of R (red), G
(Green) and B (blue) have 256 gradations (8 bits). Therefore, the pixel block 400 input via the bus 451 has a total of 384 bits (= 8 × 16 ×
It is composed of the data of 3).

A pixel block 400 sequentially output from the image reading apparatus 105 is input to a representative color extracting unit 401 in the compression encoder 106 via a bus 451, and the pixel block 400 is viewed as a whole. Extract the color information that is best represented. In the present embodiment, the description is made assuming that the average value of the gradation for each color component (R, G, B) of each pixel is taken, but the present invention is not limited to this. For example, it may be determined from the color distribution (standard deviation) of each pixel. In any case, the representative color of the pixel block 400 is determined and output as the representative color information 404a of the encoded data 404 via the bus 453. When the compression encoder 401 determines a representative color, a value (threshold) for each color component is determined.
Is output to the bus 452.

The pixel block 400 is also once input to the buffer memory 402 similarly. The buffer memory 402 can store a plurality of pixel blocks. When the representative color is extracted by the representative color extracting unit 401 and the threshold is input to the binarizer 403 via the bus 452, the pixel block corresponding to the threshold is also transmitted from the buffer memory 402 to the binarizer 403. It is input and binarized. The binarized 4 × 4 block for each color component is output as detailed information 404 b of the encoded data 404.

Further, the pixel block 400 stored in the buffer memory 402 is input to the variance calculating unit 405 via the bus 455, and the input pixel block 400
The variance values σ _R , σ _G , and σ _B are calculated from the average value of each color component output on the bus 452 from the representative color extraction unit 401. For example, the variance σ _R of “R (red)” is as follows.

Σ _R = {(R _i −A _R ) ² } / n where n is the number of pixels (16), and _AR is _R for each pixel.
(Red) the average value of the components, R _i denotes a gradation of each pixel.

The same calculation can be performed for the other G (green) and B (blue). The variances σ _R , σ _G , and σ _{B for} each color component obtained in this manner are represented by bus 456.
Is output as the shared information 404c of the encoded data 404 via the coded data 404, and constitutes the encoded data 404 together with the representative color information 404a and the detailed information 404b described above.

At this time, since the detailed information 404b is binary information of each color component of the pixel block 400,
When the variance value information 404c is represented by 8 bits for each color component, the encoded data 404 is represented by the representative color information 404a.
(8 × 3 bits), the detailed information 404b (16 × 3), and the distribution information 404c (8 × 3 bits), for a total of 96 bits. The size of the 384 bits of the pixel block 400 is compressed to １ ／. Will be.

[Explanation of Operation of Apparatus (FIGS. 2 and 3)] The coded data 404 formed by the above processing is displayed on the display device in the same manner as ordinary image data. That is, when displaying on the display device, only the representative color information is displayed as image data. Therefore, the number of display dots on the display screen can be set to 1/16 of the number of pixels read by the image reading device 105.

The following is an example applied to a case where image processing is performed using such compressed and encoded data.

Now, the compressed and encoded image A (hereinafter simply referred to as image A) shown in FIG. 2A is stored in the image memory 110, and the compressed and encoded image B (hereinafter simply referred to as "image B") shown in FIG. Image B) is stored in the image memory 109. The process up to forming the compressed and encoded image C (hereinafter, simply referred to as image C) shown in FIG. 2C using these images A and B will be described. The operator inputs an appropriate command using the keyboard 103 or the mouse 104, and rotates only the image B in the image memory 109.
Perform reduction processing. In the next stage, the bit map information representing the outline information for the image B processed in this way is converted into mask information (information of “1” or “0”) and stored in the image flag memory 111. Here, it is assumed that the outline information of the image B is formed by scanning the inside of the image memory 109 and the flag data is formed in the image memory 111 by scanning the inside of the image memory 109. However, the outline is traced using the mouse 104, for example. A boundary may be specified.

After the images and mask information are stored in the memories 109 to 111 as described above, the composite display of the images A and B is started.

FIG. 3 is a diagram showing the internal configuration of the synthesizing unit 112.

In the figure, reference numerals 301 and 304 denote signal selectors for selecting one of the input signals. The signal selector 301 masks the image flag memory 111 (sent to the signal line 114). A, B based on
Is to select one of them. Reference numeral 302 denotes a signal adder, which adds the gradations of the images A and B. The added data is divided by a 1/2 circuit 303 into 1 /
2 (average). The output of the half circuit is connected to one input side of the signal selector 304.

Therefore, for example, when the level of the signal line 351 is "0", the image data selected by the mask information in the image flag memory 111 is output to the display device via the signal line 117. The display image at this time is an image C on which images A and B are superimposed as shown in FIG. 2C.

When the level of the signal line 351 is "1", the average of the gradations of the images A and B is output to the signal line 154, so that the images A and B are transmitted and synthesized and displayed. Will be.

With the above configuration, the outline may be conspicuous when combining images. In such a case, it is achieved by controlling the signal line 351 so that the average image is selected at the contour portion. That is, the ratio of the composite display of the images A and B is 100: 0 → 50: 50 →
0: 100% can be controlled in three stages.

When the image desired by the operator is displayed, the image B in the image memory 109 and the image A in the image memory 110 are actually synthesized based on the synthesized and displayed image C. Stored in 110. At this time, not only the representative color information 404a in each encoded data, but also the detailed information 404b and the dispersion information 404c are processed as compositing targets. As a result, the image C is formed in the image memory 110.

[Explanation of Decompression Decoding (FIG. 5)] When the image C is finally printed out, the image memory 110
The encoded data of the image C stored therein is sequentially transferred to the decompression decoder 108 and decoded.

In the decompression decoder 108, the representative color information 404a and the detailed information 4 in the input encoded data 404 are input.
The image data is decoded into pixel blocks having 4 × 4 gradations from the pixel information 04b and the shared information 404c.

Actually, for a pixel which has been binarized to "1" in each color component in the detailed information 404b, the average gradient (for each color component) stored in the representative color information 404a is obtained. A _R , A _G , and A _B ) have variance values (σ _R , σ) of the color components.
_G , σ _B ). The decoding process is performed by subtracting the variance value from the average gradient for the pixel that has been binarized to “0”.

[0033] For example, a color component "R (red)", the pixel XR became binarized to _{"1", X R = A R + σ} R ... 2 binarized becomes "0" pixel XR was is given by _{X R = A R -σ R ...} .

FIG. 5 shows a binarization process for the color component "R".
This shows a simple transition of the decoding process.

In the figure, reference numeral 50 denotes a pixel block of the color component “R” read by the image reading device 105. The numerical value in each pixel indicates the gradation value of the color component “R”. Reference numeral 51 denotes a binarized block obtained by binarizing the pixels in the pixel block 50 with the average value of the gradation (A _R ≒ 53 when calculated). The average value is calculated by the representative color extracting unit 401 as described above. Also, the variance of each color component is calculated by the variance value calculation unit 405 from the calculated average value of each color component and the pixel block by the variance calculation formula described above. In this case (FIG. 5), the variance value σ _R ≒ 19
Becomes Reference numeral 52 denotes a decoded pixel block when the binarized block 51 is decoded.

When the binarized block is decoded into the decoded pixel block 52, the tone value of the pixel which is "1" in the binarized block 51 is "72 (= A _R + σ _R = 53 + 19) ”, and the pixel“ 0 ”becomes“ 34 (= A _R −σ _R ) ”, and a decoded pixel block 52 similar to the pixel block 50 is formed.

By the way, during normal printing, the image data is converted into YMC (yellow, magenta, cyan) or the like, and
7, but this processing is based on the conventional conversion processing, and the description is omitted in this embodiment.

[Explanation of Another Synthetic Display (FIG. 6)] In the above-described embodiment, the case where the composite display of the image A and the image B is combined and displayed at a three-stage ratio when the composite display is performed has been described. A further developed example will be described with reference to FIG.

In the figure, reference numeral 111a denotes an image flag memory, and this time, each of the image memories 109 and 110 is constituted by 4 bits per pixel. And this 4
The ratio of the composite display of the image A and the image B is set to be multi-step (16 steps for 4 bits) with bits. Also, 60 and 61 are represented by 4-bit values sent from the image flag memory 111a via the bus 63.
This is a multiplier for multiplying the gradation value of the image data output on the buses 115 and 116 by 0.0 to 1.0 times in 16 steps. Reference numeral 62 denotes multipliers 60 and 6 respectively.
This is an adder for adding the signal from the signal 1, and outputs the result of the addition on a signal line 117 to the display device 113.

Now, suppose that (F) ₁₆ , that is, all four bits are at a high level on the bus 63. At this time, the multiplier 60 sets the gradation of the image data on the bus 115 to 1.0.
The output is output to the adder 62 as doubled, that is, as it is. on the other hand,
Since the data from the image flag memory to the multiplier 61 is inverted (ie, (0) ₁₆ ) and input, the bus 1
The gradation of the image data on 16 is 0.0 times, that is, the output to the adder 62 is “0”. The adder 62 simply adds the gradation of the input image data and outputs the result to the display device 113 via the signal line 117. In this case, the bus 115
That is, only the upper image is output to the display device 113.

As can be seen from the above description, the data from the image flag memory 111a causes the buses 115, 1
16 can be displayed in multiple steps of the composition ratio of the gradation of the image data output on the display unit 16. For example, by combining the gradation near the contour of two images to be combined in multiple steps, The sense of incongruity of the contour portion in synthesizing images is eliminated. Further, it is possible to perform smooth image synthesis in which one image is switched to another image.

[Explanation of Another Configuration Diagram (FIG. 7)] FIG.
Is a further development of the block diagram of FIG.

In the figure, the difference from the configuration of FIG.
09 and 110 and the image flag memory 111 are not directly connected to the system bus 118 but via the processing unit 701.

In the configuration of FIG. 1, it is difficult to access the memories 109 to 111 at the same time, and the processing by the control processing unit 101 takes time. Therefore, here, the control processing device 101 is divided into a control device 702 and a processing device 701. According to this configuration, since the efficiency of use of the system bus 118 is reduced along with the improvement of the efficiency by parallelizing the access (read / write) to each memory, the control unit 702 can also perform other processing.
The processing speed of the entire system is increased.

As described above, according to this embodiment, color image data is displayed on a display screen with data obtained by compressing the image data to a fraction, and image processing is performed. Output.

Further, at the time of image editing, since only representative color information is changed, the processing speed of image processing is improved.

Further, the composition ratio of the two images can be made multi-step, so that it is possible to eliminate the unnatural feeling of the outline portion of the images to be composed, and to smoothly switch from one image to the other image. Switchable image composition display is enabled.

Further, since the display image and the output image for printing or the like are not separated from each other, there is no need to perform double processing for each memory. It also reduces.

In this embodiment, the multiplication ratio of two images has been described. However, a logical operation such as a logical sum or a logical product may be performed on these two images.

Further, the pixel block is not limited to the size of 4 × 4, but can be generally realized by n × m pixels.

Further, for example, in the case of an apparatus for processing an image of only one color (for example, black), if one focuses on one of the color components constituting the color image described in this embodiment, it is easy to consider. It can be realized.

[0052]

As described above, according to the present invention, the block
Instead of using the multiple pixels that make up the lock for synthesis,
A representative that is the average data of multiple pixels that make up the block
Because the composite image is obtained from the color data,
High-speed processing for any of the displays for image confirmation
can do. Further, the composite image forms a block.
Pixel data from the image
Thinning-out Compared to those that combine using this thinned-out image
In addition, it is possible to display the color density more faithfully. Ma
Also, when printing out, the representative color data
Supplies high-resolution data to the printing means.
This makes it possible to output a better image than the image used for display.

[Brief description of the drawings]

FIG. 1 is a block diagram of an image processing apparatus according to an embodiment.

FIG. 2A is a diagram showing an image to be combined.

FIG. 2B is a diagram showing an image to be combined.

FIG. 2C is a diagram showing an image after composition.

FIG. 3 is an internal configuration diagram of a combining unit shown in FIG. 1;

FIG. 4 is an internal configuration diagram of the compression encoder shown in FIG.

FIG. 5 is a diagram for explaining a process until compression-encoded data is subjected to decompression decoding.

FIG. 6 is a diagram for explaining another combining unit.

FIG. 7 is a block diagram of another image processing apparatus according to the embodiment.

[Explanation of symbols]

 Reference Signs List 101 control processing device 102 memory 103 keyboard 104 mouse 105 image reading device 106 compression encoder 107 printing device 108 decompression decoder 109, 110 image memory 111, 111a image flag memory 112, 112a synthesizing unit 113 display device 114 to 117 signal Line 118 System bus 301, 304 Signal selector 302 Signal adder 303 1/2 circuit 400 Pixel block 401 Representative color extractor 402 Buffer memory 403 Binarizer 404 Coded data 404a Representative color information 404b Detailed information 60, 61 Multiplication Unit 62 Adder 701 Processing unit 702 Control unit

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI G09G 5/36 530 G06F 15/62 322

Claims (1)

(57) [Claims] 1. An average data of a plurality of pixels constituting a block.
Composed of image data including representative color data
A storing step of storing the images to be stored, and a synthesizing process between the plurality of images stored in the storing step.
An instruction step of inputting an instruction to perform the processing, and the representative color data is
Compositing process of forming a used composite image and outputting it to a display unit
And the synthesized image output to the display unit in the synthesizing step.
Print data as data with higher resolution than the representative color data
And a supply step of outputting to a stage.
Processing method.