JP5637911B2 - Color adjustment apparatus, method and program - Google Patents

Description

  The present invention relates to a color adjustment processing technique between different apparatuses.

  In recent years, devices such as scanners, printers, and displays have become widespread with the spread of computers, and data including color information (hereinafter referred to as color data) has been processed by various devices such as scanners, printers, and displays. . For example, color data read from a scanner is displayed on a display and further printed by a printer.

  Each device for processing color data has information on a specific color system. Therefore, in order to obtain the same processing result from the same color data, it is necessary to adjust the color in each apparatus. When color data is exchanged between different devices, each device determines which color to output color data based on the combination of its own device and the other device that is the data source. A color adjustment process is performed to identify whether or not.

  In this color adjustment process, if calculation is performed for all the colors included in the color data each time the color data is output, the calculation amount becomes enormous and takes a long time. Therefore, the device stores a color adjustment table that defines the correspondence between the representative color and the converted color as color adjustment information associated with the data source device, and corresponds to the data source at the time of color data processing. Color adjustment is performed using the color adjustment table, representative colors are converted into defined conversion colors, and other colors are output by interpolation using parameters determined based on the definition information in the color adjustment table. Is stipulated.

  Conventionally, in color balance correction processing, based on the distribution of image data in the color space, the distribution density at the movement target position in the direction that requires fine adjustment of the balance correction of the movement target position of the coordinate axis in the color space is high. A process is known in which a plurality of parameters are set so as to determine parameters corresponding to the parallel movement of the coordinate axis to the movement target position.

JP 2005-20390 A

  In the conventional color adjustment processing, the representative colors in the color data are faithfully converted based on the definition of the color adjustment table. However, the continuity of the converted colors cannot be verified for other colors. In the converted color, there is a problem that a stepped gap occurs in density and color.

  Therefore, in order to make it as similar as possible to the result of processing the same color data with the original device, for colors that have a gap in density or color due to color adjustment and cause a sense of incongruity, further manually There was a need to adjust.

  Generally, the color adjustment process is not performed every time color data is exchanged between apparatuses, but is performed at the first stage of the process. Specifically, the processing device uses the color adjustment table that it holds to adjust the sample color data and outputs it, and the person who visually confirms that the color adjustment is appropriate is the color that requires correction. Find and adjust manually. Note that the parameters of the color adjustment process are corrected by manual adjustment, and in the subsequent processes, color data is processed by the corrected color adjustment process.

  However, if there are a large number of colors to be manually adjusted, the check operation of the target colors becomes complicated, and there is a possibility that work leakage may occur.

  An object of the present invention is to provide a color adjustment device capable of detecting a color that has lost consistency with the original color (adjusted color) during color adjustment between different devices. Another object of the present invention is to provide a color adjustment method for a computer to execute each process realized by the color adjustment apparatus. Furthermore, another object of the present invention is to provide a color adjustment program for causing a computer to execute each process realized by the color adjustment apparatus.

  A color adjustment device disclosed as one aspect of the present invention is a color adjustment device that performs color adjustment of processing colors that occur between different devices, and includes the following processing units.

That is, the color adjustment device disclosed, using discretely from the color data extraction four pixels, the pixel information reading unit acquire the pixel value information of each pixel taken out, a preset color conversion process, a color adjusting unit to convert based on the pixels taken out the to the pixel value information, the pixel is converted from the pixels extracted the a set of pixels taken out the color space set pre Me pairs and respectively 2 A straight line is obtained on the basis of the coordinate values of the first pixel and the second pixel that are arranged on the axis color space and located at the diagonal of the quadrangle formed by the set of extracted pixels. In the color space divided into two regions, the position of the third pixel in the pixel set extracted by the pixel information reading unit and the position of the third pixel in the pixel set converted by the color adjustment unit are the same. In the area of If not standing, but with a consistency checking unit for outputting warning information for the retrieved pixel.

  According to the disclosed color adjustment apparatus, it is possible to easily detect a color after adjustment that is no longer consistent with the color before adjustment during color adjustment between different apparatuses.

It is a figure which shows the structural example in one Embodiment of the color adjustment apparatus to disclose. It is a figure which shows the example in case the result of the color adjustment with respect to a pixel combination has consistency. It is a figure which shows the example in case the result of the color adjustment with respect to a pixel combination is inconsistent. It is a figure which shows another example in case the result of the color adjustment with respect to a pixel combination is inconsistent. It is a figure which shows the example of a processing flow of a color adjustment apparatus. 2 is a diagram illustrating a hardware configuration example of a color adjustment apparatus 1. FIG.

  Hereinafter, a color adjustment device disclosed as one embodiment of the present invention will be described.

  FIG. 1 is a diagram illustrating a configuration example in an embodiment of a disclosed color adjustment apparatus.

  The color adjustment device 1 is a device that checks the color consistency before and after the adjustment for the color (sample color) that becomes a control point in color adjustment between different apparatuses and detects a color that does not have consistency.

  The color adjustment apparatus 1 includes a pixel information storage unit 11, a pixel information reading unit 12, a pixel selection unit 13, a pixel combination unit 14, a color adjustment unit 15, a position information storage unit 16, and a consistency confirmation unit 17.

  The pixel information storage unit 11 stores pixel information of color data to be subjected to color adjustment. The pixel information is information indicating the pixel value of the pixel included in the color data.

  The pixel information reading unit 12 discretely extracts pixels serving as control points (colors) for color adjustment processing from the pixel information stored in the pixel information storage unit 11 and reads the pixel values of the extracted pixels. The number of pixels read by the pixel information reading unit 12 is arbitrary and is set in advance.

  The pixel selection unit 13 selects pixels one by one from the pixel group extracted by the pixel information reading unit 12 and sets them as control point candidates.

  The pixel combination unit 14 extracts a pixel located nearest to the control point candidate (selected pixel) selected by the pixel selection unit 13 from the pixel group extracted by the pixel information reading unit 12 and sets it as a corresponding pixel. And “pixel combination” of the corresponding pixels are generated.

  The nearest pixel is a pixel at the shortest distance from the position in the color space of the selected control point candidate in the set of control point candidates arranged in a certain color space. Note that, as the nearest pixel, a pixel at the shortest distance may be extracted from pixels in a range separated by a predetermined distance or more. This is because, in the consistency check process described later, if the consistency of the adjustment result is determined between pixels that are too close to the control point candidate, the determination result becomes excessively sensitive.

  Alternatively, the pixel combination unit 14 extracts two pixels located nearest to the control point candidate selected by the pixel selection unit 13 from the pixel group extracted by the pixel information reading unit 12, and the control point candidate and the two neighboring points are extracted. A combination with a pixel is generated. Then, the pixel combination unit 14 extracts all the combinations in which the neighboring pixels are common from the generated combinations of the control point candidates and the two neighboring pixels, and controls the pixel of the control point candidate, the corresponding pixel, and the two control point candidates. A "combination" is generated.

  The pixel combination unit 14 maps each pixel of the pixel combination to a preset color space based on the pixel value, generates pre-adjustment position information indicating position information of each pixel in the color space, and generates a position information storage unit 16 is recorded.

  The color adjustment unit 15 takes out each pixel combination stored in the position information storage unit 16 one by one and performs a predetermined color adjustment process using the color adjustment parameter 2 associated with the color data for the pixel combination. To convert the pixel value of each pixel of the pixel combination.

  The color adjustment unit 15 maps each pixel of the pixel combination to the color space based on the converted pixel value, generates adjusted position information indicating the position information of each pixel in the color space, and generates the position information storage unit 16. To record.

  The position information storage unit 16 stores pre-adjustment position information and post-adjustment position information for each pixel combination.

  The consistency checking unit 17 compares the positional relationship based on the pre-adjustment positional information between the control point candidate included in the pixel combination stored in the positional information storage unit 16 and the corresponding pixel with the positional relationship based on the post-adjustment positional information. Then, it is checked whether the positional relationship between the two changes before and after the color adjustment process. If the positional relationship between the control point candidate and the corresponding pixel has not changed before and after color adjustment, the consistency check unit 17 determines that the pixel after adjustment of the control point candidate of the pixel combination is consistent, If the positional relationship has changed before and after the color adjustment, it is determined that the adjusted pixel of the control point candidate of the pixel combination is not consistent.

  When it is determined that the pixel after adjustment of the control point candidate for the pixel combination is not consistent, the consistency check unit 17 outputs a warning for the pixel combination. Alternatively, the consistency confirmation unit 17 generates inconsistency information 3 including the pre-adjustment position information and the post-adjustment position information of the pixel combination.

  The inconsistency information 3 is displayed as an applicable pixel (color) or a pixel value (numerical value) on an output device such as a display device connected to the color adjustment device 1.

  Next, the color adjustment consistency determination process will be described in more detail.

  2 to 4 are diagrams showing examples of matching and mismatching of color adjustment of pixel combinations.

  There are three color systems such as Lab, XYZ, and RGB and four color systems such as CMYK as representations of the color space. In this embodiment, a and b indicating Lab colors are used for convenience of explanation. These two values will be described as pixel values. 2 to 4, the two coordinate axes a * and b * constituting the plane correspond to the interpolation dimensions a and b of the Lab color space.

  2 to 4, pixels p1 to p4 shown on the plane are pixels included in the pixel combination. Pixels p1 and p3 represent neighboring pixels, pixel p2 represents a control point candidate, and pixel p4 represents a corresponding pixel.

  That is, in the pixel combinations (pixels p1 to p4) mapped in FIGS. 2 to 4, the pixel combination unit 14 causes the combination of the control point candidate pixel p2 and the neighboring pixels p1 and p3 and the control point candidate pixel p4. And a combination of neighboring pixels p1 and p3, and a pixel combination having a lattice relationship created based on the common neighboring pixels p1 and p3.

  When generating a pixel combination of a control point candidate and a corresponding pixel, the pixel combination unit 14 generates a pixel combination of a control point candidate pixel p2 and a corresponding pixel p4. In this case, the pixels p2 and p4 are mapped in the color space.

  FIG. 2 shows an example in which the pixel combination control point candidates have consistency.

  FIG. 2A is an example of the pre-adjustment position information. In the pre-adjustment position information, positions (here, pixel values of a and b) of four pixels of the lattice-related combination in the color space are recorded. For example, the pixel p1 indicates that the value of the Lab interpolation dimension a is “17.11” and the value of b is “17.29”.

  FIG. 2B is an example of post-adjustment position information. In the post-adjustment position information, the post-adjustment positions (adjusted pixel values) of the four pixels in the lattice-related combination are recorded. For example, the pixel p1 'indicates that the value a of the Lab system is "18.11" and the value of b is "17.29".

  FIG. 2C shows the position in the color space indicated by the plane of the coordinate axes a * and b * of the pixels p1 to p4 in the case of the position information before adjustment in FIG. 2A and the position information after adjustment in FIG. Represents.

  The consistency checking unit 17 checks whether there is a change in the positional relationship between the pixels p2 and p4 and the positional relationship between the pixels p2 'and p4'. That is, the consistency confirmation unit 17 obtains the position (coordinate value) of each of the pixels p2 and p4 in the color space, obtains the magnitude relationship between the coordinate values of the two pixels for each coordinate axis, and examines the change in the magnitude relationship. .

  Here, regarding the position of the pixel pix in the color space, the coordinate value corresponding to the a * axis is represented by “pia”, and the coordinate value corresponding to the b * axis of the pixel pix is represented by “pib”.

  In the example shown in FIG. 2C, the relationship between the coordinate value (p2a, p2b) of the pixel p2 before adjustment and the coordinate value (p4a, p4b) indicating the position of the pixel p4 is p2a <p4a on the a * axis. Yes, p2b> p4b on the b * axis. The relationship between the coordinate value (p2′a, p2′b) of the pixel p2 ′ before adjustment and the coordinate value (p4′a, p4′b) indicating the position of the pixel p4 is expressed as p2 ′ on the a * axis. a <p4′a, and p2′b> p4′b on the b * axis.

  Accordingly, there is no change in the magnitude relationship of coordinate values on all coordinate axes between the pixels p2 and p4 before adjustment and the pixels p2 ′ and p4 ′ after adjustment, so that the pixel p2 after color adjustment with respect to the pixels p2 and p4. It is determined that “, p4” has consistency.

  FIG. 3 shows an example where the pixel combination control point candidates are inconsistent.

  FIG. 3A shows an example of the position information before adjustment, FIG. 3B shows an example of the position information after adjustment, and FIG. 3C shows the position information before adjustment in FIG. The position (position on the plane of coordinate axes a *, b *) of the pixels p1 to p4 in the case of the adjusted position information in FIG.

  In the example shown in FIG. 3C, the relationship between the coordinate value (p2a, p2b) of the pixel p2 before adjustment and the coordinate value (p4a, p4b) indicating the position of the pixel p4 is p2a <p4a on the a * axis. Yes, p2b> p4b on the b * axis.

  On the other hand, the relationship between the coordinate value (p2′a, p2′b) of the adjusted pixel p2 ′ and the coordinate value (p4′a, p4′b) indicating the position of the pixel p4 is p2′a on the a * axis. > P4′a, p2′b <p4′b on the b * axis, and both the a * axis and the b * axis are changed. Therefore, it is determined that the pixels p2 'and p4' after color adjustment for the pixels p2 and p4 are not consistent.

  FIG. 4 shows an example where the pixel combination control point candidates are inconsistent.

  4A shows an example of the position information before adjustment, FIG. 4B shows an example of the position information after adjustment, and FIG. 4C shows the position information before adjustment in FIG. This represents the positions (positions on the plane of the coordinate axes a * and b *) of the pixels p1 to p4 in the case of the adjusted position information in FIG. 4B.

  In the example shown in FIG. 4C, the relationship between the coordinate value (p2a, p2b) of the pixel p2 before adjustment and the coordinate value (p4a, p4b) indicating the position of the pixel p4 is p2a <p4a on the a * axis. Yes, p2b> p4b on the b * axis.

  On the other hand, the relationship between the coordinate value (p2′a, p2′b) of the adjusted pixel p2 ′ and the coordinate value (p4′a, p4′b) indicating the position of the pixel p4 is p2′a on the a * axis. > P4′a, p2′b> p4′b on the b * axis, and changes with respect to the a * axis. Therefore, it is determined that the pixels p2 'and p4' after color adjustment with respect to the pixels p2 and p4 have no consistency.

  As described above, the consistency checking unit 17 determines the change in the positional relationship between the control point candidate p2 and the corresponding coordinate p4 based on the change in the magnitude relationship of the coordinate values on either the a * axis or the b * axis. Then, determine whether it has consistency.

  In addition, the consistency checking unit 17 performs the following process as a method for examining whether there is a change in the positional relationship between the pixels p2 and p4 and the positional relationship between the pixels p2 'and p4'.

  That is, the consistency checking unit 17 obtains a linear equation L including neighboring pixels p1 and p3 using the pixels p1 to p4 of the pixel combination, and the control point candidate pixel p2 and the corresponding pixel p4 are divided by the equation L. The position relationship between the two pixels is examined by determining which of the two regions is located.

  For example, as shown in FIG. 4C, the consistency checking unit 17 specifies a straight line equation L including neighboring pixels p1 and p3 from the pre-adjustment position information, and controls the control point candidate pixel p2 and the corresponding pixel p4. Is located in the region divided by the equation L. Further, the consistency check unit 17 specifies a straight line equation L ′ including the neighboring pixels p1 ′ and p3 ′ from the adjusted position information, and the control point candidate pixel p2 ′ and the corresponding pixel p4 ′ are expressed by the equation L ′. Find which of the areas divided by.

  In the example shown in FIG. 4C, the pixel p2 before adjustment is located in the left / upper region divided by the equation L, and the pixel p4 is located in the right / lower region divided by the equation L. On the other hand, the adjusted pixel p2 'is located in the left / upper region divided by the equation L', but the pixel p4 'is located on the equation L'. Therefore, the positional relationship between the pixels p2 and p4 and the positional relationship between the pixels p2 'and p4' after color adjustment are changed. Therefore, it is determined that the pixels p2 'and p4' after color adjustment with respect to the pixels p2 and p4 have no consistency.

  A change occurs in the positional relationship between two pixels (control point candidates and corresponding coordinates) in the color space, that is, a change occurs in the magnitude relationship between any component of the color information of two colors (coordinate values on each coordinate axis). This means that the density and color are reversed between the two colors. The fact that the density and color tone of the color of interest as a control point candidate is reversed due to the color adjustment and in relation to the neighboring color (corresponding pixel). Therefore, the display color of the control point candidate changes from the display color (the color before adjustment) in the original device, which causes a sense of incongruity in the color seen by the human eye.

  The consistency confirmation unit 17 detects a control point candidate that is an adjustment result that causes a sense of incongruity at the time of output, and outputs warning information for this pixel combination. The consistency confirmation unit 17 generates, as warning information, inconsistency information 3 including pre-adjustment position information and post-adjustment position information of the pixel related to the lattice where the inconsistency is detected.

  Based on the warning information output from the color adjustment device 1, the user can easily detect a color that changes to such a degree that the color adjustment causes a sense of incongruity due to color adjustment. Also, the mismatch information 3 output from the color adjusting device 1 allows the user to know which color is the warning target color and what color it is changed to.

  Next, the processing flow of the color adjustment apparatus 1 will be described.

  FIG. 5 is a diagram illustrating a processing flow example of the color adjustment apparatus 1.

  In the processing flow of FIG. 5, the color adjustment apparatus 1 performs processing for checking the consistency of color adjustment for a pixel combination of a control point candidate and a corresponding pixel via two neighboring pixels for a pixel extracted from color data. explain.

  The pixel information reading unit 12 of the color adjustment device 1 extracts a predetermined number of control point candidates from the color data stored in the pixel information storage unit 11, and reads pixel information indicating the extracted pixel values (step). S1). The pixel selection unit 13 arbitrarily selects one pixel from the set of pixels extracted by the pixel information reading unit 12 (step S2). If the pixel selection unit 13 has not selected all the pixels from the pixel information (N in Step S3), the process proceeds to Step S4. If the pixel selection unit 13 has finished selecting all the pixels from the pixel information (Y in step S3), the process ends.

  The pixel combination unit 14 extracts pixels located in the vicinity of the pixel (control point candidate) selected in step S2, and generates a combination of the selected pixel (control point candidate) and two or more neighboring pixels. (Step S4). The pixel combination unit 14 extracts a combination of neighboring pixels based on the combination of pixels generated in the process of step S4, and generates a pixel combination with pixels having a lattice relationship (step S5). If the pixel combination unit 14 has not finished generating all pixel combinations for the selected pixel (N in step S6), the process proceeds to step S7, where the pixel combination unit 14 If the generation of the pixel combination has been completed (Y in step S6), the process returns to step S2 to select the next pixel.

  The pixel combination unit 14 records the pre-adjustment position information for the pixel combination in the position information storage unit 16 (step S7). Next, the color adjustment unit 15 performs color adjustment of each pixel of the pixel combination, and generates adjusted position information indicating the adjusted position information (step S8). The pixel combination unit 14 records the adjusted position information for the pixel combination in the position information storage unit 16 (step S9).

  The consistency checking unit 17 uses the pre-adjustment position information and the post-adjustment position information stored in the position information storage unit 16 to compare the positions of the pre-adjustment and post-adjustment pixels in the color space (step S10). . When the consistency checker 17 determines that the pre-adjustment and post-adjustment pixels are not consistent (N in step S11), the consistency checker 17 adjusts the pre-adjustment position information and the adjustment for the pixels of the pixel combination. Inconsistency information including rear position information is generated (step S12). When the consistency checking unit 17 determines that the color adjustment of the pixel combination is consistent (Y in step S11), the process returns to step S5.

  As a result of the above processing, each pixel read in the processing of step S1 is used as a control point candidate pixel, using the positional relationship with the corresponding pixel based on the position of two or more neighboring pixels, and matching the adjusted pixel values. Sex is confirmed.

  The color adjustment apparatus 1 can be realized by a computer system including hardware having a CPU and a memory and a software program, or dedicated hardware.

  FIG. 6 is a diagram illustrating a hardware configuration example of the color adjustment apparatus 1.

  The color adjustment apparatus 1 includes a computer 100 including a computing device (CPU) 101, a temporary storage device (DRAM, flash memory, etc.) 102, a permanent storage device (HDD, flash memory, etc.) 103, and an input device ( It can be implemented by a keyboard (mouse, etc.) 120 and an output device (display, printer, etc.) 130. The computer 100 may further include a network interface 104 with the network N.

  The color adjustment apparatus 1 can be implemented by a program that can be executed by the computer 100. In this case, a program describing the processing contents of the functions that the color adjustment apparatus 1 should have is provided. When the computer 100 executes the provided program, the processing functions of the color adjustment apparatus 1 described above are realized on the computer 100.

  That is, the pixel information reading unit 12, the pixel selection unit 13, the pixel combination unit 14, the color adjustment unit 15, the consistency check unit 17 and the like of the color adjustment apparatus 1 can be configured by programs, and these programs are temporarily stored. The functions of each processing unit are realized by being loaded into the apparatus 102 and executed. Further, the pixel information storage unit 11, the position information storage unit 16, and the like are realized by the persistent storage device 103.

  The computer 100 can also read a program directly from a portable recording medium and execute processing according to the program. In addition, each time the program is transferred from the server computer, the computer 100 can sequentially execute processing according to the received program.

  Further, this program can be recorded on a recording medium readable by the computer 100.

  As described above, the disclosed color adjustment apparatus 1 pays attention to the relationship between two colors of a control point candidate to be processed and a corresponding pixel in the vicinity thereof, and changes in the positional relationship between before and after adjustment. Therefore, it is only necessary to examine the change in the positional relationship between the two colors in the color space indicated by at least two coordinate axes.

  In addition, the color adjusting apparatus 1 can check the change in the magnitude relationship of the coordinate values for each coordinate axis even when the color space is a three-color system (in the case of three axes). Can be easily applied.

  According to the color adjusting apparatus 1, since the color that needs to be adjusted is detected from the color adjustment result for the sample color at the initial stage of color adjustment, the user can adjust only the color detected as inconsistency. Therefore, it is possible to prevent leakage of adjustment work and reduce the work load.

DESCRIPTION OF SYMBOLS 1 Color adjustment apparatus 11 Pixel information storage part 12 Pixel information reading part 13 Pixel selection part 14 Pixel combination part 15 Color adjustment part 16 Position information storage part 17 Consistency confirmation part 2 Color adjustment parameter 3 Inconsistency information

Claims (4)

A color adjustment device that adjusts the color of processing colors that occur between different devices,
Discretely from the color data extraction four pixels, the pixel information reading unit acquire the pixel value information of each pixel taken out,
Using a preset color conversion processing, a color adjusting unit to convert based on the pixels taken out the to the pixel value information,
Place of pixels converted from the pixels extracted the the set of the pixels extracted in the color space set Me pre set and to a color space of each two axes, the rectangle formed by the set of extracted pixel A straight line is obtained based on the coordinate values of the first pixel and the second pixel located diagonally, and the pixel information read out by the pixel information reading unit in the color space divided into two regions by the obtained straight line. Consistency check that outputs warning information for the extracted pixel when the position of the third pixel of the set and the position of the third pixel of the pixel set converted by the color adjustment unit do not exist in the same region A color adjusting device. The consistency confirmation unit is configured as a warning information, in claim 1, characterized in that outputs the inconsistency information including the pixel value information of the pixels is the color conversion processing and the pixel value information of the acquired pixel The color adjustment device described. A color adjustment method for adjusting the color of processing colors generated between different devices,
Computer
Discretely from the color data extraction four pixels, and acquired the pixel value information of each pixel taken out,
Using a preset color conversion process, converts the basis of each pixel taken out the to the pixel value information,
Place of pixels converted from the pixels extracted the the set of the pixels extracted in the color space set Me pre set and to a color space of each two axes,
In the color space, a straight line is obtained based on the coordinate values of the first pixel and the second pixel located on the diagonal of the quadrilateral formed by the set of the extracted pixels, and is divided into two regions by the obtained straight line. A warning for the extracted pixel if the position of the third pixel of the extracted pixel set and the position of the third pixel of the converted pixel set do not exist in the same area in the color space A color adjustment method characterized by executing a process of outputting information. A color adjustment program for adjusting the color of processing colors generated between different devices,
Computer
Discretely from the color data extraction four pixels, and acquired the pixel value information of each pixel taken out,
Using a preset color conversion process, converts the basis of each pixel taken out the to the pixel value information,
Place of pixels converted from the pixels extracted the the set of the pixels extracted in the color space set Me pre set and to a color space of each two axes,
In the color space, a straight line is obtained based on the coordinate values of the first pixel and the second pixel located on the diagonal of the quadrilateral formed by the set of the extracted pixels, and is divided into two regions by the obtained straight line. A warning for the extracted pixel if the position of the third pixel of the extracted pixel set and the position of the third pixel of the converted pixel set do not exist in the same area in the color space color adjustment program characterized thereby perform processing for outputting information.

Images