JP4370146B2 - Image processing program, image processing method, and recording medium - Google Patents

Description

  The present invention relates to an image processing technique, and more particularly to a technique for efficiently correcting an image.

  In general, since the automatic exposure and white balance functions of a digital camera are not always perfect, the color balance of a photographed image may be lost, or it may be too bright or too dark.

Conventionally, in such a case, the user has corrected the image using application software. As a technique for improving the efficiency of the correction work, a method of displaying a sample of the corrected result to the user has been disclosed (for example, see Patent Document 1).
JP-A-5-205019

  However, in the technique described in Patent Document 1, since the user has to manually specify a correction method for each image to be processed, there is still room for improving work efficiency.

  Therefore, it is conceivable to install automatic gradation correction and automatic color correction functions in the application software. However, if all images taken with a wide variety of digital cameras are corrected with the same algorithm, effective correction is possible. There are many cases where this is not possible.

  The present invention has been made in view of such circumstances, and an object thereof is to provide an image processing program, an image processing method, and a recording medium capable of processing an image effectively and efficiently.

A program according to claim 1 of the present invention is an image processing program for correcting an image captured by an imaging device, and is a first processing target from an image captured by the imaging device stored in advance. The image designation means designated by the image designation means from an image designation procedure for designating one image, a database recording image data before and after correction in the correction processing executed in the past, photographing conditions of the image, and correction processing contents A similar image extraction procedure for extracting a plurality of second images similar to the first image and images before and after correction processing of the plurality of extracted second images are displayed, and one of them is selected. A selection image display procedure that prompts the user to perform the correction, and the correction processing content of the third image selected from the plurality of second images displayed in the selection image display procedure. Correction processing procedure for applying the same correction to the first image, image data before and after processing of the first image in the correction processing procedure, photographing conditions and correction processing content of the first image, and the database. And a correction processing information storing procedure stored in the computer.

According to a second aspect of the present invention, there is provided the program according to the second aspect, wherein the similar image extraction procedure has at least brightness or color tone distribution among images recorded in the database. An image selection procedure for selecting, as the second image, an image similar to the brightness or color tone distribution of the first image, and the correction processing content includes at least one of the brightness and color tone of the image The content which corrects any one is included.

According to a third aspect of the present invention, there is provided the program according to the third aspect, wherein the similar image extraction procedure is such that the photographing condition is the first of the pre-correction images recorded in the database. A shooting condition selection procedure for selecting an image that is the same as or similar to the image of the image, and at least the brightness or tone distribution of the selected images is similar to the brightness or tone distribution of the first image. and an image selecting procedure for selecting an image to have as the second image, the photographing in the condition selection procedure, the a condition for selecting that camera, lens and flash are identical.

According to a fourth aspect of the present invention, there is provided a program according to the fourth aspect of the present invention, wherein the brightness or color tone by the user is applied to the second image corrected by the correction processing procedure . A manual correction procedure that enables correction is further provided.

A recording medium according to a fifth aspect of the present invention is a recording medium storing an image processing program for correcting an image captured by an imaging device, and is captured by the previously stored imaging device. from the image, the image designation step for designating a first image to be processed, from a database that records the shooting conditions of the image data and the images before and after correction and correction content in the correction process executed in the past, the A similar image extraction procedure for extracting a plurality of second images similar to the first image specified in the image specification procedure, and images before and after correction processing of the extracted second images, a selected image display procedure that prompts to select one, on the basis of the correction processing of the third image selected from the second image of the plurality of said displayed in the selected image display procedure, A correction procedure for performing serial third image to the same correction as that applied in the first image, capturing of the correction procedure image data before and after processing of the first image in its first image A correction processing information storage procedure for storing conditions and correction processing contents in the database is executed by a computer.

An image processing method according to claim 6 of the present invention is an image processing method for correcting an image captured by an imaging device, and from an image captured by the imaging device stored in advance, an image designating step for designating the first image to be processed, from a database that records the shooting conditions of the image data and the images before and after correction and correction content in the correction process executed in the past, by the image specifying step A similar image extraction step of extracting a plurality of second images similar to the designated first image, and images before and after correction processing of the extracted plurality of second images are displayed. and a selected image displaying step of prompting the user to select, on the basis of the correction processing of the third image selected from said plurality that are displayed in the selected image displaying step the second image, A correction processing step of performing the serial third image to the same correction as that applied in the first image, capturing of the correction processing and the image data before and after processing of the first image in step a first image A correction processing information storing step for storing conditions and correction processing contents in the database .

  According to the present invention, an image can be processed effectively and efficiently.

[First Embodiment]
FIG. 1 is a diagram showing a configuration of an information processing system to which the information processing method according to the first embodiment of the present invention is applied.

  The information processing system includes an information processing apparatus 1, a digital camera 2, and a communication line 3 that connects them. Here, the information processing apparatus 1 receives an image file photographed by the digital camera 2 via the communication line 3 and performs a required process on the image.

  The information processing apparatus 1 includes an input / output interface 10, a processing unit 11, an image memory 12, an image management DB 13, a clock unit 16, a display unit 17, and an operation input unit 18.

  The input / output interface 10 is an interface for exchanging various information with the digital camera 2. The processing unit 11 performs image processing and comprehensively controls the information processing apparatus 1 based on the information processing method according to the first embodiment of the present invention. The image memory 12 stores the image file received from the camera 2. The image management DB 13 stores various management information related to images stored in the image memory 12 and a history of image processing performed in the past. The clock unit 16 measures the time of the information processing apparatus 1. The display unit 17 displays information stored in the information processing apparatus 1. The operation input unit 18 receives an operation instruction input from the user and outputs it to the processing unit 11.

  The digital camera 2 includes an input / output interface 20, an imaging unit 21, a controller 22, an image memory 23, an imaging condition detection unit 24, a clock unit 25, a display unit 26, and an operation input unit 27.

  The input / output interface 20 is an interface for exchanging various types of information with the information processing apparatus 1. The imaging unit 21 acquires a light image of the subject and converts it into image data. The controller 22 creates an image file from the image data and comprehensively controls the digital camera 2. The image memory 23 stores the image file processed by the controller 22. The imaging condition detection unit 24 detects imaging conditions (aperture value, shutter speed, etc.) when the digital camera 2 executes imaging, and passes them to the controller 22. The clock unit 25 measures the time of the digital camera 2. The display unit 26 displays images and shooting information stored in the digital camera 2. The operation input unit 27 receives an operation instruction input from the user and outputs it to the controller 22.

  The communication line 3 is a path widely used for transmitting and receiving information, and is not limited to communication using a wire such as a conductive wire or an optical fiber, but also includes wireless communication using light, sound waves, radio waves, and the like.

  In the image processing method according to the present invention, the user inputs an operation instruction for processing an image based on the image processing display screen displayed on the display unit 17 of the information processing apparatus 1.

  FIG. 2 is a diagram showing the configuration of the image processing display screen.

  The image processing display screen includes a toolbar area 31 for instructing an image processing operation, an image selection area 32 for displaying a thumbnail image of the processing target image, and an image display for enlarging and displaying a specified image among the thumbnail images. An area 33 and an adjustment area 34 for displaying an adjustment operation function for correcting an image are configured.

  The toolbar area 31 is provided with an image storage button 36, and the adjustment area 34 is provided with an automatic correction button 38 for automatically executing correction.

  FIG. 3 is a schematic flowchart showing an image processing procedure. An image processing method according to the first embodiment will be described with reference to FIGS.

  An image photographed by the digital camera 2 is read into the information processing apparatus 1 via the input / output interface 10 and stored in the image memory 12. When the user performs an image processing start operation (not shown), thumbnail images of a plurality of designated image files are displayed in the image selection area 32 of the image processing display screen.

  When the user clicks a thumbnail image displayed in the image selection area 32 with the mouse pointer, the processing unit 11 selects an image stored in the image memory 12 (S01), and displays an enlarged image of the thumbnail image as an image. Display in area 33.

  Next, when the user operates the automatic correction button 38 from the image processing display screen, the processing unit 11 detects that the image correction is instructed (S02), and calculates the brightness and color distribution for the selected image. (S03).

  FIG. 4 is a schematic flowchart showing a procedure for calculating the brightness and color distribution of the selected image.

  First, a reduced image inscribed in a frame of a predetermined size is generated from the selected image (T01), and the RGB value of each pixel is converted into lightness and two-component chromaticity for the reduced image (T02). Here, the conversion formulas for brightness (Y) and chromaticity (I, Q) are expressed by equations (1) to (3).

Y = 0.299R + 0.587G + 0.114B (1)
I = 0.596R−0.274G−0.322B (2)
Q = 0.221R−0.522G + 0.311B (3)
Then, a histogram in which the number of populations is normalized for each of the above-described lightness and two-component chromaticity obtained for each pixel is created (T03), and the brightness and color distribution of the selected image is calculated. Exit.

  Returning to FIG. 3, the processing unit 11 extracts past image processing information having a distribution similar to the brightness and color distribution of the selected image based on the created histogram (S04).

  FIG. 5 is a schematic flowchart showing a procedure for extracting image processing information.

  The processing unit 11 calculates an average value and a variance value for each distribution from each histogram of the calculated reduced image (T06).

  On the other hand, the processing unit 11 is photographed with the same camera, lens and strobe as the one that photographed the selected image from the history of image processing information stored in the image management DB 13, and the white balance, aperture, and shutter speed are the same. Close ones are selected (T07).

  By using the same camera, lens, and strobe as the selection conditions, it is possible to eliminate the influence of the individual differences of the digital camera 2 on the correction process. The reason why the white balance, the aperture, and the shutter speed are close to each other is used as the selection condition because the main subject, the background, and the like are similar and the photographing conditions are similar.

  Whether or not they are similar is determined by comparing whether or not the white balance, aperture, and shutter speed of the selected image and the image to be selected are approximate. This determination algorithm can use various methods. For example, when a function obtained by linearly combining values obtained by squaring differences in white balance, aperture, and shutter speed between a selected image and an image to be selected is used as an evaluation index, and the function value is smaller than a predetermined threshold value It can also be determined that both images are similar.

  In addition to white balance, aperture, and shutter speed, the shooting location (for example, GPS information), shooting time, strobe ON / OFF, distance to the subject, zoom magnification, etc. are adopted as parameters that can determine the similarity of shooting conditions. You can also.

  Next, the lightness distribution, the average value of the chromaticity distribution, and the variance value of the images thus selected are images that are close to the average value and the dispersion value of the lightness distribution, the chromaticity distribution of the processing target image obtained in step T06. A predetermined number of processing information is extracted (T08). And the process which extracts the past image processing information is complete | finished.

  Returning to FIG. 3, the processing unit 11 performs a process of determining whether or not to perform automatic correction on the selected image (S <b> 05).

  FIG. 6 is a schematic flowchart showing a procedure for determining whether or not to perform automatic correction.

  From the extracted past image processing information, the processing unit 11 performs image processing in which the lightness and chromaticity histogram pattern of the image before the processing is closest to the lightness and chromaticity histogram pattern of the current processing target image. Is selected (T10).

  Next, for each histogram of brightness and chromaticity of the selected past image processing target image and the current processing target image, the absolute value of the difference is calculated for each value category, and the value is added for the entire category. The similarity is calculated (T11). If the similarity calculated for each of the lightness and chromaticity is equal to or less than the reference value, both images are regarded as being similar and automatic processing can be performed (T12). The procedure for determining whether or not to execute is terminated.

  Note that the similarity in step T11 may be calculated by a method other than the method described above. For example, it may be determined whether or not the histogram patterns are similar by various methods developed by pattern recognition.

  Returning to FIG. 3, when it is determined in step S05 that automatic processing can be performed, the processing unit 11 performs brightness or color correction processing similar to the extracted past image processing on the selected image (S06). . Then, the color-corrected image is displayed in the image display area 33 shown in FIG. 2, and the process proceeds to step S07.

  If it is determined in step S05 that automatic processing cannot be performed, the process proceeds to step S07 without performing step S06.

  In step S07, the processing unit 11 displays a controller for manually adjusting brightness and color on the image processing display screen (S07). On the image processing display screen of FIG. 7, a brightness adjustment slider 40, a contrast adjustment slider 41, and red, green, and blue color adjustment sliders 42 are displayed as manual adjustment controllers.

  When the user operates these manual adjustment controllers, the processing unit 11 that has detected the adjustment operation performs brightness or color adjustment corresponding to the detected operation on the selected image (S10, S11). The adjustment result is reflected in the image in the image display area 33. The user can obtain a desired image by repeating this brightness or color adjustment operation.

  When the user views the image in the image display area 33 and determines that a desired image has been obtained, the user operates the save button 36 in the tool bar area 31. When an instruction to save the selected image is detected (S15), the processing unit 11 checks whether any correction such as automatic correction or manual correction has been performed (S16).

  If no correction has been made (No in S16), the process ends because there is no image to be saved. On the other hand, if any correction is made (S16 Yes), the image correction information is recorded (S17).

  FIG. 8 is a schematic flowchart showing a procedure for recording the image correction information in step S17. The processing unit 11 generates an image obtained by reducing the corrected image so as to be inscribed in a frame of a predetermined size (T15), and records the image correction information in the image management DB 13 (T16). By recording the image correction information in the image management DB, this information can be referred to as correction history information.

  Here, as the image correction information to be recorded, the reduced image of the processed image, the processing date, the shooting information of the processing target image, the normalized histogram of the brightness and chromaticity of the processing target image, the processing target image This is the contents of the average value and variance value of lightness and chromaticity, and brightness and color correction processing.

  Next, the selected image is stored in the image memory 12 (S18), and this image processing is terminated.

  On the other hand, when the user does not correct the image, the user operates the cancel button 37 in the toolbar area 31. When it is detected that the cancel button 37 has been operated (S19), the processing unit 11 ends the process on the assumption that the image correction process has been canceled.

  According to the first embodiment, it is possible to automatically correct an image based on a correction processing result for a similar image taken in the past, and therefore it is possible to efficiently perform the correction work. In addition, since correction can be performed without being influenced by individual differences of digital cameras, correction can be performed effectively.

[Second Embodiment]
Next, an image processing method according to the second embodiment of the present invention will be described. The image processing method of the second embodiment has the same configuration as the information processing system shown in FIG. 1, but the image processing method selection procedure shown in steps S05 to S06 in FIG. 3 and the image processing display shown in FIG. Only the screen configuration is different. Accordingly, the same parts as those in the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  FIG. 9 is a schematic flowchart showing an image processing procedure according to the image processing method of the second embodiment.

  Steps S21 to S24 are the same as steps S01 to S04 shown in FIG.

  In step S24, after extracting a predetermined number of image processing information close to the average value and variance value of the brightness distribution and chromaticity distribution of the processing target image from the image processing history stored in the image management DB 13, in FIG. 11 selects which of the extracted image processing information to use, and performs the same processing as the selected image processing (S25).

  FIG. 10 is a schematic flowchart showing a procedure for performing image processing by selecting which image processing information is adopted.

  The processing unit 11 displays the pre-processing image and the post-processing image as a set from the extracted past image processing information on the image processing display screen (T21).

  FIG. 11 is a diagram illustrating an image processing display screen that displays a pre-processing image and a post-processing image as one set. An image processing history display area 35 is newly provided on the image processing display screen, and a plurality of sets are displayed with the pre-processing image, the post-processing image and the image processing selection button 44 as one set in the area. Yes.

  The user can select the optimum image processing by viewing the images before and after the processing.

  If it is determined that there is no appropriate image processing and correction based on the past history is not performed, the manual processing button 37 in the toolbar area 31 is operated. The processing unit 11 that has detected that the manual processing button has been pressed ends the selection of the image processing (T22). That is, in the subsequent processing, automatic correction processing is not performed (manual correction processing is executed).

  When the optimum image processing has been identified, the user operates the corresponding set of image processing selection buttons 44. The processing unit 11 that has detected that the image processing selection button 44 has been pressed identifies the selected image processing (T23, T24), and the processing unit 11 has the same brightness or brightness as the selected past image processing. Color correction processing is performed on the image to be processed (T25). Then, the color-corrected image is displayed in the image display area 33 of the image processing display screen shown in FIG. 2, and the process proceeds to step S26.

  Steps S26 to S39 are the same as steps S07 to S19 shown in FIG.

  According to the second embodiment described above, in addition to the effects of the first embodiment, the image before and after the image processing performed in the past is displayed, and the user can visually check the optimum image. Since processing can be selected, correction with higher accuracy can be performed.

[Third Embodiment]
Next, an image processing method according to the third embodiment of the present invention will be described. In the image processing method of the third embodiment, the configuration of the information processing system is the same as that of the second embodiment, but only the selection of the image processing method and the execution procedure of the processing shown in step S25 of FIG. 9 are different. Yes. Accordingly, the same parts as those of the second embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  FIG. 12 is a schematic flowchart showing a procedure for performing image processing by selecting which image processing to employ, which is shown in Step S25 of FIG.

  The processing unit 11 applies the extracted past image processing to the reduced image of the processing target image (T31). Then, the reduced image of the processing target image and the reduced image after processing are displayed as a set on the image processing display screen (T32). This image processing display screen is the same as the screen shown in FIG. 11 except that the displayed image is a reduced image of the processing target image. The user can select the optimum image processing by viewing the images before and after the processing.

  If it is determined that there is no appropriate image processing and correction based on the past history is not performed, the manual processing button 37 in the toolbar area 31 is operated. The processing unit 11 that has detected that the manual processing button has been pressed ends the selection of the image processing (T33). That is, in the subsequent processing, automatic correction processing is not performed (manual correction processing is executed).

  When the optimum image processing has been identified, the user operates the corresponding set of image processing selection buttons 44. The processing unit 11 that has detected that the image processing selection button 44 has been pressed identifies the selected image processing (T34, T35), and performs the same brightness or color correction processing as the selected past image processing. This is performed on the image to be processed (T36).

  According to the third embodiment described above, in addition to the effects of the first embodiment, an image obtained as a result of applying image processing performed in the past to the current reduced image is displayed. The user can select the optimum image processing by visual observation, and can perform correction with higher accuracy.

  Each function described in the above embodiment may be configured using hardware, or may be realized by reading a program describing each function into a computer using software. Each function may be configured by appropriately selecting either software or hardware.

  Furthermore, each function can be realized by causing a computer to read a program stored in a recording medium (not shown). Here, as long as the recording medium in the present embodiment can record a program and can be read by a computer, the recording format may be any form.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

The figure which shows the structure of the information processing system to which the information processing method of 1st Embodiment concerning this invention is applied. The figure which shows the structure of an image processing display screen. FIG. 3 is a schematic flowchart showing an image processing procedure. FIG. 5 is a schematic flowchart showing a procedure for calculating brightness and color distribution of a selected image. FIG. 5 is a schematic flowchart showing a procedure for extracting an image processing history. FIG. 5 is a schematic flowchart showing a procedure for determining whether to perform automatic correction. The figure which shows an image processing display screen. FIG. 5 is a schematic flowchart showing a procedure for recording image correction information. FIG. 9 is a schematic flowchart showing an image processing procedure according to an image processing method of a second embodiment. FIG. 5 is a schematic flowchart showing a procedure for selecting which image processing to adopt. The figure which shows the image processing display screen which displays the image before a process, and the image after a process as 1 set. FIG. 5 is a schematic flowchart showing a procedure for selecting which image processing to adopt.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Information processing apparatus, 2 ... Digital camera, 3 ... Communication camera, 10 ... Input / output interface, 11 ... Processing part, 12 ... Image memory, 13 ... Image management DB, 17 ... Display part, 18 ... Operation input part, 21 DESCRIPTION OF SYMBOLS ... Image pick-up part, 22 ... Controller, 23 ... Image memory, 24 ... Imaging condition detection part, 31 ... Tool bar area, 32 ... Image selection area, 33 ... Image display area, 34 ... Adjustment area, 40 ... Brightness adjustment slider, 41 ... contrast adjustment slider, 42 ... color adjustment slider, 44 ... image processing selection button.

Claims (6)

An image processing program for correcting an image captured by an imaging device,
An image designating procedure for designating a first image to be processed from an image photographed by the imaging device stored in advance;
A plurality of second images similar to the first image designated by the image designating means from a database recording image data before and after correction in the correction processing executed in the past, photographing conditions of the image, and correction processing contents. A similar image extraction procedure for extracting images of
A selection image display procedure for displaying images before and after the correction processing of the plurality of extracted second images and urging the user to select one of them;
Based on the correction processing content of the third image selected from the plurality of second images displayed in the selected image display procedure, the same correction as that applied to the third image is performed. Correction processing procedure to be applied to the image,
A correction processing information storage procedure for storing the image data before and after the processing of the first image in the correction processing procedure, the shooting condition and the correction processing content of the first image, in the database;
A program that causes a computer to execute. In the similar image extraction procedure, an image having at least brightness or tone distribution similar to the brightness or tone distribution of the first image is selected from the images recorded in the database. The image selection procedure to select as
The program according to claim 1, wherein the correction processing content includes content for correcting at least one of brightness and color tone of the image. The similar image extraction procedure includes:
A shooting condition selection procedure for selecting an image whose shooting conditions are the same as or similar to those of the first image from uncorrected images recorded in the database;
An image selection procedure for selecting, as the second image, an image whose brightness or tone distribution is similar to the brightness or tone distribution of the first image from the selected images. ,
Wherein in the imaging condition selection procedure, a program according to claim 1, camera, lens and flash is characterized in that a condition of the sorting to be identical.   The program according to claim 1, further comprising a manual correction procedure that enables a user to correct brightness or color tone of the second image that has been corrected by the correction processing procedure. . A recording medium storing an image processing program for correcting an image captured by an imaging device,
An image designating procedure for designating a first image to be processed from an image photographed by the imaging device stored in advance;
A plurality of second images similar to the first image specified in the image specifying procedure are obtained from a database in which image data before and after correction in the correction processing executed in the past, photographing conditions of the image, and correction processing contents are recorded. A similar image extraction procedure for extracting images of
A selection image display procedure for displaying images before and after the correction processing of the plurality of extracted second images and urging the user to select one of them;
Based on the correction processing content of the third image selected from the plurality of second images displayed in the selected image display procedure, the same correction as that applied to the third image is performed. Correction processing procedure to be applied to the image,
A correction processing information storage procedure for storing the image data before and after the processing of the first image in the correction processing procedure, the shooting condition and the correction processing content of the first image, in the database;
A recording medium storing a program for causing a computer to execute. An image processing method for correcting an image captured by an imaging device,
An image designating step for designating a first image to be processed from an image photographed by the imaging device stored in advance;
A plurality of second images similar to the first image specified in the image specifying step are retrieved from a database in which image data before and after correction in the correction processing executed in the past, photographing conditions of the image, and correction processing contents are recorded. A similar image extraction step for extracting the image of
A selection image display step for displaying the images before and after the correction processing of the plurality of extracted second images and urging the user to select one of the images;
Based on the correction processing content of the third image selected from the plurality of second images displayed in the selected image display step, the same correction as that applied to the third image is performed. Correction processing steps to be applied to the image,
A correction processing information storage step for storing in the database the image data before and after the processing of the first image in the correction processing step, and the shooting conditions and correction processing content of the first image;
An image processing method comprising:

Images