JP5436029B2 - Image processing apparatus and image processing method - Google Patents

Description

  The present invention relates to an image processing device, an image processing method, a program, and a storage medium, and more particularly to a technique suitable for performing image processing on a plurality of images.

  With the widespread use of digital video cameras, a technique for easily correcting and storing moving images shot by oneself by image processing has been required. For example, Patent Document 1 proposes an image processing apparatus that can easily make adjustments that are difficult for beginners, such as adjustment of a color cast image, as related to image correction.

JP 2001-16469 A

  In the conventional image adjustment method, individual images are analyzed, and the adjustment is advanced while the user confirms the results one by one. Further, as the recording memory of the digital camera increases, the number of image data to be recorded also increases. For example, it is conceivable that many images are dubbed at one time. Therefore, since it is necessary to finely adjust each image as described above, it is necessary to check what correction is applied to a large number of images and change the image processing settings of each image. Sometimes. In such a case, since the work increases, there is a problem that the usability is not good.

  An object of the present invention is to make it easy for a user to perform an operation when performing image processing on a plurality of images.

The image processing apparatus of the present invention includes a plurality of image data and a recording medium on which image correction information for performing image processing corresponding to each of the plurality of image data is recorded in association with each of the plurality of image data. Reproduction means for reproducing the image correction information, and a display unit for displaying a list of a plurality of image data recorded on the recording medium and displaying the image correction information reproduced by the reproduction means in association with the list Display means for displaying the image data, selection means for selecting image data from the list in response to a user operation, and image processing based on the image correction information for the image data selected by the selection means And setting means for setting in advance on the display section whether or not to validate .

  According to the present invention, when image processing is performed on a plurality of image data, it is possible to confirm in a list which image processing is applicable to which image. Thus, the user can easily set whether to apply image processing applicable to each image.

It is a block diagram which shows the structural example of the video camera which concerns on embodiment of this invention. It is a figure which shows an example of the selection screen of a dubbing system. It is a figure which shows an example of the manual setting screen of clean dubbing-manual. It is a figure which shows an example of the setting screen at the time of selecting one of the thumbnail images. It is a figure which shows an example of the setting screen at the time of selecting the icon of other image processing. It is a flowchart which shows an example of the process sequence until it performs a dubbing process. It is a flowchart which shows an example of the setting process sequence of an image process. It is a flowchart which shows an example of the application procedure of an image process. It is a figure which shows an example of the selection screen of a sort process. It is a figure which shows the list of the thumbnail images arranged in order of image processing. It is a figure which shows an example of the screen of the state in which the some image is selected. It is a figure which shows an example of the screen which selects whether collective correction is performed. It is a flowchart which shows an example of the procedure which sets image processing.

(First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram illustrating a configuration example of a video camera 100 according to the present embodiment.
In FIG. 1, a camera unit 101 is for capturing an image, and a system control unit 102 is for controlling the overall operation. The image processing unit 103 performs image processing to be described later on the image data captured by the camera unit 101 and writes it on the SDRAM 104. The SDRAM 104 is for temporarily storing image data that has been subjected to image processing by the image processing unit 103, image data read from the HDD 110 that is a recording medium by the HDD IF unit 108, and the like.

  The external interface (IF) 105 is for exchanging information with an external device. The compression / decompression unit 106 reads image data from the SDRAM 104, performs encoding or decoding, and rewrites the data in the SDRAM 104. The display IF unit 107 reads out image data from the SDRAM 104 and outputs the image to the display unit 109, or superimposes GUI (Graphical User Interface) information associated with the image or operation.

  The hard disk drive (HDD) 110 stores image data, image correction information accompanying the image data, and thumbnail image data as representative image data for list display. Here, the image correction information is information generated by analyzing an image photographed by the camera unit 101 by the image processing unit 103 and is information relating to applicable image processing. The image correction information is recorded in association with the image data. The HDD IF unit 108 is for writing or reading image data, image correction information, and the like to and from the HDD 110. The UI unit 111 is used by the user to perform various operations. In addition, a 1394 connection terminal (not shown), a USB terminal, and other various communication means for performing communication with the outside are provided.

FIG. 2 is a diagram showing an example of a dubbing method selection screen displayed when dubbing (duplicating) image data recorded on the HDD 110.
As shown in FIG. 2, “clean dubbing-auto”, “clean dubbing-manual”, and “normal dubbing” are displayed as selection items. The beautiful dubbing-auto is a method of dubbing by applying all the image correction information added to the image data to be dubbed. On the other hand, “clean dubbing-manual” is a dubbing method that sets whether to apply individual image correction information attached to individual image data one by one and then performs corrections that reflect the user's settings. It is a method to do. Normal dubbing is a method of dubbing recorded image data as it is.

FIG. 3 is a diagram illustrating an example of a manual setting screen displayed when “clean dubbing-manual” is selected.
As shown in FIG. 3, on the setting screen, thumbnail images of recorded image data are displayed as a list, and icons indicating the recording date and time of each image and correctable effects are added.

  In the present embodiment, thumbnail image data generated based on the image correction information attached to the image data is recorded in the HDD 110. For example, in the image correction information, when the applicable image processing is “skin beautification”, a screen having the largest effect of the image processing “skin beautification” among the image data is recorded as thumbnail image data. In addition, when there are a plurality of applicable image processes, thumbnail image data for that amount is recorded in the HDD 110.

  In the example shown in FIG. 3, six images are displayed on one screen, but the number of images can be further increased or decreased depending on the resolution of the screen display. Since the number of sheets displayed on one screen is limited, icons 301 indicating page feed are displayed on the left and right of the screen, and the screen can be switched back and forth. In the upper right of the screen, the total number of images and the number of the currently selected image are displayed. In addition, a “start dubbing” icon 302, a “list sort” icon 303, and a “return” icon 304 are displayed at the bottom of the screen.

  When the “start dubbing” icon 302 is selected, the dubbing process to which the image process that has been applied at that time is applied is started. When the “list sort” icon 303 is selected, the image display order can be changed. Furthermore, when the “return” icon 304 is selected, the dubbing method selection screen shown in FIG. 2 can be returned to. Assume that all the image processes are set to the “correct” state when the screen shown in FIG. 3 is displayed.

  As shown in FIG. 3, an image processing icon 305 is displayed below the thumbnail image, indicating the type of image processing that can be applied to the image data corresponding to the thumbnail image. Also, as shown in FIG. 3, since there is no image processing that can be applied or there is no image processing information, the thumbnail image 306 in which no image processing icon is displayed has a smaller display size than other thumbnail images. In addition, the display brightness is further reduced. Thus, it is easy to distinguish depending on whether or not image processing is applicable. Note that the display color may be changed instead of reducing the display brightness, and further, a message that there is no image processing information may be displayed.

FIG. 4 is a diagram illustrating an example of a setting screen when one of the displayed thumbnail images is selected.
As shown in FIG. 4, a thumbnail image, a date and time, and an image processing icon are surrounded by a large frame 401, and the currently selected image is emphasized. Further, in the example shown in FIG. 4, a thumbnail image having the largest effect of the currently selected image processing “skin beautification” is displayed.

  When there are a plurality of image processing icons, the icon displayed on the leftmost side at the time of switching to the setting screen shown in FIG. 4 is selected. In addition, the content of the selected icon, guide information at the time of shooting, and the like are displayed at the bottom of the screen. Further, a “correct” icon 402 for selecting whether to apply this image processing and “not correct” "403" is displayed. Here, when the user confirms the contents and selects the “do not correct” icon 403, the screen shifts to the screen shown in FIG.

FIG. 5 is a diagram illustrating an example of a setting screen when the second image processing icon added to the image data is selected.
In FIG. 5, the image processing “skin beautify” icon for which the setting has been completed is displayed in gray because it is set that the image processing is not applied. Note that the accompanying information of the icon and the display of the icon for selecting whether to apply the image processing are the same as in the example shown in FIG. In addition, the thumbnail image displayed in the example shown in FIG. 5 is an image having the greatest effect of the currently selected image processing “camera shake”, and the thumbnail image is also switched according to the switching of the image processing. Yes.

  When the user selects application or non-application of the second image processing “camera shake” on the setting screen shown in FIG. 5, the screen returns to the screen shown in FIG. Can update other image settings.

FIG. 6 is a flowchart illustrating an example of a processing procedure from when the screen illustrated in FIG. 2 is displayed until dubbing processing is performed. Each process illustrated in FIG. 6 is performed based on the control of the system control unit 102.
When the screen shown in FIG. 2 is displayed on the display unit 109, the process starts in step S601. In step S602, the process waits until the user selects a dubbing method via the UI unit 111.

  When the dubbing method is selected in step S602, it is determined in step S603 whether or not the selected method is manual (clean dubbing-manual). As a result of this determination, if the selected method is not manual, the process proceeds to step S605. In step S605, the process waits until an image is selected and a dubbing start instruction is received. When an instruction to start dubbing is received, the process proceeds to step S606. On the other hand, if the result of determination in step S603 is that the selected method is manual, the process proceeds to step S604, where image processing is set for the image to be dubbed. By shifting to this processing, it is possible to set the image processing of each image by the user while confirming the setting state on the GUI screen shown in FIGS.

  Next, in step S606, a dubbing process is performed. Specifically, the HDD IF unit 108 reads out image data corresponding to the selected thumbnail image from the HDD 110 and writes it in the SDRAM 104. Then, the image processing unit 103 corrects the image in accordance with the set image processing conditions, and writes it in the SDRAM 104. Then, the corrected image data is recorded on the HDD 110 by the HDD IF unit 108. That is, this dubbing process is a dubbing process in which image processing is performed by reflecting image correction information associated with each image. When normal dubbing is selected on the selection screen in FIG. 2, the image data is copied and recorded in the HDD 110 without correction by the image processing unit 103. In step S607, the dubbing process is terminated.

FIG. 7 is a flowchart illustrating an example of a setting processing procedure for image processing in an image to be dubbed in step S604 of FIG. Each process illustrated in FIG. 7 is performed based on the control of the system control unit 102.
When the process proceeds to step S604 in FIG. 6, the process starts in step S701. In step S702, an image to be displayed as a list of thumbnail images is determined. In this process, for example, when a user selects a folder recorded in the HDD 110 or receives a page switching instruction, an image to be displayed is determined.

  In step S703, the HDD IF unit 108 reads thumbnail image data to be displayed from the HDD 110, and the display IF unit 107 causes the display unit 109 to display a list of the thumbnail images. At this time, for a plurality of images that can be processed, the thumbnail image data corresponding to the image processing icon displayed on the leftmost side is read out. For example, the thumbnail image shown in FIG. 4 is displayed.

  In step S <b> 704, the HDD IF unit 108 reproduces and reads out the image correction information associated with the image data on which the thumbnail image is displayed from the HDD 110. In step S705, based on the read image correction information, the display IF unit 107 displays an image processing icon accompanying the thumbnail image as shown in FIG.

  Next, in step S706, it is determined whether or not page switching or sort switching is selected via the UI unit 111. Here, it is determined whether or not the icon 301 indicating page feed or the “list sort” icon 303 shown in FIG. 3 has been selected. If page switching is selected as a result of this determination, the process returns to step S702 to switch thumbnail images to be displayed as a list. On the other hand, as a result of the determination in step S706, if sort switching is selected, the image display order is changed in step S711, and the process returns to step S702.

  On the other hand, as a result of the determination in step S706, if neither page switching nor sorting switching is selected, it is determined in step S707 whether or not dubbing start is selected via the UI unit 111. If the dubbing start is selected as a result of this determination, the process ends in step S710 in order to shift to the dubbing process. On the other hand, if dubbing start is not selected as a result of the determination in step S707, it is determined in step S708 whether one of the thumbnail images is selected via the UI unit 111. If a thumbnail image is selected as a result of this determination, in step S709, a setting process for determining whether to apply image processing is performed, and the process returns to step S706. In this way, it is possible to set whether or not to apply individual image processing associated with an image. If no thumbnail image is selected as a result of the determination in step S708, the process returns to step S706.

FIG. 8 is a flowchart illustrating an example of an application procedure of image processing in step S709 when a thumbnail image is selected. Each process shown in FIG. 8 is performed based on the control of the system control unit 102.
When a thumbnail image is selected, processing starts in step S801. In step S <b> 802, the HDD IF unit 108 reads image correction information attached to the selected image data from the HDD 110. In step S803, the display IF unit 107 displays the accompanying information of the selected image processing based on the read image correction information. In the example shown in FIG. 4, the skin beautifying effect and one-point advice at the time of photographing are displayed.

  Next, in step S804, the display IF unit 107 performs GUI display for selecting whether or not to perform correction, as shown in FIG. In step S805, it is determined whether an icon that performs correction or an icon that does not perform correction has been selected via the UI unit 111. If the result of this determination is that no icon has been selected, the display returns to step S804 in order to update the display of the correction instruction icon or the like.

  On the other hand, if any icon is selected as a result of the determination in step S805, it is determined in step S806 whether or not the setting has been completed for all the image processes associated with the currently selected image data. If all the image processing settings have been completed as a result of this determination, the entire processing is terminated in step S808. On the other hand, as a result of the determination in step S806, if all the image processing settings have not been completed, in step S807, as shown in FIG. Move to processing. Then, the process returns to step S803.

FIG. 9 is a diagram illustrating an example of a selection screen for the sorting process selected in step S711 in FIG.
As shown in FIG. 9, when switching the sort, it is possible to select whether the order of the image list is the date order or the image processing. When arranged in the order of date and time, a list of thumbnail images as shown in FIG. 3 is obtained. However, when classified by image processing, the list is configured in the order of image processing as shown in FIG. When the same image processing is attached to a plurality of images, the image processing is configured in descending order.

  As described above, according to the present embodiment, thumbnail images of a plurality of image data recorded in the HDD 110 are displayed, and an icon indicating image processing applicable to the image data is displayed as image processing information. . Thereby, when performing dubbing, it is possible to confirm in a list which image processing is applicable to which image. Furthermore, it is possible to easily set whether or not to apply image processing applicable to individual images.

(Second Embodiment)
Hereinafter, a second embodiment of the present invention will be described. Since the configuration of the video camera according to this embodiment is the same as that of the first embodiment, description thereof is omitted. A difference is that a plurality of images can be selected from a plurality of thumbnail images displayed in a list by the UI unit 111. Also, the image processing setting method for a single image is the same as that in the first embodiment, and a description thereof will be omitted.

FIG. 11 is a diagram illustrating an example of a screen in a state where a plurality of images are selected from the thumbnail images displayed as a list. FIG. 12 is a diagram illustrating an example of a screen for selecting whether or not to perform batch correction when a plurality of images are selected.
As shown in FIG. 11, when a plurality of images are selected, as shown in FIG. 12, a screen for setting image processing for the selected plurality of images is displayed. This makes it possible to set image processing efficiently.

  FIG. 13 is a flowchart illustrating an example of a procedure for determining whether a selected image is one or a plurality of images and setting image processing corresponding to each image. In the video camera 100 of the present embodiment, since image processing for a plurality of images is set at once, step S709 in FIG. 7 is replaced with the processing shown in FIG. Each process illustrated in FIG. 13 is performed based on the control of the system control unit 102.

  When the process is started in step S1301 in FIG. 13, it is determined in step S1302 whether or not there is one image selected by the user. If the result of this determination is that there is one selected image, in step S1303, image processing is set according to the processing procedure shown in FIG. 8, and the processing ends in step S1306. On the other hand, if the result of determination in step S1302 is that there are a plurality of selected images, in step S1304, the display IF unit 107 selects a GUI for selecting whether or not to perform correction, as shown in FIG. Display. In step S1305, it is determined whether an icon for performing batch application or an icon for performing batch cancellation has been selected via the UI unit 111. If it is determined that an icon has been selected, the process ends in step S1306. On the other hand, if the result of determination in step S1305 is that an icon has not been selected, the process returns to step S1304 in order to update the display of the icon for selection and the like.

  As described above, according to the present embodiment, since a plurality of thumbnail images can be selected, it is possible to perform image processing on a plurality of image data collectively.

(Other embodiments according to the present invention)
Each means constituting the image processing apparatus and each step of the image processing method in the embodiment of the present invention described above can be realized by operating a program stored in a RAM or ROM of a computer. This program and a computer-readable storage medium storing the program are included in the present invention.

  In addition, the present invention can be implemented as, for example, a system, apparatus, method, program, storage medium, or the like. Specifically, the present invention may be applied to a system including a plurality of devices. The present invention may be applied to an apparatus composed of a single device.

  In the present invention, a software program for realizing the functions of the above-described embodiments (in the embodiment, programs corresponding to the flowcharts shown in FIGS. 6 to 8 and 13) is directly or remotely supplied to the system or apparatus. This includes cases where This includes the case where the system or the computer of the apparatus is also achieved by reading and executing the supplied program code.

  Accordingly, since the functions of the present invention are implemented by computer, the program code installed in the computer also implements the present invention. In other words, the present invention includes a computer program itself for realizing the functional processing of the present invention.

  In that case, as long as it has the function of a program, it may be in the form of object code, a program executed by an interpreter, script data supplied to the OS, and the like.

  Examples of the storage medium for supplying the program include a flexible disk, a hard disk, an optical disk, and a magneto-optical disk. Further, there are MO, CD-ROM, CD-R, CD-RW, magnetic tape, nonvolatile memory card, ROM, DVD (DVD-ROM, DVD-R) and the like.

  As another program supply method, there is a method of connecting to a homepage on the Internet using a browser of a client computer. It can also be supplied by downloading the computer program itself of the present invention or a compressed file including an automatic installation function from a homepage to a storage medium such as a hard disk.

  It can also be realized by dividing the program code constituting the program of the present invention into a plurality of files and downloading each file from a different homepage. As another method, the program of the present invention is encrypted, stored in a storage medium such as a CD-ROM, distributed to users, and encrypted from a homepage via the Internet to users who have cleared predetermined conditions. Download the key information to be solved. It is also possible to execute the encrypted program by using the key information and install the program on a computer.

  Further, the functions of the above-described embodiments are realized by the computer executing the read program. Furthermore, based on the instructions of the program, an OS or the like running on the computer performs part or all of the actual processing, and the functions of the above-described embodiments can be realized by the processing.

  As another method, a program read from a storage medium is first written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer. Then, based on the instructions of the program, the CPU or the like provided in the function expansion board or function expansion unit performs part or all of the actual processing, and the functions of the above-described embodiments are also realized by the processing.

102 System control unit, 103 Image processing unit, 107 Display I / F unit, 108 HDD I / F, 110 HDD, 111 UI unit

Claims (13)

Reproduction that reproduces the image correction information from a recording medium in which image correction information for performing image processing corresponding to each of the plurality of image data is recorded in association with each of the plurality of image data together with the plurality of image data Means,
Display means for displaying a list of a plurality of image data recorded on the recording medium, and displaying on the display section image correction information reproduced by the reproducing means in association with the list;
Selection means for selecting image data from the list according to a user operation;
Image processing comprising: setting means for setting in advance on the display section whether or not to enable image processing based on the image correction information for the image data selected by the selection means apparatus.   The image processing apparatus according to claim 1, wherein the display unit displays a list formed of representative images generated from the image data on the display unit. The representative image, the image processing apparatus according to claim 2, wherein the effect of the images processing is selected image from the most larger screen.   4. The display unit according to claim 2, wherein, when displaying a representative image generated from image data for which there is no associated image correction information, the display unit changes and displays the display size of the representative image. 5. The image processing apparatus described.   5. The display unit according to claim 2, wherein, when displaying a representative image generated from image data for which there is no associated image correction information, the display unit changes and displays the display brightness of the representative image. The image processing apparatus according to any one of the above.   5. The display unit according to claim 2, wherein, when displaying a representative image generated from image data for which there is no associated image correction information, the display unit changes and displays the color of the representative image. The image processing apparatus according to claim 1.   The display means, when displaying a representative image generated from image data for which there is no associated image correction information, is accompanied by a display indicating that the associated image correction information does not exist. The image processing apparatus according to claim 2.   The image processing apparatus according to claim 1, wherein the display unit displays the image correction information as an icon.   9. The display device according to claim 1, wherein when the image data is selected by the selection unit, the display unit displays information associated with the image correction information on the display unit. Image processing device. The display means, the image processing apparatus according to any one of claims 1-9, characterized in that the display in order large effect of images processed Te the list smell.   The image processing apparatus according to claim 1, wherein the display unit displays each image process in the list. The selection means selects a plurality of image data from the list,
The setting means can select whether or not to validate the entire image processing based on the image correction information of each of the plurality of image data for the plurality of image data selected by the selection means. The image processing apparatus according to claim 1, wherein the image processing apparatus is characterized in that: Reproduction that reproduces the image correction information from a recording medium in which image correction information for performing image processing corresponding to each of the plurality of image data is recorded in association with each of the plurality of image data together with the plurality of image data Process,
A display step of displaying a list of a plurality of image data recorded on the recording medium and displaying the image correction information reproduced in the reproduction step accompanying the list on the display unit;
A selection step of selecting image data from the list according to a user operation;
And a setting step for setting in advance on the display section whether or not to enable image processing based on the image correction information for the image data selected in the selection step. Method.

Images