JP2014036348A - Image processing system and method of controlling the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image processing system that obtains a moving picture in which a follow-up delay of development parameter adjustments is solved by correcting development parameters that changes according to changes of photographing content when photographing or reproducing a Raw moving picture.SOLUTION: The image processing system includes the processes of: obtaining Raw moving picture data; generating development parameters on the basis of the obtained Raw moving picture data; and performing correction processing for the development parameters on the basis of a changing period of frame image data included in the Raw moving picture data, change amounts of development parameters, and a changing period of the development parameters so that changes of the development parameters fit into the changing period of the frame image data.

Description

  The present invention relates to an image processing apparatus and a control method thereof.

  An image processing apparatus that performs so-called raw development processing is proposed in which a user designates various development parameters for raw still image data in which signals from an image sensor are recorded as they are, thereby obtaining a result image corresponding to the development parameters. ing.

  On the other hand, in recent years, various editing techniques for moving images have been proposed due to the popularization of digital video cameras (hereinafter referred to as cameras) and the improvement of the performance of personal computers. In view of this background, it is expected that not only still images but also moving images will be handled in the Raw format, and that cameras that can save files in the Raw format will generally become popular.

  When developing a raw moving image, it is necessary to give development parameters to each frame image constituting the moving image, as in the case of still image development processing. The development parameter is information necessary for performing processing such as white balance adjustment and exposure correction, for example.

  Here, a white balance adjustment parameter will be described as an example of one development parameter. In general, an imaging apparatus such as a video camera calculates color temperature information from a video signal obtained by an imaging element, and adjusts white balance in a screen based on the calculated color temperature information, so-called auto white balance (AWB) function. It has.

  An imaging apparatus that realizes an AEB function for preventing hunting due to a temporary change in color temperature (for example, when an object crosses the screen) has been proposed. For example, Patent Document 1 discloses an auto white balance device that suppresses a rapid and frequent gain change by using, as a WB adjustment value, the result of integrating color temperature information for several screens in the time direction.

  Further, Patent Document 2 detects a WB change point based on a WB adjustment parameter during shooting, and generates electronic mark data for WB adjustment based on time information indicating a time corresponding to the change point. An imaging apparatus that assists later editing of moving images has been proposed.

JP-A-6-351037 JP 2006-60732 A

  In shooting moving images, for example, the color temperature of the shooting target may suddenly change, as in the case of panning from indoors to outdoors. In such a case, since the time required for the integration process in the time direction as described above is taken into account in the AWB process in the camera, a certain amount of time is required until the WB adjustment value stabilizes (converges) to the final value. It will take time.

  Here, it is assumed that the WB adjustment parameter acquired at the time of shooting is stored in association with the Raw moving image and used as a development parameter when the Raw moving image is reproduced. If the development processing is performed using the WB adjustment parameters as they are, an image in which the tracking of the WB adjustment is delayed immediately after panning is not suitable for the user.

  The auto white balance device disclosed in Patent Document 1 freely changes the response speed of white balance adjustment by changing the integration time according to the exposure amount and detected color temperature information. However, with this auto white balance device, it is impossible to eliminate the follow-up delay of WB adjustment immediately after panning as described above.

  In addition, the imaging apparatus disclosed in Patent Document 2 aims to easily extract, for example, a video cut in editing work after shooting, and corrects the WB adjustment value using recorded change point information. Is not done. Accordingly, it is impossible to eliminate the follow-up delay of the WB adjustment as described above.

  Not only is the problem of delay in tracking WB adjustment during panning, but when a sudden change in development parameter occurs with changes in shooting content, a video with delayed tracking of development parameter adjustment is output. The problem is not suitable for the user. Therefore, it is necessary to correct development parameters that vary with changes in shooting contents so that development can be performed with appropriate development parameters immediately after the change in shooting contents is completed.

  The present invention provides an image processing apparatus that obtains a moving image in which a follow-up delay in adjusting development parameters is eliminated by performing development parameter correction processing that fluctuates in accordance with changes in shooting contents during shooting or playback of a Raw moving image. The purpose is to provide.

  An image processing apparatus according to an embodiment of the present invention acquires raw moving image data, generates a development parameter based on the acquired raw moving image data, and performs a correction process on the developing parameter. Correction means. The correction unit is configured to generate the frame image data for the development parameter based on a change period of frame image data included in the Raw moving image data, a change amount of the development parameter, and a change period of the development parameter. The correction processing is executed so that the change is settled during the change period.

  According to the present invention, it is possible to obtain an appropriate development parameter even immediately after a change in photographing content due to panning or the like. As a result, it is possible to provide the user with a more suitable moving image in which the development parameter tracking delay is eliminated.

1 is a diagram illustrating a configuration example of an image processing apparatus according to a first embodiment. It is a figure explaining the example of the development parameter generation processing by an imaging device. It is a figure which shows an image frame and a development parameter. It is a flowchart which shows the correction process of a development parameter. It is a figure which shows an image frame and a development parameter. FIG. 6 is a diagram illustrating a configuration example of an image processing apparatus according to a second embodiment. It is a figure explaining the example of the reproduction process of the Raw moving image by a moving image reproducing device.

Example 1
FIG. 1 is a diagram illustrating a configuration example of an image processing apparatus according to the first embodiment. The image processing apparatus according to the first embodiment is an imaging apparatus 10.

  In the present specification, moving image data acquired or recorded in the Raw format is described as Raw moving image data or Raw moving image file. That is, the raw moving image data is undeveloped moving image data. In addition, the frame image data constituting the Raw moving image data or the Raw moving image file is described as Raw image data or a Raw image frame.

  The imaging apparatus 10 includes an imaging unit 101, an A (Analog) / D (Digital) conversion unit 102, a development parameter generation unit 103, a raw moving image file generation unit 104, and a development parameter file generation unit 105. The imaging apparatus 10 also includes an operation unit 106, a control unit 107, a recording medium I / F (Interface) unit 108, a recording medium 109, a memory 110, a development parameter correction unit 111, and an image change detection unit 112.

  The imaging unit 101 has an imaging element such as a CCD or CMOS and a lens, and forms an image of incident light on the imaging element and converts it into an electrical signal. CCD is an abbreviation for Charge Coupled Device Image Sensor. CMOS is an abbreviation for Complementary Metal Oide Semiconductor. The A / D conversion unit 102 digitally converts the analog electrical signals sequentially output from the imaging unit 101 in units of frames and outputs raw image data (raw moving image data). That is, the imaging unit 101 and the A / D conversion unit 102 function as an imaging unit that captures a moving image by capturing a subject and outputs Raw moving image data corresponding to the captured moving image. The development parameter generation unit 103 acquires the raw image data output from the A / D conversion unit 102 and, based on the raw image data, sets development parameters necessary for image processing when developing the raw image data to the frame. Generate and output in units.

  The development parameter is a parameter for determining image quality after development when developing Raw moving image data which is Raw format moving image data. Development parameters include adjustment items such as white balance, color space, tone curve, and edge enhancement.

  The raw moving image file generation unit 104 generates a raw moving image file based on the raw image data in units of frames output from the A / D conversion unit 102. The generated raw moving image file is recorded on the recording medium 109 via the recording medium I / F unit 108.

  The development parameter file generation unit 105 generates a development parameter file based on the development parameters output from the development parameter generation unit 103. Various development parameters constituting the development parameter file are associated with corresponding frames of the Raw image data output from the A / D conversion unit 102. The operation unit 106 includes a shooting start button, a shooting end button, and the like, and is used by the user to perform various operation settings of the imaging apparatus 10.

  The control unit 107 controls the entire imaging apparatus 10. For example, the control unit 107 notifies the processing unit of the execution of various operations set by the user through the operation unit 106, and controls the execution order between the processing units.

  The recording medium I / F unit 108 controls writing of moving image data to the recording medium 109 or reading of moving image data and setting information recorded on the recording medium 109. The memory 110 includes, for example, a semiconductor storage element such as SDRAM. SDRAM is an abbreviation for Synchronous Dynamic Random Access Memory. The memory 110 is a storage unit that temporarily stores RAW image data output from the A / D conversion unit 102 and development parameters output from the development parameter generation unit 103.

  The development parameter correction unit 111 acquires the development parameter output from the development parameter generation unit 103. Then, the development parameter correction unit 111 performs a correction process according to a change in photographing content by panning or the like detected by the image change detection unit 112 described later on the acquired development parameter in accordance with an instruction from the control unit 107. . The image change detection unit 112 analyzes the frame unit image data output from the A / D conversion unit 102 and detects an image change caused by panning or the like. The image change detection unit 112 may perform zooming detection, exposure control detection, or face detection in addition to panning detection.

  With reference to FIG. 2 and FIG. 3, the development parameter generation processing of the first embodiment will be described. FIG. 2 is a flowchart illustrating an example of development parameter generation processing by the imaging apparatus. FIG. 3 shows image frames constituting the Raw moving image content generated by the imaging device 10 according to the flowchart shown in FIG. 2 and development parameters corresponding to each of the image frames along the time axis when the images are taken. It is a figure. A parameter n shown in FIG. 3 is a frame number of an image frame.

  In the example shown in FIG. 3, panning is performed during indoor shooting (n = N1) and switching to outdoor shooting (n = N2). In this embodiment, the development parameter to be corrected is a white balance adjustment parameter. Of course, the development parameters to which the present invention is applied are not limited to white balance adjustment parameters. The present invention can be applied to arbitrary development parameters. Note that the value of the white balance adjustment parameter in FIG. 3 indicates a value before the development parameter correction processing described later is performed.

  Hereinafter, an operation process according to the flowchart shown in FIG. 2 will be described. In the description of FIG. 2, it is assumed that the control unit 107 is executing a process when a processing unit that executes various processes is not clearly specified.

  First, the user operates the shooting start button to start shooting a moving image (step S201). Next, the control unit 107 initializes the frame number n to 0 (step S202). The frame number is identification information for uniquely identifying the frame image data included in the raw moving image data.

  Next, the control unit 107 increments the value of n by +1 (step S203). Is done. The control unit 107 sets n = 1 for the frame in which shooting is started.

  Next, the control unit 107 generates Raw image data of the nth frame via the imaging unit 101 and the A / D conversion unit 102 (step S204). Subsequently, the development parameter generation unit 103 reads the generated raw image data of the nth frame, and generates development parameters for the nth frame based on the read raw image data.

  Next, the raw moving image file generation unit 104 records the generated raw image data of the nth frame in the raw moving image file (step S206). In this example, in the raw moving image file recording process in step S206, image data is added to the file for each frame. In another embodiment, the image data may be buffered in the memory 110, and the raw moving image file generation unit 104 may add the image data in the memory 110 to the file at predetermined time intervals. .

  Next, the development parameter file generation unit 105 records the development parameters corresponding to the nth frame (step S207), and proceeds to step S208. In this example, in the development parameter recording process in step S207, the development parameter is added to the file for each frame. In another embodiment, the development parameters may be buffered in the memory 110, and the development parameter file generation unit 105 may add the development parameters in the memory 110 to the file at predetermined time intervals.

  Next, the control unit 107 determines whether or not a shooting end instruction is input by pressing the shooting end button of the user (step S208). While shooting is continued by the user (until the end of shooting is instructed), the process returns to step S203, and the series of processes described above are executed in units of frames by each processing unit. When the shooting end button is pressed by the user, the control unit 107 detects that a shooting end instruction has been input, and a series of shooting processes ends.

  FIG. 4 is a flowchart illustrating a development parameter correction process according to the first exemplary embodiment. FIG. 5 is a diagram showing development parameters after correction processing according to the flowchart of FIG. 4 along with the development parameters before correction processing along the time axis. The imaging apparatus according to the present exemplary embodiment performs a correction process on the development parameter generated according to the flowchart illustrated in FIG.

  The development parameter correction process according to the flowchart of FIG. 4 is executed in parallel with the development parameter generation process according to the flowchart of FIG. 2 after moving image shooting is started by the user. That is, when the imaging apparatus 10 starts capturing a moving image, the development parameters are generated according to the flowchart of FIG. 2, and the development parameters are corrected as needed during the imaging according to the flowchart of FIG.

  In step S401 in FIG. 4, the control unit 107 initializes the frame number n (n = 0) (step S401). Subsequently, the control unit 107 increments the value of n by +1 (step S402). Immediately after shooting is started, n = 1 is set.

  Next, in accordance with an instruction from the control unit 107, the image change detection unit 112 determines whether the shooting content has changed in the nth frame (step S403). In this example, the image change detection unit 112 determines whether panning is detected in the nth frame. For example, the image change detection unit 112 detects panning by a conventional technique such as detecting a motion vector from an image signal and detecting a period in which the motion vector is continuous in a certain direction as a panning scene. In this embodiment, panning is detected, but zooming detection, exposure control detection, image change detection is performed by face detection, and it is determined that the photographing content has changed when the image change is detected, It can also be used as a trigger for correction processing to be described later.

  If panning is not detected by the determination processing in step S403, the process proceeds to step S410, and the control unit 107 determines whether or not the shooting end button has been pressed by the user. While shooting is continued by the user (until the end of shooting is instructed), the process returns to step S402, and the processes after step S402 are repeated.

  If panning is detected by the determination process in step S403, the process proceeds to step S404. Steps S404 to S408 are steps in which the control unit 107 determines whether or not the development parameter value has changed by a predetermined threshold value within a predetermined period after the panning is detected and the change has converged.

  First, the control unit 107 determines whether the parameter change scanning period (L) has elapsed (step S404). The parameter change scanning period (L) is a temporal search range for determining the change in the development parameter value and its convergence. The control unit 107 sets the parameter change scanning period (L) in advance according to the setting operation by the user before the start of imaging.

  For example, when the parameter change scanning period (L) is set to 200 frames, a frame that is a target of processing from steps S405 to S409 is from 200 frames after panning is detected in step S403. In the parameter change scanning period (L), in addition to specifying a value in units of frames as described above, a value in units of time (for example, 5 seconds) can be specified.

  In the determination process of step S404, when the control unit 107 determines that the parameter change scanning period (L) has elapsed, the process proceeds to step S410, and while the shooting is continued, the processes after step S402 are performed. Repeated.

  In the determination process of step S404, when the control unit 107 determines that the parameter change scanning period (L) has not elapsed, the process proceeds to step S405.

  Next, the control unit 107 determines whether the WB adjustment parameter of the nth frame has changed by a predetermined threshold (VGAP) or more compared to the WB adjustment parameter of the frame in which panning is detected (step S404). The control unit 107 sets VGAP in advance according to the user's setting operation before starting shooting. The control unit 107 sets, for example, 1000K (Kelvin) as VGAP.

  When the control unit 107 determines that the WB adjustment parameter of the nth frame has not changed more than VGAP compared to the WB adjustment parameter of the frame in which panning is detected, the process proceeds to step S407.

  If the control unit 107 determines that the WB adjustment parameter of the nth frame has changed by VGAP or more compared to the WB adjustment parameter of the frame in which panning is detected, the process proceeds to step S406.

  In step S406, the control unit 107 determines whether or not the change in the WB adjustment parameter has converged (step S406). For example, the control unit 107 determines whether the change in the WB adjustment parameter has converged based on whether or not the value of the WB adjustment parameter has changed by 1% or more of VGAP over 20 frames. Arbitrary values can be applied as the number of frames and the change rate of VGAP serving as the determination criteria.

  In the determination process of step S406, when the control unit 107 determines that the change in the WB adjustment parameter has converged, the process proceeds to step S409. If the control unit 107 determines that the change in the WB adjustment parameter has not converged, the process proceeds to step S407.

  In step S407, the control unit 107 determines whether an instruction to interrupt shooting has been issued. If an instruction to interrupt shooting is given, the process ends. If the shooting interruption instruction has not been given, the process proceeds to step S408.

  In step S408, the control unit 107 increments the value of n by +1 (step S408), and proceeds to step S404.

  In the determination process of step S406, if the control unit 107 determines that the change in the WB adjustment parameter has converged, the process proceeds to step S409. In this example, it is assumed that the control unit 107 determines that the development parameter change has converged in the frame of n = N4 in FIG.

  In step S409, the control unit 107 executes correction processing for the development parameter. In this example, the control unit 107 executes a correction process for the WB adjustment parameter. Then, the control unit 107 determines whether or not an instruction to interrupt shooting has been given (step S410). If an instruction to interrupt shooting is given, the process ends. If the photographing interruption instruction has not been given, the process returns to step S402.

  Hereinafter, the correction process for the WB adjustment parameter in step S410 will be described. In this example, as shown in FIG. 5, it is assumed that panning starts at n = N1, and panning ends at n = N2. That is, the period corresponding to N1 to N2 is the change period of the frame image data included in the Raw moving image data. The change period of the frame image data is determined based on the detection result by the image change detection unit 112.

  Further, it is assumed that the change of the WB adjustment parameter starts at n = N3 and the change of the WB adjustment parameter ends (converges) at n = N4. The correction process for the WB adjustment parameter described below is executed after the time when the shooting target is n = N4 in the shooting process executed in parallel. Then, the control unit 107 executes a correction process for the WB adjustment parameter so that the change of the WB adjustment parameter is settled during the panning scene period (from the start to the end of panning).

Specifically, the control unit 107 calculates a WB adjustment parameter WB (n) corresponding to a frame whose frame number n is “greater than N1 and smaller than N2” by the following equation (1).
WB (n) = ((WB (N4) -WB (N3)) / (n-N1)) + WB (N1)
... Formula (1)

Further, the control unit 107 calculates a WB adjustment parameter WB (n) corresponding to a frame whose frame number n is “N2 or more and less than N4” by the following equation (2).
WB (n) = WB (N4) (2)

  Referring to Expression (1) and Expression (2), it can be seen that the control unit 107 calculates the WB adjustment parameter based on the following information. Based on the change period of the frame image data included in the raw moving image data, the change amount of the development parameter, and the change period of the development parameter, the control unit 107 adjusts the change of the development parameter during the change period of the frame image data. The WB adjustment parameter for calculating is calculated. The change in the frame image data is a change caused by a change in the photographing content of the subject corresponding to the RAW moving image data. Specifically, the change in the frame image data is a change caused by any of panning, zooming, exposure control, or face detection.

  Then, in accordance with the instruction from the control unit 107, the development parameter correction unit 111 sets the WB adjustment parameter already recorded in the development parameter file in step S207 in FIG. 2 as the WB adjustment parameter WB (n ) To update. Thereby, the WB adjustment parameter is corrected.

  As shown in FIG. 5, the variation in the WB adjustment parameter after the correction process falls within a period from the start of panning to the end of panning, and a moving image that is appropriately WB adjusted can be obtained immediately after the end of panning. As described above, according to the present embodiment, it is possible to obtain a development parameter having no fluctuation immediately after a change of photographing content by panning or the like is completed, for example, when a moving image is photographed. Therefore, it is possible to provide a moving image more suitable for the user than the conventional method.

(Example 2)
FIG. 6 is a diagram illustrating a configuration example of the image processing apparatus according to the second embodiment. The image processing apparatus according to the second embodiment is a moving image reproduction apparatus 60.

  The image processing apparatus according to the first embodiment described above corrects development parameters as needed while generating development parameters during moving image shooting. On the other hand, the moving image reproduction device 60 performs correction processing on the development parameters corresponding to the raw moving image when the raw moving image previously captured by the photographing device is reproduced by the moving image reproduction device 60.

  The moving image reproduction device 60 includes a recording medium 601, a recording medium I / F unit 602, an operation unit 603, a control unit 604, a memory 605, a raw moving image processing unit 606, a raw moving image developing unit 607, and a development parameter processing unit 608. Prepare. The moving image reproduction device 60 includes a development parameter correction unit 609, an image change detection unit 610, and a display unit 611.

  In the recording medium 601, a Raw moving image file and a development parameter file that are previously captured by an imaging device (for example, the imaging device 10 illustrated in FIG. 1) are recorded. The recording medium 601 is, for example, an optical recording medium or a semiconductor recording medium.

  A recording medium I / F unit 602 controls reading of a moving image file, a development parameter file, and the like recorded on the recording medium 601. The operation unit 603 performs various operation settings of the moving image playback device 60 in accordance with user operations. The operation unit 603 has a playback start button and the like.

  The control unit 604 instructs the corresponding processing unit to execute various operations set by the operation unit 603 and controls the execution order between the processing units. The memory 605 is a storage unit that temporarily stores the raw image data output from the raw moving image processing unit 606 and the development parameters output from the development parameter processing unit 608. The memory 605 includes, for example, a semiconductor storage element such as an SDRAM.

  The raw moving image processing unit 606 extracts raw image data in units of frames from the raw moving image file output from the recording medium I / F unit 602 in accordance with an instruction from the control unit 604.

  The raw moving image developing unit 607 performs raw moving image development processing based on the raw image data output from the raw moving image processing unit 606 and the development parameters after correction processing output from the development parameter correcting unit 609. Do. Specifically, the RAW moving image developing unit 607 performs processing such as demosaic processing, WB adjustment, exposure correction, color space processing, and edge enhancement to generate moving image data that can be displayed on the display unit 611.

  The development parameter processing unit 608 acquires a development parameter for each frame from the development parameter file output from the recording medium I / F unit 602 in accordance with an instruction from the control unit 604. The development parameter file is a development parameter file for developing Raw moving image data generated based on the Raw moving image data.

  A development parameter correction unit 609 performs a correction process on the development parameters acquired by the development parameter processing unit 608 according to a change in photographing content due to panning detected by the image change detection unit 610.

  The image change detection unit 610 analyzes image data in units of frames output from the raw moving image processing unit 606 or the raw moving image development unit 607, and detects an image change caused by, for example, panning or zooming. The display unit 611 displays image data after the development processing executed by the raw moving image development unit 607.

  FIG. 7 is a flowchart illustrating an example of raw video playback processing by the video playback device. In the flowchart of FIG. 7, a RAW moving image file that is not subjected to correction processing on the development parameters as shown in FIG. 3 is to be reproduced.

  First, the control unit 604 starts playback of a moving image in response to the user's pressing operation of the playback start button (step S701). Subsequently, the control unit 604 initializes a frame number n (n = 0) in a series of processes repeatedly performed in units of frames described later. The control unit 107 increments the value of n by +1. At the start of reproduction, the control unit 604 sets n = 1.

  Next, the raw moving image developing unit 607 executes development processing on the raw image data of the nth frame (step S704). Then, the display unit 611 displays the Raw image data of the nth frame that has been subjected to the development processing (step S705). While the reproduction is continued by the user (until the reproduction end is instructed), a series of processes in steps S703 to S705 are executed by each processing unit in units of frames. When the playback end button is pressed by the user, the control unit 604 detects that a playback end instruction has been input (step S706), and the series of playback processing shown in this flowchart ends.

  As described above, for example, a Raw moving image file as shown in FIG. 3 can be reproduced by the moving image reproducing device 60.

  An operation of the moving image reproducing device 60 for pre-reading Raw moving image data and development parameters after starting moving image reproduction and performing development parameter correction processing according to changes in image contents will be described. The development parameter correction processing of this embodiment is the same as that of Embodiment 1, and follows the flowchart shown in FIG. Further, the development parameters subjected to the correction process by the moving image reproducing device 60 according to the flowchart of FIG. 4 are the same as those in the first embodiment and are as shown in FIG.

  The development parameter correction processing performed by the moving image playback device 60 is executed in parallel with the moving image playback processing shown in the flowchart of FIG. That is, when the moving image playback is started, the moving image playback device 60 performs the playback of the moving image according to the flowchart of FIG. 7 while the playback of the moving image according to the flowchart of FIG. Execute.

  In the present embodiment, the moving image reproduction device 60 has already completed the correction process for the development parameter of the nth frame shown in the flowchart of FIG. 4 when the reproduction process of the nth frame is performed in the flowchart of FIG. To control. Therefore, the value of the frame number n shown in the flowchart of FIG. 4 is incremented regardless of the frame number n shown in the flowchart of FIG.

  The correction process for the development parameter in the second embodiment is the same as the correction process for the development parameter in the first embodiment, except that the processing subject is the control unit 604. In the second embodiment, in step S410 in FIG. 4, the control unit 604 determines whether or not the playback end button has been pressed by the user.

  In the second embodiment, the control unit 604 determines in step S410 in FIG. 4 whether the reproduction is continued. In step S407, the control unit 604 determines whether an instruction to interrupt reproduction has been issued. In step S410, the control unit 604 determines whether an instruction to interrupt reproduction has been issued.

  As described above, according to the present embodiment, it is possible to obtain a development parameter having no variation immediately after the change of the photographing content by panning or the like is completed. Therefore, at the time of replaying the raw moving image, it is possible to reproduce the moving image in which the tracking delay of the WB adjustment caused by panning or the like is eliminated. As a result, it is possible to provide a moving image that is more suitable for the user than the conventional method.

  In the present specification, the development parameters are recorded as a development parameter file separately from the raw moving image file. However, the development parameters may be recorded in the same file as the raw moving image file.

  Further, when recording development parameters, it is also possible to record together the frame number of the corresponding Raw moving image and the time information when the image was taken.

  Although the white balance adjustment parameter has been mainly described as an example of the development parameter, the present invention is not limited to this, and correction processing is performed for changes in other development parameters such as a change in γ coefficient caused by automatic exposure control. It is also possible to do this.

DESCRIPTION OF SYMBOLS 10 Imaging device 101 Imaging part 102 A / D conversion part 103 Development parameter generation part 104 Raw moving image file generation part 105 Development parameter file generation part 106 Operation part 107 Control part 108 Recording medium I / F part 109 Recording medium 110 Memory 111 Development Parameter correction unit 112 Image change detection unit

Claims (8)

Obtaining means for obtaining development parameters for development of the Raw moving image data generated based on the Raw moving image data;
Correction means for performing correction processing on the development parameters,
The correction unit is configured to generate the frame image data for the development parameter based on a change period of frame image data included in the Raw moving image data, a change amount of the development parameter, and a change period of the development parameter. An image processing apparatus, wherein the correction processing is executed so that the change in the development parameter falls within the change period. The image processing apparatus according to claim 1, wherein the change in the frame image data is a change caused by a change in photographing content of a subject corresponding to the raw moving image data. The image processing apparatus according to claim 1, wherein the change in the frame image data is a change caused by any one of panning, zooming, exposure control, and face detection. An imaging unit that captures a moving image by photographing a subject, outputs the Raw moving image data corresponding to the captured moving image, and a generating unit that generates the development parameter based on the output Raw moving image data The image processing apparatus according to claim 1, wherein the image processing apparatus is configured as an imaging apparatus including: Detection means for detecting the panning, detecting the zooming, detecting the exposure control, or detecting the face;
The image processing apparatus according to claim 4, wherein the correction unit performs the correction process using a change period of frame image data determined based on a detection result by the detection unit. The image processing apparatus according to claim 1, further comprising: a developing unit that performs a developing process on the raw moving image data based on the developing parameter. The image processing apparatus according to claim 6, further comprising display means for displaying image data developed by the developing means. A generation step of acquiring raw moving image data and generating a development parameter based on the acquired raw moving image data;
A correction step of performing correction processing on the development parameter,
In the correction step, based on the change period of the frame image data included in the Raw moving image data, the change amount of the development parameter, and the change period of the development parameter, the frame image data with respect to the development parameter. A control method for an image processing apparatus, wherein the correction processing is executed so that the change in the development parameter is accommodated during the change period of the image processing apparatus.

Images