JP2019062392A - Image processing apparatus, imaging apparatus, image processing method, and program - Google Patents

Abstract

To provide an image processing apparatus capable of precisely detecting unnecessary components.SOLUTION: In an imaging apparatus 100, an image processing apparatus 104 comprises: a light source position detection unit 111 for acquiring light source position information; a movement information detection unit 112 for acquiring movement information of an imaging optical system; an unnecessary component estimation unit 113 for acquiring estimated movement information of unnecessary components included in an image on the basis of the light source position information, the movement information of the imaging optical system, and imaging condition information about the imaging optical system; a movement body detection unit 114 for acquiring movement information of a mobile body; and an unnecessary component detection unit 115 for detecting the unnecessary components on the basis of the movement information of the mobile body and the estimated movement information of the unnecessary components.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging device capable of reducing unnecessary components such as ghosts and flares.

  2. Description of the Related Art In recent years, imaging devices such as digital still cameras and video cameras provided with imaging devices such as CCD image sensors and CMOS image sensors have become widespread. When imaging is performed using an imaging device, a part of light incident on the imaging optical system may be reflected by the interface of the lens or the lens holding member, and may reach the imaging surface as a light flux different from the imaging light flux. A luminous flux other than the imaging luminous flux that has reached the imaging surface forms a high-density spot image, or appears in a photographed image as an unnecessary component called a ghost or a flare by covering a wide area of the subject image. Therefore, conventionally, a method of detecting unnecessary components such as ghost and flare at the time of photographing has been proposed.

  In Patent Document 1, there is a method of acquiring a plurality of parallax images in one shooting, using one image as a reference image, determining relative parallax information with the remaining images, and detecting an unnecessary component included in each parallax image. It is disclosed. Patent Document 2 describes the difference between defocused images, the correlation of image magnification during zooming, and the correlation of image misalignment during pan head rotation at the focus lens in-focus position between consecutive frames. A method is disclosed for detecting ghosts from the obtained vector information.

JP, 2015-115730, A JP, 2008-54206, A

  However, in the method disclosed in Patent Document 1, depending on the position of the light source or the position of the imaging optical system of the imaging device, an unnecessary component may be reflected in the captured image, and relative parallax information sufficient for detecting the unnecessary component may be obtained. In some cases, unnecessary components can not be detected. In the method disclosed in Patent Document 2, since difference information and correlation between photographed images are seen, if a moving subject is captured during continuous shooting, the subject may be erroneously detected as an unnecessary component. There is sex.

  Then, this invention aims at providing the image processing apparatus which can detect an unnecessary component with high precision, an imaging device, the image processing method, and a program.

  An image processing apparatus according to one aspect of the present invention includes a light source position acquisition unit that acquires positional information of a light source, a movement information acquisition unit that acquires movement information of an imaging optical system, position information of the light source, and the imaging optical system. An unnecessary component estimating means for acquiring estimated movement information of an unnecessary component contained in an image based on movement information of a system and imaging condition information on the imaging optical system, and a moving body acquisition means for acquiring movement information of a moving body And unnecessary component detection means for detecting the unnecessary component based on movement information of the moving body and estimated movement information of the unnecessary component.

  An imaging apparatus according to another aspect of the present invention includes an imaging element that photoelectrically converts an optical image formed through an imaging optical system to output image data, and the image processing apparatus.

  According to another aspect of the present invention, an image processing method includes: acquiring position information of a light source; acquiring movement information of an imaging optical system; position information of the light source; and movement information of the imaging optical system Estimating movement information of an unnecessary component included in an image based on photographing condition information on the imaging optical system, acquiring movement information of a moving body, movement information of the moving body, and the unnecessary component And detecting the unnecessary component based on the estimated movement information.

  A program according to another aspect of the present invention causes a computer to execute the image processing method.

  Other objects and features of the present invention will be described in the following embodiments.

  According to the present invention, it is possible to provide an image processing apparatus, an imaging apparatus, an image processing method, and a program capable of detecting an unnecessary component with high accuracy.

It is a block diagram of an imaging device in each embodiment. It is a flowchart which shows the unnecessary component detection correction process in 1st Embodiment. It is the schematic of the unnecessary component movement information estimation process in 1st Embodiment. It is the schematic of the mobile body detection process in 1st Embodiment. It is the schematic of the unnecessary component correction | amendment process in 1st Embodiment. It is a flowchart which shows the unnecessary component detection correction process in 2nd Embodiment. It is the schematic of the unnecessary component area | region estimation process in 2nd Embodiment. It is the schematic of the moving body detection process in 2nd Embodiment. Flow chart showing unnecessary component detection and correction processing in the third embodiment

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

First Embodiment
First, with reference to FIG. 1, the entire configuration of an imaging device according to a first embodiment of the present invention will be described. FIG. 1 is a block diagram of an imaging device 100 in the present embodiment.

  The imaging optical system 101 includes a diaphragm 101a and a focusing lens 101b, and focuses light from a not-shown object on the imaging element 102 (on the imaging surface). The imaging element 102 includes photoelectric conversion elements such as a CCD sensor and a CMOS sensor, and photoelectrically converts an optical image (object image) formed through the imaging optical system 101 to generate an analog signal (image signal). The A / D converter 103 converts an analog signal output from the imaging element 102 into a digital signal.

  An image processing unit (image processing apparatus) 104 performs various types of image processing on the digital signal output from the A / D converter 103 to generate an image (image data). The image processing unit 104 also has an unnecessary light detection and correction processing function described later, and includes a light source position detection unit 111, a movement information detection unit 112, an unnecessary component estimation unit 113, a moving object detection unit 114, an unnecessary component detection unit 115, and , And the unnecessary component correction unit 116. The light source position detection unit (light source position acquisition unit) 111 detects (acquires) the position of the light source. The movement information detection unit (movement information acquisition means) 112 detects (acquires) movement information of the imaging optical system 101 accompanying movement of the imaging device 100. The unnecessary component estimation unit (necessary component estimation means) 113 estimates the movement direction of the unnecessary component and the generation position of the unnecessary component (movement information of the unnecessary component). In the present embodiment, the movement information of the unnecessary component can be acquired based on the position information of the light source, the movement information of the imaging optical system 101, and the imaging condition information on the imaging optical system 101. A mobile detection unit (mobile acquisition means) 114 detects (acquires) a mobile. The unnecessary component detection unit (unnecessary component detection means) 115 determines whether or not the moving object detected by the moving object detection unit 114 is an unnecessary component (detects the unnecessary component). The unnecessary component correction unit (necessary component correction unit) 116 corrects the image (image data) so as to remove (reduce) the unnecessary component detected by the unnecessary component detection unit 115.

  The display unit 105 includes, for example, an LCD and the like, and displays information related to a shooting mode, a preview image before shooting, and an image generated and output by the image processing unit 104. The imaging optical system control unit 106 controls the aperture 101 a and the focus lens 101 b based on the control value transmitted from the system controller 110 in accordance with the aperture value (F value) and zoom magnification specified by the shooting setting or the user's operation. Do. The state detection unit 107 detects the processing state and setting of each unit of the imaging apparatus 100, and notifies the image processing unit 104 of the detection result so as to perform appropriate image processing.

  The storage unit 108 is a memory such as a RAM or a ROM, stores a predetermined program, and holds image data during image processing and parameter data necessary for image processing. The image recording medium 109 is a removable flash memory or the like, and records the image (image data) generated and output by the image processing unit 104 as a file.

  The system controller 110 is responsible for overall control of the imaging device 100. The system controller 110 generates an image by outputting control commands to the image processing unit 104, the display unit 105, the imaging optical system control unit 106, the state detection unit 107, and the image recording medium 109 at appropriate timings. Control, save, display.

  The light source position detection unit 111 detects an object having a specific luminance as a light source, or detects the light source based on the reflection characteristic value of the object and the image parallax information by using an object recognition technique. The movement information detection unit 112 uses detection information by an acceleration sensor (not shown) installed in the imaging apparatus 100, or difference information obtained by comparing an image photographed by continuous photographing with a previously photographed image. The movement information of the imaging optical system 101 interlocked with the imaging device 100 is detected.

  When incident light from a light source (not shown) detected by the light source position detection unit 111 is reflected by a member in the imaging optical system 101, unnecessary light reaching the imaging element 102 as a light flux different from the subject photographing light flux is generated. . The unnecessary component estimation unit 113 determines the moving direction or generation of the unnecessary component based on the position where the unnecessary light appears as an unnecessary component in the image and the movement information of the imaging optical system 101 detected by the movement information detection unit 112. The position (movement information of unnecessary components) is estimated.

  The moving body detection unit 114 detects movement information of the moving body by extracting difference information from images captured by continuous shooting in comparison with previously captured images. The unnecessary component detection unit 115 compares the movement information of the unnecessary component estimated by the unnecessary component estimation unit 113 with the movement information of the mobile detected by the mobile detection unit 114, and determines whether the mobile is an unnecessary component Or, it is determined (distinguished) whether it is another object that is not an unnecessary component. The unnecessary component correction unit 116 corrects the image to remove (reduce) the unnecessary component determined (detected) by the unnecessary component detection unit 115 based on the surrounding pixel information or the image information before and after the continuous shooting. .

  Next, with reference to FIG. 2 to FIG. 5, the unnecessary component detection and correction processing in the present embodiment will be described. FIG. 2 is a flowchart showing the unnecessary component detection and correction process. Each step in FIG. 2 is executed by each unit of the image processing unit 104 mainly based on an instruction from the system controller 110. FIG. 3 is a schematic view of the unnecessary component movement information estimation process (step S203 in FIG. 2). FIG. 4 is a schematic view of the mobile object detection process (step S204 in FIG. 2). FIG. 5 is a schematic view of the unnecessary component correction process (step S206 in FIG. 2).

  First, in step S201 of FIG. 2, the light source position detection unit 111 detects an object exceeding a specific luminance as the light source 302, or based on the reflection characteristic value of the object and the parallax information of the image by object recognition technology. By detecting the light source, the position of the light source is detected. Subsequently, in step S202, the movement information detection unit 112 uses difference information obtained by comparing the image captured by the continuous shooting with the previous captured image, so that the movement of the imaging optical system 101 interlocked with the imaging device 100. Detect movement information. When detecting movement information of the imaging optical system 101, it is not necessary to use difference information obtained from comparison of front and rear images, and even if detection information by an acceleration sensor (not shown) installed in the imaging apparatus 100 is used. Good.

  Subsequently, in step S203, the unnecessary component estimation unit 113 estimates the position and movement direction of the unnecessary component (movement information of the unnecessary component) for each image. The movement information of unnecessary components includes the position (position information) of the light source 302 detected in step S201, the photographing condition information of the imaging optical system 101 such as the aperture value (F value) and the zoom lens position, and It is estimated based on the detected movement information of the imaging optical system 101. For example, assuming that the imaging apparatus 301 is swung in the direction 301a under the light source 302 and continuous shooting is performed, the arrows 303a, 304a, and 305a in the images 303, 304, and 305 relate to the position and direction of unnecessary components. Movement information (estimated movement information of unwanted components) is estimated.

  Subsequently, in step S204, the moving body detection unit 114 detects movement information (moving body information) of the moving body by extracting difference information from images captured by continuous shooting in comparison with previous captured images. Do. For example, it is assumed that the imaging apparatus 401 illustrated in FIG. 4 is swung in the direction 401a to perform continuous imaging, and images 402, 403, 404, and 405 are captured. In the images 402 to 405, objects 402a, 402b, 403a, 403b, 404a, 404b, 405a, and 405b are reflected in addition to the background portion and the main subject, respectively. At this time, the moving object detection unit 114 determines whether the object is a moving object based on the difference between the captured image to be detected and the previous captured image. When the object is a moving object, the moving object detection unit 114 detects the movement information of the object. Images 406, 407, and 408 indicate the difference information of the images 402 and 403, the difference information of the images 403 and 404, and the difference information of the images 404 and 405, respectively. When the moving body detection unit 114 determines that the objects 402a to 405b are moving bodies based on the difference information, each movement is performed as indicated by arrows 406a, 406b, 407a, 407b, 408a, and 408b. Detect body movement information.

  Subsequently, in step S205, the estimated movement information of the unnecessary component estimated in step S203 is compared with the movement information of the moving body detected in step S204 to determine whether the moving body is an unnecessary component. (Separate) For example, assuming that the imaging devices 301 and 401 and the directions 301a and 401a are respectively the same imaging device and shooting direction, estimated movement information of the unnecessary component indicated by the arrow 303a and the moving object indicated by the arrows 406a and 406b. Compare with movement information of In the present embodiment, the estimated movement information of the unnecessary component indicated by the arrow 303a matches the movement information of the mobile indicated by the arrow 406a. Therefore, the unnecessary component detection unit 115 determines that the moving body indicated by the arrow 406a is an unnecessary component. On the other hand, the estimated movement information of the unnecessary component indicated by the arrow 303a does not match the movement information of the moving body indicated by the arrow 406b. Therefore, the unnecessary component detection unit 115 determines that the moving body indicated by the arrow 406 b is not an unnecessary component.

  As described above, in the present embodiment, the unnecessary component detection unit 115 compares the movement information of the moving object with the estimated movement information of the unnecessary component. Then, the unnecessary component detection unit 115 determines that the moving object is an unnecessary component when the movement information of the moving object matches the estimated movement information of the unnecessary component. On the other hand, when the movement information of the moving object and the estimated movement information of the unnecessary component do not match, the unnecessary component detection unit 115 determines that the moving object is not an unnecessary component. In addition, since the estimated movement information of the unnecessary component is an estimated value, even if the movement information of the moving body does not completely match, if there is a correlation within a certain threshold range, the moving body is regarded as an unnecessary component You may judge. That is, the term "matching" includes not only exact matching but also values within a range that is regarded as substantial matching (substantially match).

  Subsequently, in step S206, the unnecessary component correction unit 116 corrects the image so as to remove (reduce) the unnecessary component determined (detected) in step S502. FIG. 5 shows an example of correction of unnecessary components during continuous shooting. For example, in the case of correcting the unnecessary component 502a detected in the image 502, the pixel component 501a at a position corresponding to the unnecessary component 502a in the image 501 (first image) captured before capturing the image 502 is By using it, the corrected image 504 can be generated. On the other hand, when the unnecessary component is similarly reflected at the position corresponding to the unnecessary component and the pixel component of the image before the correction target image can not be corrected, the pixel component of the subsequent captured image may be used. For example, when correcting the unnecessary component 502a determined in the image 502, by using the pixel component 503a at a position corresponding to the unnecessary component 502a in the image 503 (second image) captured after capturing the image 502, A corrected image 504 can be generated. At this time, it is not necessary to necessarily use the pixel component of the captured image of one before or after for correction, and the pixel component of the captured image of several before or after may be used. In addition, when the unnecessary component can not be used for all corrections of the previous and subsequent captured images, the unnecessary component may be corrected by using a pixel component around the unnecessary component of the correction target image itself.

  In the present embodiment, through steps S201 to S207, unnecessary components such as ghost and flare can be detected and corrected even under shooting conditions where parallax information can not be obtained. In particular, by using the position of the light source and the photographing condition of the imaging optical system, the unnecessary component movement information estimated from the movement information of the imaging optical system, and the movement information of the movable body obtained between photographed images Erroneous detection of the body can be suppressed, and unnecessary components can be detected with high accuracy.

Second Embodiment
Next, the unnecessary component detection and correction process in the second embodiment will be described with reference to FIGS. 6 to 8. FIG. 6 is a flowchart showing the unnecessary component detection and correction process in the present embodiment. Each step in FIG. 6 is executed by each unit of the image processing unit 104 mainly based on a command from the system controller 110. FIG. 7 is a schematic view of the unnecessary component region estimation process (step S604 in FIG. 6). FIG. 8 is a schematic view of the mobile object detection process (step S605 in FIG. 6).

  In this embodiment, the unnecessary component area estimation process (step S604 in FIG. 6) is added to the unnecessary component detection and correction process of the first embodiment, and the contents of the mobile object detection process (step S605) are changed accordingly. . This is to reduce the load of the detection process by suppressing the false detection of the mobile object which is not the unnecessary component by estimating the region where the unnecessary component may occur and performing the mobile object detection processing only in the estimated region. It is for. The other processes (steps S601 to S603, S606, and S607) of this embodiment are the same as the processes (steps S201 to S203, S205, and S206) of the first embodiment, and thus the description thereof will be omitted. .

  In step S604, the image processing unit 104 (the unnecessary component estimation unit 113) estimates, for each image, a region in which the unnecessary component may occur. This area includes the position information of the light source 702 detected in step S601, the imaging condition information of the imaging optical system such as the aperture value (F value) and the zoom lens position, and the movement of the imaging optical system 101 detected in step S602. It is estimated based on the information. For example, as shown in FIG. 7, when the imaging device 701 is swung in the direction 701a under the light source 702 and continuous shooting is performed, the images 703, 704, and 705 are respectively inside the regions 703b, 704b, and 705b. , The unnecessary components of the directions 703a, 704a, 705a.

  Subsequently, in step S605, the image processing unit 104 (moving object detection unit 114) performs the moving object detection process only on the area estimated in step S605, unlike step S204. FIG. 8 shows an example of mobile object detection processing performed only in the estimated area. As shown in FIG. 8, when the imaging device 801 is swung in the direction 801 a and continuous shooting is performed, it is assumed that the images 802, 803, 804, and 805 are shot. In addition, in the images 802 to 805, objects 802a, 802b, 803a, 803b, 804a, 804b, 805a, and 805b are reflected in addition to the background portion and the main subject. At this time, the moving object detection unit 114 determines whether the object is a moving object based on the difference from the previous captured image of the captured image to be detected. When it is determined that the object is a moving object, the moving object detection unit 114 detects movement information. In the present embodiment, the area to be compared in order to obtain the difference in the detection process is only the area estimated in step S604.

  Images 806, 807, and 808 in FIG. 8 are difference information on the images 802 and 803, difference information on the images 803 and 804, and difference information on the images 804 and 805, respectively. Regions 806b, 807b, and 808c are comparison regions based on the regions 703b, 704b, and 705b estimated in step S604, respectively. The directions 806a, 807a, and 808a respectively indicate movement information obtained by detecting the objects 802a, 803a, 804a, and 805a as a moving object as a comparison result. On the other hand, even if the objects 802b, 803b, and 804b are mobile objects, they are outside the unnecessary component estimation area, and the subsequent unnecessary component determination process is unnecessary. Therefore, in the present embodiment, the moving object detection unit 114 does not perform the moving object detection process on the objects 802b, 803b, and 804b.

  According to the present embodiment, the mobile object detection processing is performed only in the area where the unnecessary component may occur. As a result, compared to the first embodiment, it is possible to further suppress erroneous detection of a mobile object that is not an unnecessary component, and to reduce detection processing load.

Third Embodiment
Next, with reference to FIG. 9, the unnecessary component detection and correction process in the third embodiment will be described. FIG. 9 is a flowchart showing the unnecessary component detection and correction process in the present embodiment. Each step in FIG. 9 is executed by each unit of the image processing unit 104 mainly based on an instruction of the system controller 110. The present embodiment relates to unnecessary component detection and correction processing by an imaging device (or an image processing device) capable of acquiring images of a plurality of viewpoints in one shooting, as disclosed in Patent Document 1.

  First, in step S901, using the method disclosed in Patent Document 1, the image processing unit 104 obtains difference information (relative difference information) from images of a plurality of viewpoints. Subsequently, in step S902, the image processing unit 104 (the unnecessary component detection unit 115) determines whether the difference information obtained in step S901 is information sufficient for detecting an unnecessary component (an unnecessary component based on the difference information). To determine if it can be detected. If it is determined in step S902 that sufficient difference information can not be obtained for detecting the unnecessary component (if it is determined that the unnecessary component can be detected based on the difference information), the process proceeds to step S903. In step S903, the image processing unit 104 performs unnecessary component detection and correction processing based on the movement information. The unnecessary component detection and correction process is the unnecessary component detection and correction process described in the first embodiment or the second embodiment.

  On the other hand, if sufficient information for detecting an unnecessary component is obtained in step S902, the process proceeds to step S904. In step S904, the image processing unit 104 performs unnecessary component detection and correction processing based on the difference information acquired in step S901. The unnecessary component detection and correction processing corresponds to the unnecessary component detection processing and the unnecessary component correction processing disclosed in Patent Document 1.

  According to the present embodiment, when multiple parallax images can be acquired by one shooting, it is determined in advance whether unnecessary components can be detected based on difference information of images of multiple viewpoints, A suitable unnecessary component detection and correction method can be selected. As a result, it is possible to perform more accurate detection and correction of unnecessary components.

Other Embodiments
The present invention supplies a program that implements one or more functions of the above-described embodiments to a system or apparatus via a network or storage medium, and one or more processors in a computer of the system or apparatus read and execute the program. Can also be realized. It can also be implemented by a circuit (eg, an ASIC) that implements one or more functions.

  According to each embodiment, it is possible to provide an image processing apparatus, an imaging apparatus, an image processing method, and a program capable of detecting an unnecessary component with high accuracy even under shooting conditions where parallax information can not be obtained.

  As mentioned above, although the preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

104 Image processing unit (image processing apparatus)
111 Light source position detection unit (light source position acquisition unit)
112 Movement information detection unit (movement information acquisition unit)
113 Unwanted Component Estimation Unit (Unwanted Component Estimation Means)
114 Mobile Object Detection Unit (Mobile Object Acquisition Means)
115 Unnecessary component detection unit (unnecessary component detection means)

Claims (10)

Light source position acquisition means for acquiring position information of the light source;
Movement information acquisition means for acquiring movement information of the imaging optical system;
An unnecessary component estimation unit that acquires estimated movement information of an unnecessary component included in an image based on position information of the light source, movement information of the imaging optical system, and imaging condition information on the imaging optical system;
Mobile object acquisition means for acquiring movement information of a mobile object;
An image processing apparatus comprising: unnecessary component detection means for detecting the unnecessary component based on movement information of the movable body and estimated movement information of the unnecessary component.   The image processing apparatus according to claim 1, further comprising an unnecessary component correction unit configured to correct the image so as to reduce the unnecessary component detected by the unnecessary component detection unit.   The unnecessary component correction means corrects the image based on at least one of a first image taken before the image is taken and a second image taken after the image is taken. The image processing apparatus according to claim 2. The unnecessary component detection means
Comparing movement information of the moving body with estimated movement information of the unnecessary component;
When the movement information of the moving body and the estimated movement information of the unnecessary component coincide, it is determined that the moving body is the unnecessary component,
The image according to any one of claims 1 to 3, wherein when the movement information of the moving body and the estimated movement information of the unnecessary component do not match, it is determined that the moving body is not the unnecessary component. Processing unit. The unnecessary component estimation means estimates a region in which the unnecessary component may occur with respect to the image;
The image processing apparatus according to any one of claims 1 to 4, wherein the moving body acquisition unit acquires movement information of the moving body within the range of the area. The unnecessary component detection means
It is determined whether the unnecessary component can be detected based on difference information of a plurality of pieces of image data of different viewpoints included in the image.
When it is determined that the unnecessary component can be detected based on the difference information, the unnecessary component is detected using the difference information,
When it is determined that the unnecessary component can not be detected based on the difference information, the unnecessary component is detected based on the movement information of the moving body and the estimated movement information of the unnecessary component. An image processing apparatus according to any one of the preceding claims.   The image processing apparatus according to any one of claims 1 to 6, wherein the shooting condition information includes at least one of an aperture value of the imaging optical system and a zoom lens position. An imaging element that photoelectrically converts an optical image formed via an imaging optical system and outputs image data;
A light source position acquiring unit that acquires positional information of a light source based on the image data;
Movement information acquisition means for acquiring movement information of the imaging optical system;
Unnecessary component estimation means for acquiring estimated movement information of an unnecessary component included in the image data based on position information of the light source, movement information of the imaging optical system, and imaging condition information on the imaging optical system,
Mobile object acquisition means for acquiring movement information of a mobile object;
An image pickup apparatus comprising: unnecessary component detection means for detecting the unnecessary component based on movement information of the movable body and estimated movement information of the unnecessary component. Obtaining position information of the light source;
Acquiring movement information of the imaging optical system;
Estimating movement information of an unnecessary component included in an image based on position information of the light source, movement information of the imaging optical system, and imaging condition information on the imaging optical system;
Acquiring movement information of a mobile body;
Detecting the unnecessary component on the basis of the movement information of the movable body and the estimated movement information of the unnecessary component. Obtaining position information of the light source;
Acquiring movement information of the imaging optical system;
Estimating movement information of an unnecessary component included in an image based on position information of the light source, movement information of the imaging optical system, and imaging condition information on the imaging optical system;
Acquiring movement information of a mobile body;
Detecting the unnecessary component based on movement information of the moving object and estimated movement information of the unnecessary component.