[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2020057198A1 - Image processing method and device, electronic device and storage medium - Google Patents

Image processing method and device, electronic device and storage medium Download PDF

Info

Publication number
WO2020057198A1
WO2020057198A1 PCT/CN2019/091579 CN2019091579W WO2020057198A1 WO 2020057198 A1 WO2020057198 A1 WO 2020057198A1 CN 2019091579 W CN2019091579 W CN 2019091579W WO 2020057198 A1 WO2020057198 A1 WO 2020057198A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
frame
acquired
exposure
images
Prior art date
Application number
PCT/CN2019/091579
Other languages
French (fr)
Chinese (zh)
Inventor
李小朋
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2020057198A1 publication Critical patent/WO2020057198A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • H04N23/81Camera processing pipelines; Components thereof for suppressing or minimising disturbance in the image signal generation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265Mixing

Definitions

  • the present application relates to the field of imaging technology, and in particular, to an image processing method, device, electronic device, and storage medium.
  • smart mobile terminals such as smart phones, tablet computers, etc.
  • smartphones and tablets have a built-in camera
  • the performance of the built-in camera is getting stronger and the quality of captured images is getting higher and higher.
  • the operation of mobile terminals is simple and easy to carry.
  • people use mobile terminals such as smart phones and tablets to take pictures.
  • the image processing method, device, electronic device, and storage medium proposed in this application are used to solve the related art. Images captured in night scenes not only have a limited dynamic range, but also highlights and dark areas cannot be clearly displayed, affecting user experience. problem.
  • the image processing method includes: determining a target exposure amount of each frame of the to-be-acquired image in a plurality of frames of the to-be-acquired image according to the illumination of the current shooting scene; and according to a preset sensitivity and the The target exposure of the collected image determines the exposure time of each frame of the image to be collected; according to the preset sensitivity and the exposure time of each frame of the image to be acquired, multiple frames of images are sequentially acquired; and the acquired multiple frames of images are processed Synthesis processing to generate a target image.
  • An image processing device includes: a first determining module, configured to determine a target exposure amount of each of the frames of images to be acquired among a plurality of frames of images to be acquired according to the illumination of the current shooting scene; a second determination module Is configured to determine the exposure duration of each frame of the to-be-acquired image according to the preset sensitivity and the target exposure amount of the image to be collected per frame; the acquisition module is configured to be based on the preset sensitivity and each frame to be collected The exposure time of the image is to sequentially acquire multiple frames of images; a synthesis module is configured to synthesize the acquired multiple frames of images to generate a target image.
  • An electronic device includes: the camera module, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes The program realizes the image processing method as described above.
  • the computer-readable storage medium provided by the embodiments of the present invention in another aspect stores a computer program thereon, which is characterized in that, when the program is executed by a processor, the image processing method described above is implemented.
  • a computer program according to another embodiment of the present application which is executed by a processor to implement the image processing method according to the embodiment of the present application.
  • the image processing method, device, electronic device, computer-readable storage medium, and computer program provided in the embodiments of the present application can determine the target exposure amount of each frame of the to-be-acquired image in the multi-frame to-be-acquired image according to the illumination of the current shooting scene, and According to the preset sensitivity and the target exposure of each frame of images to be acquired, determine the exposure time of each frame of images to be acquired, and then according to the preset sensitivity and the exposure time of each frame of images to be acquired, sequentially collect multiple frames of images and Perform synthesis processing to generate a target image.
  • the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
  • FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application
  • FIG. 2 is a schematic flowchart of another image processing method according to an embodiment of the present application.
  • FIG. 3 is a schematic flowchart of another image processing method according to an embodiment of the present application.
  • FIG. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
  • FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG. 6 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
  • the embodiments of the present application propose an image processing method for the problem that, in the related art, an image captured in a night scene scene has a limited dynamic range, and highlights and dark areas cannot be clearly displayed, which affects the user experience.
  • the target exposure amount of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image may be determined according to the illumination of the current shooting scene, and the preset sensitivity and the target of the to-be-acquired image per frame
  • the amount of exposure determines the exposure time of the image to be collected for each frame, and then according to the preset sensitivity and the exposure time of the image to be collected for each frame, multiple frames of images are sequentially collected and synthesized to generate a target image.
  • the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
  • FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application.
  • the image processing method includes the following steps:
  • Step 101 Determine a target exposure amount of each frame of the image to be acquired in the plurality of frames of the image to be acquired according to the illumination of the current shooting scene.
  • the light metering module in the camera module can be used to obtain the light intensity of the current shooting scene, and an automatic exposure control (Auto Exposure Control (AEC) algorithm) is used to determine the exposure amount corresponding to the current light intensity.
  • AEC Automatic Exposure Control
  • multiple frames of images can be collected by using different exposure amounts, and the collected multiple frames of images can be combined to generate a target image to improve the captured image. Dynamic range and overall brightness to improve the quality of captured images.
  • the number of images to be acquired may be preset in advance according to actual needs. For example, in the embodiment of the present application, the number of images to be acquired may be 20 frames.
  • the target exposure amount of the image to be acquired in each frame can be determined through the illumination of the current shooting scene and the preset exposure compensation mode, so as to perform different exposure compensation on the images to be acquired in multiple frames. That is, in a possible implementation form of this embodiment of the present application, the foregoing step 101 may include:
  • the target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount, the exposure compensation range of the images to be acquired for multiple frames, and a preset exposure compensation mode.
  • the reference exposure amount refers to a normal exposure amount corresponding to the lightness of the current shooting scene determined according to the lightness of the current shooting scene.
  • the exposure compensation range refers to the range of exposure compensation values corresponding to all the images to be acquired.
  • the preset exposure compensation mode refers to a combination of preset exposure values (EV) for each image to be acquired.
  • the exposure value does not refer to an exact value, but refers to "the combination of all camera apertures and exposure times that can give the same exposure amount.”
  • Sensitivity, aperture, and exposure time determine the exposure of the camera. Different parameter combinations can produce equal exposure, that is, the EV values of these different combinations are the same. For example, if the sensitivity is the same, use 1/125.
  • the combination of the exposure time in seconds and the aperture of f11 is the same as that obtained by using the combination of 1/250 second exposure time and f8 shutter, that is, the EV value is the same.
  • the EV value When the EV value is 0, it means the exposure amount obtained when the sensitivity is 100, the aperture factor is f1, and the exposure duration is 1 second; the exposure amount is increased by one stop, that is, the exposure duration is doubled, or the sensitivity is doubled, or When the aperture is increased by one stop, the EV value is increased by 1, that is, the exposure amount corresponding to 1EV is twice the exposure amount corresponding to 0EV. As shown in Table 1, the corresponding relationship with the EV value when the exposure duration, aperture, and sensitivity are individually changed.
  • EV refers to the difference between the exposure amount corresponding to the camera metering data and the actual exposure amount.
  • + 1EV exposure compensation refers to an increase of one exposure relative to the exposure amount corresponding to the camera metering data, that is, the actual The exposure is twice the exposure corresponding to the camera's metering data.
  • the EV value corresponding to the determined reference exposure amount can be preset to 0, and + 1EV means to increase the exposure by one step, that is, the exposure amount is twice the reference exposure amount.
  • + 2EV means to increase the exposure by two stops, that is, the exposure is 4 times the reference exposure,
  • -1EV means to decrease the exposure by one stop, that is, the exposure is 0.5 times the reference exposure, and so on.
  • the illumination threshold of the shooting scene can also be preset, and according to the relationship between the illumination of the current shooting scene and the threshold, the exposure compensation range of multiple frames of images to be acquired is determined. .
  • the captured image when the EV value is negative, the captured image is an underexposed frame, which can suppress the brightness of the highlight area, prevent overexposure of the highlight area, and retain the details of the highlight area; when the EV value is positive, the captured The image is an overexposed frame, which can increase the brightness of the dark area and perform time-domain noise reduction to suppress the noise while improving the details of the dark part. Therefore, if the light level of the current shooting scene is greater than the threshold, that is, the current shooting scene is bright, the corresponding minimum exposure EV level in the multiple frames of images to be collected can be appropriately reduced, or the maximum exposure level can be appropriately reduced to appropriately reduce The exposure compensation range of images to be acquired for multiple frames.
  • the exposure compensation range can be -24EV to 8EV, which reduces the number of images captured in the current shooting scene, thereby increasing the shooting speed. If the light intensity of the current shooting scene is less than the threshold, the current shooting If the scene is dark, the corresponding minimum exposure EV level or maximum exposure EV level in multiple frames of images to be collected can be appropriately increased to ensure that the details in the dark are sufficiently clear. At this time, the exposure compensation of the multiple frames of images to be collected is compensated.
  • the range is large, for example, the exposure compensation range can be -22EV ⁇ 12EV.
  • a preset exposure compensation mode corresponding to the exposure compensation range can be selected, and then according to the reference exposure amount and the preset exposure compensation mode To determine the target exposure for each frame of image to be acquired.
  • the EV value corresponding to the preset exposure compensation mode can be [+ 12, + 12, + 8, + 8, + 4, + 4,0,0, -4, -4, -8, -8, -12, -12, -16, -16, -20, -20, -24, -24]. Then, according to the reference exposure amount X and the preset exposure compensation mode, the target exposure amount corresponding to the image to be acquired for each frame is determined.
  • the corresponding target exposure amount is For example, the target exposure for the image to be acquired with an EV value of 0 is X, and the target exposure for the image to be acquired with an EV value of +4 is 2 4 ⁇ X, and the target exposure for the image to be acquired with an EV value of -4 The amount is 2 -4 ⁇ X.
  • an exposure compensation mode consistent with the current situation may be determined according to the real-time situation of the camera module. That is, in a possible implementation form of the embodiment of the present application, before step 101, the method may further include:
  • the current jitter degree of the mobile phone that is, the current jitter degree of the camera module can be determined by acquiring the current gyro sensor information of the electronic device.
  • Gyroscope is also called angular velocity sensor, which can measure the angular velocity of rotation when the physical quantity is deflected and tilted.
  • the gyroscope can measure the movements of rotation and deflection very well, so that it can accurately analyze and judge the actual movement of the user.
  • the gyroscope information (gyro information) of the electronic device may include the movement information of the mobile phone in three dimensions in the three-dimensional space, and the three dimensions of the three-dimensional space may be respectively represented in the three directions of the X-axis, Y-axis, and Z-axis. Among them, The X-axis, Y-axis, and Z-axis are perpendicular to each other.
  • the current jitter degree of the camera module may be determined according to the current gyro information of the electronic device.
  • the absolute value threshold of the gyro movement in the three directions can be preset, and the camera module is determined according to the relationship between the acquired absolute value of the current gyro movement in the three directions and the preset threshold. The current degree of jitter.
  • the preset thresholds are the first threshold A, the second threshold B, and the third threshold C, and A ⁇ B ⁇ C.
  • the sum of the absolute values of the gyro motion in the three directions currently obtained is S . If S ⁇ A, determine the current jitter of the camera module as “no shake”; if A ⁇ S ⁇ B, you can determine the current jitter of the camera module as “slight shake”; if B ⁇ S ⁇ C, Then, it can be determined that the current shake degree of the camera module is "small shake”; if S> C, it can be determined that the current shake degree of the camera module is "large shake”.
  • the number of thresholds and specific values of each threshold can be preset according to actual needs, and the mapping relationship between the gyro information and the degree of camera module shake can be preset according to the relationship between the gyro information and each threshold.
  • the number of images to be acquired can also be preset, and then according to the current jitter of the camera module, the preset number of images to be acquired is Among the numbers, the optimal number of images to be acquired is determined.
  • the mapping relationship between the shake degree of the camera module and the exposure compensation mode can be preset, so as to determine a preset exposure that matches both the current shake degree and the exposure compensation range according to the current shake degree of the camera module. Compensation mode.
  • the corresponding exposure compensation mode is: [+ 12EV, + 12EV, + 8EV, + 8EV, + 4EV, + 4EV , 0EV, 0EV, -4EV, -4EV, -8EV, -8EV, -12EV, -12EV, -16EV, -16EV, -20EV, -20EV, -24EV, -24EV].
  • the number of captured images is 20; when the camera module shake is "slightly shake", the corresponding exposure compensation mode is: [+ 12EV, + 8EV, + 4EV, 0EV, -4EV, -8EV, -12EV, -16EV, -20EV, -24EV], that is, the number of images to be acquired corresponding to "slight jitter" is 10 and so on.
  • the degree of camera shake is small, more frames of images can be collected, that is, the number of EV values included in the corresponding exposure compensation mode is larger and is the same as the number of images to be collected, so Makes the final captured image quality higher; when the camera module has a large degree of jitter, it can collect fewer frames of the image to avoid excessively long shooting time and exacerbate the degree of jitter, which causes the captured image to contain irreversible ghost image, that is, the number of EV values included in the corresponding exposure compensation mode is small and is the same as the number of images to be acquired. Therefore, while ensuring the image exposure compensation range, the jitter of the camera module is minimized so that The final captured image is of higher quality.
  • Step 102 Determine the exposure duration of the image to be acquired for each frame according to the preset sensitivity and the target exposure amount of the image to be acquired for each frame.
  • the exposure time refers to the time that light passes through the lens.
  • the sensitivity also known as the ISO value
  • the sensitivity of a digital camera is a kind of index similar to the sensitivity of a film.
  • the ISO of a digital camera can be adjusted by adjusting the sensitivity of the photosensitive device or combining the sensing points, that is, by increasing the light sensitivity of the photosensitive device or Combining several adjacent photosensitive points to improve the ISO. It should be noted that, whether it is digital or negative photography, in order to reduce the exposure time, the use of a relatively high sensitivity will usually introduce more noise, resulting in lower image quality.
  • the sensitivity may be preset in advance, and multiple frames of images to be captured may be collected by using the preset sensitivity. It should be noted that the sensitivity can be preset to a smaller value, thereby effectively suppressing noise in the image and improving the quality of the captured image. For example, you can preset the sensitivity to 100.
  • the method may further include:
  • the preset sensitivity is determined according to the current shaking degree of the camera module.
  • the preset sensitivity determined is also the same, that is, when the degree of camera shake is constant, the sensitivity is a fixed value.
  • the sensitivity of the captured image will affect the overall shooting time. If the shooting time is too long, the degree of shake of the camera module may be increased during handheld shooting, which will affect the image quality. Therefore, the preset sensitivity can be determined according to the current shake degree of the camera module, so that the shooting duration is controlled within a proper range.
  • a smaller preset sensitivity can be selected to effectively suppress the noise of each frame image and improve the quality of the captured image; if the current jitter of the camera module is large , You can choose a larger preset sensitivity to shorten the shooting time.
  • the reference sensitivity may be determined to a smaller value to obtain higher quality as much as possible.
  • Image for example, the preset base sensitivity is determined as 100.
  • the exposure amount is related to the aperture, the exposure duration, and the sensitivity.
  • the aperture is the clear aperture, which determines the amount of light passing through in a unit time.
  • the size of the aperture may be constant, and an image to be collected for each frame is acquired using a determined preset sensitivity. Therefore, after the target exposure amount of the image to be collected is determined for each frame, the exposure time of the image to be collected can be determined according to the preset sensitivity and target exposure amount, and the exposure time of the image to be collected and its target exposure can be determined.
  • the quantity is directly proportional.
  • a reference exposure duration may also be determined according to a preset sensitivity and a reference exposure amount, and then each frame to be acquired is determined according to the reference exposure duration and a preset exposure compensation mode.
  • the exposure time of the image Specifically, assuming that the reference exposure time is T and the EV value of the image to be acquired in the i-th frame is EV i , then the exposure time of the image to be acquired in the i-th frame is
  • step 103 multiple frames of images are sequentially acquired according to the preset sensitivity and the exposure time of each frame of images to be acquired.
  • Step 104 Perform synthesis processing on the collected multiple frames of images to generate a target image.
  • multiple frames of images can be sequentially acquired according to the preset sensitivity and exposure time, and the acquired multiple frames of images are synthesized and processed to Generate a target image.
  • the target exposure amount of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image may be determined according to the illumination of the current shooting scene, and the preset sensitivity and the target of the to-be-acquired image per frame
  • the amount of exposure determines the exposure time of the image to be collected for each frame, and then according to the preset sensitivity and the exposure time of the image to be collected for each frame, multiple frames of images are sequentially collected and synthesized to generate a target image.
  • the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
  • the brightness information of the collected images may be synthesized, and after all the image collection is completed, non-brightness information of all the collected images Compositing and superimposing the previously combined brightness information to reduce the length of data processing and shorten the shooting time.
  • FIG. 2 is a schematic flowchart of another image processing method according to an embodiment of the present application.
  • the image processing method includes the following steps:
  • Step 201 Determine the target exposure of each image to be acquired from the multiple images to be acquired according to the illumination of the current shooting scene.
  • Step 202 Determine the exposure duration of the image to be acquired for each frame according to the preset sensitivity and the target exposure amount of the image to be acquired for each frame.
  • Step 203 Collect a first acquisition frame according to the preset sensitivity and exposure time of the first frame to be acquired, and display the first acquisition frame on a preview screen.
  • Step 204 Collect a second acquisition frame according to the preset sensitivity and the exposure time of the second frame to be acquired.
  • Step 205 Adjust the brightness information of the first acquisition frame displayed on the preview screen according to the metadata of the second acquisition frame and the metadata of the first acquisition frame.
  • the metadata refers to the raw data of the image sensor in the camera module converting the captured light source signals into digital signals.
  • the images to be collected in each frame may be collected according to the preset sensitivity and the exposure time of the image to be collected in each frame. And while collecting the image, the currently acquired image is synthesized with the brightness information of the metadata of the previously acquired image.
  • the first acquisition frame is displayed in a preview screen
  • the metadata of the first acquisition frame and the brightness in the metadata of the second acquisition frame are extracted.
  • the brightness information of the first collection frame and the brightness information of the second collection frame and then use the combined brightness information to adjust the brightness information of the first collection frame displayed on the preview screen.
  • the metadata of the image displayed in the current preview screen and the metadata brightness information of the third collection frame are extracted, and the brightness information of the two is synthesized, and then the synthesized brightness is used.
  • the information again adjusts the brightness information of the image displayed on the preview screen, and so on, until all the images to be collected are collected.
  • the foregoing step 205 may include:
  • the brightness information of the first acquisition frame displayed on the preview screen is adjusted by using the synthesized brightness information.
  • the weight value corresponding to the image to be acquired in each frame may be determined according to the illumination intensity of the current shooting scene and the exposure compensation mode of the image to be acquired in each frame to perform brightness information of the image to be acquired in each frame. Synthesis.
  • the exposure compensation mode of the image to be collected can be determined according to its corresponding exposure duration, that is, the longer the exposure duration is, the larger the EV level is. Therefore, in a possible implementation form of the embodiment of the present application, the weight values corresponding to the images to be collected in each frame may be determined according to the illumination of the current shooting scene and the exposure time of the images to be collected in each frame.
  • the weight value corresponding to the image to be acquired with a longer exposure duration may be determined as a larger value, and the weight value corresponding to the image to be acquired with a shorter exposure duration may be determined as Smaller values to improve the overall brightness and dark area details of the image; if the light intensity corresponding to the current shooting scene is large, the weight value corresponding to the image to be acquired with a longer exposure time can be determined as a smaller value, and the exposure will be The weight value corresponding to the shorter time-to-be-acquired image is determined to be a larger value to prevent overexposure of the highlight areas while improving the details of the dark areas.
  • the brightness information of the metadata of the currently acquired image can be synthesized with the brightness information of the image displayed on the preview screen according to the weight value in real time. That is, using the synthesized brightness information, the brightness information of the image displayed on the preview screen is adjusted until all the images to be collected are collected and the brightness information is synthesized.
  • step 206 the non-brightness information in the collected metadata of the multi-frame images is synthesized to generate an initial target image.
  • Step 207 Update the brightness information of the initial target image according to the brightness information of the image currently displayed on the preview screen to generate the target image.
  • the non-brightness information in the metadata of the collected multiple frames of images can be synthesized to generate an initial target image, and then based on the currently displayed preview image, The brightness information of the image updates the brightness of the initial target image to generate a target image.
  • the target exposure amount of each frame of the to-be-collected image and the weight value corresponding to each frame of the to-be-collected image may be determined according to the illumination of the current shooting scene, and according to a preset Sensitivity and the target exposure of each frame of images to be acquired, determine the exposure time of each frame of images to be acquired, and then according to the preset sensitivity and exposure time of each frame of images to be acquired, sequentially collect multiple frames of images and use the weight value
  • the brightness information of the captured image is synthesized in real time, and then the non-brightness information in the metadata of the collected multiple frames of images is synthesized to generate the initial target image, and according to the brightness information of the image currently displayed on the preview screen, Update the brightness information of the initial target image to generate a target image.
  • the exposure duration and weight value of each frame of the image to be collected are determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images of different exposure durations are captured and multiple frames of images are synthesized in real time according to the weight value
  • the brightness information and the non-brightness information of the multi-frame image are synthesized later, which not only further improves the quality of the captured image, but also reduces the data processing time, shortens the shooting time, and improves the user experience.
  • before shooting first determine whether the current shooting scene is a night scene according to the information in the preview screen, and then determine the current night scene mode that needs to be enabled according to the current jitter of the camera module. To make the best visual effect of the night scene image.
  • FIG. 3 is a schematic flowchart of another image processing method according to an embodiment of the present application.
  • the image processing method includes the following steps:
  • Step 301 Determine, according to the screen content of the current preview screen, that the current shooting scene belongs to a night scene.
  • AI artificial intelligence
  • a night scene according to the brightness information in the screen content of the current preview screen. Specifically, it can be determined whether the current shooting scene belongs to a night scene according to the average brightness information of the preview screen content and the brightness difference values of different regions in the screen.
  • a fourth threshold value of the average brightness of the preview screen content and a fifth threshold value of the brightness difference value may be preset, and according to the average brightness of the current preview screen content
  • the relationship with the fourth threshold, and the relationship between the brightness difference between different regions in the frame and the fifth threshold determine whether the current shooting scene belongs to a night scene.
  • the overall brightness of the picture is usually low, and in a night scene with a light source, the area near the light source will form a high-brightness area with greater brightness; while the area far from the light source will form In a dark area, the brightness is small, so that in a night scene with a light source, the brightness difference between different areas of the picture is large.
  • the overall brightness of the picture is usually high, and the brightness distribution is uniform, and no obvious high and dark areas are formed, that is, the brightness difference between different areas is small.
  • the current shooting scene may be determined. Belongs to night scenes.
  • the fourth threshold of the average brightness of the preview screen and the fifth threshold of the brightness difference between different regions may be preset according to actual needs or experience, which is not limited in the embodiment of the present application.
  • Step 302 Determine a night scene mode corresponding to the current shooting scene according to the degree of shaking of the camera module.
  • the night scene mode refers to a shooting mode that can be activated when the current shooting scene is determined to be a night scene.
  • the night scene mode includes a combination of various shooting parameters, such as sensitivity, exposure duration, exposure compensation mode, frame number of the captured image, and the like.
  • the degree of shake of the camera module will affect the quality of the captured image.
  • the degree of shake of the camera module is too large, the captured image will contain obvious ghosts and it will be difficult to eliminate.
  • the degree of camera shake will increase during handheld shooting, which will affect the image quality. Therefore, in the embodiment of the present application, the night scene mode corresponding to the current shooting scene may be determined according to the current shaking degree of the camera module, so that the shooting duration is controlled within a proper range.
  • the current shake level of the camera module is "no shake”
  • the night scene mode corresponding to the current shooting scene is "tripod night mode”
  • the current shake level of the camera module is "with shake”
  • the night scene mode corresponding to the current shooting scene is "handheld night scene mode”.
  • Step 303 Determine a target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image according to the night scene mode and the illumination of the current shooting scene.
  • Step 304 Determine the exposure duration of each frame of the to-be-acquired image according to the night scene mode and the target exposure amount of each frame of the to-be-acquired image, and sequentially collect multiple frames of images and perform synthesis processing based on the night-scape mode and the exposure time. .
  • the image to be acquired per frame can be determined according to the parameter settings (sensitivity, exposure compensation mode, etc.) in the night scene mode and the light intensity of the current shooting scene.
  • the target exposure amount and exposure duration are based on the parameter settings in the night scene mode and the exposure duration, and multiple frames of images are sequentially acquired and synthesized.
  • the image processing method provided in the embodiment of the present application can be used to determine the target exposure amount and exposure time of each frame of images to be acquired, and according to this The image processing method provided in the embodiment of the application synthesizes acquired multiple frames of images. If it is determined that the night scene mode corresponding to the current shooting scene is "handheld night scene mode", multiple frames of images can be collected and synthesized according to the parameter settings in the night scene mode.
  • the current shooting scene is determined to be a night scene according to the screen content of the current preview screen, and the night mode corresponding to the current shooting scene is determined according to the degree of shake of the camera module.
  • the night scene mode and lighting level corresponding to the shooting scene determine the target exposure of the image to be collected for each frame.
  • the present application also proposes an image processing apparatus.
  • FIG. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
  • the image processing apparatus 40 includes:
  • a first determining module 41 configured to determine a target exposure amount of each of the frames of images to be collected in the plurality of frames of images to be collected according to the illumination of the current shooting scene;
  • the second determining module 42 is configured to determine an exposure duration of the image to be acquired for each frame according to a preset sensitivity and the target exposure amount of the image to be acquired for each frame;
  • An acquisition module 43 configured to sequentially acquire multiple frames of images according to the preset sensitivity and exposure time of each frame of images to be acquired;
  • a synthesis module 44 is configured to perform synthesis processing on the collected multiple frames of images to generate a target image.
  • the image processing apparatus provided in the embodiment of the present application may be configured in any electronic device to execute the foregoing image processing method.
  • the image processing device may determine the target exposure amount of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image according to the illumination of the current shooting scene, and according to the preset sensitivity and the target of the to-be-acquired image per frame
  • the amount of exposure determines the exposure time of the image to be collected for each frame, and then according to the preset sensitivity and the exposure time of the image to be collected for each frame, multiple frames of images are sequentially collected and synthesized to generate a target image.
  • the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
  • the image processing apparatus 40 further includes:
  • the third determining module is configured to determine the preset sensitivity according to a current shaking degree of the camera module.
  • the image processing apparatus 40 further includes:
  • a fourth determining module is configured to determine the preset exposure compensation mode according to a current shaking degree of the camera module. Further, in another possible implementation form of the present application, the image processing apparatus 40 further includes:
  • a fifth determining module configured to determine that the current shooting scene belongs to a night scene according to the picture content of the current preview picture
  • a sixth determining module configured to determine a night scene mode corresponding to the current shooting scene according to the degree of shaking of the camera module
  • the first determining module 41 is further configured to:
  • a target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image is determined.
  • the foregoing first determining module 41 is specifically configured to:
  • the target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount, the exposure compensation range of the images to be acquired for multiple frames, and a preset exposure compensation mode.
  • the foregoing second determining module 42 is specifically configured to:
  • the foregoing acquisition module 43 is specifically configured to:
  • the above-mentioned acquisition module 43 is further configured to:
  • the brightness information of the first acquisition frame displayed on the preview screen is adjusted by using the synthesized brightness information.
  • the above-mentioned synthesis module 44 is specifically configured to:
  • the image processing device may determine the target exposure amount of each frame of the to-be-collected image and the weight value corresponding to each frame of the to-be-collected image according to the illumination of the current shooting scene, and according to a preset Sensitivity and the target exposure of each frame of images to be acquired, determine the exposure time of each frame of images to be acquired, and then according to the preset sensitivity and exposure time of each frame of images to be acquired, sequentially collect multiple frames of images and use the weight value
  • the brightness information of the captured image is synthesized in real time, and then the non-brightness information in the metadata of the collected multiple frames of images is synthesized to generate the initial target image, and according to the brightness information of the image currently displayed on the preview screen, Update the brightness information of the initial target image to generate a target image.
  • the exposure duration and weight value of each frame of the image to be collected are determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images of different exposure durations are captured and multiple frames of images are synthesized in real time according to the weight value
  • the brightness information and the non-brightness information of the multi-frame image are synthesized later, which not only further improves the quality of the captured image, but also reduces the data processing time, shortens the shooting time, and improves the user experience.
  • the present application also proposes an electronic device.
  • FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • the above-mentioned electronic device 200 includes a camera module 201, a memory 210, a processor 220, and a computer program stored in the memory and executable on the processor.
  • the processor executes the program, it implements The scene recognition method described in the embodiment of the present application.
  • the electronic device 200 provided in the embodiment of the present application may further include:
  • the memory 210 and the processor 220 are connected to a bus 230 of different components (including the memory 210 and the processor 220).
  • the memory 210 stores a computer program.
  • the processor 220 executes the program, the image processing method according to the embodiment of the present application is implemented. .
  • the bus 230 represents one or more of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local area bus using any of a variety of bus structures.
  • these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the enhanced ISA bus, the Video Electronics Standards Association (VESA) local area bus, and peripheral component interconnects ( PCI) bus.
  • the electronic device 200 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by the electronic device 200, including volatile and non-volatile media, removable and non-removable media.
  • the memory 210 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 240 and / or cache memory 250.
  • the electronic device 200 may further include other removable / non-removable, volatile / nonvolatile computer system storage media.
  • the storage system 260 may be used to read and write non-removable, non-volatile magnetic media (not shown in FIG. 5 and is commonly referred to as a "hard drive").
  • a disk drive for reading and writing to a removable non-volatile disk (such as a "floppy disk"), and a removable non-volatile optical disk (such as a CD-ROM, DVD-ROM, etc.) may be provided. Or other optical media).
  • each drive may be connected to the bus 230 through one or more data medium interfaces.
  • the memory 210 may include at least one program product having a set (for example, at least one) of program modules configured to perform the functions of the embodiments of the present application.
  • a program / utility tool 280 having a set (at least one) of program modules 270 may be stored in, for example, the memory 210.
  • Such program modules 270 include, but are not limited to, an operating system, one or more applications, other programs Modules and program data, each or some combination of these examples may include an implementation of a network environment.
  • Program module 270 typically performs the functions and / or methods in the embodiments described herein.
  • the electronic device 200 may also communicate with one or more external devices 290 (such as a keyboard, pointing device, display 291, etc.), and may also communicate with one or more devices that enable a user to interact with the electronic device 200, and / or with Any device (such as a network card, modem, etc.) that enables the electronic device 200 to communicate with one or more other computing devices. This communication can be performed through an input / output (I / O) interface 292.
  • the electronic device 200 may also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 293.
  • the network adapter 293 communicates with other modules of the electronic device 200 through the bus 230.
  • the processor 220 executes various functional applications and data processing by running a program stored in the memory 210.
  • the electronic device provided by the embodiment of the present application can execute the image processing method as described above.
  • the current jitter level of the camera module is detected, and the number of images to be acquired and the The reference sensitivity corresponding to the frame to be acquired, and then based on the illumination of the current shooting scene and the reference sensitivity corresponding to each frame of the to-be-acquired image, determine the exposure duration corresponding to each frame of the to-be-acquired image, and then according to the reference corresponding to each frame of the to-be-acquired image Sensitivity and exposure time, multiple frames of images are collected in sequence, and the collected multiple frames of images are synthesized to generate a target image.
  • the number of images to be acquired and the reference sensitivity are determined according to the current jitter of the camera module, and the exposure time corresponding to each frame of the image to be acquired is determined according to the illumination of the current shooting scene, so that multiple different photos are taken by shooting
  • Combining images with long exposure time not only improves the dynamic range and overall brightness of the captured image in night scene shooting mode, effectively suppresses noise in the captured image, but also suppresses ghosting and blurring caused by hand-held shake, which improves the night shot image. Quality and improved user experience.
  • the present application also proposes a computer-readable storage medium.
  • the computer-readable storage medium stores a computer program thereon, and when the program is executed by a processor, the image processing method according to the embodiment of the present application is implemented.
  • another embodiment of the present application provides a computer program, which is executed by a processor to implement the image processing method described in the embodiment of the present application.
  • the computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium.
  • the computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing.
  • a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.
  • the computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave, which carries a computer-readable program code. This propagated data signal can take many forms, including but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • the computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
  • Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
  • Computer program code for performing the operations of this application may be written in one or more programming languages, or a combination thereof, including programming languages such as Java, Smalltalk, C ++, and also conventional Procedural programming language—such as "C" or similar programming language.
  • the program code may be executed entirely on the user electronic device, partly on the user electronic device, as a separate software package, partly on the user electronic device, partly on the remote electronic device, or entirely on the remote electronic device or On the server.
  • the remote electronic device can be connected to the user's electronic device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external electronic device (e.g., using Internet services) Provider to connect via the Internet).
  • LAN local area network
  • WAN wide area network
  • Internet services Provider to connect via the Internet

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

The present application relates to the technical field of imaging, and provided thereby are an image processing method and device, an electronic device and a storage medium. The method comprises: determining a target exposure amount of each image to be acquired among multiple images to be acquired according to the illuminance of a current capture scene; determining an exposure duration of the each image to be acquired according to a preset sensitivity and the target exposure of the each image to be acquired; acquiring multiple images sequentially according to the preset sensitivity and the exposure duration of the each image to be acquired; and synthesizing the acquired multiple images so as to generate a target image. Thus, by means of the described image processing method, the dynamic range and overall brightness of a capture image are improved, and the noise in the captured image is also effectively suppressed, so that bright and dark areas may both be clearly displayed, the quality of the capture image is improved, and the user experience is thus improved.

Description

图像处理方法、装置、电子设备及存储介质Image processing method, device, electronic equipment and storage medium
相关申请的交叉引用Cross-reference to related applications
本申请要求OPPO广东移动通信有限公司于2018年9月20日提交的、发明名称为“图像处理方法、装置、电子设备及存储介质”的、中国专利申请号“201811103107.3”的优先权。This application claims the priority of China Patent Application No. “201811103107.3” filed by OPPO Guangdong Mobile Communication Co., Ltd. on September 20, 2018 with the invention name “Image Processing Method, Device, Electronic Equipment and Storage Medium”.
技术领域Technical field
本申请涉及成像技术领域,尤其涉及一种图像处理方法、装置、电子设备及存储介质。The present application relates to the field of imaging technology, and in particular, to an image processing method, device, electronic device, and storage medium.
背景技术Background technique
随着科技的发展,智能移动终端(如智能手机、平板电脑等)越来越普及。绝大多数智能手机和平板电脑都内置有摄像头,并且随着移动终端处理能力的增强以及摄像头技术的发展,内置摄像头的性能越来越强大,拍摄图像的质量也越来越高。现在移动终端的操作简单又便于携带,在日常生活中人们使用智能手机和平板电脑等移动终端拍照已经成为一种常态。With the development of technology, smart mobile terminals (such as smart phones, tablet computers, etc.) are becoming more and more popular. Most smartphones and tablets have a built-in camera, and with the enhancement of mobile terminal processing capabilities and the development of camera technology, the performance of the built-in camera is getting stronger and the quality of captured images is getting higher and higher. Now the operation of mobile terminals is simple and easy to carry. In daily life, people use mobile terminals such as smart phones and tablets to take pictures.
智能移动终端在给人们的日常拍照带来便捷的同时,人们对拍摄的图像质量的要求也越来越高。然而,由于专业水平限制,人们不知如何根据拍摄场景设置合适的拍摄参数,因此很难拍出与专业相机效果一样好的图像。While smart mobile terminals bring convenience to people's daily photography, people's requirements for the quality of captured images are also getting higher and higher. However, due to the limitation of professional level, people do not know how to set appropriate shooting parameters according to the shooting scene, so it is difficult to take an image as good as a professional camera.
发明内容Summary of the Invention
本申请提出的图像处理方法、装置、电子设备及存储介质,用于解决相关技术中,在夜景场景中拍摄的图像不仅动态范围有限,而且高亮区和暗区不能清晰显示,影响用户体验的问题。The image processing method, device, electronic device, and storage medium proposed in this application are used to solve the related art. Images captured in night scenes not only have a limited dynamic range, but also highlights and dark areas cannot be clearly displayed, affecting user experience. problem.
本申请一方面实施例提出的图像处理方法,包括:根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量;根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长;根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像;将所述采集的多帧图像进行合成处理,以生成目标图像。The image processing method according to the embodiment of one aspect of the present application includes: determining a target exposure amount of each frame of the to-be-acquired image in a plurality of frames of the to-be-acquired image according to the illumination of the current shooting scene; and according to a preset sensitivity and the The target exposure of the collected image determines the exposure time of each frame of the image to be collected; according to the preset sensitivity and the exposure time of each frame of the image to be acquired, multiple frames of images are sequentially acquired; and the acquired multiple frames of images are processed Synthesis processing to generate a target image.
本申请另一方面实施例提出的图像处理装置,包括:第一确定模块,用于根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量;第二确定模块, 用于根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长;采集模块,用于根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像;合成模块,用于将所述采集的多帧图像进行合成处理,以生成目标图像。An image processing device provided by another embodiment of the present application includes: a first determining module, configured to determine a target exposure amount of each of the frames of images to be acquired among a plurality of frames of images to be acquired according to the illumination of the current shooting scene; a second determination module Is configured to determine the exposure duration of each frame of the to-be-acquired image according to the preset sensitivity and the target exposure amount of the image to be collected per frame; the acquisition module is configured to be based on the preset sensitivity and each frame to be collected The exposure time of the image is to sequentially acquire multiple frames of images; a synthesis module is configured to synthesize the acquired multiple frames of images to generate a target image.
本申请再一方面实施例提出的电子设备,其包括:所述摄像模组、存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现如前所述的图像处理方法。An electronic device according to another embodiment of the present application includes: the camera module, a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes The program realizes the image processing method as described above.
本申请再一方面实施例提出的计算机可读存储介质,其上存储有计算机程序,其特征在于,所述程序被处理器执行时实现如前所述的图像处理方法。The computer-readable storage medium provided by the embodiments of the present invention in another aspect stores a computer program thereon, which is characterized in that, when the program is executed by a processor, the image processing method described above is implemented.
本申请又一方面实施例提出的计算机程序,该程序被处理器执行时,以实现本申请实施例所述的图像处理方法。A computer program according to another embodiment of the present application, which is executed by a processor to implement the image processing method according to the embodiment of the present application.
本申请实施例提供的图像处理方法、装置、电子设备、计算机可读存储介质及计算机程序,可以根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,并根据预设的感光度及每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,进而根据预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像并进行合成处理,生成目标图像。由此,通过根据当前拍摄场景的光照度以及预设的感光度,确定了每帧待采集图像的曝光时长,从而通过拍摄多张不同曝光时长的图像并进行合成,不仅提升了拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,使得高亮区和暗区都能清晰显示,提高了拍摄图像的质量,改善了用户体验。The image processing method, device, electronic device, computer-readable storage medium, and computer program provided in the embodiments of the present application can determine the target exposure amount of each frame of the to-be-acquired image in the multi-frame to-be-acquired image according to the illumination of the current shooting scene, and According to the preset sensitivity and the target exposure of each frame of images to be acquired, determine the exposure time of each frame of images to be acquired, and then according to the preset sensitivity and the exposure time of each frame of images to be acquired, sequentially collect multiple frames of images and Perform synthesis processing to generate a target image. Therefore, the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
本申请附加的方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实践了解到。Additional aspects and advantages of the present application will be given in part in the following description, part of which will become apparent from the following description, or be learned through practice of the present application.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
本申请上述的和/或附加的方面和优点从下面结合附图对实施例的描述中将变得明显和容易理解,其中:The above and / or additional aspects and advantages of this application will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:
图1为本申请实施例所提供的一种图像处理方法的流程示意图;FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application;
图2为本申请实施例所提供的另一种图像处理方法的流程示意图;2 is a schematic flowchart of another image processing method according to an embodiment of the present application;
图3为本申请实施例所提供的另一种图像处理方法的流程示意图;3 is a schematic flowchart of another image processing method according to an embodiment of the present application;
图4为本申请实施例所提供的一种图像处理装置的结构示意图;4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;
图5为本申请实施例所提供的一种电子设备的结构示意图;5 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
图6为本申请实施例所提供的另一种电子设备的结构示意图。FIG. 6 is a schematic structural diagram of another electronic device according to an embodiment of the present application.
具体实施方式detailed description
下面详细描述本申请的实施例,所述实施例的示例在附图中示出,其中自始至终相同或类似的标号表示相同或类似的要素。下面通过参考附图描述的实施例是示例性的,旨在用于解释本申请,而不能理解为对本申请的限制。Hereinafter, embodiments of the present application will be described in detail. Examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements throughout. The embodiments described below with reference to the drawings are exemplary, and are intended to explain the present application, and should not be construed as limiting the present application.
本申请实施例针对相关技术中,在夜景场景中拍摄的图像不仅动态范围有限,而且高亮区和暗区不能清晰显示,影响用户体验的问题,提出一种图像处理方法。The embodiments of the present application propose an image processing method for the problem that, in the related art, an image captured in a night scene scene has a limited dynamic range, and highlights and dark areas cannot be clearly displayed, which affects the user experience.
本申请实施例提供的图像处理方法,可以根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,并根据预设的感光度及每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,进而根据预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像并进行合成处理,生成目标图像。由此,通过根据当前拍摄场景的光照度以及预设的感光度,确定了每帧待采集图像的曝光时长,从而通过拍摄多张不同曝光时长的图像并进行合成,不仅提升了拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,使得高亮区和暗区都能清晰显示,提高了拍摄图像的质量,改善了用户体验。According to the image processing method provided in the embodiment of the present application, the target exposure amount of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image may be determined according to the illumination of the current shooting scene, and the preset sensitivity and the target of the to-be-acquired image per frame The amount of exposure determines the exposure time of the image to be collected for each frame, and then according to the preset sensitivity and the exposure time of the image to be collected for each frame, multiple frames of images are sequentially collected and synthesized to generate a target image. Therefore, the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
下面参考附图对本申请提供的图像处理方法、装置、电子设备、存储介质及计算机程序进行详细描述。The image processing method, device, electronic device, storage medium, and computer program provided in the present application are described in detail below with reference to the drawings.
图1为本申请实施例所提供的一种图像处理方法的流程示意图。FIG. 1 is a schematic flowchart of an image processing method according to an embodiment of the present application.
如图1所示,该图像处理方法,包括以下步骤:As shown in FIG. 1, the image processing method includes the following steps:
步骤101,根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量。Step 101: Determine a target exposure amount of each frame of the image to be acquired in the plurality of frames of the image to be acquired according to the illumination of the current shooting scene.
人们在使用移动终端进行日常拍照时,由于专业水平限制,人们不知如何根据拍摄场景设置合适的拍摄参数,因此很难拍出与专业相机效果一样好的图像,尤其在阴雨天气、逆光场景、夜景等特殊场景中,拍摄的图像质量较差。比如,在夜景场景中拍摄的图像,高亮区容易过曝,不能清晰显示,而暗区又会过暗,或者提亮后噪点过多。When people use mobile terminals for daily photography, due to the limitation of professional level, people do not know how to set appropriate shooting parameters according to the shooting scene, so it is difficult to take images as good as professional cameras, especially in rainy weather, backlit scenes, night scenes In other special scenes, the image quality is poor. For example, in a night scene, the bright areas are easily overexposed and cannot be displayed clearly, and the dark areas are too dark, or there is too much noise after being brightened.
在本申请实施例中,可以利用摄像模组中的测光模块,获取当前拍摄场景的光照度,并利用自动曝光控制(Auto Exposure Control,简称AEC)算法,确定当前光照度对应的曝光量。In the embodiment of the present application, the light metering module in the camera module can be used to obtain the light intensity of the current shooting scene, and an automatic exposure control (Auto Exposure Control (AEC) algorithm) is used to determine the exposure amount corresponding to the current light intensity.
需要说明的是,在本申请实施例一种可能实现的形式中,可以通过采用不同的曝光量分别采集多帧图像,并将采集的多帧图像合成以生成目标图像的方式,提升拍摄图像的动态范围和整体亮度,进而提高拍摄图像的质量。其中,待采集图像的数量可以根据实际需要提前预设,比如,在本申请实施例中,采集图像的数量可以是20帧。It should be noted that, in a possible implementation form of the embodiment of the present application, multiple frames of images can be collected by using different exposure amounts, and the collected multiple frames of images can be combined to generate a target image to improve the captured image. Dynamic range and overall brightness to improve the quality of captured images. The number of images to be acquired may be preset in advance according to actual needs. For example, in the embodiment of the present application, the number of images to be acquired may be 20 frames.
进一步的,可以通过当前拍摄场景的光照度以及预设的曝光补偿模式,确定每帧待采集图像的目标曝光量,以对多帧待采集的图像进行不同的曝光补偿。即在本申请实施例一 种可能的实现形式中,上述步骤101,可以包括:Further, the target exposure amount of the image to be acquired in each frame can be determined through the illumination of the current shooting scene and the preset exposure compensation mode, so as to perform different exposure compensation on the images to be acquired in multiple frames. That is, in a possible implementation form of this embodiment of the present application, the foregoing step 101 may include:
根据所述当前拍摄场景的光照度,确定基准曝光量及多帧待采集图像的曝光补偿范围;Determining a reference exposure amount and an exposure compensation range of multiple frames of images to be acquired according to the illumination of the current shooting scene;
根据所述基准曝光量、多帧待采集图像的曝光补偿范围及预设的曝光补偿模式,确定所述每帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount, the exposure compensation range of the images to be acquired for multiple frames, and a preset exposure compensation mode.
其中,基准曝光量,是指根据当前拍摄场景的光照度,确定的当前拍摄场景的光照度对应的正常曝光量。曝光补偿范围,是指所有待采集图像对应的曝光补偿值所在的范围。The reference exposure amount refers to a normal exposure amount corresponding to the lightness of the current shooting scene determined according to the lightness of the current shooting scene. The exposure compensation range refers to the range of exposure compensation values corresponding to all the images to be acquired.
在本申请实施例中,预设的曝光补偿模式,是指为每帧待采集图像分别预设的曝光值(Exposure Value,简称EV)的组合。在曝光值最初的定义中,曝光值并不是指一个准确的数值,而是指“能够给出相同的曝光量的所有相机光圈与曝光时长的组合”。感光度、光圈和曝光时长确定了相机的曝光量,不同的参数组合可以产生相等的曝光量,即这些不同组合的EV值是一样的,比如,在感光度相同的情况下,使用1/125秒曝光时长和f11的光圈组合,与使用1/250秒曝光时间与f8快门的组合,获得的曝光量是相同的,即EV值是相同的。EV值为0时,是指感光度为100、光圈系数为f1、曝光时长为1秒时获得的曝光量;曝光量增加一档,即曝光时长增加一倍,或者感光度增加一倍,或者光圈增加一档,EV值增加1,也就是说,1EV对应的曝光量是0EV对应的曝光量的两倍。如表1所示,为曝光时长、光圈、感光度分别单独变化时,与EV值的对应关系。In the embodiment of the present application, the preset exposure compensation mode refers to a combination of preset exposure values (EV) for each image to be acquired. In the original definition of the exposure value, the exposure value does not refer to an exact value, but refers to "the combination of all camera apertures and exposure times that can give the same exposure amount." Sensitivity, aperture, and exposure time determine the exposure of the camera. Different parameter combinations can produce equal exposure, that is, the EV values of these different combinations are the same. For example, if the sensitivity is the same, use 1/125. The combination of the exposure time in seconds and the aperture of f11 is the same as that obtained by using the combination of 1/250 second exposure time and f8 shutter, that is, the EV value is the same. When the EV value is 0, it means the exposure amount obtained when the sensitivity is 100, the aperture factor is f1, and the exposure duration is 1 second; the exposure amount is increased by one stop, that is, the exposure duration is doubled, or the sensitivity is doubled, or When the aperture is increased by one stop, the EV value is increased by 1, that is, the exposure amount corresponding to 1EV is twice the exposure amount corresponding to 0EV. As shown in Table 1, the corresponding relationship with the EV value when the exposure duration, aperture, and sensitivity are individually changed.
表1Table 1
Figure PCTCN2019091579-appb-000001
Figure PCTCN2019091579-appb-000001
摄影技术进入到数码时代之后,相机内部的测光功能已经非常强大,EV则经常用来表示曝光刻度上的一个级差,许多相机都允许设置曝光补偿,并通常用EV来表示。在这种情况下,EV是指相机测光数据对应的曝光量与实际曝光量的差值,比如+1EV的曝光补偿是指相对于相机测光数据对应的曝光量增加一档曝光,即实际曝光量为相机测光数据对应的曝光量的两倍。After the photography technology entered the digital age, the metering function inside the camera has become very powerful, and EV is often used to indicate a step difference on the exposure scale. Many cameras allow exposure compensation to be set, which is usually expressed in EV. In this case, EV refers to the difference between the exposure amount corresponding to the camera metering data and the actual exposure amount. For example, + 1EV exposure compensation refers to an increase of one exposure relative to the exposure amount corresponding to the camera metering data, that is, the actual The exposure is twice the exposure corresponding to the camera's metering data.
在本申请实施例中,预设曝光补偿模式时,可以将确定的基准曝光量对应的EV值预设为0,+1EV是指增加一档曝光,即曝光量为基准曝光量的2倍,+2EV是指增加两档曝光,即曝光量为基准曝光量的4倍,-1EV是指减少一档曝光,即曝光量为基准曝光量的0.5倍 等等。In the embodiment of the present application, when the exposure compensation mode is preset, the EV value corresponding to the determined reference exposure amount can be preset to 0, and + 1EV means to increase the exposure by one step, that is, the exposure amount is twice the reference exposure amount. + 2EV means to increase the exposure by two stops, that is, the exposure is 4 times the reference exposure, -1EV means to decrease the exposure by one stop, that is, the exposure is 0.5 times the reference exposure, and so on.
需要说明的是,在本申请实施例一种可能的实现形式中,还可以预设拍摄场景的光照度阈值,并根据当前拍摄场景的光照度与阈值的关系,确定多帧待采集图像的曝光补偿范围。It should be noted that, in a possible implementation form of the embodiment of the present application, the illumination threshold of the shooting scene can also be preset, and according to the relationship between the illumination of the current shooting scene and the threshold, the exposure compensation range of multiple frames of images to be acquired is determined. .
可以理解的是,EV值为负值时,采集到的图像为欠曝帧,可以压制高光区域的亮度,防止高光区域过曝,保留高光区域的细节;EV值为正值时,采集到的图像为过曝帧,可以提高暗区的亮度,并进行时域降噪,在提升暗部细节的同时抑制噪声。因此,若当前拍摄场景的光照度大于阈值,即当前拍摄场景较亮,则可以将多帧待采集图像中对应的最小曝光度EV等级适当降低,或最大曝光度等级适当减小,以适当减小多帧待采集图像的曝光补偿范围,比如曝光补偿范围可以是-24EV~8EV,从而减少当前拍摄场景下采集的图像的数量,进而提高拍摄速度;若当前拍摄场景的光照度小于阈值,即当前拍摄场景较暗,则可以将多帧待采集图像中对应的最小曝光度EV等级适当增大或最大曝光度EV等级适当增大,以保证暗部细节足够清晰,此时多帧待采集图像的曝光补偿范围较大,比如曝光补偿范围可以是-22EV~12EV。It can be understood that when the EV value is negative, the captured image is an underexposed frame, which can suppress the brightness of the highlight area, prevent overexposure of the highlight area, and retain the details of the highlight area; when the EV value is positive, the captured The image is an overexposed frame, which can increase the brightness of the dark area and perform time-domain noise reduction to suppress the noise while improving the details of the dark part. Therefore, if the light level of the current shooting scene is greater than the threshold, that is, the current shooting scene is bright, the corresponding minimum exposure EV level in the multiple frames of images to be collected can be appropriately reduced, or the maximum exposure level can be appropriately reduced to appropriately reduce The exposure compensation range of images to be acquired for multiple frames. For example, the exposure compensation range can be -24EV to 8EV, which reduces the number of images captured in the current shooting scene, thereby increasing the shooting speed. If the light intensity of the current shooting scene is less than the threshold, the current shooting If the scene is dark, the corresponding minimum exposure EV level or maximum exposure EV level in multiple frames of images to be collected can be appropriately increased to ensure that the details in the dark are sufficiently clear. At this time, the exposure compensation of the multiple frames of images to be collected is compensated. The range is large, for example, the exposure compensation range can be -22EV ~ 12EV.
在本申请实施例中一种可能的实现形式中,确定出曝光补偿范围之后,即可选取出与曝光补偿范围相符的预设的曝光补偿模式,进而根据基准曝光量和预设的曝光补偿模式,确定每帧待采集图像对应的目标曝光量。In a possible implementation form in the embodiment of the present application, after the exposure compensation range is determined, a preset exposure compensation mode corresponding to the exposure compensation range can be selected, and then according to the reference exposure amount and the preset exposure compensation mode To determine the target exposure for each frame of image to be acquired.
举例来说,若待采集的图像数量为20帧,根据当前拍摄环境的光照度确定的基准曝光量为X,曝光补偿范围为-24EV~12EV,则预设的曝光补偿模式对应的EV值可以是[+12,+12,+8,+8,+4,+4,0,0,-4,-4,-8,-8,-12,-12,-16,-16,-20,-20,-24,-24]。之后即可根据基准曝光量X和预设的曝光补偿模式,确定每帧待采集图像对应的目标曝光量,假设第i帧图像对应的EV值为EV i,则其对应的目标曝光量为
Figure PCTCN2019091579-appb-000002
如EV值为0的待采集图像对应的目标曝光量为X,EV值为+4的待采集图像对应的目标曝光量为2 4·X,EV值为-4的待采集图像对应的目标曝光量为2 -4·X。
For example, if the number of images to be acquired is 20 frames, the reference exposure amount determined according to the illumination of the current shooting environment is X, and the exposure compensation range is -24EV to 12EV, the EV value corresponding to the preset exposure compensation mode can be [+ 12, + 12, + 8, + 8, + 4, + 4,0,0, -4, -4, -8, -8, -12, -12, -16, -16, -20, -20, -24, -24]. Then, according to the reference exposure amount X and the preset exposure compensation mode, the target exposure amount corresponding to the image to be acquired for each frame is determined. Assuming that the EV value corresponding to the i-th frame image is EV i , the corresponding target exposure amount is
Figure PCTCN2019091579-appb-000002
For example, the target exposure for the image to be acquired with an EV value of 0 is X, and the target exposure for the image to be acquired with an EV value of +4 is 2 4 · X, and the target exposure for the image to be acquired with an EV value of -4 The amount is 2 -4 · X.
进一步的,对于相同的曝光补偿范围,预设的曝光补偿模式可以有多种,实际使用时,可以根据摄像模组的实时情况,确定与当前情况相符的曝光补偿模式。即在本申请实施例一种可能的实现形式中,上述步骤101之前,还可以包括:Further, for the same exposure compensation range, there may be multiple preset exposure compensation modes. In actual use, an exposure compensation mode consistent with the current situation may be determined according to the real-time situation of the camera module. That is, in a possible implementation form of the embodiment of the present application, before step 101, the method may further include:
根据所述摄像模组当前的抖动程度,确定所述预设的曝光补偿模式。Determining the preset exposure compensation mode according to the current shake degree of the camera module.
在本申请实施例中,可以通过获取电子设备当前的陀螺仪(Gyro-sensor)信息,确定手机当前的抖动程度,即摄像模组当前的抖动程度。In the embodiment of the present application, the current jitter degree of the mobile phone, that is, the current jitter degree of the camera module can be determined by acquiring the current gyro sensor information of the electronic device.
陀螺仪又叫角速度传感器,可以测量物理量偏转、倾斜时的转动角速度。在电子设备 中,陀螺仪可以很好的测量转动、偏转的动作,从而可以精确分析判断出使用者的实际动作。电子设备的陀螺仪信息(gyro信息)可以包括手机在三维空间中三个维度方向上的运动信息,三维空间的三个维度可以分别表示为X轴、Y轴、Z轴三个方向,其中,X轴、Y轴、Z轴为两两垂直关系。Gyroscope is also called angular velocity sensor, which can measure the angular velocity of rotation when the physical quantity is deflected and tilted. In electronic equipment, the gyroscope can measure the movements of rotation and deflection very well, so that it can accurately analyze and judge the actual movement of the user. The gyroscope information (gyro information) of the electronic device may include the movement information of the mobile phone in three dimensions in the three-dimensional space, and the three dimensions of the three-dimensional space may be respectively represented in the three directions of the X-axis, Y-axis, and Z-axis. Among them, The X-axis, Y-axis, and Z-axis are perpendicular to each other.
需要说明的是,在本申请实施例一种可能的实现形式中,可以根据电子设备当前的gyro信息,确定摄像模组当前的抖动程度。电子设备在三个方向上的gyro运动的绝对值越大,则摄像模组的抖动程度越大。具体的,可以预设在三个方向上gyro运动的绝对值阈值,并根据获取到的当前在三个方向上的gyro运动的绝对值之和,与预设的阈值的关系,确定摄像模组的当前的抖动程度。It should be noted that, in a possible implementation form of the embodiment of the present application, the current jitter degree of the camera module may be determined according to the current gyro information of the electronic device. The greater the absolute value of the gyro movement of the electronic device in the three directions, the greater the degree of jitter of the camera module. Specifically, the absolute value threshold of the gyro movement in the three directions can be preset, and the camera module is determined according to the relationship between the acquired absolute value of the current gyro movement in the three directions and the preset threshold. The current degree of jitter.
举例来说,假设预设的阈值为第一阈值A、第二阈值B、第三阈值C,且A<B<C,当前获取到的在三个方向上gyro运动的绝对值之和为S。若S<A,则确定摄像模组当前的抖动程度为“无抖动”;若A<S<B,则可以确定摄像模组当前的抖动程度为“轻微抖动”;若B<S<C,则可以确定摄像模组当前的抖动程度为“小抖动”;若S>C,则可以确定摄像模组当前的抖动程度为“大抖动”。For example, suppose the preset thresholds are the first threshold A, the second threshold B, and the third threshold C, and A <B <C. The sum of the absolute values of the gyro motion in the three directions currently obtained is S . If S <A, determine the current jitter of the camera module as “no shake”; if A <S <B, you can determine the current jitter of the camera module as “slight shake”; if B <S <C, Then, it can be determined that the current shake degree of the camera module is "small shake"; if S> C, it can be determined that the current shake degree of the camera module is "large shake".
需要说明的是,上述举例仅为示例性的,不能视为对本申请的限制。实际使用时,可以根据实际需要预设阈值的数量和各阈值的具体数值,以及根据gyro信息与各阈值的关系,预设gyro信息与摄像模组抖动程度的映射关系。It should be noted that the above examples are merely exemplary, and should not be regarded as limiting the present application. In actual use, the number of thresholds and specific values of each threshold can be preset according to actual needs, and the mapping relationship between the gyro information and the degree of camera module shake can be preset according to the relationship between the gyro information and each threshold.
需要说明的是,在本申请实施例一种可能的实现形式中,还可以预设多组待采集的图像数量,进而根据摄像模组当前的抖动程度,从预设的多组待采集的图像数量中,确定出最佳的一组待采集的图像数量。而待采集的图像数量不同时,需要采用不同的曝光补偿模式。因此,可以预设摄像模组的抖动程度与曝光补偿模式的映射关系,以根据摄像模组当前的抖动程度,确定出既与当前的抖动程度相符,又与曝光补偿范围相符的预设的曝光补偿模式。It should be noted that, in a possible implementation form of the embodiment of the present application, the number of images to be acquired can also be preset, and then according to the current jitter of the camera module, the preset number of images to be acquired is Among the numbers, the optimal number of images to be acquired is determined. When the number of images to be acquired is different, different exposure compensation modes need to be adopted. Therefore, the mapping relationship between the shake degree of the camera module and the exposure compensation mode can be preset, so as to determine a preset exposure that matches both the current shake degree and the exposure compensation range according to the current shake degree of the camera module. Compensation mode.
比如,若曝光补偿范围为-24EV~12EV,则摄像模组抖动程度为“无抖动”时,对应的曝光补偿模式为:[+12EV,+12EV,+8EV,+8EV,+4EV,+4EV,0EV,0EV,-4EV,-4EV,-8EV,-8EV,-12EV,-12EV,-16EV,-16EV,-20EV,-20EV,-24EV,-24EV],即“无抖动”对应的待采集的图像数量为20;摄像模组抖动程度为“轻微抖动”时,对应的曝光补偿模式为:[+12EV,+8EV,+4EV,0EV,-4EV,-8EV,-12EV,-16EV,-20EV,-24EV],即“轻微抖动”对应的待采集的图像数量为10等等。For example, if the exposure compensation range is -24EV ~ 12EV, when the camera module shake degree is "no shake", the corresponding exposure compensation mode is: [+ 12EV, + 12EV, + 8EV, + 8EV, + 4EV, + 4EV , 0EV, 0EV, -4EV, -4EV, -8EV, -8EV, -12EV, -12EV, -16EV, -16EV, -20EV, -20EV, -24EV, -24EV]. The number of captured images is 20; when the camera module shake is "slightly shake", the corresponding exposure compensation mode is: [+ 12EV, + 8EV, + 4EV, 0EV, -4EV, -8EV, -12EV, -16EV, -20EV, -24EV], that is, the number of images to be acquired corresponding to "slight jitter" is 10 and so on.
可以理解的是,当摄像模组的抖动程度较小时,可以采集较多帧的图像,即对应的曝光补偿模式中包含的EV值的个数较多,且与待采集图像的数量相同,从而使得最终拍摄到的图像质量更高;当摄像模组的抖动程度较大时,可以采集较少帧的图像,以避免拍摄时 长过长加剧抖动程度,从而造成拍摄到的图像中包含不可消除的鬼影,即对应的曝光补偿模式中包含的EV值的个数较少,且与待采集图像的数量相同,从而在保证图像曝光补偿范围的同时,尽量降低摄像模组的抖动程度,以使得最终拍摄到的图像质量更高。It can be understood that when the degree of camera shake is small, more frames of images can be collected, that is, the number of EV values included in the corresponding exposure compensation mode is larger and is the same as the number of images to be collected, so Makes the final captured image quality higher; when the camera module has a large degree of jitter, it can collect fewer frames of the image to avoid excessively long shooting time and exacerbate the degree of jitter, which causes the captured image to contain irreversible Ghost image, that is, the number of EV values included in the corresponding exposure compensation mode is small and is the same as the number of images to be acquired. Therefore, while ensuring the image exposure compensation range, the jitter of the camera module is minimized so that The final captured image is of higher quality.
步骤102,根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长。Step 102: Determine the exposure duration of the image to be acquired for each frame according to the preset sensitivity and the target exposure amount of the image to be acquired for each frame.
其中,曝光时长,是指光线通过镜头的时间。Among them, the exposure time refers to the time that light passes through the lens.
其中,感光度,又称为ISO值,是值衡量底片对于光的灵敏程度的指标。对于感光度较低的底片,需要曝光更长的时间以达到跟感光度较高的底片相同的成像。数码相机的感光度是一种类似于胶卷感光度的一种指标,数码相机的ISO可以通过调整感光器件的灵敏度或者合并感光点来调整,也就是说,可以通过提升感光器件的光线敏感度或者合并几个相邻的感光点来达到提升ISO的目的。需要说明的是,无论是数码或是底片摄影,为了减少曝光时间,使用相对较高的感光度通常会引入较多的噪声,从而导致图像质量降低。Among them, the sensitivity, also known as the ISO value, is an index that measures the sensitivity of the film to light. For lower-sensitivity negatives, longer exposure times are required to achieve the same imaging as higher-sensitivity negatives. The sensitivity of a digital camera is a kind of index similar to the sensitivity of a film. The ISO of a digital camera can be adjusted by adjusting the sensitivity of the photosensitive device or combining the sensing points, that is, by increasing the light sensitivity of the photosensitive device or Combining several adjacent photosensitive points to improve the ISO. It should be noted that, whether it is digital or negative photography, in order to reduce the exposure time, the use of a relatively high sensitivity will usually introduce more noise, resulting in lower image quality.
在本申请实施例中,可以提前预设感光度,并利用预设的感光度采集多帧待采集的图像。需要说明的是,可以将感光度预设为较小的值,从而有效抑制图像中的噪声,提高拍摄图像的质量。比如,可以将感光度预设为100。In the embodiment of the present application, the sensitivity may be preset in advance, and multiple frames of images to be captured may be collected by using the preset sensitivity. It should be noted that the sensitivity can be preset to a smaller value, thereby effectively suppressing noise in the image and improving the quality of the captured image. For example, you can preset the sensitivity to 100.
进一步的,可以预设多个不同的感光度,以使得可以根据摄像模组的抖动程度,动态调整为最佳的感光度。即在本申请实施例一种可能的实现形式中,上述步骤102之前,还可以包括:Further, multiple different sensitivities can be preset, so that the optimal sensitivities can be dynamically adjusted according to the degree of shake of the camera module. That is, in a possible implementation form of the embodiment of the present application, before step 102, the method may further include:
根据摄像模组当前的抖动程度,确定所述预设的感光度。The preset sensitivity is determined according to the current shaking degree of the camera module.
在本申请实施例一种可能的实现形式中,当摄像模组的抖动程度相同时,确定出的预设感光度也是相同的,即在摄像模组的抖动程度一定时,感光度为固定值。In a possible implementation form of the embodiment of the present application, when the degree of camera shake is the same, the preset sensitivity determined is also the same, that is, when the degree of camera shake is constant, the sensitivity is a fixed value. .
可以理解的是,采集图像的感光度会影响到整体的拍摄时长,拍摄时长过长,可能会导致手持拍摄时摄像模组的抖动程度加剧,从而影响图像质量。因此,可以根据摄像模组当前的抖动程度,确定预设的感光度,以使得拍摄时长控制在合适的范围内。It can be understood that the sensitivity of the captured image will affect the overall shooting time. If the shooting time is too long, the degree of shake of the camera module may be increased during handheld shooting, which will affect the image quality. Therefore, the preset sensitivity can be determined according to the current shake degree of the camera module, so that the shooting duration is controlled within a proper range.
具体的,若摄像模组当前的抖动程度较小,则可以选取较小的预设感光度,以有效抑制每帧图像的噪声、提高拍摄图像的质量;若摄像模组当前的抖动程度较大,则可以选取较大的预设感光度,以缩短拍摄时长。Specifically, if the current jitter of the camera module is small, a smaller preset sensitivity can be selected to effectively suppress the noise of each frame image and improve the quality of the captured image; if the current jitter of the camera module is large , You can choose a larger preset sensitivity to shorten the shooting time.
举例来说,若确定摄像模组当前的抖动程度为“无抖动”,则可以确定当前可能为脚架拍摄模式,此时可以将基准感光度确定为较小的值,以尽量获得更高质量的图像,比如将预设的基感光度确定为100。For example, if it is determined that the current shake degree of the camera module is "no shake", it may be determined that the current shooting mode may be a tripod. At this time, the reference sensitivity may be determined to a smaller value to obtain higher quality as much as possible. Image, for example, the preset base sensitivity is determined as 100.
需要说明的是,曝光量与光圈、曝光时长和感光度有关。其中,光圈也就是通光口径,决定单位时间内光线通过的数量。当每帧待采集图像对应的基准感光度相同,并且光圈大 小相同时,当前拍摄场景的光照度对应的曝光量越大,每帧待采集图像对应的曝光时长越大。It should be noted that the exposure amount is related to the aperture, the exposure duration, and the sensitivity. Among them, the aperture is the clear aperture, which determines the amount of light passing through in a unit time. When the reference sensitivity corresponding to each frame of the image to be collected is the same and the aperture size is the same, the greater the exposure amount corresponding to the light intensity of the current shooting scene, and the greater the exposure time corresponding to the image to be collected per frame.
在本申请实施例中,光圈的大小可以是不变的,并且使用确定的预设感光度采集各帧待采集的图像。因此,在确定出每帧待采集图像的目标曝光量之后,即可根据预设的感光度和目标曝光量,确定出每帧待采集图像的曝光时长,并且待采集图像的曝光时长与其目标曝光量呈正比关系。In the embodiment of the present application, the size of the aperture may be constant, and an image to be collected for each frame is acquired using a determined preset sensitivity. Therefore, after the target exposure amount of the image to be collected is determined for each frame, the exposure time of the image to be collected can be determined according to the preset sensitivity and target exposure amount, and the exposure time of the image to be collected and its target exposure can be determined. The quantity is directly proportional.
在本申请实施例一种可能的实现形式中,还可以根据预设的感光度和基准曝光量,确定出基准曝光时长,进而根据基准曝光时长和预设的曝光补偿模式,确定每帧待采集图像的曝光时长。具体的,假设基准曝光时长为T,第i帧待采集图像的EV值为EV i,则第i帧待采集图像的曝光时长为
Figure PCTCN2019091579-appb-000003
In a possible implementation form of the embodiment of the present application, a reference exposure duration may also be determined according to a preset sensitivity and a reference exposure amount, and then each frame to be acquired is determined according to the reference exposure duration and a preset exposure compensation mode. The exposure time of the image. Specifically, assuming that the reference exposure time is T and the EV value of the image to be acquired in the i-th frame is EV i , then the exposure time of the image to be acquired in the i-th frame is
Figure PCTCN2019091579-appb-000003
步骤103,根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像。In step 103, multiple frames of images are sequentially acquired according to the preset sensitivity and the exposure time of each frame of images to be acquired.
步骤104,将所述采集的多帧图像进行合成处理,以生成目标图像。Step 104: Perform synthesis processing on the collected multiple frames of images to generate a target image.
在本申请实施例中,确定了每帧待采集图像的曝光时长之后,即可根据预设的感光度及曝光时长,依次采集多帧图像,并将采集到的多帧图像进行合成处理,以生成目标图像。In the embodiment of the present application, after determining the exposure time of the image to be collected for each frame, multiple frames of images can be sequentially acquired according to the preset sensitivity and exposure time, and the acquired multiple frames of images are synthesized and processed to Generate a target image.
需要说明的是,在对采集到的多帧图像进行合成处理时,可以为每帧图像设置不同的权重,并且每采集一帧图像便将其与之前采集的图像进行合成,以获得效果最佳的目标图像,并且可以降低合成处理的时间。It should be noted that when synthesizing the collected multiple frames of images, different weights can be set for each frame of image, and each frame of image is combined with the previously collected image to obtain the best effect. The target image, and can reduce the time of compositing processing.
本申请实施例提供的图像处理方法,可以根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,并根据预设的感光度及每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,进而根据预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像并进行合成处理,生成目标图像。由此,通过根据当前拍摄场景的光照度以及预设的感光度,确定了每帧待采集图像的曝光时长,从而通过拍摄多张不同曝光时长的图像并进行合成,不仅提升了拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,使得高亮区和暗区都能清晰显示,提高了拍摄图像的质量,改善了用户体验。According to the image processing method provided in the embodiment of the present application, the target exposure amount of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image may be determined according to the illumination of the current shooting scene, and the preset sensitivity and the target of the to-be-acquired image per frame The amount of exposure determines the exposure time of the image to be collected for each frame, and then according to the preset sensitivity and the exposure time of the image to be collected for each frame, multiple frames of images are sequentially collected and synthesized to generate a target image. Therefore, the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
在本申请一种可能的实现形式中,可以在采集多帧图像的同时,对已采集到的图像的亮度信息进行合成,并在所有图像采集完成之后,对所有采集到的图像的非亮度信息进行合成,进而与之前已合成的亮度信息叠加,以减少数据处理的时长,缩短拍摄时间。In a possible implementation form of the present application, while collecting multiple frames of images, the brightness information of the collected images may be synthesized, and after all the image collection is completed, non-brightness information of all the collected images Compositing and superimposing the previously combined brightness information to reduce the length of data processing and shorten the shooting time.
下面结合图2,对本申请实施例提供的另一种图像处理方法进行进一步说明。The following describes another image processing method provided by an embodiment of the present application with reference to FIG. 2.
图2为本申请实施例所提供的另一种图像处理方法的流程示意图。FIG. 2 is a schematic flowchart of another image processing method according to an embodiment of the present application.
如图2所示,该图像处理方法,包括以下步骤:As shown in FIG. 2, the image processing method includes the following steps:
步骤201,根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目 标曝光量。Step 201: Determine the target exposure of each image to be acquired from the multiple images to be acquired according to the illumination of the current shooting scene.
步骤202,根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长。Step 202: Determine the exposure duration of the image to be acquired for each frame according to the preset sensitivity and the target exposure amount of the image to be acquired for each frame.
上述步骤201-202的具体实现过程及原理,可以参照上述实施例的详细描述,此处不再赘述。For specific implementation processes and principles of steps 201-202, reference may be made to the detailed description of the foregoing embodiments, and details are not described herein again.
步骤203,根据所述预设的感光度及第一帧待采集图像的曝光时长,采集第一采集帧,并在预览画面显示所述第一采集帧。Step 203: Collect a first acquisition frame according to the preset sensitivity and exposure time of the first frame to be acquired, and display the first acquisition frame on a preview screen.
步骤204,根据所述预设的感光度及第二帧待采集图像的曝光时长,采集第二采集帧。Step 204: Collect a second acquisition frame according to the preset sensitivity and the exposure time of the second frame to be acquired.
步骤205,根据所述第二采集帧的元数据及所述第一采集帧的元数据,对所述预览画面显示的第一采集帧的亮度信息进行调整。Step 205: Adjust the brightness information of the first acquisition frame displayed on the preview screen according to the metadata of the second acquisition frame and the metadata of the first acquisition frame.
其中,元数据,是指摄像模组中的图像感应器将捕捉到的光源信号转化为数字信号的原始数据。The metadata refers to the raw data of the image sensor in the camera module converting the captured light source signals into digital signals.
在本申请实施例中,在确定出每帧待采集图像的曝光时长之后,即可根据预设的感光度及每帧待采集图像的曝光时长,采集各帧待采集图像。并且在采集图像的同时,将当前采集到的图像与之前采集到的图像的元数据的亮度信息进行合成。In the embodiment of the present application, after determining the exposure time of the image to be collected in each frame, the images to be collected in each frame may be collected according to the preset sensitivity and the exposure time of the image to be collected in each frame. And while collecting the image, the currently acquired image is synthesized with the brightness information of the metadata of the previously acquired image.
具体的,采集到第一采集帧之后,在预览画面中显示第一采集帧,并在采集到第二采集帧之后,提取第一采集帧的元数据以及第二采集帧的元数据中的亮度信息,并将第一采集帧的亮度信息和第二采集帧的亮度信息进行合成,之后利用合成后的亮度信息对预览画面显示的第一采集帧的亮度信息进行调整。同样的,在采集到第三采集帧之后,提取当前预览画面中显示的图像的元数据和第三采集帧的元数据亮度信息,并将两者的亮度信息进行合成,之后利用合成后的亮度信息再次对预览画面显示的图像的亮度信息进行调整,以此类推,直至所有待采集图像采集完毕。Specifically, after the first acquisition frame is acquired, the first acquisition frame is displayed in a preview screen, and after the second acquisition frame is acquired, the metadata of the first acquisition frame and the brightness in the metadata of the second acquisition frame are extracted. The brightness information of the first collection frame and the brightness information of the second collection frame, and then use the combined brightness information to adjust the brightness information of the first collection frame displayed on the preview screen. Similarly, after the third collection frame is collected, the metadata of the image displayed in the current preview screen and the metadata brightness information of the third collection frame are extracted, and the brightness information of the two is synthesized, and then the synthesized brightness is used. The information again adjusts the brightness information of the image displayed on the preview screen, and so on, until all the images to be collected are collected.
进一步的,在对各帧图像的亮度信息进行合成时,可以根据当前的光照度,对各帧图像设置不同的权重值,以使得拍摄图像的视觉效果最佳。即在本申请实施例一种可能的实现形式中,上述步骤205,可以包括:Further, when synthesizing the brightness information of each frame image, different weight values can be set for each frame image according to the current illuminance, so that the visual effect of the captured image is optimal. That is, in a possible implementation form of this embodiment of the present application, the foregoing step 205 may include:
根据所述当前拍摄场景的光照度、所述第一采集帧的曝光时长及所述第二采集帧的曝光时长,确定所述第一采集帧及所述第二采集帧分别对应的权重值;Determining weight values corresponding to the first and second acquisition frames according to the illumination of the current shooting scene, the exposure time of the first acquisition frame, and the exposure time of the second acquisition frame;
根据所述第一采集帧及所述第二采集帧分别对应的权重值、及所述第一采集帧的元数据及所述第二采集帧的元数据,确定所述第二采集帧与所述第一采集帧合成后的亮度信息;Determining the second acquisition frame and the second acquisition frame according to weight values corresponding to the first acquisition frame and the second acquisition frame, and metadata of the first acquisition frame and metadata of the second acquisition frame, respectively. The brightness information after the first collection frame is synthesized;
利用所述合成后的亮度信息,对所述预览画面显示的第一采集帧的亮度信息进行调整。The brightness information of the first acquisition frame displayed on the preview screen is adjusted by using the synthesized brightness information.
需要说明的是,在本申请实施例中,可以根据当前拍摄场景的光照度以及各帧待采集图像的曝光补偿模式,确定各帧待采集图像对应的权重值,以进行各帧待采集图像亮度信 息的合成。而待采集图像的曝光补偿模式可以根据其对应的曝光时长确定,即曝光时长越长的待采集图像对应的EV等级越大。因此,在本申请实施例一种可能的实现形式中,可以根据当前拍摄场景的光照度及各帧待采集图像的曝光时长,确定各帧待采集图像分别对应的权重值。It should be noted that, in the embodiment of the present application, the weight value corresponding to the image to be acquired in each frame may be determined according to the illumination intensity of the current shooting scene and the exposure compensation mode of the image to be acquired in each frame to perform brightness information of the image to be acquired in each frame. Synthesis. The exposure compensation mode of the image to be collected can be determined according to its corresponding exposure duration, that is, the longer the exposure duration is, the larger the EV level is. Therefore, in a possible implementation form of the embodiment of the present application, the weight values corresponding to the images to be collected in each frame may be determined according to the illumination of the current shooting scene and the exposure time of the images to be collected in each frame.
具体的,若当前拍摄场景对应的光照度较小,则可以将曝光时长较长的待采集图像对应的权重值确定为较大的值,将曝光时长较短的待采集图像对应的权重值确定为较小的值,以提高图像的整体亮度和暗区细节;若当前拍摄场景对应的光照度较大,则可以将曝光时长较长的待采集图像对应的权重值确定为较小的值,将曝光时长较短的待采集图像对应的权重值确定为较大的值,以在提升暗区细节的同时防止高亮区过曝。Specifically, if the light intensity corresponding to the current shooting scene is small, the weight value corresponding to the image to be acquired with a longer exposure duration may be determined as a larger value, and the weight value corresponding to the image to be acquired with a shorter exposure duration may be determined as Smaller values to improve the overall brightness and dark area details of the image; if the light intensity corresponding to the current shooting scene is large, the weight value corresponding to the image to be acquired with a longer exposure time can be determined as a smaller value, and the exposure will be The weight value corresponding to the shorter time-to-be-acquired image is determined to be a larger value to prevent overexposure of the highlight areas while improving the details of the dark areas.
需要说明的是,在根据当前拍摄场景的光照度以各帧待采集图像的曝光时长,确定各帧待采集图像对应的权重值时,还需要保证最终合成后的亮度信息的范围处于0-255之间,以确定各权重值之间的约束关系。It should be noted that when determining the weight value corresponding to the image to be collected in each frame according to the exposure time of the image to be collected in each frame according to the illumination of the current shooting scene, it is also necessary to ensure that the range of brightness information after final synthesis is in the range of 0-255 To determine the constraint relationship between the weight values.
可以理解的是,在确定出每帧待采集图像对应的权重值之后,即可根据权重值实时将当前采集到的图像的元数据的亮度信息,与预览画面显示的图像的亮度信息进行合成,即利用合成后的亮度信息,对预览画面显示的图像的亮度信息进行调整,直至所有待采集图像采集并且亮度信息合成完毕。It can be understood that after determining the weight value corresponding to each frame of the image to be collected, the brightness information of the metadata of the currently acquired image can be synthesized with the brightness information of the image displayed on the preview screen according to the weight value in real time. That is, using the synthesized brightness information, the brightness information of the image displayed on the preview screen is adjusted until all the images to be collected are collected and the brightness information is synthesized.
步骤206,将采集的多帧图像的元数据中的非亮度信息进行合成处理,以生成初始目标图像。In step 206, the non-brightness information in the collected metadata of the multi-frame images is synthesized to generate an initial target image.
步骤207,根据预览画面当前显示的图像的亮度信息,对所述初始目标图像的亮度信息进行更新,以生成所述目标图像。Step 207: Update the brightness information of the initial target image according to the brightness information of the image currently displayed on the preview screen to generate the target image.
在本申请实施例中,多帧待采集的图像采集完毕之后,即可将采集到的多帧图像的元数据中的非亮度信息进行合成处理,生成初始目标图像,进而根据预览画面当前显示的图像的亮度信息,对初始目标图像的亮度进行更新,以生成目标图像。In the embodiment of the present application, after the collection of multiple frames of images to be collected is completed, the non-brightness information in the metadata of the collected multiple frames of images can be synthesized to generate an initial target image, and then based on the currently displayed preview image, The brightness information of the image updates the brightness of the initial target image to generate a target image.
本申请实施例提供的图像处理方法,可以根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,以及每帧待采集图像对应的权重值,并根据预设的感光度及每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,之后根据预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像并根据权重值实时对采集到的图像的亮度信息进行合成处理,进而将采集完毕的多帧图像的元数据中的非亮度信息进行合成处理,生成初始目标图像,并根据预览画面当前显示的图像的亮度信息,更新初始目标图像的亮度信息,生成目标图像。由此,通过根据当前拍摄场景的光照度以及预设的感光度,确定了每帧待采集图像的曝光时长及权重值,从而通过拍摄多张不同曝光时长的图像并根据权重值实时合成多帧图像的亮度信息,之后合成多帧图像的非亮度信息,不仅 进一步提高了拍摄图像的质量,而且减少了数据处理的时长,缩短了拍摄时间,改善了用户体验。According to the image processing method provided in the embodiment of the present application, the target exposure amount of each frame of the to-be-collected image and the weight value corresponding to each frame of the to-be-collected image may be determined according to the illumination of the current shooting scene, and according to a preset Sensitivity and the target exposure of each frame of images to be acquired, determine the exposure time of each frame of images to be acquired, and then according to the preset sensitivity and exposure time of each frame of images to be acquired, sequentially collect multiple frames of images and use the weight value The brightness information of the captured image is synthesized in real time, and then the non-brightness information in the metadata of the collected multiple frames of images is synthesized to generate the initial target image, and according to the brightness information of the image currently displayed on the preview screen, Update the brightness information of the initial target image to generate a target image. Therefore, the exposure duration and weight value of each frame of the image to be collected are determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images of different exposure durations are captured and multiple frames of images are synthesized in real time according to the weight value The brightness information and the non-brightness information of the multi-frame image are synthesized later, which not only further improves the quality of the captured image, but also reduces the data processing time, shortens the shooting time, and improves the user experience.
在本申请一种可能的实现形式中,进行拍摄之前,可以首先根据预览画面中的信息,确定当前拍摄场景是否为夜景场景,进而根据摄像模组当前的抖动程度,确定当前需要启用的夜景模式,以使得拍摄的夜景图像的视觉效果最佳。In a possible implementation form of the present application, before shooting, first determine whether the current shooting scene is a night scene according to the information in the preview screen, and then determine the current night scene mode that needs to be enabled according to the current jitter of the camera module. To make the best visual effect of the night scene image.
下面结合图3,对本申请实施例提供的另一种图像处理方法进行进一步说明。The following describes another image processing method provided by an embodiment of the present application with reference to FIG. 3.
图3为本申请实施例所提供的另一种图像处理方法的流程示意图。FIG. 3 is a schematic flowchart of another image processing method according to an embodiment of the present application.
如图3所示,该图像处理方法,包括以下步骤:As shown in FIG. 3, the image processing method includes the following steps:
步骤301,根据当前预览画面的画面内容,确定当前拍摄场景属于夜景场景。Step 301: Determine, according to the screen content of the current preview screen, that the current shooting scene belongs to a night scene.
在本申请实施例中,可以利用人工智能(Artificial Intelligence,简称AI)技术,根据当前预览画面的画面内容中的亮度信息,判断当前拍摄场景是否属于夜景场景。具体的,可以根据预览画面内容的平均亮度信息,以及画面中不同区域的亮度差值,判断当前拍摄场景是否属于夜景场景。In the embodiment of the present application, artificial intelligence (AI) technology can be used to determine whether the current shooting scene belongs to a night scene according to the brightness information in the screen content of the current preview screen. Specifically, it can be determined whether the current shooting scene belongs to a night scene according to the average brightness information of the preview screen content and the brightness difference values of different regions in the screen.
需要说明的是,在本申请实施例一种可能的实现形式中,可以预设预览画面内容的平均亮度的第四阈值,以及亮度差值的第五阈值,并根据当前预览画面内容的平均亮度与第四阈值的关系,以及画面中不同区域的亮度差值与第五阈值的关系,确定当前拍摄场景是否属于夜景场景。It should be noted that, in a possible implementation form of the embodiment of the present application, a fourth threshold value of the average brightness of the preview screen content and a fifth threshold value of the brightness difference value may be preset, and according to the average brightness of the current preview screen content The relationship with the fourth threshold, and the relationship between the brightness difference between different regions in the frame and the fifth threshold determine whether the current shooting scene belongs to a night scene.
可以理解的是,在夜景场景中,画面的整体亮度通常较低,并且在有光源的夜景场景中,光源附近区域会形成高亮区,其亮度较大;而距离光源较远的区域会形成暗区,其亮度较小,从而造成有光源的夜景场景中,画面不同区域之间的亮度差值较大。相应的,在非夜景场景中,画面的整体亮度通常较高,并且亮度分布均匀,不会形成明显的高亮区和暗区,即不同区域之间的亮度差值较小。因此,在本申请实施例一种可能的实现形式中,若当前预览画面的画面内容的平均亮度小于第四阈值,或者不同区域之间的亮度差值大于第五阈值,则可以确定当前拍摄场景属于夜景场景。It can be understood that in a night scene, the overall brightness of the picture is usually low, and in a night scene with a light source, the area near the light source will form a high-brightness area with greater brightness; while the area far from the light source will form In a dark area, the brightness is small, so that in a night scene with a light source, the brightness difference between different areas of the picture is large. Correspondingly, in non-night scenes, the overall brightness of the picture is usually high, and the brightness distribution is uniform, and no obvious high and dark areas are formed, that is, the brightness difference between different areas is small. Therefore, in a possible implementation form of the embodiment of the present application, if the average brightness of the picture content of the current preview picture is less than the fourth threshold, or the brightness difference between different regions is greater than the fifth threshold, the current shooting scene may be determined. Belongs to night scenes.
需要说明的是,预览画面平均亮度的第四阈值和不同区域之间亮度差值的第五阈值可以根据实际需要或者经验预设,本申请实施例对此不做限定。It should be noted that the fourth threshold of the average brightness of the preview screen and the fifth threshold of the brightness difference between different regions may be preset according to actual needs or experience, which is not limited in the embodiment of the present application.
步骤302,根据所述摄像模组的抖动程度,确定当前拍摄场景对应的夜景模式。Step 302: Determine a night scene mode corresponding to the current shooting scene according to the degree of shaking of the camera module.
其中,夜景模式,是指确定当前拍摄场景为夜景场景时,可以启用的拍摄模式。具体的,夜景模式中包含各种拍摄参数的组合,比如感光度、曝光时长、曝光补偿模式、采集图像的帧数等。The night scene mode refers to a shooting mode that can be activated when the current shooting scene is determined to be a night scene. Specifically, the night scene mode includes a combination of various shooting parameters, such as sensitivity, exposure duration, exposure compensation mode, frame number of the captured image, and the like.
需要说明的是,摄像模组的抖动程度会影响拍摄图像的质量,摄像模组的抖动程度过大时,会使得拍摄的图像中包含明显的鬼影并且难以消除。而且,拍摄时长过长,会导致 手持拍摄时摄像模组的抖动程度加剧,从而影响图像质量。因此,在本申请实施例中,可以根据摄像模组当前的抖动程度,确定当前拍摄场景对应的夜景模式,以使得拍摄时长控制在合适的范围内。It should be noted that the degree of shake of the camera module will affect the quality of the captured image. When the degree of shake of the camera module is too large, the captured image will contain obvious ghosts and it will be difficult to eliminate. In addition, if the shooting time is too long, the degree of camera shake will increase during handheld shooting, which will affect the image quality. Therefore, in the embodiment of the present application, the night scene mode corresponding to the current shooting scene may be determined according to the current shaking degree of the camera module, so that the shooting duration is controlled within a proper range.
具体的,若摄像模组当前的抖动程度为“无抖动”,则可以确定当前拍摄场景对应的夜景模式为“脚架夜景模式”;若摄像模组当前的抖动程度为“有抖动”,则可以确定当前拍摄场景对应的夜景模式为“手持夜景模式”。Specifically, if the current shake level of the camera module is "no shake", it can be determined that the night scene mode corresponding to the current shooting scene is "tripod night mode"; if the current shake level of the camera module is "with shake", then It can be determined that the night scene mode corresponding to the current shooting scene is "handheld night scene mode".
步骤303,根据所述夜景模式及所述当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量。Step 303: Determine a target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image according to the night scene mode and the illumination of the current shooting scene.
步骤304,根据所述夜景模式及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,并根据所述夜景模式及曝光时长,依次采集多帧图像并进行合成处理。Step 304: Determine the exposure duration of each frame of the to-be-acquired image according to the night scene mode and the target exposure amount of each frame of the to-be-acquired image, and sequentially collect multiple frames of images and perform synthesis processing based on the night-scape mode and the exposure time. .
在本申请实施例中,确定了当前拍摄场景对应的夜景模式之后,即可根据夜景模式中的参数设置(感光度、曝光补偿模式等),及当前拍摄场景的光照度,确定每帧待采集图像的目标曝光量和曝光时长,进而根据夜景模式中的参数设置以及曝光时长,依次采集多帧图像并进行合成处理。In the embodiment of the present application, after the night scene mode corresponding to the current shooting scene is determined, the image to be acquired per frame can be determined according to the parameter settings (sensitivity, exposure compensation mode, etc.) in the night scene mode and the light intensity of the current shooting scene. The target exposure amount and exposure duration are based on the parameter settings in the night scene mode and the exposure duration, and multiple frames of images are sequentially acquired and synthesized.
举例来说,若确定当前拍摄场景对应的夜景模式为“脚架夜景模式”,则可以本申请实施例提供的图像处理方法,确定每帧待采集图像的目标曝光量及曝光时长,并根据本申请实施例提供的图像处理方法,对采集的多帧图像进行合成。若确定当前拍摄场景对应的夜景模式为“手持夜景模式”,则可以根据夜景模式中的参数设置,采集多帧图像并进行合成处理。For example, if it is determined that the night scene mode corresponding to the current shooting scene is a "tripod night scene mode", the image processing method provided in the embodiment of the present application can be used to determine the target exposure amount and exposure time of each frame of images to be acquired, and according to this The image processing method provided in the embodiment of the application synthesizes acquired multiple frames of images. If it is determined that the night scene mode corresponding to the current shooting scene is "handheld night scene mode", multiple frames of images can be collected and synthesized according to the parameter settings in the night scene mode.
本申请实施例提供的图像处理方法,通过根据当前预览画面的画面内容,确定当前拍摄场景属于夜景场景,并根据摄像模组的抖动程度,确定当前拍摄场景对应的夜景模式,之后即可根据当前拍摄场景对应的夜景模式以及光照度,确定每帧待采集图像的目标曝光量,从而通过根据不同的场景启用不同的拍摄模式,不仅提高了夜景拍摄图像的质量,而且降低了非夜景场景拍摄的复杂性,提高了拍摄效率,改善了用户体验。According to the image processing method provided in the embodiment of the present application, the current shooting scene is determined to be a night scene according to the screen content of the current preview screen, and the night mode corresponding to the current shooting scene is determined according to the degree of shake of the camera module. The night scene mode and lighting level corresponding to the shooting scene determine the target exposure of the image to be collected for each frame. By enabling different shooting modes according to different scenes, not only the quality of the night scene shooting image is improved, but also the complexity of shooting non-night scene scenes is reduced. Performance, improve shooting efficiency, and improve user experience.
为了实现上述实施例,本申请还提出一种图像处理装置。In order to implement the above embodiments, the present application also proposes an image processing apparatus.
图4为本申请实施例提供的一种图像处理装置的结构示意图。FIG. 4 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application.
如图4所示,该图像处理装置40,包括:As shown in FIG. 4, the image processing apparatus 40 includes:
第一确定模块41,用于根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量;A first determining module 41, configured to determine a target exposure amount of each of the frames of images to be collected in the plurality of frames of images to be collected according to the illumination of the current shooting scene;
第二确定模块42,用于根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长;The second determining module 42 is configured to determine an exposure duration of the image to be acquired for each frame according to a preset sensitivity and the target exposure amount of the image to be acquired for each frame;
采集模块43,用于根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多 帧图像;An acquisition module 43 configured to sequentially acquire multiple frames of images according to the preset sensitivity and exposure time of each frame of images to be acquired;
合成模块44,用于将所述采集的多帧图像进行合成处理,以生成目标图像。A synthesis module 44 is configured to perform synthesis processing on the collected multiple frames of images to generate a target image.
在实际使用时,本申请实施例提供的图像处理装置,可以被配置在任意电子设备中,以执行前述图像处理方法。In actual use, the image processing apparatus provided in the embodiment of the present application may be configured in any electronic device to execute the foregoing image processing method.
本申请实施例提供的图像处理装置,可以根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,并根据预设的感光度及每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,进而根据预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像并进行合成处理,生成目标图像。由此,通过根据当前拍摄场景的光照度以及预设的感光度,确定了每帧待采集图像的曝光时长,从而通过拍摄多张不同曝光时长的图像并进行合成,不仅提升了拍摄图像的动态范围和整体亮度,而且有效抑制了拍摄图像中的噪声,使得高亮区和暗区都能清晰显示,提高了拍摄图像的质量,改善了用户体验。The image processing device provided in the embodiment of the present application may determine the target exposure amount of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image according to the illumination of the current shooting scene, and according to the preset sensitivity and the target of the to-be-acquired image per frame The amount of exposure determines the exposure time of the image to be collected for each frame, and then according to the preset sensitivity and the exposure time of the image to be collected for each frame, multiple frames of images are sequentially collected and synthesized to generate a target image. Therefore, the exposure time of each frame to be acquired is determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images with different exposure durations are captured and synthesized, which not only improves the dynamic range of the captured images And overall brightness, and effectively suppress the noise in the captured image, so that the bright and dark areas can be clearly displayed, which improves the quality of the captured image and improves the user experience.
在本申请一种可能的实现形式中,上述图像处理装置40,还包括:In a possible implementation form of the present application, the image processing apparatus 40 further includes:
第三确定模块,用于根据摄像模组当前的抖动程度,确定所述预设的感光度。The third determining module is configured to determine the preset sensitivity according to a current shaking degree of the camera module.
进一步的,在本申请另一种可能的实现形式中,上述图像处理装置40,还包括:Further, in another possible implementation form of the present application, the image processing apparatus 40 further includes:
第四确定模块,用于根据所述摄像模组当前的抖动程度,确定所述预设的曝光补偿模式。进一步的,在本申请再一种可能的实现形式中,上述图像处理装置40,还包括:A fourth determining module is configured to determine the preset exposure compensation mode according to a current shaking degree of the camera module. Further, in another possible implementation form of the present application, the image processing apparatus 40 further includes:
第五确定模块,用于根据当前预览画面的画面内容,确定当前拍摄场景属于夜景场景;A fifth determining module, configured to determine that the current shooting scene belongs to a night scene according to the picture content of the current preview picture;
第六确定模块,用于根据所述摄像模组的抖动程度,确定当前拍摄场景对应的夜景模式;A sixth determining module, configured to determine a night scene mode corresponding to the current shooting scene according to the degree of shaking of the camera module;
相应的,上述第一确定模块41,还用于:Accordingly, the first determining module 41 is further configured to:
根据所述夜景模式及所述当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量。According to the night scene mode and the illuminance of the current shooting scene, a target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image is determined.
在本申请一种可能的实现形式中,上述第一确定模块41,具体用于:In a possible implementation form of the present application, the foregoing first determining module 41 is specifically configured to:
根据所述当前拍摄场景的光照度,确定基准曝光量及多帧待采集图像的曝光补偿范围;Determining a reference exposure amount and an exposure compensation range of multiple frames of images to be acquired according to the illumination of the current shooting scene;
根据所述基准曝光量、多帧待采集图像的曝光补偿范围及预设的曝光补偿模式,确定所述每帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount, the exposure compensation range of the images to be acquired for multiple frames, and a preset exposure compensation mode.
在在本申请一种可能的实现形式中,上述第二确定模块42,具体用于:In a possible implementation form of the present application, the foregoing second determining module 42 is specifically configured to:
根据所述预设的感光度与所述基准曝光量,确定基准曝光时长;Determining a reference exposure duration according to the preset sensitivity and the reference exposure amount;
根据所述基准曝光时长及所述预设的曝光补偿模式,确定所述每帧待采集图像的曝光时长。Determining the exposure duration of the image to be acquired for each frame according to the reference exposure duration and the preset exposure compensation mode.
在本申请一种可能的实现形式中,上述采集模块43,具体用于:In a possible implementation form of the present application, the foregoing acquisition module 43 is specifically configured to:
根据所述预设的感光度及第一帧待采集图像的曝光时长,采集第一采集帧,并在预览画面显示所述第一采集帧;Collecting the first collection frame according to the preset sensitivity and the exposure time of the image to be collected in the first frame, and displaying the first collection frame in a preview screen;
根据所述预设的感光度及第二帧待采集图像的曝光时长,采集第二采集帧;Acquiring a second acquisition frame according to the preset sensitivity and the exposure time of the second frame to be acquired;
根据所述第二采集帧的元数据及所述第一采集帧的元数据,对所述预览画面显示的第一采集帧的亮度信息进行调整。Adjusting the brightness information of the first acquisition frame displayed on the preview screen according to the metadata of the second acquisition frame and the metadata of the first acquisition frame.
进一步的,在本申请另一种可能的实现形式中,上述采集模块43,还用于:Further, in another possible implementation form of the present application, the above-mentioned acquisition module 43 is further configured to:
根据所述当前拍摄场景的光照度、所述第一采集帧的曝光时长及所述第二采集帧的曝光时长,确定所述第一采集帧及所述第二采集帧分别对应的权重值;Determining weight values corresponding to the first and second acquisition frames according to the illumination of the current shooting scene, the exposure time of the first acquisition frame, and the exposure time of the second acquisition frame;
根据所述第一采集帧及所述第二采集帧分别对应的权重值、及所述第一采集帧的元数据及所述第二采集帧的元数据,确定所述第二采集帧与所述第一采集帧合成后的亮度信息;Determining the second acquisition frame and the second acquisition frame according to weight values corresponding to the first acquisition frame and the second acquisition frame, and metadata of the first acquisition frame and metadata of the second acquisition frame, respectively. The brightness information after the first collection frame is synthesized;
利用所述合成后的亮度信息,对所述预览画面显示的第一采集帧的亮度信息进行调整。The brightness information of the first acquisition frame displayed on the preview screen is adjusted by using the synthesized brightness information.
在本申请一种可能的实现形式中,上述合成模块44,具体用于:In a possible implementation form of the present application, the above-mentioned synthesis module 44 is specifically configured to:
将采集的多帧图像的元数据中的非亮度信息进行合成处理,以生成初始目标图像;Synthesize non-brightness information in the collected metadata of multiple frames of images to generate an initial target image;
根据预览画面当前显示的图像的亮度信息,对所述初始目标图像的亮度信息进行更新,以生成所述目标图像。Update the brightness information of the initial target image according to the brightness information of the image currently displayed on the preview screen to generate the target image.
需要说明的是,前述对图1、图2、图3所示的图像处理方法实施例的解释说明也适用于该实施例的图像处理装置40,此处不再赘述。It should be noted that the foregoing explanation of the embodiment of the image processing method shown in FIG. 1, FIG. 2, and FIG. 3 is also applicable to the image processing apparatus 40 of this embodiment, and details are not described herein again.
本申请实施例提供的图像处理装置,可以根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,以及每帧待采集图像对应的权重值,并根据预设的感光度及每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长,之后根据预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像并根据权重值实时对采集到的图像的亮度信息进行合成处理,进而将采集完毕的多帧图像的元数据中的非亮度信息进行合成处理,生成初始目标图像,并根据预览画面当前显示的图像的亮度信息,更新初始目标图像的亮度信息,生成目标图像。由此,通过根据当前拍摄场景的光照度以及预设的感光度,确定了每帧待采集图像的曝光时长及权重值,从而通过拍摄多张不同曝光时长的图像并根据权重值实时合成多帧图像的亮度信息,之后合成多帧图像的非亮度信息,不仅进一步提高了拍摄图像的质量,而且减少了数据处理的时长,缩短了拍摄时间,改善了用户体验。The image processing device provided in the embodiment of the present application may determine the target exposure amount of each frame of the to-be-collected image and the weight value corresponding to each frame of the to-be-collected image according to the illumination of the current shooting scene, and according to a preset Sensitivity and the target exposure of each frame of images to be acquired, determine the exposure time of each frame of images to be acquired, and then according to the preset sensitivity and exposure time of each frame of images to be acquired, sequentially collect multiple frames of images and use the weight value The brightness information of the captured image is synthesized in real time, and then the non-brightness information in the metadata of the collected multiple frames of images is synthesized to generate the initial target image, and according to the brightness information of the image currently displayed on the preview screen, Update the brightness information of the initial target image to generate a target image. Therefore, the exposure duration and weight value of each frame of the image to be collected are determined according to the illumination of the current shooting scene and the preset sensitivity, so that multiple images of different exposure durations are captured and multiple frames of images are synthesized in real time according to the weight value The brightness information and the non-brightness information of the multi-frame image are synthesized later, which not only further improves the quality of the captured image, but also reduces the data processing time, shortens the shooting time, and improves the user experience.
为了实现上述实施例,本申请还提出一种电子设备。In order to implement the above embodiments, the present application also proposes an electronic device.
图5为本申请实施例提供的电子设备的结构示意图。FIG. 5 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
如图5所示,上述电子设备200包括:摄像模组201、存储器210、处理器220及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时,实现本申请 实施例所述的场景识别方法。As shown in FIG. 5, the above-mentioned electronic device 200 includes a camera module 201, a memory 210, a processor 220, and a computer program stored in the memory and executable on the processor. When the processor executes the program, it implements The scene recognition method described in the embodiment of the present application.
如图6所示,本申请实施例提供的电子设备200,还可以包括:As shown in FIG. 6, the electronic device 200 provided in the embodiment of the present application may further include:
存储器210及处理器220,连接不同组件(包括存储器210和处理器220)的总线230,存储器210存储有计算机程序,当处理器220执行所述程序时实现本申请实施例所述的图像处理方法。The memory 210 and the processor 220 are connected to a bus 230 of different components (including the memory 210 and the processor 220). The memory 210 stores a computer program. When the processor 220 executes the program, the image processing method according to the embodiment of the present application is implemented. .
总线230表示几类总线结构中的一种或多种,包括存储器总线或者存储器控制器,外围总线,图形加速端口,处理器或者使用多种总线结构中的任意总线结构的局域总线。举例来说,这些体系结构包括但不限于工业标准体系结构(ISA)总线,微通道体系结构(MAC)总线,增强型ISA总线、视频电子标准协会(VESA)局域总线以及外围组件互连(PCI)总线。The bus 230 represents one or more of several types of bus structures, including a memory bus or a memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local area bus using any of a variety of bus structures. By way of example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the enhanced ISA bus, the Video Electronics Standards Association (VESA) local area bus, and peripheral component interconnects ( PCI) bus.
电子设备200典型地包括多种电子设备可读介质。这些介质可以是任何能够被电子设备200访问的可用介质,包括易失性和非易失性介质,可移动的和不可移动的介质。The electronic device 200 typically includes a variety of electronic device readable media. These media can be any available media that can be accessed by the electronic device 200, including volatile and non-volatile media, removable and non-removable media.
存储器210还可以包括易失性存储器形式的计算机系统可读介质,例如随机存取存储器(RAM)240和/或高速缓存存储器250。电子设备200可以进一步包括其它可移动/不可移动的、易失性/非易失性计算机系统存储介质。仅作为举例,存储系统260可以用于读写不可移动的、非易失性磁介质(图5未显示,通常称为“硬盘驱动器”)。尽管图5中未示出,可以提供用于对可移动非易失性磁盘(例如“软盘”)读写的磁盘驱动器,以及对可移动非易失性光盘(例如CD-ROM,DVD-ROM或者其它光介质)读写的光盘驱动器。在这些情况下,每个驱动器可以通过一个或者多个数据介质接口与总线230相连。存储器210可以包括至少一个程序产品,该程序产品具有一组(例如至少一个)程序模块,这些程序模块被配置以执行本申请各实施例的功能。The memory 210 may also include computer system readable media in the form of volatile memory, such as random access memory (RAM) 240 and / or cache memory 250. The electronic device 200 may further include other removable / non-removable, volatile / nonvolatile computer system storage media. For example only, the storage system 260 may be used to read and write non-removable, non-volatile magnetic media (not shown in FIG. 5 and is commonly referred to as a "hard drive"). Although not shown in FIG. 5, a disk drive for reading and writing to a removable non-volatile disk (such as a "floppy disk"), and a removable non-volatile optical disk (such as a CD-ROM, DVD-ROM, etc.) may be provided. Or other optical media). In these cases, each drive may be connected to the bus 230 through one or more data medium interfaces. The memory 210 may include at least one program product having a set (for example, at least one) of program modules configured to perform the functions of the embodiments of the present application.
具有一组(至少一个)程序模块270的程序/实用工具280,可以存储在例如存储器210中,这样的程序模块270包括——但不限于——操作系统、一个或者多个应用程序、其它程序模块以及程序数据,这些示例中的每一个或某种组合中可能包括网络环境的实现。程序模块270通常执行本申请所描述的实施例中的功能和/或方法。A program / utility tool 280 having a set (at least one) of program modules 270 may be stored in, for example, the memory 210. Such program modules 270 include, but are not limited to, an operating system, one or more applications, other programs Modules and program data, each or some combination of these examples may include an implementation of a network environment. Program module 270 typically performs the functions and / or methods in the embodiments described herein.
电子设备200也可以与一个或多个外部设备290(例如键盘、指向设备、显示器291等)通信,还可与一个或者多个使得用户能与该电子设备200交互的设备通信,和/或与使得该电子设备200能与一个或多个其它计算设备进行通信的任何设备(例如网卡,调制解调器等等)通信。这种通信可以通过输入/输出(I/O)接口292进行。并且,电子设备200还可以通过网络适配器293与一个或者多个网络(例如局域网(LAN),广域网(WAN)和/或公共网络,例如因特网)通信。如图所示,网络适配器293通过总线230与电子设备200的其它模块通信。应当明白,尽管图中未示出,可以结合电子设备200使用其它硬件和/ 或软件模块,包括但不限于:微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。The electronic device 200 may also communicate with one or more external devices 290 (such as a keyboard, pointing device, display 291, etc.), and may also communicate with one or more devices that enable a user to interact with the electronic device 200, and / or with Any device (such as a network card, modem, etc.) that enables the electronic device 200 to communicate with one or more other computing devices. This communication can be performed through an input / output (I / O) interface 292. Moreover, the electronic device 200 may also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 293. As shown, the network adapter 293 communicates with other modules of the electronic device 200 through the bus 230. It should be understood that although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 200, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage systems.
处理器220通过运行存储在存储器210中的程序,从而执行各种功能应用以及数据处理。The processor 220 executes various functional applications and data processing by running a program stored in the memory 210.
需要说明的是,本实施例的电子设备的实施过程和技术原理参见前述对本申请实施例的图像处理方法的解释说明,此处不再赘述。It should be noted that, for the implementation process and technical principle of the electronic device in this embodiment, refer to the foregoing description of the image processing method in the embodiment of the present application, and details are not described herein again.
本申请实施例提供的电子设备,可以执行如前所述的图像处理方法,在夜景拍摄模式下,检测摄像模组当前的抖动程度,并根据当前的抖动程度,确定待采集的图像数量及每帧待采集图像对应的基准感光度,之后根据当前拍摄场景的光照度及每帧待采集图像对应的基准感光度,确定每帧待采集图像对应的曝光时长,进而根据每帧待采集图像对应的基准感光度及曝光时长,依次采集多帧图像,并将采集的多帧图像进行合成处理,以生成目标图像。由此,通过根据摄像模组当前的抖动程度,确定待采集图像的数量及基准感光度,并且根据当前拍摄场景的光照度,确定了每帧待采集图像对应的曝光时长,从而通过拍摄多张不同曝光时长的图像进行合成,不仅提升了夜景拍摄模式下拍摄图像的动态范围和整体亮度,有效抑制了拍摄图像中的噪声,而且抑制了手持抖动导致的鬼影和模糊,提高了夜景拍摄图像的质量,改善了用户体验。The electronic device provided by the embodiment of the present application can execute the image processing method as described above. In the night scene shooting mode, the current jitter level of the camera module is detected, and the number of images to be acquired and the The reference sensitivity corresponding to the frame to be acquired, and then based on the illumination of the current shooting scene and the reference sensitivity corresponding to each frame of the to-be-acquired image, determine the exposure duration corresponding to each frame of the to-be-acquired image, and then according to the reference corresponding to each frame of the to-be-acquired image Sensitivity and exposure time, multiple frames of images are collected in sequence, and the collected multiple frames of images are synthesized to generate a target image. Therefore, the number of images to be acquired and the reference sensitivity are determined according to the current jitter of the camera module, and the exposure time corresponding to each frame of the image to be acquired is determined according to the illumination of the current shooting scene, so that multiple different photos are taken by shooting Combining images with long exposure time not only improves the dynamic range and overall brightness of the captured image in night scene shooting mode, effectively suppresses noise in the captured image, but also suppresses ghosting and blurring caused by hand-held shake, which improves the night shot image. Quality and improved user experience.
为了实现上述实施例,本申请还提出一种计算机可读存储介质。In order to implement the above embodiments, the present application also proposes a computer-readable storage medium.
其中,该计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时,以实现本申请实施例所述的图像处理方法。The computer-readable storage medium stores a computer program thereon, and when the program is executed by a processor, the image processing method according to the embodiment of the present application is implemented.
为了实现上述实施例,本申请再一方面实施例提供一种计算机程序,该程序被处理器执行时,以实现本申请实施例所述的图像处理方法。In order to implement the above-mentioned embodiment, another embodiment of the present application provides a computer program, which is executed by a processor to implement the image processing method described in the embodiment of the present application.
一种可选实现形式中,本实施例可以采用一个或多个计算机可读的介质的任意组合。计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的系统、装置或器件,或者任意以上的组合。计算机可读存储介质的更具体的例子(非穷举的列表)包括:具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本文件中,计算机可读存储介质可以是任何包含或存储程序的有形介质,该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。In an optional implementation form, this embodiment may use any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (non-exhaustive list) of computer-readable storage media include: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), Erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the foregoing. In this document, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in combination with an instruction execution system, apparatus, or device.
计算机可读的信号介质可以包括在基带中或者作为载波一部分传播的数据信号,其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式,包括——但不限 于——电磁信号、光信号或上述的任意合适的组合。计算机可读的信号介质还可以是计算机可读存储介质以外的任何计算机可读介质,该计算机可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。The computer-readable signal medium may include a data signal in baseband or propagated as part of a carrier wave, which carries a computer-readable program code. This propagated data signal can take many forms, including but not limited to, electromagnetic signals, optical signals, or any suitable combination of the foregoing. The computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, and the computer-readable medium may send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device .
计算机可读介质上包含的程序代码可以用任何适当的介质传输,包括——但不限于——无线、电线、光缆、RF等等,或者上述的任意合适的组合。Program code embodied on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
可以以一种或多种程序设计语言或其组合来编写用于执行本申请操作的计算机程序代码,所述程序设计语言包括面向对象的程序设计语言—诸如Java、Smalltalk、C++,还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户电子设备上执行、部分地在用户电子设备上执行、作为一个独立的软件包执行、部分在用户电子设备上部分在远程电子设备上执行、或者完全在远程电子设备或服务器上执行。在涉及远程电子设备的情形中,远程电子设备可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户电子设备,或者,可以连接到外部电子设备(例如利用因特网服务提供商来通过因特网连接)。Computer program code for performing the operations of this application may be written in one or more programming languages, or a combination thereof, including programming languages such as Java, Smalltalk, C ++, and also conventional Procedural programming language—such as "C" or similar programming language. The program code may be executed entirely on the user electronic device, partly on the user electronic device, as a separate software package, partly on the user electronic device, partly on the remote electronic device, or entirely on the remote electronic device or On the server. In the case of a remote electronic device, the remote electronic device can be connected to the user's electronic device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external electronic device (e.g., using Internet services) Provider to connect via the Internet).
本领域技术人员在考虑说明书及实践这里申请的发明后,将容易想到本申请的其它实施方案。本申请旨在涵盖本申请的任何变型、用途或者适应性变化,这些变型、用途或者适应性变化遵循本申请的一般性原理并包括本申请未发明的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的,本申请的真正范围和精神由权利要求指出。Those skilled in the art will readily think of other embodiments of the present application after considering the specification and practicing the invention applied herein. This application is intended to cover any variations, uses, or adaptations of this application. These variations, uses, or adaptations follow the general principles of this application and include common general knowledge or conventional technical means in the technical field that have not been invented by this application. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
应当理解的是,本申请并不局限于上面已经描述并在附图中示出的精确结构,并且可以在不脱离其范围进行各种修改和改变。本申请的范围仅由所附的权利要求来限制。It should be understood that the present application is not limited to the precise structure that has been described above and shown in the drawings, and various modifications and changes can be made without departing from the scope thereof. The scope of the application is limited only by the accompanying claims.

Claims (20)

  1. 一种图像处理方法,其特征在于,包括:An image processing method, comprising:
    根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量;Determine the target exposure of each frame of the to-be-acquired image in the multiple frames of the to-be-acquired image according to the illumination of the current shooting scene;
    根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长;Determining the exposure duration of the image to be acquired for each frame according to the preset sensitivity and the target exposure amount of the image to be acquired for each frame;
    根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像;Collecting multiple frames of images in sequence according to the preset sensitivity and exposure time of each frame of images to be collected;
    将所述采集的多帧图像进行合成处理,以生成目标图像。The acquired multiple frames of images are synthesized to generate a target image.
  2. 如权利要求1所述的方法,其特征在于,所述确定每帧待采集图像的曝光时长之前,还包括:The method according to claim 1, wherein before determining the exposure duration of each frame of images to be acquired, further comprising:
    根据摄像模组当前的抖动程度,确定所述预设的感光度。The preset sensitivity is determined according to the current shaking degree of the camera module.
  3. 如权利要求1或2所述的方法,其特征在于,所述根据所述当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量,包括:The method according to claim 1 or 2, wherein determining the target exposure amount of each of the images to be acquired from the plurality of frames of images to be acquired according to the illumination of the current shooting scene comprises:
    根据所述当前拍摄场景的光照度,确定基准曝光量及多帧待采集图像的曝光补偿范围;Determining a reference exposure amount and an exposure compensation range of multiple frames of images to be acquired according to the illumination of the current shooting scene;
    根据所述基准曝光量、多帧待采集图像的曝光补偿范围及预设的曝光补偿模式,确定所述每帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount, the exposure compensation range of the images to be acquired for multiple frames, and a preset exposure compensation mode.
  4. 如权利要求3所述的方法,其特征在于,所述确定每帧待采集图像的曝光时长,包括:The method according to claim 3, wherein the determining the exposure duration of each frame of images to be acquired comprises:
    根据所述预设的感光度与所述基准曝光量,确定基准曝光时长;Determining a reference exposure duration according to the preset sensitivity and the reference exposure amount;
    根据所述基准曝光时长及所述预设的曝光补偿模式,确定所述每帧待采集图像的曝光时长。Determining the exposure duration of the image to be acquired for each frame according to the reference exposure duration and the preset exposure compensation mode.
  5. 如权利要求3或4所述的方法,其特征在于,所述确定多帧待采集图像中每帧待采集图像的目标曝光量之前,还包括:The method according to claim 3 or 4, wherein before the determining the target exposure amount of each frame of the to-be-collected image in the plurality of frames of the to-be-collected image, further comprising:
    根据所述摄像模组当前的抖动程度,确定所述预设的曝光补偿模式。Determining the preset exposure compensation mode according to the current shake degree of the camera module.
  6. 如权利要求1-5任一项所述的方法,其特征在于,所述根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像,包括:The method according to any one of claims 1 to 5, wherein the sequentially acquiring multiple frames of images according to the preset sensitivity and exposure time of each frame of images to be acquired comprises:
    根据所述预设的感光度及第一帧待采集图像的曝光时长,采集第一采集帧,并在预览画面显示所述第一采集帧;Collecting the first collection frame according to the preset sensitivity and the exposure time of the image to be collected in the first frame, and displaying the first collection frame in a preview screen;
    根据所述预设的感光度及第二帧待采集图像的曝光时长,采集第二采集帧;Acquiring a second acquisition frame according to the preset sensitivity and the exposure time of the second frame to be acquired;
    根据所述第二采集帧的元数据及所述第一采集帧的元数据,对所述预览画面显示的第一采集帧的亮度信息进行调整。Adjusting the brightness information of the first acquisition frame displayed on the preview screen according to the metadata of the second acquisition frame and the metadata of the first acquisition frame.
  7. 如权利要求6所述的方法,其特征在于,根据所述第二采集帧的元数据及所述第一采集帧的元数据,对所述预览画面显示的第一采集帧的亮度信息进行调整,包括:The method according to claim 6, wherein the brightness information of the first acquisition frame displayed on the preview screen is adjusted according to the metadata of the second acquisition frame and the metadata of the first acquisition frame. ,include:
    根据所述当前拍摄场景的光照度、所述第一采集帧的曝光时长及所述第二采集帧的曝 光时长,确定所述第一采集帧及所述第二采集帧分别对应的权重值;Determining the weight values corresponding to the first acquisition frame and the second acquisition frame respectively according to the illumination of the current shooting scene, the exposure time of the first acquisition frame, and the exposure time of the second acquisition frame;
    根据所述第一采集帧及所述第二采集帧分别对应的权重值、及所述第一采集帧的元数据及所述第二采集帧的元数据,确定所述第二采集帧与所述第一采集帧合成后的亮度信息;Determining the second acquisition frame and the second acquisition frame according to weight values corresponding to the first acquisition frame and the second acquisition frame, and metadata of the first acquisition frame and metadata of the second acquisition frame, respectively. The brightness information after the first collection frame is synthesized;
    利用所述合成后的亮度信息,对所述预览画面显示的第一采集帧的亮度信息进行调整。The brightness information of the first acquisition frame displayed on the preview screen is adjusted by using the synthesized brightness information.
  8. 如权利要求6或7所述的方法,其特征在于,所述将所述采集的多帧图像进行合成处理,以生成目标图像,包括:The method according to claim 6 or 7, wherein the performing a synthesis process on the acquired multiple frames of images to generate a target image comprises:
    将采集的多帧图像的元数据中的非亮度信息进行合成处理,以生成初始目标图像;Synthesize non-brightness information in the collected metadata of multiple frames of images to generate an initial target image;
    根据预览画面当前显示的图像的亮度信息,对所述初始目标图像的亮度信息进行更新,以生成所述目标图像。Update the brightness information of the initial target image according to the brightness information of the image currently displayed on the preview screen to generate the target image.
  9. 如权利要求1-8任一所述的方法,其特征在于,所述根据所述当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量之前,还包括:The method according to any one of claims 1 to 8, wherein before determining the target exposure of each of the images to be acquired in the multiple frames of images to be acquired according to the illumination of the current shooting scene, further comprising:
    根据当前预览画面的画面内容,确定当前拍摄场景属于夜景场景;Determine that the current shooting scene belongs to a night scene according to the picture content of the current preview picture;
    根据所述摄像模组的抖动程度,确定当前拍摄场景对应的夜景模式;Determine the night scene mode corresponding to the current shooting scene according to the degree of shaking of the camera module;
    所述确定多帧待采集图像中每帧待采集图像的目标曝光量,包括:The determining the target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image includes:
    根据所述夜景模式及所述当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量。According to the night scene mode and the illuminance of the current shooting scene, a target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image is determined.
  10. 一种图像处理装置,其特征在于,包括:An image processing device, comprising:
    第一确定模块,用于根据当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量;A first determining module, configured to determine a target exposure amount of each to-be-collected image in a plurality of frames of to-be-collected images according to the illumination of the current shooting scene;
    第二确定模块,用于根据预设的感光度及所述每帧待采集图像的目标曝光量,确定每帧待采集图像的曝光时长;A second determining module, configured to determine an exposure duration of the image to be acquired for each frame according to a preset sensitivity and the target exposure amount of the image to be acquired for each frame;
    采集模块,用于根据所述预设的感光度及每帧待采集图像的曝光时长,依次采集多帧图像;An acquisition module, configured to sequentially acquire multiple frames of images according to the preset sensitivity and exposure time of each frame of images to be acquired;
    合成模块,用于将所述采集的多帧图像进行合成处理,以生成目标图像。A synthesis module is configured to synthesize the collected multiple frames of images to generate a target image.
  11. 如权利要求10所述的装置,其特征在于,还包括:The apparatus according to claim 10, further comprising:
    第三确定模块,用于根据摄像模组当前的抖动程度,确定所述预设的感光度。The third determining module is configured to determine the preset sensitivity according to a current shaking degree of the camera module.
  12. 如权利要求10或11所述的装置,其特征在于,所述第一确定模块,具体用于:The apparatus according to claim 10 or 11, wherein the first determining module is specifically configured to:
    根据所述当前拍摄场景的光照度,确定基准曝光量及多帧待采集图像的曝光补偿范围;Determining a reference exposure amount and an exposure compensation range of multiple frames of images to be acquired according to the illumination of the current shooting scene;
    根据所述基准曝光量、多帧待采集图像的曝光补偿范围及预设的曝光补偿模式,确定所述每帧待采集图像的目标曝光量。The target exposure amount of the image to be acquired for each frame is determined according to the reference exposure amount, the exposure compensation range of the images to be acquired for multiple frames, and a preset exposure compensation mode.
  13. 如权利要求12所述的装置,其特征在于,所述第二确定模块,具体用于:The apparatus according to claim 12, wherein the second determining module is specifically configured to:
    根据所述预设的感光度与所述基准曝光量,确定基准曝光时长;Determining a reference exposure duration according to the preset sensitivity and the reference exposure amount;
    根据所述基准曝光时长及所述预设的曝光补偿模式,确定所述每帧待采集图像的曝光时长。Determining the exposure duration of the image to be acquired for each frame according to the reference exposure duration and the preset exposure compensation mode.
  14. 如权利要求12或13所述的装置,其特征在于,还包括:The device according to claim 12 or 13, further comprising:
    第四确定模块,用于根据所述摄像模组当前的抖动程度,确定所述预设的曝光补偿模式。A fourth determining module is configured to determine the preset exposure compensation mode according to a current shaking degree of the camera module.
  15. 如权利要求10-14任一项所述的装置,其特征在于,所述采集模块,具体用于:The device according to any one of claims 10 to 14, wherein the acquisition module is specifically configured to:
    根据所述预设的感光度及第一帧待采集图像的曝光时长,采集第一采集帧,并在预览画面显示所述第一采集帧;Collecting the first collection frame according to the preset sensitivity and the exposure time of the image to be collected in the first frame, and displaying the first collection frame in a preview screen;
    根据所述预设的感光度及第二帧待采集图像的曝光时长,采集第二采集帧;Acquiring a second acquisition frame according to the preset sensitivity and the exposure time of the second frame to be acquired;
    根据所述第二采集帧的元数据及所述第一采集帧的元数据,对所述预览画面显示的第一采集帧的亮度信息进行调整。Adjusting the brightness information of the first acquisition frame displayed on the preview screen according to the metadata of the second acquisition frame and the metadata of the first acquisition frame.
  16. 如权利要求15所述的装置,其特征在于,所述采集模块,还用于:The apparatus according to claim 15, wherein the acquisition module is further configured to:
    根据所述当前拍摄场景的光照度、所述第一采集帧的曝光时长及所述第二采集帧的曝光时长,确定所述第一采集帧及所述第二采集帧分别对应的权重值;Determining weight values corresponding to the first and second acquisition frames according to the illumination of the current shooting scene, the exposure time of the first acquisition frame, and the exposure time of the second acquisition frame;
    根据所述第一采集帧及所述第二采集帧分别对应的权重值、及所述第一采集帧的元数据及所述第二采集帧的元数据,确定所述第二采集帧与所述第一采集帧合成后的亮度信息;Determining the second acquisition frame and the second acquisition frame according to weight values corresponding to the first acquisition frame and the second acquisition frame, and metadata of the first acquisition frame and metadata of the second acquisition frame, respectively. The brightness information after the first collection frame is synthesized;
    利用所述合成后的亮度信息,对所述预览画面显示的第一采集帧的亮度信息进行调整。The brightness information of the first acquisition frame displayed on the preview screen is adjusted by using the synthesized brightness information.
  17. 如权利要求15或16所述的装置,其特征在于,所述合成模块,具体用于:The device according to claim 15 or 16, wherein the synthesis module is specifically configured to:
    将采集的多帧图像的元数据中的非亮度信息进行合成处理,以生成初始目标图像;Synthesize non-brightness information in the collected metadata of multiple frames of images to generate an initial target image;
    根据预览画面当前显示的图像的亮度信息,对所述初始目标图像的亮度信息进行更新,以生成所述目标图像。Update the brightness information of the initial target image according to the brightness information of the image currently displayed on the preview screen to generate the target image.
  18. 如权利要求10-17任一项所述的装置,其特征在于,还包括:The device according to any one of claims 10-17, further comprising:
    第五确定模块,用于根据当前预览画面的画面内容,确定当前拍摄场景属于夜景场景;A fifth determining module, configured to determine that the current shooting scene belongs to a night scene according to the picture content of the current preview picture;
    第六确定模块,用于根据所述摄像模组的抖动程度,确定当前拍摄场景对应的夜景模式;A sixth determining module, configured to determine a night scene mode corresponding to the current shooting scene according to the degree of shaking of the camera module;
    相应的,所述第一确定模块,还用于:Accordingly, the first determining module is further configured to:
    根据所述夜景模式及所述当前拍摄场景的光照度,确定多帧待采集图像中每帧待采集图像的目标曝光量。According to the night scene mode and the illuminance of the current shooting scene, a target exposure amount of each frame of the to-be-acquired image in the plurality of frames of the to-be-acquired image is determined.
  19. 一种电子设备,其特征在于,包括:所述摄影模组、存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现如权利要求1-9中任一项所述的图像处理方法。An electronic device, comprising: the photographing module, a memory, a processor, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, the implementation is as follows: The image processing method according to any one of claims 1-9.
  20. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1-9中任一项所述的图像处理方法。A computer-readable storage medium having stored thereon a computer program, characterized in that when the program is executed by a processor, the image processing method according to any one of claims 1-9 is implemented.
PCT/CN2019/091579 2018-09-20 2019-06-17 Image processing method and device, electronic device and storage medium WO2020057198A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811103107.3 2018-09-20
CN201811103107.3A CN109218628B (en) 2018-09-20 2018-09-20 Image processing method, image processing device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2020057198A1 true WO2020057198A1 (en) 2020-03-26

Family

ID=64984411

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/091579 WO2020057198A1 (en) 2018-09-20 2019-06-17 Image processing method and device, electronic device and storage medium

Country Status (2)

Country Link
CN (1) CN109218628B (en)
WO (1) WO2020057198A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113012081A (en) * 2021-01-28 2021-06-22 北京迈格威科技有限公司 Image processing method, device and electronic system
CN113177438A (en) * 2021-04-02 2021-07-27 深圳小湃科技有限公司 Image processing method, apparatus and storage medium
CN113191994A (en) * 2021-04-26 2021-07-30 北京小米移动软件有限公司 Image processing method, device and storage medium
CN113822940A (en) * 2021-08-27 2021-12-21 华兴源创(成都)科技有限公司 Flat field correction calibration method, device and system, computer equipment and medium
CN114554106A (en) * 2022-02-18 2022-05-27 瑞芯微电子股份有限公司 Automatic exposure method, automatic exposure device, image acquisition method, medium, and apparatus
CN114727267A (en) * 2022-03-04 2022-07-08 北京极豪科技有限公司 Channel establishing and information transmitting method, device, storage medium and program product
CN114783355A (en) * 2022-03-31 2022-07-22 西安诺瓦星云科技股份有限公司 LED display method and device, electronic equipment and readable storage medium
CN115706766A (en) * 2021-08-12 2023-02-17 荣耀终端有限公司 Video processing method and device, electronic equipment and storage medium

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109218628B (en) * 2018-09-20 2020-12-08 Oppo广东移动通信有限公司 Image processing method, image processing device, electronic equipment and storage medium
CN109756681A (en) * 2019-01-30 2019-05-14 Oppo广东移动通信有限公司 Image composition method, device, electronic equipment and readable storage medium storing program for executing
CN109788207B (en) * 2019-01-30 2021-03-23 Oppo广东移动通信有限公司 Image synthesis method and device, electronic equipment and readable storage medium
CN109995999A (en) * 2019-03-14 2019-07-09 Oppo广东移动通信有限公司 Scene recognition method, device, electronic equipment and storage medium
CN110072051B (en) 2019-04-09 2021-09-03 Oppo广东移动通信有限公司 Image processing method and device based on multi-frame images
CN110072052B (en) * 2019-04-09 2021-08-27 Oppo广东移动通信有限公司 Image processing method and device based on multi-frame image and electronic equipment
CN110166709B (en) * 2019-06-13 2022-03-18 Oppo广东移动通信有限公司 Night scene image processing method and device, electronic equipment and storage medium
CN110290289B (en) * 2019-06-13 2021-07-09 Oppo广东移动通信有限公司 Image noise reduction method and device, electronic equipment and storage medium
CN110731078B (en) * 2019-09-10 2021-10-22 深圳市汇顶科技股份有限公司 Exposure time calculation method, device and storage medium
CN110740238B (en) * 2019-10-24 2021-05-11 华南农业大学 Light splitting HDR camera applied to mobile robot SLAM field
CN110798624B (en) * 2019-10-24 2021-05-11 华南农业大学 HDR camera applied to outdoor SLAM field of mobile robot
CN110677557B (en) * 2019-10-28 2022-04-22 Oppo广东移动通信有限公司 Image processing method, image processing device, storage medium and electronic equipment
WO2022061934A1 (en) * 2020-09-28 2022-03-31 深圳市大疆创新科技有限公司 Image processing method and device, system, platform, and computer readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1893558A (en) * 2005-06-30 2007-01-10 奥林巴斯映像株式会社 Electronic jitter correction device
CN101690243A (en) * 2008-05-14 2010-03-31 松下电器产业株式会社 Image pickup device and image pickup method
US20100315521A1 (en) * 2009-06-15 2010-12-16 Keiji Kunishige Photographing device, photographing method, and playback method
CN102752512A (en) * 2011-11-30 2012-10-24 新奥特(北京)视频技术有限公司 Method for adjusting image exposure effects
CN107509044A (en) * 2017-08-31 2017-12-22 广东欧珀移动通信有限公司 Image combining method, device, computer-readable recording medium and computer equipment
CN107920198A (en) * 2016-10-06 2018-04-17 韩华泰科株式会社 Image processing equipment and method
CN109218628A (en) * 2018-09-20 2019-01-15 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and storage medium

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4567593B2 (en) * 2005-12-27 2010-10-20 三星デジタルイメージング株式会社 Imaging apparatus and imaging method
CN101621630B (en) * 2008-07-03 2011-03-23 鸿富锦精密工业(深圳)有限公司 Automatic switching system and method of image sensing modes
CN101750844A (en) * 2008-12-18 2010-06-23 鸿富锦精密工业(深圳)有限公司 Photographing system and method
EP2642746B1 (en) * 2010-11-18 2015-06-10 Panasonic Intellectual Property Corporation of America Image capture device, image capture method
JP5050256B1 (en) * 2011-06-21 2012-10-17 オリンパス株式会社 Imaging apparatus and imaging method
US9729776B2 (en) * 2014-08-27 2017-08-08 Mediatek Inc. Camera auto-focus apparatus for performing lens position compensation to determine focused lens position and related camera auto-focus method
CN108028894B (en) * 2015-09-09 2020-07-10 株式会社理光 Control system, imaging apparatus, and computer-readable medium
CN105791707B (en) * 2015-12-31 2019-05-28 北京金山安全软件有限公司 Image processing method and device and electronic equipment
CN106331497B (en) * 2016-08-31 2019-06-11 宇龙计算机通信科技(深圳)有限公司 A kind of image processing method and terminal
CN106375676A (en) * 2016-09-20 2017-02-01 广东欧珀移动通信有限公司 Photographing control method and device of terminal equipment, and terminal equipment
CN106851123B (en) * 2017-03-09 2020-12-22 Oppo广东移动通信有限公司 Exposure control method, exposure control device and electronic device
CN107249105A (en) * 2017-06-16 2017-10-13 广东欧珀移动通信有限公司 Exposure compensation, device and terminal device
CN107613191B (en) * 2017-08-01 2020-09-01 努比亚技术有限公司 Photographing method, photographing equipment and computer readable storage medium
CN108337447A (en) * 2018-04-12 2018-07-27 Oppo广东移动通信有限公司 High dynamic range images exposure compensating value-acquiring method, device, equipment and medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1893558A (en) * 2005-06-30 2007-01-10 奥林巴斯映像株式会社 Electronic jitter correction device
CN101690243A (en) * 2008-05-14 2010-03-31 松下电器产业株式会社 Image pickup device and image pickup method
US20100315521A1 (en) * 2009-06-15 2010-12-16 Keiji Kunishige Photographing device, photographing method, and playback method
CN102752512A (en) * 2011-11-30 2012-10-24 新奥特(北京)视频技术有限公司 Method for adjusting image exposure effects
CN107920198A (en) * 2016-10-06 2018-04-17 韩华泰科株式会社 Image processing equipment and method
CN107509044A (en) * 2017-08-31 2017-12-22 广东欧珀移动通信有限公司 Image combining method, device, computer-readable recording medium and computer equipment
CN109218628A (en) * 2018-09-20 2019-01-15 Oppo广东移动通信有限公司 Image processing method, device, electronic equipment and storage medium

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113012081A (en) * 2021-01-28 2021-06-22 北京迈格威科技有限公司 Image processing method, device and electronic system
CN113177438A (en) * 2021-04-02 2021-07-27 深圳小湃科技有限公司 Image processing method, apparatus and storage medium
CN113177438B (en) * 2021-04-02 2024-05-31 深圳小湃科技有限公司 Image processing method, device and storage medium
CN113191994A (en) * 2021-04-26 2021-07-30 北京小米移动软件有限公司 Image processing method, device and storage medium
CN113191994B (en) * 2021-04-26 2023-11-21 北京小米移动软件有限公司 Image processing method, device and storage medium
CN115706766A (en) * 2021-08-12 2023-02-17 荣耀终端有限公司 Video processing method and device, electronic equipment and storage medium
CN115706766B (en) * 2021-08-12 2023-12-15 荣耀终端有限公司 Video processing method, device, electronic equipment and storage medium
CN113822940A (en) * 2021-08-27 2021-12-21 华兴源创(成都)科技有限公司 Flat field correction calibration method, device and system, computer equipment and medium
CN113822940B (en) * 2021-08-27 2023-09-01 华兴源创(成都)科技有限公司 Flat field correction calibration method, device and system, computer equipment and medium
CN114554106B (en) * 2022-02-18 2024-01-09 瑞芯微电子股份有限公司 Automatic exposure method, device, image acquisition method, medium and equipment
CN114554106A (en) * 2022-02-18 2022-05-27 瑞芯微电子股份有限公司 Automatic exposure method, automatic exposure device, image acquisition method, medium, and apparatus
CN114727267A (en) * 2022-03-04 2022-07-08 北京极豪科技有限公司 Channel establishing and information transmitting method, device, storage medium and program product
CN114783355A (en) * 2022-03-31 2022-07-22 西安诺瓦星云科技股份有限公司 LED display method and device, electronic equipment and readable storage medium
CN114783355B (en) * 2022-03-31 2023-09-12 西安诺瓦星云科技股份有限公司 LED display method and device, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
CN109218628B (en) 2020-12-08
CN109218628A (en) 2019-01-15

Similar Documents

Publication Publication Date Title
WO2020057198A1 (en) Image processing method and device, electronic device and storage medium
US11089207B2 (en) Imaging processing method and apparatus for camera module in night scene, electronic device and storage medium
US11532076B2 (en) Image processing method, electronic device and storage medium
CN109218627B (en) Image processing method, image processing device, electronic equipment and storage medium
WO2020103503A1 (en) Night scene image processing method and apparatus, electronic device, and storage medium
WO2020034737A1 (en) Imaging control method, apparatus, electronic device, and computer-readable storage medium
WO2021082580A1 (en) Night scene high dynamic range image generation method, device, and electronic apparatus
WO2020038072A1 (en) Exposure control method and device, and electronic device
CN110072052B (en) Image processing method and device based on multi-frame image and electronic equipment
WO2020038074A1 (en) Exposure control method and apparatus, and electronic device
CN109729274B (en) Image processing method, image processing device, electronic equipment and storage medium
CN110191291B (en) Image processing method and device based on multi-frame images
WO2020038087A1 (en) Method and apparatus for photographic control in super night scene mode and electronic device
WO2020207261A1 (en) Image processing method and apparatus based on multiple frames of images, and electronic device
CN109361853B (en) Image processing method, image processing device, electronic equipment and storage medium
CN109919116B (en) Scene recognition method and device, electronic equipment and storage medium
WO2020034701A1 (en) Imaging control method and apparatus, electronic device, and readable storage medium
CN113905182B (en) Shooting method and equipment
CN109618102B (en) Focusing processing method and device, electronic equipment and storage medium
CN110971833B (en) Image processing method and device, electronic equipment and storage medium
WO2024174625A1 (en) Image processing method and electronic device
CN117692761A (en) Motion snapshot method and electronic equipment
CN118200738A (en) Image information processing method, device, storage medium and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19863899

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19863899

Country of ref document: EP

Kind code of ref document: A1