CN105357447B

CN105357447B - Picture processing method and device

Info

Publication number: CN105357447B
Application number: CN201510731507.9A
Authority: CN
Inventors: 谢书勋
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2015-10-30
Filing date: 2015-10-30
Publication date: 2020-03-13
Anticipated expiration: 2035-10-30
Also published as: CN105357447A; WO2017071560A1

Abstract

The invention discloses a picture processing device, comprising: the photographing module is used for carrying out exposure photographing operation at preset time intervals; the acquisition module is used for acquiring a to-be-processed picture from the pictures obtained by the exposure photographing operation based on the brightness of the pictures obtained by the photographing operation when the exposure photographing operation is finished; and the superposition module is used for superposing the pictures to be processed to generate a target picture when the pictures to be processed are continuously shot pictures. The invention also discloses a picture processing method. The method and the device realize that the target picture is obtained according to the picture with the brightness higher than that of other pictures in the pictures obtained by exposure photographing operation, so that scenes appearing in the target picture instantly are clearer.

Description

Picture processing method and device

Technical Field

The present invention relates to the field of image processing technologies, and in particular, to a method and an apparatus for processing an image.

Background

With the rapid development of image processing technology, the photographing functions of mobile terminals such as mobile phones and PADs are more and more abundant.

Because the existing mobile terminal can not realize long-time exposure when taking a picture, the picture which is worried about when capturing the object or scene which appears instantly is not clear, and even the object or scene which appears instantly can not be worried about.

Disclosure of Invention

The invention provides a picture processing method and a picture processing device, and aims to solve the technical problem that pictures are not clear due to fear when an existing mobile terminal captures an object or a scene appearing instantly.

To achieve the above object, the present invention provides a picture processing apparatus, comprising:

the photographing module is used for carrying out exposure photographing operation at preset time intervals;

the acquisition module is used for acquiring a to-be-processed picture from the pictures obtained by the exposure photographing operation based on the brightness of the pictures acquired by the photographing operation when the exposure photographing operation is finished, wherein the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the pictures obtained by the exposure photographing operation;

and the superposition module is used for superposing the pictures to be processed to generate a target picture when the pictures to be processed are continuously shot pictures.

Optionally, the superimposing module includes:

the first obtaining unit is used for obtaining a first picture group where a picture with the maximum brightness value corresponding to each picture to be processed is located when the picture to be processed comprises a plurality of groups of continuously shot picture groups;

a second obtaining unit, configured to obtain a maximum luminance value of a second group of pictures, excluding the first group of pictures, in each of the groups of pictures;

the first superimposing unit is configured to, when a luminance difference between a maximum luminance value of a second group of pictures and a maximum luminance value of the first group of pictures is smaller than a preset threshold, superimpose the first group of pictures and the second group of pictures, in which the luminance difference between the maximum luminance value and the maximum luminance value of the first group of pictures is smaller than the preset threshold, respectively to generate a target picture.

Optionally, the superimposing module further includes:

and the second overlapping unit is used for overlapping the first picture group to generate a target picture when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is greater than or equal to a preset threshold value.

Optionally, the obtaining module includes:

the first picture acquiring unit is used for acquiring a picture with the brightness larger than a preset brightness threshold value from the pictures acquired by the exposure photographing operation based on the brightness of the pictures acquired by the photographing operation when the exposure photographing operation is finished;

and the second picture acquisition unit is used for acquiring the picture to be processed from the acquired pictures with the brightness larger than the preset brightness threshold, wherein the brightness of the picture to be processed is larger than the brightness of other pictures except the picture to be processed in the acquired pictures with the brightness larger than the preset brightness threshold.

Optionally, the picture processing apparatus further includes:

the storage module is used for storing the pictures obtained by the exposure photographing operation and the corresponding photographing time in real time and calculating the number of the currently stored pictures;

and the deleting module is used for deleting the picture with the earliest photographing moment when the number of the currently stored pictures reaches a preset threshold value.

In addition, to achieve the above object, the present invention further provides an image processing method, including:

carrying out exposure photographing operation at preset time intervals;

when the exposure photographing operation is finished, acquiring a to-be-processed picture from the pictures obtained by the exposure photographing operation based on the brightness of the pictures obtained by the photographing operation, wherein the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the pictures obtained by the exposure photographing operation;

and when the picture to be processed is a continuously shot picture, overlapping the picture to be processed to generate a target picture.

Optionally, when the to-be-processed picture is a continuously-shot picture, the step of superimposing the to-be-processed picture to generate a target picture includes:

when the pictures to be processed contain a plurality of groups of continuously shot picture groups, acquiring a first picture group where the picture with the largest brightness value corresponding to each picture to be processed is located;

acquiring the maximum brightness value of a second picture group except the first picture group in each picture group;

when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is smaller than a preset threshold value, the first picture group and the second picture group with the brightness difference between the maximum brightness value and the maximum brightness value of the first picture group smaller than the preset threshold value are respectively superposed to generate a target picture.

Optionally, after the step of obtaining the maximum luminance value of a second group of pictures other than the first group of pictures in each group of pictures, the method further includes:

and when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is larger than or equal to a preset threshold value, overlapping the first picture group to generate a target picture.

Optionally, when the exposure photographing operation is completed, the step of obtaining a to-be-processed picture in the picture obtained by the exposure photographing operation based on the brightness of the picture obtained by the photographing operation includes:

when the exposure photographing operation is finished, acquiring a picture with the brightness larger than a preset brightness threshold value from the pictures acquired by the exposure photographing operation based on the brightness of the pictures acquired by the photographing operation;

and acquiring a to-be-processed picture from the acquired pictures with the brightness larger than the preset brightness threshold, wherein the brightness of the to-be-processed picture is larger than the brightness of other pictures except the to-be-processed picture in the acquired pictures with the brightness larger than the preset brightness threshold.

Optionally, between the step of performing the exposure photographing operation at preset time intervals and the step of acquiring a to-be-processed picture in the picture obtained by the exposure photographing operation based on the brightness of the picture acquired by the photographing operation when the exposure photographing operation is completed, the method further includes:

storing the pictures obtained by the exposure photographing operation and the corresponding photographing time in real time, and calculating the number of the currently stored pictures;

and when the number of the currently stored pictures reaches a preset threshold value, deleting the picture with the earliest photographing moment.

According to the method, the exposure photographing operation is carried out at intervals of the preset time through the photographing module, then when the exposure photographing operation is finished, the acquisition module acquires the picture to be processed from the picture obtained through the exposure photographing operation based on the brightness of the picture obtained through the photographing operation, and then when the picture to be processed is a continuously photographed picture, the superposition module superposes the picture to be processed to generate the target picture. Further, the mobile terminal of the embodiment can capture the motion track of the object with the fast motion speed, so that the photographing function of the mobile terminal is richer.

Drawings

Fig. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention;

FIG. 2 is a functional block diagram of a picture processing apparatus according to a first embodiment of the present invention;

FIG. 3 is a graph illustrating luminance distribution of a picture according to an embodiment of the present invention;

FIG. 4 is a schematic diagram of a detailed functional module of an overlay module in a second embodiment of the image processing apparatus according to the present invention;

FIG. 5 is a graph of luminance distribution of a picture according to another embodiment of the present invention;

FIG. 6 is a schematic diagram of a detailed functional module of an obtaining module in a third embodiment of the image processing apparatus according to the present invention;

FIG. 7 is a diagram illustrating functional modules of a fourth embodiment of an image processing apparatus according to the present invention;

FIG. 8 is a flowchart illustrating a first embodiment of a method for processing pictures according to the present invention;

FIG. 9 is a schematic view of a detailed flow of a step of superimposing to-be-processed pictures according to a second embodiment of the picture processing method of the present invention;

FIG. 10 is a flowchart illustrating a detailed process of a step of obtaining a picture to be processed according to a third embodiment of the picture processing method of the present invention;

fig. 11 is a flowchart illustrating a fourth embodiment of a picture processing method according to the present invention.

The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.

Detailed Description

It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.

The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.

Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.

Referring to fig. 1, fig. 1 is a schematic diagram of a hardware structure of a mobile terminal implementing various embodiments of the present invention.

The photographing lens 1211 is composed of a plurality of optical lenses for forming an object image, and is a single focus lens or a zoom lens. The photographing lens 1211 is movable in the optical axis direction under the control of the lens driver 1221, and the lens driver 1221 controls the focal position of the photographing lens 1211 in accordance with a control signal from the lens driving control circuit 1222. The lens drive control circuit 1222 performs drive control of the lens driver 1221 in accordance with a control command from the microcomputer 1217. An image pickup device 1212 is disposed on the optical axis of the photographing lens 1211 near the position of the object image formed by the photographing lens 1211. The image pickup device 1212 is used to pick up an image of an object and acquire picked-up image data. Photodiodes constituting each pixel are two-dimensionally arranged in a matrix on the image pickup device 1212. Each photodiode generates a photoelectric conversion current corresponding to the amount of received light, and the photoelectric conversion current is charged by a capacitor connected to each photodiode. A bayer RGB color filter is disposed on the front surface of each pixel.

The image pickup device 1212 is connected to an image pickup circuit 1213, and the image pickup circuit 1213 performs charge accumulation control and image signal reading control in the image pickup device 1212, performs waveform shaping after reducing reset noise for the read image signal (analog image signal), and further performs gain improvement or the like so as to obtain an appropriate signal level. The imaging circuit 1213 is connected to an a/D converter 1214, and the a/D converter 1214 performs analog-to-digital conversion on the analog image signal and outputs a digital image signal (hereinafter referred to as image data) to the bus 1227.

The bus 1227 is a transfer path for transferring various data read out or generated inside the camera. The a/D converter 1214 described above is connected to the bus 1227, and further connected to an image processor 1215, a JPEG processor 1216, a microcomputer 1217, an SDRAM (Synchronous Dynamic random access memory) 1218, a memory interface (hereinafter referred to as memory I/F)1219, and an LCD (Liquid Crystal Display) driver 1220.

The image processor 1215 performs various image processing such as OB subtraction processing, white balance adjustment, color matrix operation, gamma conversion, color difference signal processing, noise removal processing, synchronization processing, and edge processing on image data output from the image pickup device 1212. The JPEG processor 1216 compresses the image data read out from the SDRAM1218 in a JPEG compression method when recording the image data in the recording medium 1225. The JPEG processor 1216 decompresses JPEG image data for image reproduction display. When decompression is performed, a file recorded in the recording medium 1225 is read out, decompression processing is performed in the JPEG processor 1216, and the decompressed image data is temporarily stored in the SDRAM1218 and displayed on the LCD 1226. In the present embodiment, the JPEG system is used as the image compression/decompression system, but the compression/decompression system is not limited to this, and other compression/decompression systems such as MPEG, TIFF, and h.264 may be used.

The microcomputer 1217 functions as a control unit of the entire camera, and collectively controls various processing sequences of the camera. The microcomputer 1217 is connected to an operation unit 1223 and a flash memory 1224.

The operation unit 1223 includes, but is not limited to, physical keys or virtual keys, which may be various input buttons such as a power button, a photographing key, an editing key, a moving image button, a reproduction button, a menu button, a cross key, an OK button, a delete button, and an enlargement button, and operation controls such as various input keys, and which detect operation states of these operation controls.

The detection result is output to the microcomputer 1217. A touch panel is provided on the front surface of the LCD1226 as a display, and a touch position of the user is detected and output to the microcomputer 1217. The microcomputer 1217 executes various processing sequences corresponding to the user's operation according to the detection result of the operation position from the operation unit 1223.

The flash memory 1224 stores programs for executing various processing sequences of the microcomputer 1217. The microcomputer 1217 controls the entire camera according to the program. The flash memory 1224 stores various adjustment values of the camera, and the microcomputer 1217 reads the adjustment values and controls the camera in accordance with the adjustment values.

The SDRAM1218 is an electrically rewritable volatile memory for temporarily storing image data and the like. The SDRAM1218 temporarily stores the image data output from the a/D converter 1214 and the image data processed by the image processor 1215, JPEG processor 1216, and the like.

The memory interface 1219 is connected to the recording medium 1225, and performs control for writing and reading image data and data such as a file header added to the image data to and from the recording medium 1225. The recording medium 1225 is, for example, a recording medium such as a memory card that can be attached to and detached from the camera body, but is not limited to this, and may be a hard disk or the like that is built in the camera body.

The LCD driver 1210 is connected to the LCD1226, and stores the image data processed by the image processor 1215 in the SDRAM1218, and when display is required, reads the image data stored in the SDRAM1218 and displays the image data on the LCD1226, or the image data compressed by the JPEG processor 1216 is stored in the SDRAM1218, and when display is required, the JPEG processor 1216 reads the compressed image data in the SDRAM1218, decompresses the data, and displays the decompressed image data through the LCD 1226.

The LCD1226 is disposed on the back surface of the camera body and displays an image. LCD1226LCD), however, various display panels (LCD1226) such as organic EL may be used, but not limited thereto, and various display panels such as organic EL may be used.

Based on the above schematic diagram of the hardware structure of the mobile terminal, embodiments of the image processing method and apparatus of the present invention are provided.

The invention provides a picture processing device. Referring to fig. 2, fig. 2 is a functional module diagram of a picture processing apparatus according to a first embodiment of the present invention.

In this embodiment, the picture processing apparatus includes:

the photographing module 10 is used for performing exposure photographing operation at preset time intervals;

in this embodiment, before the photographing module 10 performs the exposure photographing operation at preset time intervals, functions of continuous photographing and automatic exposure, such as taking 60 pictures per second, etc., of the camera application need to be configured. In other embodiments, when receiving a photographing instruction, the photographing module 10 performs exposure photographing operation at preset time intervals, where the triggering manner of the photographing instruction includes: triggering a photographing instruction based on touch operation triggered by a preset control, for example, a photographing option is arranged in a certain menu of the mobile terminal, and the photographing instruction can be triggered when a user clicks the photographing option in the menu; triggering a photographing instruction when a sliding touch operation triggered based on a picture processing interface is detected, for example, a camera application corresponding to the mobile terminal of the embodiment is installed on the mobile terminal, and the like, and a user can enter the photographing interface by opening the application and then trigger the photographing instruction when the sliding touch operation triggered based on the picture processing interface is detected; when the mobile terminal is provided with a pressure sensor, a photographing instruction can be triggered by the pressure sensor, the pressure sensor can be arranged on each side surface of the mobile terminal, such as the left side, the right side, the top side or the bottom side, and the like, and the photographing instruction can be triggered when the pressure sensor is detected to change and the change meets a preset condition, wherein the preset condition can be that the pressure value of the pressure sensor is greater than or equal to a preset pressure threshold value, or the pressing frequency of the pressing operation of the pressing pressure sensor is greater than or equal to a preset frequency threshold value, namely when the pressure value of the pressure sensor is greater than or equal to the preset pressure threshold value, or when the pressing operation is detected and the pressing frequency of the pressing operation is greater than or equal to the preset frequency threshold value, the photographing instruction can be triggered, and the preset pressure threshold value and the preset frequency threshold value can be set by a user according to own, of course, the preset pressure threshold and the preset number threshold may also be default values of the system, and in other embodiments, the photographing instruction may also be triggered when the pressing operation on the pressure sensor is detected, the pressure value of the pressure sensor is greater than the second preset pressure threshold, and the pressing duration of the pressing operation is greater than or equal to the preset duration threshold.

An obtaining module 20, configured to, when the exposure photographing operation is completed, obtain a to-be-processed picture in the pictures obtained by the exposure photographing operation based on brightness of the pictures obtained by the photographing operation, where the brightness of the to-be-processed picture is greater than brightness of other pictures except the to-be-processed picture in the pictures obtained by the exposure photographing operation;

the minimum brightness of the to-be-processed picture is greater than the brightness of the to-be-processed picture obtained by the exposure photographing operation. In this embodiment, the brightness of the picture and the photographing time corresponding to each picture may be obtained according to the exposure photographing operation to generate a brightness distribution map, and when a peak exists in the generated brightness distribution map, if the brightness of the picture corresponding to the peak is greater than the brightness of the pictures corresponding to other positions in the brightness distribution map, the picture corresponding to the peak is the picture to be processed. In this embodiment, the brightness of the picture obtained by the exposure photographing operation may be calculated after the exposure photographing operation is completed, or the brightness of the picture obtained by the exposure photographing operation may be calculated when each picture is obtained by the exposure photographing operation; wherein, the brightness calculation process of the picture obtained by the exposure and photographing operation is as follows: obtaining an RBG value of a picture, and then calculating corresponding brightness according to the RBG value of the picture, wherein a brightness calculation formula according to the RBG value of the picture is as follows: the luminance Y is 0.3R +0.6G +0.1B, and thus, in one case, the luminance of each picture may be calculated by first obtaining RGB values of the picture and then calculating the luminance of each picture according to a luminance value calculation formula; in another case, the brightness of each picture can be obtained by respectively obtaining the RGB values of each pixel point in each picture, then respectively calculating the brightness of each pixel point in each picture according to the brightness value calculation formula, and finally respectively performing weighted average on the brightness of each pixel point in each picture. The exposure photographing operation is finished, that is, the user stops the exposure photographing operation of the mobile terminal, and of course, the exposure photographing operation may also be stopped by the mobile terminal when the duration of the exposure photographing operation reaches a set time or when the number of the pictures obtained by the exposure photographing operation reaches a preset number, and at this time, the brightness of each picture obtained by the exposure photographing operation is calculated respectively.

And the overlapping module 30 is configured to overlap the pictures to be processed to generate a target picture when each of the pictures to be processed is a continuously shot picture.

When storing the pictures obtained by photographing, the mobile terminal may store the information such as the photographing time together, and the overlay module 30 determines whether the pictures to be processed obtained by the obtaining module 20 are continuously photographed, for example, whether each picture in the pictures to be processed is a picture obtained by photographing at intervals, or whether each photographing time of the pictures to be processed is a time of a continuous interval, and the pictures obtained by photographing may be sequentially ordered or numbered according to the time sequence. When each of the pictures to be processed is a continuously shot picture, the superimposition module 30 superimposes the pictures to be processed to generate the target picture, wherein when the pictures are superimposed, the superimposition processing that performs weighted average according to the luminance value of each of the pictures to be processed may be adopted, that is, a higher weight coefficient is assigned to a picture with a higher luminance value among the pictures to be processed, and a lower weight coefficient is assigned to a picture with a lower luminance value among the pictures to be processed. In other embodiments, a certain limitation may be imposed on the number of the pictures to be processed, for example, when the number of the pictures to be processed is greater than or equal to 5, the operation of overlapping the pictures to be processed is performed, and when the number of the pictures to be processed is less than 5, the operation of overlapping is not performed.

The mobile terminal of this embodiment may be applied to mobile terminals such as mobile phones, and certainly, in this embodiment, when there are intermittently shot pictures in each picture of the pictures to be processed, that is, each picture of the pictures to be processed is not all continuously shot pictures, the continuously shot pictures in the pictures to be processed may be respectively superimposed.

Further, in other embodiments, the mobile terminal further includes: and the storage module is used for storing the superposed pictures of the pictures to be processed and deleting the pictures obtained by the exposure and photographing operation.

After the superposition module 30 completes superposition of the pictures to be processed, the superposed target picture is generated, the superposed target picture is stored by the storage module, and the picture obtained by exposure and photographing operation is deleted, so that the occupancy rate of the storage space of the mobile terminal is reduced, and the storage space of the mobile terminal is saved.

Referring to fig. 3, fig. 3 is a luminance distribution diagram of 30 pictures obtained by the timing photographing operation, that is, a luminance distribution diagram formed according to the luminance value of the 30 pictures obtained by the timing photographing operation and the photographing time corresponding to each picture, where a preset threshold value in fig. 3 is 50, and there are continuously photographed picture groups having luminance values greater than 50 in the picture, therefore, the pictures to be processed are superimposed by the superimposing module 30 to generate a target picture, for example, when the pictures obtained by the timing photographing operation are pictures obtained by photographing lightning, the target picture generated after superimposing by the superimposing module 30 can clearly embody the shape of the lightning.

In other embodiments, the mobile terminal may set one or more groups of preset brightness values, and then calculate the brightness of the picture obtained by the exposure photographing operation in real time when the photographing module 10 performs the exposure photographing operation at preset time intervals; when the brightness is larger than the preset brightness value, taking the picture as a picture to be processed, and then executing the step of calculating the brightness of the picture obtained by the exposure and photographing operation in real time; and when the brightness is less than or equal to the preset brightness value, superposing the to-be-processed pictures to generate a target picture, and deleting the to-be-processed pictures and all currently obtained pictures through exposure and photographing operations. When a picture is obtained by photographing each time, judging whether the brightness of the current picture is greater than a preset brightness value, if so, updating the picture to be processed based on the current picture, namely adding the current picture to the picture to be processed; and if the brightness of the current picture is less than or equal to the preset brightness value, superposing the pictures to be processed to generate a target picture, and deleting the pictures in the pictures to be processed, wherein the pictures to be processed are superposed to generate the target picture when the number of the pictures to be processed is greater than 1.

In this embodiment, different preset brightness values may be set according to different environments, for example, different preset brightness values may be set according to environmental factors such as weather and time, and factors such as scenes in which pictures may be taken; since the mobile terminal of this embodiment is used to process the picture of the object appearing at the moment of shooting, that is, other scenes except the object appearing at the moment in the picture are unchanged or basically unchanged, the brightness value of any one picture except the picture including the object appearing at the moment of shooting can be used as the preset brightness value of the current shooting environment, and of course, the preset brightness value of the current shooting environment can also be determined in other ways before shooting.

In this embodiment, the exposure photographing operation is performed at preset time intervals by the photographing module 10, then when the exposure photographing operation is completed, the obtaining module 20 obtains a to-be-processed picture from the picture obtained by the exposure photographing operation based on the brightness of the picture obtained by the photographing operation, and then when the to-be-processed picture is a continuously photographed picture, the superimposing module 30 superimposes the to-be-processed picture to generate a target picture, so that the target picture is obtained according to the picture with the brightness higher than the brightness of other pictures in the picture obtained by the exposure photographing operation, so that the scene appearing in the target picture instantly is clearer, for example, the mobile terminal of this embodiment performs superimposing processing on the pictures of scenes such as lightning and the like continuously photographed pictures, the scenes such as lightning and the like in the superimposed generated target picture are clearer, and the user experience is improved. Further, the mobile terminal of the embodiment can capture the motion track of the object with the fast motion speed, so that the photographing function of the mobile terminal is richer.

A second embodiment of the image processing apparatus according to the present invention is proposed based on the first embodiment, and referring to fig. 4, in this embodiment, the superimposing module 30 includes:

the first obtaining unit 31 is configured to obtain, when the to-be-processed picture includes multiple groups of continuously-shot picture groups, a first picture group where a picture with a largest brightness value corresponding to each to-be-processed picture is located;

the picture to be processed contains a plurality of groups of continuously shot picture groups, which means that each picture group in the picture to be processed is not continuous with the shooting time of other picture groups, and at the moment, the picture group where the picture with the maximum brightness value corresponding to the picture to be processed is located is taken as the first picture group.

A second obtaining unit 32, configured to obtain a maximum luminance value of a second group of pictures, except for the first group of pictures, in each of the groups of pictures;

the second picture group is all the picture groups except the first picture group in each picture group of the picture to be processed. The second acquisition unit 32 acquires the maximum luminance value of each second group of pictures.

The first superimposing unit 33 is configured to, when a luminance difference between a maximum luminance value of a second group of pictures and a maximum luminance value of the first group of pictures is smaller than a preset threshold, superimpose the first group of pictures and the second group of pictures, in which the luminance difference between the maximum luminance value and the maximum luminance value of the first group of pictures is smaller than the preset threshold, respectively to generate a target picture.

The preset threshold is a preset brightness difference, the first group of pictures and the second group of pictures, in which the brightness difference between the maximum brightness value and the maximum brightness value of the first group of pictures is smaller than the preset threshold, are respectively superimposed by the first superimposing unit 43 to generate the target picture, so that a plurality of target pictures can be obtained, the accuracy and consistency of the target pictures formed by superimposing the groups of pictures can be ensured, and the phenomena that the generated target picture is far away from other target pictures or does not include target scenes due to errors in the photographing operation and the picture processing process are avoided.

Further, in other embodiments, the superposition module 30 further includes: and the second overlapping unit is used for overlapping the first picture group to generate a target picture when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is greater than or equal to a preset threshold value.

When the maximum brightness value of the second picture group in the picture to be processed is larger than the preset threshold value, the second superposition unit only superposes the first picture group to generate the target picture, so that the phenomena that the generated target picture is far away from other target pictures or does not comprise target scenes and the like caused by errors in the photographing operation and the picture processing process are avoided.

Referring to fig. 5, fig. 5 is a luminance distribution diagram of 50 pictures obtained by timing photographing, that is, a luminance distribution diagram formed according to the luminance values of 50 pictures obtained by timing photographing and the photographing time corresponding to each picture, where the preset threshold in fig. 5 is 50, and there are two groups of continuously photographed pictures having luminance values greater than 50 in the drawing, and the preset threshold may be set to 10, and it can be seen that the luminance difference between the maximum luminance value of the second group of pictures and the maximum luminance value of the first group of pictures is less than the preset threshold 10, therefore, the first superimposing unit 43 superimposes the two groups of pictures respectively to generate two target pictures, for example, when the picture obtained by timing photographing is a picture obtained by photographing a lightning, two different pictures containing lightning can be obtained after processing by the first superimposing unit 43.

In this embodiment, when the to-be-processed pictures include multiple groups of continuously-shot picture groups, the first obtaining unit 31 obtains a first picture group where a picture with the largest brightness value corresponding to each to-be-processed picture is located, then the second obtaining unit 32 obtains the largest brightness value of a second picture group in each picture group except the first picture group, and then when a brightness difference between the largest brightness value of the second picture group and the largest brightness value of the first picture group is smaller than a preset threshold, the first superimposing unit 33 superimposes the first picture group and the second picture group whose brightness difference between the largest brightness value and the largest brightness value of the first picture group is smaller than the preset threshold respectively to generate the target picture, so that the continuously-shot picture groups in the to-be-processed pictures are superimposed according to the preset threshold, and accuracy and consistency of each target picture are ensured, the phenomenon that the generated target picture is far from other target pictures or does not comprise target scenes and the like due to errors in the photographing operation and the picture processing process is avoided.

A third embodiment of the image processing apparatus according to the present invention is provided based on the first embodiment, and referring to fig. 6, in the present embodiment, the obtaining module 20 includes:

a first picture obtaining unit 21, configured to, when the exposure photographing operation is completed, obtain, based on brightness of a picture obtained by the photographing operation, a picture with brightness greater than a preset brightness threshold from among pictures obtained by the exposure photographing operation;

in this embodiment, the preset brightness threshold is set according to a photographing function of the mobile terminal, and a photographing environment should be considered as much as possible when the preset brightness threshold is set, for example, the mobile terminal may set different preset brightness thresholds according to different environments, such as setting different preset brightness thresholds according to environmental factors such as weather and time, and scenery in which a photographed image may be taken; since the mobile terminal of this embodiment is used to process the picture of the object appearing at the moment of shooting, that is, other scenes except the object appearing at the moment in the picture are unchanged or basically unchanged, the brightness value of any one picture except the picture including the object appearing at the moment of shooting can be used as the preset brightness threshold of the current shooting environment, and of course, the preset brightness threshold of the current shooting environment can also be determined in other ways before shooting.

The second picture obtaining unit 22 is configured to obtain a to-be-processed picture from the obtained pictures with the brightness greater than the preset brightness threshold, where the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the obtained pictures with the brightness greater than the preset brightness threshold.

In this embodiment, when the exposure photographing operation is completed, the first picture obtaining unit 21 obtains, based on the brightness of the picture obtained by the photographing operation, a picture with brightness greater than a preset brightness threshold value from the picture obtained by the exposure photographing operation, and then the second picture obtaining unit 22 obtains a to-be-processed picture from the obtained picture with brightness greater than the preset brightness threshold value, so that the to-be-processed picture is obtained according to the preset brightness threshold value, the accuracy rate of obtaining the to-be-processed picture is improved, and the accuracy of the target picture is further ensured.

A fourth embodiment of the picture processing apparatus according to the present invention is proposed based on the first embodiment, and referring to fig. 7, in this embodiment, the picture processing apparatus further includes:

the storage module 40 is used for storing the pictures obtained by the exposure photographing operation and the corresponding photographing time in real time and calculating the number of the currently stored pictures;

when the mobile terminal performs exposure shooting, the storage module 40 stores the pictures obtained by the shooting operation and the shooting time corresponding to the pictures, and calculates the number of the pictures stored at the current time.

And the deleting module 50 is configured to delete the picture with the earliest photographing time when the number of the currently stored pictures reaches a preset threshold.

The preset threshold is a maximum value of pictures obtained by photographing at fixed time for the mobile terminal which is set by the user, for example, when the time interval of the regular photographing is 1 second, the preset threshold can be set to 180, at this time, the mobile terminal only stores the pictures obtained by photographing in the last 3 minutes, and when the number of the currently stored pictures is greater than the preset threshold, the deleting module 50 deletes the picture with the earliest photographing time, so that the number of the pictures stored in the mobile terminal is less than or equal to the preset threshold, and it is further ensured that the mobile terminal currently has enough storage space to store the pictures which are subsequently photographed.

In this embodiment, the pictures obtained by the exposure photographing operation and the corresponding photographing time are stored in real time through the storage module 40, the number of the currently stored pictures is calculated, and then when the number of the currently stored pictures reaches a preset threshold, the deletion module 50 deletes the picture with the earliest photographing time, so that the number of the pictures stored in the mobile terminal is less than or equal to the preset threshold, and it is further ensured that the mobile terminal currently has enough storage space to store the subsequently photographed pictures.

The invention further provides an image processing method. Referring to fig. 8, fig. 8 is a flowchart illustrating a picture processing method according to a first embodiment of the present invention.

In this embodiment, the picture processing method includes:

step S10, exposure photographing operation is carried out at preset time intervals;

in this embodiment, before the mobile terminal performs the exposure photographing operation at preset time intervals, functions of continuous photographing and automatic exposure, such as taking 60 pictures per second, etc. need to be configured for the camera application. In other embodiments, the mobile terminal may perform exposure and photographing operations at preset time intervals when receiving a photographing instruction, where the triggering manner of the photographing instruction includes: triggering a photographing instruction based on touch operation triggered by a preset control, for example, a photographing option is arranged in a certain menu of the mobile terminal, and the photographing instruction can be triggered when a user clicks the photographing option in the menu; triggering a photographing instruction when a sliding touch operation triggered based on a picture processing interface is detected, for example, a camera application corresponding to the mobile terminal of the embodiment is installed on the mobile terminal, and the like, and a user can enter the photographing interface by opening the application and then trigger the photographing instruction when the sliding touch operation triggered based on the picture processing interface is detected; when the mobile terminal is provided with a pressure sensor, a photographing instruction can be triggered by the pressure sensor, the pressure sensor can be arranged on each side surface of the mobile terminal, such as the left side, the right side, the top side or the bottom side, and the like, and the photographing instruction can be triggered when the pressure sensor is detected to change and the change meets a preset condition, wherein the preset condition can be that the pressure value of the pressure sensor is greater than or equal to a preset pressure threshold value, or the pressing frequency of the pressing operation of the pressing pressure sensor is greater than or equal to a preset frequency threshold value, namely when the pressure value of the pressure sensor is greater than or equal to the preset pressure threshold value, or when the pressing operation is detected and the pressing frequency of the pressing operation is greater than or equal to the preset frequency threshold value, the photographing instruction can be triggered, and the preset pressure threshold value and the preset frequency threshold value can be set by a user according to own, of course, the preset pressure threshold and the preset number threshold may also be default values of the system, and in other embodiments, the photographing instruction may also be triggered when the pressing operation on the pressure sensor is detected, the pressure value of the pressure sensor is greater than the second preset pressure threshold, and the pressing duration of the pressing operation is greater than or equal to the preset duration threshold.

Step S20, when the exposure photographing operation is completed, acquiring a to-be-processed picture in the pictures acquired by the exposure photographing operation based on the brightness of the pictures acquired by the photographing operation, wherein the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the pictures acquired by the exposure photographing operation;

Step S30, when the picture to be processed is a continuously shot picture, overlapping the picture to be processed to generate a target picture

When storing the pictures obtained by photographing, the mobile terminal stores the information such as the photographing time and the like together, and determines whether the obtained pictures to be processed are continuously photographed, for example, whether each picture in the pictures to be processed is a picture obtained by photographing at intervals of regular photographing, or whether each photographing time of the pictures to be processed is a time of a continuous interval of regular photographing. When each picture in the pictures to be processed is a continuously shot picture, the pictures to be processed are overlapped to generate a target picture, wherein when the pictures are overlapped, the overlapping processing of weighted average according to the brightness value of each picture in the pictures to be processed can be adopted, namely, a higher weight coefficient is distributed to the picture with a higher brightness value in the pictures to be processed, and a lower weight coefficient is distributed to the picture with a lower brightness value in the pictures to be processed. In other embodiments, a certain limitation may be imposed on the number of the pictures to be processed, for example, when the number of the pictures to be processed is greater than or equal to 5, the operation of overlapping the pictures to be processed is performed, and when the number of the pictures to be processed is less than 5, the operation of overlapping is not performed.

In the embodiment, exposure photographing operation is performed at preset time intervals, then when the exposure photographing operation is completed, a to-be-processed picture is obtained from the picture obtained by the exposure photographing operation based on the brightness of the picture obtained by the photographing operation, and then when the to-be-processed picture is a picture continuously photographed, the to-be-processed picture is overlapped to generate a target picture. Further, the mobile terminal of the embodiment can capture the motion track of the object with the fast motion speed, so that the photographing function of the mobile terminal is richer.

A second embodiment of the picture processing method according to the present invention is proposed based on the first embodiment, and referring to fig. 9, in this embodiment, step S30 includes:

step S31, when the picture to be processed contains a plurality of groups of continuously shot picture groups, obtaining a first picture group where the picture with the maximum brightness value corresponding to each picture to be processed is located;

Step S42, obtaining a maximum brightness value of a second group of pictures in each group of pictures except the first group of pictures;

the second picture group is all the picture groups except the first picture group in each picture group of the picture to be processed.

Step S33, when a luminance difference between a maximum luminance value of a second group of pictures and a maximum luminance value of the first group of pictures is smaller than a preset threshold, superimposing the first group of pictures and the second group of pictures, in which the luminance difference between the maximum luminance value and the maximum luminance value of the first group of pictures is smaller than the preset threshold, respectively to generate a target picture;

the preset threshold is a preset brightness difference, the first picture group and the second picture group with the brightness difference between the maximum brightness value and the maximum brightness value of the first picture group being smaller than the preset threshold are respectively superposed to generate a target picture, a plurality of target pictures can be obtained, the accuracy and consistency of the target pictures formed after the picture groups are superposed can be ensured, and the phenomena that the generated target picture is far away from other target pictures or does not include target scenes due to errors in the photographing operation and picture processing process are avoided.

Further, in other embodiments, after the step S32, the step S30 further includes: and when the brightness difference between the maximum brightness value of the second picture group and the maximum brightness value of the first picture group is larger than or equal to a preset threshold value, overlapping the first picture group to generate a target picture.

In this embodiment, when the to-be-processed picture includes multiple groups of continuously-shot picture groups, a first picture group where a picture with the largest brightness value corresponding to each to-be-processed picture is located is obtained, then the largest brightness value of a second picture group in each picture group except the first picture group is obtained, and then when a brightness difference between the largest brightness value of the second picture group and the largest brightness value of the first picture group is smaller than a preset threshold, the first picture group and the second picture group with the brightness difference between the largest brightness value and the largest brightness value of the first picture group being smaller than the preset threshold are respectively superimposed to generate a target picture.

Referring to fig. 10, the third embodiment of the picture processing method according to the present invention is proposed based on the first embodiment, and in this embodiment, step S20 includes,

step S21, when the exposure photographing operation is completed, acquiring a picture with the brightness larger than a preset brightness threshold value from the pictures acquired by the exposure photographing operation based on the brightness of the pictures acquired by the photographing operation;

Step S22, acquiring a to-be-processed picture from the acquired pictures with the brightness greater than the preset brightness threshold, wherein the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the acquired pictures with the brightness greater than the preset brightness threshold.

In the embodiment, when the exposure photographing operation is completed, the image with the brightness larger than the preset brightness threshold is obtained in the image obtained by the exposure photographing operation based on the brightness of the image obtained by the photographing operation, and then the image to be processed is obtained in the image with the obtained brightness larger than the preset brightness threshold, so that the image to be processed is obtained according to the preset brightness threshold, the accuracy of obtaining the image to be processed is improved, and the accuracy of the target image is further ensured.

Referring to fig. 11, the fourth embodiment of the picture processing method according to the present invention is proposed based on the first embodiment, and in this embodiment, between step S10 and step S20, the picture processing method further includes:

step S40, storing the pictures obtained by the exposure photographing operation and the corresponding photographing time in real time, and calculating the number of the currently stored pictures;

in other embodiments, the pictures obtained by photographing may be sequentially numbered according to a time sequence during photographing, and the number of the pictures stored at the present time may be obtained by performing corresponding calculation according to the number of the current picture and the picture obtained by photographing at the first timing.

And step S50, deleting the picture with the earliest photographing time when the number of the currently stored pictures reaches a preset threshold value.

The preset threshold is the maximum value of pictures obtained by photographing at fixed time stored in the mobile terminal set by the user, for example, when the time interval of photographing at fixed time is 1 second, the preset threshold can be set to 180, at this time, the mobile terminal only stores the pictures obtained by photographing in the last 3 minutes, and when the number of the pictures stored at present is greater than the preset threshold, the picture with the earliest photographing time is deleted, so that the number of the pictures stored in the mobile terminal is less than or equal to the preset threshold, and the mobile terminal is further ensured to have enough storage space currently to store the pictures shot subsequently.

In this embodiment, the pictures obtained by the exposure photographing operation and the corresponding photographing time are stored in real time, the number of the currently stored pictures is calculated, and then when the number of the currently stored pictures reaches a preset threshold, the picture with the earliest photographing time is deleted, so that the number of the pictures stored in the mobile terminal is smaller than or equal to the preset threshold, and thus, the mobile terminal is ensured to have enough storage space to store the pictures to be subsequently photographed at present.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims

1. A picture processing apparatus, characterized in that the picture processing apparatus comprises:

the exposure and photographing device comprises an acquisition module, a processing module and a control module, wherein the acquisition module is used for acquiring a to-be-processed picture in a picture obtained by exposure and photographing operation based on the brightness of the picture acquired by the photographing operation when the exposure and photographing operation is finished, the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the picture obtained by the exposure and photographing operation, and the brightness of the to-be-processed picture is greater than a preset brightness value;

and the superposition module is used for superposing the pictures to be processed to generate target pictures when the pictures to be processed are continuously shot pictures, wherein the pictures obtained by shooting are sequentially numbered according to a time sequence, and if the numbers of all the pictures in the pictures to be processed are continuous, the pictures to be processed are continuously shot pictures.

2. The picture processing apparatus of claim 1, wherein the overlay module comprises:

3. The picture processing apparatus of claim 2, wherein the overlay module further comprises:

4. The picture processing apparatus according to claim 1, wherein the acquisition module includes:

the first picture acquiring unit is used for acquiring a first picture with the brightness larger than a preset brightness threshold value from the pictures obtained by the exposure photographing operation based on the brightness of the pictures obtained by the photographing operation when the exposure photographing operation is finished;

and the second picture acquisition unit is used for acquiring a picture to be processed from the first picture, wherein the brightness of the picture to be processed is greater than that of a second picture, and the second picture is other pictures except the picture to be processed in the first picture.

5. The picture processing apparatus according to any one of claims 1 to 4, further comprising:

6. An image processing method, characterized in that the image processing method comprises the following steps:

carrying out exposure photographing operation at preset time intervals;

when the exposure photographing operation is finished, acquiring a to-be-processed picture from the pictures obtained by the exposure photographing operation based on the brightness of the pictures obtained by the photographing operation, wherein the brightness of the to-be-processed picture is greater than the brightness of other pictures except the to-be-processed picture in the pictures obtained by the exposure photographing operation, and the brightness of the to-be-processed picture is greater than a preset brightness value;

and when the pictures to be processed are continuously shot pictures, overlapping the pictures to be processed to generate target pictures, wherein the pictures obtained by shooting are sequentially numbered according to a time sequence, and if the numbers of all the pictures in the pictures to be processed are continuous, the pictures to be processed are continuously shot pictures.

7. The picture processing method according to claim 6, wherein, when the picture to be processed is a continuously shot picture, the step of superimposing the picture to be processed to generate a target picture comprises:

8. The picture processing method according to claim 7, wherein after said step of obtaining a maximum luminance value of a second group of pictures other than said first group of pictures in each of said groups of pictures, said method further comprises:

9. The picture processing method according to claim 6, wherein the step of acquiring the picture to be processed among the pictures obtained by the exposure photographing operation based on the brightness of the pictures obtained by the photographing operation when the exposure photographing operation is completed comprises:

when the exposure photographing operation is completed, acquiring a first picture with the brightness larger than a preset brightness threshold value from the pictures acquired by the exposure photographing operation based on the brightness of the pictures acquired by the photographing operation;

and acquiring a picture to be processed in the first picture, wherein the brightness of the picture to be processed is greater than that of a second picture, and the second picture is other pictures except the picture to be processed in the first picture.

10. The picture processing method according to any one of claims 6 to 9, wherein between the step of performing an exposure photographing operation at every preset time interval and the step of acquiring a picture to be processed from among pictures obtained by the exposure photographing operation based on the brightness of the picture acquired by the photographing operation, the method further comprises: