[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN106534693A - Photo processing method, photo processing device and terminal - Google Patents

Photo processing method, photo processing device and terminal Download PDF

Info

Publication number
CN106534693A
CN106534693A CN201611059875.4A CN201611059875A CN106534693A CN 106534693 A CN106534693 A CN 106534693A CN 201611059875 A CN201611059875 A CN 201611059875A CN 106534693 A CN106534693 A CN 106534693A
Authority
CN
China
Prior art keywords
target scene
foreground object
foreground
background
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201611059875.4A
Other languages
Chinese (zh)
Other versions
CN106534693B (en
Inventor
黄雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201611059875.4A priority Critical patent/CN106534693B/en
Publication of CN106534693A publication Critical patent/CN106534693A/en
Application granted granted Critical
Publication of CN106534693B publication Critical patent/CN106534693B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Telephone Function (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a photo processing method. The photo processing method comprises steps that multiple photos of a target scene which are shot in a pre-determined angle relative to the target scene are compared and analyzed, and the multiple photos are shot through a single camera; a foreground object and a background object of the target scene are determined according to the comparison analysis result; photo synthesis is carried out according to the determined foreground object and the background object. The invention further discloses a photo processing device and a terminal, a problem that the large aperture effect can be realized through a single camera in the prior art is solved, the foreground object and the background object are determined through analyzing the multiple photos, the photos are synthesized to realize the large aperture effect, and user experience is improved.

Description

Photo processing method and device and terminal
Technical Field
The invention relates to the technical field of terminals, in particular to a photo processing method, a photo processing device and a terminal.
Background
Along with the development of the internet and the popularization of the terminal, the user group of the terminal is larger and larger, and meanwhile, more intelligent and humanized requirements are provided for software.
In the prior art, a real terminal is used as a game machine or a television by a user, possibly a learning machine, possibly a playground of a baby and the like, so that more fun is brought to the life of people.
With the gradual increase of the dependence of the user on the mobile terminal, the application of the user in the mobile terminal is increasing, the current mobile terminal can take pictures by using double lenses, one camera is used for measuring the depth of field of a shot object, the other camera is used for shooting the object, and then the information shot by the two cameras is combined into a picture. The synthesis of photos through two cameras has become a trend, but at present, most mobile terminals are still single-camera, and the effect of photos shot by a single camera is not good because the size of the aperture cannot be adjusted.
Aiming at the problem that the effect of a large aperture is difficult to shoot by a single camera in the related technology, a solution is not provided at present.
Disclosure of Invention
The invention mainly aims to provide a photo processing method, a photo processing device and a photo processing terminal, and aims to solve the problem that a large aperture effect is difficult to capture through a single camera in the related art.
To achieve the above object, the present invention provides a photo processing method, comprising:
performing comparative analysis on a plurality of pictures of a target scene, which are taken at a preset angle with the target scene, wherein the plurality of pictures are taken through a single camera;
determining a foreground object and a background object of the target scene according to the result of the comparison analysis;
and synthesizing a picture according to the determined foreground object and the background object.
Optionally, the comparing and analyzing the plurality of photographs of the target scene taken at the predetermined angle to the target scene includes: and determining the change condition of the pixels in the multiple photos by comparing the multiple photos of the target scene.
Optionally, determining the foreground object and the background object of the target scene according to the result of the contrast analysis includes: and determining a foreground object and a background object of the target scene according to the change conditions of the pixels in the plurality of pictures, wherein the background object is obtained when the pixel change is large, and the foreground object is obtained when the pixel change is small.
Optionally, synthesizing the depth-of-field picture of the large aperture according to the determined foreground object and the determined background object includes: blurring the background object to obtain a synthesized photo; or, sharpening the foreground object to obtain a synthesized picture; or, after the brightness of the foreground object is enhanced, the foreground object and the background object are combined into a photo.
Optionally, synthesizing the depth-of-field picture of the large aperture according to the determined foreground object and the determined background object includes: blurring the background object, and sharpening the foreground object; and superposing the background object after the blurring processing and the foreground object after the sharpening processing to obtain a synthesized picture.
Optionally, before performing comparative analysis on a plurality of photographs of a target scene taken at a predetermined angle to the target scene, the method further comprises: prompting to take the plurality of pictures at a position at a predetermined angle to the target object; saving the plurality of photographs taken at positions at a predetermined angle to the target object.
According to another aspect of the present invention, there is also provided a photograph processing apparatus including:
the system comprises a comparison analysis module, a comparison analysis module and a display module, wherein the comparison analysis module is used for comparing and analyzing a plurality of pictures of a target scene, which are shot at a preset angle with the target scene, and the pictures are shot by a single camera;
the determining module is used for determining a foreground object and a background object of the target scene according to the result of the comparison analysis;
and the synthesis module is used for synthesizing a picture according to the determined foreground object and the background object.
Optionally, the comparison analysis module is further configured to determine a change condition of pixels in a plurality of photos of the target scene by comparing the plurality of photos.
Optionally, the determining module is further configured to determine a foreground object and a background object of the target scene according to a change condition of pixels in the multiple photos, where the background object is a pixel with a large change, and the foreground object is a pixel with a small change.
Optionally, the synthesis module includes:
the first synthesis unit is used for blurring the background object to obtain a synthesized photo;
the second synthesis unit is used for carrying out sharpening processing on the foreground object to obtain a synthesized picture; or,
and the brightness enhancement unit is used for enhancing the brightness of the foreground object and then synthesizing the foreground object and the background object into a picture.
Optionally, the synthesis module includes:
the processing unit is used for blurring the background object and sharpening the foreground object;
and the superposition synthesis unit is used for superposing the background object subjected to the blurring processing and the foreground object subjected to the sharpening processing to obtain a synthesized picture.
Optionally, the apparatus further comprises:
the prompting module is used for prompting that the plurality of pictures are shot at the position which forms a preset angle with the target object;
and the storage module is used for storing the plurality of pictures shot at the positions forming the preset angles with the target object.
According to another aspect of the present invention, there is also provided a terminal including one of the above-described apparatuses. According to the invention, a plurality of photos of the target scene, which are shot at a preset angle with the target scene, are contrastively analyzed, wherein the plurality of photos are shot by a single camera; determining a foreground object and a background object of the target scene according to the result of the comparison analysis; according to the synthetic photo of the foreground object and the background object that determine, solved among the correlation technique through the problem of the effect of the difficult big light ring of shooting of single camera, determine foreground and background through carrying out the analysis to many photos, synthetic big light ring effect's photo has improved user experience.
Drawings
Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention;
FIG. 2 is a diagram of a wireless communication system for the mobile terminal shown in FIG. 1;
FIG. 3 is a flow diagram of a method of photo processing according to an embodiment of the invention;
FIG. 4 is a schematic illustration of taking multiple photographs according to an embodiment of the present invention;
FIG. 5 is a block diagram of a photo processing device according to an embodiment of the present invention;
FIG. 6 is a first block diagram of a photo processing device according to a preferred embodiment of the present invention;
FIG. 7 is a block diagram two of a photo processing device according to a preferred embodiment of the present invention;
fig. 8 is a block diagram three of a photograph processing apparatus according to a preferred embodiment of the present invention.
The implementation, functional features and advantages of the objects of the present invention will be further explained with reference to the accompanying drawings.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic diagram of a hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc.
Fig. 1 illustrates the mobile terminal 100 having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. The elements of the mobile terminal 100 will be described in detail below.
The wireless communication unit 110 may generally include one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive digital broadcasting by using a digital broadcasting system such as a data broadcasting system of multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO @), terrestrial digital broadcasting integrated service (ISDB-T), and the like. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).
The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.
The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.
The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth (TM), Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee (TM), and the like.
The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module 115 is a GPS (global positioning system). According to the current technology, the GPS calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS can calculate speed information by continuously calculating current position information in real time.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 122, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal 100. The microphone 122 may receive sounds (audio data) via the microphone 122 in a phone call mode, a recording mode, a voice recognition mode, or the like, and is capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
The user input unit 130 may generate key input data to control various operations of the mobile terminal 100 according to a command input by a user. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display unit 151 in the form of a layer, a touch screen may be formed.
The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device. The sensing unit 140 may include a proximity sensor 141.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and the external device.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal 100. Various command signals or power input from the cradle may be used as a signal for identifying whether the mobile terminal 100 is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and the like.
The display unit 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display unit 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display unit 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display unit 151 and the touch pad are overlapped with each other in the form of a layer to form a touch screen, the display unit 151 may serve as an input device and an output device. The display unit 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, mobile terminal 100 may include two or more display units (or other display devices), for example, mobile terminal 100 may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.
The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.
The alarm unit 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm unit 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm unit 153 may provide an output in the form of vibration, and when a call, a message, or some other incoming communication (communicating communication) is received, the alarm unit 153 may provide a tactile output (i.e., vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm unit 153 may also provide an output notifying the occurrence of an event via the display unit 151 or the audio output module 152.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
Up to this point, the mobile terminal 100 has been described in terms of its functionality. In addition, the mobile terminal 100 in the embodiment of the present invention may be a mobile terminal such as a folder type, a bar type, a swing type, a slide type, and other various types, and is not limited herein.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.
A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
Referring to fig. 2, a CDMA wireless communication system may include a plurality of intelligent terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC 280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC 280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul line may be constructed according to any of several known interfaces, which may include, for example, european/american standard high capacity digital lines (E1/T1), Asynchronous Transfer Mode (ATM), network protocol (IP), point-to-point protocol (PPP), frame relay, high-rate digital subscriber line (HDSL), Asymmetric Digital Subscriber Line (ADSL), or various types of digital subscriber lines (xDSL). It will be understood that a system as shown in fig. 2 may include multiple BSCs 275.
Each BS 270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS 270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz, 5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS 270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each partition of a particular BS 270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The location information module 115 (e.g., GPS) as shown in fig. 1 is generally configured to cooperate with the satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.
As a typical operation of the wireless communication system, the BS 270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station is processed within a particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC 280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC 280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS 270 to transmit forward link signals to the mobile terminal 100.
Based on the above mobile terminal, an embodiment of the present invention provides a photo processing method, and fig. 3 is a flowchart of the photo processing method according to the embodiment of the present invention, as shown in fig. 3, the method includes the following steps:
step S302, comparing and analyzing a plurality of pictures of a target scene, which are shot at a preset angle with the target scene, wherein the plurality of pictures are shot by a single camera;
step S304, determining a foreground object and a background object of the target scene according to the result of the comparison analysis;
and step S306, synthesizing a picture according to the determined foreground object and the determined background object.
Through the steps, a plurality of photos of the target scene, which are shot at a preset angle with the target scene, are contrastively analyzed, wherein the photos are shot through a single camera; determining a foreground object and a background object of the target scene according to the result of the comparison analysis; according to the synthetic photo of the foreground object and the background object that determine, solved among the correlation technique through the problem of the effect of the difficult big light ring of shooting of single camera, determine foreground and background through carrying out the analysis to many photos, synthetic big light ring effect's photo has improved user experience.
The method comprises the steps that a plurality of pictures are shot from left to right around an object between 1m and 5m, according to a plurality of shooting results, the position of a close foreground object does not move when a plurality of pictures are shot, the background changes greatly due to surrounding action, the corresponding position of the foreground object and the corresponding position of the background in the pictures are judged in the mode, and the depth-of-field camera pictures with large apertures can be synthesized by blurring and sharpening the background. By comparing a plurality of photographs, it is determined that an object whose position changes little is a foreground object (an object that needs SD imaging) and the other is a background object.
Performing comparative analysis of a plurality of photographs of a target scene taken at a predetermined angle to the target scene may include: and determining the change condition of the pixels in the multiple photos by comparing the multiple photos of the target scene. Optionally, determining the foreground object and the background object of the target scene according to the result of the contrast analysis may include: and determining a foreground object and a background object of the target scene according to the change conditions of the pixels in the plurality of pictures, wherein the background object is obtained when the pixel change is large, and the foreground object is obtained when the pixel change is small. Specifically, the method includes the steps of acquiring shot images of a plurality of pictures, acquiring depth information of each image according to a depth camera, and then obtaining distance information of an object in a scene from the camera. The multiple photos are differentiated in sequence, namely any two different images are subtracted to obtain difference values, and then the difference values are accumulated. And setting a threshold value T, wherein the pixel points with the accumulated difference d smaller than T are the pixel points of the target object, and the difference is smaller because the camera rotates around the object and the distance between the object pixel and the camera is basically kept unchanged. And background pixels have a large difference in distance change in each image as the camera moves. The background pixel and the target object pixel can be distinguished by mentioning the difference value by using the threshold value T.
There are many ways to compose a large-aperture depth-of-field photo according to the determined foreground object and background object, and in an alternative embodiment, the method may include: blurring the background object to synthesize a depth-of-field photo of a large aperture; sharpening the foreground object to synthesize a depth-of-field picture of a large aperture; synthesizing a depth-of-field photo of the large aperture after enhancing the brightness of the foreground object; or, the brightness of the foreground object is enhanced and then the image is matched with a depth-of-field photo of a large aperture.
In another alternative embodiment, may include: blurring the background object, sharpening the foreground object, and superposing the background object subjected to blurring and the foreground object subjected to sharpening to synthesize a large-aperture depth-of-field picture. The sharpening process can be used for rapidly focusing and blurring the edge of the foreground object by using a sharpening tool, so that the definition or focal length degree of the foreground object is improved, and the color of the foreground object is more vivid.
Enhancing the brightness of the foreground object in cooperation with the large aperture depth of view photograph may include: there are several algorithms for enhancing the local contrast of an image by enhancing the brightness of a foreground object. One such technique is referred to herein as Adaptive Contrast Enhancement (ACE). The ACE algorithm employs an unsharp mask technique: first the image is divided into two parts. The unsharp mask part, which is a low frequency, can be obtained by low-pass filtering (smoothing, blurring techniques) of the image. The second is a high frequency component, which can be obtained by subtracting the unsharp mask from the original image. The high frequency part is then amplified (the set of amplification coefficients is contrast plus CG) and added to the unsharp mask, resulting in an enhanced image, the heart of the ACE algorithm is how CG is calculated. The unsharp mask corresponds to the low frequency component of the image and can be generally implemented by calculating the pixel average of a local area centered on a particular pixel. Let us assume that x (i, j) is the gray value of a certain point in the image, and the definition of the local area is: a region with a window size of (2n +1) × (2n +1) centered on (i, j), where n is an integer. Of course, this window area need not be square. The local mean mx (i, j), i.e. the low frequency part, can be calculated by:
and the local variance σ x (i, j) is:
in the above equation, σ x (i, j) is the so-called Local Standard Deviation (LSD). Definition f (i, j) represents the enhanced pixel value corresponding to x (i, j). The ACE algorithm may be expressed as follows:
f(i,j)=mx(i,j)+G(i,j)[x(i,j)-mx(i,j)], (3)
where the function G (i, j) is CG as described above. In general, CG is always greater than 1, so that the high-frequency component [ x (i, j) -mx(i,j)]The enhancement can be obtained. One way of calculating the CG is given here as follows:
G(i,j)=min(max(1,(i,j)/G ),10) (4)
σ x (i, j) is the so-called Local Standard Deviation (LSD), G The local variance average of each point of the entire image is given by equation (5), and M and N are the image width and height. The min and max operations in equation (4) limit the value of G (i, j) to [ 110%]In the range of (1), the local mean square error is large at the edge of the image or other places with severe changes, the ratio of the average standard deviation to the whole image is also large, and the enhancement is needed; in the smooth region, the local mean square error will be small, and the ratio of the standard deviation to the global figure will be small, and thus will not be enhanced.
In order to ensure that the foreground object and the background object can be obtained through the multiple-picture contrast analysis, the multiple pictures of the target scene taken at a predetermined angle to the target scene can be prompted to be taken at a position at a predetermined angle to the target object before the multiple pictures of the target scene are subjected to the contrast analysis, the multiple pictures taken at a position at a predetermined angle to the target object are stored, fig. 4 is a schematic diagram of the multiple pictures taken according to the embodiment of the invention, as shown in fig. 4, the user is prompted to take at 45 degrees to the target scene, the pictures are stored after the shooting is finished, the user is prompted to take at 90 degrees to the target scene, and the like, the multiple pictures are obtained, and the number of intervals can be set, for example, the multiple pictures are taken without intervals of 20 degrees or 15 degrees.
According to another aspect of the embodiments of the present invention, there is also provided a photo processing apparatus, and fig. 5 is a block diagram of the photo processing apparatus according to the embodiments of the present invention, as shown in fig. 5, including:
a contrastive analysis module 52 for contrastively analyzing a plurality of photographs of a target scene taken at a predetermined angle to the target scene, wherein the plurality of photographs are taken by a single camera;
a determining module 54, configured to determine a foreground object and a background object of the target scene according to a result of the contrast analysis;
and a synthesizing module 56 for synthesizing a picture according to the determined foreground object and background object.
Optionally, the comparison analysis module 52 is further configured to determine a change condition of pixels in a plurality of photos of the target scene by comparing the plurality of photos.
Optionally, the determining module 54 is further configured to determine a foreground object and a background object of the target scene according to a change condition of pixels in the multiple photos, where the background object is a pixel with a large change, and the foreground object is a pixel with a small change.
Fig. 6 is a block diagram one of the photograph processing apparatus according to the preferred embodiment of the present invention, and as shown in fig. 6, the synthesizing module 56 includes:
a first synthesizing unit 62, configured to perform blurring processing on the background object to obtain a synthesized photo;
a second synthesizing unit 64, configured to sharpen the foreground object to obtain a synthesized picture; or,
and an enhanced brightness unit 66 for enhancing the brightness of the foreground object and then synthesizing a photo together with the foreground object.
Fig. 7 is a block diagram ii of the photograph processing apparatus according to the preferred embodiment of the present invention, and as shown in fig. 7, the synthesizing module 56 includes:
a processing unit 72, configured to perform blurring processing on the background object and perform sharpening processing on the foreground object;
and the superposition synthesis unit 74 is configured to superpose the background object subjected to the blurring processing and the foreground object subjected to the sharpening processing to obtain a synthesized photo.
Fig. 8 is a block diagram three of a photograph processing apparatus according to a preferred embodiment of the present invention, as shown in fig. 8, the apparatus further comprising:
a prompt module 82, configured to prompt the plurality of photographs to be taken at a predetermined angle with respect to the target object;
a saving module 84, configured to save the plurality of photos taken at the predetermined angle to the target object.
According to another aspect of the embodiments of the present invention, there is also provided a terminal including one of the above-mentioned apparatuses.
In the embodiment of the invention, a plurality of pictures of a target scene, which are shot at a preset angle with the target scene, are contrastively analyzed, wherein the plurality of pictures are shot by a single camera; determining a foreground object and a background object of the target scene according to the result of the comparison analysis; according to the depth of field photo of the large aperture synthesized by the determined foreground object and the determined background object, the problem that the effect of the large aperture is difficult to shoot through a single camera in the correlation technique is solved, the foreground and the background are determined through analyzing a plurality of photos, the photo of the large aperture effect is synthesized, and the user experience is improved.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes, which are made by using the contents of the present specification and the accompanying drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (10)

1. A method of processing a photograph, comprising:
performing comparative analysis on a plurality of pictures of a target scene, which are taken at a preset angle with the target scene, wherein the plurality of pictures are taken through a single camera;
determining a foreground object and a background object of the target scene according to the result of the comparison analysis;
and synthesizing a picture according to the determined foreground object and the background object.
2. The method of claim 1, wherein analyzing a plurality of photographs of a target scene taken at a predetermined angle to the target scene in comparison comprises:
and determining the change condition of the pixels in the multiple photos by comparing the multiple photos of the target scene.
3. The method of claim 2, wherein determining foreground objects and background objects of the target scene from the results of the contrast analysis comprises:
and determining a foreground object and a background object of the target scene according to the change conditions of the pixels in the plurality of pictures, wherein the background object is obtained when the pixel change is large, and the foreground object is obtained when the pixel change is small.
4. The method of claim 1, wherein composing a photograph from the determined foreground objects and background objects comprises:
blurring the background object to obtain a synthesized photo;
sharpening the foreground object to obtain a synthesized picture; or,
and after the brightness of the foreground object is enhanced, the foreground object and the background object are combined into a photo.
5. The method of claim 1, wherein composing a photograph from the determined foreground objects and background objects comprises:
blurring the background object, and sharpening the foreground object;
and superposing the background object after the blurring processing and the foreground object after the sharpening processing to obtain a synthesized picture.
6. The method of any of claims 1-5, wherein prior to performing comparative analysis of a plurality of photographs of a target scene taken at a predetermined angle to the target scene, the method further comprises:
prompting to take the plurality of pictures at a position at a predetermined angle to the target object;
saving the plurality of photographs taken at positions at a predetermined angle to the target object.
7. A photograph processing apparatus, characterized by comprising:
the system comprises a comparison analysis module, a comparison analysis module and a display module, wherein the comparison analysis module is used for comparing and analyzing a plurality of pictures of a target scene, which are shot at a preset angle with the target scene, and the pictures are shot by a single camera;
the determining module is used for determining a foreground object and a background object of the target scene according to the result of the comparison analysis;
and the synthesis module is used for synthesizing a picture according to the determined foreground object and the background object.
8. The apparatus of claim 7, wherein the synthesis module comprises:
the first synthesis unit is used for blurring the background object to obtain a synthesized photo;
the second synthesis unit is used for carrying out sharpening processing on the foreground object to obtain a synthesized picture; or,
and the brightness enhancement unit is used for enhancing the brightness of the foreground object and then synthesizing the foreground object and the background object into a picture.
9. The apparatus of claim 7, wherein the synthesis module comprises:
the processing unit is used for blurring the background object and sharpening the foreground object;
and the superposition synthesis unit is used for superposing the background object subjected to the blurring processing and the foreground object subjected to the sharpening processing to obtain a synthesized picture.
10. A terminal, characterized in that it comprises the apparatus of any one of claims 7 to 9.
CN201611059875.4A 2016-11-25 2016-11-25 A kind of photo processing method, device and terminal Active CN106534693B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611059875.4A CN106534693B (en) 2016-11-25 2016-11-25 A kind of photo processing method, device and terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611059875.4A CN106534693B (en) 2016-11-25 2016-11-25 A kind of photo processing method, device and terminal

Publications (2)

Publication Number Publication Date
CN106534693A true CN106534693A (en) 2017-03-22
CN106534693B CN106534693B (en) 2019-10-25

Family

ID=58357391

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611059875.4A Active CN106534693B (en) 2016-11-25 2016-11-25 A kind of photo processing method, device and terminal

Country Status (1)

Country Link
CN (1) CN106534693B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107018331A (en) * 2017-04-19 2017-08-04 努比亚技术有限公司 A kind of imaging method and mobile terminal based on dual camera
CN108093181A (en) * 2018-01-16 2018-05-29 奇酷互联网络科技(深圳)有限公司 Picture shooting method, device, readable storage medium storing program for executing and mobile terminal
CN108496352A (en) * 2017-05-24 2018-09-04 深圳市大疆创新科技有限公司 Image pickup method and device, image processing method and device
CN108921086A (en) * 2018-06-29 2018-11-30 Oppo广东移动通信有限公司 Image processing method and device, storage medium, electronic equipment
CN109445002A (en) * 2018-11-26 2019-03-08 Oppo广东移动通信有限公司 Microlens array structure and its manufacturing method, compound eye lens, electronic device
CN110580428A (en) * 2018-06-08 2019-12-17 Oppo广东移动通信有限公司 image processing method, image processing device, computer-readable storage medium and electronic equipment
CN111263067A (en) * 2020-02-18 2020-06-09 RealMe重庆移动通信有限公司 Image processing method, device, terminal equipment and storage medium

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101212611A (en) * 2007-12-25 2008-07-02 青岛海信信芯科技有限公司 Contrast enhancement method
CN101568908A (en) * 2006-02-14 2009-10-28 快图影像有限公司 Image blurring
CN101600044A (en) * 2008-06-03 2009-12-09 宝利微电子系统控股公司 Image definition enhancing method and device based on zoom factor
CN102096909A (en) * 2010-12-30 2011-06-15 东北大学 Improved unsharp masking image reinforcing method based on logarithm image processing model
CN102353352A (en) * 2011-07-29 2012-02-15 北京联合大学 Single-camera range measurement system and range measurement method thereof
CN103024350A (en) * 2012-11-13 2013-04-03 清华大学 Master-slave tracking method for binocular PTZ (Pan-Tilt-Zoom) visual system and system applying same
CN103559703A (en) * 2013-10-08 2014-02-05 中南大学 Crane barrier monitoring and prewarning method and system based on binocular vision
CN104424640A (en) * 2013-09-06 2015-03-18 格科微电子(上海)有限公司 Method and device for carrying out blurring processing on images
CN105245774A (en) * 2015-09-15 2016-01-13 努比亚技术有限公司 Picture processing method and terminal

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101568908A (en) * 2006-02-14 2009-10-28 快图影像有限公司 Image blurring
CN101212611A (en) * 2007-12-25 2008-07-02 青岛海信信芯科技有限公司 Contrast enhancement method
CN101600044A (en) * 2008-06-03 2009-12-09 宝利微电子系统控股公司 Image definition enhancing method and device based on zoom factor
CN102096909A (en) * 2010-12-30 2011-06-15 东北大学 Improved unsharp masking image reinforcing method based on logarithm image processing model
CN102353352A (en) * 2011-07-29 2012-02-15 北京联合大学 Single-camera range measurement system and range measurement method thereof
CN103024350A (en) * 2012-11-13 2013-04-03 清华大学 Master-slave tracking method for binocular PTZ (Pan-Tilt-Zoom) visual system and system applying same
CN104424640A (en) * 2013-09-06 2015-03-18 格科微电子(上海)有限公司 Method and device for carrying out blurring processing on images
CN103559703A (en) * 2013-10-08 2014-02-05 中南大学 Crane barrier monitoring and prewarning method and system based on binocular vision
CN105245774A (en) * 2015-09-15 2016-01-13 努比亚技术有限公司 Picture processing method and terminal

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107018331A (en) * 2017-04-19 2017-08-04 努比亚技术有限公司 A kind of imaging method and mobile terminal based on dual camera
CN108496352A (en) * 2017-05-24 2018-09-04 深圳市大疆创新科技有限公司 Image pickup method and device, image processing method and device
CN108093181A (en) * 2018-01-16 2018-05-29 奇酷互联网络科技(深圳)有限公司 Picture shooting method, device, readable storage medium storing program for executing and mobile terminal
CN110580428A (en) * 2018-06-08 2019-12-17 Oppo广东移动通信有限公司 image processing method, image processing device, computer-readable storage medium and electronic equipment
CN108921086A (en) * 2018-06-29 2018-11-30 Oppo广东移动通信有限公司 Image processing method and device, storage medium, electronic equipment
CN109445002A (en) * 2018-11-26 2019-03-08 Oppo广东移动通信有限公司 Microlens array structure and its manufacturing method, compound eye lens, electronic device
CN111263067A (en) * 2020-02-18 2020-06-09 RealMe重庆移动通信有限公司 Image processing method, device, terminal equipment and storage medium
CN111263067B (en) * 2020-02-18 2022-02-15 RealMe重庆移动通信有限公司 Image processing method, device, terminal equipment and storage medium

Also Published As

Publication number Publication date
CN106534693B (en) 2019-10-25

Similar Documents

Publication Publication Date Title
CN106454121B (en) Double-camera shooting method and device
CN106534693B (en) A kind of photo processing method, device and terminal
CN106909274B (en) Image display method and device
CN105163042B (en) A kind of apparatus and method for blurring processing depth image
CN105100491B (en) A kind of apparatus and method for handling photo
CN105278910B (en) A kind of display methods and device
CN106097284B (en) A kind of processing method and mobile terminal of night scene image
CN105303543A (en) Image enhancement method and mobile terminal
CN106713716B (en) Shooting control method and device for double cameras
CN106651867B (en) Method, device and terminal for realizing interactive image segmentation
CN107018331A (en) A kind of imaging method and mobile terminal based on dual camera
CN106657782B (en) Picture processing method and terminal
CN106851113A (en) A kind of photographic method and mobile terminal based on dual camera
CN105430258B (en) A kind of method and apparatus of self-timer group photo
CN106603931A (en) Binocular shooting method and device
CN106911881B (en) Dynamic photo shooting device and method based on double cameras and terminal
CN105100619A (en) Apparatus and method for adjusting shooting parameters
CN106851125B (en) Mobile terminal and multiple exposure shooting method
CN106993134B (en) Image generation device and method and terminal
CN106303044B (en) A kind of mobile terminal and obtain the method to coke number
CN105338244B (en) A kind of information processing method and mobile terminal
CN105049612A (en) Method of realizing recording and device of realizing recording
CN105262953B (en) A kind of mobile terminal and its method of control shooting
CN106657783A (en) Image shooting device and method
CN107071275B (en) Image synthesis method and terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant