[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN107071260A - A kind of filming apparatus and method, and terminal device - Google Patents

A kind of filming apparatus and method, and terminal device Download PDF

Info

Publication number
CN107071260A
CN107071260A CN201611087856.2A CN201611087856A CN107071260A CN 107071260 A CN107071260 A CN 107071260A CN 201611087856 A CN201611087856 A CN 201611087856A CN 107071260 A CN107071260 A CN 107071260A
Authority
CN
China
Prior art keywords
shooting
module
frame
time period
parameters
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
CN201611087856.2A
Other languages
Chinese (zh)
Inventor
邱情
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nubia Technology Co Ltd
Original Assignee
Nubia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nubia Technology Co Ltd filed Critical Nubia Technology Co Ltd
Priority to CN201611087856.2A priority Critical patent/CN107071260A/en
Publication of CN107071260A publication Critical patent/CN107071260A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/62Control of parameters via user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70Circuitry for compensating brightness variation in the scene
    • H04N23/73Circuitry for compensating brightness variation in the scene by influencing the exposure time

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Studio Devices (AREA)

Abstract

The embodiment of the invention discloses a kind of filming apparatus and method, and terminal device.The device that the present embodiment is provided includes:First taking module, for being shot in first time period by the first shooting module to the nth frame of shooting picture;Second taking module, for being shot in second time period by the second shooting module to the N+1 frames of shooting picture;Wherein, the first time period and the second time period partly overlap.The embodiment of the present invention solves high frequency image pickup method of the prior art, due to the time for exposure it is shorter and cause shoot image quality it is poor, noise is more, and resolution ratio it is relatively low the problems such as.

Description

Shooting device and method and terminal equipment
Technical Field
The present application relates to, but not limited to, the field of communications technologies, and in particular, to a photographing apparatus and method, and a terminal device.
Background
With the development of communication technology, the application range of the intelligent terminal is widely improved, for example, music can be listened, games can be played, online chatting can be performed, and photos or videos can be taken through the intelligent terminal. When using intelligent terminal to shoot, the number of frames is shot every second and the aperture size of shooting the module in the intelligent terminal is the main factor that influences the picture quality.
The current smart terminal, such as a smart phone or a tablet computer, generally has a problem of poor image quality of shooting due to short exposure time when shooting at high frequency, and since the aperture size of the shooting module is fixed after the shooting module is determined, improving the quality of each shooting frame becomes a main approach for solving the poor image quality. For example, in high-frequency shooting, slow playback is 120 frames per second (f/s), that is, the upper limit of the exposure time of each frame is 1/120 seconds, and such a short exposure time easily causes too low screen brightness, and the prior art usually solves the problem of too low screen brightness by increasing the sensitivity (ISO); however, high ISO causes problems such as excessive noise and poor image quality. In addition, with such a short exposure time, when a dynamic scene is shot or the intelligent terminal shakes, shooting parameters, such as refocusing, photometry, color restoration parameters, etc., need to be adjusted, and the processing of the parameters needs to be completed within a very short time, and more times of processing operations on the shooting parameters are needed within each second, so that new problems such as the intelligent terminal being stuck or shooting parameters being not adjusted yet when a current frame is shot are easily caused, and the intelligent terminal cannot normally shoot; in solving the new problems, the prior art generally reduces the resolution of the video and sacrifices the quality of the video.
In summary, the high-frequency shooting method in the prior art has the problems of poor picture quality, more noise, low resolution and the like due to short exposure time; in addition, in a dynamic shooting scene, the intelligent terminal may not shoot normally due to the frequent adjustment of shooting parameters.
Disclosure of Invention
In order to solve the above technical problems, embodiments of the present invention provide a shooting apparatus and method, and a terminal device, so as to solve the problems of poor picture quality, more noises, and low resolution caused by short exposure time in the high-frequency shooting method in the prior art.
The embodiment of the invention provides a shooting device, which is arranged in terminal equipment and comprises:
the first shooting module is used for shooting the Nth frame of the shot picture through the first shooting module in a first time period;
the second shooting module is used for shooting the (N + 1) th frame of the shot picture through the second shooting module in a second time period; wherein the first time period and the second time period partially overlap.
Optionally, in the above shooting device, the terminal device is configured with X shooting modules, the shooting device includes X shooting modules corresponding to the X shooting modules one to one, and a shooting period of each shooting module for shooting each frame is X × T;
the first shooting module is used for shooting the Nth frame of the shot picture through the first shooting module in a first time period, and comprises:
at a time period t0To t0Within + X T, shooting the nth frame of the shot picture through the first shooting module;
the second shooting module is used for shooting the (N + 1) th frame of the shooting picture through the second shooting module in a second time period, and the shooting method comprises the following steps:
at a time period t0+ T to T0Within plus (1+ X) × T, shooting the (N + 1) th frame of the shot picture through the second shooting module;
an ith photographing module for photographing at a time period t0T to T (i-1)0Within (i-1+ X) T, shooting the (N + i-1) th frame of the shot picture through an ith shooting module; the shooting time periods of any two adjacent frames are partially overlapped, and i is a positive integer less than or equal to X and greater than 2.
Optionally, in the shooting apparatus as described above, the ith shooting module is further configured to capture the image of the object in a time period t0+ m (i-1+ X) T to T0Within + m (i-1+2X) T, shooting the N + (m X + i-1) th frame of the shot picture through the ith shooting module; wherein i is a positive integer less than or equal to X, and m is a positive integer greater than or equal to 1.
Optionally, in the photographing apparatus as described above, the apparatus further includes:
the judging module is used for judging whether the shooting parameters of the current frame need to be adjusted or not before each shooting module shoots the current frame;
the adjusting module is used for adjusting the shooting parameters of the current frame when the judging module judges that the shooting parameters of the current frame need to be adjusted;
and the calling module is used for calling the shooting parameters used by the shooting module of the previous frame to shoot the previous frame when the judging module judges that the shooting parameters of the current frame do not need to be adjusted.
Optionally, in the above shooting apparatus, the determining module is configured to determine whether to adjust the shooting parameter of the current frame, and includes:
judging whether the shooting parameters of the current frame need to be adjusted according to the change information of the shooting data of two continuous frames with the closest shooting time periods, wherein the change information comprises: luminance change information of the frame data; or,
and judging whether the shooting parameters of the current frame need to be adjusted or not according to the detection result of a sensor arranged in the terminal equipment.
The embodiment of the invention also provides a shooting method, which comprises the following steps:
shooting an Nth frame of a shot picture through a first shooting module in a first time period;
shooting the (N + 1) th frame of the shot picture through a second shooting module in a second time period; wherein the first time period and the second time period partially overlap.
Optionally, in the above shooting method, a terminal device for shooting is configured with X shooting modules, and a shooting period of each shooting module shooting each frame is X × T;
the shooting the Nth frame of the shot picture through the first shooting module in the first time period comprises the following steps:
at a time period t0To t0Within + X T, shooting the nth frame of the shot picture through the first shooting module;
the shooting the (N + 1) th frame of the shot picture through the second shooting module in the second time period comprises:
at a time period t0+ T to T0Within plus (1+ X) × T, shooting the (N + 1) th frame of the shot picture through the second shooting module;
the method further comprises the following steps:
at a time period t0T to T (i-1)0Within (i-1+ X) T, shooting the (N + i-1) th frame of the shot picture through an ith shooting module; the shooting time periods of any two adjacent frames are partially overlapped, and i is a positive integer which is less than or equal to X and is greater than 2;
the method further comprises the following steps:
at a time period t0+ m (i-1+ X) T to T0Within + m (i-1+2X) T, shooting the N + (m X + i-1) th frame of the shot picture through the ith shooting module; wherein i is a positive integer less than or equal to X, and m is a positive integer greater than or equal to 1.
Optionally, in the shooting method described above, the method further includes:
before each shooting module shoots a current frame, judging whether shooting parameters of the current frame need to be adjusted or not;
when the shooting parameters of the current frame need to be adjusted are judged, adjusting the shooting parameters of the current frame;
and calling a shooting module of the previous frame to shoot the shooting parameters used by the previous frame when judging that the shooting parameters of the current frame do not need to be adjusted.
Optionally, in the above shooting method, the determining whether the shooting parameter of the current frame needs to be adjusted includes:
judging whether the shooting parameters of the current frame need to be adjusted according to the change information of the shooting data of two continuous frames with the closest shooting time periods, wherein the change information comprises: luminance change information of the frame data; or,
and judging whether the shooting parameters of the current frame need to be adjusted or not according to the detection result of a sensor arranged in the terminal equipment.
An embodiment of the present invention further provides a terminal device, including: at least two shooting modules and the shooting device as any one of the above;
the at least two shooting modules are connected with the shooting modules in the shooting device in a one-to-one correspondence mode.
In the photographing device and method and the terminal device provided by the embodiment of the invention, a first photographing module of the photographing device photographs an nth frame of a photographed image through the first photographing module in a first time period, and a second photographing module photographs an (N + 1) th frame of the photographed image through the second photographing module in a second time period; in addition, a first time period for shooting the nth frame and a second time period for shooting the (N + 1) th frame are partially overlapped, and the shooting device provided by the embodiment has the advantages that at least two shooting modules are configured in the terminal equipment, and the exposure time for shooting each frame in high-frequency shooting is doubled by adopting a shooting mode that a plurality of shooting modules are staggered in time; therefore, the high-frequency shooting method solves the problems that in the high-frequency shooting method in the prior art, due to the fact that exposure time is short, shooting image quality is poor, noise is more, resolution ratio is low and the like, and improves shooting experience of users.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the example serve to explain the principles of the invention and not to limit the invention.
Fig. 1 is a schematic hardware structure of an alternative mobile terminal for implementing various embodiments of the present invention;
FIG. 2 depicts a communication system in which a mobile terminal according to the present invention is capable of operating;
fig. 3 is a schematic structural diagram of a shooting device according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a shooting process of the shooting device according to the embodiment of the present invention;
fig. 5 is a schematic flow chart of shooting performed by using the shooting device provided by the embodiment of the invention;
FIG. 6 is a schematic diagram of a shooting process in the prior art;
fig. 7 is a schematic structural diagram of another photographing apparatus according to an embodiment of the present invention;
fig. 8 is a schematic diagram of another shooting process of the shooting device according to the embodiment of the present invention.
Fig. 9 is a schematic diagram of still another shooting process of the shooting device according to the embodiment of the present invention;
fig. 10 is a schematic structural diagram of another photographing apparatus according to an embodiment of the present invention;
fig. 11 is a flowchart illustrating photographing performed using the photographing apparatus of the embodiment shown in fig. 9;
fig. 12 is a schematic flowchart of a shooting method according to an embodiment of the present invention;
fig. 13 is a schematic flowchart of another shooting method according to an embodiment of the present invention;
fig. 14 is a schematic structural diagram of a terminal device according to an embodiment of the present invention.
Detailed Description
It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
A mobile terminal implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. In the following description, suffixes used to represent elements such as "module", "means", or "unit" are used only for the convenience of description of the present invention, and have no specific meaning in themselves. Thus, "module" and "component" may be used in a mixture.
The mobile terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a smart phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a navigation device, and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. In the following, it is assumed that the terminal is a mobile terminal. However, it will be understood by those skilled in the art that the configuration according to the embodiment of the present invention can be applied to a fixed type terminal in addition to elements particularly used for moving purposes.
Fig. 1 is a schematic hardware structure of an optional mobile terminal for implementing various embodiments of the present invention.
The mobile terminal 100 may include a wireless communication unit 110, an a/V (audio/video) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, an interface unit 170, a controller 180, and a power supply unit 190, etc. Fig. 1 illustrates a mobile terminal having various components, but it is to be understood that not all illustrated components are required to be implemented. More or fewer components may alternatively be implemented. Elements of the mobile terminal will be described in detail below.
The wireless communication unit 110 typically includes one or more components that allow radio communication between the mobile terminal 100 and a wireless communication system or network. For example, the wireless communication unit may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short-range communication module 114, and a location information module 115.
The broadcast receiving module 111 receives a broadcast signal and/or broadcast associated information from an external broadcast management server via a broadcast channel. The broadcast channel may include a satellite channel and/or a terrestrial channel. The broadcast management server may be a server that generates and transmits a broadcast signal and/or broadcast associated information or a server that receives a previously generated broadcast signal and/or broadcast associated information and transmits it to a terminal. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and the like. Also, the broadcast signal may further include a broadcast signal combined with a TV or radio broadcast signal. The broadcast associated information may also be provided via a mobile communication network, and in this case, the broadcast associated information may be received by the mobile communication module 112. The broadcast signal may exist in various forms, for example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB), an Electronic Service Guide (ESG) of digital video broadcasting-handheld (DVB-H), and the like. The broadcast receiving module 111 may receive a signal broadcast by using various types of broadcasting systems. In particular, the broadcast receiving module 111 may receive digital broadcasting by using a digital broadcasting system such as a data broadcasting system of multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), digital video broadcasting-handheld (DVB-H), forward link media (MediaFLO @), terrestrial digital broadcasting integrated service (ISDB-T), and the like. The broadcast receiving module 111 may be constructed to be suitable for various broadcasting systems that provide broadcast signals as well as the above-mentioned digital broadcasting systems. The broadcast signal and/or broadcast associated information received via the broadcast receiving module 111 may be stored in the memory 160 (or other type of storage medium).
The mobile communication module 112 transmits and/or receives radio signals to and/or from at least one of a base station (e.g., access point, node B, etc.), an external terminal, and a server. Such radio signals may include voice call signals, video call signals, or various types of data transmitted and/or received according to text and/or multimedia messages.
The wireless internet module 113 supports wireless internet access of the mobile terminal. The module may be internally or externally coupled to the terminal. The wireless internet access technology to which the module relates may include WLAN (wireless LAN) (Wi-Fi), Wibro (wireless broadband), Wimax (worldwide interoperability for microwave access), HSDPA (high speed downlink packet access), and the like.
The short-range communication module 114 is a module for supporting short-range communication. Some examples of short-range communication technologies include bluetooth (TM), Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), zigbee (TM), and the like.
The location information module 115 is a module for checking or acquiring location information of the mobile terminal. A typical example of the location information module is a GPS (global positioning system). According to the current technology, the GPS module 115 calculates distance information and accurate time information from three or more satellites and applies triangulation to the calculated information, thereby accurately calculating three-dimensional current location information according to longitude, latitude, and altitude. Currently, a method for calculating position and time information uses three satellites and corrects an error of the calculated position and time information by using another satellite. In addition, the GPS module 115 can calculate speed information by continuously calculating current position information in real time.
The a/V input unit 120 is used to receive an audio or video signal. The a/V input unit 120 may include a camera 121 and a microphone 1220, and the camera 121 processes image data of still pictures or video obtained by an image capturing apparatus in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display module 151. The image frames processed by the cameras 121 may be stored in the memory 160 (or other storage medium) or transmitted via the wireless communication unit 110, and two or more cameras 121 may be provided according to the construction of the mobile terminal. The microphone 122 may receive sounds (audio data) via the microphone in a phone call mode, a recording mode, a voice recognition mode, or the like, and can process such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the mobile communication module 112 in case of a phone call mode. The microphone 122 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.
The user input unit 130 may generate key input data according to a command input by a user to control various operations of the mobile terminal. The user input unit 130 allows a user to input various types of information, and may include a keyboard, dome sheet, touch pad (e.g., a touch-sensitive member that detects changes in resistance, pressure, capacitance, and the like due to being touched), scroll wheel, joystick, and the like. In particular, when the touch pad is superimposed on the display module 151 in the form of a layer, a touch screen may be formed.
The sensing unit 140 detects a current state of the mobile terminal 100 (e.g., an open or closed state of the mobile terminal 100), a position of the mobile terminal 100, presence or absence of contact (i.e., touch input) by a user with the mobile terminal 100, an orientation of the mobile terminal 100, acceleration or deceleration movement and direction of the mobile terminal 100, and the like, and generates a command or signal for controlling an operation of the mobile terminal 100. For example, when the mobile terminal 100 is implemented as a slide-type mobile phone, the sensing unit 140 may sense whether the slide-type phone is opened or closed. In addition, the sensing unit 140 can detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled with an external device.
The interface unit 170 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The identification module may store various information for authenticating a user using the mobile terminal 100 and may include a User Identity Module (UIM), a Subscriber Identity Module (SIM), a Universal Subscriber Identity Module (USIM), and the like. In addition, a device having an identification module (hereinafter, referred to as an "identification device") may take the form of a smart card, and thus, the identification device may be connected with the mobile terminal 100 via a port or other connection means. The interface unit 170 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal and the external device.
In addition, when the mobile terminal 100 is connected with an external cradle, the interface unit 170 may serve as a path through which power is supplied from the cradle to the mobile terminal 100 or may serve as a path through which various command signals input from the cradle are transmitted to the mobile terminal. Various command signals or power input from the cradle may be used as signals for recognizing whether the mobile terminal is accurately mounted on the cradle. The output unit 150 is configured to provide output signals (e.g., audio signals, video signals, alarm signals, vibration signals, etc.) in a visual, audio, and/or tactile manner. The output unit 150 may include a display module 151, an audio output module 152, an alarm module 153, and the like.
The display module 151 may display information processed in the mobile terminal 100. For example, when the mobile terminal 100 is in a phone call mode, the display module 151 may display a User Interface (UI) or a Graphical User Interface (GUI) related to a call or other communication (e.g., text messaging, multimedia file downloading, etc.). When the mobile terminal 100 is in a video call mode or an image capturing mode, the display module 151 may display a captured image and/or a received image, a UI or GUI showing a video or an image and related functions, and the like.
Meanwhile, when the display module 151 and the touch pad are stacked on each other in the form of layers to form a touch screen, the display module 151 may serve as an input device and an output device. The display module 151 may include at least one of a Liquid Crystal Display (LCD), a thin film transistor LCD (TFT-LCD), an Organic Light Emitting Diode (OLED) display, a flexible display, a three-dimensional (3D) display, and the like. Some of these displays may be configured to be transparent to allow a user to view from the outside, which may be referred to as transparent displays, and a typical transparent display may be, for example, a TOLED (transparent organic light emitting diode) display or the like. Depending on the particular desired implementation, the mobile terminal 100 may include two or more display units (or other display devices), for example, the mobile terminal may include an external display unit (not shown) and an internal display unit (not shown). The touch screen may be used to detect a touch input pressure as well as a touch input position and a touch input area.
The audio output module 152 may convert audio data received by the wireless communication unit 110 or stored in the memory 160 into an audio signal and output as sound when the mobile terminal is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output module 152 may provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output module 152 may include a speaker, a buzzer, and the like.
The alarm module 153 may provide an output to notify the mobile terminal 100 of the occurrence of an event. Typical events may include call reception, message reception, key signal input, touch input, and the like. In addition to audio or video output, the alarm module 153 may provide output in different ways to notify the occurrence of an event. For example, the alarm module 153 may provide an output in the form of a vibration, and when a call, a message, or some other incoming communication (incomingmunication) is received, the alarm module 153 may provide a tactile output (i.e., a vibration) to inform the user thereof. By providing such a tactile output, the user can recognize the occurrence of various events even when the user's mobile phone is in the user's pocket. The alarm module 153 may also provide an output notifying the occurrence of an event via the display module 151 or the audio output module 152.
The memory 160 may store software programs and the like for processing and controlling operations performed by the controller 180, or may temporarily store data (e.g., a phonebook, messages, still images, videos, and the like) that has been or will be output. Also, the memory 160 may store data regarding various ways of vibration and audio signals output when a touch is applied to the touch screen.
The memory 160 may include at least one type of storage medium including a flash memory, a hard disk, a multimedia card, a card-type memory (e.g., SD or DX memory, etc.), a Random Access Memory (RAM), a Static Random Access Memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, an optical disk, and the like. Also, the mobile terminal 100 may cooperate with a network storage device that performs a storage function of the memory 160 through a network connection.
The controller 180 generally controls the overall operation of the mobile terminal. For example, the controller 180 performs control and processing related to voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for reproducing (or playing back) multimedia data, and the multimedia module 181 may be constructed within the controller 180 or may be constructed separately from the controller 180. The controller 180 may perform a pattern recognition process to recognize a handwriting input or a picture drawing input performed on the touch screen as a character or an image.
The power supply unit 190 receives external power or internal power and provides appropriate power required to operate various elements and components under the control of the controller 180.
The various embodiments described herein may be implemented in a computer-readable medium using, for example, computer software, hardware, or any combination thereof. For a hardware implementation, the embodiments described herein may be implemented using at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processor (DSP), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a processor, a controller, a microcontroller, a microprocessor, an electronic unit designed to perform the functions described herein, and in some cases, such embodiments may be implemented in the controller 180. For a software implementation, the implementation such as a process or a function may be implemented with a separate software module that allows performing at least one function or operation. The software codes may be implemented by software applications (or programs) written in any suitable programming language, which may be stored in the memory 160 and executed by the controller 180.
Up to this point, mobile terminals have been described in terms of their functionality. Hereinafter, a slide-type mobile terminal among various types of mobile terminals, such as a folder-type, bar-type, swing-type, slide-type mobile terminal, and the like, will be described as an example for the sake of brevity. Accordingly, the present invention can be applied to any type of mobile terminal, and is not limited to a slide type mobile terminal.
The mobile terminal 100 as shown in fig. 1 may be configured to operate with communication systems such as wired and wireless communication systems and satellite-based communication systems that transmit data via frames or packets.
A communication system in which a mobile terminal according to the present invention is operable will now be described with reference to fig. 2.
Such communication systems may use different air interfaces and/or physical layers. For example, the air interface used by the communication system includes, for example, Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), Code Division Multiple Access (CDMA), and Universal Mobile Telecommunications System (UMTS) (in particular, Long Term Evolution (LTE)), global system for mobile communications (GSM), and the like. By way of non-limiting example, the following description relates to a CDMA communication system, but such teachings are equally applicable to other types of systems.
Referring to fig. 2, the CDMA wireless communication system may include a plurality of mobile terminals 100, a plurality of Base Stations (BSs) 270, Base Station Controllers (BSCs) 275, and a Mobile Switching Center (MSC) 280. The MSC280 is configured to interface with a Public Switched Telephone Network (PSTN) 290. The MSC280 is also configured to interface with a BSC275, which may be coupled to the base station 270 via a backhaul. The backhaul may be constructed according to any of several known interfaces including, for example, E1/T1, ATM, IP, PPP, frame Relay, HDSL, ADSL, or xDSL. It will be understood that a system as shown in fig. 2 may include multiple BSCs 2750.
Each BS270 may serve one or more sectors (or regions), each sector covered by a multi-directional antenna or an antenna pointing in a particular direction being radially distant from the BS 270. Alternatively, each partition may be covered by two or more antennas for diversity reception. Each BS270 may be configured to support multiple frequency allocations, with each frequency allocation having a particular frequency spectrum (e.g., 1.25MHz,5MHz, etc.).
The intersection of partitions with frequency allocations may be referred to as a CDMA channel. The BS270 may also be referred to as a Base Transceiver Subsystem (BTS) or other equivalent terminology. In such a case, the term "base station" may be used to generically refer to a single BSC275 and at least one BS 270. The base stations may also be referred to as "cells". Alternatively, each sector of a particular BS270 may be referred to as a plurality of cell sites.
As shown in fig. 2, a Broadcast Transmitter (BT)295 transmits a broadcast signal to the mobile terminal 100 operating within the system. A broadcast receiving module 111 as shown in fig. 1 is provided at the mobile terminal 100 to receive a broadcast signal transmitted by the BT 295. In fig. 2, several Global Positioning System (GPS) satellites 300 are shown. The satellite 300 assists in locating at least one of the plurality of mobile terminals 100.
In fig. 2, a plurality of satellites 300 are depicted, but it is understood that useful positioning information may be obtained with any number of satellites. The GPS module 115 as shown in fig. 1 is generally configured to cooperate with satellites 300 to obtain desired positioning information. Other techniques that can track the location of the mobile terminal may be used instead of or in addition to GPS tracking techniques. In addition, at least one GPS satellite 300 may selectively or additionally process satellite DMB transmission.
As a typical operation of the wireless communication system, the BS270 receives reverse link signals from various mobile terminals 100. The mobile terminal 100 is generally engaged in conversations, messaging, and other types of communications. Each reverse link signal received by a particular base station 270 is processed within the particular BS 270. The obtained data is forwarded to the associated BSC 275. The BSC provides call resource allocation and mobility management functions including coordination of soft handoff procedures between BSs 270. The BSCs 275 also route the received data to the MSC280, which provides additional routing services for interfacing with the PSTN 290. Similarly, the PSTN290 interfaces with the MSC280, the MSC interfaces with the BSCs 275, and the BSCs 275 accordingly control the BS270 to transmit forward link signals to the mobile terminal 100.
Based on the above mobile terminal hardware structure and communication system, various embodiments of the apparatus and method of the present invention are proposed. In order to make the objects, technical solutions and advantages of the present invention more apparent, embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments and features of the embodiments in the present application may be arbitrarily combined with each other without conflict.
The steps illustrated in the flow charts of the figures may be performed in a computer system such as a set of computer-executable instructions. Also, while a logical order is shown in the flow diagrams, in some cases, the steps shown or described may be performed in an order different than here.
The technical solution of the present invention is described in detail below with specific embodiments, and the terminal device in the following embodiments of the present invention may be an intelligent terminal, such as a smart phone, a Personal Digital Assistant (PDA), a tablet computer, or the like. The following specific embodiments of the present invention may be combined, and the same or similar concepts or processes may not be described in detail in some embodiments.
Fig. 3 is a schematic structural diagram of a shooting device according to an embodiment of the present invention. The shooting device provided by the embodiment is suitable for the situation that terminal equipment provided with a plurality of shooting modules carries out high-frequency shooting, the shooting device is usually realized by a method of combining hardware and software, and the shooting device can be integrated in a controller of the terminal equipment and used for being called by the controller. As shown in fig. 3, the photographing apparatus provided by the present embodiment may include: a first photographing module 10 and a second photographing module 20.
The first shooting module 10 is configured to shoot an nth frame of a shot picture through the first shooting module in a first time period.
The second shooting module 20 is used for shooting the (N + 1) th frame of the shot picture through the second shooting module in a second time period; wherein the first time period and the second time period partially overlap.
The photographing device provided by the embodiment of the invention provides a mode of photographing through multiple photographing modules, and the photographing modules in the embodiment of the invention can comprise components for photographing, such as a photographing lens, an aperture, a focusing component and the like, namely each photographing module in the embodiment of the invention is an independent photographing device and can independently complete photographing. In addition, the photographing apparatus of an embodiment of the present invention includes: a first shooting module 10 corresponding to the first shooting module, and a second shooting module 20 corresponding to the second shooting module; in practical applications, the shooting module can control the corresponding shooting module to shoot the current frame within a specified time period, for example, the first shooting module 10 controls the first shooting module to start shooting an nth frame at the start time of the first time period, stops shooting the nth frame at the end time of the first time period, and then continues shooting subsequent frames.
In the embodiment of the present invention, the capturing periods of two adjacent frames are partially overlapped, for example, the above-described period for capturing the nth frame (i.e., the first period) and the period for capturing the N +1 th frame (i.e., the second period) are partially overlapped.
The following describes a manner and a process of shooting by the shooting device provided by the embodiment of the invention through an application example.
For example, it is shown that the terminal device includes a first shooting module and a second shooting module as an example, as shown in fig. 4, which is a schematic diagram of a shooting process of the shooting device provided in the embodiment of the present invention. Setting the shooting period (i.e. exposure time) of each shooting module to 2 × T, and setting the shooting period to be 2 × T in the first time period, i.e. the time period T in fig. 40To t0Within +2 × T, the first capture module captures the nth frame in the second time period, i.e., time period T in fig. 40+ T to T0Within +3 × T, the second capture module captures the (N + 1) th frame, and it can be seen that, in the first time period and the second time period, T is0+ T to T0The + 2T times are overlapping. Further, the first photographing module may continue for a time period t0+2 × T to T0Within +4 × T, the (N + 2) th frame is photographed, and the second photographing module may continue to photograph for a time period T0+3 × T to T0Within +5 × T, the N +3 th frame is photographed, and it can be seen that there is an overlapping portion between the photographing periods of two adjacent frames.
In practical applications, as shown in fig. 5, a schematic flow chart of performing shooting by using the shooting device provided by the embodiment of the invention is shown. The photographing method may include the steps of S110 to S150:
s110, in the time period t0To t0And within +2 × T, the first shooting module shoots the Nth frame of the shot picture.
In this embodiment, the time 2 × T is set as a shooting period of each frame, that is, the exposure time of each frame, and corresponding shooting parameters such as ISO can be adjusted and used in a matching manner. In practical applications, the time T may be the inverse of the frequency f of the high-frequency shooting, i.e., T ═ 1/f; the corresponding ISO is calculated from the exposure time 2 × T while ensuring details such as luminance information of the image quality of the nth frame, or may be found by referring to a previously built-in correspondence table.
S120, judging whether the time is from t0To t0+ T moment; if the time is judged to have reached t0At time + T, step S130 is executed; if the time is judged not to reach t0At time + T, the second shooting module is in a waiting state or shooting the (N-1) th frame.
In addition, when the time is less than t0At time + T, the second camera module may have two operating states. One application scenario is that the Nth frame is the initial frame of shooting, at this time, the second shooting module does not shoot yet and the time is t0Before the moment + T, the second shooting module is in a waiting state; another application scenario is that the Nth frame is not the initial frame of shooting, i.e. t of the second shooting module shooting at the first shooting module0To t0During the + T period, the (N-1) th frame is being captured.
S130, in the time period t0+ T to T0Within +3 × T, the (N + 1) th frame of the shot picture is shot through the second shooting module; note that the time period t is0+ T to T0Within +2 × T, the first shooting module continues to shoot the nth frame independently, that is, the two shooting modules shoot in a time-staggered manner.
S140, judging whether the shooting is finished or not; if the shooting is not finished, the steps of time-staggered shooting of the two shooting modules are repeated, namely S110 to S130 are repeatedly executed, and t is repeatedly executed0Is changed, at this time t0'=t0+2 × T; if the shooting is finished, S150 is executed.
And S150, synthesizing the video.
Since the terminal device is configured with two shooting modules in the application examples shown in fig. 4 and 5, half of the time periods of the first shooting module and the second shooting module shooting the adjacent frames are overlapped. In the above background art, the shooting method in the prior art has been introduced, in high frequency shooting, slow playback is 120f/s, that is, the upper limit of the exposure time of each frame is 1/120s, as shown in fig. 6, which is a schematic diagram of a shooting process in the prior art, the shooting time of the shooting component of the terminal device for each frame is 1/120s, after the current frame is shot, the next frame is continuously shot, and in 1s, shooting of 120 frames is completed by one shooting component. Obviously, in the prior art, when the playback speed is fixed, since only one shooting module is used to continuously shoot, the shooting time (i.e. the exposure time) for each frame cannot be increased, which causes the problems of poor image quality, more noises, and low resolution due to the short exposure time.
Compared with the prior art, referring to the schematic diagram of the principle of the shooting process shown in fig. 4, in the process of high-frequency shooting by two shooting modules in the embodiment of the present invention, the shooting mode that the two shooting modules are staggered in passing time is adopted, so that the shooting time can be greatly delayed, i.e., the exposure time is delayed, and as can be seen from comparing fig. 4 and fig. 6, by adopting the shooting device in the embodiment of the present invention, the exposure time can be delayed by one time, i.e., the exposure time of each frame in the prior art is increased from 1/120s to 1/60s, so that the improvement on the exposure time is very outstanding. Therefore, the embodiment of the invention can effectively solve the problems of poor image quality, more noise, lower resolution and the like of shooting caused by shorter exposure time in the shooting method in the prior art.
It should be noted that the embodiment of the present invention does not limit the implementation manner in which only two shooting modules are configured for the terminal device, and the terminal device in the embodiment of the present invention may also be configured with more than two shooting modules, for example, three, four, or more shooting modules are configured, and the shooting time of each shooting module and the overlapping portion of the shooting time periods when adjacent frames are shot may be configured by a designer or may be configured by a user as needed. In addition, the application example shown in FIG. 4 can be used to realize the functions of the present inventionIt can be seen that, when the device provided by the embodiment of the present invention is used for high-frequency shooting, the exposure time of each frame can be doubled, for example, two shooting assemblies are used in the shooting process shown in fig. 4, and the exposure time is doubled, if three shooting modules are configured in the terminal device, the shooting process similar to fig. 4 is used, for example, the time period for the first shooting module to shoot the nth frame is t0To t0+3 × T, it can be seen that the exposure time per frame can be increased by a factor of 2, i.e. 3 times T in the prior art.
In the photographing device provided by the embodiment, the first photographing module photographs the nth frame of the photographed picture through the first photographing module in the first time period, and the second photographing module photographs the (N + 1) th frame of the photographed picture through the second photographing module in the second time period; in addition, a first time period for shooting the nth frame and a second time period for shooting the (N + 1) th frame are partially overlapped, and the shooting device provided by the embodiment has the advantages that at least two shooting modules are configured in the terminal equipment, and the exposure time for shooting each frame in high-frequency shooting is doubled by adopting a shooting mode that a plurality of shooting modules are staggered in time; therefore, the present embodiment solves the problems of poor image quality, more noise, low resolution, and the like caused by short exposure time in the high-frequency shooting method in the prior art.
Optionally, fig. 7 is a schematic structural diagram of another shooting device provided in the embodiment of the present invention. On the basis of the structure of the shooting device shown in fig. 3, the terminal device in this embodiment may be configured with X shooting modules, and accordingly, the shooting device may include X shooting modules corresponding to the X shooting modules one by one, and a shooting period of each shooting module shooting each frame is set to be X × T, that is, an exposure time of each frame is set to be X × T.
In this embodiment, the first shooting module 10 is configured to shoot an nth frame of a shooting picture through the first shooting module in a first time period, and includes:
at a time period t0To t0Within + X T, the Nth shooting picture is shot by the first shooting module groupShooting frames;
the second shooting module 20 is configured to shoot an N +1 th frame of the shot picture through the second shooting module in a second time period, and includes:
at a time period t0+ T to T0Within plus (1+ X) T, shooting the (N + 1) th frame of the shot picture through a second shooting module;
an ith photographing module 30 for photographing at a time period t0T to T (i-1)0Within (i-1+ X) T, shooting the (N + i-1) th frame of the shot picture through the ith shooting module; wherein the shooting time periods of any two adjacent frames are partially overlapped, and i is a positive integer less than or equal to X and greater than 2. The photographing time periods and the photographing frames corresponding to the first photographing module 10 and the second photographing module 20, respectively, have been described above, and the ith photographing module 30 herein actually refers to the third photographing module through the xth photographing module.
In the present embodiment, a general rule of the shooting periods is described by setting the number of the shooting modules to X, and the overlapping portion of the time periods for shooting any two adjacent frames described in the embodiment shown in fig. 7 can be obtained according to the shooting period and the data of the shooting modules by adopting a time period equal division principle, that is, the overlapping portion of the shooting periods of any two adjacent frames is (X-1) × T.
Optionally, after each shooting module in this embodiment performs a complete cycle of shooting, the shooting can be continued in the same manner by the first shooting module 10 to the xth shooting module, and therefore, in the apparatus provided in this embodiment, the ith shooting module 30 is also used for shooting in the time period t0+ m (i-1+ X) T to T0Within + m (i-1+2X) T, shooting the N + (m X + i-1) th frame of the shot picture through the i-th shooting module; where i is a positive integer less than or equal to X, and m is a positive integer greater than or equal to 1, where the i-th photographing module 30 actually refers to each photographing module in the photographing apparatus.
In the present embodiment, t is set0For the start of the shot, from t0To t0And the time is plus (2X-1) T, and all the shooting modules complete one complete cycle of shooting. Since the shooting is not necessarily finished at this time, each shooting module may further continue to shoot the next frame to be shot after completing the shooting of the current frame, as shown in fig. 8, which is a schematic view of another principle of the shooting process of the shooting device provided in the embodiment of the present invention. In the embodiment shown in fig. 8, X is 3, and the shooting period (i.e. the exposure time) of each shooting module is 3 × T, the shooting process is as follows:
step 1, a first shooting module is in a time period t0To t0Within +3 × T, shooting the nth frame of the shot picture;
step 2, the second shooting module is in time period t0+ T to T0Within +4 × T, shooting the (N + 1) th frame of the shot picture;
step 3, the third shooting module group is in the time period t0+2 × T to T0Within +5 × T, shooting the (N + 2) th frame of the shot picture;
step 4, the first shooting module is in time period t0+3 × T to T0Within +6 × T, shooting the (N + 3) th frame of the shot picture;
step 5, the second shooting module is in time period t0+4 × T to T0Within +7 × T, shooting the (N + 4) th frame of the shot picture;
step 6, the third shooting module group is in the time period t0+5 × T to T0Within +8 × T, the N +5 th frame of the captured image is captured.
Before the shooting is not finished, each frame of the shot picture is continuously shot in the above manner.
It should be noted that the above embodiment is only an exemplary embodiment for performing multi-shooting module shooting by using the shooting device provided by the present invention, and the above embodiment is illustrated by taking an example that each shooting module is continuously shooting, and the overlapping portions of the shooting time periods of any two adjacent frames are the same; in practical application, the embodiment of the present invention does not limit the actual form of shooting performed by the shooting module, nor does it limit the overlapping portions of the shooting time periods of any two adjacent frames to be the same or different, and the overlapping portions may be configured by designers, or users may select the shooting form according to the shooting requirements.
In practical application, X in the above embodiment of the present invention may be a preset value, that is, a maximum value of the shooting modules that can be configured in the terminal device, and if the shooting manner in the above embodiment is adopted, that is, each shooting module is a continuous shooting manner, in this application scenario, X is usually set to be less than or equal to 5.
In another application scenario, the embodiment of the present invention does not limit that all the shooting modules need to continuously shoot, for example, X is 10, and the shooting period of each shooting module is set to 5 × T, then the following shooting modes may be configured:
in an optional implementation manner of this embodiment, as shown in fig. 9, which is a schematic diagram of a further shooting process of the shooting device according to the embodiment of the present invention, each shooting module sequentially shoots consecutive frames, an overlapping time of shooting times of any two adjacent frames is 4 × T, and the 1 st shooting module shoots a time period T0To t0Within +5 × T, the nth frame is photographed, i.e. T is reached at time0+5 × T, the shooting of the nth frame is completed, and then the nth frame is in an idle state for a period of time, and the 10 th shooting module is in a period of time T0+9 × T to T0Within +14 × T, the (N + 9) th frame is photographed; subsequently, the 1 st photographing module continues at t0+10 × T to T0Within +15 × T, the (N + 10) th frame is photographed, and it can be seen that the 1 st photographing module is in the time period T0+5 × T to T0The +10 × T is in an idle state, and each shooting module enters the idle state for 5 × T after it finishes shooting the current frame.
In another optional implementation manner of this embodiment, the overlapping time of the shooting time of any two adjacent frames may be set to 2 × T and 3 × T, or the 1 st to 5 th shooting modules may be adopted to shoot the continuous frames in sequence, and after shooting for a period of time, the 6 th to 10 th shooting modules are adopted to shoot the continuous frames in sequence, so that the service time of each shooting module may be reduced, and the loss of the shooting modules is reduced.
Optionally, fig. 10 is a schematic structural diagram of another shooting apparatus according to an embodiment of the present invention, and based on the foregoing embodiment, the apparatus according to the embodiment may further include:
the judging module 40 is used for judging whether the shooting parameters of the current frame need to be adjusted before each shooting module shoots the current frame;
the adjusting module 50 is used for adjusting the shooting parameters of the current frame when the judging module 40 judges that the shooting parameters of the current frame need to be adjusted;
the calling module 60 is configured to call the shooting parameter used by the shooting module of the previous frame to shoot the previous frame when the determining module 40 determines that the shooting parameter of the current frame does not need to be adjusted.
The embodiment of fig. 10 is shown on the basis of the structure of the device shown in fig. 7 as an example. Fig. 11 is a schematic flow chart of performing shooting using the shooting apparatus of the embodiment shown in fig. 9, and based on the flow chart shown in fig. 5, S130 may include:
s131, time reaches t0When the current frame is + T, judging whether the shooting parameters of the current frame (namely the (N + 1) th frame) need to be adjusted or not; if the adjustment is needed, executing S132; if it is determined that no adjustment is required, performing S133;
s132, adjusting shooting parameters by the second shooting module;
and S133, the second shooting module calls the first shooting module to shoot the shooting parameters used by the Nth frame. S134 is executed after S132 or S133;
s134, in the time period t0+ T to T0Within +3 × T, the (N + 1) th frame of the shot picture is shot through the second shooting module; it should be noted that, in the following description,time period t0+ T to T0Within +2 × T, the first shooting module continues to shoot the nth frame independently, that is, the two shooting modules shoot in a time-staggered manner.
The shooting parameters in the present embodiment may include, for example, one or more of the following: auto Exposure (AE), Auto Focus (AF), Auto White Balance (AWB), ISO, and the like.
In practical applications, the determining module 40 of this embodiment is configured to determine whether an implementation manner of adjusting the shooting parameter of the current frame is needed, and may include the following manners:
the first method is as follows: judging whether the shooting parameters of the current frame need to be adjusted according to the change information of the shooting data of two continuous frames with the closest shooting completion time periods, wherein the change information comprises the following steps: luminance change information of the frame data; in the shooting process shown in fig. 4, since the nth frame is not completely shot when the (N + 1) th frame is shot, the shot data of the (N-2) th frame and the (N-1) th frame may be selected for judgment, and the change information, for example, includes that the brightness change information of the frame data exceeds a threshold, which may be a brightness information difference corresponding to an obvious brightness change, or may be a brightness information difference corresponding to a slight brightness change.
The second method comprises the following steps: judging whether the shooting parameters of the current frame need to be adjusted or not according to the detection result of a sensor arranged in the terminal equipment; the sensor includes, for example, an acceleration sensor, a gyroscope, a laser range finder, or the like, and it can be determined whether the terminal device transmits jitter or whether a shooting picture transmits a change, for example, an object transmission displacement in a shooting field of view, according to a data change of the sensor.
In this embodiment, when it is determined that the shooting parameters need to be readjusted, the shooting module adjusts the shooting parameters according to a conventional shooting mode, and when it is determined that the shooting parameters do not need to be readjusted, the shooting parameters used by the shooting module of the previous frame can be called.
It should be noted that the first shooting module, the second shooting module, and the xth shooting module in the embodiment of the present invention may be independent modules, and each shooting module controls a corresponding shooting module in a one-to-one correspondence manner; the plurality of shooting modules can also be realized by one integral module, and different shooting modules are respectively controlled to shoot in a specified time period.
Fig. 12 is a flowchart illustrating a shooting method according to an embodiment of the present invention. The shooting method provided by the embodiment is suitable for the situation that terminal equipment provided with a plurality of shooting modules carries out high-frequency shooting, the shooting method can be executed by the shooting device provided by the embodiment of the invention, the shooting device is usually realized by a method of combining hardware and software, and the device can be integrated in a controller of the terminal equipment and is called by the controller. As shown in fig. 12, the photographing method provided by the present embodiment may include the steps of S210 to S220:
and S210, shooting the Nth frame of the shot picture through the first shooting module in a first time period.
S220, shooting the (N + 1) th frame of the shot picture through a second shooting module in a second time period; wherein the first time period and the second time period partially overlap.
The shooting method provided by the embodiment of the invention provides a mode of shooting through multiple shooting modules, and the shooting modules in the embodiment of the invention can comprise components for shooting, such as a shooting lens, an aperture, a focusing component and the like, namely, each shooting module in the embodiment of the invention is an independent shooting device and can independently complete shooting. Namely, the terminal device for executing the shooting method provided by the embodiment of the invention at least comprises: the device comprises a first shooting module and a second shooting module; in practical applications, the terminal device may control the shooting module to shoot the current frame within a specified time period, for example, the terminal device controls the first shooting module to start shooting the nth frame at a start time of the first time period, stops shooting the nth frame at an end time of the first time period, and then continues shooting the subsequent frames.
In the embodiment of the present invention, the capturing periods of two adjacent frames are partially overlapped, for example, the above-described period for capturing the nth frame (i.e., the first period) and the period for capturing the N +1 th frame (i.e., the second period) are partially overlapped.
The implementation and the process of the shooting method provided by the embodiment of the invention are described below by an application example.
For example, taking the terminal device including the first shooting module and the second shooting module as an example, it is also possible to refer to the schematic diagram of the shooting process shown in fig. 4, and set the shooting cycle (i.e., the exposure time) of each shooting module to 2 × T, within the first time period, i.e., the time period T in fig. 40To t0Within +2 × T, the first capture module captures the nth frame in the second time period, i.e., time period T in fig. 40+ T to T0Within +3 × T, the second capture module captures the (N + 1) th frame, and it can be seen that, in the first time period and the second time period, T is0+ T to T0The + 2T times are overlapping. Further, the first photographing module may continue for a time period t0+2 × T to T0Within +4 × T, the (N + 2) th frame is photographed, and the second photographing module may continue to photograph for a time period T0+3 × T to T0Within +5 × T, the N +3 th frame is photographed, and it can be seen that there is an overlapping portion between the photographing periods of two adjacent frames.
Based on the recording process shown in fig. 4, reference can likewise be made to the flow diagram of the recording method shown in fig. 5. The steps in fig. 5 have been described in detail in the above embodiments, and thus are not described herein again.
Since the terminal device is configured with two shooting modules in the application examples shown in fig. 4 and 5, half of the time periods of the first shooting module and the second shooting module shooting the adjacent frames are overlapped. In the above background art, the shooting method in the prior art has been introduced, in high frequency shooting, slow playback is 120f/s, that is, the upper limit of the exposure time of each frame is 1/120s, and also referring to the schematic diagram of the shooting process shown in fig. 6, the shooting time of the shooting component of the terminal device for each frame is 1/120s, after the current frame is shot, the next frame is continuously shot, and in 1s, shooting of 120 frames is completed by one shooting component. Obviously, in the prior art, when the playback speed is fixed, since only one shooting module is used to continuously shoot, the shooting time (i.e. the exposure time) for each frame cannot be increased, which causes the problems of poor image quality, more noises, and low resolution due to the short exposure time.
Compared with the prior art, referring to the schematic diagram of the principle of the shooting process shown in fig. 4, in the process of high-frequency shooting by two shooting modules in the embodiment of the present invention, the shooting mode that the two shooting modules are staggered in passing time is adopted, so that the shooting time can be greatly delayed, i.e., the exposure time is delayed, and as can be seen from comparing fig. 4 and fig. 6, by adopting the shooting device in the embodiment of the present invention, the exposure time can be delayed by one time, i.e., the exposure time of each frame in the prior art is increased from 1/120s to 1/60s, so that the improvement on the exposure time is very outstanding. Therefore, the embodiment of the invention can effectively solve the problems of poor image quality, more noise, lower resolution and the like of shooting caused by shorter exposure time in the shooting method in the prior art.
It should be noted that the embodiment of the present invention does not limit the implementation manner in which only two shooting modules are configured for the terminal device, and the terminal device in the embodiment of the present invention may also be configured with more than two shooting modules, for example, three, four or more shooting modules are configured, and the shooting time of each shooting module and the overlapping portion of the shooting time periods when shooting adjacent frames may be configured by a designer, or may be configured by a user as neededAnd (5) carrying out configuration. In addition, as can be seen from the application example shown in fig. 4, when the device provided by the embodiment of the present invention is used for high-frequency shooting, the exposure time of each frame may be increased in multiples, for example, two shooting modules are used in the shooting process shown in fig. 4, the exposure time is increased in one time, if three shooting modules are configured in the terminal device, the shooting process similar to fig. 4 is used, for example, the time period for the first shooting module to shoot the nth frame is t0To t0+3 × T, it can be seen that the exposure time per frame can be increased by a factor of 2, i.e. 3 times T in the prior art.
In the shooting method provided by the embodiment, the nth frame of the shot picture is shot by the first shooting module in the first time period, and the (N + 1) th frame of the shot picture is shot by the second shooting module in the second time period; in addition, a first time period for shooting the nth frame and a second time period for shooting the (N + 1) th frame are partially overlapped, and the shooting method provided by the embodiment has the advantages that at least two shooting modules are configured in the terminal equipment, and the exposure time for shooting each frame in high-frequency shooting is doubled by adopting a shooting mode that a plurality of shooting modules are staggered in time; therefore, the present embodiment solves the problems of poor image quality, more noise, low resolution, and the like caused by short exposure time in the high-frequency shooting method in the prior art.
Optionally, fig. 13 is a schematic flowchart of another shooting method according to an embodiment of the present invention. On the basis of the shooting method shown in fig. 12, the terminal device in this embodiment may be configured with X shooting modules, and a shooting period of each shooting module shooting each frame is set to be X × T, that is, an exposure time of each frame is set to be X × T.
In this embodiment, S210 may include:
at a time period t0To t0Within + X T, shooting the Nth frame of the shot picture through the first shooting module;
in this embodiment, S220 may include:
at a time period t0+ T to T0Within plus (1+ X) T, shooting the (N + 1) th frame of the shot picture through a second shooting module;
the shooting method provided by the embodiment may further include:
s230, in the time period t0T to T (i-1)0Within (i-1+ X) T, shooting the (N + i-1) th frame of the shot picture through the ith shooting module; wherein the shooting time periods of any two adjacent frames are partially overlapped, and i is a positive integer less than or equal to X and greater than 2. The above has described the shooting time periods and the shooting frames corresponding to the first shooting module and the second shooting module, respectively, and the ith shooting module herein actually refers to the third shooting module through the xth shooting module.
In the present embodiment, a general rule of the shooting periods is described by setting the number of the shooting modules to X, and the overlapping portion of the time periods for shooting any two adjacent frames described in the embodiment shown in fig. 13 can be obtained according to the shooting period and the data of the shooting modules by adopting a time period equal division principle, that is, the overlapping portion of the shooting periods of any two adjacent frames is (X-1) × T.
Optionally, after each shooting module in this embodiment performs a complete cycle of shooting, the shooting may be performed continuously in the same manner from the first shooting module to the xth shooting module, and therefore, the shooting method provided in this embodiment may further include:
s240, in the time period t0+ m (i-1+ X) T to T0Within + m (i-1+2X) T, shooting the N + (m X + i-1) th frame of the shot picture through the i-th shooting module; where i is a positive integer less than or equal to X, and m is a positive integer greater than or equal to 1, where the i-th photographing module 30 actually refers to each photographing module in the photographing apparatus.
In the present embodiment, t is set0For the start of the shot, from t0To t0And the time is plus (2X-1) T, and all the shooting modules complete one complete cycle of shooting. Since at this time it is notAfter finishing shooting, each shooting module may further continue to shoot the next frame to be shot after finishing shooting the current frame, and as shown in fig. 8, the schematic diagram of another shooting process of the shooting device according to the embodiment of the present invention is shown. In the embodiment shown in fig. 8, X is 3 as an example, the photographing period (i.e., the exposure time) of each photographing module is 3 × T, and the steps of the photographing process shown in fig. 8 are described in detail in the above embodiment, and therefore will not be described again.
It should be noted that the above embodiment is only an exemplary embodiment of performing multi-shooting module shooting through the terminal device in the embodiment of the present invention, and the above embodiment is shown by taking an example that each shooting module is continuously shooting, and overlapping portions of shooting time periods of any two adjacent frames are the same; in practical application, the embodiment of the present invention does not limit the actual form of shooting performed by the shooting module, nor does it limit the overlapping portions of the shooting time periods of any two adjacent frames to be the same or different, and the overlapping portions may be configured by designers, or users may select the shooting form according to the shooting requirements.
In practical application, X in the above embodiment of the present invention may be a preset value, that is, a maximum value of the shooting modules that can be configured in the terminal device, and if the shooting method in the above embodiment is adopted, that is, each shooting module is in a continuous shooting manner, in the application scenario, X is usually set to be less than or equal to 5.
In another application scenario, the embodiment of the present invention does not limit that all the shooting modules need to continuously shoot, for example, X is 10, and the shooting period of each shooting module is set to 5 × T, then the following shooting modes may be configured:
in an optional implementation manner of this embodiment, referring to the shooting process shown in fig. 9, each shooting module sequentially shoots consecutive frames, the overlapping time of the shooting time of any two adjacent frames is 4 × T, and the 1 st shooting module shoots a frame in a time period T0To t0Within +5 × T, the nth frame is photographed, i.e. T is reached at time0+5 × T, the shooting of the nth frame is completed, and then the nth frame is in an idle state for a period of time, and the 10 th shooting module is in a period of time T0+9 × T to T0Within +14 × T, the (N + 9) th frame is photographed; subsequently, the 1 st photographing module continues at t0+10 × T to T0Within +15 × T, the (N + 10) th frame is photographed, and it can be seen that the 1 st photographing module is in the time period T0+5 × T to T0The +10 × T is in an idle state, and each shooting module enters the idle state for 5 × T after it finishes shooting the current frame.
In another optional implementation manner of this embodiment, the overlapping time of the shooting time of any two adjacent frames may be set to 2 × T and 3 × T, or the 1 st to 5 th shooting modules may be adopted to shoot the continuous frames in sequence, and after shooting for a period of time, the 6 th to 10 th shooting modules are adopted to shoot the continuous frames in sequence, so that the service time of each shooting module may be reduced, and the loss of the shooting modules is reduced.
Optionally, on the basis of the foregoing embodiment of the present invention, the shooting method provided in this embodiment may further include the following steps:
step 1, before each shooting module carries out shooting, judging whether shooting parameters of a current frame need to be adjusted or not;
step 2, when the shooting parameters of the current frame need to be adjusted are judged, the shooting parameters of the current frame are adjusted;
and 3, calling the shooting parameters used by the shooting module of the previous frame to shoot the previous frame when judging that the shooting parameters of the current frame do not need to be adjusted.
The shooting method provided in this embodiment can also refer to the flowchart shown in fig. 11, and the steps of the flowchart have been described in detail in the above embodiments, so that no further description is given here.
The shooting parameters in the present embodiment may include, for example, one or more of the following: auto Exposure (AE), Auto Focus (AF), Auto White Balance (AWB), ISO, and the like.
In practical application, the implementation manner of determining whether to adjust the shooting parameter of the current frame in this embodiment may include the following manner:
the first method is as follows: judging whether the shooting parameters of the current frame need to be adjusted according to the change information of the shooting data of two continuous frames with the closest shooting completion time periods, wherein the change information comprises the following steps: luminance change information of the frame data; in the shooting process shown in fig. 4, since the nth frame is not completely shot when the (N + 1) th frame is shot, the shot data of the (N-2) th frame and the (N-1) th frame may be selected for judgment, and the change information, for example, includes that the brightness change information of the frame data exceeds a threshold, which may be a brightness information difference corresponding to an obvious brightness change, or may be a brightness information difference corresponding to a slight brightness change.
The second method comprises the following steps: judging whether the shooting parameters of the current frame need to be adjusted or not according to the detection result of a sensor arranged in the terminal equipment; the sensor includes, for example, an acceleration sensor, a gyroscope, a laser range finder, or the like, and it can be determined whether the terminal device transmits jitter or whether a shooting picture transmits a change, for example, an object transmission displacement in a shooting field of view, according to a data change of the sensor.
In this embodiment, when it is determined that the shooting parameters need to be readjusted, the shooting module adjusts the shooting parameters according to a conventional shooting mode, and when it is determined that the shooting parameters do not need to be readjusted, the shooting parameters used by the shooting module of the previous frame can be called.
Fig. 14 is a schematic structural diagram of a terminal device according to an embodiment of the present invention. In the case that the terminal device provided by this embodiment is suitable for high-frequency shooting, the terminal device may include: at least two shooting modules 100, and the shooting device 200 in any of the embodiments shown in fig. 3, 7, and 10, and at least two shooting modules 100 in the terminal equipment are connected to the shooting module 210 in the shooting device 200 in a one-to-one correspondence manner, the terminal equipment shown in fig. 14 includes 3 shooting modules 100 as an example. The shooting module in the terminal device of this embodiment is configured to perform shooting through time-staggered shooting in a high-frequency shooting manner, which is the same as the shooting manner performed by the shooting device in any embodiment shown in fig. 3, 7, and 10, and is also configured to perform the shooting method provided in any embodiment shown in fig. 5, 11, 12, and 13, and has corresponding entity devices, which are similar in implementation principle and technical effect and are not described herein again.
It should be noted that the plurality of shooting modules 210 in the shooting device 200 according to the embodiment of the present invention may be independent modules, and each shooting module 210 controls the corresponding shooting module 100 in a one-to-one correspondence manner; the plurality of photographing modules 210 may be implemented by a single module, and each of the photographing modules 100 may be controlled to photograph in a predetermined time period.
Although the embodiments of the present invention have been described above, the above description is only for the convenience of understanding the present invention, and is not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A photographing apparatus provided in a terminal device, the apparatus comprising:
the first shooting module is used for shooting the Nth frame of the shot picture through the first shooting module in a first time period;
the second shooting module is used for shooting the (N + 1) th frame of the shot picture through the second shooting module in a second time period; wherein the first time period and the second time period partially overlap.
2. The shooting device according to claim 1, wherein X shooting modules are configured in the terminal device, the shooting device includes X shooting modules in one-to-one correspondence with the X shooting modules, and a shooting period of each shooting module for shooting each frame is X × T;
the first shooting module is used for shooting the Nth frame of the shot picture through the first shooting module in a first time period, and comprises:
at a time period t0To t0Within + X T, shooting the nth frame of the shot picture through the first shooting module;
the second shooting module is used for shooting the (N + 1) th frame of the shooting picture through the second shooting module in a second time period, and the shooting method comprises the following steps:
at a time period t0+ T to T0Within plus (1+ X) × T, shooting the (N + 1) th frame of the shot picture through the second shooting module;
an ith photographing module for photographing at a time period t0T to T (i-1)0Within (i-1+ X) T, shooting the (N + i-1) th frame of the shot picture through an ith shooting module; the shooting time periods of any two adjacent frames are partially overlapped, and i is a positive integer less than or equal to X and greater than 2.
3. The camera according to claim 2,
the ith shooting module is also used for shooting at a time period t0+ m (i-1+ X) T to T0Within + m (i-1+2X) T, shooting the N + (m X + i-1) th frame of the shot picture through the ith shooting module; wherein i is a positive integer less than or equal to X, and m is a positive integer greater than or equal to 1.
4. The imaging device according to any one of claims 1 to 3, characterized in that the device further comprises:
the judging module is used for judging whether the shooting parameters of the current frame need to be adjusted or not before each shooting module shoots the current frame;
the adjusting module is used for adjusting the shooting parameters of the current frame when the judging module judges that the shooting parameters of the current frame need to be adjusted;
and the calling module is used for calling the shooting parameters used by the shooting module of the previous frame to shoot the previous frame when the judging module judges that the shooting parameters of the current frame do not need to be adjusted.
5. The camera according to claim 4, wherein the determining module is configured to determine whether the shooting parameters of the current frame need to be adjusted, and includes:
judging whether the shooting parameters of the current frame need to be adjusted according to the change information of the shooting data of two continuous frames with the closest shooting time periods, wherein the change information comprises: luminance change information of the frame data; or,
and judging whether the shooting parameters of the current frame need to be adjusted or not according to the detection result of a sensor arranged in the terminal equipment.
6. A photographing method, characterized by comprising:
shooting an Nth frame of a shot picture through a first shooting module in a first time period;
shooting the (N + 1) th frame of the shot picture through a second shooting module in a second time period; wherein the first time period and the second time period partially overlap.
7. The shooting method according to claim 6, wherein X shooting modules are configured in the terminal device for shooting, and a shooting period of each shooting module for shooting each frame is X X T;
the shooting the Nth frame of the shot picture through the first shooting module in the first time period comprises the following steps:
at a time period t0To t0Within + X T, through saidA shooting module shoots the Nth frame of the shooting picture;
the shooting the (N + 1) th frame of the shot picture through the second shooting module in the second time period comprises:
at a time period t0+ T to T0Within plus (1+ X) × T, shooting the (N + 1) th frame of the shot picture through the second shooting module;
the method further comprises the following steps:
at a time period t0T to T (i-1)0Within (i-1+ X) T, shooting the (N + i-1) th frame of the shot picture through an ith shooting module; the shooting time periods of any two adjacent frames are partially overlapped, and i is a positive integer which is less than or equal to X and is greater than 2;
the method further comprises the following steps:
at a time period t0+ m (i-1+ X) T to T0Within + m (i-1+2X) T, shooting the N + (m X + i-1) th frame of the shot picture through the ith shooting module; wherein i is a positive integer less than or equal to X, and m is a positive integer greater than or equal to 1.
8. The photographing method according to claim 6 or 7, wherein the method further comprises:
before each shooting module shoots a current frame, judging whether shooting parameters of the current frame need to be adjusted or not;
when the shooting parameters of the current frame need to be adjusted are judged, adjusting the shooting parameters of the current frame;
and calling a shooting module of the previous frame to shoot the shooting parameters used by the previous frame when judging that the shooting parameters of the current frame do not need to be adjusted.
9. The shooting method according to claim 8, wherein the determining whether the shooting parameters of the current frame need to be adjusted comprises:
judging whether the shooting parameters of the current frame need to be adjusted according to the change information of the shooting data of two continuous frames with the closest shooting time periods, wherein the change information comprises: luminance change information of the frame data; or,
and judging whether the shooting parameters of the current frame need to be adjusted or not according to the detection result of a sensor arranged in the terminal equipment.
10. A terminal device, comprising: at least two shooting modules and the shooting device of any one of claims 1 to 5;
the at least two shooting modules are connected with the shooting modules in the shooting device in a one-to-one correspondence mode.
CN201611087856.2A 2016-11-29 2016-11-29 A kind of filming apparatus and method, and terminal device Withdrawn CN107071260A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611087856.2A CN107071260A (en) 2016-11-29 2016-11-29 A kind of filming apparatus and method, and terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611087856.2A CN107071260A (en) 2016-11-29 2016-11-29 A kind of filming apparatus and method, and terminal device

Publications (1)

Publication Number Publication Date
CN107071260A true CN107071260A (en) 2017-08-18

Family

ID=59619617

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611087856.2A Withdrawn CN107071260A (en) 2016-11-29 2016-11-29 A kind of filming apparatus and method, and terminal device

Country Status (1)

Country Link
CN (1) CN107071260A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110933315A (en) * 2019-12-10 2020-03-27 Oppo广东移动通信有限公司 Image data processing method and related equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101448099A (en) * 2008-12-26 2009-06-03 深圳华为通信技术有限公司 Multi-camera photographing method and equipment
CN102984463A (en) * 2012-09-14 2013-03-20 旗瀚科技有限公司 Method and system for image processing
CN104052905A (en) * 2013-03-12 2014-09-17 三星泰科威株式会社 Method and apparatus for processing image
CN105141825A (en) * 2015-06-23 2015-12-09 努比亚技术有限公司 Heavenly body shooting method and device
US20160119575A1 (en) * 2014-10-24 2016-04-28 Texas Instruments Incorporated Image data processing for digital overlap wide dynamic range sensors
CN105684421A (en) * 2013-10-01 2016-06-15 株式会社尼康 Electronic apparatus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101448099A (en) * 2008-12-26 2009-06-03 深圳华为通信技术有限公司 Multi-camera photographing method and equipment
CN102984463A (en) * 2012-09-14 2013-03-20 旗瀚科技有限公司 Method and system for image processing
CN104052905A (en) * 2013-03-12 2014-09-17 三星泰科威株式会社 Method and apparatus for processing image
CN105684421A (en) * 2013-10-01 2016-06-15 株式会社尼康 Electronic apparatus
US20160119575A1 (en) * 2014-10-24 2016-04-28 Texas Instruments Incorporated Image data processing for digital overlap wide dynamic range sensors
CN105141825A (en) * 2015-06-23 2015-12-09 努比亚技术有限公司 Heavenly body shooting method and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110933315A (en) * 2019-12-10 2020-03-27 Oppo广东移动通信有限公司 Image data processing method and related equipment

Similar Documents

Publication Publication Date Title
CN106454121B (en) Double-camera shooting method and device
CN106909274B (en) Image display method and device
US8780258B2 (en) Mobile terminal and method for generating an out-of-focus image
CN106713716B (en) Shooting control method and device for double cameras
CN106097284B (en) A kind of processing method and mobile terminal of night scene image
CN106303273B (en) A kind of mobile terminal and its camera control method
CN106506927A (en) A kind of terminal and the method shot using terminal
CN106534693B (en) A kind of photo processing method, device and terminal
CN106657782B (en) Picture processing method and terminal
CN106851113A (en) A kind of photographic method and mobile terminal based on dual camera
CN106686213A (en) Shooting method and apparatus thereof
CN106603931A (en) Binocular shooting method and device
CN105430258B (en) A kind of method and apparatus of self-timer group photo
CN106911881B (en) Dynamic photo shooting device and method based on double cameras and terminal
CN106851125B (en) Mobile terminal and multiple exposure shooting method
CN106373110A (en) Method and device for image fusion
CN107018326B (en) Shooting method and device
CN107018334A (en) A kind of applied program processing method and device based on dual camera
CN106937056B (en) Focusing processing method and device for double cameras and mobile terminal
CN106973226B (en) Shooting method and terminal
CN106303044B (en) A kind of mobile terminal and obtain the method to coke number
CN105338244B (en) A kind of information processing method and mobile terminal
CN105262952A (en) Mobile terminal and image processing method thereof
CN105898158B (en) A kind of data processing method and electronic equipment
CN106709882A (en) Image fusion method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WW01 Invention patent application withdrawn after publication

Application publication date: 20170818

WW01 Invention patent application withdrawn after publication