CN106998389A - Control method, control device and the electronic installation of auto composition - Google Patents
Control method, control device and the electronic installation of auto composition Download PDFInfo
- Publication number
- CN106998389A CN106998389A CN201710138850.1A CN201710138850A CN106998389A CN 106998389 A CN106998389 A CN 106998389A CN 201710138850 A CN201710138850 A CN 201710138850A CN 106998389 A CN106998389 A CN 106998389A
- Authority
- CN
- China
- Prior art keywords
- master image
- image
- depth
- imaging device
- caching
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/2621—Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- General Business, Economics & Management (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a kind of control method of auto composition.Control method includes：Contextual data is handled to obtain current foreground type；Current composition suggestion corresponding with current foreground type is found in memory；Drive imaging device to change state to obtain meeting the scene image of current composition suggestion with control actuator.In addition, the invention also discloses a kind of control device and electronic installation.Control method, control device and the electronic installation of the present invention determines current foreground type using depth information, advises so as to obtain the corresponding current composition of current foreground type and controls actuator to drive imaging device to change state to obtain the suitable scene image of composition.
Description
Technical field
The present invention relates to imaging technique, more particularly to a kind of control method of auto composition, control device and electronic installation.
Background technology
Composition belongs to the professional technical ability of comparison in camera technique, and many ordinary consumers do not possess the technical ability of this respect,
Do not know how that adjustment camera lens direction or camera lens are inaccurate towards adjusting, cause the poor visual effect of image.
The content of the invention
It is contemplated that at least solving one of technical problem present in prior art.Therefore, the present invention needs offer one
Plant control method, control device and the electronic installation of auto composition.
A kind of control method of auto composition, for controlling electronic installation, the electronic installation includes imaging device, storage
Device and the actuator being connected with the imaging device, the imaging device are used to gather contextual data, and the memory storage has
A variety of foreground types and the suggestion of corresponding composition；The control method comprises the following steps：
The contextual data is handled to obtain current foreground type；
Current composition suggestion corresponding with the current foreground type is found in the memory；With
The actuator is controlled to drive the imaging device to change state to obtain meeting the current composition suggestion
Scene image.
A kind of control device of auto composition, for controlling electronic installation, the electronic installation includes imaging device, storage
Device and the actuator being connected with the imaging device, the imaging device are used to gather contextual data, and the memory storage has
A variety of foreground types and the suggestion of corresponding composition；The control device includes processing module, finds module and control module.
The processing module is used to handle the contextual data to obtain current foreground type.
The searching module is used to find current composition suggestion corresponding with the current foreground type in the memory.
The control module is used to control the actuator to drive the imaging device to change state to obtain meeting institute
State the scene image of current composition suggestion.
A kind of electronic installation includes imaging device, memory, the actuator being connected with the imaging device and the control
Device.
The imaging device is used to gather contextual data, and the contextual data includes caching master image.
The memory storage has a variety of foreground types and the suggestion of corresponding composition.
Control method, control device and the electronic installation of the present invention determines current foreground type using depth information, so that
The corresponding current composition of current foreground type is obtained to advise and control actuator to drive imaging device to change state to obtain structure
Scheme suitable scene image.
The additional aspect and advantage of the present invention will be set forth in part in the description, and will partly become from the following description
Obtain substantially, or recognized by the practice of the present invention.
Brief description of the drawings
The above-mentioned and/or additional aspect and advantage of the present invention will become from description of the accompanying drawings below to embodiment is combined
Obtain substantially and be readily appreciated that, wherein：
Fig. 1 is the schematic flow sheet of the control method of the auto composition of embodiment of the present invention.
Fig. 2 is the imaging device of embodiment of the present invention and the structural representation of actuator.
Fig. 3 is the floor map of the electronic installation of embodiment of the present invention.
Fig. 4 is the schematic flow sheet of the control method of some embodiments of the invention.
Fig. 5 is the high-level schematic functional block diagram of the control device of some embodiments of the invention.
Fig. 6 is the schematic flow sheet of the control method of some embodiments of the invention.
Fig. 7 is the high-level schematic functional block diagram of the processing module of the control device of some embodiments of the invention.
Fig. 8 is the schematic flow sheet of the control method of some embodiments of the invention.
Fig. 9 is the high-level schematic functional block diagram of the processing unit of some embodiments of the invention.
Figure 10 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 11 is another high-level schematic functional block diagram of the processing unit of some embodiments of the invention.
Figure 12 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 13 is the high-level schematic functional block diagram of the acquiring unit of some embodiments of the invention.
Figure 14 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 15 is the schematic flow sheet of the control method of some embodiments of the invention.
Figure 16 is another high-level schematic functional block diagram of the processing module of some embodiments of the invention.
Figure 17 is the schematic diagram of the caching master image of some embodiments of the invention.
Figure 18 is the schematic diagram of the current composition suggestion of some embodiments of the invention.
Figure 19 is the schematic diagram of the displacement images of some embodiments of the invention.
Figure 20 is the schematic diagram of the scene image of some embodiments of the invention.
Main element symbol description：
Electronic installation 100, control device 10, processing module 12, the processing subelement 1222, second of processing unit 122, first
Handle the processing of subelement the 1224, the 3rd subelement 1226, fourth process subelement 1228, processing of acquiring unit the 124, the 5th single
Member 1242, searching subelement 1244, determining unit 126, determination subelement 1262, searching module 14, control module 16, control are single
Member 162, imaging device 20, main lens 22, imaging sensor 24, memory 30, actuator 40.
Embodiment
Embodiments of the present invention are described below in detail, the embodiment of the embodiment is shown in the drawings, wherein
Same or similar label represents same or similar element or the element with same or like function from beginning to end.Lead to below
It is exemplary to cross the embodiment being described with reference to the drawings, and is only used for explaining the present invention, and it is not intended that to the limit of the present invention
System.
Also referring to Fig. 1-3, the control method of the auto composition of embodiment of the present invention can be used for control electronics dress
Put 100.Electronic installation 100 includes imaging device 20, memory 30 and the actuator 40 being connected with imaging device 20.Imaging device
20 are used to gather contextual data.Memory 30 be stored with a variety of foreground types and corresponding composition suggestion.Control method include with
Lower step：
S12：Contextual data is handled to obtain current foreground type；
S14：Current composition suggestion corresponding with current foreground type is found in memory 30；With
S16：Control actuator 40 drives imaging device 20 to change state to obtain meeting the scene of current composition suggestion
Image.
Referring to Fig. 2 and Fig. 3, the control device 10 of the auto composition of embodiment of the present invention can be used for control electricity
Sub-device 100.Control device 10 includes processing module 12, finds module 14 and control module 16.Processing module 12 is used to handle
Contextual data is to obtain current foreground type.Finding module 14 is used to find work as corresponding with current foreground type in memory 30
Preceding composition suggestion.Control module 16 is used to control actuator 40 to drive imaging device 20 to change state to obtain meeting current structure
Scheme the scene image of suggestion.
In other words, the control method of embodiment of the present invention can be real by the control device 10 of embodiment of the present invention
It is existing, wherein, step S12 can be realized by processing module 12, and step S14 can be realized by searching module 14, and step S16 can be by
Control module 16 is realized.
In some embodiments, the control device 10 of embodiment of the present invention can apply to embodiment of the present invention
Electronic installation 100, in other words the electronic installation 100 of embodiment of the present invention can include the control device of embodiment of the present invention
10。
Control method, control device 10 and the electronic installation 100 of embodiment of the present invention are determined current using depth information
Foreground type, thus obtain the corresponding current composition of current foreground type advise and control actuator 40 drive imaging device 20 with
Change state is to obtain the suitable scene image of composition.
In some embodiments, electronic installation 100 includes mobile phone or tablet personal computer.In embodiments of the present invention, it is electric
Sub-device 100 is mobile phone.
In some embodiments, actuator 40 includes MEMS.In this way, actuator 40 can be contained in electronics dress
Put in 100.
Also referring to Fig. 3 and Fig. 4, in some embodiments, imaging device 20 includes being used to gather optical imagery
Main lens 22 and the imaging sensor 24 for being arranged on main lens 22 times for optical imagery to be converted into caching to master image.Step
S16 comprises the following steps：
S162：The control driving of actuator 40 main lens 22, imaging sensor 24 and/or imaging device 20 move to show up
Scape image.
Referring to Fig. 5, in some embodiments, control module 16 includes control unit 162.Control unit 162 is used for
The control driving of actuator 40 main lens 22, imaging sensor 24 and/or imaging device 20 move to obtain scene image.
In other words, step S162 can be realized by control unit 162.
In this way, imaging device 20 can be automatically controlled by actuator 40 obtains the scene image for meeting current composition, from
And manually-operated complexity is reduced, and avoid manually operating the error that may be brought.
Specifically, control device 10 can control actuator 40 to drive whole imaging device 20 or a portion to move
With the function of reaching adjust automatically and change scene image.For example, main lens 22 can be driven to move, image can also be driven to pass
Sensor 24 is moved, and whole imaging device 20 can also be driven to move, any limitation is not done herein.In embodiments of the present invention,
The control driving imaging sensor 24 of actuator 40 of control device 10 is moved.
Referring to Fig. 6, in some embodiments, contextual data includes caching master image, step S12 includes following step
Suddenly：
S122：Processing contextual data caches the depth information of master image to obtain；
S124：The foreground part of master image is cached according to Depth Information Acquistion；With
S126：Current foreground type is determined according to foreground part.
Referring to Fig. 7, in some embodiments, contextual data includes caching master image.Processing module 12 includes processing
Unit 122, acquiring unit 124 and determining unit 126.Processing unit 122 is used to handle contextual data to obtain caching master image
Depth information.Acquiring unit 124 is used for the foreground part that master image is cached according to Depth Information Acquistion.Determining unit 126 is used
In determining current foreground type according to foreground part.
In other words, step S122 can be realized by processing unit 122, and step S124 can be realized by acquiring unit 124,
Step S126 can be realized by determining unit 126.
In this way, the foreground part of caching master image can be obtained and based on foreground part, so as to obtain current prospect
Type.
Referring to Fig. 8, in some embodiments, contextual data includes depth image corresponding with caching master image, step
Rapid S122 comprises the following steps：
S1222：Processing depth image caches the depth data of master image to obtain；With
S1224：Depth data is handled to obtain depth information.
Referring to Fig. 9, in some embodiments, contextual data includes depth image corresponding with caching master image, place
Managing unit 122 includes the first processing subelement 1222 and second processing subelement 1224.First processing subelement 1222 is used to locate
Reason depth image caches the depth data of master image to obtain.Second processing subelement 1224 is used to handle depth data to obtain
Depth information.
In other words, step S1222 can realize that step S1224 can be by second by the first processing subelement 1222
Reason subelement 1224 is realized.
So, it is possible to use depth image quickly obtains the depth information of caching master image.
It is appreciated that caching master image is RGB color image, depth image includes the depth of each personal or object in scene
Information.It is one-to-one relation due to caching the color information of master image and the depth information of depth image, therefore, can obtains
Cache the depth information of master image.
In some embodiments, the acquisition modes of depth image corresponding with caching master image include using structure optical depth
Ranging is spent to obtain depth image and obtain depth image two using flight time (time of flight, TOF) depth camera
The mode of kind.
When obtaining depth image using structure light Range finder, imaging device 20 includes camera and the projector.
It is appreciated that structure light Range finder is that the photo structure of certain pattern is projeced into body surface using the projector,
The striation 3-D view modulated by testee shape is formed on surface.Striation 3-D view is detected to obtain by camera
Striation two dimension fault image.Relative position and body surface shape that the distortion degree of striation is depended between the projector and camera
Wide or height.The displacement shown along striation is proportional to the height of body surface, and kink illustrates the change of plane, discontinuously
The physical clearance of display surface.When the timing of relative position one between the projector and camera, by the two-dimentional optical strip image distorted
The three-D profile of coordinate just reproducible body surface, so as to obtain depth information.Structure light Range finder has higher
Resolution ratio and measurement accuracy.
When obtaining depth image using TOF depth cameras, imaging device 20 includes TOF depth cameras.
It is appreciated that the modulation infrared light emission that is sent by sensor record from luminescence unit of TOF depth cameras to
Object, then the phase place change reflected from object, according to the light velocity in the range of a wavelength, can obtain whole in real time
Scene depth distance.TOF depth cameras are not influenceed when calculating depth information by the gray scale and feature on object surface, and can
Rapidly to calculate depth information, with very high real-time.
Referring to Fig. 10, in some embodiments, contextual data includes caching sub-picture corresponding with caching master image,
Step S122 comprises the following steps：
S1226：Processing caches master image and caching sub-picture to obtain caching the depth data of master image；With
S1228：Depth data is handled to obtain depth information.
Figure 11 is referred to, in some embodiments, contextual data includes caching sub-picture corresponding with caching master image,
Processing unit 122 includes the 3rd processing subelement 1226 and fourth process subelement 1228.3rd processing subelement 1226 is used for
Processing caches master image and caching sub-picture to obtain caching the depth data of master image.Fourth process subelement 1228 is used to locate
Depth data is managed to obtain depth information.
In other words, step S1226 can be realized that step S1228 can be by the everywhere by the 3rd processing subelement 1226
Reason subelement 1228 is realized.
In this way, the depth information of master image can be cached by handling caching master image and caching sub-picture acquisition.
In some embodiments, imaging device 20 includes main camera and secondary camera.
It is appreciated that depth information can be obtained by binocular stereo vision distance-finding method, now contextual data bag
Include caching master image and caching sub-picture.Wherein, caching master image is shot by main camera and obtained, and caching sub-picture is imaged by pair
Head shoots and obtained.Binocular stereo vision ranging is that same object is imaged from different positions with two identical cameras
To obtain the stereo pairs of object, then go out by algorithmic match the corresponding picture point of stereo pairs, so that parallax is calculated,
Depth information is finally recovered using the method based on triangulation.In this way, by caching master image and caching sub-picture this
Stereo pairs, which are matched, just can obtain the depth information of caching master image.
Figure 12 is referred to, in some embodiments, step S124 comprises the following steps：
S1242：The First Point of caching master image is obtained according to depth information；With
S1244：The region found with First Point adjoining and depth consecutive variations is used as foreground part.
Figure 13 is referred to, in some embodiments, acquiring unit 124 includes the 5th processing subelement 1242 and finds son
Unit 1244.5th processing subelement 1242 is used to obtain the First Point for caching master image according to depth information.Find subelement
1244 regions for being used for searching and First Point adjoining and depth consecutive variations are used as foreground part.
In other words, step S1242 can realize that step S1244 can be by finding son by the 5th processing subelement 1242
Unit 1244 is realized.
In this way, the foreground part of caching master image physical link can be obtained, i.e., in reality scene, foreground part is to connect
It is connected together.Using the foreground part of physical link as main body, the relation of foreground part can be intuitively obtained.
Specifically, the First Point for caching master image is first obtained according to depth information, First Point is opened equivalent to foreground part
End, is diffused from First Point, obtains the region with First Point adjoining and depth consecutive variations, these regions and First Point are returned
And be foreground area.
It should be noted that First Point refer to the minimum corresponding pixel of object of depth, i.e. object distance it is minimum or from
The corresponding pixel of the nearest object of imaging device 20.Adjoining refers to that two pixels link together.During depth consecutive variations
The depth difference for referring to two adjacent pixels is less than predetermined difference value, and the difference of depth is less than two adjoinings of predetermined difference value in other words
Pixel depth consecutive variations.
Figure 14 is referred to, in some embodiments, step S124 may comprise steps of：
S1246：The First Point of caching master image is obtained according to depth information；With
S1248：The region that the difference of the depth of searching and First Point is less than predetermined threshold is used as foreground part.
In this way, the foreground part of caching master image logical communication link can be obtained, i.e., in reality scene, foreground part may
It is not attached to together, but meets certain logical relation, such as eagle, which dives, grabs the scene of chicken, eagle and chicken thing
May it not linked together in reason, but logically, it can be determined that they are connected.
Specifically, the First Point for caching master image is first obtained according to depth information, First Point is opened equivalent to foreground part
End, is diffused from First Point, and the difference of the depth of acquisition and First Point is less than the region of predetermined threshold, these regions and First Point
Merger is foreground area.
In some embodiments, predetermined threshold can be the value set by user.In this way, user can be according to itself
Demand determine the scope of foreground part, so as to obtain preferable composition suggestion, realize preferable composition.
In some embodiments, predetermined threshold can be the value that control device 10 is determined, not do any limit herein
System.The predetermined threshold that control device 10 is determined can be a fixed value of storage inside or according to different situations, example
Such as the depth of First Point, the numerical value calculated.
In some embodiments, step S124 may comprise steps of：
Find region of the depth in predetermined interval and be used as foreground part.
In this way, the foreground part that depth is in OK range can be obtained.
It is appreciated that in the case of some shootings, foreground part is not the part of foremost, but foremost part is somewhat
Part more rearward, for example, people is sitting in behind computer, computer is earlier, but the talent is main part, so by depth
Region in predetermined interval can be effectively prevented from the incorrect problem of main body'choice as foreground part.
Figure 15 is referred to, in some embodiments, step S126 comprises the following steps：
S1262：According to size, shape and/or the position of the size of foreground part, shape and the background parts of caching master image
Put matching relationship and determine foreground type.
Figure 16 is referred to, in some embodiments, determining unit 126 includes determination subelement 1262.Determination subelement
1262 size, shape and/or the positions for being used for the background parts of size, shape with caching master image according to foreground part coordinate
Relation determines foreground type.
In other words, step S1262 can be realized by determination subelement 1262.
In this way, foreground type can be determined by the matching relationship of foreground part or foreground part and background parts.
, can be as topmost it is determined that during foreground type it is appreciated that main part of the foreground part as image
Determinant, the i.e. feature such as the size of Utilization prospects part, shape, content determine foreground type.
In some embodiments, in order to improve the quality of composition, it is determined that during foreground type, background portion can also be referred to
Point or foreground part and background parts matching relationship, so as to obtain more accurate foreground type, and then obtain more satisfactory
Composition suggestion.
Also referring to Figure 17-20, in one embodiment, the control imaging device 20 of control device 10 is imaged to obtain such as
Caching master image and depth image (not shown) shown in Figure 17, caching master image can be obtained according to the processing of depth information
Foreground image is trim portions, and the trim portions position in current foreground type, such as Figure 17 is determined according to trim portions
In the upper left corner of caching master image, trim portions are caused to show not comprehensive.According to this foreground type, diagonal can be selected
Composition, as shown in figure 18, the control driving imaging sensor 24 of actuator 40 of control device 10 translate as shown in figure 19 to obtain
Displacement images, because the foreground part in displacement images does not meet diagonal composition also, can control actuator 40 to drive image
Sensor 24 rotates to obtain scene image as shown in figure 20.
In the description of embodiments of the present invention, term " first ", " second " are only used for describing purpose, without being understood that
To indicate or implying relative importance or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ",
One or more feature can be expressed or be implicitly included to the feature of " second ".In embodiments of the present invention
In description, " multiple " are meant that two or more, unless otherwise specifically defined.
, it is necessary to illustrate in the description of embodiments of the present invention, unless otherwise clearly defined and limited, term
" installation ", " connected ", " connection " should be interpreted broadly, for example, it may be fixedly connected or be detachably connected, or one
Connect body；It can be mechanical connection or electrical connection or can mutually communicate；Can be joined directly together, can also lead to
Cross intermediary to be indirectly connected to, can be connection or the interaction relationship of two elements of two element internals.For ability
For the those of ordinary skill in domain, it can understand that above-mentioned term in embodiments of the present invention specific contains as the case may be
Justice.
In the description of this specification, reference term " embodiment ", " some embodiments ", " schematically implementation
The description of mode ", " example ", " specific example " or " some examples " etc. means the tool with reference to the embodiment or example description
Body characteristicses, structure, material or feature are contained at least one embodiment of the present invention or example.In this manual,
Identical embodiment or example are not necessarily referring to the schematic representation of above-mentioned term.Moreover, the specific features of description, knot
Structure, material or feature can in an appropriate manner be combined in any one or more embodiments or example.
Any process described otherwise above or method description are construed as in flow chart or herein, represent to include
Module, fragment or the portion of the code of one or more executable instructions for the step of realizing specific logical function or process
Point, and the scope of the preferred embodiment of the present invention includes other realization, wherein can not be by shown or discussion suitable
Sequence, including according to involved function by it is basic simultaneously in the way of or in the opposite order, carry out perform function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Represent in flow charts or logic and/or step described otherwise above herein, for example, being considered use
In the order list for the executable instruction for realizing logic function, it may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (such as computer based system including the system of processing module or other can be from instruction
The system of execution system, device or equipment instruction fetch and execute instruction) use, or combine these instruction execution systems, device or
Equipment and use.For the purpose of this specification, " computer-readable medium " can be it is any can include, store, communicating, propagating or
Transmission procedure uses for instruction execution system, device or equipment or with reference to these instruction execution systems, device or equipment
Device.The more specifically example (non-exhaustive list) of computer-readable medium includes following：With one or more wirings
Electrical connection section (electronic installation), portable computer diskette box (magnetic device), random access memory (RAM), read-only storage
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device, and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, can even is that can be in the paper of printing described program thereon or other are suitable for computer-readable medium
Medium, because can then enter edlin, interpretation or if necessary with it for example by carrying out optical scanner to paper or other media
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each several part of embodiments of the present invention can be with hardware, software, firmware or combinations thereof come real
It is existing.In the above-described embodiment, multiple steps or method can be with storages in memory and by suitable instruction execution system
The software or firmware of execution is realized.If for example, being realized with hardware, with another embodiment, ability can be used
Any one of following technology known to domain or their combination are realized：With for realizing logic function to data-signal
The discrete logic of logic gates, the application specific integrated circuit with suitable combinational logic gate circuit, programmable gate array
(PGA), field programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that to realize all or part of step that above-described embodiment method is carried
Rapid to can be by program to instruct the hardware of correlation to complete, described program can be stored in a kind of computer-readable storage medium
In matter, the program upon execution, including one or a combination set of the step of embodiment of the method.
In addition, each functional unit in various embodiments of the present invention can be integrated in a processing module, also may be used
To be that unit is individually physically present, can also two or more units be integrated in a module.It is above-mentioned integrated
Module can both be realized in the form of hardware, it would however also be possible to employ the form of software function module is realized.The integrated module
If being realized using in the form of software function module and as independent production marketing or in use, a calculating can also be stored in
In machine read/write memory medium.
Storage medium mentioned above can be read-only storage, disk or CD etc..
Although embodiments of the invention have been shown and described above, it is to be understood that above-described embodiment is example
Property, it is impossible to limitation of the present invention is interpreted as, one of ordinary skill in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changed, replacing and modification.
Claims (20)
1. a kind of control method of auto composition, for controlling electronic installation, it is characterised in that the electronic installation includes imaging
Device, memory and the actuator being connected with the imaging device, the imaging device are used to gather contextual data, the storage
Device be stored with a variety of foreground types and corresponding composition suggestion；The control method comprises the following steps：
The contextual data is handled to obtain current foreground type；
Current composition suggestion corresponding with the current foreground type is found in the memory；With
The actuator is controlled to drive the imaging device to change state to obtain meeting the scene of the current composition suggestion
Image.
2. control method as claimed in claim 1, it is characterised in that the contextual data includes caching master image, the place
The step of contextual data is to obtain current foreground type is managed to comprise the following steps：
The contextual data is handled to obtain the depth information of the caching master image；
The foreground part of master image is cached according to the Depth Information Acquistion；With
Current foreground type is determined according to the foreground part.
3. control method as claimed in claim 2, it is characterised in that the contextual data includes and the caching master image pair
The depth image answered, the processing contextual data with obtain it is described caching master image depth information the step of include it is following
Step：
The depth image is handled to obtain the depth data of the caching master image；With
The depth data is handled to obtain the depth information.
4. control method as claimed in claim 2, it is characterised in that the contextual data includes and the caching master image pair
The caching sub-picture answered, the processing contextual data with obtain it is described caching master image depth information the step of include with
Lower step：
Processing is described to be cached master image and the caching sub-picture to obtain the depth data of the caching master image；With
The depth data is handled to obtain the depth information.
5. control method as claimed in claim 2, it is characterised in that described that master is cached according to the Depth Information Acquistion
The step of foreground part of image, comprises the following steps：
The First Point of the caching master image is obtained according to the depth information；With
The region found with First Point adjoining and depth consecutive variations is used as the foreground part.
6. control method as claimed in claim 2, it is characterised in that described that current prospect class is determined according to the foreground part
The step of type, comprises the following steps：
According to size, shape and/or the position of the size of the foreground part, shape and the background parts of the caching master image
Matching relationship determines the foreground type.
7. control method as claimed in claim 1, it is characterised in that the imaging device includes being used to gather optical imagery
Main lens and the imaging sensor being arranged under the main lens for the optical imagery to be converted into the caching master image；
The control actuator drives the imaging device to change state to obtain meeting the scene of the current composition suggestion
The step of image, comprises the following steps：
The actuator is controlled to drive the main lens, described image sensor and/or the imaging device movement to obtain
State scene image.
8. a kind of control device of auto composition, for controlling electronic installation, it is characterised in that the electronic installation includes imaging
Device, memory and the actuator being connected with the imaging device, the imaging device are used to gather contextual data, the storage
Device be stored with a variety of foreground types and corresponding composition suggestion；The control device includes：
Processing module, the processing module is used to handle the contextual data to obtain current foreground type；
Module is found, the searching module is used to find current composition corresponding with the current foreground type in the memory
It is recommended that；With
Control module, the control module is used to control the actuator to drive the imaging device to change state to be accorded with
Close the scene image of the current composition suggestion.
9. control device as claimed in claim 8, it is characterised in that the contextual data includes caching master image, the place
Reason module includes：
Processing unit, the processing unit is used to handle the contextual data to obtain the depth information of the caching master image；
Acquiring unit, the acquiring unit is used for the foreground part that master image is cached according to the Depth Information Acquistion；With
Determining unit, the determining unit is used to determine current foreground type according to the foreground part.
10. control device as claimed in claim 9, it is characterised in that the contextual data includes and the caching master image
Corresponding depth image, the processing unit includes：
First processing subelement, the first processing subelement is used to handle the depth image to obtain the caching master image
Depth data；With
Second processing subelement, the second processing subelement is used to handle the depth data to obtain the depth information.
11. control device as claimed in claim 9, it is characterised in that the contextual data includes and the caching master image
Corresponding caching sub-picture, the processing unit includes：
3rd processing subelement, it is described 3rd processing subelement be used for handle it is described caching master image and the caching sub-picture with
Obtain the depth data of the caching master image；With
Fourth process subelement, the fourth process subelement is used to handle the depth data to obtain the depth information.
12. control device as claimed in claim 9, it is characterised in that the acquiring unit includes：
5th processing subelement, the 5th processing subelement is used to obtain the caching master image according to the depth information
First Point；With
Subelement is found, the searching subelement is used to find and First Point adjoining and the region conduct of depth consecutive variations
The foreground part.
13. control device as claimed in claim 9, it is characterised in that the determining unit includes：
Determination subelement, the determination subelement is used for size, shape and the caching master image according to the foreground part
Size, shape and/or the position matching of background parts determine the foreground type.
14. control device as claimed in claim 8, it is characterised in that the imaging device includes being used to gather optical imagery
Main lens and be arranged under the main lens be used for by the optical imagery be converted into it is described caching master image image sensing
Device；The control module includes：
Control unit, described control unit be used to controlling the actuator drive the main lens, described image sensor and/or
The imaging device movement is to obtain the scene image.
15. a kind of electronic installation, it is characterised in that including：
Imaging device, the imaging device is used to gather contextual data, and the contextual data includes caching master image；
Memory, the memory storage has a variety of foreground types and the suggestion of corresponding composition；
The actuator being connected with the imaging device；With
Control device as described in claim 8-14 any one.
16. electronic installation as claimed in claim 15, it is characterised in that the electronic installation includes mobile phone or tablet personal computer.
17. electronic installation as claimed in claim 15, it is characterised in that the imaging device includes main camera and secondary shooting
Head.
18. electronic installation as claimed in claim 15, it is characterised in that the imaging device includes camera and the projector.
19. electronic installation as claimed in claim 15, it is characterised in that the imaging device includes TOF depth cameras.
20. electronic installation as claimed in claim 15, it is characterised in that the actuator includes MEMS.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710138850.1A CN106998389A (en) | 2017-03-09 | 2017-03-09 | Control method, control device and the electronic installation of auto composition |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710138850.1A CN106998389A (en) | 2017-03-09 | 2017-03-09 | Control method, control device and the electronic installation of auto composition |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106998389A true CN106998389A (en) | 2017-08-01 |
Family
ID=59431325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710138850.1A Pending CN106998389A (en) | 2017-03-09 | 2017-03-09 | Control method, control device and the electronic installation of auto composition |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106998389A (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108462826A (en) * | 2018-01-23 | 2018-08-28 | 维沃移动通信有限公司 | A kind of method and mobile terminal of auxiliary photo-taking |
| CN108513073A (en) * | 2018-04-13 | 2018-09-07 | 朱钢 | A kind of implementation method for the mobile phone photograph function having photographer's composition consciousness |
| WO2018161323A1 (en) * | 2017-03-09 | 2018-09-13 | 广东欧珀移动通信有限公司 | Depth-based control method and control device and electronic device |
| CN108810418A (en) * | 2018-07-16 | 2018-11-13 | Oppo广东移动通信有限公司 | Image processing method, device, mobile terminal and computer readable storage medium |
| CN108961302A (en) * | 2018-07-16 | 2018-12-07 | Oppo广东移动通信有限公司 | Image processing method, device, mobile terminal and computer readable storage medium |
| CN109089047A (en) * | 2018-09-29 | 2018-12-25 | Oppo广东移动通信有限公司 | Control method and apparatus, the storage medium, electronic equipment of focusing |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104333748A (en) * | 2014-11-28 | 2015-02-04 | 广东欧珀移动通信有限公司 | Method, device and terminal for obtaining image main object |
| CN105894016A (en) * | 2016-03-29 | 2016-08-24 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN105981368A (en) * | 2014-02-13 | 2016-09-28 | 谷歌公司 | Photo composition and position guidance in an imaging device |
| CN106034206A (en) * | 2015-03-17 | 2016-10-19 | 联想(北京)有限公司 | Electronic equipment and image display method |
| CN106331508A (en) * | 2016-10-19 | 2017-01-11 | 深圳市道通智能航空技术有限公司 | Composition shooting method and device |
-
2017
- 2017-03-09 CN CN201710138850.1A patent/CN106998389A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105981368A (en) * | 2014-02-13 | 2016-09-28 | 谷歌公司 | Photo composition and position guidance in an imaging device |
| CN104333748A (en) * | 2014-11-28 | 2015-02-04 | 广东欧珀移动通信有限公司 | Method, device and terminal for obtaining image main object |
| CN106034206A (en) * | 2015-03-17 | 2016-10-19 | 联想(北京)有限公司 | Electronic equipment and image display method |
| CN105894016A (en) * | 2016-03-29 | 2016-08-24 | 联想(北京)有限公司 | Image processing method and electronic device |
| CN106331508A (en) * | 2016-10-19 | 2017-01-11 | 深圳市道通智能航空技术有限公司 | Composition shooting method and device |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018161323A1 (en) * | 2017-03-09 | 2018-09-13 | 广东欧珀移动通信有限公司 | Depth-based control method and control device and electronic device |
| US11145086B2 (en) | 2017-03-09 | 2021-10-12 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Electronic device, and method and apparatus for controlling the same |
| CN108462826A (en) * | 2018-01-23 | 2018-08-28 | 维沃移动通信有限公司 | A kind of method and mobile terminal of auxiliary photo-taking |
| CN108513073A (en) * | 2018-04-13 | 2018-09-07 | 朱钢 | A kind of implementation method for the mobile phone photograph function having photographer's composition consciousness |
| CN108810418A (en) * | 2018-07-16 | 2018-11-13 | Oppo广东移动通信有限公司 | Image processing method, device, mobile terminal and computer readable storage medium |
| CN108961302A (en) * | 2018-07-16 | 2018-12-07 | Oppo广东移动通信有限公司 | Image processing method, device, mobile terminal and computer readable storage medium |
| WO2020015558A1 (en) * | 2018-07-16 | 2020-01-23 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and apparatus for processing image |
| CN108810418B (en) * | 2018-07-16 | 2020-09-11 | Oppo广东移动通信有限公司 | Image processing method, image processing device, mobile terminal and computer readable storage medium |
| US11233933B2 (en) | 2018-07-16 | 2022-01-25 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method and device for processing image, and mobile terminal |
| CN109089047A (en) * | 2018-09-29 | 2018-12-25 | Oppo广东移动通信有限公司 | Control method and apparatus, the storage medium, electronic equipment of focusing |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106998389A (en) | Control method, control device and the electronic installation of auto composition | |
| CN106851107A (en) | Switch control method, control device and the electronic installation of camera assisted drawing | |
| JP6552729B2 (en) | System and method for fusing the outputs of sensors having different resolutions | |
| CN106851238B (en) | Method for controlling white balance, white balance control device and electronic device | |
| CN106851123B (en) | Exposure control method, exposure control device and electronic device | |
| US8781256B2 (en) | Method to match color image and depth image using feature points | |
| US8294762B2 (en) | Three-dimensional shape measurement photographing apparatus, method, and program | |
| CN107025635A (en) | Processing method, processing unit and the electronic installation of image saturation based on the depth of field | |
| US20020126895A1 (en) | Specific point detecting method and device | |
| CN106875433A (en) | Cut control method, control device and the electronic installation of composition | |
| CN105827980B (en) | Focusing control method and device, image formation control method and device, electronic installation | |
| JP6740537B2 (en) | Focus system, cine camera system, program and computer-readable storage medium | |
| CN106412426A (en) | Omni-focus photographing apparatus and method | |
| KR102391828B1 (en) | Distance measurement device for motion picture camera focus applications | |
| WO2019144269A1 (en) | Multi-camera photographing system, terminal device, and robot | |
| CN112700484B (en) | Depth map colorization method based on monocular depth camera | |
| US8537208B2 (en) | Apparatus and method for displaying three-dimensional image according to position of user | |
| CN109165629A (en) | It is multifocal away from visual barrier cognitive method, device, equipment and storage medium | |
| CN106991378A (en) | Facial orientation detection method, detection means and electronic installation based on depth | |
| CN114788254B (en) | Auxiliary focusing method, device and system | |
| CN110880161B (en) | Depth image stitching and fusion method and system for multiple hosts and multiple depth cameras | |
| CN105865423A (en) | A binocular range finding method, a binocular range finding device, a panoramic image mosaicking method and a system thereof | |
| CN107016651A (en) | Image sharpening method, image sharpening device and electronic installation | |
| CN105335959A (en) | Quick focusing method and device for imaging apparatus | |
| CN106973224A (en) | Control method, control device and the electronic installation of assisted drawing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: OPPO Guangdong Mobile Communications Co., Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: Guangdong OPPO Mobile Communications Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170801 |
|
| RJ01 | Rejection of invention patent application after publication |