[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN107707807A - IMAQ control method and device - Google Patents

IMAQ control method and device Download PDF

Info

Publication number
CN107707807A
CN107707807A CN201510546276.4A CN201510546276A CN107707807A CN 107707807 A CN107707807 A CN 107707807A CN 201510546276 A CN201510546276 A CN 201510546276A CN 107707807 A CN107707807 A CN 107707807A
Authority
CN
China
Prior art keywords
imaging unit
blur
space
expectation
imaging
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201510546276.4A
Other languages
Chinese (zh)
Other versions
CN107707807B (en
Inventor
周梁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhigu Ruituo Technology Services Co Ltd
Original Assignee
Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhigu Ruituo Technology Services Co Ltd filed Critical Beijing Zhigu Ruituo Technology Services Co Ltd
Priority to CN201510546276.4A priority Critical patent/CN107707807B/en
Publication of CN107707807A publication Critical patent/CN107707807A/en
Application granted granted Critical
Publication of CN107707807B publication Critical patent/CN107707807B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Studio Devices (AREA)

Abstract

This application discloses a kind of IMAQ control method and device, methods described to include:Determine the expectation blur-free imaging area of space of scene;The relative plane parallel with the main lens of light-field camera at least tilts at least one first imaging unit, to be reduced at least a Part I in the average blur circle being at least imaged on one first imaging unit, wherein:For at least one first imaging unit to be used at least imaging unit that IMAQ is carried out to the expectation blur-free imaging area of space in the imaging unit array of the light-field camera, an at least Part I is positioned at least a portion of the expectation blur-free imaging area of space in the scene;The light-field camera after adjusted carries out IMAQ to the scene.The application is advantageously implemented the customization IMAQ that blur-free imaging area of space it is expected in scene, can more preferably meet diversified practical application request.

Description

IMAQ control method and device
Technical field
The application is related to a kind of field of terminal technology, more particularly to a kind of IMAQ controlling party Method and device.
Background technology
With the continuous development of acquisition technology, support IMAQ equipment constantly push away it is old go out Newly, people are also more and more to the individual demand for gathering image.
Different from traditional camera, light-field camera is typically in main lens and such as CCD imagings list A lenslet arrays are placed between element array, will scene different directions be taken the photograph by lenslet arrays Field information recorded on the focal plane of lenslet arrays, can be remembered by single exposure The four-dimensional field informations such as space, the visual angle of three-dimensional scenic are recorded, are supported " first shooting back focusing ", Abundant image effect can be generated by handling the image after shooting, example can be met Such as digital focusing, visual angle change, depth image, a variety of imaging applications of three-dimensionalreconstruction again.Mesh Before, the research of the acquisition technology based on light-field camera causes professional widely to be closed further Note.
The content of the invention
The brief overview on the application is given below, to provide on the application's The basic comprehension of some aspects.It should be appreciated that this general introduction is not the exhaustion on the application Property general introduction.It is not intended to determine the key or pith of the application, nor being intended to limit Determine scope of the present application.Its purpose only provides some concepts in simplified form, is made with this For the preamble in greater detail discussed later.
The embodiment of the present application provides a kind of IMAQ control method and device.
In a first aspect, the embodiment of the present application provides a kind of IMAQ control method, including:
Determine the expectation blur-free imaging area of space of scene;
The relative plane parallel with the main lens of light-field camera at least tilts at least one first imaging Unit, be reduced at least a Part I it is described be at least imaged on one first imaging unit it is flat Equal blur circle, wherein:At least one first imaging unit is the imaging list of the light-field camera It is used to carry out at least the one of IMAQ to the expectation blur-free imaging area of space in element array Imaging unit, an at least Part I are to be located at the expectation blur-free imaging in the scene At least a portion of area of space;
The light-field camera after adjusted carries out IMAQ to the scene.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute The expectation blur-free imaging area of space for determining scene is stated, including:Determine that the light-field camera obtains The scene preview image part for it is expected circle of good definition;Determine the expectation circle of good definition pair First space distribution information of the Part I answered in the scene;According to first space Distributed intelligence determines the expectation blur-free imaging area of space.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, really The part of the preview image for the scene that the fixed light-field camera obtains is wrapped it is expected circle of good definition Include:Obtain the selection information to the preview image;Institute is determined according at least to the selection information The corresponding topical for stating preview image is the expectation circle of good definition.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute Stating selection information includes:Choice direction information, or, selection region information, or, selection Object information.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute It is relatively described parallel with main lens to state any first imaging unit at least one first imaging unit Planar tilt after, the corresponding Part I of unit with the described first imaging is described first The average blur circle being imaged on imaging unit allows blur circle less than or equal to one.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute State it is adjusted after the light-field camera to the scene carry out IMAQ before, in addition to: Determine the depth capacity sub-district of the expectation blur-free imaging area of space covering;To the light field phase Machine carries out focusing adjustment, so that the focusing plane after light-field camera adjustment is positioned at described maximum deep Spend in sub-district.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute State the relative plane parallel with the main lens of light-field camera and at least tilt at least one first imaging list Member, be reduced at least a Part I it is described be at least imaged on one first imaging unit be averaged Blur circle, including:Relative at least one the first one-tenth described in the planar tilt parallel with the main lens As unit, with an at least Part I described in reducing it is described at least on one first imaging unit into The average blur circle of picture.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, phase It is any the first one-tenth in the planar tilt parallel to the main lens at least one first imaging unit As unit, to reduce Part I corresponding with first imaging unit in the described first imaging The average blur circle being imaged on unit, including:According to the focal length of the first sub-lens, fitting face and The photocentre edge of angle and first sub-lens between the plane parallel with main lens is vertical The direction of the plane parallel with main lens determines described first to the distance in the fitting face The expectation angle of inclination of imaging unit, wherein, first sub-lens are the light-field camera Sub-lens corresponding with first imaging unit in lenslet arrays, according to the fitting face Second of each picture formed by the main lens of at least Part I through the light-field camera is empty Between distributed intelligence fitting obtained by plane;According at least to it is described expectation angle of inclination relatively it is described with First imaging unit described in the parallel planar tilt of main lens, it is corresponding described first to reduce Divide the average blur circle being imaged on first imaging unit.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, phase Before pair the first imaging unit described in the planar tilt parallel with the main lens, in addition to:Will The expectation angle of inclination is compared with an imaging unit tilt adjustment angle threshold;In response to The expectation angle of inclination exceedes the imaging unit tilt adjustment angle threshold, adjusts the remote light The focusing position of field camera.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, phase It is any the first one-tenth in the planar tilt parallel to the main lens at least one first imaging unit As unit, to reduce Part I corresponding with first imaging unit in the described first imaging The average blur circle being imaged on unit, including:Determine that first imaging unit is relative saturating with master The parallel plane of mirror allows angular range;Allow angular range relatively described according at least to described First imaging unit described in the planar tilt parallel with main lens, to reduce corresponding described first The average blur circle that part is imaged on first imaging unit.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, really Fixed first imaging unit is with respect to the angular range of allowing of the plane parallel with main lens, bag Include:According to the folder between the focal length of the first sub-lens, fitting face and the plane parallel with main lens Side of the photocentre of angle and first sub-lens along the vertical plane parallel with main lens To the distance to the fitting face, the expectation angle of inclination of first imaging unit is determined, its In, first sub-lens are to be imaged in the lenslet arrays of the light-field camera with described first Sub-lens corresponding to unit, the fitting face are an at least Part I described in basis through the light Formed by the main lens of camera it is each as second space distributed intelligence fitting obtained by plane;Extremely It is few to allow angular range according to determining the expectation angle of inclination.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, phase It is any the first one-tenth in the planar tilt parallel to the main lens at least one first imaging unit As unit, to reduce Part I corresponding with first imaging unit in the described first imaging The average blur circle being imaged on unit, including:The relative plane parallel with main lens is intended along increase The direction of the angle between plane where conjunction face and first imaging unit, tilt described the One imaging unit, it is imaged with reducing the corresponding Part I on first imaging unit Average blur circle, wherein, the fitting face is according to passing through an at least Part I Formed by the main lens of light-field camera it is each as second space distributed intelligence fitting obtained by plane.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute State the relative plane parallel with the main lens of light-field camera and at least tilt at least one first imaging list Member, be reduced at least a Part I it is described be at least imaged on one first imaging unit be averaged Blur circle, including:At least one first imaging is single described in the relative planar tilt parallel with main lens Member and at least one first sub-lens, with an at least Part I described in reducing described at least 1 the The average blur circle being imaged on one imaging unit, wherein, at least first sub-lens are described Sub-lens corresponding with least one first imaging unit in the lenslet arrays of light-field camera.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, phase It is any the first one-tenth in pair at least one first imaging unit described in the planar tilt parallel with main lens As in unit and at least one first sub-lens corresponding with first imaging unit the One sub-lens, with reduce with corresponding with the first imaging unit one in an at least Part I The average blur circle that Part I is imaged on first imaging unit, including:According to corresponding First sub-lens focal length, fitting face and the plane parallel with main lens between Angle, the photocentre of corresponding first sub-lens are along plane vertically parallel with the main lens Direction to the distance in the fitting face and the photocentre of corresponding first sub-lens along hanging down The direction of the plane parallel with main lens to first imaging unit distance, it is determined that First angle of inclination of first imaging unit and the second of corresponding first sub-lens Angle of inclination;According to the relatively described planar tilt parallel with main lens in first angle of inclination First imaging unit and put down according to second angle of inclination is relatively described with main lens First sub-lens described in capable planar tilt, to reduce the corresponding Part I described the The average blur circle being imaged on one imaging unit.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, phase Before the planar tilt parallel to the main lens at least one first imaging unit, in addition to:Root According to first space distribution information of at least Part I in the scene, it is determined that described The second space of each picture formed by main lens of at least Part I through the light-field camera point Cloth information;The fitting face is determined according to the second space distributed intelligence.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute State each picture and arrive the minimum apart from sum of the fitting face respectively.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, extremely A while tiltedly before at least one first imaging unit, in addition to:At least determine that the imaging is single Inclined at least one first imaging unit is treated in element array.
Any IMAQ control method provided with reference to the embodiment of the present application, optionally, institute State and at least determine to treat inclined at least one first imaging unit in the imaging unit array, Including:Determine the expectation circle of good definition pair with the preview image of the scene in the lenslet arrays At least sub-lens answered, at least one first sub-lens;According to the lenslet arrays In sub-lens and the imaging unit array imaging unit between corresponding relation, it is determined that with At least one first imaging unit corresponding at least one first sub-lens.
Second aspect, the embodiment of the present application additionally provide a kind of IMAQ control device, including:
One it is expected blur-free imaging area of space determining module, for determine the expectation of scene clearly into Image space region;
One tilt control module, for the relative plane parallel with the main lens of light-field camera at least At least one first imaging unit is tilted, to be reduced at least a Part I described at least one first The average blur circle being imaged on imaging unit, wherein:At least one first imaging unit is institute State and be used to enter the expectation blur-free imaging area of space in the imaging unit array of light-field camera An at least imaging unit for row IMAQ, an at least Part I are the scene middle position In at least a portion of the expectation blur-free imaging area of space;
One IMAQ control module, for the light-field camera after adjusted to the scene Carry out IMAQ.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute State and it is expected that blur-free imaging area of space determining module includes:One it is expected circle of good definition determination sub-module, The part of the preview image of the scene obtained for determining the light-field camera is clear it is expected Clear area;One first space distribution information determination sub-module, for determining the expectation circle of good definition pair First space distribution information of the Part I answered in the scene;One it is expected that blur-free imaging is empty Between region determination sub-module, for according to first space distribution information determine it is described it is expected it is clear Clear imaging space region.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute State and it is expected that circle of good definition determination sub-module includes:One selection information acquisition unit, for obtaining to institute State the selection information of preview image;One it is expected circle of good definition determining unit, for according at least to described Selection information determines that the corresponding topical of the preview image is the expectation circle of good definition.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating selection information includes:Choice direction information, or, selection region information, or, selection Object information.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute It is relatively described parallel with main lens to state any first imaging unit at least one first imaging unit Planar tilt after, the corresponding Part I of unit with the described first imaging is described first The average blur circle being imaged on imaging unit allows blur circle less than or equal to one.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating device also includes:One depth capacity sub-district determining module, for determine it is described expectation clearly into The depth capacity sub-district of image space region overlay;One first focusing adjusting module, for described Light-field camera carries out focusing adjustment, so that the focusing plane after light-field camera adjustment is positioned at described In depth capacity sub-district.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating tilt control module includes:One first inclination control submodule, for relative saturating with the master At least one first imaging unit described in the parallel planar tilt of mirror, with least one first described in reduction Part is in the average blur circle being at least imaged on one first imaging unit.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating the first inclination control submodule includes:One it is expected angle of inclination determining unit, appoints for basis Angle between the focal lengths of one first sub-lens, fitting face and the plane parallel with main lens, with And direction of the photocentre of first sub-lens along the vertical plane parallel with main lens is arrived The distance in the fitting face, the expectation angle of inclination of any first imaging unit is determined, its In, first sub-lens are to be imaged in the lenslet arrays of the light-field camera with described first Sub-lens corresponding to unit, the fitting face are an at least Part I described in basis through the light Formed by the main lens of camera it is each as second space distributed intelligence fitting obtained by plane;One First tilt control unit, for relatively described saturating with master according at least to the expectation angle of inclination First imaging unit described in the parallel planar tilt of mirror, existed with reducing the corresponding Part I The average blur circle being imaged on first imaging unit.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating device also includes:One angle changing rate module, for the expectation angle of inclination to be imaged with one Unit tilt adjustment angle threshold is compared;One second focusing adjusting module, in response to The expectation angle of inclination exceedes the imaging unit tilt adjustment angle threshold, adjusts the remote light The focusing position of field camera.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating the first inclination control submodule includes:One allows angular range determining unit, for determining to appoint One first imaging unit allows angular range with respect to the plane parallel with main lens;One model Tilt control unit is enclosed, for allowing angular range relatively described and main lens according at least to described First imaging unit described in parallel planar tilt, to reduce the corresponding Part I in institute State the average blur circle being imaged on the first imaging unit.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute State and allow angular range determining unit to include:One it is expected angle of inclination determination subelement, for root According to the folder between the focal length of any first sub-lens, fitting face and the plane parallel with main lens Side of the photocentre of angle and first sub-lens along the vertical plane parallel with main lens To the distance to the fitting face, the expectation inclination angle of any first imaging unit is determined Degree, wherein, first sub-lens in the lenslet arrays of the light-field camera with described the Sub-lens corresponding to one imaging unit, the fitting face are at least Part I warp according to Formed by the main lens of the light-field camera it is each as second space distributed intelligence fitting obtained by Plane;One allows angular range determining unit, for true according at least to the expectation angle of inclination Allow angular range described in fixed.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating the first inclination control submodule includes:One direction tilt control unit, for relative saturating with master The parallel plane of mirror is along between the plane where increase fitting face and first imaging unit The direction of angle, first imaging unit is tilted, existed with reducing the corresponding Part I The average blur circle being imaged on first imaging unit, wherein, the fitting face is according to institute State the second space of each picture formed by main lens of at least Part I through the light-field camera Plane obtained by distributed intelligence fitting.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating tilt control module includes:One second inclination control submodule, put down for relative with main lens At least one first imaging unit described in capable planar tilt and at least one first sub-lens, to reduce An at least Part I is in the average disperse being at least imaged on one first imaging unit Circle, wherein, at least first sub-lens in the lenslet arrays of the light-field camera with institute State sub-lens at least corresponding to one first imaging unit.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating the second inclination control submodule includes:One angle of inclination determining unit, for according to corresponding The focal length of first sub-lens, the folder being fitted between face and the plane parallel with main lens Angle, the photocentre of corresponding first sub-lens are along plane vertically parallel with the main lens Direction is to the distance in the fitting face and the photocentre of corresponding first sub-lens along vertically The direction of the plane parallel with main lens determines institute to the distance of first imaging unit State the first angle of inclination of the first imaging unit and the second of corresponding first sub-lens inclines Rake angle;One second tilt control unit, for relatively described according to first angle of inclination First imaging unit described in the planar tilt parallel with main lens and according to described second tilt First sub-lens described in the relatively described planar tilt parallel with main lens of angle, it is corresponding to reduce The average blur circle that is imaged on first imaging unit of the Part I.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating device also includes:One second space distributed intelligence determining module, at least one according to First space distribution information of the Part I in the scene, it is determined that described at least one first The second space distributed intelligence of each picture formed by the main lens of light-field camera described in lease making;One fitting Face determining module, for determining the fitting face according to the second space distributed intelligence.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute State each picture and arrive the minimum apart from sum of the fitting face respectively.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute Stating device also includes:One treats inclined element determining module, at least determining the imaging unit Inclined at least one first imaging unit is treated in array.
Any IMAQ control device provided with reference to the embodiment of the present application, optionally, institute State and treat that inclined element determining module includes:One first sub-lens determination sub-module, for determining State corresponding with the expectation circle of good definition of the preview image of the scene at least one in lenslet arrays Sub-lens, at least one first sub-lens;One first imaging unit determination sub-module, use In the sub-lens in the lenslet arrays and the imaging unit of the imaging unit array Between corresponding relation, it is determined that corresponding with least one first sub-lens described at least 1 the One imaging unit.
The third aspect, the embodiment of the present application additionally provide another IMAQ control device, bag Include:
One processor, a communication interface, a memory and a communication bus;The processor, The communication interface and the memory complete mutual communication by the communication bus;
The memory is used to deposit at least one instruction;It is described instruction make the computing device with Lower operation:
Determine the expectation blur-free imaging area of space of scene;
The relative plane parallel with the main lens of light-field camera at least tilts at least one first imaging Unit, be reduced at least a Part I it is described be at least imaged on one first imaging unit it is flat Equal blur circle, wherein:At least one first imaging unit is the imaging list of the light-field camera It is used to carry out at least the one of IMAQ to the expectation blur-free imaging area of space in element array Imaging unit, an at least Part I are to be located at the expectation blur-free imaging in the scene At least a portion of area of space;
The light-field camera after adjusted carries out IMAQ to the scene.
The technical scheme that the embodiment of the present application provides is carrying out the image of scene based on light-field camera During acquisition applications, it may be determined that the expectation blur-free imaging area of space of scene, by a while Tiltedly it is used to carrying out the expectation blur-free imaging area of space at least one the first one-tenth of IMAQ As the mode of unit so that in the scene positioned at the expectation blur-free imaging area of space extremely A few Part I is in the corresponding average blur circle being at least imaged on one first imaging unit Size has reduced, thus the image quality of an at least Part I described in improvement.In addition, adopt During the technical scheme provided with the embodiment of the present application carries out the optically detecting of scene image, due to The expectation blur-free imaging area of space of the scene can determine according to being actually needed, and by least Tilt the mode of corresponding at least one first imaging unit of light-field camera can improve to it is described at least One Part I carries out the image quality of optically detecting, and therefore, being advantageously implemented in scene needs Compared with the customization IMAQ of the expectation blur-free imaging area of space of high imaging quality, can more preferably expire The diversified IMAQ application of foot and the rear interactive application based on optically detecting information etc. need Ask.
By below in conjunction with detailed description of the accompanying drawing to the alternative embodiment of the application, the application's The advantages of these and other, will be apparent from.
Brief description of the drawings
The application can be more preferable by reference to being obtained below in association with the description given by accompanying drawing Understanding, wherein having used same or analogous reference in all of the figs to represent identical Or similar part.The accompanying drawing is included in this specification together with following detailed description In and form the part of this specification, and can for be further illustrated the application Select embodiment and explain the principle and advantage of the application.In the accompanying drawings:
Fig. 1 is a kind of IMAQ control method flow chart that the embodiment of the present application provides;
Fig. 2 is that the preview image for the scene that the light-field camera that the embodiment of the present application provides obtains shows Example;
Fig. 3 is the schematic diagram in the scene depth direction that the embodiment of the present application provides;
Fig. 4 a are that the fitting face that the embodiment of the present application provides determines and the first imaging unit tilts Example one;
Fig. 4 b are that the fitting face that the embodiment of the present application provides determines and the first imaging unit tilts Example two;
Fig. 5 is the elongated surfaces of three planes of the husky nurse law correlation that the embodiment of the present application provides Intersecting example one;
Fig. 6 is the elongated surfaces of three planes of the husky nurse law correlation that the embodiment of the present application provides Intersecting example two;
Fig. 7 is the first imaging unit incline direction example that the embodiment of the present application provides;
Fig. 8 a are that the fitting face that the embodiment of the present application provides determines and the first imaging unit and the One sub-lens tilt example;
Fig. 8 b are the elongated surfaces of three planes of the husky nurse law correlation that the embodiment of the present application provides Intersecting example three;
Fig. 9 is the light-field camera topology example that the embodiment of the present application provides;
Figure 10 is the box for the first IMAQ control device that the embodiment of the present application provides Figure;
Figure 11 is the box for second of IMAQ control device that the embodiment of the present application provides Figure;
Figure 12 is the box for the third IMAQ control device that the embodiment of the present application provides Figure;
Figure 13 is the box for the 4th kind of IMAQ control device that the embodiment of the present application provides Figure.
It will be appreciated by those skilled in the art that the element in accompanying drawing is just for the sake of simple and clear For the sake of and show, and be not necessarily drawn to scale.For example, some elements in accompanying drawing Size may be exaggerated relative to other elements, to be favorably improved to the embodiment of the present application Understanding.
Embodiment
The one exemplary embodiment of the application is described in detail hereinafter in connection with accompanying drawing.For For the sake of clear and simplicity, all features of actual embodiment are not in the description described. It should be understood, however, that it must be made during any this practical embodiments are developed a lot Specific to the decision of embodiment, to realize the objectives of developer, for example, meeting Those restrictive conditions related to system and business, and these restrictive conditions may be with really Apply the difference of mode and change.In addition, it will also be appreciated that although development is possible to It is extremely complex and time-consuming, but those skilled in the art to having benefited from present disclosure come Say, this development is only routine task.
Herein, it is also necessary to which explanation is a bit, in order to avoid being obscured because of unnecessary details The application, it merely depict in the drawings and in the description closely related with the scheme according to the application Apparatus structure and/or processing step, and eliminate pair with the application relation it is little, this area Part known to those of ordinary skill and the expression and description of processing.
(identical label represents identical element in some accompanying drawings) and implementation below in conjunction with the accompanying drawings Example, is described in further detail to the embodiment of the application.Following examples are used to say Bright the application, but it is not limited to scope of the present application.
It will be understood by those skilled in the art that the term such as " first ", " second " in the application It is only used for distinguishing different step, equipment or module etc., neither represents any particular technology implication, The inevitable logical order between them is not indicated that yet.
Fig. 1 is a kind of flow chart for IMAQ control method that the embodiment of the present application provides.This The executive agent for applying for the IMAQ control method that embodiment provides can be a certain IMAQ Control device.The equipment form of expression of described image acquisition control device is unrestricted, such as institute It can be a certain independent part to state IMAQ control device;Or described image acquisition control Device can be integrated in an imaging device as a certain functional module, and the imaging device may include But it is not limited to light-field camera or includes the mobile phone of light-field camera, tablet personal computer etc., the application is real Example is applied to be not intended to limit this.Specifically as shown in figure 1, a kind of image that the embodiment of the present application provides Collection control method includes:
S101:Determine the expectation blur-free imaging area of space of scene.
S102:The relative plane parallel with the main lens of light-field camera at least tilts at least one first Imaging unit, at least it is imaged with being reduced at least a Part I described on one first imaging unit Average blur circle, wherein:At least one first imaging unit for the light-field camera into As being used for carrying out IMAQ extremely to the expectation blur-free imaging area of space in cell array A few imaging unit, an at least Part I are it is expected clearly positioned at described in the scene At least a portion in imaging space region.
S103:The light-field camera after adjusted carries out IMAQ to the scene.
Object through such as light-field camera imaging device is imaged when, ideally, object plane with Image planes are that point and point are one-to-one, but in actual application, due to light wave property, as The influence of the factors such as difference, the imaging beam of the point on object generally can not converge at a bit, but The projection of a circular spread, ellipse or other similar rounds is formed in image plane, is claimed For blur circle (circle of confusion), alternatively referred to as figure of confusion, dispersion ring, circle of confusion, The circle of confusion, scattering disk etc..If the size of blur circle is smaller, corresponding to the usual blur circle The imaging of object is comparatively clear, can visually be considered as the focus imaging of the point;Accordingly, If the size of blur circle exceedes certain permissible range, object corresponding to the blur circle into As Relative Fuzzy.
Generally, light-field camera includes main lens, the lenslet arrays set gradually along depth direction With imaging unit array, light-field camera is in and does not carry out the imaging unit that the embodiment of the present application refers to And/or the tilt operation such as sub-lens state when, plane, lenslet arrays where main lens Plane where the plane and imaging unit array at place is parallel to each other and is respectively perpendicular to depth Direction is spent, each sub-lens are located normal to the same plane of depth direction in lenslet arrays, respectively The optical axis of sub-lens is parallel with depth direction, and each imaging unit is (visual in imaging unit array For an imaging unit array or image sensing cell) include multiple pixels of array distribution, respectively into As unit also is located at the same plane perpendicular to depth direction, and the normal and depth of each imaging unit It is parallel to spend direction.The plane parallel with main lens described in the embodiment of the present application includes but unlimited In:Plane where when plane, sub-lens where main lens are in not inclined original state, Imaging unit be in not inclined original state when where plane or parallel to main lens institute In other planes of plane.
According to classical theory of geometric optics, the index path of light-field camera can be equivalent to each sub-lens To main lens imaging (such as real image or the virtual image) corresponding to the sub-lens on imaging unit again Imaging, the pixel of diverse location can be with pair of different depth in storage scenarios on imaging unit The field information of elephant, it is being imaged corresponding at least local of certain object in scene through a certain sub-lens Cell array certain pixel imaging blur circle be:
In above formula:C represents the equivalent diameter of blur circle;F represents the focal length of the sub-lens;V tables Show the object it is at least local successively after main lens and the sub-lens imaging with the son thoroughly The distance at mirror center, image distance of the distance equivalent to the sub-lens;vnRepresent that lenslet arrays are put down The distance between face and imaging unit array plane;N represents f-number (f-number).
It is every in imaging unit array in the application scenarios that IMAQ is carried out based on light-field camera Individual imaging unit includes the pixel of multiple array distributions, is not generally all pictures of imaging unit Vegetarian refreshments participates in actual IMAQ, but partial pixel point participates in actual IMAQ.Into As physical record has the equal of the blur circle of each pixel of the object images information to be taken the photograph in unit Value, can be considered size of the object to be taken the photograph in the average blur circle of the imaging unit.
The embodiment of the present application based on light-field camera carry out scene IMAQ application process in, The expectation blur-free imaging area of space of scene is can determine that, is used for by least tilting to the expectation Blur-free imaging area of space carries out the mode of at least one first imaging unit of IMAQ so that An at least Part I in the scene positioned at the expectation blur-free imaging area of space is right The size for the average blur circle being at least imaged on one first imaging unit answered has reduced, thus The image quality of an at least Part I described in improving.In addition, light-field camera passes through high-dimensional letter Breath collection can bring the more flexible rear interaction capabilities of user, but can by rear interactive computing Realize that imaging effect is information-related with being directly obtained by optically detecting, implemented using the application During the technical scheme that example provides carries out the optically detecting of scene image, due to the phase of the scene Blur-free imaging area of space is hoped to be determined according to being actually needed, and by least tilting light-field camera The mode of corresponding at least one first imaging unit can improve to enter an at least Part I The image quality of row optically detecting, therefore, being advantageously implemented in scene needs compared with high imaging quality Expectation blur-free imaging area of space customization IMAQ, can more preferably meet diversified figure As acquisition applications and the demand such as the rear interactive application based on optically detecting information.
In the technical scheme that the embodiment of the present application provides, the expectation blur-free imaging area of space Determination mode is very flexible, can meet diversified practical application request.If for example, to field More pay close attention in a certain local space region in scape, it may be determined that the corresponding local space region of scene Blur-free imaging area of space it is expected to be described, with by least tilting corresponding first imaging unit Mode is located at described at least a portion it is expected in blur-free imaging area of space to improve in scene Image quality;Or if more paid close attention to certain object in scene, it may be determined that the field The spatial distribution region of the object is the expectation blur-free imaging area of space in scape, with by extremely Monoclinic phase answers the mode of the first imaging unit to improve the image quality of the object a while;Etc..Can To understand, the part that the embodiment of the present application refers to may include a certain entire object in scene, or Part of a certain object, etc. in person's scene.
Optionally, the expectation blur-free imaging area of space for determining scene, including:Determine institute The part for stating the preview image of the scene of light-field camera acquisition is expectation circle of good definition;Determine institute State and it is expected first spatial distribution of at least Part I in the scene corresponding to circle of good definition Information;The expectation blur-free imaging area of space is determined according to first space distribution information. For example, the preview image is can recognize that, according to recognition result by user or equipment office interested Portion is defined as the expectation circle of good definition, or, can by outside light-field camera to the preview graph The operation informations such as the touch-control of picture, determine that the part of the preview image, will it is expected circle of good definition etc. It is described it is expected circle of good definition combination scene in each several part spatial distribution, determine it is described it is expected clearly into Image space region.Preview image of the program based on the scene selects the expectation of the scene clear Clear imaging space region, scheme are simply easily realized.
It is further alternative, determine the preview image for the scene that the light-field camera obtains Local is it is expected circle of good definition, including:Obtain the selection information to the preview image;At least root Determine that the corresponding topical of the preview image is the expectation circle of good definition according to the selection information.Can Through but not limited to modes such as finger touch, stylus touch-control, mouse selections in the preview graph Selected on the two-dimensional picture of picture, and the corresponding of the preview image is determined according to selection information Local is the expectation circle of good definition;It is determined that after the expectation circle of good definition, can combine in scene The space distribution information of each several part, determine the expectation blur-free imaging area of space of the scene.The party Case can improve the expectation circle of good definition or the expectation blur-free imaging area of space of the scene determines Interaction convenience and flexibility, improve Consumer's Experience.The preview image of the light-field camera is The two dimensional image at a certain visual angle of scene;Selection information to the preview image may include but It is not limited to:Choice direction information, or, selection region information, or, selecting object information Deng to provide abundant interactive mode, the convenience that raising user uses.Optional interaction side Formula:For example, the selection information may include choice direction information, user can show in preview image The direction of its expectation blur-free imaging together, IMAQ control are arbitrarily marked in display screen by finger Device determines that the area of space of a predefined size is expectation circle of good definition in the direction, with reference to the phase Hope the space distribution information of each several part in circle of good definition and scene, it may be determined that the expectation of the scene is clear Clear imaging space region;In another example the selection information may include selection region information, such as scheme Shown in 2, user can mark a certain size two-dimentional area on preview image display screen by finger Domain, the 2 dimensional region marked can directly as the expectation circle of good definition, or, also can be to two dimension Region the adjustment such as zooms in and out, rotated, correcting and using the 2 dimensional region after adjustment as the phase Circle of good definition is hoped, can be obtained and correspond to the picture of each object in scene in preview image and it is expected clearly described The two-dimensional coordinate { x_i, y_i } of one group of picture point of the part in area, afterwards, it is expected clearly with reference to described The space distribution information (as shown in Figure 3) of each several part in clear area and scene, such as according in scene The Depth profile information of each several part, it may be determined that one group of depth coordinate corresponding with this group of picture point { z_i }, according to the first space distribution information, (first space distribution information includes two dimension and sat Mark group { x_i, y_i } and depth coordinate group { z_i }, are represented by one group { x_i, y_i, z_i }), It can determine that the expectation blur-free imaging area of space of the scene;For another example the selection information can Including selecting object information, user can be touched on preview image display screen by finger selects certain right As according to the space distribution information of the object in the scene, determining that the expectation of the scene is clear Imaging space region.
The embodiment of the present application provide technical scheme in, optionally, it is described it is adjusted after it is described Before light-field camera carries out IMAQ to the scene, in addition to:Determine that the expectation is clear The depth capacity sub-district of imaging space region overlay;Focusing adjustment is carried out to the light-field camera, So that the focusing plane after the light-field camera adjustment is located in the depth capacity sub-district.
The depth of field (Depth of Field, abbreviation DoF) typically refers to pick-up lens to captured Scene is capable of the object distance range of blur-free imaging, that is to say, that in the depth direction with respect to camera lens Certain depth scope before and after the focusing object plane of head can blur-free imaging.When light-field camera aperture is adjusted After the operations such as whole, focusing are completed, the field depth of the light-field camera generally also determines therewith, The field depth is with respect to certain object distance range of light-field camera main lens on depth direction.Pass through Optically detecting of light-field camera, the disperse of the part imaging in scene in field depth Circle size is smaller, generally can blur-free imaging, and the part imaging in scene outside the field depth Blur circle size it is larger, imaging is typically more fuzzy.The program is clear by determining the expectation The depth capacity sub-district of clear imaging space region overlay, that is, obtain and be located at institute in the scene State and it is expected each several part depth capacity in the depth direction in blur-free imaging area of space and most Small depth, the depth bounds between depth capacity and minimum-depth are the depth capacity sub-district, The focusing position of the light-field camera can be adjusted to certain in the depth capacity sub-district One position, before the center or center as described in being adjusted in depth capacity sub-district A certain depth location etc. so that the field depth of the light-field camera is in the depth capacity It has been distributed in sub-district, has improved in the expectation blur-free imaging area of space and be located at the depth of field model The image quality of part in enclosing.
Optionally, any first imaging unit is relatively described at least one first imaging unit It is corresponding first with the unit of the described first imaging after the planar tilt parallel with main lens The average blur circle being imaged on first imaging unit is divided to allow disperse less than or equal to one Circle.If blur circle allows blur circle (permissible circle of less than or equal to a certain Confusion), it can be considered that the object focus is imaged;Accordingly, if blur circle is more than the appearance Perhaps blur circle, it can be considered object imaging out of focus.The size for allowing blur circle and object distance, The factors such as enlargement ratio are relevant, can predefine and allow blur circle size, such as described allow more It is 1/30mm etc. to dissipate circle size.The program is empty equivalent in the influence expectation blur-free imaging Between at least (including first imaging is single for the respective element of Part I IMAQ in region Member, or, first imaging unit and first sub-lens) during inclination control, Average disperse after the respective element for influenceing the corresponding Part I IMAQ is tilted Circle allows blur circle less than or equal to one, the convergence bar as the respective element inclination control Part, that is to say, that during respective element inclination control, if influenceing corresponding described the The respective element of a part of IMAQ is located at certain heeling condition and to should be under heeling condition Average blur circle allows blur circle described in being less than or equal to, then can complete to influence the respective element Inclination control, so, it is adjusted after light-field camera obtain the IMAQ of scene to be taken the photograph can Obtain the corresponding higher image quality of the Part I, so obtain the expectation clearly into The overall higher image quality of image space regions, realizes in scene to be taken the photograph and it is expected blur-free imaging The customization IMAQ of area of space.
, can be by least tilting at least one the first one-tenth in the technical scheme that the embodiment of the present application provides As the mode of unit, to change in the scene positioned at the expectation blur-free imaging area of space The average blur circle that an at least Part I is imaged on corresponding imaging unit, thus described in change The quality of at least Part I imaging.
(1) a kind of optional implementation, can be single by least one first imaging described in inclination The mode of member, it is expected blur-free imaging area of space at least positioned at described to change in the scene A part, that is to say, that the relative plane parallel with the main lens of light-field camera is to a while Oblique at least one first imaging unit, to be reduced at least a Part I at described at least one the first one-tenth As the average blur circle being imaged on unit, including:The relative plane parallel with the main lens is inclined Tiltedly at least one first imaging unit, with an at least Part I described in reducing it is described at least The average blur circle being imaged on one first imaging unit.To at least one first imaging unit Each first imaging unit can carry out same or similar inclination control, clear to improve the expectation At least one of overall image quality in clear imaging space region.
It might as well enter by taking any first imaging unit at least one first imaging unit as an example Row explanation.Physical record has each pixel of Part I image information in first imaging unit The average of blur circle, it can be considered average disperse of the corresponding Part I in first imaging unit Round size.Before and after the inclination of the first imaging unit, first imaging unit participates in corresponding The pixel and/or pixel quantity of Part I actual image acquisition may be identical or different. Before can first imaging unit be tilted, physical record has described in first imaging unit The average of the blur circle of each pixel of Part I image information, it is single as the described first imaging The size for the average blur circle that same section is imaged before member tilts;First imaging unit is inclined Physical record has each pixel of the Part I image information in the first module after tiltedly Blur circle average, same section is imaged flat after being tilted as first imaging unit The size of equal blur circle.
From the point of view of the imaging formula of blur circle, the embodiment of the present application can be by tilting described first The mode of imaging unit come change first imaging unit and with first imaging unit pair The distance between the sub-lens (i.e. described first sub-lens) answered v, and then cause corresponding disperse Round change, meanwhile, the average blur circle after first imaging unit is tilted is less than described Average blur circle before the inclination of first imaging unit, as the first imaging unit inclination control The condition of convergence so that the relatively described plane parallel with main lens of first imaging unit is adopted After tilting by some way, the average blur circle that can reach corresponding Part I imaging is relative The average blur circle of corresponding Part I has reduced before the first imaging unit inclination.Can To understand, the plane at place, as imaging unit array before first imaging unit tilts Plane where before tilting, parallel with the plane where the main lens, first imaging is single The plane at place or first imaging unit before relatively described first imaging unit of member tilts With respect to the planar tilt at place before imaging unit array tilt, equivalent to first imaging unit The relatively described planar tilt parallel with main lens.
It can be seen that the embodiment of the present application can determine that the expectation blur-free imaging area of space of scene, pass through Tilt for carrying out at least the one first of IMAQ to the expectation blur-free imaging area of space The mode of imaging unit so that positioned at the expectation blur-free imaging area of space in the scene An at least Part I is in the corresponding average blur circle being at least imaged on one first imaging unit Size reduced, thus improve described in an at least Part I image quality.In addition, During the technical scheme provided using the embodiment of the present application carries out the optically detecting of scene image, by It can be determined in the expectation blur-free imaging area of space of the scene according to being actually needed, and by inclining The mode of oblique corresponding at least one first imaging unit of light-field camera can be improved to described at least one Part I carry out optically detecting image quality, therefore, be advantageously implemented in scene need compared with The customization IMAQ of the expectation blur-free imaging area of space of high imaging quality, can more preferably meet The demand such as diversified IMAQ application and the rear interactive application based on optically detecting information.
In the technical scheme that the embodiment of the present application provides, can accordingly be averaged blur circle according to reduction The condition of convergence of (be even less than or equal to allow blur circle) is relative to first imaging unit The plane parallel with main lens carries out inclination control, and implementation is very flexible.
Optionally, in the parallel planar tilt of relatively described main lens at least one first imaging unit Any first imaging unit, existed with reducing corresponding with first imaging unit Part I The average blur circle being imaged on first imaging unit, including:According to Jiao of the first sub-lens Away from, fitting face and the plane parallel with main lens between angle and first sub-lens Photocentre to the distance in the fitting face, determine the expectation inclination angle of first imaging unit Degree, wherein, first sub-lens in the lenslet arrays of the light-field camera with described the Sub-lens corresponding to one imaging unit;It is relatively described and main according at least to the expectation angle of inclination First imaging unit described in the parallel planar tilt of lens, to reduce the corresponding Part I The average blur circle being imaged on first imaging unit.
Wherein, the fitting face is an at least Part I described in basis through the light-field camera Formed by main lens it is each as second space distributed intelligence fitting obtained by plane, pass through the plane To react the spatial distribution of each picture point of at least Part I through main lens imaging Main or important distribution trend.The fitting face can be tilted in the imaging surface relatively described in extremely Determined before few one first sub-lens, and the determination mode in the fitting face is very flexible, for example, The first space distribution information that can be according to an at least Part I in the scene, it is determined that Second of each picture formed by the main lens of at least Part I through the light-field camera is empty Between distributed intelligence;The fitting face is determined according to the second space distributed intelligence.Optionally, It is at least one of in the expectation blur-free imaging area of space according to being located in the scene Each object point coordinate { x_i, y_i, z_i }, can obtain described at least a portion through formed by main lens { x_i', y_i', z_i'} (i.e. second space distributed intelligence), can basis for each picpointed coordinate of picture Principal component analysis (Principal Component Analysis, abbreviation PCA) algorithm model can It is determined that the minimum bounding box (minimal bounding box) of these picture points is surrounded, such as Fig. 4 a Shown in Fig. 8 a, afterwards further according to random sampling uniformity (Random Sample Consensus, abbreviation RANSAC) algorithm model determine it is a certain in the minimum bounding box Plane so that each picture point in the minimum bounding box arrive respectively the plane apart from sum most Small, so obtained plane is the fitting face.Fitting face, scheme are determined using the program It is simple easily to realize.
In light-field camera, any first imaging unit at least one first imaging unit inclines After tiltedly, the plane where plane and first sub-lens where first imaging unit is not It is parallel again.With reference to husky nurse law (Scheimpflug principle), when prolonging for the fitting face The extension of plane where long face, first sub-lens corresponding with first imaging unit Face, the elongated surfaces of plane, three mutually give always where first imaging unit after inclination During line, as shown in figure 5, the Part I corresponding with first imaging unit can obtain The region of blur-free imaging is maximum.Meeting the angle of inclination of the first imaging unit of above-mentioned law can be The expectation angle of inclination of first imaging unit described in the embodiment of the present application.
Optionally, as shown in fig. 6, the expectation angle of inclination of first imaging unit can use Following formula calculates:
In above formula:θ represents the expectation angle of inclination of first imaging unit;F represents first The focal length of sub-lens,Represent the fitting face with the plane parallel with main lens (such as institute State the plane where lenslet arrays) between angle, u represent the light of first sub-lens Direction of the heart along the plane parallel with main lens to the fitting face distance, this away from From i.e. described first sub-lens photocentre to fitting face object distance, wherein, first sub-lens For sub-lens corresponding with first imaging unit in the lenslet arrays of the light-field camera. The relatively described plane parallel with main lens in expectation angle of inclination determined according at least to the program Tilt first imaging unit so that first imaging unit is relatively described to put down with main lens The angle of inclination of capable plane, as close possible to even equal to described expectation angle of inclination, and When carrying out IMAQ in the state of after first imaging unit is in and tilted, corresponding the A part is as small as possible in the average blur circle of first imaging unit imaging.The program improves The efficiency of first imaging unit inclination control.
According to husky nurse law, the relative plane parallel with main lens is (flat where such as lenslet arrays Place plane before face or the first imaging unit tilt) should along the centroclinal of the first imaging unit First imaging unit, allow its elongated surfaces and the first corresponding sub-lens, be fitted the extension in face Face meets at straight line, and fitting face can reach utmost sharpness;In scene corresponding to this programme, Although the angle between multiple first sub-lens being vertically distributed and fitting face is identical, It is the different vertical coordinate position of photocentre so that the multiple respective photocentre of first sub-lens arrives The object distance in fitting face is different, cause corresponding to the first different sub-lens difference first into Make fitting face clear as unit is respectively necessary for tilting different angles, each first imaging unit needs Relative position between the center and Sha Mu intersections of inclined angular dimension and each first imaging unit There is relation, specifically, the centre distance sand nurse intersection of the first imaging unit is more remote, it is necessary to incline Rake angle is smaller, otherwise bigger.
It is further alternative, as shown in figures 4 a and 4b, in actual application, with plan The elongated surfaces of plane (plane parallel with the main lens) are handed over where conjunction face and lenslet arrays The first different imaging unit of the distance of line, will meet inclined angle needed for above-mentioned husky nurse law Different, the elongated surfaces intersection of plane is nearer where such as distance fitting face and lenslet arrays First imaging unit A'(, first sub-lens As corresponding with the first imaging unit A' photocentre arrives The object distance u in fitting faceaIt is smaller) inclined angle, θ1, more than distance fitting face and lenslet arrays The the first imaging unit B'(and the first imaging unit B' of the elongated surfaces intersection of place plane farther out Object distance u of the corresponding first sub-lens B photocentre to fitting facebIt is larger) inclined angle, θ2, Therefore, it is further alternative, relative to the first one-tenth described in the planar tilt parallel with the main lens Before picture unit, in addition to:By the expectation angle of inclination and an imaging unit tilt adjustment angle Degree threshold value is compared;Exceed the imaging unit in response to the expectation angle of inclination and tilt tune Angle threshold is saved, adjusts the focusing position of the remote light-field camera.In optical camera, imaging unit Tilt adjustment can be limited by machinery, dot structure etc. so that the inclination of imaging unit is deposited In certain energy power restriction, according to imaging unit inclined ability can be allowed to determine that imaging unit inclines Slop regulation section angle threshold, by the expectation angle of inclination and the imaging unit tilt adjustment angle threshold Value is compared, if the expectation angle of inclination is more than the imaging unit tilt adjustment angle threshold Value, then the focusing position of optical camera can be adjusted to the object distance for far increasing main lens, according to thin The imaging formula of lens, main lens object distance increase, and can reduce the image distance of main lens, due to main saturating The distance between mirror and sub-lens are certain, are also equivalent to add the object distance of sub-lens, i.e., and one Determine in degree equivalent to the distance between the fitting face of adding and the first sub-lens so that fitting face The intersection of corresponding first imaging unit is apart from first imaging unit with first sub-lens Distance increased, so, the first imaging unit tilt after a less angle where it is flat Face is intersected with the intersection and may intersected, the image based on the light-field camera collection scene after regulation Then be advantageous to improve the image quality of corresponding Part I.
Optionally, in the parallel planar tilt of relatively described main lens at least one first imaging unit Any first imaging unit, existed with reducing corresponding with first imaging unit Part I The average blur circle being imaged on first imaging unit, including:Determine that first imaging is single The relative plane parallel with main lens of member allows angular range;Allow angle according at least to described First imaging unit described in the relatively described planar tilt parallel with main lens of scope, to reduce phase The average blur circle that the Part I answered is imaged on first imaging unit.Using this First imaging unit described in the relatively described planar tilt parallel with main lens of scheme, after inclination Angle where first imaging unit between plane and the plane parallel with main lens Allow angular range described in falling into.Wherein, it is described to allow angular range to be inclined according to imaging unit It can bring after tiltedly and flexibly be determined under the requirement that blur circle reduces corresponding averagely, the embodiment of the present application This is not intended to limit.The program improves the efficiency of the first imaging unit inclination control.
It is described to allow angular range to bring phase after being tilted according to first imaging unit The blur circle that should be averaged reduce requirement under predefine, it is determined that method may include but be not limited to adopt Determined with modes such as laboratory facilities, analog simulation, the derivations of equation.Optionally, described is determined One imaging unit allows angular range with respect to the plane parallel with main lens, including:According to The focal length of one sub-lens, the angle being fitted between face and the plane parallel with main lens, Yi Jisuo Direction of the photocentre of the first sub-lens along the vertical plane parallel with main lens is stated described in The distance in fitting face, the expectation angle of inclination of first imaging unit is determined, wherein, it is described First sub-lens for the light-field camera lenslet arrays in first imaging unit pair The sub-lens answered, the fitting face are an at least Part I described in basis through the light-field camera Main lens formed by it is each as second space distributed intelligence fitting obtained by plane;According at least to Allow angular range described in determining in the expectation angle of inclination.The determination for it is expected angle of inclination Method refers to record above, after the expectation angle of inclination is determined, can combine and examine Consider the first imaging unit tilt adjustment precision limitation, the Part I image quality is wanted The factor such as seek, it would be desirable to which angular range of the angle of inclination in certain range of allowable error is as institute State and allow angular range.Allow angular range relatively reasonable using described in program determination, base Allow angular range progress first imaging unit relatively described parallel with main lens in this The inclination control of plane, efficiency high and is easier to realize.
Optionally, in the parallel planar tilt of relatively described main lens at least one first imaging unit Any first imaging unit, existed with reducing corresponding with first imaging unit Part I The average blur circle being imaged on first imaging unit, including:It is relative parallel with main lens Side of the plane along the angle between the plane where increase fitting face and first imaging unit To inclination first imaging unit, to reduce the corresponding Part I described first The average blur circle being imaged on imaging unit, wherein, the fitting face is at least one according to The second space distributed intelligence of each picture formed by main lens of the Part I through the light-field camera Plane obtained by fitting.As shown in fig. 7, the first imaging unit tilts the plane at preceding place, and The Part I corresponding with first imaging unit through light-field camera main lens institute into The face as where between angle be A1, described first can be made along the direction for increasing the angle The relative plane parallel with main lens of imaging unit such as first imaging unit (where before tilting Plane) tilt, the first imaging unit tilt after where plane, with corresponding described first The angle between face where main lens imaging of the part through light-field camera is A2, A2Greatly In A1, it is seen then that plane where it after first imaging unit tilts towards the direction, intend Plane three's where conjunction face and the first sub-lens corresponding with first imaging unit Extension is exempted from intersecting collinear probability and significantly increased, and thus can reduce corresponding described first Part is in the average blur circle of the first imaging unit imaging, raising acquired image In the corresponding Part I image quality.Further, if by the incline direction and Then may be used collectively as the foundation of the first imaging unit inclination control at the expectation angle of inclination Further improve the efficiency of the first imaging unit inclination control;Or if this is tilted Direction and it is described allow angular range collectively as the first imaging unit inclination control according to According to then can further improve the efficiency of the first imaging unit inclination control.
(2) another optional implementation, a kind of optional implementation can be by inclining Tiltedly at least one first imaging unit and corresponding extremely with least one first imaging unit The mode of few one first sub-lens, it is empty positioned at the expectation blur-free imaging in the scene to change Between region at least a portion, that is to say, that it is described relative parallel with the main lens of light-field camera Plane at least tilt at least one first imaging unit, to be reduced at least a Part I described The average blur circle being at least imaged on one first imaging unit, including:It is relative parallel with main lens Planar tilt described at least one first imaging unit and at least one first sub-lens, to reduce An at least Part I is stated in the average blur circle being at least imaged on one first imaging unit, Wherein, at least first sub-lens for the light-field camera lenslet arrays in it is described extremely Sub-lens corresponding to few one first imaging unit.
Might as well with any first imaging unit described in tilting at least one first imaging unit with And illustrated exemplified by the first sub-lens corresponding with first imaging unit.First imaging Physical record has Part I image information corresponding with first imaging unit in unit The average of the blur circle of each pixel, it can be considered the corresponding Part I described the first one-tenth As the size of the average blur circle of unit.It is imaged in first imaging unit and with described first Before and after first sub-lens tilt corresponding to unit, first imaging unit participates in corresponding The pixel and/or pixel quantity of the Part I actual image acquisition may be identical or not Together.Before first imaging unit and corresponding first sub-lens being tilted, described the Physical record has each pixel of the corresponding Part I image information in one imaging unit Blur circle average, incline as first imaging unit and corresponding first sub-lens The size of the average blur circle of same section imaging before tiltedly;By first imaging unit and accordingly First sub-lens tilt after, physical record has corresponding institute in first imaging unit The average of the blur circle of each pixel of Part I image information is stated, as the described first imaging The average blur circle that same section is imaged after unit and corresponding first sub-lens tilt Size.
Each sub-lens can be considered a thin lens, the light of thin lens in the lenslet arrays of light-field camera It is as follows to learn imaging formula:
In above formula:U represents the object distance of sub-lens, that is, main lens of the part through light-field camera to be taken the photograph Imaging and the distance of the sub-lens;V represents the image distance of sub-lens;F represents sub-lens Focal length.
Understand that the embodiment of the present application can be by tilting described first with reference to formula (1) and (3) The mode of sub-lens changes the object distance u of first sub-lens to cause the first sub-lens Image distance vnGeneration respective change, and/or, by tilting first sub-lens and/or described The mode of one imaging unit changes distance v therebetween, and then causes corresponding blur circle Change, meanwhile, being averaged more after first imaging unit and first sub-lens are tilted The average blur circle before circle tilts less than first imaging unit and first sub-lens is dissipated, The condition of convergence as first imaging unit and the first sub-lens inclination control so that First imaging unit and the relatively described plane parallel with main lens of first sub-lens Adopt after tilting by some way, can reach accordingly relatively described first imaging of averagely blur circle Corresponding average blur circle has reduced before unit and first sub-lens inclination.
It can be seen that the embodiment of the present application can determine that the expectation blur-free imaging area of space of scene, pass through Tilt for carrying out at least the one first of IMAQ to the expectation blur-free imaging area of space The side of imaging unit and at least one first sub-lens corresponding with an at least imaging unit Formula so that positioned at least one first of the expectation blur-free imaging area of space in the scene The size in the corresponding average blur circle being at least imaged on one first imaging unit is divided to subtract It is small, thus improve described in an at least Part I image quality.It is in addition, real using the application During the optically detecting of technical scheme progress scene image for applying example offer, due to the scene It is expected that blur-free imaging area of space can determine according to being actually needed, and by tilting light-field camera phase At least mode of one first imaging unit and at least one first sub-lens answered can be improved to described An at least Part I carries out the image quality of optically detecting, therefore, is advantageously implemented in scene The customization IMAQ of the expectation blur-free imaging area of space compared with high imaging quality is needed, can be more Meet diversified IMAQ application and the rear interactive application based on optically detecting information well Etc. demand.
In the technical scheme that the embodiment of the present application provides, can accordingly be averaged blur circle according to reduction The condition of convergence of (be even less than or equal to allow blur circle) is to any first imaging unit Corresponding first sub-lens carry out inclination control with first imaging unit, and implementation is very Flexibly.
Optionally, at least one first imaging unit described in the relative planar tilt parallel with main lens In in any first imaging unit and at least one first sub-lens with the described first imaging Corresponding first sub-lens of unit, to reduce with being imaged in an at least Part I with first The average blur circle that the corresponding Part I of unit is imaged on first imaging unit, bag Include:According to the focal length of corresponding first sub-lens, fitting face and described parallel with main lens Plane between angle, the photocentre of corresponding first sub-lens is along vertically saturating with the master The direction of the parallel plane of mirror is saturating to the distance in the fitting face and corresponding first son Direction of the photocentre of mirror along the vertical plane parallel with main lens is single to the described first imaging The distance of member, determine the first angle of inclination and corresponding described first of first imaging unit Second angle of inclination of sub-lens;Put down according to first angle of inclination is relatively described with main lens First imaging unit described in capable planar tilt and according to second angle of inclination with respect to institute The first sub-lens described in the planar tilt parallel with main lens are stated, to reduce corresponding described first The average blur circle that part is imaged on first imaging unit.
In light-field camera, first imaging unit and first sub-lens tilt it respectively Afterwards, the plane where first imaging unit may with the plane where first sub-lens It is no longer parallel.With reference to husky nurse law, when the extension in the fitting face exempts from, first sub-lens The extension of plane where after the elongated surfaces of plane, first imaging unit tilt where after inclination Face, when three mutually gives line always, the corresponding Part I can obtain the area of blur-free imaging Domain is maximum.The angle of inclination for meeting first imaging unit of above-mentioned law is the application reality The first angle of inclination described in example is applied, meets the inclination angle of first sub-lens of above-mentioned law Degree is the second angle of inclination described in the embodiment of the present application.
After first imaging unit and first sub-lens tilt, the Part I is through master Optional imaging optical path example such as Fig. 8 a and Fig. 8 b of the lens imaging through sub-lens re-imaging It is shown, relationship below can be obtained according to Fig. 8 b:
V=v1+v2......................................................................(6)
According to the angular relationship in light path shown in formula (4) to (9) and Fig. 8 b, can obtain:
Wherein:α represents the first inclination angle of first imaging unit;β represents described first Second inclination angle of sub-lens;F represents the focal length of the first sub-lens;Represent fitting face and with Between the parallel plane of main lens (plane where before being tilted such as first imaging unit) Angle;U represents the photocentre of corresponding first sub-lens through vertically parallel with the main lens Plane (such as the first sub-lens tilt before where plane, or, first imaging unit Tilt before where plane) direction to the fitting face distance;V represents corresponding described Along the vertical plane parallel with main lens, (such as the first sub-lens incline the photocentre of first sub-lens Plane where before tiltedly, or, first imaging unit tilt before where plane) side Front and rear center is tilted to the distance to first imaging unit, such as first sub-lens Keep constant, described first imaging unit to tilt front and rear center and keep constant, then described first The distance between the center of sub-lens and the center of first imaging unit, as corresponding institute Direction of the photocentre of the first sub-lens along the vertical plane parallel with main lens is stated described in The distance of first imaging unit.The program improves first imaging unit and first son The efficiency of the common inclination control of lens, and it is adjusted after light-field camera carry out IMAQ can obtain Obtain the imaging of the Part I better quality accordingly.
Any technical scheme provided with reference to the embodiment of the present application, optionally, at least tilts institute Before stating at least one first imaging unit, in addition to:At least determine in the imaging unit array Treat inclined at least one first imaging unit.Can be in the imaging of light-field camera using the program Determined in cell array for carrying out IMAQ to the expectation blur-free imaging area of space An at least imaging unit, as inclined at least one first imaging unit is treated, afterwards relatively The plane parallel with main lens at least tilts at least one first imaging unit so that institute At least Part I for it is expected blur-free imaging area of space is stated in corresponding first imaging The average blur circle being imaged on unit has reduced, and thus improves the imaging of corresponding Part I Quality.
It is further alternative, it is described at least determine to treat in the imaging unit array it is inclined described At least one first imaging unit, including:Determine pre- with the scene in the lenslet arrays Look at an at least sub-lens corresponding to the expectation circle of good definition of image, at least one first son thoroughly Mirror;The imaging unit of sub-lens and the imaging unit array in the lenslet arrays Between corresponding relation, it is determined that corresponding with least one first sub-lens described at least 1 the One imaging unit.A kind of optional implementation, in the light-field camera, as shown in figure 9, The focal length for each sub-lens that the lenslet arrays include is identical, the imaging unit array and institute The distance for stating lenslet arrays is equal to the focal length of the sub-lens;In the imaging unit of light-field camera It is in sub-lens in the state of not tilting, it is a certain to gather scene to be taken the photograph based on the light-field camera The spatial resolution and the son of the lenslet arrays of the image (such as the preview image) at visual angle Lens distribution is corresponding, and each sub-lens correspond to a certain imaging list in the imaging unit array Member, each imaging unit include the multiple pixels of array distribution, the son are recorded by the imaging unit Lens are to the light informations of the different directions from certain portion of the scene to be taken the photograph, that is, the light In the camera of field, the pixel distribution of the preview image and the sub-lens of the lenslet arrays are distributed Between corresponding relation, the sub-lens of the lenslet arrays and the imaging unit array be present In imaging unit corresponding relation be present, therefore, can according to the light-field camera obtain described in Part corresponding with the depth profile sub-district in the preview image of scene to be taken the photograph, it is determined that influenceing institute The first sub-lens of the first depth profile sub-district IMAQ are stated, further according to the lenslet arrays In sub-lens and the imaging unit array imaging unit between corresponding relation, it is determined that with First imaging unit corresponding to first sub-lens.It can determine that using the program and wait to tilt At least one first imaging unit and at least one first sub-lens, method it is simple easily real It is existing.
It will be understood by those skilled in the art that in any of the above-described side of the application embodiment In method, the sequence number size of each step is not meant to the priority of execution sequence, the execution of each step Order should be determined with its function and internal logic, without the reality of reply the application embodiment Apply process and form any restriction.
Figure 10 is the box for the first IMAQ control device that the embodiment of the present application provides Figure.As shown in Figure 10, the first IMAQ control device bag that the embodiment of the present application provides Include:One it is expected blur-free imaging area of space determining module 101, the and of a tilt control module 102 One IMAQ control module 103.It is expected that blur-free imaging area of space determining module 101 is used for Determine the expectation blur-free imaging area of space of scene;Tilt control module 102 is used for relative with light The plane that the main lens of field camera is parallel at least tilts at least one first imaging unit, to be decreased to A few Part I in the average blur circle being at least imaged on one first imaging unit, its In:At least one first imaging unit is to be used in the imaging unit array of the light-field camera An at least imaging unit for IMAQ is carried out to the expectation blur-free imaging area of space, it is described An at least Part I is it is expected blur-free imaging area of space extremely positioned at described in the scene A few part;IMAQ control module 103 be used for it is adjusted after the light-field camera to institute State scene and carry out IMAQ.
The IMAQ control device that the embodiment of the present application provides is carrying out field based on light-field camera In the IMAQ application process of scape, it may be determined that the expectation blur-free imaging area of space of scene, lead to Cross and at least tilt for carrying out IMAQ at least to the expectation blur-free imaging area of space The mode of one first imaging unit so that positioned at the expectation blur-free imaging space in the scene An at least Part I in region it is corresponding be at least imaged on one first imaging unit be averaged The size of blur circle has reduced, thus the image quality of an at least Part I described in improvement. In addition, the technical scheme provided using the embodiment of the present application carries out the optically detecting phase of scene image Between, because the expectation blur-free imaging area of space of the scene can determine according to being actually needed, and It can be improved by way of at least tilting corresponding at least one first imaging unit of light-field camera pair An at least Part I carries out the image quality of optically detecting, therefore, is advantageously implemented field The customization IMAQ of the expectation blur-free imaging area of space compared with high imaging quality is needed in scape, Diversified IMAQ application and the rear interaction based on optically detecting information can more preferably be met Using etc. demand.
The equipment form of expression of described image acquisition control device is unrestricted, such as described image Acquisition control device can be a certain independent part;Or described image acquisition control device can It is integrated in as a certain functional module in an imaging device, the imaging device may include but unlimited In light-field camera or include the mobile phone of light-field camera, tablet personal computer etc., the embodiment of the present application pair This is not intended to limit.
Optionally, as shown in figure 11, the expectation blur-free imaging area of space determining module 101 Including:One it is expected that circle of good definition determination sub-module 1011, one first space distribution information determine son Module 1012 and one it is expected blur-free imaging area of space determination sub-module 1013.It is expected circle of good definition Determination sub-module 1011 is used for the preview image for determining the scene that the light-field camera obtains Part for it is expected circle of good definition;First space distribution information determination sub-module 1012 is used to determine First space distribution information of the Part I in the scene corresponding to the expectation circle of good definition; It is expected that blur-free imaging area of space determination sub-module 1013 is used for according to first spatial distribution Information determines the expectation blur-free imaging area of space.Preview graph of the program based on the scene Expectation blur-free imaging area of space as selecting the scene, scheme are simply easily realized.
Further alternative, the expectation circle of good definition determination sub-module 1011 includes:One selection Information acquisition unit 10111 and one it is expected circle of good definition determining unit 10112.Select acquisition of information Unit 10111 is used to obtain the selection information to the preview image;It is single it is expected that circle of good definition determines Member 10112 is used for the corresponding topical that the preview image is determined according at least to the selection information For the expectation circle of good definition.The program can improve the expectation of the expectation circle of good definition or the scene The interaction convenience and flexibility that blur-free imaging area of space determines, improve Consumer's Experience.It is described The preview image of light-field camera is the two dimensional image at a certain visual angle of the scene;To the preview graph The selection information of picture may include but be not limited to:Choice direction information, or, selection region information, Or selecting object information etc., to provide abundant interactive mode, improve the side that user uses Just property.
Optionally, any first imaging unit is relatively described at least one first imaging unit It is corresponding first with the unit of the described first imaging after the planar tilt parallel with main lens The average blur circle being imaged on first imaging unit is divided to allow disperse less than or equal to one Circle.
Optionally, described image acquisition control device also includes:One depth capacity sub-district determines mould The focusing adjusting module 105 of block 104 and 1 first.Depth capacity sub-district determining module 104 is used for Determine the depth capacity sub-district of the expectation blur-free imaging area of space covering;First focusing adjustment Module 105 is used to carry out focusing adjustment to the light-field camera, so that the light-field camera adjusts Focusing plane afterwards is located in the depth capacity sub-district.The program is by by the light-field camera Focusing position is adjusted to a certain position in the depth capacity sub-district so that the light field The field depth of camera has been distributed in the depth capacity sub-district, and it is clear to improve the expectation The image quality of part in imaging region in the field depth.
Optionally, as shown in figure 12, the tilt control module 102 includes:One first inclines Oblique control submodule 1021.First inclination control submodule 1021 is used for relative saturating with the master At least one first imaging unit described in the parallel planar tilt of mirror, with least one first described in reduction Part is in the average blur circle being at least imaged on one first imaging unit.The program can determine that The expectation blur-free imaging area of space of scene, it is used for by tilting to the expectation blur-free imaging sky Between region carry out IMAQ at least one first imaging unit mode so that in the scene An at least Part I positioned at the expectation blur-free imaging area of space is corresponding at least one The size for the average blur circle being imaged on first imaging unit has reduced, thus described in improvement extremely The image quality of a few Part I.In addition, the technical scheme provided using the embodiment of the present application During the optically detecting for carrying out scene image, due to the expectation blur-free imaging space region of the scene Domain can determine according to being actually needed, and is imaged by tilting light-field camera corresponding at least one first The mode of unit can improve the image quality that optically detecting is carried out to an at least Part I, Therefore, it is advantageously implemented the expectation blur-free imaging area of space needed in scene compared with high imaging quality Customization IMAQ, can more preferably meet the application of diversified IMAQ and based on optics Gather the demands such as the rear interactive application of information.
Optionally, the first inclination control submodule 1021 includes:One it is expected angle of inclination The tilt control unit 10212 of determining unit 10211 and 1 first.It is single it is expected that angle of inclination determines Member 10211 is used for according to the focal lengths of any first sub-lens, fitting face and parallel with main lens The photocentre of angle and first sub-lens between plane is put down along vertically described with main lens The direction of capable plane determines any first imaging unit to the distance in the fitting face It is expected angle of inclination, wherein, first sub-lens are the lenslet arrays of the light-field camera In sub-lens corresponding with first imaging unit, the fitting face be according to described at least one The second space distributed intelligence of each picture formed by main lens of the Part I through the light-field camera Plane obtained by fitting;First tilt control unit 10212 is used to incline according at least to the expectation First imaging unit described in the relatively described planar tilt parallel with main lens of rake angle, to reduce The average blur circle that the corresponding Part I is imaged on first imaging unit.At least The relatively described planar tilt parallel with main lens in expectation angle of inclination determined according to the program First imaging unit so that first imaging unit is relatively described parallel with main lens The angle of inclination of plane, as close possible to even equal to described expectation angle of inclination, and in institute When carrying out IMAQ in the state of stating the first imaging unit after tilting, corresponding first Divide the average blur circle in first imaging unit imaging as small as possible.The program improves The efficiency of one imaging unit inclination control.
Optionally, described image acquisition control device also includes:The He of one angle changing rate module 106 One second focusing adjusting module 107.Angle changing rate module 106 is used for the expectation inclination angle Degree is compared with an imaging unit tilt adjustment angle threshold;Second focusing adjusting module 107 For exceeding the imaging unit tilt adjustment angle threshold in response to the expectation angle of inclination, Adjust the focusing position of the remote light-field camera.The program is adjusted equivalent to by focusing to a certain extent It is whole to add the distance between fitting face and the first sub-lens so that fitting face and with this first son The intersection of the first imaging unit has increased apart from the distance of first imaging unit corresponding to lens Add, so, the first imaging unit tilts the plane and the intersection phase at place after a less angle Handing over may intersect, and the image based on the light-field camera collection scene after regulation is then advantageous to improve The image quality of corresponding Part I.
Optionally, the first inclination control submodule 1021 includes:One allows angular range The scope tilt control unit 10214 of determining unit 10213 and one.Angular range is allowed to determine single Member 10213 is used to determine any first imaging unit with respect to the plane parallel with main lens Allow angular range;Scope tilt control unit 10214 is used to allow to press from both sides according at least to described First imaging unit described in the relatively described planar tilt parallel with main lens of angular region, to reduce The average blur circle that the corresponding Part I is imaged on first imaging unit.Its In, it is described to allow angular range to bring accordingly averagely disperse after being tilted according to imaging unit Flexibly determined under the requirement that circle reduces, the embodiment of the present application is not intended to limit to this.The program improves The efficiency of first imaging unit inclination control.
It is further alternative, it is described to allow angular range determining unit 10213 to include:One it is expected Angle of inclination determination subelement 102131 and one allows angular range determining unit 102312.Phase Angle of inclination determination subelement 102131 is hoped to be used for the focal length according to any first sub-lens, intend The photocentre of angle and first sub-lens between conjunction face and the plane parallel with main lens Along the direction of the vertical plane parallel with main lens to the distance in the fitting face, it is determined that appointing The expectation angle of inclination of one first imaging unit, wherein, first sub-lens are described Sub-lens corresponding with first imaging unit, the plan in the lenslet arrays of light-field camera Conjunction face is each formed by main lens of at least Part I through the light-field camera according to As second space distributed intelligence fitting obtained by plane;Allow angular range determining unit 102312 are used to allow angular range according at least to described in the determination of the expectation angle of inclination.Adopt Allow angular range relatively reasonable described in program determination, allow angular range to enter based on this The inclination control of the row relatively described plane parallel with main lens of the first imaging unit, efficiency It is high and be easier to realize.
Optionally, the first inclination control submodule 1021 includes:One direction inclination control Unit 1025.Direction tilt control unit 1025 is used for the relative plane edge parallel with main lens The direction of the angle between plane where increase fitting face and first imaging unit, is tilted First imaging unit, to reduce the corresponding Part I in first imaging unit The average blur circle of upper imaging, wherein, the fitting face is an at least Part I according to The second space distributed intelligence of each picture formed by main lens through the light-field camera is fitted and obtained Plane.It is flat where it after the direction that first imaging unit is determined towards the program tilts Plane where face, fitting face and the first sub-lens corresponding with first imaging unit The extension of three is exempted from intersecting collinear probability and significantly increased, and thus can reduce corresponding institute Average blur circle of the Part I in the first imaging unit imaging is stated, raising is gathered Image in the corresponding Part I image quality.
Further, if by the incline direction and the expectation angle of inclination collectively as described The foundation of first imaging unit inclination control, then it can further improve first imaging unit and incline The efficiency tiltedly controlled;Or if by the incline direction and described angular range is allowed to make jointly For the foundation of the first imaging unit inclination control, then first imaging is can further improve The efficiency of unit inclination control.
Optionally, the tilt control module 102 includes:One second inclination control submodule 1022.Second inclination control submodule 1022 is used for the relative planar tilt parallel with main lens At least one first imaging unit and at least one first sub-lens, with described in reducing at least 1 the A part in the average blur circle being at least imaged on one first imaging unit, wherein, it is described At least the first sub-lens in the lenslet arrays of the light-field camera with described at least one first Sub-lens corresponding to imaging unit.The program can determine that the expectation blur-free imaging space region of scene Domain, it is used to carry out IMAQ at least to the expectation blur-free imaging area of space by tilting One first imaging unit and at least one first son corresponding with an at least imaging unit are thoroughly The mode of mirror so that positioned at least the one of the expectation blur-free imaging area of space in the scene Size of the Part I in the corresponding average blur circle being at least imaged on one first imaging unit It has been reduced that, thus the image quality of an at least Part I described in improvement.In addition, using this During the optically detecting for applying for the technical scheme progress scene image that embodiment provides, due to described The expectation blur-free imaging area of space of scene can determine according to being actually needed, and by tilting light field The corresponding at least mode of one first imaging unit and at least one first sub-lens of camera can improve The image quality of optically detecting is carried out to an at least Part I, therefore, is advantageously implemented The customization image of the expectation blur-free imaging area of space compared with high imaging quality is needed to adopt in scene Collection, it can more preferably meet diversified IMAQ application and the rear friendship based on optically detecting information The mutually demand such as application.
Further alternative, the second inclination control submodule 1022 includes:One inclination angle Spend the tilt control unit 10222 of determining unit 10221 and 1 second.One angle of inclination determines single First 10221 for the focal length according to corresponding first sub-lens, fitting face and described and master Angle between the parallel plane of lens, corresponding first sub-lens photocentre along vertically with The direction of the parallel plane of the main lens is to the distance in the fitting face and corresponding described The direction of the photocentres of first sub-lens along the vertical plane parallel with main lens is to described the The distance of one imaging unit, determine the first angle of inclination of first imaging unit and corresponding Second angle of inclination of first sub-lens;One second tilt control unit 10222 is used for root According to first angle of inclination relative to the first one-tenth described in the planar tilt parallel with main lens Incline as unit and according to the relatively described plane parallel with main lens in second angle of inclination Oblique first sub-lens, to reduce the corresponding Part I in first imaging unit The average blur circle of upper imaging.The program improves first imaging unit and first son The efficiency of the common inclination control of lens, and it is adjusted after light-field camera carry out IMAQ can obtain Obtain the imaging of the Part I better quality accordingly.
Optionally, described image acquisition control device also includes:One second space distributed intelligence is true Cover half block 108 and one is fitted face determining module 109.Second space distributed intelligence determining module 108 For according to described in first space distribution information of at least Part I in the scene, really The second of each picture formed by the fixed main lens of at least Part I through the light-field camera Space distribution information;Fitting face determining module 109 is used for according to the second space distributed intelligence Determine the fitting face.Optionally, it is described it is each as arrive respectively the fitting face apart from sum most It is small.Fitting face is determined using the program, scheme is simply easily realized.
Optionally, as shown in figure 11, described image acquisition control device also includes:One waits to incline Oblique element determining module 1010.Treat that inclined element determining module 1010 is used for described at least determination Inclined at least one first imaging unit is treated in imaging unit array.Such as described at least 1 the One imaging unit wait inclined element determination mode it is very flexible, the embodiment of the present application to this simultaneously Do not limit.
It is further alternative, it is described to treat that inclined element determining module 1010 includes:One first son The imaging unit determination sub-module 10102 of lens determination sub-module 10101 and 1 first.First son Lens determination sub-module 10101 is pre- with the scene in the lenslet arrays for determining Look at an at least sub-lens corresponding to the expectation circle of good definition of image, at least one first son thoroughly Mirror;First imaging unit determination sub-module 10102 is used for the son in the lenslet arrays Corresponding relation between the imaging unit of lens and the imaging unit array, it is determined that with it is described extremely At least one first imaging unit corresponding to few one first sub-lens.Institute is determined using the program State at least one first sub-lens and at least one first imaging unit, the method are simply easily realized.
Figure 13 is that the structure for the 4th kind of IMAQ control device that the embodiment of the present application provides is shown It is intended to, the not specific implementation to IMAQ control device 1300 of the application specific embodiment Mode limits.As shown in figure 13, IMAQ control device 1300 can include:
Processor (Processor) 1310, communication interface (Communications Interface) 1320th, memory (Memory) 1330 and communication bus 1340.Wherein:
Processor 1310, communication interface 1320 and memory 1330 pass through communication bus 1340 complete mutual communication.
Communication interface 1320, for being communicated with such as deformable imaging unit array etc..
Processor 1310, for configuration processor 1332, it can specifically perform any of the above-described method Correlation step in embodiment.
For example, program 1332 can include program code, described program code includes computer Operational order.
Processor 1310 is probably a central processing unit (Central Processing Unit, letter Claim CPU), or specific integrated circuit (Application Specific Integrated Circuit, Abbreviation ASIC), or it is arranged to implement the integrated electricity of one or more of the embodiment of the present application Road.
Memory 1330, for depositing program 1332.Memory 1330 may be included and deposited at random Access to memory (Random Access Memory, abbreviation RAM), it is also possible to also including non-easy The property lost memory (Non-volatile memory), for example, at least a magnetic disk storage.
For example, in a kind of optional implementation, processor 1310 passes through configuration processor 1332 Executable following steps:Determine the expectation blur-free imaging area of space of scene;It is relative with light field phase The plane that the main lens of machine is parallel at least tilts at least one first imaging unit, to be reduced at least one Part I in the average blur circle being at least imaged on one first imaging unit, wherein:Institute At least one first imaging unit is stated to be used in the imaging unit array of the light-field camera to institute State at least imaging unit for it is expected that blur-free imaging area of space carries out IMAQ, it is described at least One Part I is positioned at least the one of the expectation blur-free imaging area of space in the scene Part;The light-field camera after adjusted carries out IMAQ to the scene.
In other optional implementations, processor 1310 may be used also by configuration processor 1332 The step of other above-mentioned any embodiments refer to is performed, will not be repeated here.
The specific implementation of each step may refer to the corresponding step in above-described embodiment in program 1332 Suddenly, corresponding description in module, submodule, unit, will not be repeated here.Art Technical staff can be understood that, for convenience and simplicity of description, the equipment of foregoing description With the specific work process of module, the corresponding process that may be referred in preceding method embodiment is retouched State, will not be repeated here.
In the application the various embodiments described above, the sequence number and/or sequencing of embodiment are only just In description, the quality of embodiment is not represented.Description to each embodiment all emphasizes particularly on different fields, certain There is no the part being described in detail in individual embodiment, may refer to the associated description of other embodiment.It is relevant The associated description of device, the implementation principle of equipment or system embodiment or process, reference can be made to accordingly The record of embodiment of the method, will not be repeated here.
Those of ordinary skill in the art with reference to the embodiments described herein it is to be appreciated that retouch The unit and method and step for each example stated, can with electronic hardware or computer software and The combination of electronic hardware is realized.These functions are performed with hardware or software mode actually, Application-specific and design constraint depending on technical scheme.Professional and technical personnel can be to every It is individual specifically to apply to realize described function using distinct methods, but this realization is not It is considered as exceeding scope of the present application.
If the function is realized in the form of SFU software functional unit and is used as independent product pin Sell or in use, can be stored in a computer read/write memory medium.Based on such Understand, part that the technical scheme of the application substantially contributes to prior art in other words or The part of person's technical scheme can be embodied in the form of software product, the computer software Product is stored in a storage medium, including some instructions are causing a computer equipment (can be personal computer, server, or network equipment etc.) performs each reality of the application Apply all or part of step of a methods described.And foregoing storage medium includes:USB flash disk, shifting Dynamic hard disk, read-only storage (Read-Only Memory, abbreviation ROM), arbitrary access are deposited Reservoir (Random Access Memory, abbreviation RAM), magnetic disc or CD etc. are various can With the medium of store program codes.
In the embodiments such as the device of the application, method, system, it is clear that each part (system, Subsystem, module, submodule, unit, subelement etc.) or each step be can decompose, group Reconfigured after conjunction and/or decomposition.These, which decompose and/or reconfigured, should be regarded as the application's Equivalents.Meanwhile in the description to the application specific embodiment above, for a kind of real The feature that the mode of applying is described and/or shown can be in a manner of same or similar one or more Used in individual other embodiment, it is combined with the feature in other embodiment, or substitute it Feature in its embodiment.
It should be emphasized that term "comprises/comprising" refers to feature, key element, step when being used herein Rapid or component presence, but be not precluded from one or more further features, key element, step or The presence of component is additional.
Finally it should be noted that:Embodiment of above is merely to illustrate the application, and not to this The limitation of application, the those of ordinary skill about technical field, spirit herein is not being departed from In the case of scope, it can also make a variety of changes and modification, therefore all equivalent technologies Scheme falls within the category of the application, and the scope of patent protection of the application should be limited by claim It is fixed.

Claims (10)

  1. A kind of 1. IMAQ control method, it is characterised in that including:
    Determine the expectation blur-free imaging area of space of scene;
    The relative plane parallel with the main lens of light-field camera at least tilts at least one first imaging Unit, be reduced at least a Part I it is described be at least imaged on one first imaging unit it is flat Equal blur circle, wherein:At least one first imaging unit is the imaging list of the light-field camera It is used to carry out at least the one of IMAQ to the expectation blur-free imaging area of space in element array Imaging unit, an at least Part I are to be located at the expectation blur-free imaging in the scene At least a portion of area of space;
    The light-field camera after adjusted carries out IMAQ to the scene.
  2. 2. according to the method for claim 1, it is characterised in that the determination scene It is expected blur-free imaging area of space, including:
    Determine that the part of the preview image for the scene that the light-field camera obtains is clear it is expected Clear area;
    Determine first space of the Part I in the scene corresponding to the expectation circle of good definition Distributed intelligence;
    The expectation blur-free imaging area of space is determined according to first space distribution information.
  3. 3. according to the method for claim 2, it is characterised in that determine the light field phase The part of the preview image for the scene that machine obtains is expectation circle of good definition, including:
    Obtain the selection information to the preview image;
    Determine that the corresponding topical of the preview image is the phase according at least to the selection information Hope circle of good definition.
  4. 4. according to the method for claim 3, it is characterised in that the selection packet Include:Choice direction information, or, selection region information, or, selecting object information.
  5. 5. according to any described methods of claim 1-4, it is characterised in that it is described at least The relatively described plane parallel with main lens of any first imaging unit in one first imaging unit After inclination, Part I corresponding with the unit of the described first imaging is single in the described first imaging The average blur circle being imaged in member allows blur circle less than or equal to one.
  6. A kind of 6. IMAQ control device, it is characterised in that including:
    One it is expected blur-free imaging area of space determining module, for determine the expectation of scene clearly into Image space region;
    One tilt control module, for the relative plane parallel with the main lens of light-field camera at least At least one first imaging unit is tilted, to be reduced at least a Part I described at least one first The average blur circle being imaged on imaging unit, wherein:At least one first imaging unit is institute State and be used to enter the expectation blur-free imaging area of space in the imaging unit array of light-field camera An at least imaging unit for row IMAQ, an at least Part I are the scene middle position In at least a portion of the expectation blur-free imaging area of space;
    One IMAQ control module, for the light-field camera after adjusted to the scene Carry out IMAQ.
  7. 7. IMAQ control device according to claim 6, it is characterised in that institute State and it is expected that blur-free imaging area of space determining module includes:
    One it is expected circle of good definition determination sub-module, the field obtained for determining the light-field camera The part of the preview image of scape is expectation circle of good definition;
    One first space distribution information determination sub-module, for determining that the expectation circle of good definition is corresponding First space distribution information of the Part I in the scene;
    One it is expected blur-free imaging area of space determination sub-module, for according to first space point Cloth information determines the expectation blur-free imaging area of space.
  8. 8. IMAQ control device according to claim 7, it is characterised in that institute State and it is expected that circle of good definition determination sub-module includes:
    One selection information acquisition unit, for obtaining the selection information to the preview image;
    One it is expected circle of good definition determining unit, described pre- for being determined according at least to the selection information The corresponding topical of image look at is the expectation circle of good definition.
  9. 9. IMAQ control device according to claim 8, it is characterised in that institute Stating selection information includes:Choice direction information, or, selection region information, or, selection Object information.
  10. A kind of 10. IMAQ control device, it is characterised in that including:
    One processor, a communication interface, a memory and a communication bus;The processor, The communication interface and the memory complete mutual communication by the communication bus;
    The memory is used to deposit at least one instruction;It is described instruction make the computing device with Lower operation:
    Determine the expectation blur-free imaging area of space of scene;
    The relative plane parallel with the main lens of light-field camera at least tilts at least one first imaging Unit, be reduced at least a Part I it is described be at least imaged on one first imaging unit it is flat Equal blur circle, wherein:At least one first imaging unit is the imaging list of the light-field camera It is used to carry out at least the one of IMAQ to the expectation blur-free imaging area of space in element array Imaging unit, an at least Part I are to be located at the expectation blur-free imaging in the scene At least a portion of area of space;
    The light-field camera after adjusted carries out IMAQ to the scene.
CN201510546276.4A 2015-08-31 2015-08-31 Image acquisition control method and device Active CN107707807B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510546276.4A CN107707807B (en) 2015-08-31 2015-08-31 Image acquisition control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510546276.4A CN107707807B (en) 2015-08-31 2015-08-31 Image acquisition control method and device

Publications (2)

Publication Number Publication Date
CN107707807A true CN107707807A (en) 2018-02-16
CN107707807B CN107707807B (en) 2020-01-03

Family

ID=61168205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510546276.4A Active CN107707807B (en) 2015-08-31 2015-08-31 Image acquisition control method and device

Country Status (1)

Country Link
CN (1) CN107707807B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112311971A (en) * 2019-08-01 2021-02-02 浙江大华技术股份有限公司 Camera and monitoring system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003037767A (en) * 2001-07-24 2003-02-07 Minolta Co Ltd Digital camera
CN101971610A (en) * 2008-03-11 2011-02-09 佳能株式会社 Image capturing apparatus and image processing method
WO2014110484A2 (en) * 2013-01-11 2014-07-17 Digimarc Corporation Next generation imaging methods and systems
CN104486537A (en) * 2014-10-27 2015-04-01 北京智谷技术服务有限公司 Light field acquisition control method and device
CN104506762A (en) * 2014-12-25 2015-04-08 北京智谷睿拓技术服务有限公司 Optical field collecting control method and device and optical field collecting equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003037767A (en) * 2001-07-24 2003-02-07 Minolta Co Ltd Digital camera
CN101971610A (en) * 2008-03-11 2011-02-09 佳能株式会社 Image capturing apparatus and image processing method
WO2014110484A2 (en) * 2013-01-11 2014-07-17 Digimarc Corporation Next generation imaging methods and systems
CN104486537A (en) * 2014-10-27 2015-04-01 北京智谷技术服务有限公司 Light field acquisition control method and device
CN104506762A (en) * 2014-12-25 2015-04-08 北京智谷睿拓技术服务有限公司 Optical field collecting control method and device and optical field collecting equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112311971A (en) * 2019-08-01 2021-02-02 浙江大华技术股份有限公司 Camera and monitoring system

Also Published As

Publication number Publication date
CN107707807B (en) 2020-01-03

Similar Documents

Publication Publication Date Title
CN104506762B (en) Optical field acquisition control method and device, optical field acquisition equipment
JP6047807B2 (en) Method and electronic device for realizing refocusing
CN105335950B (en) Image processing method and image processing apparatus
CN104486537B (en) Optical field acquisition control method and device
KR102028297B1 (en) Device and method for generating panoramic image
CN106254859B (en) Light field display control method and device, light field display device
CN108769462A (en) Free-viewing angle scene walkthrough method and device
CN106254857B (en) Light field display control method and device, light field display device
CN111627119B (en) Texture mapping method and device, equipment and storage medium
CN106161922B (en) Image Acquisition control method and device
WO1997025690A1 (en) Increased depth of field for photography
CN107534731B (en) Image processing apparatus, image processing method, and program
KR20220016838A (en) 3D model optimization
CN114926612A (en) Aerial panoramic image processing and immersive display system
CN106254804B (en) Light field display control method and device, light field show equipment
CN106254753B (en) Light field display control method and device, light field show equipment
CN106303208A (en) Image acquisition control method and device
CN106375648B (en) Image Acquisition control method and device
CN107707807A (en) IMAQ control method and device
CN107534730B (en) Image processing apparatus and image processing method
Chlubna et al. Real-time per-pixel focusing method for light field rendering
CN106254750B (en) Image Acquisition control method and device
CN105898145A (en) Photographing method and terminal
CN106254858B (en) Light field display control method and device, light field display device
CN106303209B (en) Image Acquisition control method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant