CN104766315B - Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship - Google Patents
Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship Download PDFInfo
- Publication number
- CN104766315B CN104766315B CN201510145995.5A CN201510145995A CN104766315B CN 104766315 B CN104766315 B CN 104766315B CN 201510145995 A CN201510145995 A CN 201510145995A CN 104766315 B CN104766315 B CN 104766315B
- Authority
- CN
- China
- Prior art keywords
- image
- mirror
- referential
- display screen
- pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
The embodiment of the invention discloses a kind of methods of uncalibrated image acquisition device and display screen relative positional relationship, comprising: shows a pattern on the display screen of the electronic device；An acquisition image is obtained by image collecting device, wherein includes the virtual images for the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode in the acquisition image；The acquisition image is analyzed, determines the relative positional relationship of described image acquisition device and the display screen；The spatial operation of described image acquisition device operating body collected is corresponded on the display screen based on the relative positional relationship and is responded.The embodiment of the invention also discloses a kind of electronic equipment.
Description
Technical field
The present invention relates to the information processing technology more particularly to a kind of uncalibrated image acquisition devices and display screen relative position
The method and electronic equipment of relationship.
Background technique
Currently, three-dimensional (3D) camera technology development is swift and violent, with volume constantly reduces, power consumption and cost constantly reduce,
Precision is continuously improved, related application service and the ecosystem constantly improve and major factories such as industry Intel, Microsoft
Quotient's widelys popularize, and 3D camera product gradually turns to individual consumer market from laboratory and industrial circle application, becomes big
The product of crowdization.
Since the virtual world in electronic equipment is established generally about electronic equipment screen is referential, and electronic equipment
The true world 3D perceived by 3D camera is that referential is established generally about 3D camera, in order to preferably will be electric
The real world that virtual world in sub- equipment is lived with user is combined together, need to establish electronic equipment screen referential with
Corresponding relationship between 3D camera referential, that is, need the positional relationship demarcated between electronic equipment screen and 3D camera.
But existing scaling method is complex, ordinary user is difficult to grasp, therefore some is integrated with the device manufacturer of 3D camera
Often by the fixed a certain position on an electronic device of 3D camera, user is not allowed arbitrarily to move, thus before equipment factory
Just the positional relationship between camera and electronic equipment screen is measured, relevant parameter is permanently kept in electronic equipment,
The electronic equipment can be used directly without calibration in user.But aforesaid way is limited to user when 3D camera dispatches from the factory
Parameter configuration, such as field angle, the resolution ratio, the clarity that acquire image etc., therefore, limit the use freedom degree of user, drop
Low user experience.
Summary of the invention
To solve existing technical problem, the embodiment of the invention provides a kind of uncalibrated image acquisition device and displays
The method and electronic equipment of screen relative positional relationship.
The technical solution of the embodiment of the present invention is achieved in that
The embodiment of the invention provides a kind of method of uncalibrated image acquisition device and display screen relative positional relationship, institutes
The method of stating includes:
A pattern is shown on the display screen of the electronic device；
An acquisition image is obtained by image collecting device, wherein includes the corresponding image of mirror in the acquisition image
And the mirror passes through the virtual images for the pattern that physics imaging mode is presented；
The acquisition image is analyzed, determines the relative positional relationship of described image acquisition device and the display screen；
The spatial operation of described image acquisition device operating body collected is corresponded to based on the relative positional relationship
It is responded on the display screen.
The embodiment of the present invention also provides a kind of electronic equipment, and the electronic equipment includes:
Display unit, for showing a pattern on the display screen of the electronic device；
Image acquisition unit, for obtaining an acquisition image by image collecting device, wherein wrapped in the acquisition image
Include the virtual images for the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode；
Analytical unit determines the phase of described image acquisition device with the display screen for analyzing the acquisition image
To positional relationship；
Response unit, for based on the relative positional relationship by the sky of described image acquisition device operating body collected
Between operation correspond on the display screen and respond.
Uncalibrated image acquisition device described in the embodiment of the present invention and the method and electronics for showing screen relative positional relationship
Equipment can show a pattern on the display screen of the electronic device, and obtaining one by image collecting device includes mirror pair
The acquisition image of the virtual images for the pattern that the image and the mirror answered are presented by physics imaging mode；In turn
The relative positional relationship that described image acquisition device and the display screen are determined according to the acquisition image, finally by institute
The spatial operation for stating image collecting device operating body collected, which corresponds on the display screen, to be responded, and realizes image collector
Corresponding real world is set in conjunction with the virtual world that the display screen of the electronic equipment is shown, promotes user experience.
In addition, the method letter of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship
List is realized convenient for user, it is therefore not necessary to by the image collecting device connecting with the electronic equipment or the electronic equipment
In described image acquisition device be fixed in the electronic equipment, therefore, the side with existing fixed described image acquisition device
Formula is compared, and the embodiment of the present invention is higher using freedom degree, is more able to satisfy the different demands of user.
Detailed description of the invention
Fig. 1 is the realization stream of the method for uncalibrated image of embodiment of the present invention acquisition device and display screen relative positional relationship
Journey schematic diagram one；
Fig. 2 is application scenarios schematic diagram of the embodiment of the present invention；
Fig. 3 is the realization stream of the method for uncalibrated image of embodiment of the present invention acquisition device and display screen relative positional relationship
Journey schematic diagram two；
Fig. 4 is the realization stream of the method for uncalibrated image of embodiment of the present invention acquisition device and display screen relative positional relationship
Journey schematic diagram three；
Fig. 5 is the structural schematic diagram one of electronic equipment of the embodiment of the present invention；
Fig. 6 is the structural schematic diagram two of electronic equipment of the embodiment of the present invention.
Specific embodiment
The basic thought of the embodiment of the present invention is: showing a pattern on the display screen of the electronic device；It is adopted by image
Acquisition means obtain an acquisition image, wherein include that the corresponding image of mirror and the mirror pass through object in the acquisition image
The virtual images for the pattern that reason imaging mode is presented；Analyze the acquisition image, determine described image acquisition device with
The relative positional relationship of the display screen；Based on the relative positional relationship by the operation collected of described image acquisition device
The spatial operation of body is corresponded on the display screen and is responded.
In the actual use scene of 3D camera, 3D camera is generally as input terminal, mainly to user and user institute
Place's environment is perceived；And the display screen of electronic equipment is mainly used for exporting the 3D camera to user as output end
The content that the user perceived and user's local environment are adapted；Accordingly, it is considered to 3D camera to ring locating for user and user
The acquisition convenience of the corresponding image in border, and display screen export the convenience of content, 3D camera and display screen to user
Curtain is often arranged at same direction；Therefore, present invention is primarily based on the applications that 3D camera and display screen are in same direction
Under scene, realizes uncalibrated image acquisition device and show the purpose of screen relative positional relationship.
In order to more fully hereinafter understand the features of the present invention and technology contents, with reference to the accompanying drawing to reality of the invention
It is now described in detail, appended attached drawing purposes of discussion only for reference, is not used to limit the present invention.
Embodiment one
Fig. 1 is the realization stream of the method for uncalibrated image of embodiment of the present invention acquisition device and display screen relative positional relationship
Journey schematic diagram one；The method is applied to an electronic equipment；The electronic equipment connection includes image collecting device；It is described
Image collecting device supports 3D rendering acquisition；As shown in Figure 1, which comprises
Step 101: showing a pattern on the display screen of the electronic device；
In the present embodiment, the electronic equipment can be specially the electronic equipment that computer, television set etc. support 3D display.
In the present embodiment, when the electronic equipment includes described image acquisition device, described image acquisition device energy
It is enough to be rotated relative to the electronic equipment or mobile.
In the present embodiment, the pattern is two dimensional image namely the pattern and the display screen in same plane.
Step 102: an acquisition image being obtained by the image collecting device of the electronic equipment, wherein the acquisition figure
The virtual images of the pattern presented including the corresponding image of mirror and the mirror by physics imaging mode as in；
In the present embodiment, since the Image Acquisition direction of described image acquisition device and the display screen of electronic equipment are in
Same direction, at this point, as shown in Fig. 2, when placing a mirror 22 in front of the display screen 21 of the electronic equipment, the mirror
22 patterns 23 that can be reflected in the display screen 21 enable described image acquisition device 24 to collect in turn
The virtual images for the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode, such as
This, lays a good foundation for uncalibrated image acquisition device and display screen relative positional relationship.
Here it is worth noting that the application scenarios that Fig. 2 is provided are only for explaining the embodiment of the present invention, it is not intended to
The embodiment of the present invention is limited, in practical applications, the position that the mirror is placed is unrestricted, as long as can reflect described aobvious
The pattern and mirror that display screen curtain is presented.
In the present embodiment, since described image acquisition device supports 3D rendering acquisition, described image acquisition device is adopted
Collecting the acquisition image is a 3-D image；Further, described image acquisition device can be specially 3D camera.
Step 103: analyzing the acquisition image, determine the relative position of described image acquisition device and the display screen
Relationship；
In the present embodiment, the corresponding image of mirror and the pattern pair are analyzed based on the mirror image-forming principle
The virtual images answered, and then determine the relative positional relationship of described image acquisition device and the display screen, Ye Jisuo
State the Parameter Switch relationship of the corresponding referential of image collecting device referential corresponding with the display screen of the electronic equipment.
Step 104: being grasped the space of described image acquisition device operating body collected based on the relative positional relationship
It corresponds on the display screen and responds.
In the present embodiment, when the electronic equipment determines the opposite position of described image acquisition device and the display screen
Set relationship namely the corresponding referential of described image acquisition device referential corresponding with the display screen of the electronic equipment
After Parameter Switch relationship, the electronic equipment can be acquired described image acquisition device according to the Parameter Switch relationship of reference system
To image correspond to the electronic equipment display screen on so that it is described display screen virtual world make with electronic equipment
The real world of user's life is combined together, and then promotes user experience.
The method of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship, Neng Gou
Show a pattern on the display screen of electronic equipment, by image collecting device obtain one include the corresponding image of mirror and
The acquisition image of the virtual images for the pattern that the mirror is presented by physics imaging mode；And then according to the acquisition
Image determines the relative positional relationship of described image acquisition device and the display screen, is filled with finally acquiring described image
The spatial operation for setting operating body collected, which corresponds on the display screen, to be responded, and realizes that image collecting device is corresponding true
The world promotes user experience in conjunction with the virtual world that the display screen of the electronic equipment is shown.
In addition, the method letter of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship
List is realized convenient for user, it is therefore not necessary to by the image collecting device connecting with the electronic equipment or the electronic equipment
In described image acquisition device be fixed in the electronic equipment, therefore, the side with existing fixed described image acquisition device
Formula is compared, and the embodiment of the present invention is higher using freedom degree, is more able to satisfy the different demands of user.
Moreover, because it is not necessary that described image acquisition device is fixed, so user can be according to actual needs arbitrarily to institute
It states image collecting device to be adjusted, it might even be possible to the higher image collecting device of parameter configuration is replaced, it therefore meets user
Multiple demands.
Embodiment two
Fig. 3 is the realization stream of the method for uncalibrated image of embodiment of the present invention acquisition device and display screen relative positional relationship
Journey schematic diagram two；The method is applied to an electronic equipment；The electronic equipment connection includes image collecting device；It is described
Image collecting device supports 3D rendering acquisition；As shown in Figure 3, which comprises
Step 301: showing a pattern on the display screen of the electronic device；
In the present embodiment, the electronic equipment can be specially the electronic equipment that computer, television set etc. support 3D display.
In the present embodiment, when the electronic equipment includes described image acquisition device, described image acquisition device energy
It is enough to be rotated relative to the electronic equipment or mobile.
In the present embodiment, the pattern is two dimensional image namely the pattern and the display screen in same plane.
Step 302: an acquisition image being obtained by image collecting device, wherein include mirror pair in the acquisition image
The virtual images for the pattern that the image and the mirror answered are presented by physics imaging mode；
In the present embodiment, since the Image Acquisition direction of described image acquisition device and the display screen of electronic equipment are in
Same direction, at this point, as shown in Fig. 2, when placing a mirror 22 in front of the display screen 21 of the electronic equipment, the mirror
22 patterns 23 that can be reflected in the display screen 21 enable described image acquisition device 24 to collect in turn
The virtual images for the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode, such as
This, lays a good foundation for uncalibrated image acquisition device and display screen relative positional relationship.
Here it is worth noting that the application scenarios that Fig. 2 is provided are only for explaining the embodiment of the present invention, it is not intended to
The embodiment of the present invention is limited, in practical applications, the position that the mirror is placed is unrestricted, as long as can reflect described aobvious
The pattern and mirror that display screen curtain is presented.
In the present embodiment, since described image acquisition device supports 3D rendering acquisition, described image acquisition device is adopted
Collecting the acquisition image is a 3-D image；Further, described image acquisition device can be specially 3D camera.
Step 303: obtaining first group seat of the corresponding image of mirror under the first referential described in the acquisition image
Mark information；First referential is the corresponding referential of described image acquisition device；
Step 304: the mirror obtained in the acquisition image passes through the pattern that physics imaging mode is presented
Second group coordinate information of the virtual images under first referential；
Step 305: determining described image acquisition dress according to first group of coordinate information and second group of coordinate information
Set the relative positional relationship with the display screen；
Step 306: being grasped the space of described image acquisition device operating body collected based on the relative positional relationship
It corresponds on the display screen and responds.
In the present embodiment, when the electronic equipment determines the opposite position of described image acquisition device and the display screen
Set relationship namely the corresponding referential of described image acquisition device referential corresponding with the display screen of the electronic equipment
After Parameter Switch relationship, the electronic equipment can be acquired described image acquisition device according to the Parameter Switch relationship of reference system
To image correspond to the electronic equipment display screen on so that it is described display screen virtual world make with electronic equipment
The real world of user's life is combined together, and then promotes user experience.
In the present embodiment, since described image acquisition device supports 3D rendering acquisition, acquired and filled by described image
It is equal for each coordinate in a 3-D image namely first group of coordinate information to set the corresponding image of the mirror got
For a three-dimensional coordinate；It therefore, can be according to described first group after the electronic equipment gets first group of coordinate information
Coordinate information is determined in the plane where the mirror under first referential.
Similarly, the corresponding virtual image of the pattern obtained by described image acquisition device is also a three-dimensional figure
Each coordinate in picture namely second group of coordinate information is also a three-dimensional coordinate；Therefore, when the electronic equipment is got
After second group of coordinate information, can be determined under first referential according to second group of coordinate information described in
Plane where virtual image.
In turn, when the electronic equipment determine where the mirror under first referential plane and
After plane where virtual image, the pattern place under first referential can be determined according to mirror-reflection principle
Plane where the display screen under plane namely first referential, and since first referential is the figure
As the corresponding referential of acquisition device, therefore, it is capable of determining that the display screen is acquired in described image through the above way
Coordinate under corresponding first referential of device, and then determine the phase of described image acquisition device with the display screen
To positional relationship, the electronic equipment is enabled to be based on the relative positional relationship described image acquisition device is collected
The spatial operation of operating body is corresponded on the display screen and is responded, realize the corresponding real world of image collecting device with it is described
The virtual world that the display screen of electronic equipment is shown combines.
The method of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship, Neng Gou
Show a pattern on the display screen of electronic equipment, by image collecting device obtain one include the corresponding image of mirror and
The acquisition image of the virtual images for the pattern that the mirror is presented by physics imaging mode；And then according to the acquisition
Image determines the relative positional relationship of described image acquisition device and the display screen, is filled with finally acquiring described image
The spatial operation for setting operating body collected, which corresponds on the display screen, to be responded, and realizes that image collecting device is corresponding true
The world promotes user experience in conjunction with the virtual world that the display screen of the electronic equipment is shown.
In addition, the method letter of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship
List is realized convenient for user, it is therefore not necessary to by the image collecting device connecting with the electronic equipment or the electronic equipment
In described image acquisition device be fixed in the electronic equipment, therefore, the side with existing fixed described image acquisition device
Formula is compared, and the embodiment of the present invention is higher using freedom degree, is more able to satisfy the different demands of user.
Moreover, because it is not necessary that described image acquisition device is fixed, so user can be according to actual needs arbitrarily to institute
It states image collecting device to be adjusted, it might even be possible to the higher image collecting device of parameter configuration is replaced, it therefore meets user
Multiple demands.
Embodiment three
Fig. 4 is the realization stream of the method for uncalibrated image of embodiment of the present invention acquisition device and display screen relative positional relationship
Journey schematic diagram three；The method is applied to an electronic equipment；The electronic equipment connection includes image collecting device；It is described
Image collecting device supports 3D rendering acquisition；As shown in Figure 4, which comprises
Step 401: showing a pattern on the display screen of the electronic device；
In the present embodiment, the electronic equipment can be specially the electronic equipment that computer, television set etc. support 3D display.
In the present embodiment, when the electronic equipment includes described image acquisition device, described image acquisition device energy
It is enough to be rotated relative to the electronic equipment or mobile.
In the present embodiment, the pattern is two dimensional image namely the pattern and the display screen in same plane.
Step 402: an acquisition image being obtained by image collecting device, wherein include mirror pair in the acquisition image
The virtual images for the pattern that the image and the mirror answered are presented by physics imaging mode；
In the present embodiment, since the Image Acquisition direction of described image acquisition device and the display screen of electronic equipment are in
Same direction, at this point, as shown in Fig. 2, when placing a mirror 22 in front of the display screen 21 of the electronic equipment, the mirror
22 patterns 23 that can be reflected in the display screen 21 enable described image acquisition device 24 to collect in turn
The virtual images for the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode, such as
This, lays a good foundation for uncalibrated image acquisition device and display screen relative positional relationship.
Here it is worth noting that the application scenarios that Fig. 2 is provided are only for explaining the embodiment of the present invention, it is not intended to
The embodiment of the present invention is limited, in practical applications, the position that the mirror is placed is unrestricted, as long as can reflect described aobvious
The pattern and mirror that display screen curtain is presented.
In the present embodiment, since described image acquisition device supports 3D rendering acquisition, described image acquisition device is adopted
Collecting the acquisition image is a 3-D image；Further, described image acquisition device can be specially 3D camera.
Step 403: obtaining at least three characteristic points in the corresponding image of the mirror in the acquisition image；
Step 404: being determined under the first referential according at least three characteristic points in the corresponding image of the mirror
First group of coordinate information；First referential is the corresponding referential of described image acquisition device；
In the present embodiment, at least three characteristic points according in the corresponding image of the mirror determine the first reference
First group of coordinate information under system, comprising:
Judge whether at least three characteristic points in the corresponding image of the mirror meet the first preset rules；Described first
Preset rules are for being characterized under first referential according at least three characteristic point energy in the corresponding image of the mirror
Plane where enough uniquely determining out a mirror；
Meet described when the judging result got characterizes at least three characteristic points in the corresponding image of the mirror
When one preset rules, first under the first referential is determined according at least three characteristic points in the corresponding image of the mirror
Group coordinate information.
In the present embodiment, the purpose for determining first group of coordinate information is to determine under first referential
Plane where the corresponding image of the mirror；Therefore, when the electronic equipment is got in the corresponding image of the mirror
After at least three characteristic points, need to judge that at least three characteristic points in the corresponding image of the mirror got whether can
The corresponding plane of the mirror is uniquely determined out, and then at least the three of the corresponding plane of the mirror will be uniquely determined out
A feature point group synthesizes first group of coordinate information.
In one embodiment, the mirror determined by least three characteristic points of the corresponding plane of the mirror
The corresponding plane of son is that there are the planes of first position relationship with the display screen, such as corresponding with the display plane
A plane.
In one embodiment, using angle point and line detection algorithm, be able to detect that mirror plane four edges and
Four vertex, and then the three-dimensional coordinate on corresponding four vertex of the mirror is obtained, and then plane fitting goes out where the mirror
Position of the plane under first referential.
Step 405: obtaining the mirror and pass through in the virtual images for the pattern that physics imaging mode is presented extremely
Few three characteristic points；
In one embodiment, using feature point detection algorithm, the corresponding virtual image of the pattern can be collected
In at least three specified points three-dimensional coordinate, and then it is corresponding virtual using plane fitting algorithm can to fit the pattern
Position of the plane under first referential where image.
Step 406: passing through in the virtual images for the pattern that physics imaging mode is presented extremely according to the mirror
Few three characteristic points determine second group of coordinate information under first referential；
In the present embodiment, the virtual images of the pattern presented according to the mirror by physics imaging mode
In at least three characteristic points determine second group of coordinate information under first referential, comprising:
Judge that the mirror passes through in the virtual images for the pattern that physics imaging mode is presented at least three is special
Whether sign point meets the second preset rules；Second preset rules are for being characterized under first referential through the void
Plane as where at least three characteristic points in image can uniquely determine out the virtual image；
When the judging result got characterizes the virtual image for the pattern that the mirror is presented by physics imaging mode
When at least three characteristic points in image meet second preset rules, it is in by physics imaging mode according to the mirror
At least three characteristic points in the virtual images of the existing pattern determine that second group of coordinate under first referential is believed
Breath.
In the present embodiment, the purpose for determining second group of coordinate information is to determine under first referential
The pattern passes through plane where the presented virtual image of physics imaging mode, and then according to mirror-reflection principle described first
Plane where determining the display screen under referential；Therefore, pass through physics when the electronic equipment gets the mirror
After at least three characteristic points in the virtual images for the pattern that imaging mode is presented, the virtual image figure for judging to get is needed
Whether at least three characteristic points as in can uniquely determine out a plane, and then will uniquely determine out the described of a plane
At least three feature point groups in virtual image synthesize second group of coordinate information.
Step 407: determining described image acquisition dress according to first group of coordinate information and second group of coordinate information
Set the relative positional relationship with the display screen；
Step 408: being grasped the space of described image acquisition device operating body collected based on the relative positional relationship
It corresponds on the display screen and responds.
In the present embodiment, when the electronic equipment determines the opposite position of described image acquisition device and the display screen
Set relationship namely the corresponding referential of described image acquisition device referential corresponding with the display screen of the electronic equipment
After Parameter Switch relationship, the electronic equipment can be acquired described image acquisition device according to the Parameter Switch relationship of reference system
To image correspond to the electronic equipment display screen on so that it is described display screen virtual world make with electronic equipment
The real world of user's life is combined together, and then promotes user experience.
In the present embodiment, since described image acquisition device supports 3D rendering acquisition, acquired and filled by described image
It is equal for each coordinate in a 3-D image namely first group of coordinate information to set the corresponding image of the mirror got
For a three-dimensional coordinate；It therefore, can be according to described first group after the electronic equipment gets first group of coordinate information
Coordinate information is determined in the plane where the mirror under first referential.
Similarly, the corresponding virtual image of the pattern obtained by described image acquisition device is also a three-dimensional figure
Each coordinate in picture namely second group of coordinate information is also a three-dimensional coordinate；Therefore, when the electronic equipment is got
After second group of coordinate information, can be determined under first referential according to second group of coordinate information described in
Plane where virtual image.
In turn, when the electronic equipment determine where the mirror under first referential plane and
After plane where virtual image, the pattern place under first referential can be determined according to mirror-reflection principle
Plane where the display screen under plane namely first referential, and since first referential is the figure
As the corresponding referential of acquisition device, therefore, it is capable of determining that the display screen is acquired in described image through the above way
Coordinate under corresponding first referential of device, and then determine the phase of described image acquisition device with the display screen
To positional relationship, the electronic equipment is enabled to be based on the relative positional relationship described image acquisition device is collected
The spatial operation of operating body is corresponded on the display screen and is responded, realize the corresponding real world of image collecting device with it is described
The virtual world that the display screen of electronic equipment is shown combines.
The method of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship, Neng Gou
Show a pattern on the display screen of electronic equipment, by image collecting device obtain one include the corresponding image of mirror and
The acquisition image of the virtual images for the pattern that the mirror is presented by physics imaging mode；And then according to the acquisition
Image determines the relative positional relationship of described image acquisition device and the display screen, is filled with finally acquiring described image
The spatial operation for setting operating body collected, which corresponds on the display screen, to be responded, and realizes that image collecting device is corresponding true
The world promotes user experience in conjunction with the virtual world that the display screen of the electronic equipment is shown.
In addition, the method letter of uncalibrated image acquisition device described in the embodiment of the present invention and display screen relative positional relationship
List is realized convenient for user, it is therefore not necessary to by the image collecting device connecting with the electronic equipment or the electronic equipment
In described image acquisition device be fixed in the electronic equipment, therefore, the side with existing fixed described image acquisition device
Formula is compared, and the embodiment of the present invention is higher using freedom degree, is more able to satisfy the different demands of user.
Moreover, because it is not necessary that described image acquisition device is fixed, so user can be according to actual needs arbitrarily to institute
It states image collecting device to be adjusted, it might even be possible to the higher image collecting device of parameter configuration is replaced, it therefore meets user
Multiple demands.
Example IV
Fig. 5 is the structural schematic diagram one of electronic equipment of the embodiment of the present invention；As shown in figure 5, the electronic equipment includes:
Display unit 51, for showing a pattern on the display screen of the electronic device；
Image acquisition unit 52, for obtaining an acquisition image by image collecting device, wherein in the acquisition image
Virtual images including the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode；
Analytical unit 53 determines described image acquisition device and the display screen for analyzing the acquisition image
Relative positional relationship；
Response unit 54, for based on the relative positional relationship by described image acquisition device operating body collected
Spatial operation is corresponded on the display screen and is responded.
It will be appreciated by those skilled in the art that in the electronic equipment of the embodiment of the present invention each processing unit function, can join
Understand according to the associated description of aforementioned uncalibrated image acquisition device and the method for display screen relative positional relationship, the present invention is implemented
Each processing unit in the electronic equipment of example, can by realizing that the analog circuit of function described in the embodiment of the present invention be realized,
It can be realized by executing operation of the software of function described in the embodiment of the present invention on intelligent terminal.
Embodiment five
Fig. 6 is the structural schematic diagram two of electronic equipment of the embodiment of the present invention；As shown in fig. 6, the electronic equipment includes:
Display unit 51, for showing a pattern on the display screen of the electronic device；
Image acquisition unit 52, for obtaining an acquisition image by image collecting device, wherein in the acquisition image
Virtual images including the pattern that the corresponding image of mirror and the mirror are presented by physics imaging mode；
Analytical unit 53 determines described image acquisition device and the display screen for analyzing the acquisition image
Relative positional relationship；
Response unit 54, for based on the relative positional relationship by described image acquisition device operating body collected
Spatial operation is corresponded on the display screen and is responded.
In above scheme, the analytical unit 53, comprising:
First obtains subelement 531, for obtaining the corresponding image of mirror described in the acquisition image in the first reference
First group of coordinate information under system；First referential is the corresponding referential of described image acquisition device；
Second obtains subelement 532, passes through physics imaging mode institute for obtaining the mirror in the acquisition image
Second group coordinate information of the virtual images of the pattern presented under first referential.
In above scheme, the analytical unit, further includes:
Subelement 533 is determined, described in determining according to first group of coordinate information and second group of coordinate information
The relative positional relationship of image collecting device and the display screen.
It will be appreciated by those skilled in the art that in the electronic equipment of the embodiment of the present invention each processing unit function, can join
Understand according to the associated description of aforementioned uncalibrated image acquisition device and the method for display screen relative positional relationship, the present invention is implemented
Each processing unit in the electronic equipment of example, can by realizing that the analog circuit of function described in the embodiment of the present invention be realized,
It can be realized by executing operation of the software of function described in the embodiment of the present invention on intelligent terminal.
Embodiment six
Based on electronic equipment described in embodiment five, in the present embodiment, described first obtains subelement, is also used to obtain institute
State at least three characteristic points in the corresponding image of the mirror in acquisition image；
It is also used to determine under the first referential according at least three characteristic points in the corresponding image of the mirror
One group of coordinate information.
In the present embodiment, described first obtains subelement, is also used to judge at least three in the corresponding image of the mirror
Whether a characteristic point meets the first preset rules；First preset rules are for being characterized under first referential according to institute
Plane where a mirror can be uniquely determined out by stating at least three characteristic points in the corresponding image of mirror；
It is also used to meet when at least three characteristic points that the judging result got characterizes in the corresponding image of the mirror
When first preset rules, determined under the first referential according at least three characteristic points in the corresponding image of the mirror
First group of coordinate information.
In the present embodiment, described second obtains subelement, is also used to obtain the mirror by physics imaging mode and is in
At least three characteristic points in the virtual images of the existing pattern；
It is also used to pass through in the virtual images for the pattern that physics imaging mode is presented at least according to the mirror
Three characteristic points determine second group of coordinate information under first referential.
In the present embodiment, described second obtains subelement, is also used to judge that the mirror is in by physics imaging mode
Whether at least three characteristic points in the virtual images of the existing pattern meet the second preset rules；Second preset rules
Institute can be uniquely determined out by least three characteristic points in the virtual images for being characterized under first referential
State the plane where virtual image；
It is also used to pass through the pattern that physics imaging mode is presented when the judging result got characterizes the mirror
Virtual images at least three characteristic points when meeting second preset rules, pass through physics imaging side according to the mirror
At least three characteristic points in the virtual images for the pattern that formula is presented determine second group under first referential
Coordinate information.
It will be appreciated by those skilled in the art that in the electronic equipment of the embodiment of the present invention each processing unit function, can join
Understand according to the associated description of aforementioned uncalibrated image acquisition device and the method for display screen relative positional relationship, the present invention is implemented
Each processing unit in the electronic equipment of example, can by realizing that the analog circuit of function described in the embodiment of the present invention be realized,
It can be realized by executing operation of the software of function described in the embodiment of the present invention on intelligent terminal.
In several embodiments provided herein, it should be understood that disclosed device and method can pass through it
Its mode is realized.Apparatus embodiments described above are merely indicative, for example, the division of the unit, only
A kind of logical function partition, there may be another division manner in actual implementation, such as: multiple units or components can combine, or
It is desirably integrated into another system, or some features can be ignored or not executed.In addition, shown or discussed each composition portion
Mutual coupling or direct-coupling or communication connection is divided to can be through some interfaces, the INDIRECT COUPLING of equipment or unit
Or communication connection, it can be electrical, mechanical or other forms.
Above-mentioned unit as illustrated by the separation member, which can be or may not be, to be physically separated, aobvious as unit
The component shown can be or may not be physical unit, it can and it is in one place, it may be distributed over multiple network lists
In member；Some or all of units can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in various embodiments of the present invention can be fully integrated in one processing unit, it can also
To be each unit individually as a unit, can also be integrated in one unit with two or more units；It is above-mentioned
Integrated unit both can take the form of hardware realization, can also realize in the form of hardware adds SFU software functional unit.
Those of ordinary skill in the art will appreciate that: realize that all or part of the steps of above method embodiment can pass through
The relevant hardware of program instruction is completed, and program above-mentioned can be stored in a computer readable storage medium, the program
When being executed, step including the steps of the foregoing method embodiments is executed；And storage medium above-mentioned include: movable storage device, it is read-only
Memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disk or
The various media that can store program code such as person's CD.
If alternatively, the above-mentioned integrated unit of the present invention is realized in the form of software function module and as independent product
When selling or using, it also can store in a computer readable storage medium.Based on this understanding, the present invention is implemented
Substantially the part that contributes to existing technology can be embodied in the form of software products the technical solution of example in other words,
The computer software product is stored in a storage medium, including some instructions are used so that computer equipment (can be with
It is personal computer, server or network equipment etc.) execute all or part of each embodiment the method for the present invention.
And storage medium above-mentioned includes: that movable storage device, read-only memory (ROM, Read Only Memory), arbitrary access are deposited
The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any
Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain
Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (14)
1. a kind of method of uncalibrated image acquisition device and display screen relative positional relationship, which comprises
A pattern is shown on the display screen of the electronic device；
Pass through image collecting device and obtain an acquisition image, wherein in the acquisition image including the corresponding image of mirror and
The virtual images for the pattern that the mirror is presented by physics imaging mode；
The acquisition image is analyzed, determines the relative positional relationship of described image acquisition device and the display screen；The phase
It is the corresponding referential of described image acquisition device referential corresponding with the display screen of the electronic equipment to positional relationship
Parameter Switch relationship；
The spatial operation of described image acquisition device operating body collected corresponded to based on the relative positional relationship described
It is responded on display screen.
2. the method according to claim 1, wherein the analysis acquisition image, comprising:
Obtain first group coordinate information of the corresponding image of mirror under the first referential described in the acquisition image；Described
One referential is the corresponding referential of described image acquisition device；
The virtual images for obtaining the pattern that the mirror in the acquisition image is presented by physics imaging mode exist
Second group of coordinate information under first referential.
3. according to the method described in claim 2, it is characterized in that, mirror described in the acquisition acquisition image is corresponding
First group coordinate information of the image under the first referential, comprising:
Obtain at least three characteristic points in the corresponding image of the mirror in the acquisition image；
Determine that first group of coordinate under the first referential is believed according at least three characteristic points in the corresponding image of the mirror
Breath.
4. according to the method described in claim 3, it is characterized in that, at least three according in the corresponding image of the mirror
A characteristic point determines first group of coordinate information under the first referential, comprising:
Judge whether at least three characteristic points in the corresponding image of the mirror meet the first preset rules；Described first is default
Rule can be only according at least three characteristic points in the corresponding image of the mirror for being characterized under first referential
One determines plane where a mirror；
Meet described first in advance when the judging result got characterizes at least three characteristic points in the corresponding image of the mirror
If determining first group of seat under the first referential according at least three characteristic points in the corresponding image of the mirror when rule
Mark information.
5. according to the method described in claim 2, it is characterized in that, the mirror obtained in the acquisition image passes through
Second group coordinate information of the virtual images for the pattern that physics imaging mode is presented under first referential, packet
It includes:
Obtain at least three characteristic points in the virtual images for the pattern that the mirror is presented by physics imaging mode；
Pass through at least three characteristic points in the virtual images for the pattern that physics imaging mode is presented according to the mirror
Determine second group of coordinate information under first referential.
6. according to the method described in claim 5, it is characterized in that, described be in by physics imaging mode according to the mirror
At least three characteristic points in the virtual images of the existing pattern determine that second group of coordinate under first referential is believed
Breath, comprising:
Judge that the mirror passes through at least three characteristic points in the virtual images for the pattern that physics imaging mode is presented
Whether second preset rules are met；Second preset rules are for being characterized under first referential through the virtual image figure
At least three characteristic points as in can uniquely determine out the virtual images where plane；
When the judging result got characterizes the virtual images for the pattern that the mirror is presented by physics imaging mode
In at least three characteristic points when meeting second preset rules, presented according to the mirror by physics imaging mode
At least three characteristic points in the virtual images of the pattern determine second group of coordinate information under first referential.
7. according to the method described in claim 2, it is characterized in that, the determining described image acquisition device and the display screen
The relative positional relationship of curtain, comprising:
Described image acquisition device and the display are determined according to first group of coordinate information and second group of coordinate information
The relative positional relationship of screen.
8. a kind of electronic equipment, comprising:
Display unit, for showing a pattern on the display screen of the electronic device；
Image acquisition unit, for obtaining an acquisition image by image collecting device, wherein include mirror in the acquisition image
The virtual images for the pattern that sub corresponding image and the mirror are presented by physics imaging mode；
Analytical unit determines the opposite position of described image acquisition device and the display screen for analyzing the acquisition image
Set relationship；The relative positional relationship is the display screen of the corresponding referential of described image acquisition device Yu the electronic equipment
The Parameter Switch relationship of corresponding referential；
Response unit, for being grasped the space of described image acquisition device operating body collected based on the relative positional relationship
It corresponds on the display screen and responds.
9. electronic equipment according to claim 8, which is characterized in that the analytical unit, comprising:
First obtains subelement, for obtaining the corresponding image of mirror described in the acquisition image the under the first referential
One group of coordinate information；First referential is the corresponding referential of described image acquisition device；
Second obtains subelement, passes through the institute that physics imaging mode is presented for obtaining the mirror in the acquisition image
State second group coordinate information of the virtual images of pattern under first referential.
10. electronic equipment according to claim 9, which is characterized in that described first obtains subelement, is also used to obtain institute
State at least three characteristic points in the corresponding image of the mirror in acquisition image；
It is also used to determine first group under the first referential according at least three characteristic points in the corresponding image of the mirror
Coordinate information.
11. electronic equipment according to claim 10, which is characterized in that described first obtains subelement, is also used to judge
Whether at least three characteristic points in the corresponding image of the mirror meet the first preset rules；First preset rules are used for
Being characterized under first referential can uniquely determine out according at least three characteristic points in the corresponding image of the mirror
Plane where one mirror；
Described in being also used to meet when at least three characteristic points that the judging result got characterizes in the corresponding image of the mirror
When the first preset rules, under the first referential is determined according at least three characteristic points in the corresponding image of the mirror
One group of coordinate information.
12. electronic equipment according to claim 9, which is characterized in that described second obtains subelement, is also used to obtain institute
State at least three characteristic points in the virtual images for the pattern that mirror is presented by physics imaging mode；
It is also used to pass through according to the mirror at least three in the virtual images for the pattern that physics imaging mode is presented
Characteristic point determines second group of coordinate information under first referential.
13. electronic equipment according to claim 12, which is characterized in that described second obtains subelement, is also used to judge
Whether at least three characteristic points in the virtual images for the pattern that the mirror is presented by physics imaging mode meet
Second preset rules；Second preset rules pass through in the virtual images extremely for being characterized under first referential
Few three characteristic points can uniquely determine out the plane where the virtual images；
It is also used to characterize the void for the pattern that the mirror is presented by physics imaging mode when the judging result got
When meeting second preset rules as at least three characteristic points in image, pass through physics imaging mode institute according to the mirror
At least three characteristic points in the virtual images of the pattern presented determine second group of coordinate under first referential
Information.
14. electronic equipment according to claim 9, which is characterized in that the analytical unit, further includes:
Subelement is determined, for determining that described image acquires according to first group of coordinate information and second group of coordinate information
The relative positional relationship of device and the display screen.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510145995.5A CN104766315B (en) | 2015-03-30 | 2015-03-30 | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510145995.5A CN104766315B (en) | 2015-03-30 | 2015-03-30 | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104766315A CN104766315A (en) | 2015-07-08 |
| CN104766315B true CN104766315B (en) | 2019-03-29 |
Family
ID=53648124
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510145995.5A Active CN104766315B (en) | 2015-03-30 | 2015-03-30 | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104766315B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106384065B (en) | 2015-06-30 | 2019-08-06 | 北京智谷睿拓技术服务有限公司 | Display control method and device |
| CN106250791A (en) | 2015-06-30 | 2016-12-21 | 北京智谷睿拓技术服务有限公司 | Display control method and device |
| CN110506252B (en) * | 2017-11-27 | 2021-01-29 | 华为技术有限公司 | Terminal screen is fixed a position to transform relation based on mark figure point coordinate in pattern |
| CN113656132A (en) * | 2021-08-17 | 2021-11-16 | 维沃移动通信（杭州）有限公司 | Display method and device |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104111036A (en) * | 2013-04-18 | 2014-10-22 | 中国科学院沈阳自动化研究所 | Mirror object measuring device and method based on binocular vision |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20020036617A1 (en) * | 1998-08-21 | 2002-03-28 | Timothy R. Pryor | Novel man machine interfaces and applications |
| CN101072366B (en) * | 2007-05-24 | 2010-08-11 | 上海大学 | Free stereo display system based on light field and binocular vision technology |
| CN102298467A (en) * | 2010-06-24 | 2011-12-28 | 北京威亚视讯科技有限公司 | Automatic calibration method and system for display screen |
-
2015
- 2015-03-30 CN CN201510145995.5A patent/CN104766315B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104111036A (en) * | 2013-04-18 | 2014-10-22 | 中国科学院沈阳自动化研究所 | Mirror object measuring device and method based on binocular vision |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104766315A (en) | 2015-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108765498B (en) | Monocular vision tracking, device and storage medium | |
| CN104766315B (en) | Method, the equipment of uncalibrated image acquisition device and display screen relative positional relationship | |
| JP5843340B2 (en) | 3D environment sharing system and 3D environment sharing method | |
| EP3144880B1 (en) | A method and an apparatus for generating data representative of a light field | |
| US20160232703A1 (en) | System and method for image processing | |
| JP2019510311A (en) | Method and computer program product for calibrating a stereo imaging system using a planar mirror | |
| RU2612572C2 (en) | Image processing system and method | |
| EP2767092A1 (en) | Apparatus, method and program for 3d data analysis and fine particle analysis system | |
| EP2907307A1 (en) | System and method for combining data from multiple depth cameras | |
| CN105516579B (en) | A kind of image processing method, device and electronic equipment | |
| WO2017017790A1 (en) | Image generation device, image generation system, and image generation method | |
| CN104735348A (en) | Double-camera photographing method and system | |
| CN110689580A (en) | Multi-camera calibration method and device | |
| CN103959770A (en) | Image processing device, image processing method and program | |
| EP3312803A1 (en) | Image processing system, method and program | |
| US10268216B2 (en) | Method and system for providing position or movement information for controlling at least one function of an environment | |
| JP5611875B2 (en) | Information display device, information display method, and program | |
| US9189890B2 (en) | Orientating an oblique plane in a 3D representation | |
| CN108711186A (en) | Method and apparatus, identity recognition device and the electronic equipment of target object drawing | |
| JP2003346185A (en) | Information display system and personal digital assistant | |
| CN107422842A (en) | A kind of information processing method and device | |
| JP7210131B2 (en) | Information processing device, information processing method and program | |
| US20140285430A1 (en) | Information processing method and electronic device | |
| AU2020277020A1 (en) | Novel systems and methods for collecting, locating and visualizing sensor signals in extended reality | |
| CN109636895B (en) | Holographic display method and electronic sand table device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| EXSB | Decision made by sipo to initiate substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |