CN109240484A - Exchange method, device and equipment in a kind of augmented reality system - Google Patents
Exchange method, device and equipment in a kind of augmented reality system Download PDFInfo
- Publication number
- CN109240484A CN109240484A CN201710556621.1A CN201710556621A CN109240484A CN 109240484 A CN109240484 A CN 109240484A CN 201710556621 A CN201710556621 A CN 201710556621A CN 109240484 A CN109240484 A CN 109240484A
- Authority
- CN
- China
- Prior art keywords
- directed toward
- virtual ray
- controlling equipment
- virtual
- point
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 28
- 238000000034 method Methods 0.000 title claims abstract description 25
- 230000008859 change Effects 0.000 claims abstract description 73
- 230000002452 interceptive effect Effects 0.000 claims abstract description 13
- 230000001133 acceleration Effects 0.000 claims description 12
- 230000006399 behavior Effects 0.000 claims description 9
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004891 communication Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 239000011800 void material Substances 0.000 description 3
- 230000002708 enhancing effect Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000004807 localization Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
This application discloses the exchange methods in a kind of augmented reality system, device and equipment, it is related to augmented reality, the embodiment of the present invention is according to the posture and location information of controlling equipment, determine the direction that controlling equipment virtual ray is directed toward in scene, the length of the virtual ray in the direction and setting be directed toward further according to virtual ray, determine the point that virtual ray is directed toward, and then it can capture the change information of the point of virtual ray direction, and the manipulation of dummy object in scene is carried out according to the change information, the object in augmented reality system is manipulated by way of virtual ray, reduce computation complexity, improve the interactive efficiency in augmented reality system.
Description
Technical field
The present disclosure relates generally to computer fields, and in particular to augmented reality more particularly to a kind of augmented reality system
Exchange method, device and equipment in system.
Background technique
Augmented reality (Augmented Reality, AR), be a kind of position for calculating camera image in real time and
Angle and the technology for adding respective image, video, 3D model, the target of this technology are that virtual world is covered existing on the screen
The real world is simultaneously interacted.
SLAM (simultaneous localization and mapping), also referred to as CML (Concurrent
Mapping and Localization), instant positioning and map structuring, or concurrently build figure and positioning.
TOF (Time of Flight, flight time) technology, i.e. sensor issue modulated near infrared light, meet object
Back reflection, sensor is by calculating light transmitting and reflection interval difference or phase difference, come the distance of scenery of being taken that converts, to produce
Furthermore raw depth information is shot in conjunction with traditional camera, the three-D profile of object can be represented in different colors difference away from
From topographic map mode show.
There are much interactive modes on the basis of virtual reality at present, such as by optical alignment handle/control stick, passes through
Optical scanner hand motion completes operation etc., but the computation complexity that these interactive modes need is higher, and interactive process is inadequate
Efficiently.
Summary of the invention
In view of drawbacks described above in the prior art or deficiency, be intended to provide a kind of exchange method in augmented reality system,
Device and equipment, to improve the interactive efficiency in augmented reality system.
In a first aspect, the embodiment of the present invention provides the exchange method in a kind of augmented reality system, which comprises
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines what the virtual ray was directed toward
Point；
The change information for the point that the virtual ray is directed toward is captured, and dummy object in scene is carried out according to the change information
Manipulation.
Further, the posture and location information according to controlling equipment determines that controlling equipment virtual ray refers in scene
To direction, specifically include:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, really
Determine the direction that controlling equipment virtual ray is directed toward in scene.
Preferably, the change information for capturing the point that the virtual ray is directed toward, and field is carried out according to the change information
The manipulation of dummy object in scape, specifically includes:
The change information of the posture of controlling equipment and the change information of location information and ray length is captured, and according to behaviour
It controls the posture of equipment and the change information of location information and the change information of ray length changes the position of respective virtual object；
And/or
The variation of the flip angle in 3 axis deflection angle information of controlling equipment is captured, and according in 3 axis deflection angle information
Flip angle variation, dummy object corresponding in scene is overturn.
Further, the length of the virtual ray of the direction being directed toward according to virtual ray and setting, determines the void
After the point that quasi- ray is directed toward, further includes:
Laser point is shown in the point that virtual ray is directed toward by display equipment.
Further, further includes:
When capturing the click signal of controlling equipment setting key, the virtual push button at point being directed toward to virtual ray is carried out
Clicking operation.
Second aspect, accordingly the interactive device in a kind of augmented reality system, described device include: the embodiment of the present invention
First determination unit determines that controlling equipment is virtual in scene for the posture and location information according to controlling equipment
The direction that ray is directed toward；
Second determination unit, the length of the virtual ray in direction and setting for being directed toward according to virtual ray determine
The point that the virtual ray is directed toward；
Unit is manipulated, is carried out for capturing the change information for the point that the virtual ray is directed toward, and according to the change information
The manipulation of dummy object in scene.
Further, first determination unit is specifically used for:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, really
Determine the direction that controlling equipment virtual ray is directed toward in scene.
Preferably, the manipulation unit is specifically used for:
The change information of the posture of controlling equipment and the change information of location information and ray length is captured, and according to behaviour
It controls the posture of equipment and the change information of location information and the change information of ray length changes the position of respective virtual object；
And/or
The variation of the flip angle in 3 axis deflection angle information of controlling equipment is captured, and according in 3 axis deflection angle information
Flip angle variation, dummy object corresponding in scene is overturn.
Further, second determination unit is also used to:
In the length of the virtual ray in the direction and setting be directed toward according to virtual ray, determine that the virtual ray is directed toward
Point after, the point display laser point is directed toward by display equipment in virtual ray.
Further, the manipulation unit is also used to:
When capturing the click signal of controlling equipment setting key, the virtual push button at point being directed toward to virtual ray is carried out
Clicking operation.
The third aspect, the embodiment of the present invention accordingly provide a kind of equipment, including processor, memory and display；
The memory includes can be by instruction that the processor executes so that the processor executes:
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines what the virtual ray was directed toward
Point；
The change information for the point that the virtual ray is directed toward is captured, and dummy object in scene is carried out according to the change information
Manipulation.
Further, further includes:
3 axle acceleration sensors, for obtaining the acceleration information of equipment；
3 axis gyroscopes, for obtaining the deflection angle information of equipment；
The posture and location information according to controlling equipment determines the side that controlling equipment virtual ray is directed toward in scene
To specifically including:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, really
Determine the direction that controlling equipment virtual ray is directed toward in scene.
Further, the equipment includes:
Controlling equipment, including first processor, memory, 3 axle acceleration sensors, 3 axis gyroscopes, first processing
Device is used for: according to the posture and location information of controlling equipment, determining the direction that controlling equipment virtual ray is directed toward in scene；According to
The length of the virtual ray in direction and setting that virtual ray is directed toward determines the point that the virtual ray is directed toward；Described in capture
The change information for the point that virtual ray is directed toward, and according to the manipulation of dummy object in change information progress scene；
Equipment is shown, including for the display of display environment picture and dummy object, second processor, outer for obtaining
The camera of boundary's environment picture；
The controlling equipment is connected with display equipment by communication module.
Further, the display is also used to:
Laser point is shown in the point that virtual ray is directed toward.
Fourth aspect, the embodiment of the present invention correspondingly provide a kind of computer readable storage medium, are stored thereon with calculating
Machine program, the computer program are used for:
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines what the virtual ray was directed toward
Point；
The change information for the point that the virtual ray is directed toward is captured, and dummy object in scene is carried out according to the change information
Manipulation.
The embodiment of the present invention provides exchange method, device and the equipment in a kind of augmented reality system, according to controlling equipment
Posture and location information, determine the direction that controlling equipment virtual ray in scene is directed toward, the side being directed toward further according to virtual ray
To and setting virtual ray length, determine virtual ray be directed toward point, and then can capture virtual ray direction point
Change information, and according to the change information carry out scene in dummy object manipulation, to enhancing by way of virtual ray
Object in reality system is manipulated, and computation complexity is reduced, and improves the interactive efficiency in augmented reality system.
Detailed description of the invention
By reading a detailed description of non-restrictive embodiments in the light of the attached drawings below, the application's is other
Feature, objects and advantages will become more apparent upon:
Fig. 1 is the exchange method flow chart in augmented reality system provided in an embodiment of the present invention；
Fig. 2 is virtual ray and laser point schematic diagram in augmented reality system provided in an embodiment of the present invention；
Fig. 3 be in augmented reality system provided in an embodiment of the present invention by virtual ray and laser point and virtual screen into
The schematic diagram of row interaction；
Fig. 4 is the interactive device structural schematic diagram in augmented reality system provided in an embodiment of the present invention；
Fig. 5 is the interactive device structural schematic diagram in augmented reality system provided in an embodiment of the present invention；
Fig. 6 is the interactive device structural schematic diagram in preferable augmented reality system provided in an embodiment of the present invention；
Fig. 7 is the interactive device structural schematic diagram in more preferably augmented reality system provided in an embodiment of the present invention.
Specific embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched
The specific embodiment stated is used only for explaining related invention, rather than the restriction to the invention.It also should be noted that in order to
Convenient for description, part relevant to invention is illustrated only in attached drawing.
It should be noted that in the absence of conflict, the features in the embodiments and the embodiments of the present application can phase
Mutually combination.The application is described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.
Referring to FIG. 1, the exchange method in augmented reality system provided in an embodiment of the present invention, comprising:
Step S101, according to the posture of controlling equipment and location information, determine that controlling equipment virtual ray is directed toward in scene
Direction；
Step S102, the length of the virtual ray in the direction and setting being directed toward according to virtual ray, determines virtual ray
The point of direction；
Step S103, the change information for the point that virtual ray is directed toward is captured, and void in scene is carried out according to the change information
The manipulation of quasi- object.
This method determines the side that controlling equipment virtual ray is directed toward in scene according to the posture and location information of controlling equipment
To the length of the virtual ray in the direction and setting be directed toward further according to virtual ray determines the point that virtual ray is directed toward, in turn
It can capture the change information of the point of virtual ray direction, and carry out the manipulation of dummy object in scene according to the change information,
The object in augmented reality system is manipulated by way of virtual ray, reduces computation complexity, improves enhancing
Interactive efficiency in reality system.
It should be noted that although describing the operation of the method for the present invention in the accompanying drawings with particular order, this is not required that
Or hint must execute these operations in this particular order, or have to carry out operation shown in whole and be just able to achieve the phase
The result of prestige.On the contrary, the step of describing in flow chart can change and execute sequence.Additionally or alternatively, it is convenient to omit certain
Multiple steps are merged into a step and executed, and/or a step is decomposed into execution of multiple steps by step.
The course angle and pitch angle letter in the 3 shaft position information and 3 axis deflection angle information of controlling equipment can be passed through
Breath determines the direction that virtual ray is directed toward, wherein 3 shaft position information can be set by original position-information and for obtaining
3 axle acceleration sensors of standby acceleration information determine that 3 axis deflection angle information can be determined by 3 axis gyroscopes.This
When, step S101 determines the side that controlling equipment virtual ray is directed toward in scene according to the posture and location information of controlling equipment
To specifically including:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, really
Determine the direction that controlling equipment virtual ray is directed toward in scene.
In step s 103, it realizes in scene when the manipulation of dummy object, first including the position for changing dummy object,
The change to the position of dummy object can be realized, at this point, step S103 by the variation of the position for the point that virtual ray is directed toward
In, the change information for the point that virtual ray is directed toward is captured, and the manipulation of dummy object in scene, tool are carried out according to the change information
Body includes:
The change information of the posture of controlling equipment and the change information of location information and ray length is captured, and according to behaviour
It controls the posture of equipment and the change information of location information and the change information of ray length changes the position of respective virtual object.
Further, in step s 103, it realizes to when the manipulation of dummy object, can also including to dummy object in scene
Turning operation, turning operation can be carried out to dummy object by the variation of the flip angle of virtual ray, at this point, step S103
In, the change information for the point that virtual ray is directed toward is captured, and the manipulation of dummy object in scene is carried out according to the change information, also
Include:
The variation of the flip angle in 3 axis deflection angle information of controlling equipment is captured, and according in 3 axis deflection angle information
Flip angle variation, dummy object corresponding in scene is overturn.
In step S103, the change information for the point that virtual ray is directed toward is captured, and carry out in scene according to the change information
The manipulation of dummy object can be carried out in the specific implementation by following two mode:
Mode one determines the changing value for the point that virtual ray is directed toward, and changes the position and angle of dummy object according to changing value
Degree；
Mode two, by refreshing, the point for determining that virtual ray is directed toward changes, and determines what new virtual ray was directed toward
Point shows dummy object in scene according to the point that new virtual ray is directed toward, to realize the manipulation to dummy object in scene.
Further, the position that the point of virtual ray direction is determined for the ease of user, thus to the dummy object at the point
It is controlled, in the length of the virtual ray in the direction and setting that step S102 is directed toward according to virtual ray, determination is virtually penetrated
After the point that line is directed toward, further includes:
Laser point is shown in the point that virtual ray is directed toward by display equipment.
As shown in Fig. 2, to indicate convenient, virtual ray and virtual laser point are shown in Fig. 2, in practical application, virtually
Ray does not show that for virtual laser point by showing that equipment is shown, the user for only wearing display equipment is visible.
Further, this method further include:
When capturing the click signal of controlling equipment setting key, the virtual push button at point being directed toward to virtual ray is carried out
Clicking operation.
As shown in figure 3, likewise, showing virtual ray and virtual laser point, practical application in Fig. 2 to indicate convenient
In, virtual ray is not shown, for virtual laser point by showing that equipment is shown, the user for only wearing display equipment is visible.In Fig. 3
User can carry out clicking operation to virtual push button corresponding on virtual screen by virtual laser point, can also be by virtually swashing
Luminous point drags virtual screen frame, adjusts virtual screen size.
Specifically, in practical applications, depth measurement scanning current scene can be first passed through, obtain depth map, thus
The point cloud data of each position in scene is obtained, point cloud data real-time Transmission is realized into SLAM scene map structuring, and on the scene
The preparation of configuration dummy object is carried out in scape, obtains data information (3 axle acceleration, the 3 axis gyro of 6 freedom degrees of controlling equipment
Instrument), calibration certain point is positive direction, and converting to obtain controlling equipment current pose according to data information, (including 3 axis device locations are believed
Breath, 3 axis equipment deflection angle information) according to one line principle of two o'clock, it is a little controlling equipment, another point is scene midpoint cloud, root
According to controlling equipment posture and location information it is available in the scene, which point what controlling equipment was specifically directed towards is, place
Reason device shows virtual class ray bright spot in the target point of direction by display equipment.
It is operated by this, realizes the display position judgement for being accurate to the upper any point of material object in reality scene.Based on this
Ray maps to any point position in spatial scene by providing the length of ray.
All dummy objects can accurately be placed in any position in space based on this location determination as a result,.
Further, virtual laser point can carry out corresponding with the surface in kind in scene, i.e. realization controlling equipment to object
The positioning of any position in space can be realized in the vector line of surface point, the length by controlling the vector.It needs to infuse
3 shaft position information and course angle and pitch angle in 3 axis deflection angle information is mainly utilized in the positioning of meaning, laser point
Information, and flip angle is used for the rotation of laser point, and corresponding to the object of manipulation, the overturning of manipulation object may be implemented.In this rank
Section, virtual object can accurately be placed in realistic space scene, or the operation such as lift rotation, complete to be accurately located at
Complexity manipulation.
With further reference to Fig. 4, it illustrates the interactions being used in augmented reality system according to the application one embodiment
The exemplary block diagram of device.
As shown in figure 4, the device includes:
First determination unit 401 determines that controlling equipment is empty in scene for the posture and location information according to controlling equipment
The direction that quasi- ray is directed toward；
Second determination unit 402, the length of the virtual ray in direction and setting for being directed toward according to virtual ray, really
Determine the point of virtual ray direction；
Unit 403 is manipulated, the change information of the point for capturing virtual ray direction, and field is carried out according to the change information
The manipulation of dummy object in scape.
Further, the first determination unit 401 is specifically used for:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, really
Determine the direction that controlling equipment virtual ray is directed toward in scene.
Further, manipulation unit 403 is specifically used for:
The change information of the posture of controlling equipment and the change information of location information and ray length is captured, and according to behaviour
It controls the posture of equipment and the change information of location information and the change information of ray length changes the position of respective virtual object；
And/or
The variation of the flip angle in 3 axis deflection angle information of controlling equipment is captured, and according in 3 axis deflection angle information
Flip angle variation, dummy object corresponding in scene is overturn.
Further, the second determination unit 402 is also used to:
In the length of the virtual ray in the direction and setting be directed toward according to virtual ray, the point that virtual ray is directed toward is determined
Later, laser point is shown in the point that virtual ray is directed toward by display equipment.
Further, manipulation unit 403 is also used to:
When capturing the click signal of controlling equipment setting key, the virtual push button at point being directed toward to virtual ray is carried out
Clicking operation.
The device can be set in controlling equipment, also can be set in helmet matched with controlling equipment.
It should be appreciated that each in the method that all units or module recorded in device as shown in Figure 4 are described with reference Fig. 2
A step is corresponding.The operation above with respect to method description and feature are equally applicable to device as shown in Figure 4 and wherein as a result,
The unit for including, details are not described herein.Device as shown in Figure 4 can be realized in advance in the browser of electric equipment or other safety
In, it can also be loaded into the browser or its security application of electric equipment by modes such as downloadings.Dress as shown in Figure 4
The corresponding units set can be cooperated with the unit in electric equipment to realize the scheme of the embodiment of the present application.
Below with reference to Fig. 5, it illustrates the structural schematic diagrams for the equipment 500 for being suitable for being used to realize the embodiment of the present application.
As shown in figure 5, the equipment includes: processor 501, memory 502 and display 503；
Memory 502 includes the instruction that can be executed by processor 501 so that processor 501 executes:
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines the point that virtual ray is directed toward；
The change information for the point that virtual ray is directed toward is captured, and carries out the behaviour of dummy object in scene according to the change information
Control.
Further, as shown in fig. 6, the equipment, further includes:
3 axle acceleration sensors 504, for obtaining the acceleration information of equipment；
3 axis gyroscopes 505, for obtaining the deflection angle information of equipment；
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene, tool are determined
Body includes:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, really
Determine the direction that controlling equipment virtual ray is directed toward in scene.
Further, to carry and controlling convenient for user, the manipulation part of equipment and display portion can be provided separately, this
When, as shown in fig. 7, the equipment includes:
Controlling equipment 701, including first processor 7011, memory 7012,3 axle acceleration sensors 7013,3 axis gyros
Instrument 7014, wherein first processor 7011 is used for: it according to the posture and location information of controlling equipment 701, determines in scene and manipulates
The direction that 701 virtual ray of equipment is directed toward；The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines
The point that virtual ray is directed toward；The change information for the point that virtual ray is directed toward is captured, and void in scene is carried out according to the change information
The manipulation of quasi- object；
Equipment 702 is shown, including for display environment picture and the display 7021 of dummy object, second processor
7022, for obtaining the camera 7023 of external environment picture；
Wherein, controlling equipment 701 is connected with display equipment 702 by communication module.
Further, display 7021 is also used to:
Laser point is shown in the point that virtual ray is directed toward.
Further, controlling equipment 701 is also used to: when capturing the click signal of controlling equipment setting key, to virtual
The virtual push button at point that ray is directed toward carries out clicking operation.
The embodiment of the present invention also provides a kind of computer readable storage medium, is stored thereon with computer program, computer
Program is used for:
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines the point that virtual ray is directed toward；
The change information for the point that virtual ray is directed toward is captured, and carries out the behaviour of dummy object in scene according to the change information
Control.
Particularly, in accordance with an embodiment of the present disclosure, it may be implemented as computer software above with reference to the process of Fig. 1 description
Program.For example, embodiment of the disclosure includes a kind of computer program product comprising be tangibly embodied in machine readable media
On computer program, the computer program includes program code for executing the method for Fig. 1.In such embodiment
In, which can be downloaded and installed from network, and/or be mounted from detachable media.
Flow chart and block diagram in attached drawing are illustrated according to the system of various embodiments of the invention, method and computer journey
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
A part of one module, program segment or code of table, a part of the module, program segment or code include one or more
Executable instruction for implementing the specified logical function.It should also be noted that in some implementations as replacements, institute in box
The function of mark can also occur in a different order than that indicated in the drawings.For example, two boxes succeedingly indicated are practical
On can be basically executed in parallel, they can also be executed in the opposite order sometimes, and this depends on the function involved.Also it wants
It is noted that the combination of each box in block diagram and or flow chart and the box in block diagram and or flow chart, Ke Yiyong
The dedicated hardware based system of defined functions or operations is executed to realize, or can be referred to specialized hardware and computer
The combination of order is realized.
Being described in the embodiment of the present application involved unit or module can be realized by way of software, can also be with
It is realized by way of hardware.Described unit or module also can be set in the processor, for example, can be described as:
A kind of processor includes XX unit, YY unit and ZZ unit.Wherein, the title of these units or module is under certain conditions simultaneously
The restriction to the unit or module itself is not constituted, for example, XX unit is also described as " unit for XX ".
As on the other hand, present invention also provides a kind of computer readable storage medium, the computer-readable storage mediums
Matter can be computer readable storage medium included in device described in above-described embodiment；It is also possible to individualism, not
The computer readable storage medium being fitted into equipment.Computer-readable recording medium storage has one or more than one journey
Sequence, described program are used to execute the formula input method for being described in the application by one or more than one processor.
Above description is only the preferred embodiment of the application and the explanation to institute's application technology principle.Those skilled in the art
Member is it should be appreciated that invention scope involved in the application, however it is not limited to technology made of the specific combination of above-mentioned technical characteristic
Scheme, while should also cover in the case where not departing from the inventive concept, it is carried out by above-mentioned technical characteristic or its equivalent feature
Any combination and the other technical solutions formed.Such as features described above has similar function with (but being not limited to) disclosed herein
Can technical characteristic replaced mutually and the technical solution that is formed.
Claims (15)
1. the exchange method in a kind of augmented reality system, which comprises
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines the point that the virtual ray is directed toward；
The change information for the point that the virtual ray is directed toward is captured, and carries out the behaviour of dummy object in scene according to the change information
Control.
2. the method according to claim 1, wherein the posture and location information according to controlling equipment, really
Determine the direction that controlling equipment virtual ray is directed toward in scene, specifically include:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, field is determined
The direction that controlling equipment virtual ray is directed toward in scape.
3. the method according to claim 1, wherein the variation letter for capturing the point that the virtual ray is directed toward
Breath, and according to the manipulation of dummy object in change information progress scene, it specifically includes:
The change information of the posture of controlling equipment and the change information of location information and ray length is captured, and is set according to manipulation
The change information of standby posture and location information and the change information of ray length change the position of respective virtual object；With/
Or
The variation of the flip angle in 3 axis deflection angle information of controlling equipment is captured, and according to turning in 3 axis deflection angle information
The variation of corner overturns dummy object corresponding in scene.
4. the method according to claim 1, wherein the direction being directed toward according to virtual ray and setting
The length of virtual ray, after determining the point that the virtual ray is directed toward, further includes:
Laser point is shown in the point that virtual ray is directed toward by display equipment.
5. according to the method described in claim 4, it is characterized by further comprising:
When capturing the click signal of controlling equipment setting key, the virtual push button at point being directed toward to virtual ray is clicked
Operation.
6. the interactive device in a kind of augmented reality system, described device include:
First determination unit determines controlling equipment virtual ray in scene for the posture and location information according to controlling equipment
The direction of direction；
Second determination unit, the length of the virtual ray in direction and setting for being directed toward according to virtual ray, determine described in
The point that virtual ray is directed toward；
Unit is manipulated, carries out scene for capturing the change information for the point that the virtual ray is directed toward, and according to the change information
The manipulation of middle dummy object.
7. device according to claim 6, which is characterized in that first determination unit is specifically used for:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, field is determined
The direction that controlling equipment virtual ray is directed toward in scape.
8. device according to claim 6, which is characterized in that the manipulation unit is specifically used for:
The change information of the posture of controlling equipment and the change information of location information and ray length is captured, and is set according to manipulation
The change information of standby posture and location information and the change information of ray length change the position of respective virtual object；With/
Or
The variation of the flip angle in 3 axis deflection angle information of controlling equipment is captured, and according to turning in 3 axis deflection angle information
The variation of corner overturns dummy object corresponding in scene.
9. device according to claim 6, which is characterized in that second determination unit is also used to:
In the length of the virtual ray in the direction and setting be directed toward according to virtual ray, the point that the virtual ray is directed toward is determined
Later, laser point is shown in the point that virtual ray is directed toward by display equipment.
10. device according to claim 9, which is characterized in that the manipulation unit is also used to:
When capturing the click signal of controlling equipment setting key, the virtual push button at point being directed toward to virtual ray is clicked
Operation.
11. a kind of equipment, including processor, memory and display；It is characterized by:
The memory includes can be by instruction that the processor executes so that the processor executes:
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines the point that the virtual ray is directed toward；
The change information for the point that the virtual ray is directed toward is captured, and carries out the behaviour of dummy object in scene according to the change information
Control.
12. equipment according to claim 11, which is characterized in that further include:
3 axle acceleration sensors, for obtaining the acceleration information of equipment；
3 axis gyroscopes, for obtaining the deflection angle information of equipment；
The posture and location information according to controlling equipment determines the direction that controlling equipment virtual ray is directed toward in scene, tool
Body includes:
According to the course angle and pitch angle information in 3 shaft position information of controlling equipment and 3 axis deflection angle information, field is determined
The direction that controlling equipment virtual ray is directed toward in scape.
13. equipment according to claim 12, which is characterized in that the equipment includes:
Controlling equipment, including first processor, memory, 3 axle acceleration sensors, 3 axis gyroscopes, the first processor are used
In: according to the posture and location information of controlling equipment, determine the direction that controlling equipment virtual ray is directed toward in scene；According to virtual
The length of the virtual ray in direction and setting that ray is directed toward determines the point that the virtual ray is directed toward；It captures described virtual
The change information for the point that ray is directed toward, and according to the manipulation of dummy object in change information progress scene；
Show equipment, including for the display of display environment picture and dummy object, second processor, for obtaining extraneous ring
The camera of border picture；
The controlling equipment is connected with display equipment by communication module.
14. equipment according to claim 13, which is characterized in that the display is also used to:
Laser point is shown in the point that virtual ray is directed toward.
15. a kind of computer readable storage medium is stored thereon with computer program, the computer program is used for:
According to the posture and location information of controlling equipment, the direction that controlling equipment virtual ray is directed toward in scene is determined；
The length of the virtual ray in the direction and setting be directed toward according to virtual ray determines the point that the virtual ray is directed toward；
The change information for the point that the virtual ray is directed toward is captured, and carries out the behaviour of dummy object in scene according to the change information
Control.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710556621.1A CN109240484A (en) | 2017-07-10 | 2017-07-10 | Exchange method, device and equipment in a kind of augmented reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710556621.1A CN109240484A (en) | 2017-07-10 | 2017-07-10 | Exchange method, device and equipment in a kind of augmented reality system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109240484A true CN109240484A (en) | 2019-01-18 |
Family
ID=65083356
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710556621.1A Pending CN109240484A (en) | 2017-07-10 | 2017-07-10 | Exchange method, device and equipment in a kind of augmented reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109240484A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111459263A (en) * | 2019-01-21 | 2020-07-28 | 广东虚拟现实科技有限公司 | Virtual content display method and device, terminal equipment and storage medium |
| CN112286362A (en) * | 2020-11-16 | 2021-01-29 | Oppo广东移动通信有限公司 | Method, system and storage medium for displaying virtual prop in real environment picture |
| CN112742023A (en) * | 2021-01-13 | 2021-05-04 | 杭州电魂网络科技股份有限公司 | Control method and system of virtual gyroscope |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130083976A1 (en) * | 2011-10-03 | 2013-04-04 | Qualcomm Incorporated | Image-based head position tracking method and system |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN104756045A (en) * | 2012-10-04 | 2015-07-01 | 微软公司 | Wearable sensor for tracking articulated body-parts |
| US20160026253A1 (en) * | 2014-03-11 | 2016-01-28 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
| CN105912110A (en) * | 2016-04-06 | 2016-08-31 | 北京锤子数码科技有限公司 | Method, device and system for performing target selection in virtual reality space |
| US9465129B1 (en) * | 2009-03-06 | 2016-10-11 | See Scan, Inc. | Image-based mapping locating system |
| CN106716303A (en) * | 2014-09-12 | 2017-05-24 | 微软技术许可有限责任公司 | Stabilizing motion of an interaction ray |
| CN106920274A (en) * | 2017-01-20 | 2017-07-04 | 南京开为网络科技有限公司 | Mobile terminal 2D key points rapid translating is the human face model building of 3D fusion deformations |
-
2017
- 2017-07-10 CN CN201710556621.1A patent/CN109240484A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9465129B1 (en) * | 2009-03-06 | 2016-10-11 | See Scan, Inc. | Image-based mapping locating system |
| US20130083976A1 (en) * | 2011-10-03 | 2013-04-04 | Qualcomm Incorporated | Image-based head position tracking method and system |
| CN104756045A (en) * | 2012-10-04 | 2015-07-01 | 微软公司 | Wearable sensor for tracking articulated body-parts |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| US20160026253A1 (en) * | 2014-03-11 | 2016-01-28 | Magic Leap, Inc. | Methods and systems for creating virtual and augmented reality |
| CN106716303A (en) * | 2014-09-12 | 2017-05-24 | 微软技术许可有限责任公司 | Stabilizing motion of an interaction ray |
| CN105912110A (en) * | 2016-04-06 | 2016-08-31 | 北京锤子数码科技有限公司 | Method, device and system for performing target selection in virtual reality space |
| CN106920274A (en) * | 2017-01-20 | 2017-07-04 | 南京开为网络科技有限公司 | Mobile terminal 2D key points rapid translating is the human face model building of 3D fusion deformations |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111459263A (en) * | 2019-01-21 | 2020-07-28 | 广东虚拟现实科技有限公司 | Virtual content display method and device, terminal equipment and storage medium |
| CN111459263B (en) * | 2019-01-21 | 2023-11-03 | 广东虚拟现实科技有限公司 | Virtual content display method and device, terminal equipment and storage medium |
| CN112286362A (en) * | 2020-11-16 | 2021-01-29 | Oppo广东移动通信有限公司 | Method, system and storage medium for displaying virtual prop in real environment picture |
| CN112286362B (en) * | 2020-11-16 | 2023-05-12 | Oppo广东移动通信有限公司 | Method, system and storage medium for displaying virtual prop in real environment picture |
| CN112742023A (en) * | 2021-01-13 | 2021-05-04 | 杭州电魂网络科技股份有限公司 | Control method and system of virtual gyroscope |
| CN112742023B (en) * | 2021-01-13 | 2024-01-09 | 杭州电魂网络科技股份有限公司 | Control method and system of virtual gyroscope |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11967162B2 (en) | Method and apparatus for 3-D auto tagging | |
| US11887312B2 (en) | Fiducial marker patterns, their automatic detection in images, and applications thereof | |
| US10958891B2 (en) | Visual annotation using tagging sessions | |
| CN110073313B (en) | Interacting with an environment using a parent device and at least one companion device | |
| US10852847B2 (en) | Controller tracking for multiple degrees of freedom | |
| CN103460256B (en) | In Augmented Reality system, virtual image is anchored to real world surface | |
| Piekarski | Interactive 3d modelling in outdoor augmented reality worlds | |
| WO2017075932A1 (en) | Gesture-based control method and system based on three-dimensional displaying | |
| US20130229396A1 (en) | Surface aware, object aware, and image aware handheld projector | |
| CN109074660A (en) | The method and system of monocular camera real-time three-dimensional capture and immediate feedback | |
| US20120328158A1 (en) | Augmented reality method and devices using a real time automatic tracking of marker-free textured planar geometrical objects in a video stream | |
| US8838381B1 (en) | Automatic video generation for navigation and object finding | |
| CN105190703A (en) | 3D environmental modeling using photometric stereo | |
| US10192360B2 (en) | Information processing apparatus and information processing method | |
| KR102197615B1 (en) | Method of providing augmented reality service and server for the providing augmented reality service | |
| CN107407959A (en) | The manipulation of 3-D view based on posture | |
| CN109240484A (en) | Exchange method, device and equipment in a kind of augmented reality system | |
| US20200356233A1 (en) | Capture indicator for a virtual world | |
| CN117173756A (en) | Augmented reality AR system, computer equipment and storage medium | |
| Zhang et al. | Virtual reality aided high-quality 3D reconstruction by remote drones | |
| CN116472486A (en) | Image-based finger tracking and controller tracking | |
| JP2023171298A (en) | Adaptation of space and content for augmented reality and composite reality | |
| JP2005157610A (en) | Image processor and image processing method | |
| JP2015121892A (en) | Image processing apparatus, and image processing method | |
| US20230288690A1 (en) | Microscope system and system, method, and computer program for a microscope system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190118 |