CN109144239A

CN109144239A - A kind of augmented reality method, server and terminal

Info

Publication number: CN109144239A
Application number: CN201810609064.XA
Authority: CN
Inventors: 刘祖齐
Original assignee: Huawei Technologies Co Ltd
Current assignee: Huawei Technologies Co Ltd
Priority date: 2018-06-13
Filing date: 2018-06-13
Publication date: 2019-01-04
Anticipated expiration: 2038-06-13
Also published as: CN109144239B

Abstract

The present embodiments relate to a kind of augmented reality method, server and terminals.Method includes: the current geographic position information that server first receives the terminal from terminal, then the server receives request message from the terminal, the request message is used for request geographic location association data, then the server determines the geographic location association data according to the current geographic position information of the terminal, the last server sends the geographic location association data to the terminal, so that the terminal carries out augmented reality processing according to the geographic location association data.The embodiment of the present invention is capable of providing the information exchange with ambient enviroment, and user is made to obtain better user experience.

Description

A kind of augmented reality method, server and terminal

Technical field

The present invention relates to the communications field more particularly to a kind of augmented reality methods, server and terminal.

Background technique

With the development of science and technology, augmented reality (augmented reality, AR) technology and virtual reality (virtual Reality, VR) technology gradually entered into people life in.AR: augmented reality is answered virtual information by computer technology Use real world, true environment and virtual object have been added to the same picture in real time or space exists simultaneously.VR: Virtual reality is generated the virtual world of a three-dimensional space using computer simulation, provides user about vision, the sense of hearing, tactile The simulation of equal sense organs, allows user as being personally on the scene, can observe the thing in three-dimensional space in time, without limitation Object.

Current augmented reality method usually compares solidification, inflexible.By taking a moving scene as an example, in AR equipment Incoming information, motion state and forward image etc. can be shown on (such as AR glasses), but the social functions of AR equipment are opposite It is weaker, the information exchange with ambient enviroment is not provided, family is not available and obtains better user experience.

Summary of the invention

The embodiment of the invention provides a kind of augmented reality method, server and terminals, are capable of providing and ambient enviroment Information exchange makes user obtain better user experience.

In a first aspect, providing a kind of augmented reality method.Server receives the current geographic position of the terminal from terminal Confidence breath；The server receives request message from the terminal, and the request message is used for request geographic location association Data；The server determines the geographic location association data according to the current geographic position information of the terminal；The clothes Device of being engaged in the terminal sends the geographic location association data so that the terminal according to the geographic location association data into The processing of row augmented reality.

It is understood that above-mentioned terminal is AR equipment.The terminal can be dedicated AR equipment, such as AR glasses； The terminal may be general AR equipment, such as be equipped with the mobile phone of AR functional software.

The embodiment of the present invention does not carry out alone augmented reality processing by terminal, by terminal and server cooperate into The processing of row augmented reality.Server current geographic position information that the terminal is received from terminal first, the then server Request message is received from the terminal, the request message is used for request geographic location association data, the then service Device determines the geographic location association data according to the current geographic position information of the terminal, and the last server is to described Terminal sends the geographic location association data, so that the terminal carries out augmented reality according to the geographic location association data Processing.Therefore to carry out augmented reality processing associated with the current geographic position of itself for terminal, to realize and surrounding The information exchange of environment makes user obtain better user experience.

It should be noted that server receives the current geographic position information of the terminal from terminal and request message includes Two kinds of situations: the first situation, server can first receive the current geographic position information of the terminal from terminal, then described Server receives request message from the terminal again, for example, terminal periodic sends the current geographic of the terminal to server Location information sends request message when terminal receives user's instruction, then to server.Second situation, server is from institute It states terminal and receives request message, the current geographic position information of the terminal is carried in the request message.

In addition, it is necessary to explanation, it is optional step that the server, which receives request message from the terminal, and server can To send geographic location association data to terminal after receiving request message from the terminal, can also actively be pushed to terminal Geographic location association data, for example, pushing geographical location to terminal when server determines that the geographical location of terminal changes Associated data.

In a kind of possible embodiment, the geographic location association data are to be in same geographic region with the terminal The mark of other terminals within the scope of domain；The server is according to the current geographic position information of the terminal, from first list The mark of other terminals described in middle lookup, the first list include other terminals current geographic position information with it is described The corresponding relationship of the mark of other terminals.According to the embodiment, the user of terminal can be made to learn neighbouring user.

In a kind of possible embodiment, the geographic location association data are to be in same geographic region with the terminal Meet the mark of other terminals of preset condition within the scope of domain and with the parameter value of the match parameter of the terminal；In the service Before device determines the geographic location association data according to the current geographic position information of the terminal, the server is from described Terminal receives the parameter value of the match parameter of the terminal；The server is according to the current geographic position information and the end The parameter value of the match parameter at end, searches the mark of other terminals from second list, and the second list includes described The current geographic position information of other terminals, other terminals match parameter parameter value and other terminals mark Corresponding relationship.According to the embodiment, the user of terminal can be made to learn the user nearby to match with oneself.

In a kind of possible embodiment, the match parameter includes: user with speed and/or for identity user The parameter for rule of running.According to the embodiment, the user of terminal can be made to learn and nearby matched with oneself motion feature User.

In a kind of possible embodiment, the server sends the mark of other terminals to the terminal；? After the server sends the mark of other terminals to the terminal, the server to the terminal send whether with The prompt information that the user of other terminals is interacted；The server receives confirmation and other described ends from the terminal The instruction information that the user at end is interacted；The server establishes the terminal and other described ends according to the instruction information Communication connection between end, so that the user of the terminal and the user of other terminals are carried out mutually by the communication connection It is dynamic.According to the embodiment, the user near two can be made to be able to carry out interaction by server.

In a kind of possible embodiment, the geographic location association data are the current geographic position with the terminal Associated exercise suggestion data；The server obtains the current position according to the current geographic position information of the terminal Manage the corresponding meteorological data of location information or condition of road surface data；The server is according to the meteorological data or condition of road surface number According to determining the exercise suggestion data according to preset rules.According to the embodiment, can make the user of terminal learn with it is described The associated exercise suggestion data of the current geographic position of terminal, so as to according to geographical location dynamic adjustment exercise program.

For example, above-mentioned meteorological data includes temperature, humidity, wind speed or air quality etc..Above-mentioned condition of road surface data include It whether is ramp, curvature etc..

In a kind of possible embodiment, the exercise suggestion data include suggesting heart rate.According to the embodiment, use It family can be according to suggesting the heart rate of Rate control oneself in the suggestion heart rate hereinafter, in order to avoid excessive movement damages body.

In a kind of possible embodiment, the geographic location association data are the current geographic position with the terminal Associated audio or video data；The server is according to the current geographic position information of the terminal, from third list The audio or video data are searched, the third list, which includes that geographical location information is corresponding with audio or video data, closes System.According to the embodiment, user's uppick of terminal audio associated with the current geographic position of the terminal can be made Or video associated with the current geographic position of the terminal is watched, increase interest.

Second aspect provides a kind of augmented reality method.Terminal to server sends the current geographic position of the terminal Confidence breath；The terminal sends request message to the server, and the request message is used for request geographic location association Data；The terminal receives the corresponding geographic location association data of the current geographic position information from the server；It is described Terminal carries out augmented reality processing according to the geographic location association data.

The embodiment of the present invention does not carry out alone augmented reality processing by terminal, by terminal and server cooperate into The processing of row augmented reality.The terminal to server current geographic position information that sends the terminal first, then the terminal to The server sends request message, and the request message is used for request geographic location association data；The terminal is from institute It states server and receives the corresponding geographic location association data of the current geographic position information；The terminal is according to the geographical position It sets associated data and carries out augmented reality processing.Therefore terminal carries out the current geographic position of augmented reality processing and itself It is associated, to realize the information exchange with ambient enviroment, user is made to obtain better user experience.

In a kind of possible embodiment, the geographic location association data are to be in same geographic region with the terminal The mark of other terminals within the scope of domain；The terminal receives the mark of other terminals from the server.According to the reality Mode is applied, the user of terminal can be made to learn neighbouring user.

In a kind of possible embodiment, the geographic location association data are to be in same geographic region with the terminal Meet the mark of other terminals of preset condition within the scope of domain and with the parameter value of the match parameter of the terminal；The terminal Before receiving the corresponding geographic location association data of the current geographic position information from the server, the terminal is to described Server sends the parameter value of the match parameter of the terminal；The terminal receives the current geographic position from the server The corresponding geographic location association data of information, comprising: the terminal receives the mark of other terminals from the server.Root According to the embodiment, the user of terminal can be made to learn the user nearby to match with oneself.

In a kind of possible embodiment, the terminal from the server receive other terminals mark it Afterwards, the terminal receives the prompt information whether interacted with the user of other terminals from the server；The end It holds to the server and sends the instruction information that confirmation is interacted with the user of other terminals；The terminal passes through described Server establishes the communication connection between other described terminals；The terminal passes through the communication connection and other described terminals The message that the user of the user and other terminals of transmitting the terminal are interacted.According to the embodiment, can pass through Server makes the user near two be able to carry out interaction.

In a kind of possible embodiment, the geographic location association data are the current geographic position with the terminal Associated exercise suggestion data；The terminal receives the exercise suggestion data from the server.According to the embodiment, The user of terminal can be made to learn exercise suggestion data associated with the current geographic position of the terminal, so as to basis Geographical location dynamic adjustment exercise program.

In a kind of possible embodiment, the geographic location association data are the current geographic position with the terminal Associated audio or video data；The terminal receives the audio or video data from the server.According to the implementation Mode, can make user's uppick of terminal audio associated with the current geographic position of the terminal or watch with it is described The associated video of the current geographic position of terminal increases interest.

The third aspect, the embodiment of the invention provides a kind of server, which may be implemented above-mentioned first aspect side Performed function in method design, the function it is real can also to execute corresponding software by hardware realization by hardware It is existing.The hardware or software include one or more modules corresponding with above-mentioned function.

It include processor in the structure of the server in a possible design, which is configured as supporting to be somebody's turn to do Server executes corresponding function in above-mentioned first aspect method.The server can also include memory, which is used for It is coupled with processor, saves the necessary program instruction of the server and data.The server can also include communication interface, should Communication interface is for sending or receiving information, transmission audio or video data etc..

Fourth aspect, the embodiment of the invention provides a kind of terminal, which may be implemented above-mentioned second aspect method and sets Performed function, the function can also execute corresponding software realization by hardware realization by hardware in meter.Institute It states hardware or software includes one or more modules corresponding with above-mentioned function.

It include processor in the structure of the terminal in a possible design, which is configured as supporting the end End executes corresponding function in above-mentioned second aspect method.The terminal can also include memory, which is used for and processing Device coupling, saves the necessary program instruction of the terminal and data.The terminal can also include communication interface, which uses In sending or receiving information, transmission audio or video data etc..

5th aspect, the embodiment of the invention provides a kind of communication device, which may, for example, be chip, this is logical T unit can be set in server, which includes processor and interface.The processor is configured as supporting that this is logical T unit executes corresponding function in above-mentioned first aspect method.The interface is for supporting the communication device and other communication devices Or the communication between other network elements.The communication device can also include memory, which protects for coupling with processor Deposit the necessary program instruction of the communication device and data.

6th aspect, the embodiment of the invention provides a kind of communication device, which may, for example, be chip, this is logical T unit can be set in terminal, which includes processor and interface.The processor is configured as supporting the communication Device executes corresponding function in above-mentioned second aspect method.The interface for support the communication device and other communication devices or Communication between other network elements.The communication device can also include memory, which saves for coupling with processor The necessary program instruction of the communication device and data.

7th aspect, the embodiment of the invention provides a kind of computer storage medium, is deposited in the computer storage medium Instruction is contained, when run on a computer, so that computer executes any one of above-mentioned first aspect or first aspect Method described in possible design.

Eighth aspect is deposited in the computer storage medium the embodiment of the invention provides a kind of computer storage medium Instruction is contained, when run on a computer, so that computer executes any one of above-mentioned second aspect or second aspect Method described in possible design.

9th aspect, the embodiment of the invention provides a kind of computer program products, and it includes instructions, when described program quilt When performed by computer, the instruction is so that computer executes any one possible design of above-mentioned first aspect or first aspect Described in method.

Tenth aspect, the embodiment of the invention provides a kind of computer program products, and it includes instructions, when described program quilt When performed by computer, the instruction is so that computer executes any one possible design of above-mentioned second aspect or second aspect Described in method.

Tenth on the one hand, and the embodiment of the invention provides a kind of computer programs, and it includes instructions, when described program is counted When performed by calculation machine, the instruction is so that computer executes in any one possible design of above-mentioned first aspect or first aspect The method.

12nd aspect, the embodiment of the invention provides a kind of computer programs, and it includes instructions, when described program is counted When performed by calculation machine, the instruction is so that computer executes in any one possible design of above-mentioned second aspect or second aspect The method.

Detailed description of the invention

Fig. 1 be augmented reality method provided in an embodiment of the present invention based on a kind of system architecture schematic diagram；

Fig. 2 is a kind of augmented reality method communication scheme provided in an embodiment of the present invention；

Fig. 3 is another augmented reality method communication scheme provided in an embodiment of the present invention；

Fig. 4 is a kind of method flow diagram found with passerby provided in an embodiment of the present invention；

Fig. 5 is provided in an embodiment of the present invention a kind of to provide exercise suggestion method flow diagram；

Fig. 6 shows a kind of possible structural schematic diagram of server involved in the embodiment of the present invention；

Fig. 7 shows the alternatively possible structural schematic diagram of server involved in the embodiment of the present invention；

Fig. 8 shows a kind of possible structural schematic diagram of terminal involved in the embodiment of the present invention；

Fig. 9 shows the alternatively possible structural schematic diagram of terminal involved in the embodiment of the present invention；

Figure 10 is a kind of communication device schematic diagram provided by the embodiments of the present application.

Specific embodiment

The embodiment of the invention provides a kind of augmented reality method, server first receives the current of the terminal from terminal Geographical location information, then the server receives request message from the terminal, and the request message is for request Position related data is managed, then the server determines that the geographical location is closed according to the current geographic position information of the terminal Join data, the last server sends the geographic location association data to the terminal, so that the terminal is according to Geographic location association data carry out augmented reality processing.The embodiment of the present invention can be based on by cooperating for terminal and server Terminal current geographic position information provides the information exchange with ambient enviroment, and user is made to obtain better user experience.

This specification provide one or more embodiments in, the user of terminal may be implemented with the people on periphery, landscape with And the interaction of oneself three dimension.

In one example, the module for having network savvy, such as Wireless Fidelity are integrated in existing AR glasses (wireless-fidelity, Wifi) module, bluetooth module, honeycomb 2/3/4/5 generation (2/3/4/5generation, 2G/3G/ 4G/5G) communication module etc., to be connected to cloud server.After AR glasses are connected to cloud server, AR glasses and cloud are taken Business device interacts, and AR glasses report current geographic position information to cloud server, and cloud server is based on geographical in real time Location information has other AR glasses of similar parameters for the matching of AR glasses, and by the user of AR glasses be confirmed whether to need with The user of other AR glasses interacts, and parameter herein can be riding under moving scene/velocity is ridden/and run Route etc..It is understood that the embodiment of the present invention needs the scene interacted to be not specifically limited user, in addition to above-mentioned fortune The case where interacting is needed under dynamic scene, can also be needs under some scenic spot of visit and other scenes under tourism scene The case where interacting.

Fig. 1 be augmented reality method provided in an embodiment of the present invention based on a kind of system architecture schematic diagram.Referring to Fig.1, System mainly consists of two parts, and a part is server 110, alternatively referred to as cloud server, and server 110 mainly includes base In the database 111 of position, the database 112 based on user, computing engines module 113, transmission module 114 etc..Another part For terminal 120 (such as AR glasses), terminal 120 mainly includes locating module 121, image module 122, display module 123, power supply Module 124, computing module 125, pickup module 126, wireless module 127, pedometer module 128 etc..

Wherein in server 110, location-based database 111 is the various databases organized according to geographical location, than Scenic spot database such as based on geographical location tissue, the Crowds Distribute database based on geographical location tissue；Based on use The database 112 at family refers to the data of the case where for different user's daily exercises, such as the temperature of frequency of training, sports center The data such as degree/humidity/wind speed, exercise heart rate, training index, while the variation number of training front and back physical sign parameters can also be included According to, such as the muscle group moved, the data such as variation of body；Computing engines module 113 can be used for the interaction according to terminal 120 Demand carries out parameter matching in location-based database 111 or database 112 based on user, relatively to time requirement It is high；Transmission module 114, may include various wirelessly or non-wirelessly information transmission modulars, for example, Wifi, bluetooth (bluetooth, BT), the wire transmission module such as the wireless transport modules such as 2G/3G/4G/5G and copper wire, optical fiber.

Wherein in terminal 120, locating module 121 can be based on global positioning system (global positioning System GPS), dipper system, Galileo system, lattice Ross system etc., specific location can be accurately positioned；Image module 122 Refer to video system of such as taking pictures, can identify the scenery etc. in front；Display module 123 can refer to the display screen of terminal 120 (such as eyeglass of AR glasses), content can project display module 123；Computing module 125 is the processing system of terminal 120, For integrating the information such as locating module 121, image module 122, pickup module 126, wireless module is passed through according to the instruction of user 127 and server 110 interact, and receive the information from server 110 handled, so as to display the content in display In module 123；Wireless module 127 may include the wireless transport modules such as Wifi, BT, 2G/3G/4G/5G, for receiving Interactive information between transmitting server 110 and terminal 120；Pedometer module 128 is for measuring and recording running or cycling Speed matches the data such as speed, heart rate.

As Fig. 1 system in, terminal 120 can be dedicated AR equipment, such as AR glasses, provided in an embodiment of the present invention AR glasses can increase locating module and wireless module on the basis of existing common AR glasses, facilitate positioning and transmission information. Terminal 120 or general AR equipment, such as the mobile phone of AR functional software is installed, mobile phone usually just has locating module And wireless module.

Fig. 2 is a kind of augmented reality method communication scheme provided in an embodiment of the present invention, which can be based on Fig. 1 Shown in system architecture, this method comprises:

Step 201, terminal to server sends the current geographic position information of the terminal；

Step 202, terminal sends request message to the server, and the request message is used for request geographical location Associated data；

Step 203, server determines the geographic location association data according to the current geographic position information of the terminal；

Step 204, server sends the geographic location association data to the terminal；

Step 205, terminal carries out augmented reality processing according to the geographic location association data.

The specific executive mode of above each step is described below.

First in step 201, terminal to server sends the current geographic position information of the terminal.It is appreciated that eventually End can be to the current geographic position information of terminal described in server periodicity sending, correspondingly, and server periodically updates institute The current geographic position information of terminal is stated, server can only save the current geographic position of the last terminal received Information.

Then in step 202, terminal sends request message to the server, and the request message is for request Manage position related data.

In a kind of possible embodiment, the geographic location association data are to be in same geographic region with the terminal The mark of other terminals within the scope of domain.In a kind of possible embodiment, the geographic location association data be with it is described Terminal is in same geographical coverage area and meets other ends of preset condition with the parameter value of the match parameter of the terminal The mark at end.In a kind of possible embodiment, the geographic location association data are the current geographic position with the terminal Set associated exercise suggestion data.In a kind of possible embodiment, the geographic location association data are and the end The associated audio or video data of the current geographic position at end.

It is understood that the geographical location that the server that can make an appointment between terminal and server is sent to terminal is closed Join data.Alternatively, terminal can send different types of request message to server according to the different demands of the user of terminal, The type for the geographic location association data that server is sent according to the true directional terminals of request message.

In one example, the request message is in same geographical coverage area for request and the terminal Other terminals mark.

In another example, the server also receives the parameter value of the match parameter of the terminal from the terminal； The request message is in same geographical coverage area for request and the terminal and the matching with the terminal The parameter value of parameter meets the mark of other terminals of preset condition.Wherein, the match parameter can be, but not limited to include: use The parameter of the running rule with speed and/or for identity user at family, the parameter example of the above-mentioned running rule for identity user It can be such as the initial time for entering above-mentioned same geographical coverage area.

In another example, the request message is associated with the current geographic position of the terminal for request Exercise suggestion data.For example, the exercise suggestion data include suggesting heart rate.

In another example, the request message is associated with the current geographic position of the terminal for request Audio or video data.

Then in step 203, server determines that the geographical location is closed according to the current geographic position information of the terminal Join data.

In one example, the geographic location association data are to be in same geographical coverage area with the terminal The mark of other terminals；The server according to the current geographic position information of the terminal, searched from first list described in The mark of other terminals, the first list include other terminals current geographic position information and other terminals The corresponding relationship of mark.

In another example, the geographic location association data are to be in same geographical coverage area with the terminal And meet the mark of other terminals of preset condition with the parameter value of the match parameter of the terminal；Before step 203, described Server receives the parameter value of the match parameter of the terminal from the terminal；In step 203, the server is worked as according to The parameter value of the match parameter of preceding geographical location information and the terminal searches the mark of other terminals from second list Know, the second list include the current geographic position information of other terminals, other terminals match parameter ginseng The corresponding relationship of the mark of numerical value and other terminals.

For example, the match parameter includes: the parameter of the running rule with speed and/or for identity user of user.

In another example, the geographic location association data are associated with the current geographic position of the terminal Exercise suggestion data；The server obtains the current geographic position letter according to the current geographic position information of the terminal Cease corresponding meteorological data or condition of road surface data；The server according to the meteorological data or condition of road surface data, according to Preset rules determine the exercise suggestion data.

For example, above-mentioned meteorological data includes temperature, humidity, wind speed or air quality etc..Above-mentioned condition of road surface data include It whether is ramp, curvature etc..The exercise suggestion data include suggesting heart rate etc..

In another example, the geographic location association data are associated with the current geographic position of the terminal Audio or video data；The server according to the current geographic position information of the terminal, searched from third list described in Audio or video data, the third list include the corresponding relationship of geographical location information Yu audio or video data.

Wherein, the request message that server can be sent according to step 202 terminal, according to the current geographic position of the terminal Confidence breath determines the geographic location association data, and this will not be repeated here.

Then in step 204, server sends the geographic location association data to the terminal.

In one example, the mark for other terminals that the server is determined to the terminal sending step 203.

Optionally, after the server sends the mark of other terminals to the terminal, the server is to institute It states terminal and sends the prompt information whether interacted with the user of other terminals；The server is received from the terminal Confirm the instruction information interacted with the user of other terminals；The server is according to instruction information foundation Communication connection between terminal and other described terminals, so that the user of the terminal and the user of other terminals pass through institute Communication connection is stated to be interacted.

In another example, the exercise suggestion data that the server is determined to the terminal sending step 203.

In another example, the audio or video data that the server is determined to the terminal sending step 203.

Finally in step 205, terminal carries out augmented reality processing according to the geographic location association data.

In one example, the terminal can be established with other terminals according to the mark of other terminals received and be communicated Connection, to realize interacting for the user of terminal and the user of other terminals.

In another example, the terminal is according to the exercise suggestion data point reuse exercise program received, to realize The user of terminal interacts with oneself.

In another example, the terminal plays the audio or video according to the audio or video data received Data interact to realize with ambient enviroment.

In system shown in Figure 1, terminal has locating module and wireless module, facilitates positioning and transmission information.Its In, terminal can be, but not limited to the current geographic position information to terminal described in server transport, user name, user with speed, One or more information in the information such as the parameter (can referred to as run rule) of running rule for identity user.

Server mainly includes location-based database and the database based on user.Above-mentioned database can be pre- It first configures, is also possible to what basis was updated from received property information cycle of terminal.Be given below location-based database and The example of database based on user.Wherein, its format one of location-based database is as shown in Table 1.

Table one: location-based database format one

Coordinate	User name	With speed	Running rule
				(x1, y1, z1)	First	700	6 points of morning run 30 minutes
(x2, y2, z2)	Second	650	6 points of morning run 10 minutes
				(x3, y3, z3)	Third	630	6 points of morning run 45 minutes
(x4, y4, z4)	Fourth	600	6 points of morning run 35 minutes
				……	……	……	……

Wherein, table one can be equivalent to aforementioned first list or second list, and user name can be equivalent to the mark of terminal. Server can update table one according to from received property information cycle of terminal.The specific coordinate of location-based database format, There is relationship with receiver concrete model, can be latitude and longitude coordinates or X, Y, Z coordinate or both of which have.With speed 700 It is meant that every kilometer of running of nail spends 7 minutes.Refer within 30 minutes user's first 6:00 AM 30 minutes for 6 points of morning run in running rule It runs the geographic area identified into coordinate (x1, y1, z1).

In addition, its format two of location-based database is as shown in Table 2 in server.

Table two: location-based database format two

Coordinate	Sight spot name	Audio	Video
				(x1, y1, z1)	Broken Bridge with Thawing Snow	White wife's legend	Broken Bridge with Thawing Snow snow scenes
(x2, y2, z2)	Pinghu autumn month	The night of flowers and moonlight by the spring river	Pinghu autumn in mid-autumn month
				(x3, y3, z3)	G20 performance ground	Most recall is Hangzhou	G20 performs segment
(x4, y4, z4)	Lotus in the Breeze near Quyuan Garden	The inner poem of poplar ten thousand	Summer lotus exhibition
				……	……	……	……

Wherein, table two can be equivalent to aforementioned third list.Server can be pre-configured with table two.Table two includes geographical position The corresponding relationship with audio and video is set, such as coordinate (x1, y1, z1), the sight spot of this coordinate is Broken Bridge with Thawing Snow, works as trip When visitor, running, cycling are by a certain range of this coordinate, the audio story of " white wife's legend " can be appreciated, while at end The Broken Bridge with Thawing Snow snow scenes video being superimposed upon on screen is seen on end (such as AR glasses).

In addition, its format one of the database based on user is as shown in Table 3 in server.

Table three: the database format one based on user

Wherein, server can update table three according to from received property information cycle of terminal.Referring to table three, user's first is in place In coordinate (x1, y1, z1) exercise heart rate be 140, that is, heartbeat per minute 140 under, while at this time coordinate (x1, y1, Z1 temperature/humidity/wind speed) is respectively 25 degree, 75% and 4 grade.

In addition, its format two of the database based on user is as shown in Table 4 in server.

Table four: the database format two based on user

User	Age	Weight	Height
				First	41	65	170
Second	50	68	165
				Third	28	75	178
Fourth	35	76	172
				……	……	……	……

Wherein, server can be pre-configured with table four.Data in table four can derive from the registration information of user.Referring to Table four, from weight and height data, according to BMI=weight/(height * height), it can be determined that whether particular user is overweight, BMI (first)=22.49, BMI (second)=24.97, BMI (third)=23.67, BMI (fourth)=25.68, it is therefore apparent that user's first and use The third Normal-weight of family, and user's second and user's fourth are overweight, and for overweight user, generally it is not recommended that the speed of its movement It is too high, in order to avoid damage body.Server can send exercise suggestion data to terminal according to the data in table four, so that terminal is used Family adjusts the exercise intensity of oneself.

It is understood that the computing engines module in server is to realize the pass of augmented reality of embodiment of the present invention method The current geographic position information of key, the terminal that computing engines module is used to be sent according to terminal determines geographical location incidence number According to, and the geographic location association data are sent to terminal by transmission module, so that terminal (such as AR glasses) be made to obtain the ground Position related data is managed, has social functions, has the interaction function with the people on periphery, landscape and oneself three dimension.

Several formats of database based on above-mentioned introduction are discussed in detail so that terminal is AR glasses as an example of the invention real below The augmented reality method of example offer is provided.

Fig. 3 is another augmented reality method communication scheme provided in an embodiment of the present invention, which can be based on System architecture shown in FIG. 1, the main body being related to include AR glasses (first), cloud server and AR glasses (second), this method comprises:

Step 301, AR glasses send data to cloud server.

It is understood that AR glasses (first) and AR glasses (second) transmit data to cloud server respectively.

For example, above-mentioned data can be, but not limited to include: AR glasses current geographic position information, user name, user With speed, for one or more information in the information such as the parameter (can referred to as run rule) of running rule of identity user.

Step 302, cloud server storing data.

In one example, after cloud server receives the data of AR glasses (first) and AR glasses (second), data are stored In database, data can be according to the format analysis processing of table one, table two, table three and table four.

Step 303, AR glasses transmit a request to cloud server.

It is understood that AR glasses (first) and AR glasses (second) transmit a request to cloud server respectively, which can To be the audio, video data in a certain coordinate range of request, be also possible to request search it is identical with speed running fan, Ride fan etc..

Step 304, cloud server processing request.

In one example, after cloud server receives the requests of AR glasses (first) and AR glasses (second), according to database It the operation processing requests such as inquires and compares, and processing result is sent respectively to AR glasses (first) and AR glasses (second).

For different requests, different processing modes is taken, including finds and is less than preset threshold with speed deviation with region And the similar same passerby of running rule, trained suggestion is provided, the audio and video etc. of particular geographic location are played.

Step 305, cloud server sends processing result and gives AR glasses.

Step 306, the data such as audio-video are presented in AR glasses.

In one example, the respective coordinates that AR glasses (first) and AR glasses (second) can send over cloud server A certain range of audio, video data is shown on the display screen of AR glasses.

In addition after being also possible to AR glasses (first) and AR glasses (second) user's successful match, one starting stride of agreement is cycled Or other activities, the sign data for being also possible to cloud server in conjunction with each user provide exercise suggestion, effect of controling oneself etc..

Step 307, AR glasses respond processing result.

It is understood that with the change of AR eye positions, above-mentioned treatment process server, AR glasses (first) beyond the clouds The circular treatment between AR glasses (second), with this recursion.

The embodiment of the present invention, cloud server can carry out information exchange with AR glasses (first), AR glasses (second), to difference The data of AR glasses are integrated, to realize between the user of AR glasses, the user of AR glasses and surrounding scenery, AR glasses User interacts with itself.

Wherein, cloud server may not only carry out information exchanges with two AR glasses in practice, but with it is a large amount of (such as 1000) AR glasses carry out information exchange, and processing mode is identical as the processing mode of two AR glasses, and this will not be repeated here.

The embodiment of the invention provides one kind of a kind of combination end side AR glasses, cloud side cloud server to be based on geographical location End cloud collaboration augmented reality method.It is made further below with reference to augmented reality method communication scheme shown in Fig. 3 Detailed description, wherein the request of cloud server processing AR glasses is the core point of the embodiment of the present invention.

In step 301, AR glasses send data to cloud server.

In one example, wear AR glasses user's first and user's second, running or cycle or tourism etc. respectively into Enter the region of coordinate (x1, y1, z1) mark, the region of coordinate (x2, y2, z2) mark, the locating module of AR glasses identifies user The geographical coordinate of first and user's second is respectively (x1, y1, z1), (x2, y2, z2), and by pre-registered user name first and second, is taken With running with fast data 700,650, and entering 6 points of zone time 30 minutes, 6 points of (x1, y1, z1), (x2, y2, z2) Cloud server is given in 10 distributions.That wherein runs is obtained with fast data by the pedometer module of AR glasses.The data of user's first As shown in Table 5, the data of user's second are as shown in Table 6.

Table five: the data of user's first

Coordinate	User name	With speed	Running rule
				(x1, y1, z1)	First	700	6 points of morning run 30 minutes

Table six: the data of user's second

Coordinate	User name	With speed	Running rule
				(x2, y2, z2)	Second	650	6 points of morning run 10 minutes

AR glasses (first) and AR glasses (second) respectively in connection with user's second in the data and table six of user's first in table five data, It is packaged according to wireless data transmission format, cloud server is sent to by the wireless module of AR glasses, wherein data are transmitted Format is determined with the transmission mode between AR glasses and cloud server, such as if it is 3G wireless transmission method, then according to 3G The format of wireless transmission method encapsulates.

In step 302, cloud server storing data.

In one example, cloud server receives the data of AR glasses (first) and AR glasses (second), according to table seven Format stores data into location-based database.

Table seven: cloud server storing data

Coordinate	User name	With speed	Running rule
				(x1, y1, z1)	First	700	6 points of morning run 30 minutes
(x2, y2, z2)	Second	650	6 points of morning run 10 minutes

Wherein the critical field of database of the cloud server based on geographical location is coordinate, using coordinate as storing data Index.

In step 303, AR glasses transmit a request to cloud server.

In one example, AR glasses (first) and AR glasses (second) transmit a request to cloud server respectively, and AR glasses are logical The solicited message that pickup module obtains user is crossed, the request data of user is sent at AR glasses computing module by pickup module Reason, and cloud server is sent by wireless module by processing result.

Above-mentioned request may is that running same passerby, offer training suggestion or training effect of the searching with fast 30 seconds deviations are in Now even virtual encouragement, the audio and video for playing particular geographic location etc..

In step 304, cloud server processing request.

It can be understood that cloud server receives the request of AR glasses (first) and AR glasses (second), asked for different It asks, takes different processing modes, illustrate separately below.

And running rule similar same passerby smaller with speed deviation with region is found in request one.

Application scenarios 1: the West Lake is the place of public daily exercise from Bai Causeway Broken Bridge with Thawing Snow to Su Causeway Fish Wonder at Huagang Crook, and approach is disconnected Bridge, brocade band bridge, the moon in Pinghu autumn, the West Lake Art Museum, Zhejiang museum, Xihu Museum, Zhongshan Park, Chamber of Literature Prosperity, Xiling Seal Society, Western cool bridge, Wu Song's tomb, yellow guest's rainbow sculpture, autumn a beautiful gem wind and rain pavilion, G20 performance ground, Lotus in the Breeze near Quyuan Garden, Fish Wonder at Huagang Crook, Lin Huiyin hollow out carving Modeling etc..It is daily the West Lake running, ride, find the much the same people of speed be one challenge.For example tri- day for human beings of A, B, C is often all to match Speed is run for 7min/Km, and exercise time is also similar, is currently worn smartwatch movement, but respectively run respectively, is not handed over substantially Collection.By the augmented reality method based on geographical location, cloud server can push the object for meeting the match parameter of setting, than It is lower than the object of preset threshold, with speed difference value such as so as to realize that more people interact.For example, A, B, C can be received is The information of no interaction can go with when determining interact with one another and run or ride, increase many enjoyment and power, mutually swash It encourages.

Under above-mentioned application scenarios, satisfactory data are retrieved from location-based database, for example, issuing request It is user's first in table one, is to find in same coordinate (x1, y1, z1) range with fast 30 seconds deviations, running for request Regular time difference is not more than 10 minutes same passerbys of running.Concrete processing procedure can be as shown in Figure 4:

Step 401, retrieval is in coordinate (x1, y1, z1) all users.

Firstly, computing engines module in cloud server with coordinate (x1, y1, z1) for critical field, be entirely based on It is retrieved in the database of position, cloud server also receives in geographical position coordinates (x1, y1, z1) a certain range The information of other runnings, cycling or traveller, result such as eight geographical location of table (x1, y1, z1) the user information institute after retrieval Show.

Table eight: geographical location (x1, y1, z1) user information

Coordinate	User name	With speed	Running rule
				(x1, y1, z1)	First	700	6 points of morning run 30 minutes
(x1, y1, z1)	A	640	6 points of morning run 25 minutes
				(x1, y1, z1)	B	720	6 points of morning run 00 minute
(x1, y1, z1)	C	400	6 points of morning run 30 minutes
				……	……	……	……

Step 402, retrieval is with the fast user in a certain range.

Secondly, to be retrieved with fast critical field as term, and comparing with fast field, judgement is with speed in conjunction with table eight Whether the absolute value of difference calculates less than 30 seconds | match fast (Y) with fast (X)-| < 30 seconds, wherein | ... | represent absolute value The meaning, the result after retrieval are if table nine is with shown in the different user information within the scope of 30 seconds of speed difference.

Table nine: match the different user information within the scope of 30 seconds of speed difference

Coordinate	User name	With speed	Running rule
				(x1, y1, z1)	First	700	6 points of morning run 30 minutes
(x1, y1, z1)	A	640	6 points of morning run 25 minutes
				(x1, y1, z1)	B	720	6 points of morning run 00 minute

Step 403, retrieval meets the user of running rule.

Again, in conjunction with table nine, it is that critical field is retrieved, and compares the regular field of running with running rule, judges to run The absolute value of regular time difference is walked whether less than 10 minutes, that is, is calculated | regular (X)-running of running is regular (Y) | and < 10 minutes, Wherein | ... | the meaning for representing absolute value, result after retrieval are run regular difference institute within the scope of 10 minutes for such as table ten Show.

Table ten: match the different user information within the scope of 30 seconds of speed difference

Coordinate	User name	With speed	Running rule
				(x1, y1, z1)	First	700	6 points of morning run 30 minutes
(x1, y1, z1)	A	640	6 points of morning run 25 minutes

Step 404, the user name of the user retrieved is exported.

Finally, cloud server exports user name A.That is, user's first can pass through the calculating of cloud server Engine modules retrieve in same moving region and oneself match within speed difference different 30 seconds, while rule of running was less than 10 minutes User A.

Request two, provides trained suggestion.

Application scenarios 2: the data of user during exercise are shown in current various VR and AR glasses, such as when heart rate, movement On the basis of long, consumption calorie, according to the variation and state of human body when user movement, show current kinetic position or Muscle group, and the role of personal coach is served as, instruct or correct current motion mode；Or display for a user post exercise modeling Body effect encourages user to adhere to moving；Or according to the data training of user or the parameter of adjustment body-building equipment, so that body-building is set It is standby to be more suitable for active user.

Based on this application scene: the data of reference table one, table three and table four, user's fourth can be such as table 11,12 and of table Shown in table 13.

Table 11: the data one of user's fourth

Table 12: the data two of user's fourth

User	Heart rate	Temperature/humidity/wind speed	Coordinate
				Fourth	170	25/80%/3	(x4, y4, z4)

Table 13: the data three of user's fourth

User	Age	Weight	Height
				Fourth	35	76	172

The data of table 11, table 12 and table 13 illustrate that user's fourth is overweight, running with speed be every kilometer 6 minutes, sitting The temperature for marking the sports center (x4, y4, z4) movement is 25 degree, and humidity 80%, wind speed is 3 grades, which can To be obtained from local weather server.The flow chart for providing exercise suggestion can be as shown in Figure 5.

Step 501, the temperature difference of Current Temperatures and preset temperature is calculated.

For example, temperature difference can be calculated according to formula Tdiff=Tnow-14.Wherein, Tdiff represents temperature difference, Tnow generation Table Current Temperatures, 14 represent preset temperature.

Step 502, the psychrometric difference of current humidity and default humidity is calculated.

For example, psychrometric difference can be calculated according to formula Hdiff=Hnow-50%.Wherein, Hdiff represents psychrometric difference, Hnow Current humidity is represented, 50% represents default humidity.

Step 503, it is calculated according to the age of user, temperature difference, psychrometric difference and suggests heart rate.

For example, can suggest that heart rate=180-Age-Tdiff-Hdiff/10% is calculated according to formula suggests heart rate.Wherein, Age represents the age of user, and Tdiff represents temperature difference, and Hdiff represents psychrometric difference.

Step 504, heart rate is suggested in output.

It finds, is required according to laws of motion after study, the age of general exercise heart rate=180- user, for user For fourth, exercise heart rate=180-35=145bpm, and the heart rate of actual user's fourth is 170bpm, beyond suggestion heart rate 170- 145=25bpm, cloud server can provide trained suggestion thus, it is proposed that user's fourth reduces speed, while observing heart rate test number According to, until heart rate be lower than 145bpm, notice that heart rate test temperature at this time is 14 degree, the data of 50% humidity.

Further, it is contemplated that the temperature or humidity or wind speed in this region, the general higher heart rate of temperature is higher, and humidity is bigger Heart rate is higher, and rule, which is that temperature is every, to be increased once, and heart rate increases 1bpm, and humidity is every to increase 10%, and heart rate increases 1bpm, in conjunction with Local temperature and humidity, cloud server can provide suggestion heart rate here and now be 145- (25-14)-(80%-50%)/ 10%=131bpm.Namely cloud server suggests that the heart rate that user's fourth is run here and now is 131bpm.

To sum up, exercise heart rate=180-Age- (Tnow-14)-(Hnow-50%)/10, wherein Age is the age of user, Tnow is the temperature under user movement scene, and Hnow is the humidity under user movement scene.With the change of user's fourth running position Change, temperature and humidity data constantly change, the suggestion heart rate meeting minor change that cloud server provides, that is to say, that cloud service Device suggests that the exercise heart rate of user's fourth is dynamic change, does not have to and different with the environment of movement.

In one example, cloud server is when providing exercise suggestion, in addition to considering temperature, humidity, wind speed, age It influences, it is also contemplated that the road datas such as ramp, curvature.

Request three, plays the audio and video of particular geographic location.

Application scenarios 3: it travels to some unfamiliar place, it is seen that current scenery, some static text descriptions are introduced, But it often knows little about it to the history of scenery, especially dynamic video/audio, history anecdotes are with regard to less.By based on geographical position The augmented reality method set, cloud server can correspond to the audio/video information at some sight spot based on location push, wear AR Mirror can be heard and see information abundant, and the interest of tourism is increased.

Based on the application scenarios, user's propyl in geographical location data as shown in table 14:

Table 14: user's propyl is in the data in geographical location

Coordinate	User name	With speed	Running rule
				(x3, y3, z3)	Third	630	6 points of morning run 45 minutes

When the position coordinate (x3, y3, z3) is arrived in 6 points of runnings in 45 minutes to user third in the morning, AR glasses pass through wireless network to cloud Server is held to send request, request plays the audio and video of particular geographic location；When cloud server receives AR glasses hair It is keyword in position database retrieval using three-dimensional coordinate, the data retrieved are as shown in table 15 after request out.

Table 15: the data in the geographical location coordinate (x3, y3, z3)

Coordinate	Sight spot name	Audio	Video
				(x3, y3, z3)	G20 performance ground	Most recall is Hangzhou	G20 performs segment

By table 15 as it can be seen that user third is in the position coordinate (x3, y3, z3), the audio of broadcasting is " most recall is Hangzhou ", is played Video be " G20 perform segment ".It is constantly moving when third, shift position, the audio and video information of cloud server feedback Change with the variation of position, that is, be dynamic change, such as at position (x1, y1, z1), audio is exactly that " white wife passes It is odd ", video is exactly " Broken Bridge with Thawing Snow snow scenes ", and at position (x2, y2, z2), audio is exactly " night of flowers and moonlight by the spring river ", and video is exactly " Pinghu autumn in mid-autumn month ".

In step 305, cloud server sends processing result and gives AR glasses.

For three kinds of scenes above, the processing result that cloud server sends computing engines module gives AR glasses.

When for similar same passerby's scene regular compared with dogtrot with speed deviation with region is found, cloud server is sent The user A retrieved gives user's first, the request of the Data Matching first of user A.

When for training suggestion scene is provided, cloud server, which sends training, suggests giving user's fourth, comprehensively considers user Height, weight, sports center temperature there and then, humidity and wind speed, it is proposed that user's fourth is moved with heart rate 131bpm, In order to avoid damage body.User's fourth monitors the heart rate of oneself in real time by the module of the measurement heart rate of AR glasses, and Rate control is existed 131bpm or less.

When for play particular geographic location audio and video scene when, cloud server will " most recall is Hangzhou " sound Frequency or " G20 performs segment " are passed on the AR glasses of user third in the form of Streaming Media by wireless network, wherein view is wireless Network bandwidth situation judges whether the storage device space that audio or video data are downloaded to AR glasses.

Within step 306, the data such as audio-video are presented in AR glasses.

For three kinds of scenes above, after AR glasses receive the information of cloud server transmission.

When for similar same passerby's scene regular compared with dogtrot with speed deviation with region is found, user's first passes through AR Mirror is exchanged by phone or wechat or QQ by speech ciphering equipment with user A, it is determined whether is taken exercise together, or is shared sound It is happy, or share movement gains in depth of comprehension.

When for training suggestion scene is provided, user's fourth receives the information of cloud server, and control exercise heart rate exists 131bmp hereinafter, on AR glasses real-time display user fourth exercise heart rate, can be in such a way that similar vehicle-mounted new line be i.e. aobvious.

When for the audio and video scene for playing particular geographic location, user third receives cloud server transmission Streaming Media " most recall is Hangzhou " audio or " G20 performs segment " video, audio/video information can be shown on AR glasses.

In step 307, AR glasses respond processing result.

For example, AR glasses send feedback information to cloud server, i.e. confirmation message has received, and responds processing result.

The embodiment of the present invention receives the solicited message that each AR glasses are sent by cloud server, cloud server Computing engines module is retrieved and is calculated, until meeting AR in the database based on geographical location and the database based on user The solicited message that glasses are sent.Search result is fed back to AR glasses by cloud server simultaneously, and search result is shown in AR On glasses.This embodiment achieves users to wear user interaction and the periphery of AR glasses by other of AR glasses and periphery The interaction of environment scenery, and oneself interaction after exercise.

The embodiment of the invention provides a kind of, and the end cloud based on geographical location cooperates with augmented reality method.End side AR glasses hair After sending location-based request, cloud side cloud server to receive request, the location-based database of computing engines module synthesis With the database based on user, calculates the result for meeting request and feed back the AR glasses of an end side.Computing engines module point difference Scene realization, pass through audio, video data library of the retrieval based on geographical location, or the sign and local environment that pass through user Data provide the suggestion of user's exercise, or the other users of retrieval matching user's request.Computing engines module passes through retrieval base In position audio, video data library and be sent to the AR glasses of user, realize the interaction of user and surrounding enviroment；Computing engines mould Block provides the suggestion of user's exercise by the sign and local environment data of analyzing user and issues the AR glasses of user, realizes The interaction of user and oneself；Computing engines module realizes user and other use by the other users of retrieval matching user's request The interaction at family.

It is above-mentioned to be mainly described from scheme of the angle of method flow to the embodiment of the present invention.It is understood that In order to realize the above functions, it comprises execute each corresponding hardware configuration of function for each network element, such as server, terminal etc. And/or software module.Those skilled in the art should be readily appreciated that, described in conjunction with the examples disclosed in this document each Exemplary unit and algorithm steps, the present invention can be realized with the combining form of hardware or hardware and computer software.Some Function is executed in a manner of hardware or computer software driving hardware actually, depending on technical solution specific application and set Count constraint condition.Professional technician can use different methods to achieve the described function each specific application, But such implementation should not be considered as beyond the scope of the present invention.

The embodiment of the present invention can carry out the division of functional module, example according to above method example to server, terminal etc. Such as, each functional module of each function division can be corresponded to, two or more functions can also be integrated at one It manages in module.Above-mentioned integrated module both can take the form of hardware realization, can also use the form of software function module It realizes.It should be noted that being schematical, only a kind of logic function stroke to the division of module in the embodiment of the present invention Point, there may be another division manner in actual implementation.

Using integrated module, one kind that Fig. 6 shows server involved in above-described embodiment can The structural schematic diagram of energy.Server 600 includes: processing module 602, communication module 603.Processing module 602 is used for server Movement carry out control management, for example, processing module 602 is for supporting server to execute process of the Fig. 2 into Fig. 5, and/or use In other processes of techniques described herein.Communication module 603 is used to support the communication of server Yu other network entities, example Communication such as between terminal.Server can also include memory module 601, the program code sum number for storage server According to.

It is understood that the processing module 602 in Fig. 6 can be equal to the computing engines module 113 in Fig. 1, in Fig. 6 Communication module 603 can be equal to the transmission module 114 in Fig. 1, the memory module 601 in Fig. 6 can be used for storing in Fig. 1 The database 112 based on user in location-based database 111 and Fig. 1.

Wherein, communication module 603, for receiving the current geographic position information of the terminal from terminal；And from described Terminal receives request message, and the request message is used for request geographic location association data；

Processing module 602, it is true for the current geographic position information according to the received terminal of the communication module 603 The fixed geographic location association data；

The communication module 603 is also used to send the geographic location association that the processing module 602 determines to the terminal Data, so that the terminal carries out augmented reality processing according to the geographic location association data.

In one example, the geographic location association data that the processing module 602 determines be at the terminal In the mark of other terminals in same geographical coverage area；

The processing module 602, specifically for the current geographic position according to the received terminal of the communication module 603 Confidence breath, searches the mark of other terminals from first list, and the first list includes the current of other terminals The corresponding relationship of the mark of geographical location information and other terminals.

In another example, the geographic location association data that the processing module 602 determines are and the terminal Meet other terminals of preset condition in same geographical coverage area and with the parameter value of the match parameter of the terminal Mark；

The communication module 603 is also used to received described according to the communication module 603 in the processing module 602 Before the current geographic position information of terminal determines the geographic location association data, of the terminal is received from the terminal Parameter value with parameter；

The processing module 602, specifically for the match parameter according to the current geographic position information and the terminal Parameter value, the mark of other terminals is searched from second list, the second list includes working as other terminals Preceding geographical location information, other terminals match parameter parameter value and other terminals mark corresponding relationship.

For example, the match parameter includes: the parameter of the running rule with speed or for identity user of user.

In one example, the communication module 603, specifically for sending the mark of other terminals to the terminal Know；

The communication module 603 is also used to send the mark of other terminals to the terminal in the communication module 603 After knowledge, the prompt information whether interacted with the user of other terminals is sent to the terminal；It is connect from the terminal Receive the instruction information that confirmation is interacted with the user of other terminals；The terminal and institute are established according to the instruction information The communication connection between other terminals is stated, so that the user of the terminal and the user of other terminals pass through the communication link Tap into capable interaction.

In another example, the geographic location association data that the processing module 602 determines are and the terminal The associated exercise suggestion data of current geographic position；

The processing module 602 obtains the current position specifically for the current geographic position information according to the terminal Manage the corresponding meteorological data of location information or condition of road surface data；According to the meteorological data or condition of road surface data, according to pre- If rule determines the exercise suggestion data.

In another example, the geographic location association data that the processing module 602 determines are and the terminal The associated audio or video data of current geographic position；

The processing module 602 is looked into from third list specifically for the current geographic position information according to the terminal The audio or video data are looked for, the third list includes the corresponding relationship of geographical location information Yu audio or video data.

The embodiment of the present invention does not carry out alone augmented reality processing by terminal, by terminal and server cooperate into The processing of row augmented reality.The current geographic position information that the terminal is received from terminal of communication module 603 first, then from described Terminal receives request message, and the request message is used for request geographic location association data, then 602 basis of processing module The current geographic position information of the terminal determines the geographic location association data, and last communication module 603 is to the terminal The geographic location association data are sent, so that the terminal carries out at augmented reality according to the geographic location association data Reason.Therefore terminal progress augmented reality processing is associated with the current geographic position of itself, to realize and surrounding ring The information exchange in border makes user obtain better user experience.

Wherein, processing module 602 can be processor or controller, such as can be central processing unit (Central Processing Unit, CPU), general processor, digital signal processor (Digital Signal Processor, DSP), Specific integrated circuit (Application-Specific Integrated Circuit, ASIC), field programmable gate array It is (Field Programmable Gate Array, FPGA) or other programmable logic device, transistor logic, hard Part component or any combination thereof.It, which may be implemented or executes, combines various examples described in disclosure of the embodiment of the present invention The logic block of property, module and circuit.The processor is also possible to realize the combination of computing function, such as includes one or more The combination etc. of a micro processor combination, DSP and microprocessor.Communication module 603 can be communication interface, transceiver, transmitting-receiving Circuit etc., wherein communication interface is to be referred to as, and may include one or more interfaces.Memory module 601 can be memory.

When processing module 602 is processor, communication module 603 is communication interface, when memory module 601 is memory, this Server involved in inventive embodiments can be server shown in Fig. 7.

As shown in fig.7, the server 700 includes: processor 702, communication interface 703, memory 701.Wherein, it communicates Interface 703, processor 702 and memory 701 can be connected with each other by communication connection.

Using integrated module, Fig. 8 shows a kind of possibility of terminal involved in above-described embodiment Structural schematic diagram.Terminal 800 includes: processing module 802, communication module 803.Processing module 802 is for the movement to terminal Control management is carried out, for example, processing module 802 is used to that terminal to be supported to execute the process in Fig. 2, Fig. 3, and/or is used for this paper institute Other processes of the technology of description.Communication module 803 is used to supporting the communication of terminal Yu other network entities, for example, with server Or the communication between other terminals.Terminal can also include memory module 801, for storing the program code and data of terminal.

It is understood that the processing module 802 in Fig. 8 can be equal to the computing module 125 in Fig. 1, it is logical in Fig. 8 Letter module 803 can be equal to the wireless module 127 in Fig. 1.

Wherein, communication module 803, for sending the current geographic position information of the terminal to server；To the clothes Business device sends request message, and the request message is used for request geographic location association data；Institute is received from the server State the corresponding geographic location association data of current geographic position information；

Processing module 802, for carrying out augmented reality according to the received geographic location association data of the communication module 803 Processing.

In one example, the received geographic location association data of the communication module 803 be at the terminal In the mark of other terminals in same geographical coverage area；

The communication module 803, specifically for receiving the mark of other terminals from the server.

In another example, the received geographic location association data of the communication module 803 are and the terminal Meet other terminals of preset condition in same geographical coverage area and with the parameter value of the match parameter of the terminal Mark；

The communication module 803 is also used to receive the current geographic position from the server in the communication module 803 Before confidence ceases corresponding geographic location association data, the parameter value of the match parameter of the terminal is sent to the server；

In one example, the communication module 803 is also used to receive in the communication module 803 from the server After the mark of other terminals, the prompt whether interacted with the user of other terminals is received from the server Information；The instruction information that confirmation is interacted with the user of other terminals is sent to the server；Pass through the service Device establishes the communication connection between other described terminals；

The processing module 802, be specifically used for controlling the communication module 803 by the communication connection with it is described other The message that the user of terminal described in terminal transmission and the user of other terminals are interacted.

In another example, the received geographic location association data of the communication module 803 are and the terminal The associated exercise suggestion data of current geographic position；

The communication module 803 is specifically used for receiving and the exercise suggestion data from the server.

In another example, the received geographic location association data of the communication module 803 are and the terminal The associated audio or video data of current geographic position；

The communication module 803 is specifically used for receiving the audio or video data from the server.

The embodiment of the present invention does not carry out alone augmented reality processing by terminal, by terminal and server cooperate into The processing of row augmented reality.The current geographic position information that the terminal is sent to server of communication module 803 first, then to clothes Business device sends request message, and the request message is used for request geographic location association data, receives describedly from server Position related data is managed, processing module 802 carries out augmented reality processing according to the geographic location association data.Therefore It is associated with the current geographic position of itself that terminal carries out augmented reality processing, to realize and the friendship of the information of ambient enviroment Mutually, user is made to obtain better user experience.

Wherein, processing module 802 can be processor or controller, such as can be central processing unit (Central Processing Unit, CPU), general processor, digital signal processor (Digital Signal Processor, DSP), Specific integrated circuit (Application-Specific Integrated Circuit, ASIC), field programmable gate array It is (Field Programmable Gate Array, FPGA) or other programmable logic device, transistor logic, hard Part component or any combination thereof.It, which may be implemented or executes, combines various examples described in disclosure of the embodiment of the present invention The logic block of property, module and circuit.The processor is also possible to realize the combination of computing function, such as includes one or more The combination etc. of a micro processor combination, DSP and microprocessor.Communication module 803 can be communication interface, transceiver, transmitting-receiving Circuit etc., wherein communication interface is to be referred to as, and may include one or more interfaces.Memory module 801 can be memory.

When processing module 802 be processor, communication module 803 be communication interface (such as radio frequency (Radio Frequency, RF) circuit), when memory module 801 is memory, terminal involved in the embodiment of the present invention can be terminal shown in Fig. 9.

As shown in fig.9, Fig. 9 is another terminal structure schematic diagram provided by the embodiments of the present application, it is with mobile terminal For AR glasses, Fig. 9 shows the block diagram of the part-structure of AR glasses 900 relevant to the embodiment of the present invention.

By taking terminal device is AR glasses as an example, Fig. 9 shows the part of AR glasses 900 relevant to the embodiment of the present invention The block diagram of structure.With reference to Fig. 9, AR glasses 900 include: radio frequency (Radio Frequency, RF) circuit 910, power supply 920, processing Device 930, memory 940, input unit 950, display unit 960, USB Driver 970, GPS module 980 and other nothings The components such as line communication module 990.

The above effect of each module in the present invention:

RF circuit 910 provides the communication capacities such as GPRS, mobile communication (such as 4G), is a kind of delivering path in the present invention One of, it in one example, can be used for and server communication, for example, obtaining current geographic position information, and be reported to service Device.Current geographic position information determines geographical position related data for server.

Memory 940 can be used for storing software program and module, and processor 930 is stored in memory 940 by operation Software program and module, thereby executing the various function application and data processing of AR glasses 900.Enhancing in the present invention The application of practical method and audio-visual data etc. are stored in memory 940.The operation of application, the processing of application are patrolled It collects and is all executed on processor 930.

USB Driver 970, it is possible to provide the communication capacity of other terminal devices and AR glasses 900 can be used as data output Or program more new interface etc..

GPS module 980, it is possible to provide stationkeeping ability shows longitude and latitude locating for AR glasses, can upload in one example The foundation of geographical position related data is determined as server to server.

The short range transmissions modules such as other wireless transport modules 990, including bluetooth, NFC, Wifi module.AR glasses 900 are logical It crosses other wireless transport modules 990 to send and receive e-mail, browse webpage and access streaming video etc., it is provided wirelessly for user Broadband internet access, while provide with other terminal devices realize communication ability, including file transmission ability.It can With understanding, and be not belonging to must be configured into for AR glasses 900, AR glasses can have it is one such or a variety of, It is not limited to these types.

Input unit 950 can be used for receiving the number or character information of input, and generates and set with the user of AR glasses 900 It sets and the related key signals of function control inputs.For example, input unit 950 can specifically include microphone for receiving user Voice messaging, double touch feedbacks and Trackpad.

Display unit 960 needs in be shown during can be used for showing the entire augmented reality method in present invention Hold, including audio-visual data etc..Accelerate for display for example, display unit 960 can specifically include colored display engine, is colored See through display module and provides visual channel for user.

AR glasses 900 further include the power supply 920 (such as battery) powered to all parts, and power supply can pass through power management System and processor 930 are logically contiguous, to realize the functions such as management charging, electric discharge and power consumption by power-supply management system. Although being not shown, AR glasses 900 can also include camera, infrared module etc., and details are not described herein.

Figure 10 is a kind of communication device schematic diagram provided by the embodiments of the present application, as shown in Figure 10, the communication device 1000 can be chip, and the chip includes processing unit and communication unit.The processing unit can be processor 1010, institute Stating processor can be previously described various types of processors.The communication unit for example can be input/output interface 1020, pin or circuit etc., the communication unit may include system bus or connect with system bus.Optionally, described Communication device further includes storage unit, and the storage unit can be the memory 1030 of the chip interior, such as register, Caching, random access memory (random access memory, RAM), EEPROM or FLASH etc.；The storage unit It can also be that the memory positioned at the chip exterior, the memory can be previously described various types of memories.Place Reason device is connected to memory, the instruction which can be stored with run memory, so that the communication device executes above-mentioned Fig. 2 extremely Method shown in fig. 5.

It, can be wholly or partly by software, hardware, firmware or it is any in above-mentioned each embodiment of the present invention Combination is to realize.When implemented in software, it can entirely or partly realize in the form of a computer program product.The meter Calculation machine program product includes one or more computer instructions.Load and execute on computers the computer program instructions When, it entirely or partly generates according to process or function described in the embodiment of the present invention.The computer can be general-purpose computations Machine, special purpose computer, computer network or other programmable devices.The computer instruction can store can in computer It reads in storage medium, or is transmitted from a computer-readable medium to another computer-readable medium, for example, the calculating Machine instruction can pass through wired (such as coaxial cable, optical fiber, number from a web-site, computer, server or data center Word user line (digital subscriber line, DSL)) or wireless (such as infrared, wireless, microwave etc.) mode to another A web-site, computer, server or data center are transmitted.The computer readable storage medium can be computer Any usable medium that can be accessed either includes the data such as one or more usable mediums integrated server, data center Store equipment.The usable medium can be magnetic medium (for example, floppy disk, hard disk, tape), optical medium (for example, DVD) or Person's semiconductor medium (for example, solid state hard disk) etc..

Above-described specific embodiment has carried out further the purpose of the present invention, technical scheme and beneficial effects It is described in detail, it should be understood that being not intended to limit the present invention the foregoing is merely a specific embodiment of the invention Protection scope, all any modification, equivalent substitution, improvement and etc. on the basis of technical solution of the present invention, done should all Including within protection scope of the present invention.

Claims

1. a kind of augmented reality method, which is characterized in that the described method includes:

Server receives the current geographic position information of the terminal from terminal；

The server receives request message from the terminal, and the request message is used for request geographic location association number According to；

The server determines the geographic location association data according to the current geographic position information of the terminal；

The server sends the geographic location association data to the terminal, so that the terminal is according to the geographical location Associated data carries out augmented reality processing.

2. the method as described in claim 1, which is characterized in that the geographic location association data are to be in same with the terminal The mark of other terminals in one geographical coverage area；

The server determines the geographic location association data according to the current geographic position information of the terminal, comprising:

The server searches the mark of other terminals according to the current geographic position information of the terminal from first list Know, the first list, which includes that the current geographic position information of other terminals is corresponding with the mark of other terminals, closes System.

3. the method as described in claim 1, which is characterized in that the geographic location association data are to be in same with the terminal Meet the mark of other terminals of preset condition in one geographical coverage area and with the parameter value of the match parameter of the terminal；

Before the server determines the geographic location association data according to the current geographic position information of the terminal, institute State method further include:

The server receives the parameter value of the match parameter of the terminal from the terminal；

The server is according to the parameter value of the current geographic position information and the match parameter of the terminal, from second list The mark of other terminals described in middle lookup, the second list include the current geographic position information, described of other terminals The corresponding relationship of the mark of the parameter value of the match parameter of other terminals and other terminals.

4. method as claimed in claim 3, which is characterized in that the match parameter includes: user with speed or for identifying The parameter of the running rule of user.

5. the method as described in any one of claim 2 to 4, which is characterized in that the server sends institute to the terminal State geographic location association data, comprising:

The server sends the mark of other terminals to the terminal；

After the server sends the mark of other terminals to the terminal, the method also includes:

The server sends the prompt information whether interacted with the user of other terminals to the terminal；

The server receives the instruction information that confirmation is interacted with the user of other terminals from the terminal；

The server establishes the communication connection between the terminal and other described terminals according to the instruction information, so that institute The user of the user and other terminals that state terminal are interacted by the communication connection.

6. the method as described in claim 1, which is characterized in that the geographic location association data are current with the terminal The associated exercise suggestion data in geographical location；

The server obtains the corresponding gas of the current geographic position information according to the current geographic position information of the terminal Image data or condition of road surface data；

The server determines the exercise suggestion number according to the meteorological data or condition of road surface data, according to preset rules According to.

7. the method as described in claim 1, which is characterized in that the geographic location association data are current with the terminal The associated audio or video data in geographical location；

The server searches the audio or video number according to the current geographic position information of the terminal from third list According to the third list includes the corresponding relationship of geographical location information Yu audio or video data.

8. a kind of augmented reality method, which is characterized in that the described method includes:

Terminal to server sends the current geographic position information of the terminal；

The terminal sends request message to the server, and the request message is used for request geographic location association number According to；

The terminal receives the corresponding geographic location association data of the current geographic position information from the server；

The terminal carries out augmented reality processing according to the geographic location association data.

9. method according to claim 8, which is characterized in that the geographic location association data are to be in same with the terminal The mark of other terminals in one geographical coverage area；

The terminal receives the corresponding geographic location association data of the current geographic position information from the server, comprising:

The terminal receives the mark of other terminals from the server.

10. method according to claim 8, which is characterized in that the geographic location association data are to be in the terminal Meet the mark of other terminals of preset condition in same geographical coverage area and with the parameter value of the match parameter of the terminal Know；

Before the terminal receives the corresponding geographic location association data of the current geographic position information from the server, institute State method further include:

The terminal sends the parameter value of the match parameter of the terminal to the server；

The terminal receives the mark of other terminals from the server.

11. method as claimed in claim 10, which is characterized in that the match parameter includes: user with speed or for marking Know the parameter of the running rule of user.

12. the method as described in any one of claim 9 to 11, which is characterized in that connect in the terminal from the server After the mark for receiving other terminals, the method also includes:

The terminal receives the prompt information whether interacted with the user of other terminals from the server；

The terminal sends the instruction information that confirmation is interacted with the user of other terminals to the server；

The terminal establishes the communication connection between other described terminals by the server；

The terminal carries out augmented reality processing according to the geographic location association data, comprising:

User and other terminals of the terminal by the communication connection with terminal described in described other terminal transmissions The message that user is interacted.

13. method according to claim 8, which is characterized in that the geographic location association data are to work as with the terminal The preceding associated exercise suggestion data in geographical location；

The terminal receives the exercise suggestion data from the server.

14. method according to claim 8, which is characterized in that the geographic location association data are to work as with the terminal The preceding associated audio or video data in geographical location；

The terminal receives the audio or video data from the server.

15. a kind of server, which is characterized in that the server includes:

Communication module, for receiving the current geographic position information of the terminal from terminal；Request message is received from the terminal, The request message is used for request geographic location association data；

Processing module, for determining the geography according to the current geographic position information of the received terminal of the communication module Position related data；

The communication module is also used to send the geographic location association data that the processing module determines to the terminal, So that the terminal carries out augmented reality processing according to the geographic location association data.

16. server as claimed in claim 15, which is characterized in that the geographic location association that the processing module determines Data are the mark for other terminals being in same geographical coverage area with the terminal；

The processing module, specifically for the current geographic position information according to the received terminal of the communication module, from The mark of other terminals is searched in first list, the first list includes the current geographic position letter of other terminals The corresponding relationship of breath and the mark of other terminals.

17. server as claimed in claim 15, which is characterized in that the geographic location association that the processing module determines Data are to be in same geographical coverage area and meet with the parameter value of the match parameter of the terminal default with the terminal The mark of other terminals of condition；

The communication module is also used to the current geographic in the processing module according to the received terminal of the communication module Before location information determines the geographic location association data, the parameter of the match parameter of the terminal is received from the terminal Value；

The processing module, specifically for the parameter according to the current geographic position information and the match parameter of the terminal Value, searches the mark of other terminals from second list, and the second list includes the current geographic of other terminals Location information, other terminals match parameter parameter value and other terminals mark corresponding relationship.

18. server as claimed in claim 17, which is characterized in that the match parameter include: user with speed or be used for The parameter of the running rule of identity user.

19. the server as described in any one of claim 16 to 18, which is characterized in that the communication module is specifically used for The mark of other terminals is sent to the terminal；

The communication module is also used to after the communication module sends the mark of other terminals to the terminal, to The terminal sends the prompt information whether interacted with the user of other terminals；Confirmation and institute are received from the terminal State the instruction information that the user of other terminals is interacted；The terminal and other described terminals are established according to the instruction information Between communication connection so that the user of the terminal and the user of other terminals carried out by the communication connection it is mutual It is dynamic.

20. server as claimed in claim 15, which is characterized in that the geographic location association that the processing module determines Data are exercise suggestion data associated with the current geographic position of the terminal；

The processing module obtains the current geographic position specifically for the current geographic position information according to the terminal The corresponding meteorological data of information or condition of road surface data；According to the meteorological data or condition of road surface data, according to preset rules Determine the exercise suggestion data.

21. server as claimed in claim 15, which is characterized in that the geographic location association that the processing module determines Data are audio or video data associated with the current geographic position of the terminal；

The processing module, specifically for the current geographic position information according to the terminal, from third list described in lookup Audio or video data, the third list include the corresponding relationship of geographical location information Yu audio or video data.

22. a kind of terminal, which is characterized in that the terminal includes:

Communication module, for sending the current geographic position information of the terminal to server；It sends and requests to the server Message, the request message are used for request geographic location association data；The current geographic position is received from the server Confidence ceases corresponding geographic location association data；

Processing module, for carrying out augmented reality processing according to the geographic location association data.

23. terminal as claimed in claim 22, which is characterized in that the received geographic location association number of communication module According to for the mark for other terminals being in the terminal in same geographical coverage area；

The communication module, specifically for receiving the mark of other terminals from the server.

24. terminal as claimed in claim 22, which is characterized in that the received geographic location association number of communication module It is preset according to be in same geographical coverage area with the terminal and meeting with the parameter value of the match parameter of the terminal The mark of other terminals of condition；

The communication module is also used to receive the current geographic position information from the server in the communication module corresponding Geographic location association data before, the parameter value of the match parameter of the terminal is sent to the server；

25. terminal as claimed in claim 24, which is characterized in that the match parameter includes: user with speed or for marking Know the parameter of the running rule of user.

26. the terminal as described in any one of claim 23 to 25, which is characterized in that the communication module is also used in institute Communication module is stated after the mark that the server receives other terminals, from the server receive whether with it is described its The prompt information that the user of his terminal is interacted；Confirmation is sent to the server and the user of other terminals carries out mutually Dynamic instruction information；The communication connection between other described terminals is established by the server；

The processing module is specifically used for the control communication module and passes through the communication connection and other described terminal transmission institutes The message that the user of the user and other terminals that state terminal are interacted.

27. terminal as claimed in claim 22, which is characterized in that the received geographic location association number of communication module According to for exercise suggestion data associated with the current geographic position of the terminal；

The communication module is specifically used for receiving and the exercise suggestion data from the server.

28. terminal as claimed in claim 22, which is characterized in that the received geographic location association number of communication module According to for audio or video data associated with the current geographic position of the terminal；

The communication module is specifically used for receiving the audio or video data from the server.

29. a kind of server, which is characterized in that the server includes memory, processor and communication interface；

The memory, for storing program instruction；

The processor, for being executed according to claim 1 according to the program instruction stored in the memory to any one of 7 institutes The method stated.

30. a kind of terminal, which is characterized in that the terminal includes memory, processor and communication interface；

The memory, for storing program instruction；

The processor, for being executed according to the program instruction stored in the memory according to any one of claim 8 to 14 The method.

31. a kind of computer readable storage medium, including instruction, which is characterized in that when described instruction is run on computers, The computer is set to execute method according to any one of claims 1 to 7.

32. a kind of computer readable storage medium, including instruction, which is characterized in that when described instruction is run on computers, Execute the computer according to the described in any item methods of claim 8 to 14.