CN110147288A - Information interacting method and device, electronic equipment and storage medium - Google Patents
Information interacting method and device, electronic equipment and storage medium Download PDFInfo
- Publication number
- CN110147288A CN110147288A CN201910394192.1A CN201910394192A CN110147288A CN 110147288 A CN110147288 A CN 110147288A CN 201910394192 A CN201910394192 A CN 201910394192A CN 110147288 A CN110147288 A CN 110147288A
- Authority
- CN
- China
- Prior art keywords
- request
- terminal side
- feedback result
- client process
- service processes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/547—Remote procedure calls [RPC]; Web services
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/541—Client-server
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
This disclosure relates to a kind of information interacting method and device, electronic equipment and storage medium, wherein this method comprises: creating client process and service processes in terminal side；Augmented reality (AR) request is initiated by the client process；The AR request is responded by the service processes, obtains AR feedback result；According to the AR feedback result, the AR fusion results being shown in the terminal side are obtained.Using the disclosure, treatment effeciency is improved while capable of realizing AR function in terminal side, and reduce the information exchange time.
Description
Technical field
This disclosure relates to technical field of computer vision more particularly to a kind of information interacting method and device, electronic equipment
And storage medium.
Background technique
In the related technology, for the demanding augmented reality of timeliness (AR) scene, need to meet the information exchange time and
Treatment effeciency meets the use demand of AR.However, the demand is not achieved in the interaction time and treatment effeciency due to the prior art,
It, may if user wishes a virtual information and actual environment fusion of imaging to influence whether final AR treatment effect
Can not obtain in time two dimension or three-dimensional imaging as a result, imaging effect it is poor.However, in this regard, not existing in the related technology effective
Solution.
Summary of the invention
The present disclosure proposes a kind of exchange technology schemes.
According to the one side of the disclosure, a kind of information interacting method is mentioned, which comprises
Client process and service processes are created in terminal side；
Augmented reality AR request is initiated by the client process；
The AR request is responded by the service processes, obtains AR feedback result；
According to the AR feedback result, the AR fusion results being shown in the terminal side are obtained.
In possible implementation, the method also includes: it is described terminal side create client process and service processes it
Before,
It obtains Software Development Kit (SDK), creates the client process by running the SDK；
It obtains augmented reality service (ARService), by running the processing logic in the ARService to create
State service processes.
In possible implementation, the method also includes:
After initiating AR request by the client process, requested AR request data is stored in shared drive, it is described
AR request data is read for the service processes.
In possible implementation, the method also includes:
The AR request is responded by the service processes, after obtaining AR feedback result, the AR feedback result is stored in
In shared drive, the AR feedback result is read for the client process.
In possible implementation, according to the AR feedback result, the AR being shown in terminal side fusion is obtained
As a result, comprising:
Virtual information is parsed from the AR feedback result；
The virtual information is merged with the actual environment parameter of acquisition, obtains the AR fusion results, shows institute
State AR fusion results.
In possible implementation, according to the AR feedback result, the AR being shown in terminal side fusion is obtained
As a result, comprising:
AR is parsed from the AR feedback result requests requested processing logic；
Interface message is obtained from the SDK and runs the configuration parameter of the processing logic；
The processing logic is run using the SDK according to the interface message is enabled；
The processing logic is run according to the configuration parameter, obtains virtual information；
The virtual information is merged with the actual environment parameter of acquisition, obtains the AR fusion results, shows institute
State AR fusion results.
In possible implementation, the AR request, the request inputted inside or outside terminal side；
In the feelings that AR request is externally input second request of the first request inputted inside terminal side and terminal side
Under condition, the method also includes: it is stored in the shared drive after first request and second request are packaged.
According to the one side of the disclosure, a kind of information interactive device is mentioned, comprising:
Creation module, for creating client process and service processes in terminal side；
Request module, for initiating augmented reality AR request by the client process；
Respond module obtains AR feedback result for responding the AR request by the service processes；
Processing module, for obtaining the AR fusion results being shown in the terminal side according to the AR feedback result.
In possible implementation, described device further include:
First obtains module, for obtaining SDK, creates the client process by running the SDK；
Second obtains module, for obtaining ARService, is created by running the processing logic in the ARService
Build the service processes.
In possible implementation, described device further include:
First storage initiation module, after initiating AR request by the client process, by requested AR number of request
According in deposit shared drive, the AR request data is read for the service processes.
In possible implementation, described device further include:
Second storage initiation module, for responding the AR request by the service processes, after obtaining AR feedback result,
The AR feedback result is stored in shared drive, the AR feedback result is read for the client process.
In possible implementation, the processing module is further used for:
Virtual information is parsed from the AR feedback result；
The virtual information is merged with the actual environment parameter of acquisition, obtains the AR fusion results, shows institute
State AR fusion results.
In possible implementation, the processing module is further used for:
AR is parsed from the AR feedback result requests requested processing logic；
Interface message is obtained from the SDK and runs the configuration parameter of the processing logic；
The processing logic is run using the SDK according to the interface message is enabled；
The processing logic is run according to the configuration parameter, obtains virtual information；
The virtual information is merged with the actual environment parameter of acquisition, obtains the AR fusion results, shows institute
State AR fusion results.
In possible implementation, the AR request, the request inputted inside or outside terminal side；
In the feelings that AR request is externally input second request of the first request inputted inside terminal side and terminal side
Under condition, described device further include:
Third storage initiation module, for requesting to be stored in described share first request and described second after being packaged
In depositing.
According to the one side of the disclosure, a kind of electronic equipment is provided, comprising:
Processor；
Memory for storage processor executable instruction；
Wherein, the processor is configured to: execute above- mentioned information exchange method.
According to the one side of the disclosure, a kind of computer readable storage medium is provided, computer program is stored thereon with
Above- mentioned information exchange method is realized in instruction when the computer program instructions are executed by processor.
In the embodiments of the present disclosure, client process and service processes are created in terminal side；It is initiated by the client process
AR request；The AR request is responded by the service processes, obtains AR feedback result；According to the AR feedback result, obtain
In the AR fusion results that the terminal side is shown.Using the disclosure, since the both sides communicated with each other are all located at terminal one
Therefore AR is requested the information exchange for making requests and responding in side, can not only realize AR function in terminal side, and reduce letter
Treatment effeciency is improved while ceasing interaction time.
It should be understood that above general description and following detailed description is only exemplary and explanatory, rather than
Limit the disclosure.
According to below with reference to the accompanying drawings to detailed description of illustrative embodiments, the other feature and aspect of the disclosure will become
It is clear.
Detailed description of the invention
The drawings herein are incorporated into the specification and forms part of this specification, and those figures show meet this public affairs
The embodiment opened, and together with specification it is used to illustrate the technical solution of the disclosure.
Fig. 1 shows the flow chart of the information interacting method according to the embodiment of the present disclosure.
Fig. 2 shows carry out information exchange by shared drive according to the client process and service processes of the embodiment of the present disclosure
Flow chart.
Fig. 3 shows the information exchange overall structure diagram according to the embodiment of the present disclosure.
Fig. 4 shows the parallel block schematic illustration of more algorithms according to the embodiment of the present disclosure.
Fig. 5 shows the block diagram of the information interactive device according to the embodiment of the present disclosure.
Fig. 6 shows the block diagram of the electronic equipment according to the embodiment of the present disclosure.
Specific embodiment
Various exemplary embodiments, feature and the aspect of the disclosure are described in detail below with reference to attached drawing.It is identical in attached drawing
Appended drawing reference indicate element functionally identical or similar.Although the various aspects of embodiment are shown in the attached drawings, remove
It non-specifically points out, it is not necessary to attached drawing drawn to scale.
Dedicated word " exemplary " means " being used as example, embodiment or illustrative " herein.Here as " exemplary "
Illustrated any embodiment should not necessarily be construed as preferred or advantageous over other embodiments.
The terms "and/or", only a kind of incidence relation for describing affiliated partner, indicates that there may be three kinds of passes
System, for example, A and/or B, can indicate: individualism A exists simultaneously A and B, these three situations of individualism B.In addition, herein
Middle term "at least one" indicate a variety of in any one or more at least two any combination, it may for example comprise A,
B, at least one of C can indicate to include any one or more elements selected from the set that A, B and C are constituted.
In addition, giving numerous details in specific embodiment below to better illustrate the disclosure.
It will be appreciated by those skilled in the art that without certain details, the disclosure equally be can be implemented.In some instances, for
Method, means, element and circuit well known to those skilled in the art are not described in detail, in order to highlight the purport of the disclosure.
Time of cell-phone terminal is various, especially android mobile phone, and each manufacturer brings AR application using different hardware
Greatly challenge.The disclosure is to create client process and service processes in terminal side, initiates AR request by client process, can be with
In service processes according to running processing logic (one or more) and its updating, AR request is responded.Due to client into
Journey and service processes are located at terminal side, mention while can not only realizing AR function in terminal side, and reduce the information exchange time
High treatment efficiency.
Fig. 1 shows the flow chart of the information interacting method according to the embodiment of the present disclosure, which is applied to letter
Exchange method device is ceased, for example, image segmentation device can be executed by terminal device or other processing equipments, wherein terminal is set
Standby can be user equipment (UE, User Equipment), mobile device, cellular phone, wireless phone, personal digital assistant
(PDA, Personal Digital Assistant), handheld device, calculating equipment, mobile unit, wearable device etc..One
In a little possible implementations, which can call the computer-readable finger stored in memory by processor
The mode of order is realized.As shown in Figure 1, the process includes:
Step S101, client process and service processes are created in terminal side；
Step S102, augmented reality AR request is initiated by the client process；
Step S103, the AR request is responded by the service processes, obtains AR feedback result；
Step S104, according to the AR feedback result, the AR fusion results being shown in the terminal side are obtained.
The disclosure pertains only to terminal side, had not only included client process in terminal side side but also had included service processes.Wherein, client
Process can be operation SDK and be created, and service processes are one or more processing logics in operation ARService (or one
A or polyalgorithm) created, communication interaction is then carried out between client process and service processes.One information exchange is shown
Example: downloading ARService from application market first, may include the algorithmic code of SDK energy operation in ARService, from SDK pairs
It is mainly some in the downloading of developer the website SDK, SDK answered to be used for and the progress information exchanges such as ARService and sensor
Interface message and for configuration parameter needed for the operation processing logic.Then, from client process initiate AR request to service into
Journey obtains algorithmic code in ARService, these algorithmic codes are run according to interface and/or configuration parameter in client process,
The corresponding application function of algorithm is executed, for example, user wishes to be realized a virtual information and actual environment fusion of imaging
Application function exactly obtains the two dimension or three-dimensional imaging result and shows in terminal side.Using the disclosure, due to communicating with each other
Both sides be all located at terminal side, therefore, the information exchange that makes requests and respond is requested for AR, can not only be real in terminal side
Existing AR function, and treatment effeciency is improved while the reduction information exchange time.
It is noted that the SDK of the disclosure, specifically SenseAR SDK (abbreviation SDK in text), the SDK of the disclosure is
One augmented reality platform, there is stronger compatibility, and including the versions SDK such as c, java, Unity3D, developer only needs
SDK is integrated in client, so that the integrated cost of developer is as small as possible.The SDK be capable of providing real-time tracking and build figure,
Size estimation, more plane monitoring-networks, illumination estimation, more people share the functions such as anchor point, gesture identification, Face datection, and developer can be with
Function required for flexible choice is integrated into the application of oneself.
It is described before terminal side creates client process and service processes in the possible implementation of the disclosure, it obtains
SDK creates the client process by running the SDK.ARService is obtained, by running in the ARService
Logic is handled to create the service processes.After initiating AR request by the client process, by requested AR request data
It is stored in shared drive, the AR request data is read for the service processes.The AR is responded by the service processes to ask
Ask, after obtaining AR feedback result, by the AR feedback result be stored in shared drive in, the AR feedback result for the client into
Journey is read.
In one example, single terminal end is handled in the scene of AR, and AR request can be multiple requests, and a such as terminal issues
Multiple requests, or in the scene that multiple terminals cooperates with processing AR, multiple terminals, multiple requests can be multiple terminals hair
It requests out, each terminal at least initiates a request.
In the related technology, it initiates based on traditional C/S framework and by java layers to the calling of shared drive, and the disclosure
In, terminal side is pertained only to, in terminal side, the interactively of shared drive and client process and service processes is as shown in Figure 2.One
In example, Fig. 2 shows carry out information exchange by shared drive according to the client process and service processes of the embodiment of the present disclosure
Flow chart.As shown in Fig. 2, multiple AR are initiated by client process and are requested after terminal side creates client process and service processes,
It will be in requested multiple AR request data deposit shared drives.Multiple AR requests are read from shared drive by service processes
Data are called after processing logic progress parallel processing corresponding with multiple AR request datas that AR is anti-in multiple processing logics respectively
It presents in result deposit shared drive.
In one example, the AR that client process can be initiated is requested, before being sent to service processes, by AR request data
Write direct shared drive；Service processes read AR request data from the shared drive, by the algorithm generation of corresponding A R request data
Code writes direct shared drive.It needs in use, client process and service processes can directly be read from shared drive, due to
The influence for eliminating communication delay suffered by direct communication and Network status between client process and service processes, in shared
The mode deposited is more stable and efficient.
It should be pointed out that the shared drive of the disclosure can be created by java layers, but its calling is held by C layers
Row, because in the related technology, java layers are not only Memory Allocation by the execution of java virtual machine, and there are also other operations, will lead to
Inefficiency.
Using the disclosure, the interaction of client process and service processes is by the way of shared drive, and it is virtual to avoid java
The memory copying of machine, to improve treatment effeciency；It is used parallel in multiple processing logic (more algorithms) of service processes operation
Mode makes full use of the advantage of terminal side (mobile terminal such as mobile phone) multiprocessor, and it is (calculate to improve multiple processing logics more
Method) the speed of service.Interprocess communication uses the method optimizing memory and transmission speed of shared drive, avoids Android system
The Binder that unites communicates the transmission size limitation of (Binder is one of android system striding course communication mode), solves big
The interprocess communication problem of data, while shared drive is write the data directly into, avoid the Memory Allocation of java virtual machine.
In the possibility implementation of the disclosure, the AR feedback result that client process obtains is that the logic that handled of feedback obtains
Virtual information, can use general recognizable interface, then not need interface message and configuration parameter, can run directly in
SDK.In one example, virtual information (the virtual letter obtained through handling logical process is parsed from the AR feedback result
Breath)；The virtual information is merged with the actual environment parameter acquired by sensor, obtains the AR fusion results,
Show the AR fusion results.
In one example, such as virtual information is integrated with the real world seen by mobile terminal camera, for example, quiet
In state scene, the available habited effect of user, the furniture effect etc. that environment is put indoors.Wherein, clothes and furniture
It is all the virtual information obtained from third party, user and indoor environment are real worlds.In dynamic scene, sensor can be passed through
It tracks the position (three-dimensional spatial information) of certain virtual 3D ball, and constructs its understanding to real world, integrated with real world
Together, it for example dishes out on the virtual 3D ball to television set, the dynamic treatment effect for being collided and being sprung back.
In the possibility implementation of the disclosure, the AR feedback result that client process obtains is processing logic, and interface is obstructed
With needing to be adapted to according to interface.Requested processing logic is parsed from the AR feedback result, from the SDK
It obtains interface message and runs the configuration parameter of the processing logic.It is run according to the interface message is enabled using the SDK
The processing logic.The processing logic is run according to the configuration parameter, obtains the void obtained through the processing logical process
Quasi- information.The virtual information is merged with the actual environment parameter acquired by sensor, obtains the AR fusion knot
Fruit shows the AR fusion results.
In the possibility implementation of the disclosure, the AR feedback result that client process obtains is that virtual information (is patrolled through processing
Collect the virtual information that processing obtains), and interface is not general, needs to be adapted to according to interface.It is solved from the AR feedback result
AR is precipitated and requests requested virtual information.Interface message is obtained from the SDK, the void is enabled according to the interface message
Quasi- information.The virtual information is merged with the actual environment parameter acquired by sensor, obtains the AR fusion knot
Fruit shows the AR fusion results.
In the possibility implementation of the disclosure, inside and outside data entry terminal is supported.AR request, derives from terminal side
The request of internal or external input；It is that the first request inputted inside terminal side and terminal side are externally input in AR request
In the case where second request, it is stored in the shared drive after first request and second request are packaged.
In the possibility implementation of the disclosure, support more algorithms parallel.In the related technology, existing using traditional C/S framework
Algorithm is not more to cover and be unable to parallel processing in server side.In the disclosure, multiple processing logics (calculate more in ARServicer
Method) can after the request for receiving multiple client processes, called according to corresponding request corresponding processing logic (algorithm) come
Data are handled, the result handled well writes direct shared drive, is supplied to corresponding client process and reads from shared drive.It can also
Client process is returned to by shared content again all to have handled all requests.
In one example, multiple data acquisition results in shared drive are read by service processes, multiple processing is run and patrols
Processing logic corresponding with the multiple data acquisition results in volume.
It is detected according to one: the first data acquisition results of situation from the first interface that Software Development Kit SDK is obtained
Gesture operation, the first configuration parameter operation the first processing logic obtained according to SDK, at the gesture operation
Reason, obtains the first processing result；
The three of the second interface virtual objects detected obtained according to two: the second data acquisition results of situation from SDK
Dimension space information runs second processing logic according to the second configuration parameter that SDK is obtained, in conjunction with the three-dimensional space of the virtual objects
Between information handled, obtain second processing result；
Situation three: the light of the third interface actual environment detected obtained according to third data acquisition results from SDK
According to information, the third configuration parameter operation third processing logic obtained according to SDK is handled in conjunction with the Lighting information, is obtained
To third processing result.
By the first processing result obtained in the situation one to three, the second processing result, third processing knot
At least two results in fruit are stored in the shared drive, are read for the client process.
Gesture combines positioning immediately and builds in a processing example of figure (SLAM), first detects, detects to gesture
Virtual 3D ball is thrown after the movement thrown away, collides the television set in true environment, rebound is returned.In this example, SDK is mentioned
Two interfaces are supplied, first interface is the interface of gestures detection, and second interface is the interface that virtual 3D ball positions.Third connects
Mouthful, it can be done by third party, be the interface of TV machine testing in true environment, while running multiple logics (more algorithms), it can be
The collision television set and rebound information and virtual 3D ball information received carries out AR image co-registration, realizes the friendship between result
Mutually.
Using example:
Third-party application integrates the SDK of the disclosure, by placement algorithm parameter, specifies the SDK to run algorithms of different, then
The structure of parsing SDK return simultaneously does corresponding displaying according to demand.Fig. 3 shows whole according to the information exchange of the embodiment of the present disclosure
Structure, as shown in figure 3, the process of corresponding execution specifically includes: enabling each algorithm (it can be appreciated that triggering is each by interface
The operation of algorithm) and configuration parameter.Starting algorithm, if it is the externally input data in terminal side, then need to input each frame with
And additional information (being mainly used for the interface message that client process is interacted with service processes and each sensor) triggering algorithm fortune
Row can start the sensors such as camera if it is the data of terminal side inside input automatically, obtain the sensing such as image from system bottom
Device data, and by the shared drive mode of putting be transmitted to ARService do algorithm operation then return to client.It calls and updates
Interface simultaneously actively obtains result.Active calling interface stops SDK operation when scene exits.The algorithm packet that service processes can start
It includes: positioning immediately and build figure (SLAM) processing, gesture processing and illumination estimation processing etc..With a 3D virtual ball of dishing out, touch
It bumps against in the example that television set is sprung back again, SLAM processing is can to position and build immediately figure, to virtual information (such as 3D virtual ball)
Positioning, obtains the location information in three-dimensional space, so as to the modeling of subsequent realization Three-dimensional Gravity, such as according to the location information of three-dimensional space
The map etc. for establishing corresponding actual environment uses, so as to understand and track virtual information (such as 3D virtual ball) relative to reality
The relative position (position relative to television set in real world) in the world.Gesture processing is to execute correspondence for different gestures
Gesture estimate operation.Illumination estimation processing is can to estimate the current illumination condition of environment (light intensity weak or light direction etc.), with
Imaging results are adjusted, for example, the image that comparison is darker, can be turned up light intensity.
Fig. 4 shows the parallel frame of more algorithms according to the embodiment of the present disclosure.As shown in figure 4, a frame data (following, sensing
Device data etc.) be transmitted to service processes in a manner of shared drive by client process after, start each processing logic (at such as SLAM
Reason, gesture processing and illumination estimation processing etc.) parallel data processing, after waiting all processing logics all to handle, service processes
Processing result is returned into client process in a manner of shared drive again.Various algorithm abilities are provided for third-party application, make third
Fang Yingyong can provide outstanding AR experience promptly for user.This parallel frame of more algorithms is that algorithm is parallel, and algorithm
As a result it is separately returned to SDK.And traditional algorithm synchronization framework, it is that algorithm is serial, waits a frame data to handle and return again to processing
As a result.In ARService, different modules can be logically divided into according to different processing, it is unified by single algorithm inside APP
Frame/parallel frame of more algorithms calls.
At least one process after one APP operation may include multiple threads in one process.Wherein, service processes
Realize multiple threads, in a manner of thread pool to solve the demand that multitask is performed simultaneously.The operation of multithreading can be according to CPU
Switching is completed, and how to be switched and is determined by CPU.When there is thread task, one is taken from thread pool, thread object after the completion of execution
Gui Chi can save the resource of system in this way to avoid performance cost brought by thread object is created repeatedly.
It is the realization that third-party application unifies AR on each terminal, it is only necessary to a set of code using the disclosure
All terminals for supporting the AR technology are operated in, can be directly integrated in the APP of terminal, it can also be in third-party application
When needing integrated AR function, the AR technology is integrated.
It will be understood by those skilled in the art that each step writes sequence simultaneously in the above method of specific embodiment
It does not mean that stringent execution sequence and any restriction is constituted to implementation process, the specific execution sequence of each step should be with its function
It can be determined with possible internal logic.
Above-mentioned each embodiment of the method that the disclosure refers to can phase each other without prejudice to principle logic
The embodiment formed after combining is mutually combined, as space is limited, the disclosure repeats no more.
In addition, the disclosure additionally provides information interactive device, electronic equipment, computer readable storage medium, program, it is above-mentioned
It can be used to realize any information interacting method that the disclosure provides, corresponding technical solution and description and referring to method part
It is corresponding to record, it repeats no more.
Fig. 5 shows the block diagram of the information interactive device according to the embodiment of the present disclosure, as shown in figure 5, the embodiment of the present disclosure
Information interactive device, comprising: creation module 31, for creating client process and service processes in terminal side；Request module 32 is used
It is requested in initiating augmented reality AR by the client process；Respond module 33, for by described in service processes response
AR request, obtains AR feedback result；Processing module 34 is carried out for obtaining according to the AR feedback result in the terminal side
The AR fusion results of displaying.
In the possible implementation of the disclosure, described device further include: the first acquisition module passes through fortune for obtaining SDK
The SDK go to create the client process；Second obtains module, for obtaining ARService, by described in operation
Processing logic in ARService creates the service processes.
In the possible implementation of the disclosure, described device further include: the first storage initiation module, for passing through the visitor
After family process initiates AR request, requested AR request data is stored in shared drive, the AR request data supplies the clothes
Business process is read.
In the possible implementation of the disclosure, described device further include: the second storage initiation module, for passing through the clothes
Business process responds the AR request, after obtaining AR feedback result, the AR feedback result is stored in shared drive, the AR is anti-
Result is presented to read for the client process.
In the possible implementation of the disclosure, the processing module is further used for: parsing from the AR feedback result
Virtual information out；The virtual information is merged with the actual environment parameter of acquisition, obtains the AR fusion results, is shown
The AR fusion results.
In the possible implementation of the disclosure, the processing module is further used for: parsing from the AR feedback result
AR requests requested processing logic out；Interface message is obtained from the SDK and runs the configuration parameter of the processing logic；
The processing logic is run using the SDK according to the interface message is enabled；The processing is run according to the configuration parameter
Logic obtains virtual information；The virtual information is merged with the actual environment parameter of acquisition, obtains the AR fusion knot
Fruit shows the AR fusion results.
In the possible implementation of the disclosure, the AR request, the request inputted inside or outside terminal side；?
In the case that the AR request is externally input second request of the first request inputted inside terminal side and terminal side, the dress
It sets further include: third stores initiation module, described shared for being stored in after being packaged first request and second request
In memory.
In some embodiments, the embodiment of the present disclosure provides the function that has of device or comprising module can be used for holding
The method of row embodiment of the method description above, specific implementation are referred to the description of embodiment of the method above, for sake of simplicity, this
In repeat no more.
The embodiment of the present disclosure also proposes a kind of computer readable storage medium, is stored thereon with computer program instructions, institute
It states when computer program instructions are executed by processor and realizes the above method.Computer readable storage medium can be non-volatile meter
Calculation machine readable storage medium storing program for executing.
The embodiment of the present disclosure also proposes a kind of electronic equipment, comprising: processor；For storage processor executable instruction
Memory；Wherein, the processor is configured to the above method.
The equipment that electronic equipment may be provided as terminal, server or other forms.
Fig. 6 is the block diagram of a kind of electronic equipment 800 shown according to an exemplary embodiment.For example, electronic equipment 800 can
To be mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, Medical Devices are good for
Body equipment, the terminals such as personal digital assistant.
Referring to Fig. 6, electronic equipment 800 may include following one or more components: processing component 802, memory 804,
Power supply module 806, multimedia component 808, audio component 810, the interface 812 of input/output (I/O), sensor module 814,
And communication component 816.
The integrated operation of the usual controlling electronic devices 800 of processing component 802, such as with display, call, data are logical
Letter, camera operation and record operate associated operation.Processing component 802 may include one or more processors 820 to hold
Row instruction, to perform all or part of the steps of the methods described above.In addition, processing component 802 may include one or more moulds
Block, convenient for the interaction between processing component 802 and other assemblies.For example, processing component 802 may include multi-media module, with
Facilitate the interaction between multimedia component 808 and processing component 802.
Memory 804 is configured as storing various types of data to support the operation in electronic equipment 800.These data
Example include any application or method for being operated on electronic equipment 800 instruction, contact data, telephone directory
Data, message, picture, video etc..Memory 804 can by any kind of volatibility or non-volatile memory device or it
Combination realize, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM) is erasable
Except programmable read only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, fastly
Flash memory, disk or CD.
Power supply module 806 provides electric power for the various assemblies of electronic equipment 800.Power supply module 806 may include power supply pipe
Reason system, one or more power supplys and other with for electronic equipment 800 generate, manage, and distribute the associated component of electric power.
Multimedia component 808 includes the screen of one output interface of offer between the electronic equipment 800 and user.
In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch surface
Plate, screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes one or more touches
Sensor is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding
The boundary of movement, but also detect duration and pressure associated with the touch or slide operation.In some embodiments,
Multimedia component 808 includes a front camera and/or rear camera.When electronic equipment 800 is in operation mode, as clapped
When taking the photograph mode or video mode, front camera and/or rear camera can receive external multi-medium data.It is each preposition
Camera and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 810 is configured as output and/or input audio signal.For example, audio component 810 includes a Mike
Wind (MIC), when electronic equipment 800 is in operation mode, when such as call mode, recording mode, and voice recognition mode, microphone
It is configured as receiving external audio signal.The received audio signal can be further stored in memory 804 or via logical
Believe that component 816 is sent.In some embodiments, audio component 810 further includes a loudspeaker, is used for output audio signal.
I/O interface 812 provides interface between processing component 802 and peripheral interface module, and above-mentioned peripheral interface module can
To be keyboard, click wheel, button etc..These buttons may include, but are not limited to: home button, volume button, start button and lock
Determine button.
Sensor module 814 includes one or more sensors, for providing the state of various aspects for electronic equipment 800
Assessment.For example, sensor module 814 can detecte the state that opens/closes of electronic equipment 800, the relative positioning of component, example
As the component be electronic equipment 800 display and keypad, sensor module 814 can also detect electronic equipment 800 or
The position change of 800 1 components of electronic equipment, the existence or non-existence that user contacts with electronic equipment 800, electronic equipment 800
The temperature change of orientation or acceleration/deceleration and electronic equipment 800.Sensor module 814 may include proximity sensor, be configured
For detecting the presence of nearby objects without any physical contact.Sensor module 814 can also include optical sensor,
Such as CMOS or ccd image sensor, for being used in imaging applications.In some embodiments, which may be used also
To include acceleration transducer, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 816 is configured to facilitate the communication of wired or wireless way between electronic equipment 800 and other equipment.
Electronic equipment 800 can access the wireless network based on communication standard, such as WiFi, 2G or 3G or their combination.Show at one
In example property embodiment, communication component 816 receives broadcast singal or broadcast from external broadcasting management system via broadcast channel
Relevant information.In one exemplary embodiment, the communication component 816 further includes near-field communication (NFC) module, short to promote
Cheng Tongxin.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module
(UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, electronic equipment 800 can be by one or more application specific integrated circuit (ASIC), number
Word signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array
(FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, a kind of non-volatile computer readable storage medium storing program for executing is additionally provided, for example including calculating
The memory 804 of machine program instruction, above-mentioned computer program instructions can be executed by the processor 820 of electronic equipment 800 to complete
The above method.
The disclosure can be system, method and/or computer program product.Computer program product may include computer
Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the disclosure.
Computer readable storage medium, which can be, can keep and store the tangible of the instruction used by instruction execution equipment
Equipment.Computer readable storage medium for example can be-- but it is not limited to-- storage device electric, magnetic storage apparatus, optical storage
Equipment, electric magnetic storage apparatus, semiconductor memory apparatus or above-mentioned any appropriate combination.Computer readable storage medium
More specific example (non exhaustive list) includes: portable computer diskette, hard disk, random access memory (RAM), read-only deposits
It is reservoir (ROM), erasable programmable read only memory (EPROM or flash memory), static random access memory (SRAM), portable
Compact disk read-only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanical coding equipment, for example thereon
It is stored with punch card or groove internal projection structure and the above-mentioned any appropriate combination of instruction.Calculating used herein above
Machine readable storage medium storing program for executing is not interpreted that instantaneous signal itself, the electromagnetic wave of such as radio wave or other Free propagations lead to
It crosses the electromagnetic wave (for example, the light pulse for passing through fiber optic cables) of waveguide or the propagation of other transmission mediums or is transmitted by electric wire
Electric signal.
Computer-readable program instructions as described herein can be downloaded to from computer readable storage medium it is each calculate/
Processing equipment, or outer computer or outer is downloaded to by network, such as internet, local area network, wide area network and/or wireless network
Portion stores equipment.Network may include copper transmission cable, optical fiber transmission, wireless transmission, router, firewall, interchanger, gateway
Computer and/or Edge Server.Adapter or network interface in each calculating/processing equipment are received from network to be counted
Calculation machine readable program instructions, and the computer-readable program instructions are forwarded, for the meter being stored in each calculating/processing equipment
In calculation machine readable storage medium storing program for executing.
Computer program instructions for executing disclosure operation can be assembly instruction, instruction set architecture (ISA) instructs,
Machine instruction, machine-dependent instructions, microcode, firmware instructions, condition setup data or with one or more programming languages
The source code or object code that any combination is write, the programming language include the programming language-of object-oriented such as
Smalltalk, C++ etc., and conventional procedural programming languages-such as " C " language or similar programming language.Computer
Readable program instructions can be executed fully on the user computer, partly execute on the user computer, be only as one
Vertical software package executes, part executes on the remote computer or completely in remote computer on the user computer for part
Or it is executed on server.In situations involving remote computers, remote computer can pass through network-packet of any kind
It includes local area network (LAN) or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as benefit
It is connected with ISP by internet).In some embodiments, by utilizing computer-readable program instructions
Status information carry out personalized customization electronic circuit, such as programmable logic circuit, field programmable gate array (FPGA) or can
Programmed logic array (PLA) (PLA), the electronic circuit can execute computer-readable program instructions, to realize each side of the disclosure
Face.
Referring herein to according to the flow chart of the method, apparatus (system) of the embodiment of the present disclosure and computer program product and/
Or block diagram describes various aspects of the disclosure.It should be appreciated that flowchart and or block diagram each box and flow chart and/
Or in block diagram each box combination, can be realized by computer-readable program instructions.
These computer-readable program instructions can be supplied to general purpose computer, special purpose computer or other programmable datas
The processor of processing unit, so that a kind of machine is produced, so that these instructions are passing through computer or other programmable datas
When the processor of processing unit executes, function specified in one or more boxes in implementation flow chart and/or block diagram is produced
The device of energy/movement.These computer-readable program instructions can also be stored in a computer-readable storage medium, these refer to
It enables so that computer, programmable data processing unit and/or other equipment work in a specific way, thus, it is stored with instruction
Computer-readable medium then includes a manufacture comprising in one or more boxes in implementation flow chart and/or block diagram
The instruction of the various aspects of defined function action.
Computer-readable program instructions can also be loaded into computer, other programmable data processing units or other
In equipment, so that series of operation steps are executed in computer, other programmable data processing units or other equipment, to produce
Raw computer implemented process, so that executed in computer, other programmable data processing units or other equipment
Instruct function action specified in one or more boxes in implementation flow chart and/or block diagram.
The flow chart and block diagram in the drawings show system, method and the computer journeys according to multiple embodiments of the disclosure
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
One module of table, program segment or a part of instruction, the module, program segment or a part of instruction include one or more use
The executable instruction of the logic function as defined in realizing.In some implementations as replacements, function marked in the box
It can occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be held substantially in parallel
Row, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram and/or
The combination of each box in flow chart and the box in block diagram and or flow chart, can the function as defined in executing or dynamic
The dedicated hardware based system made is realized, or can be realized using a combination of dedicated hardware and computer instructions.
The presently disclosed embodiments is described above, above description is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes are obvious for the those of ordinary skill in art field.The selection of term used herein, purport
In the principle, practical application or technological improvement to technology in market for best explaining each embodiment, or make the art
Other those of ordinary skill can understand each embodiment disclosed herein.
Claims (10)
1. a kind of information interacting method, which is characterized in that the described method includes:
Client process and service processes are created in terminal side；
Augmented reality AR request is initiated by the client process；
The AR request is responded by the service processes, obtains AR feedback result；
According to the AR feedback result, the AR fusion results being shown in the terminal side are obtained.
2. the method according to claim 1, wherein the method also includes: it is described terminal side create client
Before process and service processes,
Software Development Kit SDK is obtained, creates the client process by running the SDK；
It obtains augmented reality and services ARService, create the service by running the processing logic in the ARService
Process.
3. method according to claim 1 or 2, which is characterized in that the method also includes:
After initiating AR request by the client process, requested AR request data is stored in shared drive, the AR is asked
Data are asked to read for the service processes.
4. method according to claim 1 or 2, which is characterized in that the method also includes:
The AR request is responded by the service processes, after obtaining AR feedback result, the AR feedback result is stored in shared
In memory, the AR feedback result is read for the client process.
5. method according to claim 1-4, which is characterized in that according to the AR feedback result, obtain in institute
State the AR fusion results that terminal side is shown, comprising:
Virtual information is parsed from the AR feedback result；
The virtual information is merged with the actual environment parameter of acquisition, the AR fusion results is obtained, shows the AR
Fusion results.
6. method according to claim 1-4, which is characterized in that according to the AR feedback result, obtain in institute
State the AR fusion results that terminal side is shown, comprising:
AR is parsed from the AR feedback result requests requested processing logic；
Interface message is obtained from the SDK and runs the configuration parameter of the processing logic；
The processing logic is run using the SDK according to the interface message is enabled；
The processing logic is run according to the configuration parameter, obtains virtual information；
The virtual information is merged with the actual environment parameter of acquisition, the AR fusion results is obtained, shows the AR
Fusion results.
7. according to method described in claim 3-6, which is characterized in that the AR request, inside or outside terminal side
The request of input；
In the case where AR request is the first request inputted inside terminal side and terminal side externally input second is requested,
The method also includes: it is stored in the shared drive after first request and second request are packaged.
8. a kind of information interactive device characterized by comprising
Creation module, for creating client process and service processes in terminal side；
Request module, for initiating augmented reality AR request by the client process；
Respond module obtains AR feedback result for responding the AR request by the service processes；
Processing module, for obtaining the AR fusion results being shown in the terminal side according to the AR feedback result.
9. a kind of electronic equipment characterized by comprising
Processor；
Memory for storage processor executable instruction；
Wherein, the processor is configured to: perform claim require any one of 1 to 7 described in method.
10. a kind of computer readable storage medium, is stored thereon with computer program instructions, which is characterized in that the computer
Method described in any one of claim 1 to 7 is realized when program instruction is executed by processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910394192.1A CN110147288A (en) | 2019-05-13 | 2019-05-13 | Information interacting method and device, electronic equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910394192.1A CN110147288A (en) | 2019-05-13 | 2019-05-13 | Information interacting method and device, electronic equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110147288A true CN110147288A (en) | 2019-08-20 |
Family
ID=67594088
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910394192.1A Pending CN110147288A (en) | 2019-05-13 | 2019-05-13 | Information interacting method and device, electronic equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110147288A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112099967A (en) * | 2020-08-20 | 2020-12-18 | 深圳市元征科技股份有限公司 | Data transmission method, terminal, device, equipment and medium |
| CN114490727A (en) * | 2021-12-31 | 2022-05-13 | 深圳云天励飞技术股份有限公司 | High-dimensional vector searching method for target database and related equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012044735A2 (en) * | 2010-10-01 | 2012-04-05 | Imerj, Llc | Cross-environment communication using application space api |
| CN102843347A (en) * | 2011-06-24 | 2012-12-26 | 中兴通讯股份有限公司 | System, method, terminal and server for achieving mobile augmented reality service |
| CN103428270A (en) * | 2013-07-09 | 2013-12-04 | 国云科技股份有限公司 | Network communication method applicable to distributed-type environment |
| CN106570927A (en) * | 2016-10-14 | 2017-04-19 | 惠州Tcl移动通信有限公司 | Method of realizing virtual reality based on Android system, terminal and system |
| CN108492352A (en) * | 2018-03-22 | 2018-09-04 | 腾讯科技（深圳）有限公司 | Implementation method, device, system, computer equipment and the storage medium of augmented reality |
| CN108682037A (en) * | 2018-04-27 | 2018-10-19 | 腾讯科技（深圳）有限公司 | Method for relocating, device, equipment and the storage medium of camera posture tracing process |
-
2019
- 2019-05-13 CN CN201910394192.1A patent/CN110147288A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012044735A2 (en) * | 2010-10-01 | 2012-04-05 | Imerj, Llc | Cross-environment communication using application space api |
| CN102843347A (en) * | 2011-06-24 | 2012-12-26 | 中兴通讯股份有限公司 | System, method, terminal and server for achieving mobile augmented reality service |
| CN103428270A (en) * | 2013-07-09 | 2013-12-04 | 国云科技股份有限公司 | Network communication method applicable to distributed-type environment |
| CN106570927A (en) * | 2016-10-14 | 2017-04-19 | 惠州Tcl移动通信有限公司 | Method of realizing virtual reality based on Android system, terminal and system |
| CN108492352A (en) * | 2018-03-22 | 2018-09-04 | 腾讯科技（深圳）有限公司 | Implementation method, device, system, computer equipment and the storage medium of augmented reality |
| CN108682037A (en) * | 2018-04-27 | 2018-10-19 | 腾讯科技（深圳）有限公司 | Method for relocating, device, equipment and the storage medium of camera posture tracing process |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112099967A (en) * | 2020-08-20 | 2020-12-18 | 深圳市元征科技股份有限公司 | Data transmission method, terminal, device, equipment and medium |
| CN114490727A (en) * | 2021-12-31 | 2022-05-13 | 深圳云天励飞技术股份有限公司 | High-dimensional vector searching method for target database and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112291583A (en) | Live broadcast wheat connecting method and device, server, terminal and storage medium | |
| CN106375479B (en) | Data sharing method and device | |
| CN109920065A (en) | Methods of exhibiting, device, equipment and the storage medium of information | |
| CN110134532A (en) | A kind of information interacting method and device, electronic equipment and storage medium | |
| CN112738544B (en) | Live broadcast room interaction method and device, electronic equipment and storage medium | |
| CN108260020A (en) | The method and apparatus that interactive information is shown in panoramic video | |
| CN109963200A (en) | Video broadcasting method and device | |
| CN110458218A (en) | Image classification method and device, sorter network training method and device | |
| CN111158576A (en) | Social relationship establishing method and device based on live broadcast scene and storage medium | |
| CN110147288A (en) | Information interacting method and device, electronic equipment and storage medium | |
| CN108540850A (en) | Barrage display methods and device | |
| CN110121106A (en) | Video broadcasting method and device | |
| CN114090140B (en) | Interaction method between devices based on pointing operation and electronic device | |
| CN109359218A (en) | Multimedia resource methods of exhibiting and device | |
| CN112783316A (en) | Augmented reality-based control method and apparatus, electronic device, and storage medium | |
| CN109064280A (en) | The methods of exhibiting and device of user's right | |
| CN114564101B (en) | Control method and terminal of three-dimensional interface | |
| CN109040837A (en) | Method for processing video frequency and device, electronic equipment and storage medium | |
| CN113518198A (en) | Session interface display method, conference interface display method and device and electronic equipment | |
| CN106354254B (en) | The immersion exchange method and device of intelligent router | |
| CN109992754A (en) | Document processing method and device | |
| CN113518261A (en) | Method and device for guiding video playing, computer equipment and storage medium | |
| CN109587344A (en) | Call control method, device, mobile terminal and medium based on mobile terminal | |
| CN109873823A (en) | Verification method and device, electronic equipment and storage medium | |
| CN109150976A (en) | The method, apparatus and storage medium of security service are provided |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190820 |
|
| RJ01 | Rejection of invention patent application after publication |