CN107172542B - A kind of step sound feedback method, device and virtual reality system - Google Patents
A kind of step sound feedback method, device and virtual reality system Download PDFInfo
- Publication number
- CN107172542B CN107172542B CN201710225220.8A CN201710225220A CN107172542B CN 107172542 B CN107172542 B CN 107172542B CN 201710225220 A CN201710225220 A CN 201710225220A CN 107172542 B CN107172542 B CN 107172542B
- Authority
- CN
- China
- Prior art keywords
- voice signal
- virtual reality
- signal
- sound
- basic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/683—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
Landscapes
- Engineering & Computer Science (AREA)
- Library & Information Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a kind of step sound feedback method, device and virtual reality systems, this method comprises: the signal of the sole stress variation of the collected reflection virtual reality shoes of the sensing device for receiving virtual reality shoes；Step feature is determined according to the signal；Basic step voice signal is determined according to the step feature；It obtains and is directed to the preset step sound material of current virtual reality scene；The step sound material is superimposed on the basic step voice signal, the step voice signal under current virtual reality scene is obtained；Control sounding device plays the step voice signal under the current virtual reality scene.
Description
Technical field
The present invention relates to Audio Signal Processing technical fields, more particularly it relates to a kind of step sound feedback side
Method, a kind of step audio feedback means and a kind of virtual reality system.
Background technique
Virtual reality (Virtual Reality, VR) technology is that it comprehensively utilizes computer graphics system and various reality
And the interface equipments such as control, the technology for immersing feeling is provided in three-dimensional environment generating on computers, can interacting.
Now, developer increasingly values the simulation in reality environment to sense organs such as the sense of hearing, vision, tactiles,
To solve the problems, such as to influence immersion experience because of the missing of feeling, for example, if ignoring in reality environment heavy
Gravity feel, people will be unable to experience oneself walking some influence of bring, therefore, meeting in reality environment when walking
There is hollow feeling.
It currently, the sense organ simulation mainly realized includes the simulation to vision, for example is to see in reality environment certainly
Oneself both hands, and the simulation to tactile, for example, be in reality environment by foot apply and virtual reality scenario
Matched stress simulates foot's stress etc., but rarely has the simulation to the sense of hearing, and the especially simulation to step sound is therefore, non-
Often it is necessary to provide a kind of in reality environment carries out the technical solution of step sound feedback, to improve immersion experience.
Summary of the invention
One purpose of the embodiment of the present invention is to provide a kind of technical solution for carrying out step sound feedback, to improve user
Immersion experience.
According to the first aspect of the invention, a kind of step sound feedback method is provided comprising:
Receive the sole stress variation of the collected reflection virtual reality shoes shoes of sensing device of virtual reality shoes
Signal；
Step feature is determined according to the signal；
Basic step voice signal is determined according to the step feature；
It obtains and is directed to the preset step sound material of current virtual reality scene；
The step sound material is superimposed on the basic step voice signal, current virtual reality scene is obtained
Under step voice signal；
Control sounding device plays the step voice signal under the current virtual reality scene.
Optionally, the step feature includes landing the landing moment of speed and the corresponding landing speed, wherein institute
It is directly proportional in the volume value at corresponding landing moment with the basic step voice signal to state landing speed.
Optionally, described to determine that basic step voice signal includes: according to the step feature
Read pre-stored step voice signal；
The pre-stored step voice signal according to the step characteristic modification obtains the basic step sound
Signal.
It is optionally, described that basic step voice signal is determined according to the step feature specifically:
In pre-stored step voice signal database, the step voice signal being consistent with the step feature is searched
Form basic step voice signal.
Optionally, described obtain includes: for the preset step sound material of current virtual reality scene
Search the table of comparisons of mapping relations between pre-stored reflection virtual reality scenario and step sound material；
According to the table of comparisons, the step sound material of the corresponding current virtual reality scene is obtained.
According to the second aspect of the invention, a kind of step audio feedback means are additionally provided comprising:
Signal receiving module, the collected reflection virtual reality shoes of sensing device for receiving virtual reality shoes
The signal of sole stress variation；
Step characteristic determination module, for determining step feature according to the signal；
First voice signal determining module, for determining basic step voice signal according to the step feature；
Sound material obtains module, is directed to the preset step sound material of current virtual reality scene for obtaining；
Second sound signal determining module, for the step sound material to be superimposed to the basic footsteps message
On number, the step voice signal under current virtual reality scene is obtained；And
Execution module plays step voice signal under the current virtual reality scene for controlling sounding device.
Optionally, the first voice signal determining module includes:
Reading unit, for reading pre-stored step voice signal；And
Amending unit is used for the pre-stored step voice signal according to the step characteristic modification, obtains described
Basic step voice signal.
Optionally, the first voice signal determining module is specifically used in pre-stored step sound signal data
In library, searches the step voice signal being consistent with the step feature and form basic step voice signal.
According to the third aspect of the invention we, a kind of step audio feedback means are additionally provided comprising memory and processing
Device, for storing instruction, described instruction is operated for controlling the processor to execute according to the present invention the memory
First aspect described in step sound feedback method.
According to the fourth aspect of the invention, a kind of virtual reality system is additionally provided comprising virtual reality shoes, sounding dress
It sets and according to the second aspect of the invention or step audio feedback means described in the third aspect, the virtual reality footwear
There is sensing device, the sensing device is arranged to be used for the signal that acquisition reflects the sole stress variation of the virtual reality shoes
The step audio feedback means are supplied to, the sounding device is arranged to be used for according to the step audio feedback means
Control plays the step voice signal under the current virtual reality scene.
A beneficial effect of the invention is that step sound feedback method of the invention, device can be according to reflection shoes
The signal of bottom stress variation determines basic step voice signal, and by folded on the basis of the basic step voice signal
It is added in the step sound material walked in current virtual reality scene, active user can be obtained under current virtual reality scene
The step voice signal of walking, and then realize the immersion feedback of step sound, to improve the immersion experience of user.
By referring to the drawings to the detailed description of exemplary embodiment of the present invention, other feature of the invention and its
Advantage will become apparent.
Detailed description of the invention
It is combined in the description and the attached drawing for constituting part of specification shows the embodiment of the present invention, and even
With its explanation together principle for explaining the present invention.
Fig. 1 is the flow diagram according to a kind of embodiment of step sound feedback method of the present invention；
Fig. 2 is to be shown according to the waveform of the signal of the sole stress variation of the reflection virtual reality shoes of an embodiment of the present invention
It is intended to；
Fig. 3 is the frame principle figure according to a kind of embodiment of step audio feedback means of the present invention；
Fig. 4 is the frame principle figure according to a kind of hardware configuration of step audio feedback means of the present invention；
Fig. 5 is the frame principle figure according to a kind of embodiment of virtual reality system of the present invention.
Specific embodiment
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should also be noted that unless in addition having
Body explanation, the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The range of invention.
Be to the description only actually of at least one exemplary embodiment below it is illustrative, never as to the present invention
And its application or any restrictions used.
Technology, method and apparatus known to person of ordinary skill in the relevant may be not discussed in detail, but suitable
In the case of, the technology, method and apparatus should be considered as part of specification.
It is shown here and discuss all examples in, any occurrence should be construed as merely illustratively, without
It is as limitation.Therefore, other examples of exemplary embodiment can have different values.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined in a attached drawing, then in subsequent attached drawing does not need that it is further discussed.
Fig. 1 is a kind of flow diagram of embodiment of step sound feedback method according to the present invention.
According to Fig. 1, include the following steps: according to the method for the present invention
Step S110, the collected sole stress for reflecting the virtual reality shoes of sensing device for receiving virtual reality shoes become
The signal of change.
According to the method for the present invention, virtual reality system is also configured with virtual reality shoes other than head-mounted display apparatus,
The virtual reality footwear has sensing device, and the sole stress which is arranged to be used for acquisition reflection virtual reality shoes becomes
The signal of change.
Specifically, which may include shoe body, the sensing device that shoe bottom is arranged in, which can
It to be built in shoe body, also can be set in the outside of shoe body, as long as can be adopted when user puts on virtual reality shoes walking
Collect the signal of reflection sole stress variation.
Since the signal has mapping relations with the step for putting on virtual reality shoes walking, it can be according to the letter
Number determine corresponding step feature.
The sensing device may include force snesor, and the magnitude of the power between virtual reality shoes and ground is converted to electricity
Signal output.
The sensing device can form an induction point in shoe bottom, the induction point for example positioned at rear heel region,
Two induction points (such as being located at forefoot area and rear heel region) can be formed in shoe bottom, it can also be in shoe body
More induction points are formed on bottom.
Step S120 determines step feature according to above-mentioned signal.
Since when walking, step sound is primarily generated at the landing stage, therefore, which may include landing speed
The landing moment etc. of degree and corresponding landing speed.
When Fig. 2 show user and puts on the walking of virtual reality shoes, wherein signal that an induction point of a shoes generates
Waveform diagram.
According to the waveform diagram it is found that each full curve along the time axis indicate corresponding induction point from step on to
The waveform variation lifted, every curve are divided into the landing rank that depth is gradually increased according to change in depth (directly proportional to pressure change)
What section and depth were gradually reduced lifts the stage, according to every full curve the slope of any time in landing stage can be true
Surely the landing speed at moment is corresponded to, and can determine each landing speed corresponding landing moment in turn.
Step S130 determines basic step voice signal according to step feature.
In step S130, can preset step feature and between mapping relations mapping ruler, and according to this
Mapping ruler determines basic step voice signal.
The mapping ruler is directly proportional to the size of step sound for example including landing speed, can be true according to the mapping ruler
It is scheduled on the size of the step sound at landing speed corresponding landing moment, and then determines basic step voice signal in the landing
The volume value at moment.
The embodiment of an induction point is respectively formed on two shoes of virtual reality shoes for sensing device, if shoes
Induction point A1 generates signal FA1, and the induction point A2 of another shoes generates signal FA2, signal FA1, FA2 can be superimposed,
And all landing stages are determined according to superimposed signal, according still further to mapping ruler, according to landing speed and corresponding landing
Moment determines basic step voice signal.
The embodiment for respectively forming an induction point on two shoes of virtual reality shoes for sensing device, is also possible to:
The step voice signal to induction signal FA1 and the step voice signal to induction signal FA2 are first determined respectively, obtain two-way footsteps
Sound signal, then be superimposed obtained two-way step voice signal to obtain basic step voice signal.
The embodiment for respectively forming two induction points in two shoes of virtual reality shoes for sensing device, if the sense of a shoes
Should point A1 generate signal FA1, induction point A2 and generate signal FA2, the induction point B1 of another shoes generates signal FB1, induction point B2
Signal FB2 is generated, can be and determine the step voice signal to induction signal FA1, the footsteps message to induction signal FA2 respectively
Number, the step voice signal to induction signal FB1 and the step voice signal to induction signal FB2, obtain four road footsteps messages
Number, tetra- road step voice signal of Zai Jiang is superimposed to obtain basic step voice signal.
The embodiment for respectively forming over two induction points in two shoes of virtual reality shoes for sensing device, is referred to
The embodiment for respectively forming two induction points obtains basic step voice signal, and details are not described herein.
When Jiang Gelu step voice signal is superimposed to obtain basic step voice signal, any volume value for landing the moment
Can maximum value of the road the Qu Mei step voice signal at the corresponding landing moment, or four road step voice signals is taken to land corresponding
The average value etc. at moment.
In step S130, determine that basic step voice signal also may further include according to step feature:
Step S131 reads pre-stored step voice signal.
Here, the step voice signal generated can be picked up according to typical step, and the footsteps picked up is stored in advance
Sound signal.
The pre-stored step voice signal may include the voice signal that primary landing generates.
Step S132 is obtained according to the step characteristic modification of the step S120 determination pre-stored step voice signal
The basic step voice signal.
In step S132, it can first compare the feature according to the step S120 step feature determined and typical step,
Such as compare landing speed between the two, the landing time that the landing stage needs etc., this is corrected in advance further according to comparison result
The step voice signal of storage.
Modified method for example can be with are as follows: first according to the difference between the landing time, to pre-stored footsteps message
It number carries out elongating or shortening processing, this can be the time interval between adjustment consecutive number strong point, so that treated step
The landing time consistency of voice signal and the step feature determined according to step S120；Further according to treated step voice signal
, in the ratio of the landing speed at same landing moment, increase or reduce correspondence with according to step S120 determining step feature and fall
The volume value at ground moment obtains basic step voice signal.
In step S130, determine that basic step voice signal can further include according to step feature:
In pre-stored step voice signal database, the foot being consistent with the step S120 step feature determined is searched
Step voice signal forms basic step voice signal.
The step sound with different step features once landed can be stored in advance in step voice signal database
Signal.In this way, the step feature that can be determined according to step S120 searches and lands matched step voice signal every time and formed
The basic step voice signal.
Step S140 is obtained and is directed to the preset step sound material of current virtual reality scene.
Due to virtual reality system have a variety of virtual reality scenarios, the virtual reality scenario for example including meadow scene,
Gravel road scene, asphalt road scene, sandy beach scene, scene etc. in water, due to the sound for sending of walking under different scenes
Be it is differentiated, therefore, in order to realize the feedback walked under different scenes, can for various scenes preset footsteps phoneme
Material, to be superimposed in the basic step voice signal that step S130 is determined.
Obtaining in step S140 may further include for the preset step sound material of current virtual reality scene:
Step S141 searches pair of mapping relations between pre-stored reflection virtual reality scenario and step sound material
According to table.
Step S142 obtains the step sound material of corresponding current virtual reality scene according to the table of comparisons.
Step sound material is superimposed on basic step voice signal by step S150, obtains current virtual reality field
Step voice signal under scape.
The step sound material embodies the step characteristic voice walked under current virtual reality scene, is superimposed upon
Just it may be implemented in the feedback for the step sound walked under current virtual reality scene on basic step voice signal.
By step S150, under different virtual reality scenarios, even if basic step voice signal is identical, finally
It is also different for feeding back to the step sound of user, and the step sound for feeding back to user is able to reflect in current virtual reality field
The characteristic voice walked under scape, and then immersion experience can be further increased.
Step S160, control sounding device play the step voice signal under the current virtual reality scenario, and realization is being worked as
The feedback for the step sound walked under preceding virtual reality scenario.
Fig. 3 is the frame principle figure according to a kind of embodiment of step audio feedback means of the present invention.
According to Fig.3, step audio feedback means of the present invention include that signal receiving module 310, step feature determine mould
Block 320, the first voice signal determining module 330, sound material obtain module 340, second sound signal determining module 350 and
Execution module 360.
The signal receiving module 310 is used to receive collected reflection virtual reality shoes of sensing device of virtual reality shoes
Sole stress variation signal.
The step characteristic determination module 320 is used to determine step feature according to the signal that signal receiving module 310 provides.
The step feature that the first voice signal determining module 330 is used to be determined according to step characteristic determination module 320 is true
Fixed basic step voice signal；
The sound material obtains module 340 and is directed to the preset step sound material of current virtual reality scene for obtaining.
The second sound signal determining module 350 is used for the footsteps phoneme for providing sound material acquisition module 340
Material is superimposed on basic step voice signal, obtains the step voice signal under current virtual reality scene.
The execution module 360 is used to control the step voice signal under sounding device broadcasting current virtual reality scene, with
Realize the feedback for the step sound walked under current virtual reality scene.
Above-mentioned first voice signal determining module 330 may further include reading unit and amending unit (does not show in figure
Out).The reading unit is for reading pre-stored step voice signal.The amending unit according to the step feature for repairing
The just described pre-stored step voice signal, obtains the basic step voice signal.
Above-mentioned first voice signal determining module 330 can also be specifically used in pre-stored step sound signal data
In library, searches the step voice signal being consistent with step feature and form basic step voice signal.
Above-mentioned first voice signal determining module 330 can also be specifically used for according between step feature and step sound
Mapping ruler determines basic step voice signal.
The mapping ruler for example, the landing speed in step feature is directly proportional to the size of step sound.
Above-mentioned second sound signal determining module 350 can be further used for searching pre-stored reflection virtual reality field
The table of comparisons of mapping relations between scape and step sound material, and corresponding current virtual reality field is obtained according to the table of comparisons
The step sound material of scape.
Fig. 4 is a kind of schematic diagram of hardware configuration of step audio feedback means according to the present invention.
According to Fig.4, in this embodiment, which may include memory 420 and processor
410, for storing instruction, which is operated according to the present invention to execute the memory 420 for control processor 710
Step sound feedback method.
The memory 420 may include high speed random access memory, can also include nonvolatile memory, such as one or
Multiple magnetic storage devices, flash memory or other non-volatile solid state memories.
Fig. 5 is a kind of frame principle figure of structure of virtual reality system according to the present invention.
According to Fig.5, which includes any of the above-described kind of step audio feedback means, is marked in Fig. 5
It is denoted as 510.
The virtual reality system further includes virtual reality shoes 520, sounding device 530, head-mounted display apparatus 540.
The virtual reality footwear has sensing device, which is arranged to be used for the shoes of acquisition reflection virtual reality shoes
The signal of bottom stress variation is supplied to step audio feedback means 510.
The sounding device 520 is arranged to be used for playing the current void according to the control of step audio feedback means 510
Step voice signal under quasi- reality scene.
The head-mounted display apparatus 540 is arranged to be used for realizing the immersion experience of virtual reality.
According to Fig.5, which can also include hand grip control means 550, photographic device 560, host
570, light-seeking device 580 etc..
Above-mentioned host 570 and photographic device 560, head-mounted display apparatus 540, hand grip control means 550, step sound are anti-
The communication connections such as device 510 are presented, which may include wireless communication connection and/or wire communication connection.
The step audio feedback means 510 can be set in virtual reality shoes 520, also can be set in host 570
Deng.
Above-mentioned photographic device 560 can be set on head-mounted display apparatus 540, also may be mounted at carry out virtual reality
In the site space of experience.
Above-mentioned sounding device 530 can be set on head-mounted display apparatus 540.
Above-mentioned light-seeking device 580 includes infrared photosphere etc., these photospheres can be distributed in hand grip control means 550, void
On quasi- reality shoes 520.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment
Divide cross-reference, each embodiment focuses on the differences from other embodiments, but those skilled in the art
Member is it should be understood that the various embodiments described above can according to need exclusive use or be combined with each other.In addition, for device
For embodiment, since it is corresponding with embodiment of the method, so describing fairly simple, related place is implemented referring to method
The explanation of the corresponding part of example.The apparatus embodiments described above are merely exemplary, wherein being used as separation unit
The module of explanation may or may not be physically separated.
The present invention can be device, method and/or computer program product.Computer program product may include computer
Readable storage medium storing program for executing, containing for making processor realize the computer-readable program instructions of various aspects of the invention.
Computer readable storage medium, which can be, can keep and store the tangible of the instruction used by instruction execution equipment
Equipment.Computer readable storage medium for example can be-- but it is not limited to-- storage device electric, magnetic storage apparatus, optical storage
Equipment, electric magnetic storage apparatus, semiconductor memory apparatus or above-mentioned any appropriate combination.Computer readable storage medium
More specific example (non exhaustive list) includes: portable computer diskette, hard disk, random access memory (RAM), read-only deposits
It is reservoir (ROM), erasable programmable read only memory (EPROM or flash memory), static random access memory (SRAM), portable
Compact disk read-only memory (CD-ROM), digital versatile disc (DVD), memory stick, floppy disk, mechanical coding equipment, for example thereon
It is stored with punch card or groove internal projection structure and the above-mentioned any appropriate combination of instruction.Calculating used herein above
Machine readable storage medium storing program for executing is not interpreted that instantaneous signal itself, the electromagnetic wave of such as radio wave or other Free propagations lead to
It crosses the electromagnetic wave (for example, the light pulse for passing through fiber optic cables) of waveguide or the propagation of other transmission mediums or is transmitted by electric wire
Electric signal.
Computer-readable program instructions as described herein can be downloaded to from computer readable storage medium it is each calculate/
Processing equipment, or outer computer or outer is downloaded to by network, such as internet, local area network, wide area network and/or wireless network
Portion stores equipment.Network may include copper transmission cable, optical fiber transmission, wireless transmission, router, firewall, interchanger, gateway
Computer and/or Edge Server.Adapter or network interface in each calculating/processing equipment are received from network to be counted
Calculation machine readable program instructions, and the computer-readable program instructions are forwarded, for the meter being stored in each calculating/processing equipment
In calculation machine readable storage medium storing program for executing.
Computer program instructions for executing operation of the present invention can be assembly instruction, instruction set architecture (ISA) instructs,
Machine instruction, machine-dependent instructions, microcode, firmware instructions, condition setup data or with one or more programming languages
The source code or object code that any combination is write, the programming language include the programming language-of object-oriented such as
Smalltalk, C++ etc., and conventional procedural programming languages-such as " C " language or similar programming language.Computer
Readable program instructions can be executed fully on the user computer, partly execute on the user computer, be only as one
Vertical software package executes, part executes on the remote computer or completely in remote computer on the user computer for part
Or it is executed on server.In situations involving remote computers, remote computer can pass through network-packet of any kind
It includes local area network (LAN) or wide area network (WAN)-is connected to subscriber computer, or, it may be connected to outer computer (such as benefit
It is connected with ISP by internet).In some embodiments, by utilizing computer-readable program instructions
Status information carry out personalized customization electronic circuit, such as programmable logic circuit, field programmable gate array (FPGA) or can
Programmed logic array (PLA) (PLA), the electronic circuit can execute computer-readable program instructions, to realize each side of the invention
Face.
Referring herein to according to the method for the embodiment of the present invention, the flowchart and or block diagram of device and computer program product
Describe various aspects of the invention.It should be appreciated that each box and flowchart and or block diagram of flowchart and or block diagram
In each box combination, can be realized by computer-readable program instructions.
These computer-readable program instructions can be supplied to general purpose computer, special purpose computer or other programmable datas
The processor of processing unit, so that a kind of machine is produced, so that these instructions are passing through computer or other programmable datas
When the processor of processing unit executes, function specified in one or more boxes in implementation flow chart and/or block diagram is produced
The device of energy/movement.These computer-readable program instructions can also be stored in a computer-readable storage medium, these refer to
It enables so that computer, programmable data processing unit and/or other equipment work in a specific way, thus, it is stored with instruction
Computer-readable medium then includes a manufacture comprising in one or more boxes in implementation flow chart and/or block diagram
The instruction of the various aspects of defined function action.
Computer-readable program instructions can also be loaded into computer, other programmable data processing units or other
In equipment, so that series of operation steps are executed in computer, other programmable data processing units or other equipment, to produce
Raw computer implemented process, so that executed in computer, other programmable data processing units or other equipment
Instruct function action specified in one or more boxes in implementation flow chart and/or block diagram.
The flow chart and block diagram in the drawings show the device of multiple embodiments according to the present invention, method and computer journeys
The architecture, function and operation in the cards of sequence product.In this regard, each box in flowchart or block diagram can generation
One module of table, program segment or a part of instruction, the module, program segment or a part of instruction include one or more use
The executable instruction of the logic function as defined in realizing.In some implementations as replacements, function marked in the box
It can occur in a different order than that indicated in the drawings.For example, two continuous boxes can actually be held substantially in parallel
Row, they can also be executed in the opposite order sometimes, and this depends on the function involved.It is also noted that block diagram and/or
The combination of each box in flow chart and the box in block diagram and or flow chart, can the function as defined in executing or dynamic
The dedicated hardware based system made is realized, or can be realized using a combination of dedicated hardware and computer instructions.It is right
For those skilled in the art it is well known that, by hardware mode realize, by software mode realize and pass through software and
It is all of equal value that the mode of combination of hardware, which is realized,.
Various embodiments of the present invention are described above, above description is exemplary, and non-exclusive, and
It is not limited to disclosed each embodiment.Without departing from the scope and spirit of illustrated each embodiment, for this skill
Many modifications and changes are obvious for the those of ordinary skill in art field.The selection of term used herein, purport
In the principle, practical application or technological improvement to the technology in market for best explaining each embodiment, or lead this technology
Other those of ordinary skill in domain can understand each embodiment disclosed herein.The scope of the present invention is limited by appended claims
It is fixed.
Claims (10)
1. a kind of step sound feedback method characterized by comprising
Receive the signal of the sole stress variation of the collected reflection virtual reality shoes of sensing device of virtual reality shoes；
Step feature is determined according to the signal；
Basic step voice signal is determined according to the step feature；
It obtains and is directed to the preset step sound material of current virtual reality scene；
The step sound material is superimposed on the basic step voice signal, is obtained under current virtual reality scene
Step voice signal；
Control sounding device plays the step voice signal under the current virtual reality scene.
2. step sound feedback method according to claim 1, which is characterized in that the step feature includes landing speed
With the landing moment of the correspondence landing speed, wherein the landing speed is with the basic step voice signal corresponding
The volume value for landing the moment is directly proportional.
3. step sound feedback method according to claim 1, which is characterized in that described to be determined according to the step feature
Basic step voice signal includes:
Read pre-stored step voice signal；
The pre-stored step voice signal according to the step characteristic modification obtains the basic footsteps message
Number.
4. step sound feedback method according to claim 1, which is characterized in that described to be determined according to the step feature
Basic step voice signal specifically:
In pre-stored step voice signal database, searches the step voice signal being consistent with the step feature and formed
Basic step voice signal.
5. step sound feedback method according to any one of claim 1 to 4, which is characterized in that the acquisition is directed to
The preset step sound material of current virtual reality scene includes:
Search the table of comparisons of mapping relations between pre-stored reflection virtual reality scenario and step sound material；
According to the table of comparisons, obtain described for the preset step sound material of current virtual reality scene.
6. a kind of step audio feedback means characterized by comprising
Signal receiving module, the sole of the collected reflection virtual reality shoes of sensing device for receiving virtual reality shoes
The signal of stress variation；
Step characteristic determination module, for determining step feature according to the signal；
First voice signal determining module, for determining basic step voice signal according to the step feature；
Sound material obtains module, is directed to the preset step sound material of current virtual reality scene for obtaining；
Second sound signal determining module, for the step sound material to be superimposed to the basic step voice signal
On, obtain the step voice signal under current virtual reality scene；And
Execution module plays step voice signal under the current virtual reality scene for controlling sounding device.
7. step audio feedback means according to claim 6, which is characterized in that the first voice signal determining module
Include:
Reading unit, for reading pre-stored step voice signal；And
Amending unit is used for the pre-stored step voice signal according to the step characteristic modification, obtains described basic
Step voice signal.
8. step audio feedback means according to claim 6, which is characterized in that the first voice signal determining module
Specifically for searching the step voice signal being consistent with the step feature in pre-stored step voice signal database
Form basic step voice signal.
9. a kind of step audio feedback means, which is characterized in that including memory and processor, the memory refers to for storing
It enables, described instruction is operated for controlling the processor to execute step according to any one of claim 1 to 5
Sound feedback method.
10. a kind of virtual reality system, which is characterized in that including virtual reality shoes, sounding device and according to claim 6 to 9
Any one of described in step audio feedback means, the virtual reality footwear has sensing device, and the sensing device is set
The step audio feedback means, institute are supplied to for the signal for acquiring the sole stress variation for reflecting the virtual reality shoes
Sounding device is stated to be arranged to be used for playing the current virtual reality scene according to the control of the step audio feedback means
Under step voice signal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710225220.8A CN107172542B (en) | 2017-04-07 | 2017-04-07 | A kind of step sound feedback method, device and virtual reality system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710225220.8A CN107172542B (en) | 2017-04-07 | 2017-04-07 | A kind of step sound feedback method, device and virtual reality system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107172542A CN107172542A (en) | 2017-09-15 |
| CN107172542B true CN107172542B (en) | 2019-03-15 |
Family
ID=59849879
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710225220.8A Active CN107172542B (en) | 2017-04-07 | 2017-04-07 | A kind of step sound feedback method, device and virtual reality system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107172542B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111028374B (en) * | 2019-10-30 | 2021-09-21 | 中科南京人工智能创新研究院 | Attendance machine and attendance system based on gait recognition |
| CN118799462A (en) * | 2020-06-18 | 2024-10-18 | 完美世界(北京)软件科技发展有限公司 | Virtual footprint generation method, device and equipment |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1206007C (en) * | 2002-10-31 | 2005-06-15 | 威盛电子股份有限公司 | Pressure-sensitive virtual running machine |
| CN2886661Y (en) * | 2006-01-23 | 2007-04-04 | 浙江理工大学 | Human-machine interaction oriented foot force feedback device |
| US10725298B2 (en) * | 2014-03-26 | 2020-07-28 | Mark D. Wieczorek, P.C. | Virtual reality devices and accessories |
| CN105487657A (en) * | 2015-11-24 | 2016-04-13 | 小米科技有限责任公司 | Sound loudness determination method and apparatus |
-
2017
- 2017-04-07 CN CN201710225220.8A patent/CN107172542B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN107172542A (en) | 2017-09-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7125992B2 (en) | Building a virtual reality (VR) game environment using a virtual reality map of the real world | |
| RU2678361C1 (en) | Audio navigation assistance | |
| US20190361797A1 (en) | System and method for developing, testing and deploying digital reality applications into the real world via a virtual world | |
| JP2021534491A (en) | Cross reality system | |
| CN112334953A (en) | Multiple integration model for device localization | |
| JP2021168139A (en) | Method, device, apparatus and medium for man-machine interactions | |
| US20110293144A1 (en) | Method and System for Rendering an Entertainment Animation | |
| CN113946211A (en) | Method for interacting multiple objects based on metauniverse and related equipment | |
| CN106484115A (en) | For strengthening the system and method with virtual reality | |
| JP2022548331A (en) | Artificial Intelligence (AI) controlled camera perspective generator and AI broadcaster | |
| CN114419205B (en) | Driving method of virtual digital person and training method of pose acquisition model | |
| JP2022545128A (en) | Artificial Intelligence (AI) controlled camera perspective generator and AI broadcaster | |
| CN105427865A (en) | Voice control system and method of intelligent robot based on artificial intelligence | |
| CN113939870A (en) | Technique for learning valid music features for generation and retrieval based applications | |
| JP6863936B2 (en) | Speech generator in virtual space, quadtree generation method, and speech generator | |
| US20170076629A1 (en) | Apparatus and method for supporting choreography | |
| JP2022509731A (en) | Cross reality system | |
| CN114999441A (en) | Avatar generation method, apparatus, device, storage medium, and program product | |
| CN107172542B (en) | A kind of step sound feedback method, device and virtual reality system | |
| CN113113045A (en) | Scene picture display method, device, terminal and storage medium | |
| CN112973130B (en) | Playback model construction method, device, equipment and storage medium of virtual scene | |
| CN111739135B (en) | Virtual character model processing method and device and readable storage medium | |
| CN111243070B (en) | Virtual reality presenting method, system and device based on 5G communication | |
| WO2024173398A1 (en) | Qualifying labels automatically attributed to content in images | |
| CN116225234A (en) | Interaction method and cloud server |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |