CN107404581A - Musical instrument analogy method, device and the storage medium and mobile terminal of mobile terminal - Google Patents
Musical instrument analogy method, device and the storage medium and mobile terminal of mobile terminal Download PDFInfo
- Publication number
- CN107404581A CN107404581A CN201710613432.3A CN201710613432A CN107404581A CN 107404581 A CN107404581 A CN 107404581A CN 201710613432 A CN201710613432 A CN 201710613432A CN 107404581 A CN107404581 A CN 107404581A
- Authority
- CN
- China
- Prior art keywords
- mobile terminal
- user
- scale
- data
- musical instrument
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 34
- 230000001133 acceleration Effects 0.000 claims description 25
- 230000015654 memory Effects 0.000 claims description 18
- 238000006073 displacement reaction Methods 0.000 claims description 16
- 238000004590 computer program Methods 0.000 claims description 4
- 238000004088 simulation Methods 0.000 abstract description 16
- 230000002093 peripheral effect Effects 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 230000000694 effects Effects 0.000 description 7
- 230000002452 interceptive effect Effects 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 230000000903 blocking effect Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 230000006399 behavior Effects 0.000 description 2
- 238000007664 blowing Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000004247 hand Anatomy 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 241000209140 Triticum Species 0.000 description 1
- 235000021307 Triticum Nutrition 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 210000000707 wrist Anatomy 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Environmental & Geological Engineering (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Electrophonic Musical Instruments (AREA)
Abstract
The embodiment of the invention discloses musical instrument analogy method, device and the storage medium and mobile terminal of a kind of mobile terminal, methods described includes：Air flow information, the scale control instruction of user's input and the user that acquisition user sends are to mobile terminal close to away from status information；Corresponding volume data is generated according to the air flow information, corresponding scale data are generated according to the scale control instruction, and corresponding audio data are generated close to away from status information according to described；The setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data.Technical scheme provided in an embodiment of the present invention, enriches the musical instrument analog form of mobile terminal, and makes the audio of the musical instrument of mobile terminal simulation more life-like.
Description
Technical field
The present embodiments relate to terminal applies technical field, more particularly to a kind of musical instrument analogy method of mobile terminal,
Device and storage medium and mobile terminal.
Background technology
With the development of electronic technology, the mobile terminal such as mobile phone, tablet personal computer turns into must can not in people's daily life
Few instrument.At present, the function on mobile terminal is more and more, and people can be made a phone call by mobile terminal, be done shopping, searching for letter
Breath, can also be played by mobile terminal analog instruments, such as the performance of the simulation musical instrument such as piano or drum.
But the musical instrument analog functuion of current mobile terminal is relatively simple, the fairly simple dullness of effect of performance, not
The musical instrument simulation demand of the growing personalization of people, diversification can be met.
The content of the invention
The embodiment of the present invention provides a kind of musical instrument analogy method, device and the storage medium and mobile terminal of mobile terminal,
The musical instrument analog form of mobile terminal can be enriched.
In a first aspect, the embodiments of the invention provide a kind of musical instrument analogy method of mobile terminal, including：
Air flow information, the scale control instruction of user's input and the user that acquisition user sends are to mobile terminal close to far
From status information；
Corresponding volume data is generated according to the air flow information, corresponding scale is generated according to the scale control instruction
Data, and generate corresponding audio data close to away from status information according to described；
The setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data.
In second aspect, the embodiments of the invention provide a kind of musical instrument analogue means of mobile terminal, including：
User's operation information acquisition module, the scale control for obtaining air flow information, the user input that user sends refer to
Order and user are to the close away from status information of mobile terminal；
Tone data acquisition module, for generating corresponding volume data according to the air flow information, according to the scale
Control instruction generates corresponding scale data, and generates corresponding audio data close to away from status information according to described；
Musical sound playing module, for sending setting playing type pleasure according to the volume data, scale data and audio data
The corresponding musical sound of device.
The third aspect, the embodiments of the invention provide a kind of computer-readable recording medium, is stored thereon with computer journey
Sequence, the musical instrument analogy method of the mobile terminal provided such as first aspect is realized when the program is executed by processor.
In fourth aspect, the embodiments of the invention provide a kind of mobile terminal, including memory, processor and it is stored in
The shifting that such as first aspect is provided is realized on reservoir and the computer program that can run on a processor, during the computing device
The musical instrument analogy method of dynamic terminal.
In terms of the 5th, the embodiments of the invention provide a kind of mobile terminal, including：Microphone, for gathering user's hair
The air flow information gone out；Touch-screen, the scale control instruction of touch-screen is acted on for gathering user；And/or acceleration sensing
Device, for gathering the scale control instruction of user's input；Proximity transducer, for gathering user to the close remote of mobile terminal
Status information；Memory, for storing the air flow information, scale control instruction and close to away from status information；Processor, use
In the acquisition air flow information, scale control instruction and close to away from status information；It is corresponding according to air flow information generation
Volume data, corresponding scale data are generated according to the scale control instruction, and according to described close to away from status information
Generate corresponding audio data；And send setting playing type musical instrument phase according to the volume data, scale data and audio data
The musical sound answered.
The embodiment of the present invention is by obtaining the scale control instruction and user couple that the air flow information, user that user sends input
The close remote status information of mobile terminal, generates corresponding volume data, according to the scale control according to the air flow information
System instruction generates corresponding scale data, and generates corresponding audio data, and root close to away from status information according to described
The setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data, enriches mobile terminal
Musical instrument analog form, and make mobile terminal simulate musical instrument audio it is more life-like.
Brief description of the drawings
Fig. 1 is a kind of flow chart of the musical instrument analogy method of mobile terminal provided in an embodiment of the present invention；
Fig. 2 is the interactive interface schematic diagram of mobile terminal simulation mouth organ provided in an embodiment of the present invention；
Fig. 3 is another interactive interface schematic diagram of mobile terminal simulation mouth organ provided in an embodiment of the present invention；
Fig. 4 is musical instrument simulation system block architecture diagram provided in an embodiment of the present invention；
Fig. 5 is the flow chart of the musical instrument analogy method of another mobile terminal provided in an embodiment of the present invention；
Fig. 6 is that the interactive interface provided in an embodiment of the present invention that scale control instruction is obtained using acceleration transducer is illustrated
Figure；
Fig. 7 is a kind of structural representation of the musical instrument analogue means of mobile terminal provided in an embodiment of the present invention；
Fig. 8 is a kind of structural representation of mobile terminal provided in an embodiment of the present invention.
Embodiment
In order that the object, technical solutions and advantages of the present invention are clearer, below in conjunction with the accompanying drawings to the specific reality of the present invention
Example is applied to be described in further detail.It is understood that specific embodiment described herein is used only for explaining the present invention,
Rather than limitation of the invention.It also should be noted that for the ease of describing, illustrate only in accompanying drawing related to the present invention
Part rather than full content.It should be mentioned that some exemplary realities before exemplary embodiment is discussed in greater detail
Apply processing or method that example is described as describing as flow chart.Although operations (or step) are described as order by flow chart
Processing, but many of which operation can be implemented concurrently, concomitantly or simultaneously.In addition, the order of operations
It can be rearranged.The processing can be terminated when its operations are completed, it is also possible to being not included in accompanying drawing
Additional step.The processing can correspond to method, function, code, subroutine, subprogram etc..
Fig. 1 gives a kind of flow chart of the musical instrument analogy method of mobile terminal provided in an embodiment of the present invention, this implementation
The method of example can be performed by the musical instrument analogue means of mobile terminal, and the device can be real by way of hardware and/or software
Existing, described device can be arranged on the inside of the mobile terminal as a mobile terminal part.Skill provided in an embodiment of the present invention
Art scheme is applied to simulate the application scenarios of playing type musical instrument using mobile terminal.
As shown in figure 1, the musical instrument analogy method for the mobile terminal that the present embodiment provides comprises the following steps：
Air flow information, the scale control instruction of user's input and the user that step 101, acquisition user send are to mobile terminal
Close to away from status information.
The step can obtain user by the microphone of mobile terminal or the setting regions of mobile terminal touch screen
The air flow information sent by mouth or other modes；For example, it can be obtained by pressure sensor and/or acceleration transducer
Air velocity and air-flow that user sends to touch-screen setting regions act on the air flow informations such as the pressure of touch-screen.
The step can obtain the scale control instruction that user acts on touch-screen by the touch-screen of mobile terminal；Or
Person, the scale control instruction that user inputs can be obtained according to the aerial gesture of user；Or mobile terminal can also be passed through
Acceleration transducer obtains the scale control instruction of user's input.
The step can obtain user by the proximity transducer of mobile terminal and mobile terminal is believed close to away from state
Breath.Typically, user, can be by blocking the scale button or sound of playing type musical instrument when operating playing type musical instrument and being played
Hole, or whole playing type musical instrument is constantly closed into opening, to produce certain tremolo effect.The step passes through proximity transducer
User is obtained to mobile terminal close to remote status information, can be with the audio of more life-like simulation playing type musical instrument.
It is exemplary, the sound hole of mouth organ can be shown by the whole longitudinal interface in either part of mobile terminal or
The sound hole of mouth organ can be shown by the whole or parts transversely interface of mobile terminal.Fig. 2 gives implementation of the present invention
The interactive interface schematic diagram for the mobile terminal simulation mouth organ that example provides.Fig. 3 gives mobile terminal provided in an embodiment of the present invention
Simulate another interactive interface schematic diagram of mouth organ.As shown in Fig. 2 if microphone in the bottom of mobile terminal, exists for the convenience of the user
Scale control instruction, the right half of longitudinal boundary that the sound hole of mouth organ can be passed through mobile terminal are inputted while sending air flow information
Face is shown, as shown in figure 3, or can be shown the sound hole of mouth organ by the upper transverse interface of mobile terminal
Show.It should be noted that the part sound hole of mouth organ is only show schematically in Fig. 2 and Fig. 3, in actual use, can
Complete mouth organ sound hole is shown by interactive interface.
Accordingly, corresponding horizontal/vertical boundary can be pre-set according to the operating habit of user for other playing type musical instruments
Face display mode.
Step 102, corresponding volume data generated according to the air flow information, phase is generated according to the scale control instruction
The scale data answered, and generate corresponding audio data close to away from status information according to described.
It is described to be included according to the corresponding volume data of air flow information generation：The air-flow sent according to user it is strong
Weak and/or sound size, produces corresponding volume data.
It is described to be included according to the corresponding scale data of scale control instruction generation：Touch is acted on according to user
The pressing of screen either slide sound hole button scale control instruction generate corresponding scale data or, sky is passed through according to user
The scale control instruction of middle gesture form input generates corresponding scale data, or, obtained according to by acceleration transducer
The scale control instruction of user's input generate corresponding scale data.
It is described to be included close to away from the corresponding audio data of status information generation according to described：Close to away from state
When information represents that user's palm or finger move closer to mobile terminal, the corresponding high-frequency suppressing operation for performing scale, and to current
The low frequency that scale increase is sized, generate the trill audio data being adjusted to current scale or volume.
When the musical instrument of mobile terminal present day analog is mouth organ, the trill audio is hand tremolo or hand sound.Typically,
When playing wind instruments mouth organ, right-hand man is closed up to the cavity for making a closing, using the wrist of two hands contact as fulcrum, rapidly
The shake right hand makes two hands switch under the two states closed and opened, it is possible to obtains the effect of hand tremolo.By hand tremolo skill
Ingeniously slow down, main points are " change down close soon ", have just obtained hand sound.Degree of strength can be played freely according to the proficiency of user,
Caused effect is also different.By according to close to dynamic to simulate blocking for user during mouth organ is played wind instruments away from status information
Make, to generate trill audio data corresponding with blocking action, can make it that the effect of mobile terminal simulation mouth organ is more life-like,
More it is bonded the actual playing effect of real instrument.
Step 103, according to the volume data, scale data and audio data send setting playing type musical instrument find pleasure in accordingly
Sound.
Wherein, the setting playing type musical instrument include mouth organ, flute, it is desolate, number, cucurbit flute, an ancient egg-shaped, holed wind instrument, saxophone and suona horn,
It is chosen as mouth organ.
After the volume data, scale data and audio data are generated, tone color and the setting playing type pleasure are sent
Device is identical, and volume is corresponding to the volume data, and scale is identical with the scale data and has audio corresponding with audio data
Musical sound.
The musical instrument analogy method for the mobile terminal that the present embodiment provides, by obtaining air flow information, the user that user sends
The scale control instruction of input and user generate corresponding to the close away from status information of mobile terminal according to the air flow information
Volume data, corresponding scale data are generated according to the scale control instruction, and believe close to away from state according to described
Breath generates corresponding audio data, and sends setting playing type musical instrument according to the volume data, scale data and audio data
Corresponding musical sound, enriches the musical instrument analog form of mobile terminal, and makes the audio of the musical instrument of mobile terminal simulation more life-like.
On the basis of above-described embodiment, it can also comprise the following steps：If detecting, user acts on the more of touch-screen
Refer to operational order, then generation chord data is instructed according to the multifingered manipulation, and send the corresponding musical sound of the chord data.
Wherein, the multifingered manipulation instruction acts on the behaviour of different sound hole buttons on touch-screen for the multiple fingers of user simultaneously
Instruct.
On the basis of above-described embodiment, blown sending setting according to the volume data, scale data and audio data
While playing type musical instrument corresponding musical sound, it can also comprise the following steps：According to the volume data, scale data and audio number
According to other at least one setting corresponding musical sounds of type musical instrument are sent, He Zou is sent jointly to play wind instruments type musical instrument with the setting
Musical sound.
Wherein, described other set type musical instrument as the musical instrument in addition to the setting playing type musical instrument, can be to play wind instruments
Type musical instrument can also be that other types for example play type musical instrument.
Exemplary, described set plays wind instruments type musical instrument as mouth organ, and other described setting type musical instruments can be piano, hand
One or more in violin, guitar or flute etc..Mouth is being sent according to the volume data, scale data and audio data
While qin corresponding musical sound, other the one or more musical instruments sent in piano, portable qin, guitar or flute etc. are corresponding
Musical sound, to produce (instrumental) ensemble effect.Wherein, the volume that other setting type musical instruments can be set is less than the setting playing type musical instrument
Volume, for example, the volume of the piano is the 70% of mouth organ volume, with the more prominent musical sound for setting playing type musical instrument.
For ease of understanding, below by taking android system as an example, the musical instrument simulation system framework in android system is entered
Row simple declaration.
As shown in figure 4, the present embodiment provide musical instrument simulation system framework mainly include application (Application) layer,
Application framework (Framework) layer, hardware abstraction layer (Hardware Abstraction Layer, HAL), hardware driving
(Driver) layer and hardware system.Application layer is the superiors of the system of systems, can be performed by writing an application program
Corresponding logical operation, such as a sound recording can be issued to lower floor by AudioRecorder and instructed, to drive bottom
Microphone obtains the air flow information of user, and the audio data that lower floor uploads can be obtained by AudioEffect, has phase with generation
Answer the musical sound of audio, can by UI obtain user user act on touch-screen operational order to perform corresponding operation, can lead to
Cross Player and issue a musical sound play instruction to lower floor, to drive the loudspeaker of bottom to carry out the broadcasting of musical sound.Application framework
Layer, which provides, obtains volume, the MediaRecorder interfaces and MediaPlayer interfaces of scale.Hardware abstraction (HAL) layer is application
Ccf layer to hardware driving layer transition, to realize the compatibility of bottom hardware.Hardware driving (Driver) layer includes audio driven
Audio Driver, sensor driving Sensor Driver and touch-screen driving TP Driver, the audio driven include wheat
The driving of gram wind and speaker drive, the sensor driving includes proximity transducer driving and proximity transducer drives.Hardware system
System includes microphone, sensor, touch-screen and loudspeaker etc..Microphone is used for air flow information, the proximity transducer for gathering user
Mobile terminal is driven for obtaining user close to away from status information, acceleration transducer to mobile terminal for obtaining user
Displacement caused by movement and moving direction, touch-screen are used to receive the scale control instruction that user acts on touch-screen, loudspeaker
For playing final musical sound.
Fig. 5 gives the flow chart of the musical instrument analogy method of another mobile terminal provided in an embodiment of the present invention.Such as Fig. 5
Shown, the method that the present embodiment provides comprises the following steps：
Step 201, the air flow information that user sends is obtained using the microphone of mobile terminal.
Step 202, the scale control instruction that user acts on touch-screen is obtained using the touch-screen of mobile terminal；Or
The scale control instruction of user's input is obtained using the acceleration transducer of mobile terminal.
For example, the key press or slip instruction of sound hole button on touch-screen are acted on by detecting user, to obtain
Scale control instruction corresponding to the pressing or slip instruction.Wherein, the pressing instruction can be that user's single finger presses certain
The pressing instruction or more fingers while the pressing instruction for pressing multiple sound hole buttons of one sound hole button, the slip instruction can
Think the slip instruction that one or more sound hole button is covered in the sliding trace of user's finger on the touchscreen.
Wherein, the acceleration transducer using mobile terminal obtains the scale control instruction that user inputs and can wrapped
Include：User, which is obtained, using the acceleration transducer of mobile terminal drives displacement and moving direction caused by mobile terminal movement；Root
According to the displacement and moving direction and the original position of the displacement, the scale control instruction that user inputs is determined.
The hand-holdable mobile terminal of user moves in default original position, and mobile terminal can utilize acceleration transducer
The moving direction of mobile terminal and caused displacement are detected, according to the moving direction and displacement and the original position,
Determine the scale control instruction of user's input.Before user moves the mobile terminal, user's blowing instrument can be predefined
Original position originate sound hole, such as receive note corresponding to the starting sound hole that user input by input frame or receive use
Family acts on the pressing instruction of the starting sound hole button of touch-screen, after starting sound hole is determined, acceleration transducer detection
Mobile terminal is beginning to move into caused displacement and mobile direction in this period for terminating movement, and then can determine that and pass through
Mobile mobile terminal and caused scale control instruction.Fig. 6, which gives, provided in an embodiment of the present invention utilizes acceleration transducer
Obtain the interactive interface schematic diagram of scale control instruction.As shown in fig. 6, for example, original position is sound hole 4, acceleration transducer
Detect the moving direction of mobile terminal for X, mobile displacement S are 1cm to the right, it is assumed that each the spacing value d of sound hole button is
0.5cm, then corresponding scale is moved to the left S note (sound hole) composition for starting sound hole, it may be determined that user is moved by mobile
The scale control instruction of dynamic terminal input is 32, i.e. user continuously have input note 3 and note 2.Accordingly, seen for ease of user
To the scale of user's input, the scale currently inputted can be shown in the form of being different from other scales, for example, by note
3 and note 2 corresponding to sound hole button shown in the form of completely black, sending the musical sound of the scale and then by the sound hole
Button reverts to white.Refer to it should be noted that explanation merely exemplary Fig. 6 obtains scale control by acceleration transducer
Order, the moving direction of the mobile terminal also can be identical with the moving direction of scale, and such as above-mentioned example, mobile terminal move right
S displacements, corresponding scale can be that starting sound hole 4 move right S note 5 and note 6 forms.In actual use,
User may be accordingly, mobile whole by continuously moving mobile terminal in different directions to simulate the continuous action to play the harmonica
End can utilize acceleration transducer according to start note and each moving direction of mobile terminal and moving displacement to obtain correspondingly
Scale control instruction.
So set the reason for be：The operation that user moves mobile terminal is detected by acceleration transducer, and then really
Determine the scale control instruction of user's input, provided the user the musical instrument analog form of diversification, for simulation mouth organ, more
Stick on to share and the actual conditions of scale are produced by mobile mouth organ when mouth organ is played wind instruments at family, user can experience more life-like
The musical instrument pseudo-experience of mobile terminal.
Step 203, close remote status information of the user to mobile terminal is obtained using the proximity transducer of mobile terminal.
Step 204, corresponding volume data generated according to the air flow information.
Step 205, corresponding scale data are generated according to the scale control instruction.
Step 206, according to described generate corresponding audio data close to away from status information；
Step 207, according to the volume data, scale data and audio data send setting playing type musical instrument find pleasure in accordingly
Sound.
It is understood that the execution sequence of step 201 to step 203 can arbitrarily be adjusted or concurrently performed, step 204
Execution sequence to step 206 can arbitrarily be adjusted or concurrently performed.
The method that the present embodiment provides, passed by using the microphone, touch-screen or acceleration configured on mobile terminal
Air flow information, the scale data of user's input and the user that sensor and proximity transducer acquisition user send are to mobile terminal
Generate corresponding volume data close to away from status information, and according to the air flow information, according to the scale control instruction
Generate corresponding scale data and generate corresponding audio data close to away from status information according to described, further according to the volume number
The setting corresponding musical sound of playing type musical instrument is sent according to, scale data and audio data, enriches the musical instrument simulation side of mobile terminal
Formula, and make the audio of the musical instrument of mobile terminal simulation more life-like, meet the growing personalization of people, the pleasure of diversification
Device mode requirement.
Fig. 7 be a kind of mobile terminal provided in an embodiment of the present invention musical instrument analogue means structural representation, the device
It can be realized, be integrated in the terminal by software and/or hardware.As shown in fig. 7, the device, which includes user's operation information, obtains mould
Block 31, tone data acquisition module 32 and musical sound playing module 33.
The user's operation information acquisition module 31, for obtaining the scale for air flow information, the user input that user sends
Control instruction and user are to the close away from status information of mobile terminal；
The tone data acquisition module 32, for generating corresponding volume data according to the air flow information, according to institute
State scale control instruction and generate corresponding scale data, and corresponding audio number is generated close to away from status information according to described
According to；
The musical sound playing module 33, blown for sending setting according to the volume data, scale data and audio data
Play the corresponding musical sound of type musical instrument.
On the basis of above-described embodiment, the user's operation information acquisition module is specifically used for：
The air flow information sent using the microphone acquisition user of mobile terminal；
The scale control instruction of touch-screen is acted on using the touch-screen acquisition user of mobile terminal；Or utilize movement
The acceleration transducer of terminal obtains the scale control instruction of user's input；
User is obtained to mobile terminal close to away from status information using the proximity transducer of mobile terminal.
On the basis of above-described embodiment, the user's operation information acquisition module utilizes the acceleration sensing of mobile terminal
The scale control instruction that device obtains user's input includes：
User, which is obtained, using the acceleration transducer of mobile terminal drives displacement and movement side caused by mobile terminal movement
To；
According to the displacement and moving direction and the original position of the displacement, determine that the scale control of user's input refers to
Order.
On the basis of above-described embodiment, described device also includes：
Chord data generation module, if for detecting that user acts on the multifingered manipulation instruction of touch-screen, according to institute
Multifingered manipulation instruction generation chord data is stated, and sends the corresponding musical sound of the chord data.
On the basis of above-described embodiment, described device also includes：
Musical sound generation module is instrumental ensembled, for blowing sending setting according to the volume data, scale data and audio data
While playing type musical instrument corresponding musical sound, according to the volume data, scale data and audio data send it is at least one other
The corresponding musical sound of type musical instrument is set, (instrumental) ensemble musical sound is sent jointly to play wind instruments type musical instrument with the setting.
On the basis of above-described embodiment, the tone data acquisition module generates according to described close to away from status information
Corresponding audio data include：
Close to when representing that user's palm or finger move closer to mobile terminal away from status information, the high frequency of scale is performed
Suppress operation, and to the low frequency that current scale increase is sized, generate the trill being adjusted to current scale or volume
Audio data.
On the basis of above-described embodiment, the setting playing type musical instrument include mouth organ, flute, it is desolate, number, cucurbit flute, an ancient egg-shaped, holed wind instrument,
Saxophone and suona horn.
The device that the present embodiment provides, the scale control instruction inputted by obtaining the air flow information, user that user sends
Corresponding volume data is generated according to the air flow information, according to institute close to away from status information to mobile terminal with user
State scale control instruction and generate corresponding scale data, and corresponding audio number is generated close to away from status information according to described
According to, and the setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data, enrich shifting
The musical instrument analog form of dynamic terminal, and make the audio of the musical instrument of mobile terminal simulation more life-like.
The embodiment of the present invention also provides a kind of storage medium for including computer executable instructions, and the computer can perform
Instruct includes when being performed by computer processor for the musical instrument analogy method for performing a kind of mobile terminal, this method：
Air flow information, the scale control instruction of user's input and the user that acquisition user sends are to mobile terminal close to far
From status information；
Corresponding volume data is generated according to the air flow information, corresponding scale is generated according to the scale control instruction
Data, and generate corresponding audio data close to away from status information according to described；
The setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data.
Storage medium --- any various types of memory devices or storage device.Term " storage medium " is intended to wrap
Include：Install medium, such as CD-ROM, floppy disk or magnetic tape equipment；Computer system memory or random access memory, such as
DRAM, DDR RAM, SRAM, EDO RAM, blue Bath (Rambus) RAM etc.；Nonvolatile memory, such as flash memory, magnetizing mediums
(such as hard disk or optical storage)；Memory component of register or other similar types etc..Storage medium can also include other
The memory of type or its combination.In addition, storage medium can be located at program in the first computer system being wherein performed,
Or can be located in different second computer systems, second computer system is connected to the by network (such as internet)
One computer system.Second computer system can provide programmed instruction and be used to perform to the first computer." storage is situated between term
Matter " can include may reside within diverse location two of (such as in different computer systems by network connection) or
More storage mediums.Storage medium can store the programmed instruction that can be performed by one or more processors and (such as implement
For computer program).
Certainly, a kind of storage medium for including computer executable instructions that the embodiment of the present invention is provided, its computer
The musical instrument simulated operation that executable instruction is not limited to the described above, it can also carry out the movement that any embodiment of the present invention is provided
Associative operation in the musical instrument analogy method of terminal.
The embodiment of the present invention additionally provides a kind of mobile terminal, and the mobile terminal can carry including any embodiment of the present invention
The musical instrument analogue means of the mobile terminal of confession.Fig. 8 is a kind of structural representation of mobile terminal provided in an embodiment of the present invention, such as
Shown in Fig. 8, the mobile terminal can include microphone, the air flow information sent for gathering user；Touch-screen, used for gathering
Family acts on the scale control instruction of touch-screen；And/or acceleration transducer, the scale control for gathering user's input refer to
Order；Proximity transducer, for gathering user to mobile terminal close to away from status information；And memory 401, central processing
Device (Central Processing Unit, CPU) 402 (also known as processor, hereinafter referred to as CPU), the memory 401, are used for
Store executable program code；The processor 402 by read the executable program code stored in the memory 401 come
Operation program corresponding with the executable program code, for performing：Obtain air flow information, the user's input that user sends
Scale control instruction and user to mobile terminal close to away from status information；Corresponding sound is generated according to the air flow information
Data are measured, corresponding scale data are generated according to the scale control instruction, and given birth to close to away from status information according to described
Into corresponding audio data；It is corresponding that setting playing type musical instrument is sent according to the volume data, scale data and audio data
Musical sound.
The mobile terminal also includes：Peripheral Interface 403, RF (Radio Frequency, radio frequency) circuit 405, audio-frequency electric
Road 406, loudspeaker 411, power management chip 408, input/output (I/O) subsystem 409, touch-screen 412, other input/controls
Control equipment 410 and outside port 404, these parts are communicated by one or more communication bus or signal wire 407.
It should be understood that diagram mobile terminal 400 is only an example of mobile terminal, and mobile terminal 400
Can have than more or less parts shown in figure, can combine two or more parts, or can be with
Configured with different parts.Various parts shown in figure can be including one or more signal transactings and/or special
Hardware, software including integrated circuit are realized in the combination of hardware and software.
Exemplary, the mobile terminal in the present embodiment is specifically as follows mobile phone, tablet personal computer and digital reader etc.
Terminal, preferably smart mobile phone.
Below with regard to the present embodiment provide the mobile terminal for analog instruments be described in detail, the mobile terminal with
Exemplified by mobile phone.
Memory 401, the memory 401 can be accessed by CPU402, Peripheral Interface 403 etc., and the memory 401 can
Including high-speed random access memory, can also include nonvolatile memory, such as one or more disk memories,
Flush memory device or other volatile solid-state parts.
The input of equipment and output peripheral hardware can be connected to CPU402 and deposited by Peripheral Interface 403, the Peripheral Interface 403
Reservoir 401.
I/O subsystems 409, the I/O subsystems 409 can be by the input/output peripherals in equipment, such as touch-screen 412
With other input/control devicess 410, Peripheral Interface 403 is connected to.I/O subsystems 409 can include the He of display controller 4091
For controlling one or more input controllers 4092 of other input/control devicess 410.Wherein, one or more input controls
Device 4092 processed receives electric signal from other input/control devicess 410 or sends electric signal to other input/control devicess 410,
Other input/control devicess 410 can include physical button (pressing button, rocker buttons etc.), dial, slide switch, behaviour
Vertical pole, click on roller.What deserves to be explained is input controller 4092 can with it is following any one be connected：Keyboard, infrared port,
The instruction equipment of USB interface and such as mouse.
Touch-screen 412, the touch-screen 412 are the input interface and output interface between user terminal and user, can
It can include figure, text, icon, video etc. to user, visual output depending on output display.
Display controller 4091 in I/O subsystems 409 receives electric signal from touch-screen 412 or sent out to touch-screen 412
Electric signals.Touch-screen 412 detects the contact on touch-screen, and the contact detected is converted to and shown by display controller 4091
The interaction of user interface object on touch-screen 412, that is, realize man-machine interaction, the user interface being shown on touch-screen 412
Icon that object can be the icon of running game, be networked to corresponding network etc..What deserves to be explained is equipment can also include light
Mouse, light mouse is not show the touch sensitive surface visually exported, or the extension of the touch sensitive surface formed by touch-screen.
RF circuits 405, it is mainly used in establishing the communication of mobile phone and wireless network (i.e. network side), realizes mobile phone and wireless network
The data receiver of network and transmission.Such as transmitting-receiving short message, Email etc..Specifically, RF circuits 405 receive and send RF letters
Number, RF signals are also referred to as electromagnetic signal, and RF circuits 405 convert electrical signals to electromagnetic signal or electromagnetic signal is converted into telecommunications
Number, and communicated by the electromagnetic signal with communication network and other equipment.RF circuits 405 can include being used to perform
The known circuit of these functions, it includes but is not limited to antenna system, RF transceivers, one or more amplifiers, tuner, one
Individual or multiple oscillators, digital signal processor, CODEC (COder-DECoder, coder) chipset, user identify mould
Block (Subscriber Identity Module, SIM) etc..
Voicefrequency circuit 406, it is mainly used in receiving voice data from Peripheral Interface 403, the voice data is converted into telecommunications
Number, and the electric signal is sent to loudspeaker 411.
Loudspeaker 411, the input line of the loudspeaker 411 are electrically connected by pad and the voicefrequency circuit 406 in mobile terminal
Connect, for the voice signal for receiving mobile phone from wireless network by RF circuits 405, sound is reduced to simultaneously by loudspeaker 411
The sound is played to user.
Power management chip 408, the hardware for being connected by CPU402, I/O subsystem 409 and Peripheral Interface 403 enter
Row power supply and power management.
Above-mentioned mobile terminal can perform the method that any embodiment of the present invention is provided, and possess the corresponding function of execution method
Module, mobile terminal provided in an embodiment of the present invention, the scale inputted by obtaining the air flow information, user that user sends control
Instruction and user generate corresponding volume data, root to the close away from status information of mobile terminal according to the air flow information
Corresponding scale data are generated according to the scale control instruction, and corresponding sound is generated close to away from status information according to described
Data are imitated, and the setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data, are enriched
The musical instrument analog form of mobile terminal, and make the audio for the musical instrument that mobile terminal simulates more life-like.
The technical principle that above are only presently preferred embodiments of the present invention and used.The invention is not restricted to spy described here
Determine embodiment, the various significant changes that can carry out for a person skilled in the art, readjust and substitute all without departing from
Protection scope of the present invention.Therefore, although being described in further detail by above example to the present invention, this hair
It is bright to be not limited only to above example, without departing from the inventive concept, other more equivalence enforcements can also be included
Example, and the scope of the present invention is determined by the scope of claim.
Claims (11)
- A kind of 1. musical instrument analogy method of mobile terminal, it is characterised in that including：Air flow information, the scale control instruction of user's input and the user that acquisition user sends are to mobile terminal close to away from shape State information；Corresponding volume data is generated according to the air flow information, corresponding scale number is generated according to the scale control instruction According to, and according to described close to away from the corresponding audio data of status information generation；The setting corresponding musical sound of playing type musical instrument is sent according to the volume data, scale data and audio data.
- 2. according to the method for claim 1, it is characterised in that described to obtain air flow information, the user's input that user sends Scale control instruction and user mobile terminal is included close to away from status information：The air flow information sent using the microphone acquisition user of mobile terminal；The scale control instruction of touch-screen is acted on using the touch-screen acquisition user of mobile terminal；Or utilize mobile terminal Acceleration transducer obtain user input scale control instruction；User is obtained to mobile terminal close to away from status information using the proximity transducer of mobile terminal.
- 3. according to the method for claim 2, it is characterised in that the acceleration transducer using mobile terminal, which obtains, to be used The scale control instruction of family input includes：User, which is obtained, using the acceleration transducer of mobile terminal drives displacement and moving direction caused by mobile terminal movement；According to the displacement and moving direction and the original position of the displacement, the scale control instruction that user inputs is determined.
- 4. according to the method for claim 1, it is characterised in that also include：If detecting, user acts on the multifingered manipulation instruction of touch-screen, and generation and chord number are instructed according to the multifingered manipulation According to, and send the corresponding musical sound of the chord data.
- 5. according to the method for claim 1, it is characterised in that according to the volume data, scale data and audio number While according to setting playing type musical instrument corresponding musical sound is sent, in addition to：Other at least one setting type musical instruments are sent according to the volume data, scale data and audio data accordingly to find pleasure in Sound, (instrumental) ensemble musical sound is sent jointly to play wind instruments type musical instrument with the setting.
- 6. according to the method for claim 1, it is characterised in that described according to described corresponding close to being generated away from status information Audio data include：Close to when representing that user moves closer to mobile terminal away from status information, the high-frequency suppressing for performing scale operates, and right The low frequency that current scale increase is sized, generates the trill audio data being adjusted to current scale or volume.
- 7. according to the method described in claim any one of 1-6, it is characterised in that the setting playing type musical instrument include mouth organ, Flute, it is desolate, number, cucurbit flute, an ancient egg-shaped, holed wind instrument, saxophone and suona horn.
- A kind of 8. musical instrument analogue means of mobile terminal, it is characterised in that including：User's operation information acquisition module, for obtain air flow information, the user input that user sends scale control instruction and User is to mobile terminal close to away from status information；Tone data acquisition module, for generating corresponding volume data according to the air flow information, controlled according to the scale Instruction generates corresponding scale data, and generates corresponding audio data close to away from status information according to described；Musical sound playing module, for sending setting playing type musical instrument phase according to the volume data, scale data and audio data The musical sound answered.
- 9. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that the program is held by processor The musical instrument analogy method of the mobile terminal as described in any in claim 1-7 is realized during row.
- 10. a kind of mobile terminal, including memory, processor and storage are on a memory and the calculating that can run on a processor Machine program, it is characterised in that realized described in the computing device during computer program as described in any in claim 1-7 The musical instrument analogy method of mobile terminal.
- A kind of 11. mobile terminal, it is characterised in that including：Microphone, the air flow information sent for gathering user；Touch-screen, the scale control instruction of touch-screen is acted on for gathering user；And/or acceleration transducer, for gathering The scale control instruction of user's input；Proximity transducer, for gathering user to mobile terminal close to away from status information；Memory, for storing the air flow information, scale control instruction and close to away from status information；Processor, for obtaining the air flow information, scale control instruction and close to away from status information；Believed according to the air-flow Breath generates corresponding volume data, and corresponding scale data are generated according to the scale control instruction, and according to described close Corresponding audio data are generated away from status information；And send setting according to the volume data, scale data and audio data The corresponding musical sound of playing type musical instrument.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710613432.3A CN107404581B (en) | 2017-07-25 | 2017-07-25 | Musical instrument simulation method and device for mobile terminal, storage medium and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710613432.3A CN107404581B (en) | 2017-07-25 | 2017-07-25 | Musical instrument simulation method and device for mobile terminal, storage medium and mobile terminal |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107404581A true CN107404581A (en) | 2017-11-28 |
| CN107404581B CN107404581B (en) | 2020-03-31 |
Family
ID=60401000
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710613432.3A Expired - Fee Related CN107404581B (en) | 2017-07-25 | 2017-07-25 | Musical instrument simulation method and device for mobile terminal, storage medium and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107404581B (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101883177A (en) * | 2010-04-26 | 2010-11-10 | 华为终端有限公司 | Mobile communication terminal and playing method thereof |
| US20110316793A1 (en) * | 2010-06-28 | 2011-12-29 | Digitar World Inc. | System and computer program for virtual musical instruments |
| CN103167161A (en) * | 2012-10-09 | 2013-06-19 | 深圳市金立通信设备有限公司 | System and method for achieving mobile phone instrument playing based on microphone input |
| US20130283159A1 (en) * | 2009-05-11 | 2013-10-24 | Samsung Electronics Co., Ltd. | Portable terminal with music performance function and method for playing musical instruments using portable terminal |
| CN104154915A (en) * | 2014-07-04 | 2014-11-19 | 北京搜狗科技发展有限公司 | Audio operating method based on intelligent wearable device and intelligent wearable device |
| CN104915137A (en) * | 2015-03-31 | 2015-09-16 | 努比亚技术有限公司 | Music playing method and device based on frame-free terminal |
| CN105027192A (en) * | 2014-01-30 | 2015-11-04 | 施政 | Apparatus and method to enhance expressive qualities of digital music |
| CN105741639A (en) * | 2016-02-04 | 2016-07-06 | 北京千音互联科技有限公司 | Micro-sensing palmtop musical instrument of simulating bowed stringed instrument |
| CN105931627A (en) * | 2016-04-07 | 2016-09-07 | 百度在线网络技术（北京）有限公司 | Artificial intelligence movement recognition-based music instrument simulation method and device |
| CN106205283A (en) * | 2016-08-26 | 2016-12-07 | 北京千音互联科技有限公司 | A kind of handset type intelligent musical instrument playing method |
-
2017
- 2017-07-25 CN CN201710613432.3A patent/CN107404581B/en not_active Expired - Fee Related
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130283159A1 (en) * | 2009-05-11 | 2013-10-24 | Samsung Electronics Co., Ltd. | Portable terminal with music performance function and method for playing musical instruments using portable terminal |
| CN101883177A (en) * | 2010-04-26 | 2010-11-10 | 华为终端有限公司 | Mobile communication terminal and playing method thereof |
| US20110316793A1 (en) * | 2010-06-28 | 2011-12-29 | Digitar World Inc. | System and computer program for virtual musical instruments |
| CN103167161A (en) * | 2012-10-09 | 2013-06-19 | 深圳市金立通信设备有限公司 | System and method for achieving mobile phone instrument playing based on microphone input |
| CN105027192A (en) * | 2014-01-30 | 2015-11-04 | 施政 | Apparatus and method to enhance expressive qualities of digital music |
| CN104154915A (en) * | 2014-07-04 | 2014-11-19 | 北京搜狗科技发展有限公司 | Audio operating method based on intelligent wearable device and intelligent wearable device |
| CN104915137A (en) * | 2015-03-31 | 2015-09-16 | 努比亚技术有限公司 | Music playing method and device based on frame-free terminal |
| CN105741639A (en) * | 2016-02-04 | 2016-07-06 | 北京千音互联科技有限公司 | Micro-sensing palmtop musical instrument of simulating bowed stringed instrument |
| CN105931627A (en) * | 2016-04-07 | 2016-09-07 | 百度在线网络技术（北京）有限公司 | Artificial intelligence movement recognition-based music instrument simulation method and device |
| CN106205283A (en) * | 2016-08-26 | 2016-12-07 | 北京千音互联科技有限公司 | A kind of handset type intelligent musical instrument playing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107404581B (en) | 2020-03-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9558727B2 (en) | Performance method of electronic musical instrument and music | |
| EP1816640B1 (en) | Sound processing apparatus and storage medium storing sound processing program | |
| US20110005367A1 (en) | Device and method to display fingerboard of mobile virtual guitar | |
| US20170109127A1 (en) | Tactilated electronic music systems for sound generation | |
| EP2786371A2 (en) | Determining the characteristic of a played chord on a virtual instrument | |
| JP6737996B2 (en) | Handheld controller for computer, control system for computer and computer system | |
| US10748515B2 (en) | Enhanced real-time audio generation via cloud-based virtualized orchestra | |
| WO2020059245A1 (en) | Information processing device, information processing method and information processing program | |
| CN107705776A (en) | The System and method for that a kind of intelligent piano or so keyboard subregion uses | |
| CN101883177A (en) | Mobile communication terminal and playing method thereof | |
| CN101937670A (en) | Method and device for displaying and making music | |
| CN109427222A (en) | A kind of intelligent Piano Teaching system and method based on cloud platform | |
| US20180350337A1 (en) | Electronic musical instrument with separate pitch and articulation control | |
| CN101477796A (en) | Method, apparatus and system for playing music by displacement inputting signal | |
| CN107126697B (en) | Non-contact music toy | |
| CN107404581A (en) | Musical instrument analogy method, device and the storage medium and mobile terminal of mobile terminal | |
| CN208655232U (en) | A kind of intelligent piano being provided with weight Dynamics keyboard | |
| CN110491355A (en) | A kind of electronic organ plays practice interactive system and electronic organ | |
| CN109739388B (en) | Violin playing method and device based on terminal and terminal | |
| WO2014190293A2 (en) | Haptic force-feedback for computing interfaces | |
| Portovedo et al. | Hasgs: Five years of reduced augmented evolution | |
| KR102244293B1 (en) | Digital piano system works with mobile devices | |
| CN201348875Y (en) | Device for playing music by utilizing displacement input signals | |
| Overholt | Advancements in violin-related human-computer interaction | |
| CN109801613B (en) | Terminal-based cello playing method and device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant after: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. Address before: Changan town in Guangdong province Dongguan 523860 usha Beach Road No. 18 Applicant before: GUANGDONG OPPO MOBILE TELECOMMUNICATIONS Corp.,Ltd. |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200331 |
|
| CF01 | Termination of patent right due to non-payment of annual fee |