[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2022213511A1 - Music playing method, electronic device, and computer-readable storage medium - Google Patents

Music playing method, electronic device, and computer-readable storage medium Download PDF

Info

Publication number
WO2022213511A1
WO2022213511A1 PCT/CN2021/107317 CN2021107317W WO2022213511A1 WO 2022213511 A1 WO2022213511 A1 WO 2022213511A1 CN 2021107317 W CN2021107317 W CN 2021107317W WO 2022213511 A1 WO2022213511 A1 WO 2022213511A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
note
sensor
sequence
music
Prior art date
Application number
PCT/CN2021/107317
Other languages
French (fr)
Chinese (zh)
Inventor
凌晓军
凌正阳
凌正中
Original Assignee
凌晓军
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 凌晓军 filed Critical 凌晓军
Publication of WO2022213511A1 publication Critical patent/WO2022213511A1/en

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0008Associated control or indicating means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H5/00Instruments in which the tones are generated by means of electronic generators

Definitions

  • the senor includes one or more of a temperature sensor, a respiration sensor, a blood pressure sensor and a pulse sensor;
  • the sensor unit includes one or more of the following: touch screen, acceleration sensor, force keyboard, vibration sensor, gyroscope sensor, bioelectric wave sensor, temperature sensor, respiration sensor, blood pressure sensor, pulse sensor, image sensors and pickups.
  • FIG. 3 is a schematic diagram of generating sound intensity time value data and note switching point data in a music performance method provided by an embodiment of the present invention
  • the sensor includes one or more of a bioelectric wave sensor, an image sensor, and a pickup
  • changes in bioelectric waves eg, brain waves
  • images eg, dance moves
  • the pickup Sounds e.g.
  • the feelings of different people in different environments and at different times can be integrated into the music played, so as to express and interpret the music to the greatest extent, and realize the personalized music performance of each person.
  • the above-mentioned storage unit 83 is used for storing the note sequence and the timbre data, wherein the note sequence is composed of the pitch data of a plurality of notes.
  • the wireless transmission unit 86 is electrically connected with the main control unit 81 , and the main control unit 81 obtains the note sequence by analyzing the communication signal of the wireless transmission unit 86 , and stores the note sequence in the storage unit 83 . That is, the electronic device can communicate with other terminal devices or servers through the wireless transmission unit 86, and obtain the note sequence by means of communication.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

The present invention provides a music playing method, an electronic device, and a computer-readable storage medium. The method comprises: acquiring a human body characteristic parameter in real time by means of a sensor, the human body characteristic parameter comprising an electric signal corresponding to a human body action and/or an emotional sign; generating sound intensity value data and note switching point data according to the human body characteristic parameter; and generating music data according to the sound intensity value data, the note switching point data, and prestored note sequence and timbre data, and playing the music data, the note sequence being composed of pitch data of a plurality of notes. According to the present invention, the sound intensity value data and the note switching point data are generated by the sensor acquiring the human body characteristic parameter, and the music data is synthesized in combination with the prestored note sequence and timbre data, such that each person can play personalized music only by simple practice.

Description

音乐演奏方法、电子设备及计算机可读存储介质Music performance method, electronic device, and computer-readable storage medium 技术领域technical field
本发明涉及电子乐器领域,更具体地说,涉及一种音乐演奏方法、电子设备及计算机可读存储介质。The present invention relates to the field of electronic musical instruments, and more particularly, to a music performance method, an electronic device and a computer-readable storage medium.
背景技术Background technique
音强、音高、音色为乐音的三大要素,其中:音强是指声音信号中主音调的强弱程度,是判别乐音的基础,其由机械波振幅的大小决定(两者成正比关系,振幅越大则音越"强",反之则越"弱");音高是指音调,其由机械波的频率决定的(严格说是基波频率);音色是指不同声音表现在波形方面与众不同的特性,音色是声音除基波外的其他波段(如泛音)所决定,这些波段不影响音高,通常,不同的发声体由于其材料、结构不同,发出声音的音色也不同(例如钢琴、小提琴和人发出的声音不一样)。Sound intensity, pitch, and timbre are the three major elements of musical sound, among which: sound intensity refers to the strength of the main tone in the sound signal, which is the basis for judging musical sound, which is determined by the magnitude of the mechanical wave amplitude (the two are proportional to each other, The larger the amplitude, the more "stronger" the sound, and vice versa, the "weaker"); the pitch refers to the tone, which is determined by the frequency of the mechanical wave (strictly speaking, the fundamental frequency); the timbre refers to the performance of different sounds in terms of waveforms. Different characteristics, the timbre is determined by other bands (such as overtones) of the sound other than the fundamental wave. These bands do not affect the pitch. Usually, different sound generators have different timbres due to their different materials and structures (for example, Pianos, violins and people make different sounds).
乐器作为一种能够陶冶情操的发声器物,是人类重要的精神财产。传统乐器的种类繁多并且结构和音色也有很大差异,其发音体基本上是弦、膜、簧、板或金属体等,如提琴类、胡琴类和弹弦类乐器,均由弦振动而发出声音;锣和拔类乐器则由金属体振动发出声音。虽然电吉它、电贝司也需要通电使用,但它们的发音体仍然是弦,故归类为电声乐器而非电子乐器。As a sounding tool that can cultivate sentiment, musical instrument is an important spiritual property of human beings. There are many kinds of traditional musical instruments, and the structure and timbre are also very different. The sound bodies are basically strings, membranes, springs, plates or metal bodies, such as violins, huqins and stringed instruments, which are all emitted by the vibration of strings. Sound; gongs and plucked instruments produce sound by vibrating metal bodies. Although electric guitars and electric basses also need to be powered on, their sound bodies are still strings, so they are classified as electroacoustic instruments rather than electronic instruments.
在当下社会,随着生活节奏的加快以及生活水平的提升,越来越多的人更倾向于感官的接触和更为直接的视觉体验,因此,传统的乐器受发声结构的限制已不能满足相应的需求。In the current society, with the acceleration of life rhythm and the improvement of living standards, more and more people are more inclined to contact with the senses and more direct visual experience. Therefore, the traditional musical instruments are limited by the sound structure and can no longer meet the corresponding requirements. demand.
电子乐器是乐手通过特定手段触发电子信号,使其利用电子合成技术或是采样技术来通过电声设备发出声音的乐器,如电子琴、电钢琴、电子合成器、电子鼓等。不同于传统乐器,电子乐器的发音体是由若干电子元件组成振荡器,通过电压放大,不同的频率变化产生出不同的音频信号,再进行功率放大,由扬声器传送出特定的声音。并且相较于传统乐器,电子乐器一般不受自然气候条件的影响,它只是受电压、电流或电子元件质量等因素的影响(正规的电子乐器产品出现这种现象的可能性极小)。Electronic musical instruments are musical instruments in which musicians trigger electronic signals by specific means, so that they use electronic synthesis technology or sampling technology to produce sounds through electro-acoustic devices, such as electronic pianos, electric pianos, electronic synthesizers, and electronic drums. Different from traditional musical instruments, the sounding body of electronic musical instruments is composed of a number of electronic components to form oscillators. Through voltage amplification, different frequency changes generate different audio signals, and then power amplification is performed to transmit specific sounds from speakers. And compared with traditional musical instruments, electronic musical instruments are generally not affected by natural climatic conditions, it is only affected by factors such as voltage, current or the quality of electronic components (the possibility of this phenomenon occurring in regular electronic musical instruments is extremely small).
然而,无论是传统乐器还是电子乐器,其对演奏者本身要求较高,演奏者往往需要经过系统培训和长时间的练习才能进行演奏。例如钢琴一般有88个琴键,每个琴键对应一个音符,加上脚踏,演奏者在按乐谱演奏乐曲时,需将10个手指和脚熟练配合才能完成;使用小提琴进行演奏时,演奏者一般是右手拉弓,左手五个手指用于触碰弦上不同位置来发出不同的乐音,虽然小提琴只有三根弦,但是不同的音符需要手指触碰弦上不同位置,触碰位置稍有差异,音就会不准。However, whether it is a traditional musical instrument or an electronic musical instrument, it has high requirements on the performer, and the performer often needs to go through systematic training and long-term practice before playing. For example, a piano generally has 88 keys, and each key corresponds to a note. With the addition of a foot pedal, the player needs to skillfully cooperate with 10 fingers and feet when playing a piece of music according to the score; when playing with a violin, the player generally The bow is drawn with the right hand, and the five fingers of the left hand are used to touch different positions on the strings to produce different tones. Although the violin has only three strings, different notes require fingers to touch different positions on the strings, and the touch positions are slightly different. will not be allowed.
此外,目前的乐器,演奏者一般通过肢体动作控制音强(响度),把情感注入音乐中,肢体动作(包括力度)的细微差异都会影响演奏效果,这也是乐器演奏难度大的原因。并且,无论演奏者如何练习,无论演奏技巧多熟练,肢体动作也不能完全反映人的情感,因此无法把情感完全注入音乐中。In addition, in the current musical instruments, players generally control the sound intensity (loudness) through body movements, and inject emotion into the music. The subtle differences in body movements (including strength) will affect the performance, which is why it is difficult to play musical instruments. Moreover, no matter how the performer practices, no matter how skilled the performance is, body movements cannot fully reflect human emotions, so it is impossible to fully inject emotions into music.
技术问题technical problem
本发明要解决的技术问题在于,针对上述乐器需要培训和练习才能进行个性化演奏的问题,提供一种音乐演奏方法、电子设备及计算机可读存储介质。The technical problem to be solved by the present invention is to provide a music performance method, an electronic device and a computer-readable storage medium for the problem that the above-mentioned musical instruments require training and practice to perform individualized performances.
技术解决方案technical solutions
本发明解决上述技术问题的技术方案是,提供一种音乐演奏方法,包括:The technical scheme that the present invention solves the above-mentioned technical problems is to provide a music performance method, comprising:
通过传感器实时获取人体特征参数,所述人体特征参数包括人体动作和/或情感体征对应的电信号;Real-time acquisition of human body characteristic parameters through sensors, where the human body characteristic parameters include electrical signals corresponding to human movements and/or emotional signs;
根据所述人体特征参数生成音强时值数据和音符切换点数据;Generate sound intensity time value data and note switching point data according to the human body characteristic parameters;
根据所述音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据,并播放所述音乐数据,所述音符序列由多个音符的音高数据构成。Music data is generated according to the sound intensity time value data, the note switching point data, and the pre-stored note sequence and timbre data, and the music data is played, and the note sequence is composed of pitch data of a plurality of notes.
作为本发明的进一步改进,所述传感器包括触摸屏、压力传感器、力度键盘、加速度传感器、振动传感器和陀螺仪传感器中的一个或多个,且所述人体特征参数包括人体动作数据;As a further improvement of the present invention, the sensor includes one or more of a touch screen, a pressure sensor, a force keyboard, an acceleration sensor, a vibration sensor and a gyroscope sensor, and the human body characteristic parameter includes human motion data;
所述根据所述人体特征参数生成音强时值数据和音符切换点数据,包括:The generation of sound intensity time value data and note switching point data according to the human body feature parameters includes:
将人体动作转换为幅值参数和时间参数;Convert human motion into amplitude parameters and time parameters;
根据所述幅值参数生成音强时值数据,以及根据时间参数生成音符切换点数据。The sound intensity duration data is generated according to the amplitude parameter, and the note switching point data is generated according to the time parameter.
作为本发明的进一步改进,所述传感器包括生物电波传感器、图像传感器和拾音器中的一个或多个;As a further improvement of the present invention, the sensor includes one or more of a bioelectric wave sensor, an image sensor and a sound pickup;
所述根据所述人体特征参数生成音强时值数据和音符切换点数据,包括:The generation of sound intensity time value data and note switching point data according to the human body feature parameters includes:
将所述传感器采集的信号转换为幅值参数和时间参数;Converting the signal collected by the sensor into an amplitude parameter and a time parameter;
根据所述幅值参数生成音强时值数据,以及根据时间参数生成音符切换点数据。The sound intensity duration data is generated according to the amplitude parameter, and the note switching point data is generated according to the time parameter.
作为本发明的进一步改进,所述传感器包括温度传感器、呼吸传感器、血压传感器和脉搏传感器中的一个或多个;As a further improvement of the present invention, the sensor includes one or more of a temperature sensor, a respiration sensor, a blood pressure sensor and a pulse sensor;
所述根据所述人体特征参数生成音强时值数据和音符切换点数据,包括:The generation of sound intensity time value data and note switching point data according to the human body feature parameters includes:
将所述传感器采集的信号转换为幅值系数和时间系数;converting the signal collected by the sensor into an amplitude coefficient and a time coefficient;
根据所述幅值参数和幅值系数生成音强时值数据,以及根据时间参数和时间系数生成音符切换点数据。The sound intensity time value data is generated according to the amplitude parameter and the amplitude coefficient, and the note switching point data is generated according to the time parameter and the time coefficient.
作为本发明的进一步改进,所述根据所述音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据,并播放所述音乐数据,包括以下步骤:As a further improvement of the present invention, generating music data according to the sound intensity time value data, note switching point data, and pre-stored note sequence and timbre data, and playing the music data, includes the following steps:
(a)读取预存的音色数据以及音符序列,并根据所述音符序列生成音符播放序列;(a) read pre-stored timbre data and note sequence, and generate note play sequence according to described note sequence;
(b)从所述音符播放序列中取出最前端的音符,并将所述音符转换为音高数据;(b) taking out the foremost note from the note playing sequence, and converting the note into pitch data;
(c)根据所述音色数据、音高数据以及当前时刻的音强时值数据生成当前时刻的音乐数据并播放;(c) according to described timbre data, pitch data and the sound intensity time value data of the present moment, generate the music data of the present moment and play;
(d)在收到音符切换点信号时,从音符播放序列中删去当前音符,并判断所述音符播放序列是否为空,若所述音符播放序列非空,则执行步骤(b),否则结束演奏。(d) when receiving the note switching point signal, delete the current note from the note playback sequence, and determine whether the note playback sequence is empty, if the note playback sequence is not empty, then execute step (b), otherwise End the performance.
本发明还提供一种电子设备,包括主控单元、播放单元、存储单元、以及传感器单元;其中:The present invention also provides an electronic device, comprising a main control unit, a playback unit, a storage unit, and a sensor unit; wherein:
所述存储单元,用于存储音符序列和音色数据,所述音符序列由多个音符的音高数据构成;The storage unit is used to store a sequence of notes and timbre data, and the sequence of notes is composed of pitch data of a plurality of notes;
所述传感器单元,用于实时获取人体特征参数,并根据所述人体特征参数生成音强时值数据和音符切换点数据,所述人体特征参数包括人体动作和/或情感体征对应的电信号;The sensor unit is configured to acquire human body characteristic parameters in real time, and generate sound intensity time value data and note switching point data according to the human body characteristic parameters, where the human body characteristic parameters include electrical signals corresponding to human body movements and/or emotional signs;
所述主控单元,用于根据所述音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据;Described main control unit, is used for generating music data according to described sound intensity time value data, note switching point data and pre-stored note sequence and timbre data;
所述播放单元,用于播放由所述主控单元生成的音乐数据。The playing unit is used for playing the music data generated by the main control unit.
作为本发明的进一步改进,所述传感器单元包括以下一个或多个:触摸屏、加速度传感器、力度键盘、振动传感器、陀螺仪传感器、生物电波传感器、温度传感器、呼吸传感器、血压传感器、脉搏传感器、图像传感器和拾音器。As a further improvement of the present invention, the sensor unit includes one or more of the following: touch screen, acceleration sensor, force keyboard, vibration sensor, gyroscope sensor, bioelectric wave sensor, temperature sensor, respiration sensor, blood pressure sensor, pulse sensor, image sensors and pickups.
作为本发明的进一步改进,所述电子设备包括输入单元,所述主控单元根据所述输入单元的输入信号生成所述音符序列和音色数据并存储到所述存储单元。As a further improvement of the present invention, the electronic device includes an input unit, and the main control unit generates the note sequence and timbre data according to the input signal of the input unit and stores them in the storage unit.
本发明还提供一种电子设备,包括存储器和处理器,所述存储器中存储有可在所述处理器中执行的计算机程序,且所述处理器执行所述计算机程序时实现如上所述的音乐演奏方法的步骤。The present invention also provides an electronic device comprising a memory and a processor, the memory stores a computer program executable in the processor, and the processor implements the above music when executing the computer program Steps of how to play.
本发明还提供一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使计算机执行如上所述的音乐演奏方法的步骤。The present invention also provides a computer-readable storage medium storing computer-executable instructions for causing a computer to perform the steps of the music performance method as described above.
有益效果beneficial effect
本发明的音乐演奏方法、电子设备及计算机可读存储介质,通过传感器采集人体特征参数生成音强时值数据和音符切换点数据,并结合预存的音符序列和音色数据合成音乐数据,只需简单练习即可让每一个人演奏出个性化的音乐。The music performance method, electronic device and computer-readable storage medium of the present invention collect human body characteristic parameters through sensors to generate sound intensity time value data and note switching point data, and combine the pre-stored note sequence and timbre data to synthesize music data. Practice allows everyone to play personalized music.
附图说明Description of drawings
图1是本发明实施例提供的音乐演奏方法的流程示意图;1 is a schematic flowchart of a music performance method provided by an embodiment of the present invention;
图2是待演奏的音乐的节选简谱;Fig. 2 is the excerpted musical notation of the music to be played;
图3是本发明实施例提供的音乐演奏方法中的生成音强时值数据和音符切换点数据的示意图;3 is a schematic diagram of generating sound intensity time value data and note switching point data in a music performance method provided by an embodiment of the present invention;
图4是本发明实施例提供的音乐演奏方法生成音乐数据的示意图;Fig. 4 is the schematic diagram that the music performance method that the embodiment of the present invention provides generates music data;
图5是本发明实施例提供的音乐演奏方法中生成音强时值数据以及音符切换点数据的流程示意图;5 is a schematic flowchart of generating sound intensity time value data and note switching point data in the music performance method provided by an embodiment of the present invention;
图6是本发明实施例提供的音乐演奏方法中另一生成音强时值数据以及音符切换点数据的流程示意图;Fig. 6 is another schematic flow chart of generating sound intensity time value data and note switching point data in the music performance method provided by the embodiment of the present invention;
图7是本发明实施例提供的音乐演奏方法中生成并播放音乐数据的流程示意图;7 is a schematic flowchart of generating and playing music data in a music performance method provided by an embodiment of the present invention;
图8是本发明实施例提供的电子设备的框图;8 is a block diagram of an electronic device provided by an embodiment of the present invention;
图9是本发明另一实施例提供的电子设备的框图。FIG. 9 is a block diagram of an electronic device provided by another embodiment of the present invention.
本发明的实施方式Embodiments of the present invention
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the objectives, technical solutions and advantages of the present invention clearer, the present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, but not to limit the present invention.
如图1所示,是本发明实施例提供的音乐演奏方法的流程示意图,该音乐演奏方法可应用于智能移动终端(例如手机)、智能手环、智能手表、耳机或专用的电子设备,并实现个性化的音乐演奏。具体地,本实施例的音乐演奏方法可结合安装到智能移动终端、智能手环、智能手表、耳机或专用的电子设备的应用程序实现,该方法包括:As shown in FIG. 1, it is a schematic flowchart of a music performance method provided by an embodiment of the present invention. The music performance method can be applied to a smart mobile terminal (such as a mobile phone), a smart bracelet, a smart watch, an earphone or a dedicated electronic device, and Realize personalized music performance. Specifically, the music performance method of this embodiment can be implemented in combination with an application program installed on a smart mobile terminal, smart bracelet, smart watch, earphone or dedicated electronic device, and the method includes:
步骤S11:通过传感器实时获取人体特征参数,上述人体特征参数包括人体动作(例如手、手指、脚、头、脸、腰等部位的动作)和/或情感体征(例如脑电波等生物电波、温度、脉搏、血压和表情等)对应的电信号。Step S11: Real-time acquisition of human body characteristic parameters through sensors, the above-mentioned human body characteristic parameters include human movements (such as movements of hands, fingers, feet, head, face, waist, etc.) and/or emotional signs (such as bioelectric waves such as brain waves, temperature, etc.) , pulse, blood pressure and expression, etc.) corresponding electrical signals.
在实际应用中,上述传感器包括触摸屏、加速度传感器、力度键盘、陀螺仪、生物电波传感器、温度传感器、脉搏传感器、血压传感器、震动传感器、图像传感器和拾音器中的一种或多种。通过各类传感器获取人体特征参数属于本领域常规技术,在此不再赘述。In practical applications, the above sensors include one or more of a touch screen, an acceleration sensor, a force keyboard, a gyroscope, a bioelectric wave sensor, a temperature sensor, a pulse sensor, a blood pressure sensor, a vibration sensor, an image sensor, and a sound pickup. Obtaining human body characteristic parameters through various types of sensors is a conventional technique in the art, and details are not described herein again.
步骤S12:根据人体特征参数实时生成音强时值数据和音符切换点数据。结合图3所示,上述音强时值数据是指音强及每一音强的持续时间,其可表示为图3中的曲线31,并对应于声音振动随时间变化的幅值;音符切换点数据是指进行切换(音符)演奏的时间点,其可表示为图3中垂直于时间轴的直线32,在接收到音符切换点数据时需进行切换操作。Step S12: Generate sound intensity time value data and note switching point data in real time according to the human body characteristic parameters. As shown in Fig. 3, the above-mentioned sound intensity time value data refers to the sound intensity and the duration of each sound intensity, which can be represented as the curve 31 in Fig. 3, and corresponds to the amplitude of the sound vibration changing with time; The point data refers to the time point at which the switching (note) performance is performed, which can be represented as a straight line 32 perpendicular to the time axis in FIG. 3 , and a switching operation is required when receiving the note switching point data.
例如当传感器佩戴到人体手腕时,该步骤生成的音强时值数据可传感器测得的手腕的动作幅度正相关,例如图3所示曲线31,在对应于序号为7和14的部分的手腕动作幅度大于其他部分的手腕动作幅度,相应的音强时值数据也较大;并且,该步骤生成的音符切换点数据与传感器测得的手腕动作速度也正相关,例如图3所示曲线31,在对应于序号为7和14的部分的手腕动作速度慢于其他部分的手腕动作速度,此时的音符切换点数据的间隔也较大。For example, when the sensor is worn on the human wrist, the sound intensity time value data generated in this step can be positively correlated with the motion amplitude of the wrist measured by the sensor, such as curve 31 shown in FIG. The movement amplitude is larger than the wrist movement amplitude of other parts, and the corresponding sound intensity time value data is also larger; and the note switching point data generated in this step is also positively correlated with the wrist movement speed measured by the sensor, such as curve 31 shown in Figure 3 , the wrist movement speed of the parts corresponding to serial numbers 7 and 14 is slower than that of other parts, and the interval of the note switching point data at this time is also larger.
步骤S13:根据音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据,并播放音乐数据,上述音符序列由多个音符的音高数据构成。Step S13: Generate music data according to the sound intensity time value data, the note switching point data, and the pre-stored note sequence and timbre data, and play the music data, where the note sequence is composed of pitch data of a plurality of notes.
在本实施例中,音符序列包括多个按顺序排列的音符,其可提前输入并存储到存储单元。例如,对应于图2所示的节选乐谱,预存的音符序列可以为:11556654433221,每一音符对应于一个音高(音调)。音色数据则用于表示声音特性,例如钢琴、小提琴、古筝、二胡、架子鼓等。In this embodiment, the note sequence includes a plurality of sequentially arranged notes, which can be input in advance and stored in the storage unit. For example, corresponding to the excerpt music score shown in FIG. 2 , the pre-stored note sequence may be: 11556654433221, and each note corresponds to a pitch (tone). Timbre data is used to represent sound characteristics, such as piano, violin, guzheng, erhu, drum set, etc.
结合图4所示,在该步骤中,可提前从预存数据中选择音符序列和音色数据,然后将选中的音符序列和音色数据与步骤S12中实时生成的音强时值数据和音符切换点数据依次生成对应的音乐数据51并播放。4, in this step, the note sequence and timbre data can be selected from the pre-stored data in advance, and then the selected note sequence and timbre data are compared with the sound intensity time value data and note switching point data generated in real time in step S12. Corresponding music data 51 are sequentially generated and played.
上述音乐演奏方法通过传感器采集人体特征参数生成音强时值数据和音符切换点数据,并结合预存的音符序列和音色数据合成音乐数据,只需简单练习即可让每一个人演奏出个性化的音乐,并且可实现所有乐器的演奏。特别适用于对音乐进行个性化的改编和演奏。The above music performance method collects human body characteristic parameters through sensors to generate sound intensity time value data and note switching point data, and combines the pre-stored note sequence and timbre data to synthesize music data. With simple practice, everyone can play personalized music. Music, and can achieve the performance of all instruments. It is especially suitable for personalised arrangements and performances of music.
如图5所示,是本发明实施例提供的音乐演奏方法中生成音强时值数据以及音符切换点数据(即步骤S12)的流程示意图。具体地,当传感器包括触摸屏、压力传感器、力度键盘、加速度传感器、振动传感器和陀螺仪传感器中的一个或多个时,上述步骤S12包括;As shown in FIG. 5 , it is a schematic flowchart of generating sound intensity time value data and note switching point data (ie, step S12 ) in the music performance method provided by the embodiment of the present invention. Specifically, when the sensor includes one or more of a touch screen, a pressure sensor, a force keyboard, an acceleration sensor, a vibration sensor and a gyroscope sensor, the above step S12 includes;
步骤S121:将人体动作转换为幅值参数和时间参数。Step S121: Convert the human motion into amplitude parameters and time parameters.
例如当传感器为触摸屏时,触摸屏接收到的滑动动作的幅度和速度与幅值参数正相关,滑动动作的速度则与时间参数正相关;当传感器为加速度传感器、振动传感器和陀螺仪传感器之一时,其检测到的移动幅度速度、加速度与幅值参数正相关,滑动动作的持续时间或时长则与时间参数正相关;当传感器为压力传感器时,其检测到的按压力度及变化与幅值参数正相关,检测到的按压持续时间或时长则与时间参数正相关。For example, when the sensor is a touch screen, the amplitude and speed of the sliding action received by the touch screen are positively correlated with the amplitude parameter, and the speed of the sliding action is positively correlated with the time parameter; when the sensor is one of an acceleration sensor, a vibration sensor and a gyroscope sensor, The detected movement amplitude speed and acceleration are positively correlated with the amplitude parameter, and the duration or duration of the sliding action is positively correlated with the time parameter; when the sensor is a pressure sensor, the detected pressing force and change are positively correlated with the amplitude parameter. Correlation, the detected compression duration or duration is positively correlated with the time parameter.
特别地,当传感器为力度键盘时,其可根据被按下的力度等方式确认人体动作,例如,力度键盘包括琴键以及位于琴键下方不同高度位置的若干导电橡胶触点,在琴键被按下过程中,琴键与不同导电橡胶触点的电接触存在时间差,由于上述时间差和琴键的运动速度成反比,而琴键的运动速度则与按键的力度成正比,可根据上述时间差获得琴键的按压力度,进而获得人体动作,并以此生成幅值参数和时间参数,例如,幅值参数与按压力度正相关,琴键被按下的时间点则可作为时间参数。此外,力度键盘也可通过电磁感应实现,即力度键盘包括琴键、安装在琴键上的磁铁、以及安装在印制电路板上的感应线圈,按琴键的动作带动磁铁运动,磁场的变化在感应线圈中产生电流,该电流信号强度与按键力度对应,进而获得人体动作,并以此生成幅值参数和时间参数。In particular, when the sensor is a force keyboard, it can confirm the human action according to the pressing force. For example, the force keyboard includes a key and a number of conductive rubber contacts located at different heights below the key. When the key is pressed Among them, there is a time difference between the electrical contact between the keys and different conductive rubber contacts. Since the above time difference is inversely proportional to the movement speed of the keys, and the movement speed of the keys is proportional to the strength of the keys, the pressing force of the keys can be obtained according to the above time difference, and then The human body movement is obtained, and the amplitude parameter and time parameter are generated accordingly. For example, the amplitude parameter is positively related to the pressing force, and the time point when the key is pressed can be used as the time parameter. In addition, the force keyboard can also be realized by electromagnetic induction, that is, the force keyboard includes the keys, the magnets installed on the keys, and the induction coils installed on the printed circuit board. The action of pressing the keys drives the magnets to move, and the magnetic field changes in the induction coils. A current is generated in the current, and the signal strength of the current corresponds to the strength of the button, so as to obtain the motion of the human body, and then generate the amplitude parameter and the time parameter.
步骤S122:根据幅值参数生成音强时值数据,以及根据时间参数生成音符切换点数据。具体地,幅值参数越大,音强时值参数越大;时间参数越大,音符切换点数据的间隔越长。Step S122: Generate sound intensity duration data according to the amplitude parameter, and generate note switching point data according to the time parameter. Specifically, the larger the amplitude parameter is, the larger the sound intensity time value parameter is; the larger the time parameter is, the longer the interval of note switching point data is.
通过上述方式,演奏者可通过在触摸屏(例如智能移动终端的触摸屏)上滑动,或者按压、挤压带有压力传感器的电子设备,或者佩戴智能手环、智能手表挥舞手臂,或者手持专用电子设备等挥舞手臂、或者佩戴耳机做摇头或点头动作,实现不同乐器的音乐演奏,而无需具备乐器演奏技能。In the above manner, the performer can slide on the touch screen (such as the touch screen of a smart mobile terminal), or press or squeeze the electronic device with the pressure sensor, or wear a smart bracelet, a smart watch and wave his arm, or hold a special electronic device By waving your arms, or wearing headphones to shake your head or nod your head, you can play different musical instruments without having musical instrument skills.
此外,当传感器包括生物电波传感器、图像传感器和拾音器中的一个或多个时,可通过生物电波传感器检测生物电波(例如脑电波)变化、通过图像传感器拍摄图像(例如舞蹈动作)、通过拾音器拾取声音(例如哼唱歌曲),相应地,可通过以下方式生成音强时值数据和音符切换点数据:将图像传感器采集的信号和拾音器采集的信号转换为幅值参数和时间参数,例如当图像传感器采集的信号中舞蹈动作越剧烈时,幅值参数越大,音符切换点数据的间隔时间越短;根据幅值参数生成音强时值数据,以及根据时间参数生成音符切换点数据,具体地,幅值参数越大,音强时值参数越大;时间参数越大,音符切换点数据的间隔越长。通过上述方式,演奏者可借助舞蹈动作或哼唱歌曲,实现不同乐器的演奏。In addition, when the sensor includes one or more of a bioelectric wave sensor, an image sensor, and a pickup, changes in bioelectric waves (eg, brain waves) may be detected by the biowave sensor, images (eg, dance moves) may be captured by the image sensor, and picked up by the pickup Sounds (e.g. humming songs), correspondingly, sound intensity duration data and note switching point data can be generated by converting the signal acquired by the image sensor and the signal acquired by the pickup into amplitude parameters and time parameters, such as when the image When the dance action is more intense in the signal collected by the sensor, the larger the amplitude parameter is, the shorter the interval time of the note switching point data; the sound intensity time value data is generated according to the amplitude parameter, and the note switching point data is generated according to the time parameter, specifically , the larger the amplitude parameter, the larger the sound intensity time value parameter; the larger the time parameter, the longer the interval of note switching point data. In the above manner, the performer can perform different musical instruments by means of dance moves or humming songs.
结合图6所示,在本发明的一个实施例中,还可通过以下方式生成音强时值数据以及音符切换点数据(即步骤S12)的流程示意图。具体地,当传感器包括触摸屏、压力传感器、加速度传感器、振动传感器、陀螺仪传感器、生物电波传感器、图像传感器和拾音器中的一个或多个,以及温度传感器、呼吸传感器、血压传感器和脉搏传感器中的一个或多个时,上述步骤S12包括;With reference to FIG. 6 , in an embodiment of the present invention, a schematic flowchart of the sound intensity duration data and the note switching point data (ie, step S12 ) may also be generated in the following manner. Specifically, when the sensor includes one or more of a touch screen, a pressure sensor, an acceleration sensor, a vibration sensor, a gyroscope sensor, a bioelectric wave sensor, an image sensor, and a sound pickup, as well as a temperature sensor, a respiration sensor, a blood pressure sensor, and a pulse sensor One or more, the above step S12 includes;
步骤S121’:将触摸屏、压力传感器、加速度传感器、振动传感器、陀螺仪传感器、生物电波传感器、图像传感器和拾音器中的一个或多个所采集的人体动作转换为幅值参数和时间参数。Step S121': Convert the human motion collected by one or more of the touch screen, pressure sensor, acceleration sensor, vibration sensor, gyroscope sensor, bioelectric wave sensor, image sensor and pickup into amplitude parameters and time parameters.
例如当传感器为触摸屏时,触摸屏接收到的滑动动作的幅度与幅值参数正相关,滑动动作的速度则与时间参数正相关;当传感器为加速度传感器、振动传感器和陀螺仪传感器之一时,其移动幅度与幅值参数正相关,滑动动作的速度则与时间参数负相关。For example, when the sensor is a touch screen, the amplitude of the sliding action received by the touch screen is positively correlated with the amplitude parameter, and the speed of the sliding action is positively correlated with the time parameter; when the sensor is one of an acceleration sensor, a vibration sensor and a gyroscope sensor, its movement The amplitude is positively correlated with the amplitude parameter, and the speed of the sliding action is negatively correlated with the time parameter.
步骤S122’:将生物电波传感器、温度传感器、呼吸传感器、血压传感器和脉搏传感器中的一个或多个采集的信号转换为幅值系数和时间系数。Step S122': Convert the signals collected by one or more of the bioelectric wave sensor, the temperature sensor, the respiration sensor, the blood pressure sensor and the pulse sensor into an amplitude coefficient and a time coefficient.
例如,当温度传感器、呼吸传感器、脉搏传感器所产生的信号的幅值越大时,幅值系数越大,当生物电波传感器、呼吸传感器、脉搏传感器所产生的信号频率越高时,时间系数越大;当温度传感器产生温度信号越大时,幅值系数和时间系数越大;当血压传感器产生血压信号越大时,幅值系数和时间系数越大。For example, when the amplitude of the signal generated by the temperature sensor, respiration sensor, and pulse sensor is larger, the amplitude coefficient is larger. When the temperature signal generated by the temperature sensor is larger, the amplitude coefficient and time coefficient are larger; when the blood pressure sensor generates a larger blood pressure signal, the amplitude coefficient and time coefficient are larger.
步骤S123’:根据幅值参数和幅值系数生成音强时值数据,以及根据时间参数和时间系数生成音符切换点数据。Step S123': Generate sound intensity time value data according to the amplitude parameter and the amplitude coefficient, and generate note switching point data according to the time parameter and the time coefficient.
在该步骤中,可将幅值参数和幅值系数的乘积作为新的幅值参数,将时间参数和时间系数作为新的时间参数,并以新的幅值参数和新的时间参数生成音强时值数据和音符切换点数据。In this step, the product of the amplitude parameter and the amplitude coefficient can be used as the new amplitude parameter, the time parameter and the time coefficient can be used as the new time parameter, and the sound intensity can be generated with the new amplitude parameter and the new time parameter Duration data and note switching point data.
通过上述方式,可将不同人在不同环境、不同时间的感情融入到演奏的音乐中,从而最大程度的表达和演绎音乐,实现各位个性化的音乐演奏。Through the above methods, the feelings of different people in different environments and at different times can be integrated into the music played, so as to express and interpret the music to the greatest extent, and realize the personalized music performance of each person.
如图7所示,是本发明实施例提供的音乐演奏方法中生成并播放音乐数据(即步骤S13)的流程示意图。该步骤S13包括:As shown in FIG. 7 , it is a schematic flowchart of generating and playing music data (ie, step S13 ) in the music performance method provided by the embodiment of the present invention. This step S13 includes:
步骤S131:读取预存的音色数据以及音符序列,并根据音符序列生成音符播放序列。Step S131: Read the pre-stored timbre data and the note sequence, and generate a note playing sequence according to the note sequence.
具体地,读取预存的音色数据以及音符序列是指将存储单元的音色数据以及音符序列写入到缓存,而生成音符播放序列可以为在缓存中创建一个包括音符序列的队列。Specifically, reading the pre-stored timbre data and the note sequence refers to writing the timbre data and the note sequence of the storage unit into the buffer, and generating the note playing sequence may create a queue including the note sequence in the buffer.
步骤S132:从音符播放序列中取出最前端的音符,并将音符转换为音高数据。Step S132: Take out the foremost note from the note playing sequence, and convert the note into pitch data.
步骤S133:根据音色数据、音高数据以及当前时刻的音强时值数据(在步骤S12中生成)生成当前时刻的音乐数据并播放,直至完成一个音符的演奏。Step S133: Generate and play music data at the current time according to the timbre data, pitch data and the sound intensity time value data at the current time (generated in step S12) until the performance of one note is completed.
步骤S134:在接收到音符切换点信号(在步骤S12中生成)时,将当前音符从音符播放序列删除(例如当音符播放序列为包括音符序列的队列时,将队列的起始位置的指针左移一个音符),并判断音符播放序列是否为空。当音符播放序列非空时,返回步骤S132,进行下一音符演奏,直到音符播放序列为空。Step S134: when receiving the note switching point signal (generated in step S12), delete the current note from the note playback sequence (for example, when the note playback sequence is a queue including a note sequence, move the pointer of the starting position of the queue to the left. move one note), and determine if the note play sequence is empty. When the note playing sequence is not empty, return to step S132 to perform the next note playing until the note playing sequence is empty.
如图8所示,是本发明实施例提供的电子设备框图,该电子设备可以为智能移动终端(例如手机),佩戴到人体的智能手环、智能手表、耳机等,或者利于手持的专用电子装置,并进行音乐演奏。本实施例的电子设备包括主控单元81、播放单元82、存储单元83以及传感器单元84。As shown in FIG. 8, it is a block diagram of an electronic device provided by an embodiment of the present invention. The electronic device may be a smart mobile terminal (such as a mobile phone), a smart bracelet, smart watch, earphone, etc., which are worn on the human body, or a special electronic device that is convenient for hand-held. device and perform music. The electronic device in this embodiment includes a main control unit 81 , a playback unit 82 , a storage unit 83 and a sensor unit 84 .
特别地,上述电子设备可包括主壳体以及安装在主壳体内印刷线路板,主控单元81、存储单元83和传感器单元84集成到上述印刷线路板,播放单元82则可电性连接到印刷电路板。在实际应用中,主控单元81、存储单元83以及传感器单元84也可集成到多个电性连接的印刷线路板。In particular, the above-mentioned electronic device may include a main casing and a printed circuit board installed in the main casing. The main control unit 81, the storage unit 83 and the sensor unit 84 are integrated into the above-mentioned printed circuit board, and the playback unit 82 can be electrically connected to the printed circuit board. circuit board. In practical applications, the main control unit 81 , the storage unit 83 and the sensor unit 84 can also be integrated into a plurality of electrically connected printed circuit boards.
上述存储单元83用于存储音符序列和音色数据,其中音符序列由多个音符的音高数据构成。The above-mentioned storage unit 83 is used for storing the note sequence and the timbre data, wherein the note sequence is composed of the pitch data of a plurality of notes.
传感器单元84用于实时获取人体特征参数,并根据人体特征参数生成音强时值数据和音符切换点数据,上述人体特征参数包括人体动作(包括手、手指、脚、头、脸、腰等部位的动作)和/或情感体征(包括生物电波(含脑电波)、温度、脉搏、血压和表情)对应的电信号。具体地,传感器单元84可包括触摸屏、压力传感器、力度键盘、加速度传感器、陀螺仪传感器、生物电波传感器、温度传感器、脉搏传感器、血压传感器、震动传感器、图像传感器和拾音器中的一个或多个。并且,该传感器单元84还可将采集的人体特征参数转换为模拟信号或数字信号,传输到主控单元81。The sensor unit 84 is used to acquire human body characteristic parameters in real time, and generate sound intensity time value data and note switching point data according to the human body characteristic parameters. movements) and/or electrical signals corresponding to emotional signs (including bioelectric waves (including brain waves), temperature, pulse, blood pressure, and expressions). Specifically, the sensor unit 84 may include one or more of a touch screen, a pressure sensor, a force keyboard, an acceleration sensor, a gyro sensor, a bioelectric wave sensor, a temperature sensor, a pulse sensor, a blood pressure sensor, a shock sensor, an image sensor, and a microphone. In addition, the sensor unit 84 can also convert the collected human body characteristic parameters into analog signals or digital signals, and transmit them to the main control unit 81 .
主控单元81分别与存储单元83和传感器单元84电性连接,并根据传感器单元84实时获取的人体特征参数(例如肢体动作、生物电(含脑电波)、脉搏、血压、体温、表情等)生成音强时值数据和音符切换点数据,其中音强时值数据表示声音的强度及对应强度的持续时间(即一个音符的音强随时间变化的曲线),音符切换点数据则表示切换音符的时间点。在获得音强时值数据和音符切换点数据后,主控单元81将音强时值数据、音符切换点数据与从存储单元83读取的音符序列、音色数据结合生成音乐数据(例如MIDI数据)。The main control unit 81 is electrically connected to the storage unit 83 and the sensor unit 84 respectively, and according to the real-time acquisition of human body characteristic parameters (such as limb movements, bioelectricity (including brain waves), pulse, blood pressure, body temperature, expression, etc.) Generate sound intensity duration data and note switching point data, where the sound intensity duration data represents the intensity of the sound and the duration of the corresponding intensity (that is, the curve of the sound intensity of a note changing with time), and the note switching point data represents the switching note. time point. After obtaining the sound intensity duration data and the note switching point data, the main control unit 81 combines the sound intensity duration data and the note switching point data with the note sequence and timbre data read from the storage unit 83 to generate music data (for example, MIDI data ).
该主控单元81可包括一个或多个微控制单元(Microcontroller Unit,MCU),例如包括与现有的电子音响合成器(Synthesizer)中的控制单元类似的芯片,其可将传感器单元84采集的人体特征参数,转换为音强时值数据及音符切换点数据。主控单元81可将上述音强时值数据、音符切换点数据与存储单元83中的音符序列和音色数据,制造出上百种音色、几十种节奏型和音响效果电信号。此外,主控单元81还可将生成的音乐数据存储到存储单元83,以便演奏者后续播放、重听。The main control unit 81 may include one or more microcontroller units (Microcontroller Unit, MCU), for example including a chip similar to the control unit in the existing electronic sound synthesizer (Synthesizer), which can convert the human body characteristic parameters collected by the sensor unit 84 into sound intensity time value data and note switching point data . The main control unit 81 can produce hundreds of timbres, dozens of rhythm patterns and sound effects electrical signals from the above-mentioned sound intensity time value data, note switching point data, and the note sequence and timbre data in the storage unit 83 . In addition, the main control unit 81 can also store the generated music data in the storage unit 83, so that the player can play and listen again later.
播放单元82与主控单元81电性连接,并播放主控单元81生成的音乐数据,从而演奏者或听众可听到音乐。具体地,当可穿戴电子设备集成到智能手环、智能手表时,播放单元82可采用电动扬声器;当可穿戴电子设备集成到耳机时,播放单元82可采用电动扬声器或骨传导扬声器等。The playing unit 82 is electrically connected to the main control unit 81, and plays the music data generated by the main control unit 81, so that the player or the audience can hear the music. Specifically, when the wearable electronic device is integrated into a smart bracelet or smart watch, the playback unit 82 may use an electric speaker; when the wearable electronic device is integrated into a headset, the playback unit 82 may use an electric speaker or a bone conduction speaker.
上述电子设备,通过传感器单元采集人体特征参数生成音强时值数据和音符切换点数据,并结合存储单元中存储的音符序列和音色数据合成音乐数据,不仅携带方便,而且只需简单练习即可让每一个人演奏出个性化的音乐。The above electronic equipment collects human body characteristic parameters through the sensor unit to generate sound intensity time value data and note switching point data, and combines the note sequence and timbre data stored in the storage unit to synthesize music data, which is not only convenient to carry, but also requires simple practice. Let everyone play personalized music.
在本发明的另一实施例中,结合图9所示,电子设备除了包括主控单元81、播放单元82、存储单元83以及传感器单元84外,还包括输入单元85,且该输入单元85与主控单元81电性连接。输入单元85具体可采用键盘或触摸屏,主控单元81通过从输入单元85采集的输入信号生成音符序列,并将音符序列存储到存储单元83,以便后续演奏使用。In another embodiment of the present invention, as shown in FIG. 9 , in addition to the main control unit 81 , the playback unit 82 , the storage unit 83 and the sensor unit 84 , the electronic device also includes an input unit 85 , and the input unit 85 is connected to the input unit 85 . The main control unit 81 is electrically connected. The input unit 85 may specifically use a keyboard or a touch screen. The main control unit 81 generates a note sequence through the input signal collected from the input unit 85 and stores the note sequence in the storage unit 83 for subsequent performance.
除了音符序列外,输入单元85还可输入音符序列对应的音色数据,并由主控单元81存储到存储单元83。In addition to the note sequence, the input unit 85 can also input timbre data corresponding to the note sequence, which is stored in the storage unit 83 by the main control unit 81 .
在本发明的另一实施例中,可穿戴电子设备除了包括主控单元81、播放单元、存储单元18以及传感器单元84外,还包括无线传输单元86,或同时包括输入单元85和无线传输单元86。该无线传输单元86具体可采用蓝牙模块、WIFI模块等,在此不做限制。In another embodiment of the present invention, in addition to the main control unit 81, the playback unit, the storage unit 18 and the sensor unit 84, the wearable electronic device also includes a wireless transmission unit 86, or includes an input unit 85 and a wireless transmission unit at the same time 86. The wireless transmission unit 86 may specifically adopt a Bluetooth module, a WIFI module, etc., which is not limited here.
该无线传输单元86与主控单元81电性连接,且主控单元81通过解析无线传输单元86的通讯信号获取音符序列,并将音符序列存储到存储单元83。即电子设备可通过无线传输单元86与其他终端设备或服务器通信,并以通讯方式获得音符序列。The wireless transmission unit 86 is electrically connected with the main control unit 81 , and the main control unit 81 obtains the note sequence by analyzing the communication signal of the wireless transmission unit 86 , and stores the note sequence in the storage unit 83 . That is, the electronic device can communicate with other terminal devices or servers through the wireless transmission unit 86, and obtain the note sequence by means of communication.
此外,上述无线传输单元86还可将主控单元81生成的音乐数据传输到其他播放设备进行播放,例如与蓝牙接收器连接的音箱等。In addition, the above-mentioned wireless transmission unit 86 can also transmit the music data generated by the main control unit 81 to other playback devices for playback, such as a speaker connected to a Bluetooth receiver.
本发明实施例还提供一种电子设备,该电子设备可以为智能移动终端、智能手表、智能手环、耳机、专用电子设备等,并进行音乐演奏。本实施例的电子设备包括存储器和处理器,其中存储器中存储有可在处理器中执行的计算机程序,且处理器执行所述计算机程序时实现如图1-7实施例所述的音乐演奏方法的步骤。The embodiment of the present invention also provides an electronic device, which can be a smart mobile terminal, a smart watch, a smart bracelet, an earphone, a special electronic device, etc., and performs music performance. The electronic device of this embodiment includes a memory and a processor, wherein a computer program executable in the processor is stored in the memory, and when the processor executes the computer program, the music performance method described in the embodiments of FIGS. 1-7 is implemented A step of.
本实施例中的电机控制器与上述图1-7对应实施例中的音乐演奏方法属于同一构思,其具体实现过程详细见对应的方法实施例,且方法实施例中的技术特征在本设备实施例中均对应适用,这里不再赘述。The motor controller in this embodiment belongs to the same concept as the music performance method in the above-mentioned embodiment corresponding to FIGS. 1-7 , and the specific implementation process is detailed in the corresponding method embodiment, and the technical features in the method embodiment are implemented in this device. All of the examples are applicable, and will not be repeated here.
本发明的一个实施例提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使计算机执行如上所述的音乐演奏方法。One embodiment of the present invention provides a computer-readable storage medium storing computer-executable instructions for causing a computer to execute the above-described music performance method.
本实施例中的计算机可读存储介质与上述图1-7对应实施例中的音乐演奏方法属于同一构思,其具体实现过程详细见对应的方法实施例,且方法实施例中的技术特征在本设备实施例中均对应适用,这里不再赘述。The computer-readable storage medium in this embodiment belongs to the same concept as the music performance method in the above-mentioned embodiment corresponding to FIGS. 1-7 , and the specific implementation process is detailed in the corresponding method embodiment, and the technical features in the method embodiment are described in this document. All of the device embodiments are correspondingly applicable, and details are not repeated here.
应理解,上述实施例中各步骤的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。It should be understood that the size of the sequence numbers of the steps in the above embodiments does not mean the sequence of execution, and the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述或记载的部分,可以参见其它实施例的相关描述。In the foregoing embodiments, the description of each embodiment has its own emphasis. For parts that are not described or described in detail in a certain embodiment, reference may be made to the relevant descriptions of other embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of this application.
在本申请所提供的实施例中,应该理解到,所揭露的音乐演奏方法、及电子设备,可以通过其它的方式实现。In the embodiments provided in this application, it should be understood that the disclosed music performance method and electronic device may be implemented in other ways.
本申请实现上述实施例方法中的全部或部分流程,也可以通过计算机程序来指令相关的硬件来完成,所述的计算机程序可存储于一计算机可读存储介质中,该计算机程序在被处理器执行时,可实现上述各个方法实施例的步骤。其中,所述计算机程序包括计算机程序代码,所述计算机程序代码可以为源代码形式、对象代码形式、可执行文件或某些中间形式等。所述计算机可读介质可以包括:能够携带所述计算机程序代码的任何实体或界面切换设备、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、电载波信号、电信信号以及软件分发介质等。需要说明的是,所述计算机可读介质包含的内容可以根据司法管辖区内立法和专利实践的要求进行适当的增减,例如在某些司法管辖区,根据立法和专利实践,计算机可读介质不包括是电载波信号和电信信号。This application implements all or part of the processes in the methods of the above embodiments, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can be processed by the processor. When executed, the steps of the foregoing method embodiments may be implemented. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form, and the like. The computer-readable medium may include: any entity or interface switching device capable of carrying the computer program code, recording medium, U disk, removable hard disk, magnetic disk, optical disk, computer memory, Read-Only Memory (Read-Only Memory) Memory, ROM), random access memory (Random Access Memory, RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable media may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer-readable media Excluded are electrical carrier signals and telecommunication signals.
上面结合附图对本发明实施例作了详细说明,但是本发明不限于上述实施例,在所属技术领域普通技术人员所具备的知识范围内,还可以在不脱离本发明宗旨的前提下作出各种变化。此外,在不冲突的情况下,本发明的实施例及实施例中的特征可以相互组合。The embodiments of the present invention have been described in detail above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned embodiments, and within the scope of knowledge possessed by those of ordinary skill in the art, various Variety. Furthermore, the embodiments of the present invention and features in the embodiments may be combined with each other without conflict.

Claims (10)

  1. 一种音乐演奏方法,其特征在于,包括: A music performance method, comprising:
    通过传感器实时获取人体特征参数,所述人体特征参数包括人体动作和/或情感体征对应的电信号;Real-time acquisition of human body characteristic parameters through sensors, where the human body characteristic parameters include electrical signals corresponding to human movements and/or emotional signs;
    根据所述人体特征参数生成音强时值数据和音符切换点数据;Generate sound intensity time value data and note switching point data according to the human body characteristic parameters;
    根据所述音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据,并播放所述音乐数据;Generate music data according to the sound intensity time value data, note switching point data and pre-stored note sequence and timbre data, and play the music data;
    所述音符序列由多个音符的音高数据构成。The sequence of notes consists of pitch data of a plurality of notes.
  2. 根据权利要求1所述的音乐演奏方法,其特征在于,所述传感器包括触摸屏、压力传感器、力度键盘、加速度传感器、振动传感器和陀螺仪传感器中的一个或多个; The music performance method according to claim 1, wherein the sensor comprises one or more of a touch screen, a pressure sensor, a force keyboard, an acceleration sensor, a vibration sensor and a gyroscope sensor;
    所述根据所述人体特征参数生成音强时值数据和音符切换点数据,包括:The generation of sound intensity time value data and note switching point data according to the human body feature parameters includes:
    将人体动作转换为幅值参数和时间参数;Convert human motion into amplitude parameters and time parameters;
    根据所述幅值参数生成音强时值数据,以及根据时间参数生成音符切换点数据。The sound intensity duration data is generated according to the amplitude parameter, and the note switching point data is generated according to the time parameter.
  3. 根据权利要求1所述的音乐演奏方法,其特征在于,所述传感器包括生物电波传感器、图像传感器和拾音器中的一个或多个; The music performance method according to claim 1, wherein the sensor comprises one or more of a bioelectric wave sensor, an image sensor and a sound pickup;
    所述根据所述人体特征参数生成音强时值数据和音符切换点数据,包括:The generation of sound intensity time value data and note switching point data according to the human body feature parameters includes:
    将所述传感器采集的信号转换为幅值参数和时间参数;Converting the signal collected by the sensor into an amplitude parameter and a time parameter;
    根据所述幅值参数生成音强时值数据,以及根据时间参数生成音符切换点数据。The sound intensity duration data is generated according to the amplitude parameter, and the note switching point data is generated according to the time parameter.
  4. 根据权利要求2或3所述的音乐演奏方法,其特征在于,所述传感器包括温度传感器、呼吸传感器、血压传感器和脉搏传感器中的一个或多个; The music performance method according to claim 2 or 3, wherein the sensor comprises one or more of a temperature sensor, a respiration sensor, a blood pressure sensor and a pulse sensor;
    所述根据所述人体特征参数生成音强时值数据和音符切换点数据,包括:The generation of sound intensity time value data and note switching point data according to the human body feature parameters includes:
    将所述传感器采集的信号转换为幅值系数和时间系数;converting the signal collected by the sensor into an amplitude coefficient and a time coefficient;
    根据所述幅值参数和幅值系数生成音强时值数据,以及根据时间参数和时间系数生成音符切换点数据。The sound intensity time value data is generated according to the amplitude parameter and the amplitude coefficient, and the note switching point data is generated according to the time parameter and the time coefficient.
  5. 根据权利要求1所述的音乐演奏方法,其特征在于,所述根据所述音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据,并播放所述音乐数据,包括以下步骤: The music performance method according to claim 1, characterized in that, generating music data according to the sound intensity time value data, note switching point data, and pre-stored note sequence and timbre data, and playing the music data, comprising: The following steps:
    (a)读取预存的音色数据以及音符序列,并根据所述音符序列生成音符播放序列;(a) read pre-stored timbre data and note sequence, and generate note play sequence according to described note sequence;
    (b)从所述音符播放序列中取出最前端的音符,并将所述音符转换为音高数据;(b) taking out the foremost note from the note playing sequence, and converting the note into pitch data;
    (c)根据所述音色数据、音高数据以及当前时刻的音强时值数据生成当前时刻的音乐数据并播放;(c) according to described timbre data, pitch data and the sound intensity time value data of the present moment, generate the music data of the present moment and play;
    (d)在收到音符切换点信号时,从音符播放序列中删去当前音符,并判断所述音符播放序列是否为空,若所述音符播放序列非空,则执行步骤(b),否则结束演奏。(d) when receiving the note switching point signal, delete the current note from the note playback sequence, and determine whether the note playback sequence is empty, if the note playback sequence is not empty, then execute step (b), otherwise End the performance.
  6. 一种电子设备,其特征在于,包括主控单元、播放单元、存储单元、以及传感器单元;其中: An electronic device, characterized in that it comprises a main control unit, a playback unit, a storage unit, and a sensor unit; wherein:
    所述存储单元,用于存储音符序列和音色数据,所述音符序列由多个音符的音高数据构成;The storage unit is used to store a sequence of notes and timbre data, and the sequence of notes is composed of pitch data of a plurality of notes;
    所述传感器单元,用于实时获取人体特征参数,并根据所述人体特征参数生成音强时值数据和音符切换点数据,所述人体特征参数包括人体动作和/或情感体征对应的电信号;The sensor unit is configured to acquire human body characteristic parameters in real time, and generate sound intensity time value data and note switching point data according to the human body characteristic parameters, where the human body characteristic parameters include electrical signals corresponding to human body movements and/or emotional signs;
    所述主控单元,用于根据所述音强时值数据、音符切换点数据以及预存的音符序列和音色数据生成音乐数据;Described main control unit, is used for generating music data according to described sound intensity time value data, note switching point data and pre-stored note sequence and timbre data;
    所述播放单元,用于播放由所述主控单元生成的音乐数据。The playing unit is used for playing the music data generated by the main control unit.
  7. 根据权利要求6所述的电子设备,其特征在于,所述传感器单元包括以下一个或多个:触摸屏、压力传感器、力度键盘、加速度传感器、振动传感器、陀螺仪传感器、生物电波传感器、温度传感器、呼吸传感器、血压传感器、脉搏传感器、图像传感器和拾音器。 The electronic device according to claim 6, wherein the sensor unit comprises one or more of the following: a touch screen, a pressure sensor, a force keyboard, an acceleration sensor, a vibration sensor, a gyroscope sensor, a bioelectric wave sensor, a temperature sensor, Respiratory sensor, blood pressure sensor, pulse sensor, image sensor and pickup.
  8. 根据权利要求6所述的电子设备,其特征在于,所述电子设备包括输入单元,所述主控单元根据所述输入单元的输入信号生成所述音符序列和音色数据并存储到所述存储单元。The electronic device according to claim 6, wherein the electronic device comprises an input unit, and the main control unit generates the note sequence and timbre data according to the input signal of the input unit and stores them in the storage unit .
  9. 一种电子设备,包括存储器和处理器,其特征在于,所述存储器中存储有可在所述处理器中执行的计算机程序,且所述处理器执行所述计算机程序时实现如权利要求1至5任一项所述的音乐演奏方法的步骤。 An electronic device, comprising a memory and a processor, characterized in that, a computer program executable in the processor is stored in the memory, and when the processor executes the computer program, the implementation of claims 1 to 5 any one of the steps of the music performance method.
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机可执行指令,所述计算机可执行指令用于使计算机执行如权利要求1至5任一项所述的音乐演奏方法的步骤。 A computer-readable storage medium, characterized in that the computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are used to cause a computer to execute the music according to any one of claims 1 to 5 Steps of how to play.
PCT/CN2021/107317 2021-04-09 2021-07-20 Music playing method, electronic device, and computer-readable storage medium WO2022213511A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110386865.6 2021-04-09
CN202110386865.6A CN113223483A (en) 2021-04-09 2021-04-09 Music performance method, electronic device, and computer-readable storage medium

Publications (1)

Publication Number Publication Date
WO2022213511A1 true WO2022213511A1 (en) 2022-10-13

Family

ID=77086847

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/107317 WO2022213511A1 (en) 2021-04-09 2021-07-20 Music playing method, electronic device, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN113223483A (en)
WO (1) WO2022213511A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5471009A (en) * 1992-09-21 1995-11-28 Sony Corporation Sound constituting apparatus
JP2004271566A (en) * 2003-03-05 2004-09-30 Yohei Akazawa Player
CN103258529A (en) * 2013-04-16 2013-08-21 初绍军 Performance method of electronic musical instrument and music
CN104834642A (en) * 2014-02-11 2015-08-12 北京三星通信技术研究有限公司 Method, apparatus and device for changing music performance style
CN107067879A (en) * 2017-04-07 2017-08-18 济宁学院 A kind of intelligent Piano Teaching system
CN108986777A (en) * 2018-06-14 2018-12-11 森兰信息科技(上海)有限公司 Method, somatosensory device and the musical instrument terminal of music simulation are carried out by body-sensing
CN109791740A (en) * 2016-10-11 2019-05-21 森兰信息科技(上海)有限公司 Intelligent measurement and feedback system for intelligent piano

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5471009A (en) * 1992-09-21 1995-11-28 Sony Corporation Sound constituting apparatus
JP2004271566A (en) * 2003-03-05 2004-09-30 Yohei Akazawa Player
CN103258529A (en) * 2013-04-16 2013-08-21 初绍军 Performance method of electronic musical instrument and music
CN104834642A (en) * 2014-02-11 2015-08-12 北京三星通信技术研究有限公司 Method, apparatus and device for changing music performance style
CN109791740A (en) * 2016-10-11 2019-05-21 森兰信息科技(上海)有限公司 Intelligent measurement and feedback system for intelligent piano
CN107067879A (en) * 2017-04-07 2017-08-18 济宁学院 A kind of intelligent Piano Teaching system
CN108986777A (en) * 2018-06-14 2018-12-11 森兰信息科技(上海)有限公司 Method, somatosensory device and the musical instrument terminal of music simulation are carried out by body-sensing

Also Published As

Publication number Publication date
CN113223483A (en) 2021-08-06

Similar Documents

Publication Publication Date Title
JP6807924B2 (en) Equipment for reed instruments
US6647359B1 (en) System and method for synthesizing music by scanning real or simulated vibrating object
EP2946479B1 (en) Synthesizer with bi-directional transmission
KR20170106889A (en) Musical instrument with intelligent interface
CN107146598A (en) The intelligent performance system and method for a kind of multitone mixture of colours
WO2000070601A1 (en) Musical instruments that generate notes according to sounds and manually selected scales
Välimäki et al. Commuted waveguide synthesis of the clavichord
US11295715B2 (en) Techniques for controlling the expressive behavior of virtual instruments and related systems and methods
CN110136681A (en) A kind of no string guitar
US6288320B1 (en) Electric musical instrument
Halmrast et al. Gesture and timbre
CN112216260A (en) Electronic erhu system
WO2022213511A1 (en) Music playing method, electronic device, and computer-readable storage medium
CN215007477U (en) Wearable electronic device
CN111091799A (en) Virtual dulcimer system
CN112420006B (en) Method and device for operating simulated musical instrument assembly, storage medium and computer equipment
CN112435644B (en) Audio signal output method and device, storage medium and computer equipment
Taylor Sounds of music
Nichols II The vbow: An expressive musical controller haptic human-computer interface
JP2003500700A (en) Voice-controlled electronic musical instruments
US20240273981A1 (en) Tactile signal generation device, tactile signal generation method, and program
WO2018102593A1 (en) Transduction of electronic signals into magnetic fields and soundwaves
Rosati et al. Play with Sound: Manual for Electronic Musicians and Other Sound Explorers
Knight-Hill The Nature of Sound and Recording
RU2140102C1 (en) Electronic musical instrument kubyz (wargan)

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21935731

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21935731

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21935731

Country of ref document: EP

Kind code of ref document: A1