[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN107393518B - Intelligent piano temperament identification and automatic adjustment system and method - Google Patents

Intelligent piano temperament identification and automatic adjustment system and method Download PDF

Info

Publication number
CN107393518B
CN107393518B CN201710572825.4A CN201710572825A CN107393518B CN 107393518 B CN107393518 B CN 107393518B CN 201710572825 A CN201710572825 A CN 201710572825A CN 107393518 B CN107393518 B CN 107393518B
Authority
CN
China
Prior art keywords
module
control module
piano
main control
temperament
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201710572825.4A
Other languages
Chinese (zh)
Other versions
CN107393518A (en
Inventor
仇建
蔡业胜
张桦
商吉利
王长横
沈敏儿
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Dianzi University
Original Assignee
Hangzhou Dianzi University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Dianzi University filed Critical Hangzhou Dianzi University
Priority to CN201710572825.4A priority Critical patent/CN107393518B/en
Publication of CN107393518A publication Critical patent/CN107393518A/en
Application granted granted Critical
Publication of CN107393518B publication Critical patent/CN107393518B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/32Constructional details
    • G10H1/34Switch arrangements, e.g. keyboards or mechanical switches specially adapted for electrophonic musical instruments
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10FAUTOMATIC MUSICAL INSTRUMENTS
    • G10F1/00Automatic musical instruments
    • G10F1/02Pianofortes with keyboard
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10FAUTOMATIC MUSICAL INSTRUMENTS
    • G10F5/00Details or accessories
    • G10F5/04Tune barrels, sheets, rollers, spools, or the like
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10FAUTOMATIC MUSICAL INSTRUMENTS
    • G10F5/00Details or accessories
    • G10F5/04Tune barrels, sheets, rollers, spools, or the like
    • G10F5/06Driving or setting of tune barrels, discs, or the like; Winding, rewinding, or guiding of tune sheets or the like
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/0008Associated control or indicating means
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10HELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00Details of electrophonic musical instruments
    • G10H1/02Means for controlling the tone frequencies, e.g. attack or decay; Means for producing special musical effects, e.g. vibratos or glissandos

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

本发明公开了一种智能钢琴音律识别和自动调整系统及方法。本发明中的手机移动端通过WIFI模块连接主控制模块,将MIDI音乐文件传入主控制模块并启动工作,主控制模块将受到的MIDI文件进行解析并且包装成音符数据包,通过CAN总线模块将音符数据包对应分发到分控微处理器模块,分控制模块在其引脚形成对应的PWM波形输出到电磁螺线驱动模块,并由电磁螺线驱动模块驱动对应琴键发声,最后由音律传感器模块解析、评价音律质量,再将音律修改建议发回到主控板,重新对MIDI音乐文件的解析和播放进行调整。本发明大大减少了智能钢琴系统开发者的工作量并明显提高了智能钢琴的演奏质量。

Figure 201710572825

The invention discloses a system and method for recognizing and automatically adjusting the temperament of an intelligent piano. In the present invention, the mobile terminal of the mobile phone is connected to the main control module through the WIFI module, and the MIDI music file is transferred to the main control module and starts to work. The note data packets are distributed to the sub-control microprocessor module, and the sub-control module forms the corresponding PWM waveform on its pins and outputs it to the electromagnetic spiral driver module, and the electromagnetic spiral driver module drives the corresponding piano keys to sound, and finally the temperament sensor module. Analyze and evaluate the temperament quality, and then send the temperament modification suggestions back to the main control board to re-adjust the analysis and playback of MIDI music files. The invention greatly reduces the workload of the intelligent piano system developer and obviously improves the playing quality of the intelligent piano.

Figure 201710572825

Description

Intelligent piano temperament identification and automatic adjustment system and method
Technical Field
The invention relates to the field of intelligent control of musical instruments, in particular to an intelligent piano temperament identification and automatic adjustment system and method.
Background
With the wide application and continuous progress of digital communication technology and computer technology, computer music is popularized in the music field, and some instruments for automatically playing musical instruments such as an intelligent piano playing system are born while the requirements of people on music are met. The piano automatic playing system is characterized in that intelligent computer electronic equipment is installed on a traditional hand-playing piano, and the intelligent electronic equipment can perfectly control the piano to automatically play songs. The appearance of the automatic piano playing system combines high and new technology, and plays an important role in the propagation of the whole human social culture and the inheritance of civilization.
The key of the automatic piano playing system is to convert the MIDI music file into the mechanical sound production process of the electromagnetic drive impacting keys through analysis and translation. The traditional piano playing process has very high requirements on the playing level, playing rhythm and dynamics accuracy of a player, and is also the same as the intelligent piano automatic playing system. The duration and intensity of a MIDI single note musical event are accurately represented by mechanical impact sounding, which requires a lot of human resources to constantly measure and calibrate. And for different pianos, slight friction among the wood boards connected with the keys and different humidity factors caused by the geographical positions of the pianos, the playing effect of the whole system can be influenced. Therefore, how to reduce the massive and heavy tuning and calibration work of the intelligent piano automatic playing system in the development process becomes the key point of attention in the manufacture of intelligent musical instruments.
Disclosure of Invention
The invention aims to provide an intelligent piano temperament identification and automatic adjustment system.
The invention enables the preliminarily developed intelligent piano automatic playing system to have the capability of self-adjusting and optimizing the temperament effect by dynamically and quantitatively comparing the collected intelligent piano playing audio with the played standard audio, greatly reduces the temperament calibration work of a piano automatic playing system developer in the system development process, and also replaces a manual adjustment mode mainly based on empirical judgment and estimation by an accurate quantitative and dynamic adjustment mode.
The technical solution for realizing the purpose of the invention is as follows:
the utility model provides an intelligence piano temperament discernment and automatic adjustment system, includes removal end application module, main control module, branch control module, electromagnetism spiral drive module, power module and the temperament sensor module, WIFI module, the CAN bus module of being connected respectively with this main control module, and all parts are integrated integrative, connect to set up in the piano central point and put, wherein:
the mobile terminal application template issues an instruction to the main control module through a WIFI protocol, and receives, stores and displays the running condition information of the intelligent piano system in real time.
And the main control template waits for receiving the instruction of the mobile terminal through a WIFI protocol, analyzes the format of the MIDI music file, and is responsible for sending the voice recognition feedback information to the subordinate sub-control modules.
The sub-control modules receive the instructions of the main control panel, cooperatively control 88 keys among the modules, and have the capabilities of real-time parallel processing, dynamic force output, storage and play of evaluation feedback information and indirect processing of temperament feedback information;
the electromagnetic spiral module is connected with the sub-control module pins and drives the magnets at the bottoms of the piano keys after being electrified to impact the keys to enable the piano to produce sound.
The power supply module comprises a 36V rechargeable battery arranged inside the piano and supplies power to the whole piano control system.
The melody sensor module captures sound data in the environment, samples, quantifies and analyzes the data, and feeds back the obtained analysis data to the main control module.
And the WIFI module is used for wireless communication between the mobile terminal and the main control module and forwarding the intelligent piano condition information.
And the CAN bus module is used for the area communication between the main control module and the sub-control module and is responsible for information transmission and interaction between the intelligent piano system boards.
Furthermore, the main control module adopts an i.MX287ARM industrial control board, takes an ARM9 inner core as a processor core, has the highest main frequency of 454MHz, is provided with a DDR2 and a NAND Flash memory, and has very low power consumption. The main control module is connected with the mobile terminal application module through WIFI, connected with the sub-control module through the CAN bus module and connected with the computer through the serial port output module.
Furthermore, the branch control module adopts an STM32 microprocessor which is low in power consumption, strong in performance and easy to develop, is connected with the main control module through the CAN bus module, is connected with the electromagnetic spiral module through a lead wire, and has real-time parallel processing capacity, dynamic force output capacity, storage and play evaluation feedback information capacity and indirect processing temperament feedback information capacity, and the branch control module is concretely as follows:
(1) real-time parallel processing capability: each sub-control module is responsible for controlling twelve keys, and a thread is created for the generation of the PWM waveform of each key, so that different keys cannot be blocked mutually. The CAN bus module of the microprocessor has an automatic awakening function for receiving the synchronous interval characters, and the processor CAN awaken a corresponding process when receiving the data frame.
(2) Dynamic force output capacity: data information of the changing force is also integrated into communication protocols of the main control module and the sub-control modules, and the sub-control modules can accurately control the force to change step by matching with the timer modules after receiving specific instructions.
(3) And (3) storing and playing evaluation feedback information capacity: the microprocessor is provided with a Flash memory chip of a permanent memory medium, can quickly and permanently store the data received immediately and store the data in combination with historical data.
(4) And (3) indirectly processing the rhythm feedback information: and receiving the range feedback information of the temperament sensor module, adjusting the playing pitch intensity of the corresponding musical notes by changing the corresponding PWM waveforms and frequency according to the requirements of the protocol data frames, and adjusting the playing pitch length of the corresponding musical notes by adjusting the pressing and playing time of the corresponding musical notes.
Further, the temperament sensor module comprises 2 parts, specifically:
(1) the digital microphone is used as a temperament perception module for receiving the musical instrument sound, and the temperament perception module is connected with the temperament identification module and is responsible for converting the temperament collected in the environment into discrete and processable audio data and then delivering the discrete and processable audio data to the temperament identification module for processing.
(2) The high-performance computer is used as a temperament identification module for calculating the piano sound, the temperament identification module is connected with the temperament perception module and is connected with the main control module through the CAN bus module, and is responsible for receiving the discrete audio data transmitted by the temperament perception module, and performing denoising and sound processing, time domain analysis, frequency domain analysis, characteristic processing and temperament identification on the discrete audio data, so that the audio data CAN better embody the essence of sound, and then the audio data of the pitch, the duration and the intensity of the collected piano sound is obtained. Finally, the audio feedback modification suggestion is formed according to the result of dynamic comparison by dynamically comparing the audio feedback modification suggestion with the ideal audio data pre-judged in the MIDI music file and is processed by the main control module.
An intelligent piano temperament identification and automatic adjustment method comprises the following steps:
step 1, firstly, initializing a mobile terminal application module, a main control module, a sub-control module, an electromagnetic spiral driving module, a power supply module, a melody sensor module and a CAN bus module.
Step 2, creating a standard piano MIDI file to be played through an audio playing device, and recording an audio database y obtained by an audio sensor module1Carrying out denoising and sound-changing processing, time domain analysis, frequency domain analysis, characteristic processing and temperament identification on the audio database to obtain a temperament evaluation standard database y2As audio evaluation and feedback comparison standard.
And 3, starting the WIFI module, sending an automatic temperament adjustment starting instruction to the main control module by the mobile terminal application, and displaying the system running state sent back by the main control module in real time through the user interface.
And 4, the MIDI music file is analyzed by the main control module and then broadcast to the CAN bus module, the sub-control module receives the data stream and generates PWM waveforms in real time, and the sub-control module controls the electromagnetic solenoid module to drive the keys to sound.
And 5, acquiring discrete audio data by the tone law identification module, and performing denoising and sound-changing processing, time domain analysis, frequency domain analysis, characteristic processing and tone law identification on the discrete audio data to obtain the audio data of the pitch, the duration and the intensity of the measured musical instrument sound. Finally, the sound rhythm evaluation standard database y is passed2Comparing the ideal audio data, forming an audio feedback modification suggestion according to the result of the dynamic comparison, and sending the audio feedback modification suggestion to the main control module for processing, wherein the main control module sends the playing modification suggestion to the main control moduleAnd the sub-control module is used for adjusting the length and the intensity of the keys with the appointed pitch.
And 6, repeating the operations of the step 4 and the step 5 on 88 key objects of the piano in sequence until the intelligent piano playing effect is adjusted to the standard sound effect. In order to prevent the packet loss during the transmission, the packet is transmitted again after the specified time interval t 2.
Further, the micro control module in step 1 initializes the mobile terminal application module, the main control module, the sub control module, the electromagnetic solenoid drive module, and the power supply module, wherein the temperament sensor module and the CAN bus module are in a temporary sleep state to wait for a wake-up command.
Further, in step 3, a temperament evaluation standard database y is obtained according to the temperament sensor module2The method comprises the following steps:
the rhythm sensing module is used for sensing the audio database y1The method comprises the steps of playing a monophonic note music event, sampling to obtain discrete audio data, delivering the discrete audio data to a sound rate identification module, and performing sound frequency extraction on the monophonic note music event by the sound rate identification module by using a wavelet analysis method to determine the pitch attribute of the monophonic note music event, namely determine which note the monophonic note music event belongs to. And measuring the duration of the vibration waveform of the monophonic event to determine the duration attribute of the monophonic event. And finally, carrying out Fourier transform on the collected data, and calculating the decibel value of the monophonic note event, namely determining the sound intensity attribute of the monophonic note event.
The pitch rate identification module stores the obtained attributes of the notes, the duration and the intensity in a temperament evaluation standard database y2As a standard for comparative evaluation in step 5.
Further, the necessity and the process of the rhythm identification module for automatically adjusting the rhythm in step 5 are as follows:
(1) the necessity: the sound production principle of the intelligent piano playing system is that MIDI music files are finally converted into mechanical sound production processes of electromagnetic drive impacting keys through analysis and translation. In the whole conversion process, the mechanical impact is required to produce sound to accurately represent the duration and the intensity of a MIDI single note music event, and a large amount of human resources are required to continuously measure and calibrate. Meanwhile, the MIDI music file has 127-grade different playing dynamics, and each playing dynamics corresponds to a series of variable factors which possibly influence the playing effect, so that the intelligent piano system with the automatic temperament adjusting system is very necessary and feasible. And the set of system is also applicable to automatic playing systems of all musical instruments.
(2) The process is as follows: the audio information of the real playing of the intelligent piano is collected, and the audio identification module is put in for analysis. The data obtained by identification and the tone law evaluation standard database y2For comparison. And finally, the sub-control module performs repeated and repeated PWM waveform adjustment to optimize the tone intensity attribute, the specific playing time delay or reduction is performed to optimize the tone length attribute, and finally, the optimization of the process of converting the whole MIDI music file into the real playing process of the intelligent piano is completed.
The invention has the beneficial effects that:
(1) the problems that the efficiency of the tone rhythm calibration process is too low and human resources are consumed too much in the development process of the existing intelligent piano automatic playing system are solved.
(2) And a manual regulation mode mainly based on empirical judgment and estimation is replaced by a quantitative and dynamic tone law calibration mode.
(3) The mobile application terminal is used as a system console, so that the user use experience of the system is optimized.
Drawings
Fig. 1 is a system configuration diagram of a multiple intelligent piano temperament identification and automatic adjustment system of the present invention.
Fig. 2 is a flow chart of the work of the intelligent piano temperament identification and automatic adjustment system of the invention.
Detailed Description
The invention is further described below with reference to the accompanying drawings.
Combine fig. 1, an intelligence piano temperament discernment and automatic adjustment system, including removing end application module, main control module, branch control module, electromagnetism spiral drive module, power module and the temperament sensor module who is connected respectively with this main control module, WIFI module, CAN bus module, all parts are integrated integrative, connect to set up in the piano central point and put, wherein:
the mobile terminal application template issues an instruction to the main control module through a WIFI protocol, and receives, stores and displays the running condition information of the intelligent piano system in real time.
And the main control template waits for receiving the instruction of the mobile terminal through a WIFI protocol, analyzes the format of the MIDI music file, and is responsible for sending the voice recognition feedback information to the subordinate sub-control modules.
The sub-control modules receive the instructions of the main control panel, cooperatively control 88 keys among the modules, and have the capabilities of real-time parallel processing, dynamic force output, storage and play of evaluation feedback information and indirect processing of temperament feedback information.
The electromagnetic spiral module is connected with the sub-control module pins and drives the magnets at the bottoms of the piano keys after being electrified to impact the keys to enable the piano to produce sound.
The power supply module comprises a 36V rechargeable battery arranged inside the piano and supplies power to the whole piano control system.
The melody sensor module captures sound data in the environment, samples, quantifies and analyzes the data, and feeds back the obtained analysis data to the main control module.
And the WIFI module is used for wireless communication between the mobile terminal and the main control module and forwarding the intelligent piano condition information.
And the CAN bus module is used for the area communication between the main control module and the sub-control module and is responsible for information transmission and interaction between the intelligent piano system boards.
As a specific example, the main control module adopts an i.MX287ARM industrial control board, an ARM9 inner core is taken as a processor core, the main frequency can reach 454MHz at most, and the main control module is provided with a DDR2 and a NAND Flash memory and has very low power consumption. The main control module is connected with the mobile terminal application module through WIFI, connected with the sub-control module through the CAN bus module and connected with the computer through the serial port output module.
As a specific example, the sub-control module adopts an STM32 microprocessor which is low in power consumption, strong in performance and easy to develop, is connected with the main control module through the CAN bus module, and is connected with the electromagnetic solenoid module through a lead, and has real-time parallel processing capability, dynamic force output capability, capability of storing and playing evaluation feedback information, and capability of indirectly processing temperament feedback information, and the specific examples are as follows:
(1) real-time parallel processing capability: each sub-control module is responsible for controlling twelve keys, and a thread is created for the generation of the PWM waveform of each key, so that different keys cannot be blocked mutually. The CAN bus module of the microprocessor has an automatic awakening function for receiving the synchronous interval characters, and the processor CAN awaken a corresponding process when receiving the data frame.
(2) Dynamic force output capacity: data information of the changing force is also integrated into communication protocols of the main control module and the sub-control modules, and the sub-control modules can accurately control the force to change step by matching with the timer modules after receiving specific instructions.
(3) And (3) storing and playing evaluation feedback information capacity: the microprocessor is provided with a Flash memory chip of a permanent memory medium, can quickly and permanently store the data received immediately and store the data in combination with historical data.
(4) And (3) indirectly processing the rhythm feedback information: and receiving the range feedback information of the temperament sensor module, adjusting the playing pitch intensity of the corresponding musical notes by changing the corresponding PWM waveforms and frequency according to the requirements of the protocol data frames, and adjusting the playing pitch length of the corresponding musical notes by adjusting the pressing and playing time of the corresponding musical notes.
As a specific example, the temperament sensor module includes 2 parts, specifically:
1) the digital microphone STMicroelectronics MP45DT02 is used as a temperament perception module for receiving the musical instrument sound, and the temperament perception module is connected with the temperament identification module and is responsible for converting the temperament collected in the environment into discrete and processable audio data and then delivering the discrete and processable audio data to the temperament identification module for processing.
2) The high-performance computer is used as a temperament identification module for calculating the piano sound, the temperament identification module is connected with the temperament perception module and is connected with the main control module through the CAN bus module, and is responsible for receiving the discrete audio data transmitted by the temperament perception module, and performing denoising and sound processing, time domain analysis, frequency domain analysis, characteristic processing and temperament identification on the discrete audio data, so that the audio data CAN better embody the essence of sound, and then the audio data of the pitch, the duration and the intensity of the collected piano sound is obtained. Finally, the audio feedback modification suggestion is formed according to the result of dynamic comparison by dynamically comparing the audio feedback modification suggestion with the ideal audio data pre-judged in the MIDI music file and is processed by the main control module.
With reference to fig. 2, the intelligent piano temperament identification and automatic adjustment method of the invention comprises the following steps:
step 1, firstly, initializing a mobile terminal application module, a main control module, a sub-control module, an electromagnetic spiral driving module, a power supply module, a melody sensor module and a CAN bus module.
Step 2, creating a standard piano MIDI file to be played through an audio playing device, and recording an audio database y obtained by an audio sensor module1Carrying out denoising and sound-changing processing, time domain analysis, frequency domain analysis, characteristic processing and temperament identification on the audio database to obtain a temperament evaluation standard database y2As audio evaluation and feedback comparison standard.
And 3, starting the WIFI module, sending an automatic temperament adjustment starting instruction to the main control module by the mobile terminal application, and displaying the system running state sent back by the main control module in real time through the user interface.
And 4, combining a play protocol data format table, broadcasting the MIDI music file to the CAN bus module after the MIDI music file is analyzed by the main control module, receiving data streams by the sub-control modules, generating PWM waveforms in real time, and controlling the electromagnetic solenoid module to drive the keys to sound.
Play protocol data format table
Protocol header Message type Keyboard number Original force Force of ending Duration of time Time delay
1 byte 1 byte 1 byte 1 byte 1 byte 1 byte 1 byte
And 5, identifying a feedback protocol data format table by combining the temperament. And the tone law identification module acquires discrete audio data, and performs denoising processing, time domain analysis, frequency domain analysis, characteristic processing and tone law identification on the discrete audio data to obtain the audio data of the pitch, the duration and the intensity of the measured musical instrument sound. Finally, the sound rhythm evaluation standard database y is passed2Comparing the idealized audio data to form audio based on the results of the dynamic comparisonThe modification suggestions are fed back and processed by the main control module, the main control module sends the playing modification suggestions to the sub-control modules, and the sub-control modules adjust the length and the intensity of the keys with the appointed pitch.
Data format table of voice rhythm identification feedback protocol
Protocol header Control code Phonetic symbol code Data segment length Data segment
And 6, repeating the operations of the step 4 and the step 5 on 88 key objects of the piano in sequence until the intelligent piano playing effect is adjusted to the standard sound effect. In order to prevent the packet loss during the transmission, the packet is transmitted again after the specified time interval t 2.

Claims (6)

1.一种智能钢琴音律识别和自动调整系统,包括移动端应用模块、主控制模块、分控制模块、电磁螺线驱动模块、电源模块以及与该主控制模块分别连接的音律传感器模块、WIFI模块、CAN总线模块,所有部件集成一体,连接设置于钢琴中心位置,其特征在于:1. An intelligent piano temperament recognition and automatic adjustment system, comprising a mobile terminal application module, a main control module, a sub-control module, an electromagnetic spiral drive module, a power supply module, and a temperament sensor module and a WIFI module respectively connected to the main control module. , CAN bus module, all components are integrated, and the connection is set at the center of the piano, which is characterized by: 所述移动端应用模块,通过WIFI协议给主控制模块下发指令,并实时接受、存储、显示智能钢琴系统运行状况信息;The mobile terminal application module sends instructions to the main control module through the WIFI protocol, and accepts, stores and displays the operating status information of the intelligent piano system in real time; 所述主控制模块,通过WIFI协议等待接受移动端指令,对MIDI音乐文件进行格式解析,并负责将声音识别反馈信息发放到下级分控制模块;The main control module waits to accept the mobile terminal command through the WIFI protocol, performs format analysis on the MIDI music file, and is responsible for issuing the voice recognition feedback information to the lower-level sub-control module; 所述分控制模块,多个分控制模块接受主控制板指令,模块间协作控制八十八个琴键,具有实时并行处理能力、动态力度输出能力、存储播放评价反馈信息、间接处理音律反馈信息的能力;In the sub-control module, multiple sub-control modules accept the instructions of the main control board, and the modules cooperate to control eighty-eight piano keys. ability; 所述电磁螺线驱动模块,与分控制模块引脚相连,通电后驱动钢琴按键底部的磁铁,撞击琴键使钢琴发声;The electromagnetic helical drive module is connected with the pins of the sub-control module, and drives the magnets at the bottom of the piano keys after being energized, and hits the keys to make the piano sound; 所述电源模块,包含设置在钢琴内部的36V可充电电池,对整个钢琴控制系统进行供电;The power supply module includes a 36V rechargeable battery arranged inside the piano to supply power to the entire piano control system; 所述音律传感器模块,在环境中捕捉声音数据,对数据进行采样、量化、分析,将得到的分析数据反馈给主控制模块;The rhythm sensor module captures sound data in the environment, samples, quantifies and analyzes the data, and feeds back the obtained analysis data to the main control module; 所述WIFI模块,用于移动端与主控制模块的无线通讯,并对智能钢琴状况信息进行转发;The WIFI module is used for wireless communication between the mobile terminal and the main control module, and forwards the status information of the smart piano; 所述CAN总线模块,用于主控制模块与分控制模块的区域通信,负责智能钢琴系统板间信息传递和交互;The CAN bus module is used for the regional communication between the main control module and the sub-control module, and is responsible for information transfer and interaction between the intelligent piano system boards; 所述音律传感器模块包括两个部分,具体为:The temperament sensor module includes two parts, specifically: (1)利用数字麦克风作为接受琴声的音律感知模块,所述音律感知模块与音律识别模块相连,负责将环境中采集到的音律转为离散、可处理的音频数据再交由音律识别模块处理;(1) The digital microphone is used as the rhythm perception module that receives the sound of the piano. The rhythm perception module is connected to the rhythm recognition module, and is responsible for converting the rhythm collected in the environment into discrete and processable audio data, which is then processed by the rhythm recognition module. ; (2)所述音律识别模块负责接受音律感知模块传来的离散音频数据,并对离散音频数据进行去噪声化处理、时域分析、频域分析、特征处理、音律识别,使音频数据更能体现出声音的本质;得到采集后琴声的音高、音长、音强的音频数据;通过与MIDI音乐文件中预判断的理想化音频数据做动态比较,根据动态比较的结果形成音频反馈修改建议并交由主控制模块处理;(2) The rhythm recognition module is responsible for receiving the discrete audio data from the rhythm perception module, and performs denoising processing, time domain analysis, frequency domain analysis, feature processing, and rhythm recognition on the discrete audio data, so that the audio data can be more Reflect the essence of the sound; obtain the audio data of the pitch, length, and intensity of the collected piano sound; make a dynamic comparison with the idealized audio data pre-judged in the MIDI music file, and form an audio feedback modification according to the result of the dynamic comparison Suggested and handed over to the main control module for processing; 所述分控制模块采用STM32微处理器,通过CAN总线模块与主控制模块相连,通过引线与电磁螺线驱动模块相连,具有实时并行处理能力、动态力度输出能力、存储播放评价反馈信息能力、间接处理音律反馈信息能力,具体如下:The sub-control module adopts STM32 microprocessor, is connected with the main control module through the CAN bus module, and is connected with the electromagnetic spiral drive module through the lead wire, and has real-time parallel processing capability, dynamic force output capability, storage and playback evaluation feedback information capability, indirect The ability to process temperament feedback information, as follows: (1)实时并行处理能力:每个分控制模块负责控制十二个琴键,为每一个琴键的PWM波形产生创建一个线程,使得不同琴键之间不会互相阻塞;STM32微处理器的CAN总线模块具有接收到同步间隔字符的自动唤醒功能,接受到数据帧时处理器就会唤醒相应进程;(1) Real-time parallel processing capability: each sub-control module is responsible for controlling twelve keys, creating a thread for the PWM waveform generation of each key, so that different keys will not block each other; the CAN bus module of the STM32 microprocessor It has the function of automatic wake-up after receiving the synchronization interval character, and the processor will wake up the corresponding process when the data frame is received; (2)动态力度输出能力:在主控制模块和分控制模块的通信协议中还融入了变化力度的数据信息,分控制模块接受到指令后配合其定时器模块准确地控制力度逐级改变;(2) Dynamic force output capability: The data information of changing force is also integrated into the communication protocol between the main control module and the sub-control module. After receiving the instruction, the sub-control module cooperates with its timer module to accurately control the force to change step by step; (3)存储播放评价反馈信息能力:微处理器配有永久性存储介质Flash存储芯片,能将即时接受到的数据快速、永久地存储下来,并且结合历史数据进行存储;(3) Ability to store and play evaluation feedback information: The microprocessor is equipped with a permanent storage medium Flash memory chip, which can quickly and permanently store the immediately received data, and store it in combination with historical data; (4)间接处理音律反馈信息能力:接受到音律传感器模块的音域反馈信息,根据协议数据帧要求,通过改变对应的PWM波形和频率来调整对应音符弹奏音强,通过调整对应音符按下、弹起时间来调整对应音符弹奏音长。(4) Ability to indirectly process temperament feedback information: After receiving the pitch range feedback information from the temperament sensor module, according to the requirements of the protocol data frame, adjust the sound intensity of the corresponding note by changing the corresponding PWM waveform and frequency. Play the time to adjust the playing length of the corresponding note. 2.根据权利要求1所述的智能钢琴音律识别和自动调整系统,其特征在于,所述主控制模块采用i.MX287ARM工控板,基于ARM9内心为处理器核心;该主控制模块通过WIFI与移动端应用模块相连,通过CAN总线模块与分控制模块相连,通过串口输出模块与计算机相连。2. intelligent piano rhythm recognition and automatic adjustment system according to claim 1, is characterized in that, described main control module adopts i.MX287ARM industrial control board, is processor core based on ARM9 inner heart; This main control module passes WIFI and mobile The terminal application module is connected to the sub-control module through the CAN bus module, and the computer is connected through the serial port output module. 3.一种智能钢琴音律识别和自动调整方法,利用权利要求1所述的系统,其特征在于,包括如下步骤:3. a kind of intelligent piano rhythm identification and automatic adjustment method, utilizes the system described in claim 1, is characterized in that, comprises the steps: 步骤1,首先将移动端应用模块、主控制模块、分控制模块、电磁螺线驱动模块、电源模块、音律传感器模块、CAN总线模块进行初始化;Step 1, first initialize the mobile terminal application module, the main control module, the sub-control module, the electromagnetic spiral drive module, the power supply module, the rhythm sensor module, and the CAN bus module; 步骤2,创建标准钢琴MIDI文件,通过音频播放设备播放;音频传感器模块录制得到音频数据库y1、将音频数据库进行去噪声化处理、时域分析、频域分析、特征处理、音律识别后得到音律评价标准数据库y2作为音频评价、反馈比较标准;Step 2, create a standard piano MIDI file, and play it through an audio playback device; the audio sensor module records and obtains the audio database y 1 , and the audio database is subjected to denoising processing, time domain analysis, frequency domain analysis, feature processing, and temperament identification to obtain the temperament The evaluation standard database y 2 is used as a comparison standard for audio evaluation and feedback; 步骤3,启动WIFI模块,移动端应用向主控制模块发出自动音律调整开始指令,并通过用户界面实时显示主控制模块发回的系统运行状况;Step 3, start the WIFI module, the mobile terminal application sends an automatic pitch adjustment start instruction to the main control module, and displays the system operating status sent back by the main control module in real time through the user interface; 步骤4,MIDI音乐文件经过主控制模块解析后广播到CAN总线模块,由分控制模块接受数据流并实时产生PWM波形,控制电磁螺线驱动模块驱动琴键发声;Step 4, the MIDI music file is broadcasted to the CAN bus module after being parsed by the main control module, and the sub-control module accepts the data stream and generates a PWM waveform in real time, and controls the electromagnetic helical drive module to drive the piano keys to sound; 步骤5,音律识别模块采集离散音频数据,并对离散音频数据进行去噪声化处理、时域分析、频域分析、特征处理、音律识别,得到被测琴声的音高、音长、音强的音频数据;通过与音律评价标准数据库y2的理想化音频数据做比较,根据动态比较的结果形成音频反馈修改建议并交由主控制模块处理,主控制模块将播放修改建议发往分控制模块,由分控制模块对指定音高的琴键进行音长、音强的调整;Step 5: The rhythm recognition module collects discrete audio data, and performs denoising processing, time domain analysis, frequency domain analysis, feature processing, and rhythm recognition on the discrete audio data to obtain the pitch, length, and intensity of the measured piano sound. By comparing with the idealized audio data of the temperament evaluation standard database y 2 , the audio feedback modification suggestion is formed according to the result of the dynamic comparison and handed over to the main control module for processing, and the main control module sends the playback modification suggestion to the sub-control module. , the sub-control module adjusts the length and intensity of the keys of the specified pitch; 步骤6,依次对钢琴的八十八个琴键对象重复步骤4、步骤5的操作,直至将智能钢琴弹奏效果调整至标准音效果。Step 6: Repeat the operations of Step 4 and Step 5 for the eighty-eight key objects of the piano in turn, until the playing effect of the intelligent piano is adjusted to the standard sound effect. 4.根据权利要求3所述的方法,其特征在于,步骤1首先将移动端应用模块、主控制模块、分控制模块、电磁螺线驱动模块、电源模块进行初始化,其中音律传感器模块、CAN总线模块处于暂时休眠状态等待唤醒指令。4. method according to claim 3, is characterized in that, step 1 first initializes mobile terminal application module, main control module, sub-control module, electromagnetic spiral drive module, power supply module, wherein rhythm sensor module, CAN bus The module is in a temporary sleep state waiting for a wake-up command. 5.根据权利要求3所述的方法,其特征在于,步骤2根据音律传感器模块得到音律评价标准数据库y2,具体如下:5. method according to claim 3, is characterized in that, step 2 obtains pitch evaluation standard database y 2 according to pitch sensor module, is specifically as follows: 音律感知模块对音频数据库y1播放单音乐事件进行采样以得到离散音频数据,并将离散音频数据交由音律识别模块,再由音律识别模块利用小波分析法对单音符音乐事件进行声音频率提取,以确定单音乐事件的音高属性,即确定单音乐事件属于哪个音符;再通过对单音符事件的振动波形延续时间进行测量,即确定单音符事件的音长属性;最后对采集到的数据进行傅里叶变换,计算出单音符事件的分贝值,即确定单音符事件的音强属性;The rhythm perception module samples the audio database y1 playing a single music event to obtain discrete audio data, and passes the discrete audio data to the rhythm recognition module, and then the rhythm recognition module utilizes the wavelet analysis method to extract the sound frequency of the single-note music event, To determine the pitch attribute of the single-note event, that is, to determine which note the single-note event belongs to; then by measuring the duration of the vibration waveform of the single-note event, that is, to determine the pitch attribute of the single-note event; Fourier transform, calculate the decibel value of the single-note event, that is, determine the sound intensity attribute of the single-note event; 音律识别模块将得到的音符、音长、音强属性存入音律评价标准数据库y2作为步骤5比较评价的标准。The temperament identification module stores the obtained attributes of note, length and intensity in the temperament evaluation standard database y 2 as the standard for comparison evaluation in step 5 . 6.根据权利要求3所述的方法,其特征在于,步骤5所述音律识别模块对音律进行自动调整过程具体如下:通过采集智能钢琴真实弹奏的音频信息,并且放入音律识别模块进行解析,将识别得到的数据与音律评价标准数据库y2作比较,最后由分控制模块进行反复、多次的PWM波形调整来优化音强属性,通过具体的播放延时或者缩减来优化音长属性,最后完成对整个MIDI音乐文件转为智能钢琴真实播放过程的优化。6. method according to claim 3, is characterized in that, the described temperament identification module of step 5 carries out automatic adjustment process to pitch and is specifically as follows: by collecting the audio information that intelligent piano really plays, and put into pitch identification module and analyze , compare the identified data with the temperament evaluation standard database y 2 , and finally the sub-control module performs repeated and multiple PWM waveform adjustments to optimize the sound intensity attribute, and optimize the sound length attribute through specific playback delay or reduction, Finally, the optimization of the entire MIDI music file to the real playback process of the smart piano is completed.
CN201710572825.4A 2017-07-14 2017-07-14 Intelligent piano temperament identification and automatic adjustment system and method Active CN107393518B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710572825.4A CN107393518B (en) 2017-07-14 2017-07-14 Intelligent piano temperament identification and automatic adjustment system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710572825.4A CN107393518B (en) 2017-07-14 2017-07-14 Intelligent piano temperament identification and automatic adjustment system and method

Publications (2)

Publication Number Publication Date
CN107393518A CN107393518A (en) 2017-11-24
CN107393518B true CN107393518B (en) 2021-03-02

Family

ID=60339634

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710572825.4A Active CN107393518B (en) 2017-07-14 2017-07-14 Intelligent piano temperament identification and automatic adjustment system and method

Country Status (1)

Country Link
CN (1) CN107393518B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110827788B (en) * 2019-12-02 2023-04-18 北京博声音元科技有限公司 Music playing simulation method and device
CN113642869A (en) * 2021-07-29 2021-11-12 北京金三惠科技有限公司 Electric piano management method and system based on MIDI interaction
CN115297108B (en) * 2022-08-11 2023-08-25 青岛美迪康数字工程有限公司 Diagnosis and treatment quality control file transmission method and device based on piano syllables

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9601101B1 (en) * 2015-09-08 2017-03-21 The Florida International University Board Of Trustees Frequency calibration for audio synthesizers

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201336131Y (en) * 2008-12-05 2009-10-28 复旦大学附属中学 Automatic tuner for piano
CN101807391A (en) * 2010-02-09 2010-08-18 李忠孝 Piano automatic tone tuning device and automatic tone tuning method thereof
CN102982792A (en) * 2011-09-07 2013-03-20 杜惠红 Method using mobile phone to tune musical instrument and device using mobile phone to tune musical instrument
CN103903597A (en) * 2014-03-22 2014-07-02 哈尔滨工程大学 Piano electronic tuning method based on machine vision and device
CN106504767A (en) * 2016-10-12 2017-03-15 耿梁宸 Musical instrument tuning and song pitch determination methods by sound waveform
CN106448634A (en) * 2016-11-17 2017-02-22 安徽克洛斯威智能乐器科技有限公司 Intelligent voice piano system capable of prompting key position and tuning tone

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9601101B1 (en) * 2015-09-08 2017-03-21 The Florida International University Board Of Trustees Frequency calibration for audio synthesizers

Also Published As

Publication number Publication date
CN107393518A (en) 2017-11-24

Similar Documents

Publication Publication Date Title
CN101853650B (en) Music processing and output system and method thereof
CN104395953B (en) The assessment of bat, chord and strong beat from music audio signal
CN107393518B (en) Intelligent piano temperament identification and automatic adjustment system and method
WO2019232928A1 (en) Musical model training method, music creation method, devices, terminal and storage medium
CN101667422B (en) Method and device for adjusting mode of song accompaniment
CN103823867A (en) Humming type music retrieval method and system based on note modeling
CN104123938A (en) Voice control system, electronic device and voice control method
CN102723079B (en) Music and chord automatic identification method based on sparse representation
JP2016136251A (en) Automatic transcription of musical content and real-time musical accompaniment
US20230402047A1 (en) Audio processing method and apparatus, electronic device, and computer-readable storage medium
CN104992712A (en) Music reorganization-based music score automatic formation method
CN112992109B (en) Auxiliary singing system, auxiliary singing method and non-transient computer readable recording medium
CN110516102B (en) Lyric time stamp generation method based on spectrogram recognition
CN107103912A (en) A kind of student for imparting knowledge to students and checking and rating sings performance points-scoring system
CN105469669A (en) Auxiliary teaching device for sing
CN201611570U (en) Audio evaluating device
CN101093660B (en) A note segmentation method and device based on double peak detection
CN109410972B (en) Method, device and storage medium for generating sound effect parameters
CN111402919B (en) Method for identifying style of playing cavity based on multi-scale and multi-view
US20080189105A1 (en) Apparatus And Method For Automatically Indicating Time in Text File
CN111259188A (en) Lyric alignment method and system based on seq2seq network
CN110853457A (en) Interactive music teaching guidance method
CN113571030B (en) MIDI music correction method and device based on hearing harmony evaluation
CN201196877Y (en) Acoustic control type household sound equipment
CN112270929B (en) Song identification method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant