[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN112149498A - An online intelligent identification system and method for abnormal noise of complex automobile parts - Google Patents

An online intelligent identification system and method for abnormal noise of complex automobile parts Download PDF

Info

Publication number
CN112149498A
CN112149498A CN202010811107.XA CN202010811107A CN112149498A CN 112149498 A CN112149498 A CN 112149498A CN 202010811107 A CN202010811107 A CN 202010811107A CN 112149498 A CN112149498 A CN 112149498A
Authority
CN
China
Prior art keywords
abnormal noise
abnormal
signal
fbank
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202010811107.XA
Other languages
Chinese (zh)
Other versions
CN112149498B (en
Inventor
陈严
王若平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu University
Original Assignee
Jiangsu University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu University filed Critical Jiangsu University
Priority to CN202010811107.XA priority Critical patent/CN112149498B/en
Publication of CN112149498A publication Critical patent/CN112149498A/en
Application granted granted Critical
Publication of CN112149498B publication Critical patent/CN112149498B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/12Classification; Matching
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M17/00Testing of vehicles
    • G01M17/007Wheeled or endless-tracked vehicles
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • G06F18/241Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • G06N3/084Backpropagation, e.g. using gradient descent
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/08Feature extraction

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Measurement Of Mechanical Vibrations Or Ultrasonic Waves (AREA)

Abstract

本发明公开一种面向汽车复杂部件异响的在线智能识别系统及方法,涉及信号处理与模式识别技术领域。本发明根据用户使用汽车过程中一些异响问题的反馈,有针对性地于样车实验环境下采集异响信号,并经过分类人工标注,整理入库,存储于云端服务器;测试人员根据指导于移动智能设备下载相应软件,采集待识别异响信号,经过前处理与分析,通过无线网络或移动数据网络上传至云端服务器,再交由训练好的深度学习模型实现异响的在线智能识别。本发明解决了汽车复杂部件异响台架试验繁琐、人工听音不一致、识别结果不准确等问题,实现了简单、高效识别汽车复杂部件的异响。

Figure 202010811107

The invention discloses an on-line intelligent identification system and method for abnormal noise of complex automobile components, and relates to the technical field of signal processing and pattern identification. According to the feedback of some abnormal noise problems in the process of using the car, the invention collects the abnormal noise signal in the experimental environment of the prototype car in a targeted manner, and manually marks it through classification, arranges it into the warehouse, and stores it in the cloud server; The mobile smart device downloads the corresponding software, collects the abnormal noise signal to be identified, and after pre-processing and analysis, uploads it to the cloud server through the wireless network or mobile data network, and then passes it to the trained deep learning model to realize the online intelligent identification of abnormal noise. The invention solves the problems of cumbersome bench test of abnormal sound of complex parts of automobiles, inconsistent artificial listening, inaccurate identification results, etc., and realizes simple and efficient identification of abnormal sounds of complex parts of automobiles.

Figure 202010811107

Description

一种面向汽车复杂部件异响的在线智能识别系统及方法An online intelligent identification system and method for abnormal noise of complex automobile parts

技术领域technical field

本发明涉及信号处理与模式识别技术领域,尤其涉及一种面向汽车复杂部件异响的在线智能识别系统及方法。The invention relates to the technical field of signal processing and pattern recognition, in particular to an online intelligent recognition system and method for abnormal noise of complex parts of automobiles.

背景技术Background technique

声品质是传统汽车与新能源车辆的关键性能之一,异响则是影响整车声品质的决定性因素。异响控制水平体现了整车厂在汽车设计、加工、装配等方面的综合能力,逐渐成为影响消费者购买决定和使用满意度的关键因素之一。Sound quality is one of the key performances of traditional cars and new energy vehicles, and abnormal noise is a decisive factor affecting the sound quality of the entire vehicle. Abnormal noise control level reflects the comprehensive capabilities of vehicle manufacturers in vehicle design, processing, and assembly, and has gradually become one of the key factors affecting consumers' purchasing decisions and user satisfaction.

自主品牌及合资品牌汽车异响问题突出,投诉量居高不下。异响问题严重影响用户的驾乘体验,同时某些异响问题是汽车故障的前奏,不及时发现,会带来安全隐患。The problem of abnormal noise of self-owned brand and joint venture brand cars is prominent, and the number of complaints remains high. Abnormal noise problems seriously affect the user's driving experience. At the same time, some abnormal noise problems are the prelude to car failures. If they are not detected in time, they will bring security risks.

异响具有问题源头广、随机发生、形成机理复杂、特征不明显的特点,识别难度很大。针对内饰、车身、动力总成、刹车、转向等系统的异响问题,目前主要依靠主观感受及台架测试的方式进行识别诊断,其效率较低且对测试人员经验要求较高。Abnormal noise has the characteristics of wide source of problems, random occurrence, complex formation mechanism, and inconspicuous characteristics, and it is very difficult to identify. For the abnormal noise of the interior, body, powertrain, brake, steering and other systems, the identification and diagnosis mainly rely on subjective feelings and bench testing methods, which are less efficient and require higher experience for testers.

随着数字信号处理、机器学习的快速发展,运用声音识别技术的相关方法实现对汽车异响的自动识别,在现实中具有重要的意义。目前的声音识别方法中,对于特征参数的提取与声学建模仍然以传统的浅层模型居多。常用的浅层模型有隐马尔科夫模型(HiddenMarkov Model,HMM)、高斯混合模型(Gaussian Mixed Model,GMM)、支持向量机(SupportVector Machine,SVM)等,它们对于复杂数据的建模表征能力存在不足,模型训练量大且计算时间较长,识别效果和准确率不佳,无法快速准确地实现异响的在线识别。With the rapid development of digital signal processing and machine learning, it is of great significance in reality to use the related methods of sound recognition technology to realize the automatic recognition of abnormal car noise. In the current sound recognition methods, the extraction of feature parameters and acoustic modeling are still mostly traditional shallow models. Commonly used shallow models include Hidden Markov Model (HMM), Gaussian Mixed Model (GMM), Support Vector Machine (SVM), etc., which have the ability to model and represent complex data. Insufficient, the model training amount is large and the calculation time is long, the recognition effect and accuracy are poor, and the online recognition of abnormal noise cannot be quickly and accurately realized.

发明内容SUMMARY OF THE INVENTION

针对上述存在的问题,本发明提供一种面向汽车复杂部件的在线智能识别系统及方法,解决汽车复杂部件异响台架试验繁琐、人工听音不一致、识别结果不准确等问题,以实现简单、高效识别汽车复杂部件的异响。In view of the above existing problems, the present invention provides an online intelligent identification system and method for complex automobile parts, which solves the problems of cumbersome bench test of abnormal noise of automobile complex parts, inconsistent manual listening, and inaccurate identification results, so as to achieve simple, Efficiently identify the abnormal noise of complex parts of the car.

为实现上述目的,本发明具体技术方案如下:一种面向汽车复杂部件异响的在线智能识别方法,包括如下步骤:In order to achieve the above purpose, the specific technical scheme of the present invention is as follows: an online intelligent identification method for abnormal noise of complex components of automobiles, comprising the following steps:

1)构建汽车复杂部件异响信号样本WT-FBank图谱,并上传至云端服务器。1) Construct the WT-FBank map of abnormal noise signal samples of complex automobile parts and upload them to the cloud server.

2)构建一种基于经典模型LeNet-5架构的卷积神经网络模型CNN。2) Construct a convolutional neural network model CNN based on the classical model LeNet-5 architecture.

3)利用训练模型搭建模块,结合分类器支持向量机SVM,训练异响信号样本WT-FBank图谱,获得训练好的CNN模型与训练好的SVM识别模型。3) Use the training model to build a module, combine with the classifier support vector machine SVM, train the WT-FBank map of the abnormal noise signal sample, and obtain the trained CNN model and the trained SVM recognition model.

4)利用异响采集模块实时采集已启动的待检测车辆异响信号。4) Use the abnormal sound acquisition module to collect the activated abnormal sound signal of the vehicle to be detected in real time.

5)利用前处理与分析模块预处理待检测异响信号,获得待检测异响信号的WT-FBank特征,构建待检测异响信号WT-FBank图谱。5) Using the preprocessing and analysis module to preprocess the abnormal sound signal to be detected, obtain the WT-FBank characteristics of the abnormal sound signal to be detected, and construct a WT-FBank map of the abnormal sound signal to be detected.

6)利用智能识别模块,将检测异响信号WT-FBank图谱输入至训练好的CNN模型提取待检测异响信号的特征,并转化为稀疏低维特征向量,输入至训练好的SVM识别模型进行智能匹配,输出识别类别结果返回至移动智能设备端,并利用自动更新模块,完善数据库。6) Using the intelligent recognition module, input the WT-FBank map of the detected abnormal noise signal into the trained CNN model to extract the characteristics of the abnormal noise signal to be detected, and convert it into a sparse low-dimensional feature vector, and input it into the trained SVM recognition model. Intelligent matching, output recognition category results and return to the mobile smart device, and use the automatic update module to improve the database.

7)判断异响信号检测是否结束,如果未结束,则转步骤4),继续检测新的异响信号并进行识别,否则结束异响信号检测。7) Determine whether the abnormal sound signal detection is over, if not, go to step 4), continue to detect and identify new abnormal sound signals, otherwise end the abnormal sound signal detection.

进一步地,上述步骤1)中所述构建汽车复杂部件异响信号样本WT-FBank图谱,并上传至云端服务器包括如下步骤:Further, constructing the WT-FBank map of the abnormal noise signal sample of complex automobile parts as described in the above step 1) and uploading it to the cloud server includes the following steps:

1.1)利用声音采集设备采集启动状态下汽车复杂部件的异响信号样本。1.1) Use the sound acquisition device to collect the abnormal noise signal samples of the complex parts of the automobile under the starting state.

1.2)对异响信号样本进行人工标注,建立汽车复杂部件异响信号样本库。1.2) Manually label the abnormal noise signal samples, and establish a sample library of abnormal noise signals for complex automobile parts.

1.3)利用前处理与分析模块预处理异响信号样本,即提取异响信号样本的WT-FBank特征,构建异响信号样本WT-FBank图谱,并上传至云端服务器存储。1.3) Use the preprocessing and analysis module to preprocess the abnormal noise signal samples, that is, extract the WT-FBank features of the abnormal noise signal samples, construct the WT-FBank map of the abnormal noise signal samples, and upload them to the cloud server for storage.

进一步地,上述步骤3)中获得训练好的CNN模型与训练好的SVM识别模型,包括如下步骤:Further, in the above-mentioned step 3), the trained CNN model and the trained SVM recognition model are obtained, including the following steps:

3.1)将异响信号样本WT-FBank图谱输入至CNN模型中,得到全局平均池化后的特征。3.1) Input the WT-FBank map of the abnormal noise signal sample into the CNN model to obtain the features after global average pooling.

3.2)将全局平均池化后的特征输入至Softmax函数中,计算输出值与期望值间的误差。3.2) Input the feature after global average pooling into the Softmax function, and calculate the error between the output value and the expected value.

3.3)根据误差,采用反向传播算法,反向逐层更新各层的权重、偏置项参数,直至达到训练误差精度为止,得到训练好的CNN模型。3.3) According to the error, the back propagation algorithm is used to reversely update the weight and bias parameter parameters of each layer layer by layer until the training error accuracy is reached, and the trained CNN model is obtained.

3.4)将汽车复杂部件异响信号样本WT-FBank图谱输入至已训练好的CNN模型进行特征提取,并转化为低维特征向量,输入相应类别标签。3.4) Input the WT-FBank map of abnormal noise signal samples of complex automobile parts into the trained CNN model for feature extraction, convert it into a low-dimensional feature vector, and input the corresponding category label.

3.5)将提取的低维特征向量和对应标签输入至SVM分类器完成训练,得到训练好的SVM识别模型。3.5) Input the extracted low-dimensional feature vector and the corresponding label to the SVM classifier to complete the training, and obtain a trained SVM recognition model.

进一步地,上述步骤1.3)和所述步骤5)中,前处理与分析模块预处理过程包括如下步骤:Further, in above-mentioned step 1.3) and described step 5), the preprocessing and analysis module preprocessing process includes the following steps:

4.1)利用小波阈值降噪和经验模态分解降噪方法对采集模块采集的异响信号进行降噪处理,滤除掉其中不重要的信息以及背景噪声。4.1) Use wavelet threshold noise reduction and empirical mode decomposition noise reduction methods to perform noise reduction processing on the abnormal noise signal collected by the acquisition module, and filter out unimportant information and background noise.

4.2)通过一阶高通滤波器对降噪后的信号进行预加重,补偿信号高频分量在传输过程中的过大衰减。4.2) Pre-emphasize the noise-reduced signal through a first-order high-pass filter to compensate for the excessive attenuation of the high-frequency component of the signal during the transmission process.

4.3)对预加重后的信号加汉明窗分帧成短时信号x(i),帧长为N。4.3) Add a Hamming window to the pre-emphasized signal to form a short-term signal x(i), and the frame length is N.

4.4)将短时信号x(i)进行小波变换,转换为频域信号,并计算其短时能量谱Wi(ω),计算公式如下:4.4) Perform wavelet transform on the short-term signal x(i), convert it into a frequency domain signal, and calculate its short-term energy spectrum W i (ω), the calculation formula is as follows:

Wi(ω)=|Wi(f)|2=|Xi(e)|2,0≤i≤N-1W i (ω)=|W i (f)| 2 =|X i (e )| 2 , 0≤i≤N-1

式中,i是指第i帧,Wi(f)即Xi(e)为经过小波变换后的频域信号,Wi(ω)为短时能量谱。In the formula, i refers to the i -th frame, Wi ( f ) is the frequency domain signal after wavelet transformation, and Wi ( ω) is the short-term energy spectrum.

4.5)使用梅尔滤波器组对所得能量谱Wi(ω)进行滤波处理,并计算滤波器输出的对数能量s(m),即WT-FBank特征,计算公式如下:4.5) Use the Mel filter bank to filter the obtained energy spectrum Wi (ω), and calculate the logarithmic energy s (m) output by the filter, that is, the WT-FBank feature. The calculation formula is as follows:

Figure BDA0002630992150000031
Figure BDA0002630992150000031

式中,s(m)为对数能量,Hm(ω)为梅尔滤波器的频率响应,其中m是指第m个梅尔滤波器。where s(m) is the logarithmic energy, H m (ω) is the frequency response of the mel filter, where m refers to the mth mel filter.

4.6)将各帧WT-FBank特征拼接在一起得到WT-FBank图谱。4.6) Splicing the WT-FBank features of each frame together to obtain the WT-FBank map.

进一步地,本发明还提供一种面向汽车复杂部件异响的在线智能识别系统,包括异响采集模块、前处理与分析模块、数据库构建模块、训练模型搭建模块、智能识别模块、自动更新模块;其中,异响采集模块用于采集启动的问题车辆中待识别异响;前处理与分析模块用于对异响采集模块采集的部件异响信号进行前处理与分析,获得可以表征该部件异响声音的特征图谱;数据库构建模块用于利用异响数据构建汽车复杂部件异响数据库并存储至云端服务器;训练模型搭建模块用于搭建训练模型;智能识别模块用于识别部件异响信号的特征图谱,输出分类结果;自动更新模块定期将新识别出的各种异响数据添加进云端数据库,并重新训练模型,用于数据库扩充。Further, the present invention also provides an online intelligent identification system for abnormal noise of complex automobile components, including an abnormal noise acquisition module, a preprocessing and analysis module, a database construction module, a training model construction module, an intelligent identification module, and an automatic update module; Among them, the abnormal sound acquisition module is used to collect the abnormal sound to be identified in the problem vehicle that is started; the preprocessing and analysis module is used to preprocess and analyze the abnormal sound signal of the component collected by the abnormal sound acquisition module, and obtain a signal that can characterize the abnormal sound of the component. The feature map of the sound; the database building module is used to use the abnormal noise data to build the abnormal noise database of complex parts of the car and store it in the cloud server; the training model building module is used to build the training model; the intelligent recognition module is used to identify the feature map of the abnormal noise signal of the part , and output the classification results; the automatic update module regularly adds the newly identified various abnormal noise data into the cloud database, and retrains the model for database expansion.

与现有技术相比,本发明克服了传统方法台架实验繁琐、过度依赖专家先验知识的不足,简单可行且识别高效;有效提升了识别效果与准确率,更适合于汽车异响的在线识别;本发明提供了借助移动智能设备与云端服务器的系统构建思路,不仅可以为各主机厂与4S店提供异响识别诊断服务,同时也为使用者个人提供检测异响的应用方案,进一步提升传统汽车与新能源车辆的声品质性能。Compared with the prior art, the present invention overcomes the shortcomings of the traditional method that the bench experiment is cumbersome and relies too much on the prior knowledge of experts. The invention provides a system construction idea with the help of mobile smart devices and cloud servers, which can not only provide abnormal noise identification and diagnosis services for various OEMs and 4S stores, but also provide users with an application scheme for detecting abnormal noises, further improving Sound quality performance of traditional and new energy vehicles.

附图说明Description of drawings

图1为本发明的面向汽车复杂部件异响的在线识别系统组成示意图。FIG. 1 is a schematic diagram of the composition of the online identification system for abnormal noise of complex automobile components according to the present invention.

图2为本发明中在线智能识别异响的方法流程图。FIG. 2 is a flow chart of the method for online intelligent identification of abnormal noise in the present invention.

图3为本发明中异响信号WT-FBank特征图谱提取流程图。Fig. 3 is a flow chart of extracting the characteristic map of abnormal noise signal WT-FBank in the present invention.

具体实施方式Detailed ways

以下将结合附图所示的各实施方式对本发明进行详细描述,但这些实施方式并不限制本发明,本领域的普通技术人员根据这些实施方式所做出的结构、方法、或功能上的变换均包含在本发明的保护范围内。The present invention will be described in detail below with reference to the various embodiments shown in the accompanying drawings, but these embodiments do not limit the present invention, and those of ordinary skill in the art can make structural, method, or functional transformations according to these embodiments. All are included in the protection scope of the present invention.

图1所示为本发明的一种面向汽车复杂部件异响的在线智能识别系统的组成示意图,面向汽车复杂部件异响的在线识别系统包括异响采集模块、前处理与分析模块、数据库构建模块、训练模型搭建模块、智能识别模块、自动更新模块。其中:Fig. 1 is a schematic diagram showing the composition of an online intelligent identification system for abnormal noise of complex automobile parts according to the present invention, and the online identification system for abnormal noise of complex automobile parts comprises an abnormal noise acquisition module, a preprocessing and analysis module, and a database construction module , training model building module, intelligent recognition module, automatic update module. in:

异响采集模块,利用移动智能设备(智能手机或平板)外接产品级麦克风,用于采集启动的问题车辆中待识别异响。相对于传统的基于实验室专业数采设备外加高精度声传感器的异响采集设备,手持式的设备操作更为便捷简单,满足采集精度的同时且成本较低,也便于确定异响声源表现明显的位置区域。车辆的异响问题涵盖各个复杂部件,包括主副仪表板、座椅导轨、门窗开闭件、车身附件、底盘和动力传动系统等。Abnormal sound acquisition module, which uses a mobile smart device (smartphone or tablet) to connect a product-level microphone to collect the abnormal sound to be identified in the problem vehicle that is started. Compared with the traditional abnormal sound acquisition equipment based on laboratory professional data acquisition equipment and high-precision acoustic sensors, the hand-held equipment is more convenient and simple to operate. It can meet the acquisition accuracy and cost less, and it is also easy to determine the performance of abnormal sound sources. Obvious location area. The abnormal sound problem of a vehicle covers various complex components, including the main and auxiliary instrument panels, seat rails, door and window openings, body accessories, chassis and power transmission systems.

前处理与分析模块,用于对异响采集模块采集的部件异响信号进行前处理与分析,获得可以表征该部件异响声音的特征图谱。即通过移动智能设备APP对采集到的待识别部件异响信号进行前处理与分析,获得可以表征该部件异响声音的特征图谱,并将图谱显示在移动智能设备屏幕上。The preprocessing and analysis module is used for preprocessing and analyzing the abnormal sound signal of the component collected by the abnormal sound acquisition module to obtain a characteristic map that can characterize the abnormal sound of the component. That is, pre-processing and analyzing the collected abnormal noise signal of the component to be identified through the mobile smart device APP, obtaining a feature map that can characterize the abnormal sound of the component, and displaying the map on the screen of the mobile smart device.

数据库构建模块,用于利用异响数据构建汽车复杂部件异响数据库并存储至云端服务器。即根据用户使用汽车过程中问题的反馈,有针对性地于样车实验环境下采集常见的复杂部件异响信号,并进行分类人工标注,构建汽车复杂部件异响数据库并存储至云端服务器。The database building module is used to use the abnormal noise data to construct the abnormal noise database of complex automobile parts and store it in the cloud server. That is, according to the feedback of the user's problems in the process of using the car, the abnormal noise signals of common complex parts are collected in the prototype vehicle experimental environment in a targeted manner, and classified and manually marked, and the abnormal noise database of complex parts of the car is constructed and stored in the cloud server.

训练模型搭建模块,用于搭建训练模型。即基于深度学习方法训练建立好的异响数据库中的数据,获得训练好的模型,以供待测异响信号输入,从而实现在线识别功能。The training model building module is used to build the training model. That is, the data in the established abnormal noise database is trained based on the deep learning method, and the trained model is obtained for the input of the abnormal noise signal to be measured, so as to realize the online identification function.

智能识别模块,用于识别部件异响信号的特征图谱,输出分类结果。即将前处理与分析后获得的待检测可表征某汽车部件异响特征的图谱,通过无线网络或者移动数据网络上传至云端服务器,输入至训练好的识别模型进行在线智能匹配,输出分类结果返回至移动智能设备APP端。The intelligent identification module is used to identify the feature map of the abnormal noise signal of the component and output the classification result. The spectrum obtained after pre-processing and analysis that can characterize the abnormal noise of a certain auto part is uploaded to the cloud server through the wireless network or mobile data network, input to the trained recognition model for online intelligent matching, and the output classification result is returned to Mobile smart device APP.

自动更新模块,定期将新识别出的各种异响数据添加进云端数据库,并重新训练模型,用于数据库扩充。The module is automatically updated, and the newly identified abnormal noise data is regularly added to the cloud database, and the model is retrained for database expansion.

上述异响采集模块和前处理与分析模块的功能主要借助移动智能设备来实现,数据库构建模块、训练模型搭建模块、智能识别模块和自动更新模块的功能均通过云端服务器来实现。The functions of the above abnormal noise acquisition module and preprocessing and analysis module are mainly realized by mobile smart devices, and the functions of database building module, training model building module, intelligent identification module and automatic update module are all realized by cloud server.

如图2所示,本发明为一种面向汽车复杂部件异响的在线智能识别方法,包括以下步骤:As shown in Figure 2, the present invention is an online intelligent identification method for abnormal noise of complex automobile components, comprising the following steps:

1)构建汽车复杂部件异响信号样本WT-FBank图谱,并上传至云端服务器;作为本发明的优选实施例,包括如下步骤:1) construct the WT-FBank map of the abnormal noise signal sample of complex automobile parts, and upload it to the cloud server; as a preferred embodiment of the present invention, it includes the following steps:

1.1)利用声音采集设备采集启动状态下汽车复杂部件的异响信号样本;1.1) Use the sound acquisition device to collect the abnormal noise signal samples of the complex parts of the automobile under the starting state;

1.2)对异响信号样本进行人工标注,建立汽车复杂部件异响信号样本库;1.2) Manually mark abnormal noise signal samples, and establish a sample library of abnormal noise signals for complex automobile parts;

本发明具体实施例中,给采集的汽车各复杂部件异响信号人工定义标签,采集样本具体包含座椅振动异响、侧门饰板异响、车窗密封条异响、空调出风口异响、主副仪表盘异响、车身附件异响,将上述样本依次分别定义数字标签1—6,不同的数字标签代表不同的异响类型。In the specific embodiment of the present invention, labels are manually defined for the collected abnormal noise signals of various complex parts of the automobile, and the collected samples specifically include abnormal noise of seat vibration, abnormal noise of side door trim, abnormal noise of window sealing strip, abnormal noise of air conditioner outlet, For the abnormal noise of the main and auxiliary instrument panels and the abnormal noise of the body accessories, the above samples are respectively defined as digital labels 1-6, and different digital labels represent different types of abnormal noises.

1.3)利用前处理与分析模块预处理异响信号样本,即提取异响信号样本的WT-FBank特征,构建异响信号样本WT-FBank图谱,并上传至云端服务器存储;1.3) Use the preprocessing and analysis module to preprocess the abnormal noise signal samples, that is, extract the WT-FBank features of the abnormal noise signal samples, construct the WT-FBank map of the abnormal noise signal samples, and upload them to the cloud server for storage;

本发明具体实施例中,特征图谱是建立在上述前处理的基础之上,提取的是小波变换(Wavelet Transform,WT)优化改进的FBank(Filter Banks)特征,简称WT-FBank特征。FBank是语音识别领域模拟人耳听觉特性提出的参数,是传统的声学特征参数梅尔频率倒谱系数(Mel Frequency Cepstrum Coefficient,MFCC)计算时剔除离散余弦变换得到的特征,减少了计算量的同时,便于后续识别模型更好地利用该特征相关性,从而达到良好的识别效果。同样的,不同于传统的特征提取建立在快速傅里叶变换的基础之上,快速傅里叶变换过程中时间和频率上的分辨率是保持不变的,不能同时达到最佳效果,无法满足在低频时有较好的频率分辨率,高频时有较好的时间分辨率,而小波变换弥补了上述不足,在时频两域都具有表征局部特性的能力,可充分适应异响信号的时频特点。In the specific embodiment of the present invention, the feature map is established on the basis of the above preprocessing, and the extracted FBank (Filter Banks) feature optimized and improved by the wavelet transform (Wavelet Transform, WT), referred to as the WT-FBank feature. FBank is a parameter proposed in the field of speech recognition to simulate the auditory characteristics of the human ear. It is a traditional acoustic feature parameter, Mel Frequency Cepstrum Coefficient (MFCC), when calculating the features obtained by excluding discrete cosine transform, reducing the amount of calculation. , so that the subsequent recognition model can make better use of the feature correlation, so as to achieve a good recognition effect. Similarly, unlike traditional feature extraction, which is based on fast Fourier transform, the time and frequency resolution in the fast Fourier transform process remains unchanged, and the best results cannot be achieved at the same time. It has better frequency resolution at low frequencies and better time resolution at high frequencies, and wavelet transform makes up for the above shortcomings. It has the ability to represent local characteristics in both time and frequency domains, and can fully adapt to the abnormal noise signal time-frequency characteristics.

如图3所示,作为本发明的优选实施例,提取异响信号WT-FBank特征,构建WT-FBank图谱,包括如下步骤:As shown in Figure 3, as a preferred embodiment of the present invention, extracting the abnormal noise signal WT-FBank features, and constructing a WT-FBank map, includes the following steps:

1.3.1)利用小波阈值降噪和经验模态分解降噪方法对采集模块采集的异响信号进行降噪处理,滤除掉其中不重要的信息以及背景噪声;1.3.1) Use wavelet threshold noise reduction and empirical mode decomposition noise reduction methods to perform noise reduction processing on the abnormal noise signal collected by the acquisition module, and filter out unimportant information and background noise;

1.3.2)通过一阶高通滤波器对降噪后的信号进行预加重,补偿信号高频分量在传输过程中的过大衰减;1.3.2) Pre-emphasize the denoised signal through a first-order high-pass filter to compensate for the excessive attenuation of the high-frequency component of the signal during transmission;

1.3.3)对预加重后的信号加汉明窗分帧成短时信号x(i),帧长为N;1.3.3) Add a Hamming window to the pre-emphasized signal and frame it into a short-term signal x(i), and the frame length is N;

1.3.4)将短时信号x(i)进行小波变换,转换为频域信号,并计算其短时能量谱Wi(ω),计算公式如下:1.3.4) Perform wavelet transform on the short-term signal x(i), convert it into a frequency domain signal, and calculate its short-term energy spectrum W i (ω), the calculation formula is as follows:

Wi(ω)=|Wi(f)|2=|Xi(e)|2,0≤i≤N-1W i (ω)=|W i (f)| 2 =|X i (e )| 2 , 0≤i≤N-1

式中,i是指第i帧,Wi(f)即Xi(e)为经过小波变换后的频域信号,Wi(ω)为短时能量谱;In the formula, i refers to the i-th frame, W i (f), namely X i (e ), is the frequency domain signal after wavelet transformation, and W i (ω) is the short-term energy spectrum;

1.3.5)使用梅尔滤波器组对所得能量谱Wi(ω)进行滤波处理,并计算滤波器输出的对数能量s(m),即WT-FBank特征,计算公式如下:1.3.5) Use the Mel filter bank to filter the obtained energy spectrum W i (ω), and calculate the logarithmic energy s(m) output by the filter, that is, the WT-FBank feature. The calculation formula is as follows:

Figure BDA0002630992150000061
Figure BDA0002630992150000061

式中,s(m)为对数能量,Hm(ω)为梅尔滤波器的频率响应,其中m是指第m个梅尔滤波器(共有M个)。In the formula, s(m) is the logarithmic energy, H m (ω) is the frequency response of the mel filter, where m refers to the mth mel filter (there are M in total).

本发明具体实施例中,采用的滤波器为三角滤波器。梅尔滤波器组是在梅尔频率内将三角滤波器加于滤波器组上而形成,在频率轴上等间隔分配每个三角滤波器的中心频率。In the specific embodiment of the present invention, the filter used is a triangular filter. The mel filter bank is formed by adding triangular filters to the filter bank within the mel frequency, and the center frequency of each triangular filter is distributed at equal intervals on the frequency axis.

1.3.6)将各帧WT-FBank特征拼接在一起得到WT-FBank图谱。1.3.6) Assemble the WT-FBank features of each frame together to obtain the WT-FBank map.

2)构建一种基于经典模型LeNet-5架构的卷积神经网络模型(ConvolutionalNeural Network,CNN)。其中,CNN模型包括:数据输入层、特征提取层与分类输出层。2) Construct a convolutional neural network model (Convolutional Neural Network, CNN) based on the classical model LeNet-5 architecture. Among them, the CNN model includes: data input layer, feature extraction layer and classification output layer.

本发明具体实施例中,数据输入层为WT-FBank图谱经过裁剪得到尺寸为36*36的二维特征图输入;特征提取层由传统的卷积层、激活层和池化层组成,依靠依次循环堆叠结构,前一层输出作为后一层输入,从而构建深层特征提取层,设置卷积层中卷积核大小为3*3,个数为10,卷积窗滑动步长为1,池化操作采用最大池化方式,池化窗大小为2*2,以修正线性单元(ReLU)作为卷积后激活层的激活函数;分类输出层由全连接层和Softmax分类器组合形成,设置模型迭代次数为50,训练精度要求达90%以上。考虑到全连接层结构参数过多、计算量较大,易造成测试耗时过长,不利于实时快速识别,故在此采用一种新的方法:在最后一组特征提取层的卷积层后使用全局平均池化层代替传统的全连接层,即将上一层特征图的像素用平均值来替代,从而得到低维的特征向量。In the specific embodiment of the present invention, the data input layer is the WT-FBank map and is cut to obtain a two-dimensional feature map input with a size of 36*36; Cyclic stacking structure, the output of the previous layer is used as the input of the latter layer, so as to build a deep feature extraction layer, set the size of the convolution kernel in the convolution layer to 3*3, the number to 10, the sliding step size of the convolution window to 1, and the pool The maximum pooling method is used in the operation, and the size of the pooling window is 2*2, and the modified linear unit (ReLU) is used as the activation function of the activation layer after the convolution; the classification output layer is formed by the combination of the fully connected layer and the Softmax classifier, and the model is set. The number of iterations is 50, and the training accuracy is required to be above 90%. Considering that the fully connected layer has too many structural parameters and a large amount of calculation, it is easy to cause the test to take too long, which is not conducive to real-time rapid identification, so a new method is adopted here: the convolution layer of the last set of feature extraction layers Then, the global average pooling layer is used to replace the traditional fully connected layer, that is, the pixels of the feature map of the previous layer are replaced by the average value, so as to obtain a low-dimensional feature vector.

3)利用训练模型搭建模块,结合分类器支持向量机SVM,训练异响信号样本WT-FBank图谱,依次获得训练好的CNN模型与训练好的SVM识别模型。作为本发明的优选实施例,包括如下步骤:3) Use the training model to build a module, combine the classifier support vector machine SVM, train the WT-FBank map of the abnormal noise signal sample, and obtain the trained CNN model and the trained SVM recognition model in turn. As a preferred embodiment of the present invention, it includes the following steps:

3.1)将构建好的异响信号样本WT-FBank图谱输入至所述CNN模型中,得到全局平均池化后的特征;3.1) Input the constructed abnormal noise signal sample WT-FBank map into the CNN model to obtain the features after global average pooling;

3.2)将全局平均池化后的特征输入至Softmax函数中,计算输出值与期望值间的误差。3.2) Input the feature after global average pooling into the Softmax function, and calculate the error between the output value and the expected value.

在一种可实现的方式中,选用交叉熵函数作为误差代价函数,计算公式如下:In an achievable way, the cross entropy function is selected as the error cost function, and the calculation formula is as follows:

Figure BDA0002630992150000071
Figure BDA0002630992150000071

式中,n为训练样本数量,t为训练模型输出值,y为期望值,E为期望值与输出值误差。In the formula, n is the number of training samples, t is the output value of the training model, y is the expected value, and E is the error between the expected value and the output value.

3.3)根据误差,采用反向传播算法,反向逐层更新各层的权重、偏置项参数,要求达到计算误差最小的目的,且等到训练误差精度或迭代步数满足预设目标时停止训练。此时,将保存模型优化改进过的参数,获得已训练好的CNN模型。3.3) According to the error, the back propagation algorithm is used to reversely update the weight and bias parameter parameters of each layer layer by layer, so as to achieve the purpose of minimizing the calculation error, and stop training when the training error accuracy or the number of iteration steps meet the preset target. . At this point, the parameters optimized and improved by the model will be saved to obtain the trained CNN model.

在一种可实现的方式中,此处采用梯度下降法求解最小误差,计算公式如下:In an achievable way, the gradient descent method is used to solve the minimum error, and the calculation formula is as follows:

Figure BDA0002630992150000072
Figure BDA0002630992150000072

Figure BDA0002630992150000073
Figure BDA0002630992150000073

式中,ω′、b′分别为更新后权重、偏置项参数,ω、b分别为当前网络权重、偏置项参数,ε为当前网络学习速率参数。In the formula, ω′ and b′ are the updated weight and bias item parameters, respectively, ω and b are the current network weight and bias item parameters, respectively, and ε is the current network learning rate parameter.

3.4)将汽车复杂部件异响信号样本WT-FBank图谱输入至已训练好的CNN模型进行特征提取,并转化为低维特征向量,输入相应类别标签。3.4) Input the WT-FBank map of abnormal noise signal samples of complex automobile parts into the trained CNN model for feature extraction, convert it into a low-dimensional feature vector, and input the corresponding category label.

3.5)将提取的低维特征向量和对应标签输入至SVM分类器完成训练,得到最终训练好的SVM识别模型。3.5) Input the extracted low-dimensional feature vector and the corresponding label to the SVM classifier to complete the training, and obtain the final trained SVM recognition model.

4)利用异响采集模块实时采集已启动的待检测车辆异响信号。本发明具体实施例中,异响采集模块由智能手持设备外接麦克风构成。4) Use the abnormal sound acquisition module to collect the activated abnormal sound signal of the vehicle to be detected in real time. In the specific embodiment of the present invention, the abnormal noise collection module is formed by an external microphone of the intelligent handheld device.

5)利用前处理与分析模块预处理待检测异响信号,即获得待检测车辆异响信号WT-FBank特征,构建待检测车辆异响信号WT-FBank图谱;5) Using the preprocessing and analysis module to preprocess the abnormal noise signal to be detected, that is, to obtain the WT-FBank feature of the abnormal noise signal of the vehicle to be detected, and construct the WT-FBank map of the abnormal noise signal of the vehicle to be detected;

6)利用智能识别模块,将检测异响信号WT-FBank图谱输入至训练好的CNN模型提取待检测异响信号的特征,并转化为稀疏低维特征向量,输入至训练好的SVM识别模型进行智能匹配,输出识别类别结果返回至移动智能设备端,最后利用自动更新模块,不断完善数据库;6) Using the intelligent recognition module, input the WT-FBank map of the detected abnormal noise signal into the trained CNN model to extract the characteristics of the abnormal noise signal to be detected, and convert it into a sparse low-dimensional feature vector, and input it into the trained SVM recognition model. Intelligent matching, output the recognition category results and return them to the mobile smart device, and finally use the automatic update module to continuously improve the database;

7)判断异响信号检测是否结束,如果未结束,则继续步骤4),检测新的异响信号并进行识别,否则结束异响信号检测。7) Determine whether the abnormal sound signal detection is over, if not, proceed to step 4), detect and identify a new abnormal sound signal, otherwise end the abnormal sound signal detection.

不同于传统的CNN,改进的CNN算法模型中设计了全局平均池化层代替了传统CNN中全连接层部分,极大地减少了模型训练参数量和计算时间。然后在全局均值池化层之后再并行连接Softmax层和SVM分类器,用于最终的识别分类结果输出。将CNN强大的深层特征提取和数据挖掘能力与SVM针对有限样本良好的泛化能力优势互补结合,使得提出的方法更适合于汽车异响的在线识别。Different from the traditional CNN, the global average pooling layer is designed in the improved CNN algorithm model to replace the fully connected layer in the traditional CNN, which greatly reduces the amount of model training parameters and computing time. Then, after the global mean pooling layer, the Softmax layer and the SVM classifier are connected in parallel for the final recognition and classification result output. Combining the powerful deep feature extraction and data mining capabilities of CNN and the good generalization ability of SVM for limited samples, the proposed method is more suitable for online identification of abnormal car noises.

Claims (5)

1.一种面向汽车复杂部件异响的在线智能识别方法,其特征在于,包括如下步骤:1. an on-line intelligent identification method for abnormal noise of complex parts of automobiles, is characterized in that, comprises the steps: 1)构建汽车复杂部件异响信号样本WT-FBank图谱,并上传至云端服务器;1) Build the WT-FBank map of abnormal noise signal samples of complex automobile parts and upload them to the cloud server; 2)构建一种基于经典模型LeNet-5架构的卷积神经网络模型CNN;2) Construct a convolutional neural network model CNN based on the classic model LeNet-5 architecture; 3)利用训练模型搭建模块,结合分类器支持向量机SVM,训练异响信号样本WT-FBank图谱,获得训练好的CNN模型与训练好的SVM识别模型;3) Use the training model to build a module, combine the classifier support vector machine SVM, train the WT-FBank map of the abnormal noise signal sample, and obtain the trained CNN model and the trained SVM recognition model; 4)利用异响采集模块实时采集已启动的待检测车辆异响信号;4) Use the abnormal sound acquisition module to collect the activated abnormal sound signal of the vehicle to be detected in real time; 5)利用前处理与分析模块预处理待检测异响信号,获得待检测异响信号的WT-FBank特征,构建待检测异响信号WT-FBank图谱;5) Using the preprocessing and analysis module to preprocess the abnormal sound signal to be detected, obtain the WT-FBank characteristics of the abnormal sound signal to be detected, and construct the WT-FBank map of the abnormal sound signal to be detected; 6)利用智能识别模块,将检测异响信号WT-FBank图谱输入至训练好的CNN模型提取待检测异响信号的特征,并转化为稀疏低维特征向量,输入至训练好的SVM识别模型进行智能匹配,输出识别类别结果返回至移动智能设备端,并利用自动更新模块,完善数据库;6) Using the intelligent recognition module, input the WT-FBank map of the detected abnormal noise signal into the trained CNN model to extract the characteristics of the abnormal noise signal to be detected, and convert it into a sparse low-dimensional feature vector, and input it into the trained SVM recognition model. Intelligent matching, output recognition category results and return to the mobile smart device, and use the automatic update module to improve the database; 7)判断异响信号检测是否结束,如果未结束,则转步骤4),继续检测新的异响信号并进行识别,否则结束异响信号检测。7) Determine whether the abnormal sound signal detection is over, if not, go to step 4), continue to detect and identify new abnormal sound signals, otherwise end the abnormal sound signal detection. 2.如权利要求1所述的面向汽车复杂部件异响的在线智能识别方法,其特征在于,所述步骤1)中所述构建汽车复杂部件异响信号样本WT-FBank图谱,并上传至云端服务器包括如下步骤:2. The online intelligent identification method for abnormal noise of complex automobile parts as claimed in claim 1, characterized in that, described in the step 1), construct a WT-FBank map of the abnormal noise signal sample of complex automobile parts, and upload it to the cloud The server includes the following steps: 1.1)利用声音采集设备采集启动状态下汽车复杂部件的异响信号样本;1.1) Use the sound acquisition device to collect the abnormal noise signal samples of the complex parts of the automobile under the starting state; 1.2)对异响信号样本进行人工标注,建立汽车复杂部件异响信号样本库;1.2) Manually mark abnormal noise signal samples, and establish a sample library of abnormal noise signals for complex automobile parts; 1.3)利用前处理与分析模块预处理异响信号样本,即提取异响信号样本的WT-FBank特征,构建异响信号样本WT-FBank图谱,并上传至云端服务器存储。1.3) Use the preprocessing and analysis module to preprocess the abnormal noise signal samples, that is, extract the WT-FBank features of the abnormal noise signal samples, construct the WT-FBank map of the abnormal noise signal samples, and upload them to the cloud server for storage. 3.如权利要求1所述的面向汽车复杂部件异响的在线智能识别方法,其特征在于,所述步骤3)中获得训练好的CNN模型与训练好的SVM识别模型,包括如下步骤:3. the online intelligent identification method for abnormal noise of complex automobile parts as claimed in claim 1, is characterized in that, in described step 3), obtain trained CNN model and trained SVM recognition model, comprise the steps: 3.1)将异响信号样本WT-FBank图谱输入至CNN模型中,得到全局平均池化后的特征;3.1) Input the WT-FBank map of the abnormal noise signal sample into the CNN model to obtain the features after global average pooling; 3.2)将全局平均池化后的特征输入至Softmax函数中,计算输出值与期望值间的误差;3.2) Input the feature after global average pooling into the Softmax function, and calculate the error between the output value and the expected value; 3.3)根据误差,采用反向传播算法,反向逐层更新各层的权重、偏置项参数,直至达到训练误差精度为止,得到训练好的CNN模型;3.3) According to the error, the back propagation algorithm is used to reversely update the weight and bias parameter parameters of each layer layer by layer until the training error accuracy is reached, and a trained CNN model is obtained; 3.4)将汽车复杂部件异响信号样本WT-FBank图谱输入至已训练好的CNN模型进行特征提取,并转化为低维特征向量,输入相应类别标签;3.4) Input the WT-FBank map of the abnormal noise signal sample of complex automobile parts into the trained CNN model for feature extraction, convert it into a low-dimensional feature vector, and input the corresponding category label; 3.5)将提取的低维特征向量和对应标签输入至SVM分类器完成训练,得到训练好的SVM识别模型。3.5) Input the extracted low-dimensional feature vector and the corresponding label to the SVM classifier to complete the training, and obtain a trained SVM recognition model. 4.如权利要求1所述的面向汽车复杂部件异响的在线智能识别方法,其特征在于,所述步骤1.3)和所述步骤5)中,前处理与分析模块预处理过程包括如下步骤:4. the online intelligent identification method for abnormal noise of complex automobile parts as claimed in claim 1, is characterized in that, in described step 1.3) and described step 5), pre-processing and analysis module pre-processing process comprises the steps: 4.1)利用小波阈值降噪和经验模态分解降噪方法对采集模块采集的异响信号进行降噪处理,滤除掉其中不重要的信息以及背景噪声;4.1) Use wavelet threshold noise reduction and empirical mode decomposition noise reduction methods to perform noise reduction processing on the abnormal noise signal collected by the acquisition module, and filter out unimportant information and background noise; 4.2)通过一阶高通滤波器对降噪后的信号进行预加重,补偿信号高频分量在传输过程中的过大衰减;4.2) Pre-emphasize the denoised signal through a first-order high-pass filter to compensate for the excessive attenuation of the high-frequency component of the signal during transmission; 4.3)对预加重后的信号加汉明窗分帧成短时信号x(i),帧长为N;4.3) Add a Hamming window to the pre-emphasized signal and frame it into a short-term signal x(i), and the frame length is N; 4.4)将短时信号x(i)进行小波变换,转换为频域信号,并计算其短时能量谱Wi(ω),计算公式如下:4.4) Perform wavelet transform on the short-term signal x(i), convert it into a frequency domain signal, and calculate its short-term energy spectrum W i (ω), the calculation formula is as follows: Wi(ω)=|Wi(f)|2=|Xi(e)|2,0≤i≤N-1W i (ω)=|W i (f)| 2 =|X i (e )| 2 , 0≤i≤N-1 式中,i是指第i帧,Wi(f)即Xi(e)为经过小波变换后的频域信号,Wi(ω)为短时能量谱;In the formula, i refers to the i-th frame, W i (f), namely X i (e ), is the frequency domain signal after wavelet transformation, and W i (ω) is the short-term energy spectrum; 4.5)使用梅尔滤波器组对所得能量谱Wi(ω)进行滤波处理,并计算滤波器输出的对数能量s(m),即WT-FBank特征,计算公式如下:4.5) Use the Mel filter bank to filter the obtained energy spectrum Wi (ω), and calculate the logarithmic energy s (m) output by the filter, that is, the WT-FBank feature. The calculation formula is as follows:
Figure FDA0002630992140000021
Figure FDA0002630992140000021
式中,s(m)为对数能量,Hm(ω)为梅尔滤波器的频率响应,其中m是指第m个梅尔滤波器;where s(m) is the logarithmic energy, H m (ω) is the frequency response of the Mel filter, where m refers to the mth Mel filter; 4.6)将各帧WT-FBank特征拼接在一起得到WT-FBank图谱。4.6) Splicing the WT-FBank features of each frame together to obtain the WT-FBank map.
5.一种面向汽车复杂部件异响的在线智能识别系统,其特征在于,包括异响采集模块、前处理与分析模块、数据库构建模块、训练模型搭建模块、智能识别模块、自动更新模块;所述异响采集模块,用于采集启动的问题车辆中待识别异响;所述前处理与分析模块,用于对异响采集模块采集的部件异响信号进行前处理与分析,获得可以表征该部件异响声音的特征图谱;所述数据库构建模块,用于利用异响数据构建汽车复杂部件异响数据库并存储至云端服务器;所述训练模型搭建模块,用于搭建训练模型;所述智能识别模块,用于识别部件异响信号的特征图谱,输出分类结果;所述自动更新模块,定期将新识别出的各种异响数据添加进云端数据库,并重新训练模型,用于数据库扩充。5. An online intelligent identification system for abnormal noise of complex automobile components, characterized in that it comprises an abnormal noise acquisition module, a preprocessing and analysis module, a database construction module, a training model construction module, an intelligent identification module, and an automatic update module; The abnormal sound acquisition module is used to collect the abnormal sound to be identified in the problem vehicle that is started; the preprocessing and analysis module is used to preprocess and analyze the abnormal sound signal of the component collected by the abnormal sound acquisition module, and obtain a signal that can characterize the abnormal sound. The characteristic map of the abnormal sound of the parts; the database building module is used to construct the abnormal noise database of complex automobile parts by using the abnormal noise data and store it in the cloud server; the training model building module is used to build the training model; the intelligent identification The module is used to identify the feature map of the abnormal noise signal of the component, and output the classification result; the automatic update module regularly adds the newly identified various abnormal noise data into the cloud database, and retrains the model for database expansion.
CN202010811107.XA 2020-08-13 2020-08-13 Online intelligent recognition system and method for abnormal sound of complex part of automobile Active CN112149498B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010811107.XA CN112149498B (en) 2020-08-13 2020-08-13 Online intelligent recognition system and method for abnormal sound of complex part of automobile

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010811107.XA CN112149498B (en) 2020-08-13 2020-08-13 Online intelligent recognition system and method for abnormal sound of complex part of automobile

Publications (2)

Publication Number Publication Date
CN112149498A true CN112149498A (en) 2020-12-29
CN112149498B CN112149498B (en) 2024-05-14

Family

ID=73887955

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010811107.XA Active CN112149498B (en) 2020-08-13 2020-08-13 Online intelligent recognition system and method for abnormal sound of complex part of automobile

Country Status (1)

Country Link
CN (1) CN112149498B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112863546A (en) * 2021-01-21 2021-05-28 安徽理工大学 Belt conveyor health analysis method based on audio characteristic decision
CN114065809A (en) * 2021-11-03 2022-02-18 浙江吉利控股集团有限公司 A method, device, electronic device and storage medium for identifying abnormal noise in a passenger car
CN114486289A (en) * 2022-02-14 2022-05-13 重庆金康赛力斯新能源汽车设计院有限公司 A test method, device, storage medium and vehicle-mounted terminal for abnormal sound of a vehicle
CN115512716A (en) * 2021-06-23 2022-12-23 华晨宝马汽车有限公司 Method, device and system for recognizing abnormal sound of vehicle
CN115810365A (en) * 2021-09-16 2023-03-17 成都睿畜电子科技有限公司 Pig health warning method and system based on pig voice
CN115824672A (en) * 2023-01-10 2023-03-21 中国汽车工程研究院股份有限公司 Mute linear load pneumatic control method and system
CN116183241B (en) * 2023-02-15 2023-10-03 杭州腾励传动科技股份有限公司 Method for reducing abnormal sound caused by rapid acceleration of vehicle around 8-shaped vehicle and testing method
CN118335114A (en) * 2024-04-22 2024-07-12 浙江吉利控股集团有限公司 Vehicle abnormal noise identification method and device, vehicle and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109060371A (en) * 2018-07-04 2018-12-21 深圳万发创新进出口贸易有限公司 A kind of auto parts and components abnormal sound detection device
CN109949823A (en) * 2019-01-22 2019-06-28 江苏大学 A method for identifying abnormal noise in vehicle based on DWPT-MFCC and GMM

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109060371A (en) * 2018-07-04 2018-12-21 深圳万发创新进出口贸易有限公司 A kind of auto parts and components abnormal sound detection device
CN109949823A (en) * 2019-01-22 2019-06-28 江苏大学 A method for identifying abnormal noise in vehicle based on DWPT-MFCC and GMM

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112863546A (en) * 2021-01-21 2021-05-28 安徽理工大学 Belt conveyor health analysis method based on audio characteristic decision
CN115512716A (en) * 2021-06-23 2022-12-23 华晨宝马汽车有限公司 Method, device and system for recognizing abnormal sound of vehicle
CN115810365A (en) * 2021-09-16 2023-03-17 成都睿畜电子科技有限公司 Pig health warning method and system based on pig voice
CN114065809A (en) * 2021-11-03 2022-02-18 浙江吉利控股集团有限公司 A method, device, electronic device and storage medium for identifying abnormal noise in a passenger car
CN114486289A (en) * 2022-02-14 2022-05-13 重庆金康赛力斯新能源汽车设计院有限公司 A test method, device, storage medium and vehicle-mounted terminal for abnormal sound of a vehicle
CN115824672A (en) * 2023-01-10 2023-03-21 中国汽车工程研究院股份有限公司 Mute linear load pneumatic control method and system
CN116183241B (en) * 2023-02-15 2023-10-03 杭州腾励传动科技股份有限公司 Method for reducing abnormal sound caused by rapid acceleration of vehicle around 8-shaped vehicle and testing method
CN118335114A (en) * 2024-04-22 2024-07-12 浙江吉利控股集团有限公司 Vehicle abnormal noise identification method and device, vehicle and storage medium
CN118335114B (en) * 2024-04-22 2025-02-28 浙江吉利控股集团有限公司 Vehicle abnormal noise identification method and device, vehicle and storage medium

Also Published As

Publication number Publication date
CN112149498B (en) 2024-05-14

Similar Documents

Publication Publication Date Title
CN112149498A (en) An online intelligent identification system and method for abnormal noise of complex automobile parts
CN109949823B (en) A method for identifying abnormal noise in vehicle based on DWPT-MFCC and GMM
CN103310789B (en) A kind of sound event recognition method of the parallel model combination based on improving
CN106935248B (en) Voice similarity detection method and device
CN110120218B (en) Recognition method of large vehicles on expressway based on GMM-HMM
CN109243429B (en) Voice modeling method and device
CN112908344B (en) Intelligent bird song recognition method, device, equipment and medium
CN110136745A (en) A car horn recognition method based on convolutional neural network
CN106847293A (en) Facility cultivation sheep stress behavior acoustical signal monitoring method
CN115346514B (en) An audio warning intelligent recognition method for intelligent driving evaluation
CN114155876B (en) Traffic flow identification method and device based on audio signals and storage medium
CN111653289A (en) A kind of playback voice detection method
CN116741148A (en) Voice recognition system based on digital twinning
CN111341319A (en) A method and system for audio scene recognition based on local texture features
CN114187923B (en) Convolutional neural network audio recognition method based on one-dimensional attention mechanism
WO2024140172A1 (en) Sound recognition model training method and apparatus, electronic device, and storage medium
Al-Kaltakchi et al. Thorough evaluation of TIMIT database speaker identification performance under noise with and without the G. 712 type handset
CN103994820B (en) A kind of moving target recognition methods based on micropore diameter microphone array
CN117332293A (en) Truck overload detection method based on sound Mel frequency characteristics
CN117457031A (en) Emotion recognition method based on global acoustic features and local spectrum features of voice
Huang et al. Novel sub-band spectral centroid weighted wavelet packet features with importance-weighted support vector machines for robust speech emotion recognition
Soni et al. Automatic audio event recognition schemes for context-aware audio computing devices
Loh et al. Speech recognition interactive system for vehicle
CN103544953B (en) A kind of acoustic environment recognition methods based on ground unrest minimum statistics measure feature
CN113129926A (en) Voice emotion recognition model training method, voice emotion recognition method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant