CN116705069B

CN116705069B - Audio detection method, chip, component on traffic equipment and traffic equipment

Info

Publication number: CN116705069B
Application number: CN202310952105.6A
Authority: CN
Inventors: 邵毅
Original assignee: Beijing Xinchi Semiconductor Technology Co ltd
Current assignee: Beijing Xinchi Semiconductor Technology Co ltd
Priority date: 2023-07-31
Filing date: 2023-07-31
Publication date: 2023-11-10
Anticipated expiration: 2043-07-31
Also published as: CN116705069A

Abstract

The application provides an audio detection method, a chip, a component on traffic equipment and the traffic equipment, which are applied to a hardware domain on a multi-core heterogeneous system, wherein the hardware domain at least comprises an audio player, an IP core to be detected, a reference IP core and a processor core, and the method comprises the following steps: the audio player sends an audio stream to be detected, which comprises at least two sound channels, to the processor core through the IP core to be detected and the reference IP core, and the audio stream to be detected is generated by the audio generator and is input to the audio player through the audio generator; the audio player sends the audio parameters corresponding to the audio streams to be tested of each channel to the processor core, and the audio parameters corresponding to the audio streams to be tested of any two channels are different; for each channel, the processor core judges whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel, and a matching result is obtained; the processor core determines whether an error occurs after the audio to be tested of the channel is processed by the IP core to be tested based on the matching result.

Description

Audio detection method, chip, component on traffic equipment and traffic equipment

Technical Field

The present application relates to audio data processing technology, and in particular, to an audio detection method, a chip, a component on a traffic device, and a traffic device.

Background

The audio stream on the traffic equipment sometimes has a dislocation of sound channels in the playing process, such as the audio stream needing to be played in the left loudspeaker is played in the right loudspeaker, the audio stream needing to be played in the subwoofer is played in the tweeter, and the like. The dislocation of the sound channel can cause sound channel change during recording, or can cause that audio cannot be picked up during recording, or can cause that the electronic equipment performs voice recognition and the like, thereby affecting the performance of the electronic equipment. Therefore, how to efficiently detect whether an error occurs in an audio stream on an electronic device is a problem to be solved in the field of audio data processing.

Disclosure of Invention

The embodiment of the application provides an audio detection method, a chip, a component on traffic equipment and the traffic equipment, which can be used for efficiently detecting whether an audio stream on the traffic equipment is wrong or not.

The technical scheme of the embodiment of the application is realized as follows:

in a first aspect, an embodiment of the present application provides an audio detection method, where the method is applied to a hardware domain on a multi-core heterogeneous system, where the hardware domain includes at least an audio player, an IP core to be detected, a reference IP core, and a processor core, and the method includes:

the audio player sends an audio stream to be detected, which comprises at least two sound channels, to the processor core through the IP core to be detected and the reference IP core, wherein the audio stream to be detected is generated by an audio generator and is input to the audio player by the audio generator;

The audio player sends the audio parameters corresponding to the audio streams to be tested of each channel to the processor core, and the audio parameters corresponding to the audio streams to be tested of any two channels are different;

for each channel, the processor core judges whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel, and a matching result is obtained;

and the processor core determines whether an error occurs after the audio to be tested of the channel flows through the IP core to be tested for processing based on the matching result.

In some alternative embodiments, the audio player sends an audio stream under test including at least two channels to the processor core via the IP core under test and the reference IP core, including:

the audio player sends an audio stream to be tested comprising at least two channels to the IP core to be tested;

the IP core to be tested processes the audio stream to be tested to obtain waveform data corresponding to the audio stream to be tested respectively, and the waveform data is sent to the reference IP core;

the reference IP checks the waveform data to process the waveform data, obtains the audio streams to be tested of all channels corresponding to the waveform data, and sends the audio streams to be tested of all channels to the processor core.

the audio player sends an audio stream to be tested comprising at least two channels to the reference IP core;

the reference IP checks the audio stream to be detected to obtain waveform data corresponding to the audio stream to be detected, and sends the waveform data to the IP core to be detected;

and the IP to be tested checks the waveform data to process the waveform data, so as to obtain the audio streams to be tested of all channels corresponding to the waveform data, and the audio streams to be tested of all channels are sent to the processor core.

In some optional embodiments, the processor core determining whether an error occurs after the audio under test of the channel is processed by the IP under test core based on the matching result includes:

responding to the matching result to represent that the audio stream to be detected of the channel is matched with the audio parameter corresponding to the channel, and determining that no error occurs after the audio stream to be detected corresponding to the channel is processed by the IP core to be detected;

and responding to the matching result to represent that the audio stream to be detected of the channel is not matched with the audio parameters corresponding to the channel, and determining that the audio stream to be detected corresponding to the channel is processed by the IP core to be detected and then is in error.

In some optional embodiments, the processor core determining whether the received audio stream to be measured of the channel matches the audio parameter corresponding to the channel includes:

for the audio stream to be measured of each channel, the audio parameters include at least: loudness and frequency;

the processor core judges whether the difference between the loudness corresponding to the received audio stream to be detected and the loudness included by the audio parameters is smaller than a loudness threshold value;

the processor core judges whether the difference between the frequency corresponding to the received audio stream to be detected and the frequency included by the audio parameter is smaller than a frequency threshold value;

if the difference between the loudness corresponding to the received audio stream to be detected and the loudness included in the audio parameter is smaller than a loudness threshold value, and the difference between the frequency corresponding to the received audio stream to be detected and the frequency included in the audio parameter is smaller than a frequency threshold value, the processor core judges that the received audio stream to be detected is matched with the audio parameter;

otherwise, the processor core judges that the received audio stream to be detected is not matched with the audio parameters.

In some optional embodiments, if the audio to be tested of any channel is processed by the IP core to be tested and then an error occurs, the method further includes:

The processor core sends audio error warning information; and/or the processor core records an audio error log.

In some alternative embodiments, the audio stream under test generated by the audio generator comprises any one of: an overloaded audio stream, an underloaded audio stream, and a normally played audio stream.

In some alternative embodiments, the IP core to be tested and the reference IP core are in a full duplex mode of operation;

or the IP core to be tested and the reference IP core are in a half-duplex working mode.

In some alternative embodiments, the method further comprises: the processor core configures working parameters of the IP core to be tested for the audio stream to be tested;

wherein the operating parameters include at least one of a sampling rate, a channel format, and an operating mode.

In a second aspect, an embodiment of the present application provides a chip, where the chip includes an audio player, an IP core to be tested, a reference IP core, and a processor core;

the audio player is used for sending an audio to be detected, which comprises at least two sound channels, to the processor core through the IP core to be detected and the reference IP core; transmitting audio parameters corresponding to the audio streams to be detected of each channel to the processor core, wherein the audio parameters corresponding to the audio streams to be detected of any two channels are different; the audio stream to be tested is generated by an audio generator and is input to the audio player by the audio generator;

The processor core is used for judging whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel for each channel to obtain a matching result; and determining whether an error occurs after the audio to be tested of the channel flows through the IP core to be tested and is processed based on the matching result.

The audio player, the IP core to be tested, the reference IP core and the processor core form a hardware domain on the multi-core heterogeneous system.

In a third aspect, an embodiment of the present application provides a component on a traffic device, where the component includes a chip capable of executing the above-mentioned audio detection method.

In a fourth aspect, an embodiment of the present application provides a traffic device, where the traffic device includes a chip capable of executing the above-mentioned audio detection method.

The audio detection method provided by the embodiment of the application comprises the following steps: the audio player sends an audio stream to be detected, which comprises at least two sound channels, to the processor core through the IP core to be detected and the reference IP core, wherein the audio stream to be detected is generated by an audio generator and is input to the audio player by the audio generator; the audio player sends the audio parameters corresponding to the audio streams to be tested of each channel to the processor core, and the audio parameters corresponding to the audio streams to be tested of any two channels are different; for each channel, the processor core judges whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel, and a matching result is obtained; and the processor core determines whether an error occurs after the audio to be tested of the channel flows through the IP core to be tested for processing based on the matching result. Therefore, the embodiment of the application generates the audio streams to be tested with different audio parameters aiming at different channels through the audio generator, and judges whether errors occur after the audio streams to be tested are processed by the IP core to be tested and the reference IP core by using the processor core. The reference IP core is an IP core in a stable and reliable working state, and the audio to be tested cannot generate errors after being processed by the reference IP core; if the processor core judges that the audio to be tested is processed by the IP core to be tested and the reference IP core to be tested, the audio to be tested is necessarily processed by the IP core to be tested and then is wrong. The audio detection method provided by the embodiment of the application can be used for efficiently detecting whether the audio stream on the electronic equipment is wrong or not.

Drawings

FIG. 1 is a schematic diagram of an alternative processing flow of an audio detection method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of another alternative processing flow of the audio detection method according to the embodiment of the present application;

fig. 3 is a schematic diagram of an alternative processing flow of an audio detection method for an audio playing scene according to an embodiment of the present application;

FIG. 4 is a schematic diagram of an alternative processing flow of an audio detection method for a recording scene according to an embodiment of the present application;

FIG. 5 is a schematic diagram of audio generated by an audio generator according to an embodiment of the present application;

fig. 6 is a schematic diagram of a composition structure of a chip according to an embodiment of the present application.

Detailed Description

The present application will be further described in detail with reference to the accompanying drawings, for the purpose of making the objects, technical solutions and advantages of the present application more apparent, and the described embodiments should not be construed as limiting the present application, and all other embodiments obtained by those skilled in the art without making any inventive effort are within the scope of the present application.

In the following description, reference is made to "some embodiments" which describe a subset of all possible embodiments, but it is to be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments and can be combined with one another without conflict.

In the following description, the terms "first", "second", and the like are merely used to distinguish between similar objects and do not represent a particular ordering of the objects, it being understood that the "first", "second", or the like may be interchanged with one another, if permitted, to enable embodiments of the application described herein to be practiced otherwise than as illustrated or described herein.

Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of the application only and is not intended to be limiting of the application.

It should be understood that, in various embodiments of the present application, the size of the sequence number of each implementation process does not mean that the execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

Before describing embodiments of the present application in further detail, the terms and terminology involved in the embodiments of the present application will be described, and the terms and terminology involved in the embodiments of the present application will be used in the following explanation.

1) The IP core is a general term of integrated circuit core with intellectual property core, and is a repeatedly verified integrated circuit design macro module (logic or functional unit) with specific functions, capable of being reused and containing specific core elements (instruction set, functional description, code, etc.) gradually separated in a chip design link, which can be understood as a part of the repeatedly usable "chip design module", such as an integrated circuit built-in audio Bus (Inter-IC Sound, I2S), an S/PDIF digital audio output interface, a DIRECT MEMORY ACCESS (DMA) High-speed Bus (Advanced High-performance Bus, AHB), a peripheral Bus (Advanced Peripheral Bus, APB), an ethernet, a serial peripheral device interface (Serial Peripheral interface, SPI), an integrated circuit Bus (Inter-Integrated Circuit, I2C), a mobile industry processor interface (Mobile Industry Processor Interface, MIPI), a universal serial Bus (Universal Serial Bus, USB), a universal asynchronous Transmitter (Universal Asynchronous Receiver/transceiver, UART) core, etc.

2) An overloaded audio stream, which may also be referred to as an overrun audio stream; when recording an audio stream, if the audio stream data is not read in time, and the audio stream data which is not read in time is not properly stored, overflow occurs, so that the data is lost, and the audio stream which is not read in time is called as an overloaded audio stream.

3) Underloaded audio streams, which may also be referred to as underrun audio streams; when playing the audio stream, if the current audio stream data is already played, the new audio stream data is not written in, and under-load condition can occur at the moment; the audio stream played under the underload condition is referred to as an underloaded audio stream.

4) The multi-core heterogeneous system is a system in which two or more processor cores are integrated in a single chip, and each processor core can be used as an independent processor to independently run instructions stored in a memory corresponding to the processor core.

5) A hardware domain, which is a set of hardware sets, and the hardware sets may include hardware resources such as a processor core, an interrupt controller, a clock controller, and a memory; the number of processor cores in the hardware set may be one or more; one hardware domain runs one operating system, and different hardware domains can run different operating systems.

The embodiment of the application provides an audio detection method, which is applied to a hardware domain on a multi-core heterogeneous system, wherein the hardware domain at least comprises an audio player, an IP core to be detected, a reference IP core and a processor core; an optional processing flow of the audio detection method, as shown in fig. 1, at least includes the following steps:

In step S101, the audio player sends an audio stream to be tested including at least two channels to the processor core via the IP core to be tested and the reference IP core.

In some embodiments, if the audio stream to be tested is an audio stream for playing, the audio player sends the audio stream to be tested including at least two channels to the IP core to be tested through the audio driver, and the audio stream to be tested is sent to the reference IP core after flowing through the IP core to be tested, and the audio stream to be tested is sent to the processor core after flowing through the reference IP core.

In some embodiments, if the audio stream to be measured is an audio stream for recording, the audio player sends the audio stream to be measured including at least two channels to the reference IP core through the audio driver, and the audio stream to be measured is sent to the IP core after flowing through the reference IP core, and the audio stream to be measured is sent to the processor core after flowing through the IP core to be measured.

The IP core to be detected is an IP core which needs to detect whether abnormal functions occur or not; the reference IP core is a normal functioning IP core, and thus, the reference IP core may be a standard IP core.

In some embodiments, the audio stream under test may be generated by an audio generator, and the audio stream under test generated by the audio generator may be collected by an audio player, or the audio stream under test may be sent by the audio generator to the audio player. The audio stream to be measured may be a normally played audio stream, or may be an over run audio stream or an underrun audio stream.

If the audio stream to be tested is an abnormally played audio stream such as an over run audio stream or an underrun audio stream, the embodiment of the application can detect whether the IP core to be tested can normally play the abnormally played audio stream or detect whether the IP core to be tested can recover the abnormally played audio stream to a normal state.

In some embodiments, the audio streams to be measured of at least two channels are multi-channel audio streams to be measured, and the audio parameters corresponding to the audio streams to be measured of any two channels are different. Wherein the audio parameters may include at least: loudness of sound and/or frequency of sound. As an example, if the audio parameters only include the loudness of the sound, the loudness of the sound corresponding to the audio stream to be detected of any two channels is different; if the loudness of the sound corresponding to the audio stream to be measured of the first channel is 20db, and the loudness of the sound corresponding to the audio stream to be measured of the second channel is 25db. If the audio parameters only comprise the frequency of the sound, the frequencies of the sounds corresponding to the audio streams to be detected of any two channels are different; if the frequency of the sound corresponding to the audio stream to be measured of the first channel is 100KHz, the frequency of the sound corresponding to the audio stream to be measured of the second channel is 200KHz. The audio parameters comprise the loudness of the sound and the frequency of the sound, and one or two of the frequency of the sound and the loudness of the sound corresponding to the audio streams to be detected of any two channels are different; if the loudness of sound corresponding to the audio stream to be detected of the first channel is 20db, the frequency of the sound is 100KHz; the loudness of the sound corresponding to the audio stream to be measured of the second channel is 25db, and the frequency of the sound is 200KHz.

Step S102, the audio player sends the audio parameters corresponding to the audio streams to be tested of each channel to the processor core.

In step S101, the audio parameters corresponding to the audio stream to be detected are described, and in the embodiment of the present application, the audio player may send the audio parameters corresponding to the audio stream to be detected of each channel to the processor core, so that the processor core can determine whether an error occurs in the audio stream received by the processor core according to the audio parameters.

Step S103, for each channel, the processor core judges whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel, and a matching result is obtained.

In some embodiments, the processor core determines whether the audio stream to be measured of the first channel matches the audio parameter corresponding to the first channel, and the processor core determines whether the audio stream to be measured of the second channel matches the audio parameter corresponding to the second channel.

In some embodiments, if the audio parameters include only the loudness of the sound, the processor core determines, for each channel, whether the difference between the loudness of the sound corresponding to the received audio stream of the channel and the loudness of the sound sent by the audio player to the processor core is less than a loudness threshold. If the difference of the loudness is smaller than the loudness threshold, the processor core judges that the received audio stream to be detected is matched with the audio parameters sent to the processor core by the audio player; if the difference of the loudness is larger than the loudness threshold, the processor core judges that the received audio stream to be detected is not matched with the audio parameters sent to the processor core by the audio player.

In other embodiments, if the audio parameter includes only the frequency of the sound, the processor core determines, for each channel, whether a difference between the frequency of the sound corresponding to the audio stream of the received channel and the frequency of the sound sent to the processor core by the audio player is less than a frequency threshold. If the difference between the frequencies is smaller than the frequency threshold, the processor core judges that the received audio stream to be detected is matched with the audio parameters sent to the processor core by the audio player. If the difference between the frequencies is greater than the frequency threshold, the processor core judges that the received audio stream to be detected is not matched with the audio parameters sent to the processor core by the audio player.

In still other embodiments, if the audio parameters include the loudness of the sound and the frequency of the sound, for each channel, the processor core needs to determine whether the difference between the loudness of the sound corresponding to the audio stream of the received channel and the loudness of the sound sent to the processor core by the audio player is less than a loudness threshold, and whether the difference between the frequency of the sound corresponding to the audio stream of the received channel and the frequency of the sound sent to the processor core by the audio player is less than a frequency threshold. If the difference of the loudness is smaller than the loudness threshold and the difference of the frequency is smaller than the frequency threshold, the processor core judges that the received audio stream to be detected is matched with the audio parameters sent to the processor core by the audio player. If the difference of the loudness is larger than the loudness threshold value, or the difference of the frequencies is larger than the frequency threshold value, or the difference of the loudness is larger than the loudness threshold value, and the difference of the frequencies is larger than the frequency threshold value, the processor core judges that the received audio stream to be detected is not matched with the audio parameters sent to the processor core by the audio player.

Step S104, the processor core determines whether an error occurs after the audio to be tested of the channel is processed by the IP core to be tested based on the matching result.

In some embodiments, if the matching result obtained in step S103 is that the received audio stream to be tested of the channel is not matched with the audio parameter corresponding to the channel, the processor core determines that the audio stream to be tested of the channel is processed by the IP core to be tested and then an error occurs.

The scene of the channel, in which the audio stream to be tested is processed by the IP core to be tested, may be an error generated when the audio drive performs digital-to-analog conversion processing or analog-to-digital conversion processing on the audio stream to be tested, or an error generated when the IP core to be tested processes the audio stream to be tested.

In other embodiments, if the matching result obtained in step S103 is that the received audio stream to be tested of the channel matches the audio parameter corresponding to the channel, the processor core determines that no error occurs after the audio stream to be tested of the channel is processed by the IP core to be tested.

It should be noted that, in the embodiment of the present application, the processor core may configure the working parameters of the IP core to be tested for the audio stream to be tested; the working parameters at least can comprise one or more of sampling rate, channel format and working mode, and the working parameters can also comprise the working time length of the IP core to be tested.

The channel format may be an I2S format or a TDM format. The operation mode may include an operation of the IP core to be tested or an inoperability of the IP core to be tested. Specifically, if the IP core to be tested works and the reference IP core also works, the IP core to be tested and the reference IP core are in a full duplex working mode; if the IP core to be tested does not work and the reference IP core also works, the IP core to be tested and the reference IP core are in a half-duplex working mode.

In the embodiment of the application, the audio generator can be used for generating the audio streams to be detected with different audio parameters aiming at different channels, and the processor core is used for judging whether errors occur after the audio streams to be detected are processed by the IP core to be detected and the reference IP core. The reference IP core is an IP core in a stable and reliable working state, and the audio to be tested cannot generate errors after being processed by the reference IP core; therefore, if the processor core determines that the audio to be measured is processed by the IP core to be measured and the reference IP core, the audio to be measured is necessarily processed by the IP core to be measured and then is in error. The audio detection method provided by the embodiment of the application can be used for efficiently detecting whether the audio stream on the electronic equipment is wrong or not.

An alternative processing flow of the audio detection method provided by the embodiment of the present application, as shown in fig. 2, at least includes the following steps:

In step S201, the audio player sends an audio stream to be tested including at least two channels to the processor core via the IP core to be tested and the reference IP core.

In step S202, the audio player sends the audio parameters corresponding to the audio stream to be tested of each channel to the processor core.

Step S203, for each channel, the processor core judges whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel, and a matching result is obtained.

In the embodiment of the present application, the description for step S201 to step S203 is the same as the description for step S101 to step S103 in fig. 1.

In step S204, the processor core determines that the audio to be tested of the channel is processed by the IP core to be tested and then has an error based on the matching result.

In some embodiments, if the audio parameters of the audio stream to be measured of any channel after being processed by the IP core to be measured are different from the audio parameters of the audio stream to be measured generated by the audio generator, determining that an error occurs after the audio stream to be measured is processed by the IP core to be measured.

In step S205, the processor core transmits the audio error alert information, and/or the processor core records the audio error log.

In some alternative embodiments, if an error occurs after the audio stream to be tested is processed by the IP core to be tested, the processor core may send the audio error alert information to the display device in the hardware domain, so that the display device displays the audio error alert information. The processor core may also record an audio error log, where channel information corresponding to the audio stream to be tested, error information of the audio stream to be tested, and time when the audio stream to be tested is detected as an error may be recorded in the audio error log. The channel information corresponding to the audio stream to be detected can be a channel corresponding to the audio stream to be detected; the error information of the audio stream to be tested can be that the audio stream to be tested after being processed by the IP core to be tested is different in frequency and/or different in loudness from the audio stream to be tested generated by the audio generator.

An optional processing flow diagram of an audio detection method for an audio playing scene provided by the embodiment of the application is shown in fig. 3, and the audio detection method is applied to a safe driving domain on an intelligent automobile and at least can comprise the following steps:

in step S301, the audio generator generates an audio stream to be measured.

In some alternative embodiments, the audio stream to be tested is an over run audio stream, or an underrun audio stream, or a normally played audio stream.

If the audio stream to be tested is an over run audio stream, the processor core can detect whether the IP core to be tested can work normally when the over run audio stream is played. If the audio stream to be tested is an underun audio stream, the processor core can detect whether the IP core to be tested can work normally when the over run audio stream is played. If the audio stream to be tested is a normal audio stream, the processor core can detect whether the IP core to be tested can work normally when the normal audio stream is played.

Step S302, the audio player collects the audio stream to be tested.

In some embodiments, the audio stream to be measured may be a multi-channel audio stream, and the audio parameters corresponding to the audio streams of each channel are different.

In step S303, the audio player sends the audio parameters of the audio stream to be tested to the processor core.

Step S304, the audio player sends the collected audio stream to be tested to the IP core to be tested through the audio driver.

Step S305, the IP core to be tested processes the audio stream to be tested to obtain waveform data corresponding to the audio stream to be tested, and the waveform data is sent to the reference IP core.

In some embodiments, waveform data corresponding to the audio stream to be tested is Output through a first Input-Output (Input-Output) interface and then Input to the reference IP core through a second IO interface. The waveform data corresponding to the audio stream to be measured includes waveform data of all channels, and as an example, when outputting the waveform data, different time slots may correspond to waveform data of different channels.

Step S306, the waveform data is checked by referring to the IP to obtain the audio streams to be tested of each channel corresponding to the waveform data, and the audio streams to be tested of each channel are sent to the processor core.

In some embodiments, the waveform data may have different formats, and the waveform data may be processed according to the format of the waveform data obtained by the IP core to be tested in step S405. The format of the waveform data may be preset.

Step S307, for each channel, the processor core determines whether the received audio stream to be tested of the channel is matched with the audio parameter corresponding to the channel, so as to obtain a matching result.

In some embodiments, for the first channel, the processor core determines whether the audio stream to be measured of the first channel received by the processor core matches audio parameters of the first channel sent to the processor core by the audio player. Specifically, if the difference between the audio parameter of the audio stream to be detected and the audio parameter of the first channel received by the processor core is smaller than a preset threshold value, the processor core judges that the received audio stream to be detected of the channel is matched with the audio parameter corresponding to the channel.

As an example, the processor core determines whether a difference between a loudness of sound corresponding to an audio stream of the received channel and a loudness of sound sent by the audio player to the processor core is less than a loudness threshold. If the difference of the loudness is smaller than the loudness threshold, the processor core judges that the received audio stream to be detected is matched with the audio parameters sent to the processor core by the audio player; if the difference of the loudness is larger than the loudness threshold, the processor core judges that the received audio stream to be detected is not matched with the audio parameters sent to the processor core by the audio player.

As an example, the processor core determines whether a difference between a frequency of sound corresponding to an audio stream of the received channel and a frequency of sound transmitted to the processor core by the audio player is less than a frequency threshold. If the difference between the frequencies is smaller than the frequency threshold, the processor core judges that the received audio stream to be detected is matched with the audio parameters sent to the processor core by the audio player. If the difference between the frequencies is greater than the frequency threshold, the processor core judges that the received audio stream to be detected is not matched with the audio parameters sent to the processor core by the audio player.

In step S308, the processor core determines whether an error occurs after the audio stream to be tested of the channel is processed by the IP core to be tested based on the matching result.

In some embodiments, if the matching result is not matching, the processor core determines that an error occurs after the audio to be tested of the channel is processed by the IP core to be tested.

The reason why the audio to be tested is in error after being processed by the IP core to be tested can be that the audio driver is in error or that the IP core to be tested is in error.

In some embodiments, if the processor core determines that the audio to be tested has an error after being processed by the IP core to be tested, the processor core sends an audio error alert message, and/or the processor core records an audio error log.

Specifically, the processor core may send an audio error alert message to the display.

An optional processing flow diagram of an audio detection method for a recording scene provided by the embodiment of the application is shown in fig. 4, and the audio detection method is applied to a safe driving domain on an intelligent automobile, and at least comprises the following steps:

in step S401, the audio generator generates an audio stream to be measured.

Step S402, the audio player collects the audio stream to be measured.

In step S403, the audio generator sends audio parameters of the audio stream to be tested to the processor core.

Step S404, the audio player sends the collected audio stream to be tested to the reference IP core.

Step S405, referring to the IP core to check the audio stream to be tested to process, obtaining waveform data corresponding to the audio stream to be tested, and sending the waveform data to the IP core to be tested.

In some embodiments, waveform data corresponding to the audio stream to be tested of each channel is output through the third IO interface and then input to the reference IP core through the fourth IO interface. The waveform data corresponding to the audio stream to be measured includes waveform data of all channels, and as an example, when outputting the waveform data, different time slots may correspond to waveform data of different channels.

Step S406, the IP to be tested checks the waveform data to obtain the audio stream to be tested of each channel corresponding to the waveform data, and sends the audio stream to be tested of each channel to the processor core through the audio driver.

In some embodiments, the waveform data may have different formats, and the IP core to be tested needs to process the waveform data according to the format of the waveform data obtained by referring to the IP core in step S405. The format of the waveform data may be preset.

Step S407, for each channel, the processor core judges whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel, and a matching result is obtained.

In step S408, the processor core determines whether an error occurs after the audio stream to be tested of the channel is processed by the IP core to be tested based on the matching result.

The embodiments shown in fig. 1 to fig. 4 described above take the case that the audio generated by the audio generator is multi-channel audio as an example, and the audio detection method provided by the embodiment of the present application is described. In other embodiments, the audio generated by the audio generator may include sound data for only one channel, not for other channels, or be silence data for other channels. As shown in fig. 5, the audio generated by the audio generator includes four channels, only the first channel includes sound data, and none of the three channels except the first channel includes sound data. With the audio shown in fig. 5, the processor core may detect whether a channel misalignment occurs in the first channel by comparing the audio parameters of the sound data included in the first channel with the audio parameters of the audio stream received by the processor core.

The embodiment of the application also provides a chip, and the composition structure diagram of the chip is shown in fig. 6, and the chip comprises an audio player 601, an IP core to be tested 602, a reference IP core 603 and a processor core 604;

the audio player 601 is configured to send an audio stream to be tested including at least two channels to the processor core 604 via the IP core to be tested 602 and the reference IP core 603; the audio parameters corresponding to the audio streams to be tested of each channel are sent to the processor core 604, and the audio parameters corresponding to the audio streams to be tested of any two channels are different; the audio stream to be tested is generated by an audio generator and input to the audio player 601 by the audio generator;

The processor core 604 is configured to determine, for each channel, whether a received audio stream to be detected of the channel is matched with an audio parameter corresponding to the channel, so as to obtain a matching result; and determining whether an error occurs after the audio to be tested of the channel is processed by the IP core to be tested 602 based on the matching result.

The audio player 601, the IP core to be tested 602, the reference IP core 603 and the processor core 604 form a hardware domain on the multi-core heterogeneous system.

In some alternative embodiments, the audio player 601 is configured to send an audio stream to be tested including at least two channels to the IP core to be tested 602;

the IP core 602 to be tested processes the audio stream to be tested to obtain waveform data corresponding to the audio stream to be tested of each channel, and sends the waveform data to the reference IP core 603;

the reference IP core 603 processes the waveform data to obtain an audio stream to be tested corresponding to the waveform data, and sends the audio stream to be tested to the processor core 604.

In some alternative embodiments, the audio player 601 sends an audio stream under test comprising at least two channels to the reference IP core 603;

The reference IP core 603 processes the audio stream to be tested to obtain waveform data corresponding to the audio stream to be tested of each channel, and sends the waveform data to the IP core 602 to be tested;

the IP core to be tested 602 processes the waveform data to obtain an audio stream to be tested corresponding to the waveform data, and sends the audio stream to be tested to the processor core 604.

In some alternative embodiments, in response to the matching result characterizing that the audio stream to be tested of the channel matches the audio parameter corresponding to the channel, the processor core 604 determines that no error occurs after the audio stream to be tested corresponding to the channel is processed by the IP core 602 to be tested; in response to the matching result indicating that the audio stream to be tested of the channel is not matched with the audio parameter corresponding to the channel, the processor core 604 determines that the audio stream to be tested corresponding to the channel is processed by the IP core 602 to generate an error.

In some alternative embodiments, for the audio stream under test for each channel, the audio parameters include at least: loudness and frequency; the processor core 604 determines whether the difference between the loudness corresponding to the received audio stream to be detected and the loudness included in the audio parameter is less than a loudness threshold;

The processor core 604 determines whether a difference between a frequency corresponding to the received audio stream to be detected and a frequency included in the audio parameter is less than a frequency threshold;

if the difference between the loudness corresponding to the received audio stream to be detected and the loudness included in the audio parameter is smaller than a loudness threshold, and the difference between the frequency corresponding to the received audio stream to be detected and the frequency included in the audio parameter is smaller than a frequency threshold, the processor core 604 determines that the received audio stream to be detected is matched with the audio parameter;

otherwise, the processor core 604 determines that the received audio stream to be tested does not match the audio parameters.

In some alternative embodiments, if an error occurs after the audio stream to be tested of any channel is processed by the IP core to be tested 602, the processor core 604 sends an audio error alert message; and/or the processor core 604 records an audio error log.

In some alternative embodiments, the audio stream under test generated by the audio generator 601 includes any one of the following: an overloaded audio stream, an underloaded audio stream, and a normally played audio stream.

In some alternative embodiments, the IP core under test 602 and the reference IP core 603 are in a full duplex mode of operation; alternatively, the IP core to be tested 602 and the reference IP core 603 are in half duplex operation mode.

The embodiment of the application also provides a component on the traffic equipment, which comprises a chip shown in fig. 6, wherein the chip is used for realizing the audio detection method shown in fig. 1 to 5. The components may be circuit board level components, vehicle electrical system level components, or vehicle assembly components. As examples, the components may be an engine, a chassis, a body, and electrical and electronic equipment of a vehicle. Among them, the electrical and electronic equipment of the vehicle may include a headlight for illumination, a management device for controlling the engine, a center control device for receiving broadcasting, navigation, listening to music, entertainment, and the like.

The embodiment of the application also provides traffic equipment, which comprises the chip shown in fig. 6, wherein the chip is used for realizing the audio detection method shown in fig. 1 to 5. The traffic equipment can be intelligent traffic equipment such as intelligent electric automobiles or intelligent fuel automobiles.

The above is merely an example of the present application and is not intended to limit the scope of the present application. Any modification, equivalent replacement, improvement, etc. made within the spirit and scope of the present application are included in the protection scope of the present application.

Claims

1. The audio detection method is characterized by being applied to a hardware domain on a multi-core heterogeneous system, wherein the hardware domain at least comprises an audio player, an IP core to be detected, a reference IP core and a processor core, and the method comprises the following steps:

the audio player sends an audio driver, the IP core to be tested and the reference IP core which are included in the multi-core heterogeneous system to the processor core, wherein the audio driver, the IP core to be tested and the reference IP core are included in the audio stream to be tested, and the audio stream to be tested is generated by an audio generator and is input to the audio player by the audio generator;

2. The method of claim 1, wherein the audio player sends an audio driver, the IP core under test and the reference IP core, included in the multi-core heterogeneous system, to the processor core, the audio driver including at least two channels of audio under test, comprising:

The audio player sends an audio stream to be tested, which comprises at least two channels, to the IP core to be tested through the audio driver;

the IP core to be tested processes the audio stream to be tested to obtain waveform data corresponding to the audio stream to be tested, and the waveform data is sent to the reference IP core;

3. The method of claim 1, wherein the audio player sends an audio driver, the IP core under test and the reference IP core, included in the multi-core heterogeneous system, to the processor core, the audio driver including at least two channels of audio under test, comprising:

and the IP to be tested checks the waveform data to process the waveform data, so as to obtain audio streams to be tested of all channels corresponding to the waveform data, and the audio streams to be tested of all channels are sent to the processor core through the audio driver.

4. The method of claim 1, wherein the processor core determining whether an error occurred after processing the audio stream under test of the channel through the IP core under test based on the matching result comprises:

5. The method of claim 4, wherein the processor core determining whether the received audio stream to be measured for the channel matches the audio parameters corresponding to the channel comprises:

6. The method of claim 1, wherein if an error occurs after the audio stream under test for any one channel is processed by the IP core under test, the method further comprises:

the processor core sends audio error warning information;

and/or the processor core records an audio error log.

7. The method of claim 1, wherein the audio stream under test generated by the audio generator comprises any one of:

an overloaded audio stream, an underloaded audio stream, and a normally played audio stream.

8. The method of claim 1, wherein the IP core under test and the reference IP core are in a full duplex mode of operation;

9. The method according to claim 1, wherein the method further comprises:

the processor core configures working parameters of the IP core to be tested for the audio stream to be tested;

10. The chip is characterized by comprising an audio player, an audio driver, an IP core to be tested, a reference IP core and a processor core;

the audio player is used for sending an audio stream to be tested, which comprises at least two channels, to the processor core through the audio driver, the IP core to be tested and the reference IP core; transmitting audio parameters corresponding to the audio streams to be detected of each channel to the processor core, wherein the audio parameters corresponding to the audio streams to be detected of any two channels are different; the audio stream to be tested is generated by an audio generator and is input to the audio player by the audio generator;

the processor core is used for judging whether the received audio stream to be detected of the channel is matched with the audio parameters corresponding to the channel for each channel to obtain a matching result; determining whether an error occurs after the audio to be tested of the channel flows through the IP core to be tested to be processed or not based on the matching result;

11. A component on a traffic device, characterized in that it comprises a chip capable of performing the method of any one of claims 1 to 9.

12. A traffic device, characterized in that it comprises a chip capable of performing the method of any one of claims 1 to 9.