JP7089650B2 - Processing equipment, systems, processing methods, and programs - Google Patents

Description

The present invention relates to processing equipment, systems, processing methods, and programs.

In the medical field, it is important to measure the patient's respiratory volume. For example, if the decrease in respiratory volume can be captured, it will be useful for early detection of abnormalities such as pneumothorax. Further, in recent years, a method of estimating a respiratory state or the like by analyzing a signal obtained by using a sensor such as an electronic stethoscope has been proposed.

Patent Document 1 describes a technique for calculating a biological sound characteristic by using a power ratio between a biological sound in a first part of a living body and a biological sound in a second part, a power of a biological signal in a specific frequency band, and the like. Has been done.

Patent Document 2 describes that an expiratory sound is extracted from continuous breath sounds, and a suspected expiratory sound suspected to be an abnormal expiratory sound is detected by using a value or the like representing the sound pressure of the expiratory sound. Further, Patent Document 2 describes that a breathing band sensor is attached so as to wrap around the chest of a subject, changes in chest expansion and contraction during respiratory movements are measured, and exhaled sounds are extracted using the measurement results. There is.

Patent Document 3 describes that the output signal of a sensor including a piezoelectric element is digitized and filtered by a high-pass filter to obtain a breathing airflow sound signal of a living body. Further, Patent Document 3 describes specifying a time zone in which an intake sound and an exhalation sound are generated based on the magnitude of the amplitude of the breathing airflow sound signal.

Patent Document 4 describes extracting breath sounds from biological sounds using a bandpass filter. It also describes estimating the breathing section based on the power pattern of breath sounds. A preset threshold value is used for estimating the breathing section.

International Publication No. 2012/060107 Japanese Unexamined Patent Publication No. 2012-205693 Japanese Unexamined Patent Publication No. 2017-169647 International Publication No. 2014/103107

However, since the signal obtained by the sensor includes the influence of biological sounds other than the breath sounds and the influence varies from person to person, it is not easy to obtain an accurate breath volume by analysis.

One example of the problem to be solved by the present invention is to provide a technique for calculating a breathing volume close to the volume perceived by human hearing from biological sound data.

The invention according to claim 1 is
The acquisition unit that acquires sound data including breath sounds,
At least one of the first section in which breathing is presumed to be performed in the sound data and the second section between the plurality of first sections is used as a threshold value for a value indicating the amplitude of the sound data. Equipped with a section specific part to be specified,
The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the sound data.
The section specifying unit determines the threshold value based on the sound data, and determines the threshold value.
The section identification part is
Find the mode of the value indicating the amplitude in the sound data,
Set the threshold value larger than the mode,
Among the sound data, the first process for specifying at least a section in which the value indicating the amplitude exceeds the threshold value is specified as the first section, and the section in which at least the value indicating the amplitude is less than the threshold value is the first section. Perform at least one of the second processes specified as two sections
It is a processing device.

The invention according to claim 9 is
The processing apparatus according to claim 1 and
Equipped with a sensor,
The acquisition unit is a system that acquires the sound data indicating the sound detected by the sensor.

The invention according to claim 10 is
The acquisition step to acquire sound data including breath sounds, and
At least one of the first section in which breathing is presumed to be performed in the sound data and the second section between the plurality of first sections is used as a threshold value for a value indicating the amplitude of the sound data. Including the section specific step to be specified
The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the sound data.
In the section specifying step, the threshold value is determined based on the sound data, and the threshold value is determined .
In the section identification step,
Find the mode of the value indicating the amplitude in the sound data,
Set the threshold value larger than the mode,
Among the sound data, the first process for specifying at least a section in which the value indicating the amplitude exceeds the threshold value is specified as the first section, and the section in which at least the value indicating the amplitude is less than the threshold value is the first section. Perform at least one of the second processes specified as two sections
It is a processing method.

The invention according to claim 11 is
A program that causes a computer to execute each step of the processing method according to claim 10.

The above-mentioned objectives and other objectives, features and advantages are further clarified by the preferred embodiments described below and the accompanying drawings below.

It is a figure which illustrates the structure of the processing apparatus which concerns on 1st Embodiment. It is a flowchart illustrating the processing method which concerns on 1st Embodiment. It is the figure which image-displayed an example of sound data. It is a figure which illustrates the structure of the processing apparatus and system which concerns on 2nd Embodiment. It is a flowchart which illustrates the processing method executed by the processing apparatus which concerns on 2nd Embodiment. It is a flowchart which exemplifies the processing content of a section specifying step S130 in detail. (A) to (d) are diagrams for explaining an example of the processing content of the section specifying step S130 according to the second embodiment. It is a figure for demonstrating the example of the processing content of the section specifying step S130 which concerns on 2nd Embodiment. (A) and (b) are diagrams for explaining an example of the processing content of the section specifying step S130 according to the second embodiment. It is a figure which illustrates the computer for realizing the processing apparatus. It is a figure which illustrates the structure of the processing apparatus and system which concerns on 3rd Embodiment. It is a figure which illustrates the mounting position of a plurality of sensors. It is a figure which shows the display example of the volume information of a plurality of parts. It is a figure which illustrates the structure of the processing apparatus and system which concerns on 5th Embodiment. It is a figure which shows the display example of the volume information of a plurality of parts. It is a figure which shows the display example of the volume information of a plurality of parts. It is a box plot which shows the relationship between the value which shows the volume calculated in the comparative example, and the result of auditory evaluation. It is a box plot which shows the relationship between the value which shows the volume calculated in an Example, and the result of auditory evaluation. It is a figure which showed the relationship between the result of the auditory evaluation and the value which shows the volume calculated in the comparative example by a histogram. It is a figure which showed the relationship between the result of the auditory evaluation and the value which shows the volume calculated in an Example by a histogram.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In all the drawings, similar components are designated by the same reference numerals, and the description thereof will be omitted as appropriate.

In the following description, each component of the processing device 10 shows a block of functional units, not a configuration of hardware units, unless otherwise specified. Each component of the processing device 10 is a CPU of an arbitrary computer, a memory, a program loaded in the memory, a storage medium such as a hard disk for storing the program, and any hardware and software centering on a network connection interface. It is realized by the combination. And there are various modifications in the realization method and the device.

(First Embodiment)
FIG. 1 is a diagram illustrating the configuration of the processing apparatus 10 according to the first embodiment. The processing apparatus 10 according to the present embodiment includes an acquisition unit 110, a section specifying unit 130, and a calculation unit 150. The acquisition unit 110 acquires one or more sound data including breath sounds. The section specifying unit 130 specifies at least one of the first section and the second section. The first section is a section estimated to be breathing, and the second section is a section between a plurality of first sections. The calculation unit 150 uses the first part of the target sound data determined based on the first section and the second part of the target sound data determined based on the second section of the target sound data. Calculate the volume information indicating the breathing volume.

FIG. 2 is a flowchart illustrating the processing method according to the first embodiment. The method includes an acquisition step S110, a section specifying step S130, and a calculation step S150. In the acquisition step S110, one or more sound data including the breath sounds are acquired. In the section specifying step S130, at least one of the first section and the second section is specified. The first section is a section estimated to be breathing, and the second section is a section between a plurality of first sections. In the calculation step S150, the first part of the target sound data determined based on the first section and the second part of the target sound data determined based on the second section are used to obtain the target sound data. , Volume information indicating the breathing volume is calculated.

This processing method can be executed by the processing apparatus 10.

As for the calculation of the respiratory volume, for example, there is a method of performing a filter process for removing a specific frequency component from the biological signal and obtaining the signal power after extracting the respiratory sound component. However, it is difficult to uniquely determine the cutoff frequency that separates the breath sounds component from other biological sound components (pulsation, heart sounds, blood flow sounds, etc.). This is because the appropriate cutoff frequency when trying to extract breath sounds only by filtering differs depending on the part where the biological sound is acquired and the individual difference of the measurement target person.

Further, the frequency band of the breath sound component and the frequency band of other biological sound components overlap each other in the biological sound detected at any part. In one measurement example, in the biological sound obtained by the sensor attached to the neck, the breath sounds component appeared in the band from 0 Hz to 1500 Hz, and the pulsation and blood flow sound components appeared in the band from 0 Hz to 200 Hz. Further, in the biological sound obtained by the sensor attached to the upper right of the chest, the breath sounds component appeared in the band from 0 Hz to 300 Hz, and the heart sound component appeared in the band from 0 Hz to 500 Hz. In the biological sound obtained by the sensor attached to the upper left of the chest, the breath sounds component appeared in the band from 0 Hz to 300 Hz, and the heart sound component appeared in the band from 0 Hz to 400 Hz. Then, in the biological sound obtained by the sensor attached to the lower right of the chest, the breath sounds component appeared in the band from 0 Hz to 300 Hz, and the heart sound component appeared in the band from 0 Hz to 300 Hz. Therefore, even if the signal power is obtained by simply limiting the band, the influence of other components cannot be avoided.

In the processing device 10 according to the present embodiment, the acquisition unit 110 acquires sound data from, for example, a sensor attached to a living body. The section specifying unit 130 specifies the first section and the second section. The first section is a section in which it is presumed that the action of inhaling or exhaling is performed in the living body. The second section is a section between the first section and the first section. More specifically, the second section is a section other than the first section. That is, the second section is a section presumed not to be breathing, and is a section presumed to be temporarily apnea between breathing. The second section does not necessarily have to be between the first section and the first section. For example, the end of the sound data may be specified as the second section.

FIG. 3 is an image display of an example of sound data. In this figure, the time waveform of the sound data is shown in the display area 501, and the spectrogram of the sound data is shown in the display area 502. In the spectrogram, the horizontal axis is time (time), the vertical axis is frequency, and the intensity of each frequency component is shown by luminance. The horizontal axis of the time waveform and the horizontal axis of the spectrogram are aligned. Further, the section specified as the first section is indicated by an arrow in the display area 502. On the other hand, the section not marked with an arrow is the second section. In this way, the interval indicates a time range. Further, the sound data has a plurality of first sections separated from each other, and a plurality of second sections separated from each other.

Here, it is considered that the part presumed to be breathing contains the breath sounds component and other biosound components, and the part presumed to be apnea contains only other biosound components. Be done. Therefore, by comparing the data of the portion where breathing is presumed with the data of the portion other than that, it is possible to obtain volume information in which the influence of other biological sound components is reduced. The volume information calculated in this way has a high correlation with, for example, the volume of breath sounds that a person perceives when hearing. If such volume information is used, for example, abnormalities in the living body can be easily detected by data processing, which is useful for assisting diagnosis and monitoring the patient's condition, for example.

The detailed processing contents in the processing apparatus 10 will be described in detail in the second and subsequent embodiments described later.

As described above, according to the present embodiment, the calculation unit 150 includes a first portion of the target sound data determined based on the first section and a second portion of the target sound data determined based on the second section. Is used to calculate volume information indicating the breathing volume of the target sound data. Therefore, it is possible to calculate the breathing volume close to the volume perceived by human hearing from the biological sound data.

(Second embodiment)
FIG. 4 is a diagram illustrating the configurations of the processing apparatus 10 and the system 20 according to the second embodiment. The processing apparatus 10 according to the present embodiment has the configuration of the processing apparatus 10 according to the first embodiment. FIG. 5 is a flowchart illustrating a processing method executed by the processing apparatus 10 according to the second embodiment. The processing method according to the present embodiment has the configuration of the processing method according to the first embodiment.

The system 20 according to this embodiment includes a processing device 10 and a sensor 210. Then, the acquisition unit 110 acquires sound data indicating the sound detected by the sensor 210.

Each component of the processing apparatus 10 and the system 20 will be described in detail below.

The sensor 210 detects biological sounds including breath sounds. The sensor 210 generates an electrical signal indicating a biological sound and outputs it as sound data. The sensor 210 is, for example, a microphone or a vibration sensor. The vibration sensor is, for example, a displacement sensor, a velocity sensor, or an acceleration sensor. Microphones convert air vibrations caused by biological sounds into electrical signals. The signal level value of this electric signal indicates the sound pressure of the vibration of air. On the other hand, the vibration sensor converts the vibration of the medium (for example, the body surface of the subject) caused by the biological sound into an electric signal. The signal level value of this electrical signal directly or indirectly indicates the vibration displacement of the medium. For example, when the vibration sensor includes a diaphragm, the vibration of the medium is transmitted to the diaphragm, and the vibration of the diaphragm is converted into an electric signal. The electric signal may be an analog signal or a digital signal. Further, the sensor 210 may be configured to include a circuit or the like for processing an electric signal. Examples of the circuit for processing the electric signal include an A / D conversion circuit and a filter circuit. However, A / D conversion and the like may be performed by the processing device 10.

The sound data is data showing an electric signal, and is data showing a signal level value based on the electric signal obtained by the sensor 210 in time series. That is, the sound data represents the waveform of the sound wave. In addition, one sound data means a continuous sound data in time.

Further, the sensor 210 is, for example, an electronic stethoscope. The sensor 210 is pressed or attached to, for example, a portion of the living body of the subject whose biological sound is desired to be measured by the measurer. In this embodiment, an example in which the acquisition unit 110 acquires only one continuous sound data will be described.

In the acquisition step S110, the acquisition unit 110 acquires, for example, sound data from the sensor 210. In this case, the acquisition unit 110 can acquire the sound data detected by the sensor 210 in real time. However, the sound data measured in advance by the sensor 210 and held in the storage device may be read out and acquired by the acquisition unit 110. The storage device may be provided inside the processing device 10 or may be provided outside. The storage device provided inside the processing device 10 is, for example, the storage device 1080 of the computer 1000 described later. Further, the acquisition unit 110 may acquire sound data output from the sensor 210 and subjected to conversion processing or the like in the processing device 10 or in a device other than the processing device 10. Examples of the conversion process include an amplification process and an A / D conversion process.

The acquisition unit 110 continuously acquires, for example, sound data including biological sounds from the sensor 210. Each signal level value of the sound data is associated with the recording time. The sound data may be associated with a time in the sensor 210, or when the sound data is acquired from the sensor 210 in real time, the acquisition unit 110 may associate the acquisition time of the sound data with the sound data.

Of the sound data acquired by the acquisition unit 110, the sound data for which the volume information is to be calculated is also referred to as the target sound data. In this embodiment, the acquisition unit 110 acquires only one sound data, so that the acquired sound data is the target sound data. The acquisition unit 110 can continuously acquire sound data while the subsequent steps S120, section specifying step S130, and calculation step S150 are being performed. The following processing is performed on the acquired sound data in order from the beginning.

In the example of this figure, the processing device 10 further includes a filter processing unit 120. When the acquisition of sound data by the acquisition unit 110 is started, step S120 is started. In step S120, the filter processing unit 120 performs the first filter processing on at least the target sound data. Specifically, the filter processing unit 120 performs bandpass filter processing in which the cutoff frequency on the low frequency side is f _L1 [Hz] and the cutoff frequency on the high frequency side is f _H1 [Hz]. In the first filtering process, for example, a Fourier transform is performed on the sound data to remove a band of f _L1 [Hz] or less and a band of f _H1 [Hz] or more in the frequency space. Then, the time axis waveform is restored by the inverse Fourier transform. The Fourier transform is, for example, the Fast Fourier Transform (FFT). However, the first filter processing is not limited to the above example, and may be processing by, for example, an FIR (Finite Impulse Response) filter or an IIR (Infinite Impulse Response) filter.

In the example of this figure, the calculation unit 150 calculates the volume information using the first part and the second part of the target sound data after the first filter processing. Here, it is preferable that 50 ≦ f _L1 ≦ 150 holds, and it is preferable that 500 ≦ f _H1 ≦ 1500 holds. The noise included in the sound data can be removed by the first filtering process. It is not necessary to extract only the breath sounds component by the first filter processing. The sound data after the first filter processing may contain components other than breath sounds.

The section specifying unit 130 specifies at least one of the first section and the second section. In the examples of FIGS. 4 and 5, the section specifying unit 130 specifies at least one of the first section and the second section based on the sound data acquired by the acquisition unit 110. However, the section specifying unit 130 may specify at least one of the first section and the second section without using the sound data. The method by which the section specifying unit 130 specifies the section will be described in detail later.

Further, the section specifying unit 130 generates at least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section based on the specifying result of the section. For example, when the section specifying unit 130 specifies the first section, the section specifying unit 130 generates the first time information, and when the section specifying unit 130 specifies the second section, the section specifying unit 130 generates the second time information. do. When a plurality of discontinuous first sections are specified by the section specifying unit 130, a plurality of first time information is generated. Further, when a plurality of discontinuous second sections are specified by the section specifying unit 130, a plurality of second time information is generated.

In the calculation step S150, the calculation unit 150 calculates the volume information using the data in the first region among the target sound data acquired by the acquisition unit 110. The _first region is, for example, an region showing sounds during the latest time T1 at the time when the calculation unit 150 performs this step. T ₁ is not particularly limited, but is, for example, 2 seconds or more and 30 seconds or less.

As described above, the calculation unit 150 uses at least one of the first time information and the second time information generated by the section identification unit 130 to specify the first part and the second part in the first region of the target sound data. do.

When the section specifying unit 130 generates the first time information and the second time information, the calculation unit 150 sets the part of the time range indicated by the first time information in the first region of the target sound data as the first part. The part of the time range indicated by the second time information in the first area is defined as the second part. Further, when the section specifying unit 130 generates only the first time information, the calculation unit 150 uses the part of the time range indicated by the first time information in the first area as the first part, and the other part of the first area. Let the part be the second part. Further, when the section specifying unit 130 generates only the second time information, the calculation unit 150 sets the portion of the time range indicated by the second time information in the first region as the second portion, and uses that of the first region. The part other than is the first part.

Then, the calculation unit 150 calculates the first signal strength, which is the strength of the first portion of the target sound data, and the second signal strength, which is the strength of the second portion of the target sound data. Specifically, for example, the calculation unit 150 calculates the RMS (root mean square) of the first portion of the target sound data as the first signal strength. Further, the calculation unit 150 calculates the RMS of the second part of the target sound data as the second signal strength. The calculation unit 150 may calculate other indexes such as a peak to peak value as the signal strength instead of the RMS. However, the calculation method of the first signal strength and the calculation method of the second signal strength are the same.

When two or more first portions are included in the processing range, the first signal strength is a value indicating the signal strength when, for example, all the first portions are regarded as one continuous signal. Further, when two or more second portions are included in the processing range, the second signal strength is a value indicating the signal strength when, for example, all the second portions are regarded as one continuous signal.

Then, the calculation unit 150 calculates the volume information of the target sound data using the first signal strength and the second signal strength. The volume information does not have to be an absolute volume (for example, dB SPL, etc.) measured by another device or the like. The volume information may be at least a relative value that can be compared between the volume information obtained by the processing device 10.

Specifically, the calculation unit 150 measures sound data for at least one of the information for specifying the ratio of the first signal strength to the second signal strength and the information for specifying the difference between the first signal strength and the second signal strength. It is calculated as the volume information of. However, it is preferable that the calculation unit 150 calculates at least information for specifying the ratio of the first signal strength to the second signal strength as volume information. By doing so, the volume information can be expressed in dB units in the same manner as the normal volume, and the information can be made closer to the volume perceived by human hearing. The information for specifying the ratio of the first signal strength to the second signal strength is, for example, a value obtained by dividing the first signal strength by the second signal strength, a value obtained by dividing the second signal strength by the first signal strength, and these values. Any of the values displayed in decibels.

In the same way, the calculation unit 150 calculates the volume information _every time T2, for example. T ₂ is not particularly limited, but is, for example, 1 second or more and 10 seconds or less.

The volume information calculated by the calculation unit 150 is displayed on, for example, a display device. Here, the calculation unit 150 may calculate a plurality of volume information of the target sound data in a time series, and a graph showing the plurality of volume information in the time series may be displayed on the display device. However, the volume information may be displayed numerically. Further, the volume information calculated by the calculation unit 150 may be stored in the storage device or may be output to a device other than the processing device 10.

FIG. 6 is a flowchart illustrating in detail the processing content of the section specifying step S130. Further, FIGS. 7A to 9B are diagrams for explaining an example of the processing content of the section specifying step S130 according to the present embodiment. In FIGS. 7 (a) to 7 (d), 9 (a), and 9 (b), the horizontal axis indicates the elapsed time from the reference time. With reference to FIGS. 6 to 9 (b), an example of a method in which the section specifying unit 130 specifies a section will be described in detail below.

In the section specifying step S130, the section specifying unit 130 specifies at least one of the first section and the second section using a threshold value for a value indicating the amplitude of the first sound data. The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the first sound data. Then, the section specifying unit 130 determines the threshold value based on the first sound data.

The sound data acquired by the acquisition unit 110 includes the first sound data and the target sound data. Here, the first sound data is the sound data used for specifying the section, and the target sound data is the sound data for which the volume information is calculated. When the acquisition unit 110 acquires only one sound data, both the first sound data and the target sound data are the one sound data, and they are the same at the time of acquisition by the acquisition unit 110. In the present embodiment, the sound data acquired by the acquisition unit 110 is preferably the biological sound data acquired by the neck. Then, the section can be specified more accurately. This is because the respiratory sound components can be detected at a high ratio in the neck and its vicinity.

The section specifying unit 130 performs a second filter process in step S131 on the first sound data acquired by the acquisition unit 110. In the second filtering process, for example, a Fourier transform is performed on the sound data to remove the band of f _L2 [Hz] or less and the band of f _H2 [Hz] or more in the frequency space. Then, the time axis waveform is restored by the inverse Fourier transform. The Fourier transform is, for example, the Fast Fourier Transform (FFT). However, the second filter processing is not limited to the above example, and may be processing by, for example, an FIR filter or an IIR filter.

The section specifying unit 130 obtains the mode value, which will be described later, based on the first sound data after the second filter processing. The second filter processing is a bandpass filter processing in which the cutoff frequency on the low frequency side is f _L2 [Hz] and the cutoff frequency on the high frequency side is f _H2 [Hz]. Here, it is preferable that 150 ≦ f _L2 ≦ 250 holds, and it is preferable that 550 ≦ f _H2 ≦ 650 holds. By the second filter processing, the breath sounds component included in the first sound data can be mainly extracted. It is not necessary to extract only the breath sounds component by the second filter processing. Further, the first sound data after the second filter processing may include components other than the breath sounds.

FIG. 7A is a diagram illustrating a waveform of the first sound data at the time of acquisition by the acquisition unit 110, and FIG. 7B is a diagram in which the waveform of FIG. 7A is subjected to a second filter process. It is a figure which illustrates the waveform after that. As shown by the arrow in FIG. 7B, the breath sounds component is mainly extracted by the second filtering process.

In the first sound data acquired by the acquisition unit 110, both the first filter processing of step S120 by the filter processing unit 120 and the second filter processing of step S131 by the section specifying unit 130 are performed. You may be broken. However, when the pass band of the second filter processing is narrower than the pass band of the first filter processing, the presence or absence of the first filter processing does not affect the specific result of the section.

Next, in step S132, the section specifying unit 130 calculates the absolute value of the data obtained in step S131. That is, each signal level value in the time series data is converted into an absolute value. FIG. 7 (c) is a diagram showing the result of calculating the absolute value of the data of FIG. 7 (b).

Next, in step S133, the section specifying unit 130 performs a downsampling process on the data obtained in step S132. By doing so, the outline of the data waveform can be obtained as shown in FIG. 7 (d). Then, each data point of the data obtained by the downsampling process corresponds to a value indicating the amplitude of each time of the first sound data. The section specifying unit 130 obtains the mode value, which will be described later, based on the data obtained by at least downsampling the first sound data in this way. Here, in FIG. 7 (d), the portion presumed to be breathing is indicated by a downward arrow, and the portion presumed not to be breathed is indicated by an upward arrow. It suffices if these can be finally identified by the section specifying unit 130.

Next, in step S134, the section specifying unit 130 determines whether or not to update (determine) the threshold value based on a predetermined update condition. Specifically, for example, when the threshold value is never determined by the section specifying unit 130 for the first sound data, the section specifying unit 130 determines that the update condition is satisfied. On the other hand, when the threshold value is determined by the section specifying unit 130 at least once for the first sound data, the section specifying unit 130 determines that the update condition is not satisfied.

When it is determined that the update condition is satisfied (Yes in step S134), the section specifying unit 130 proceeds to step S135 and performs a process for determining the threshold value. On the other hand, when it is determined that the update condition is not satisfied (No in step S134), the section specifying unit 130 performs step S137 using the already determined threshold value.

The process in which the section specifying unit 130 determines the threshold value will be described below. The section specifying unit 130 obtains the mode value of the value indicating the amplitude in the first data. Specifically, in step S135, the section specifying unit 130 obtains the mode value of the value indicating the amplitude of the first sound data. Therefore, the section specifying unit 130 counts the number of appearances of a value indicating each amplitude in a predetermined time range in the first sound data. Then, the section specifying unit 130 obtains a value indicating the amplitude having the largest number of appearances as a mode value. The predetermined time range may be, for example, a range from the acquisition unit 110 starting to acquire the first sound data to the time when the section specifying unit 130 performs this step, or the section specifying unit 130 may perform this step. It may be the latest time _T3 at the time of performing. T ₃ is not particularly limited, but is, for example, 2 seconds or more and 30 seconds or less. Further, for example, T ₃ may be the same as T ₁ . When the first sound data is the target sound data, the area of a predetermined time range may be matched with the above-mentioned first area.

As described above, the acquisition unit 110 may read and acquire the sound data held in the storage device. In that case, for example, the section specifying unit 130 may specify the mode value and determine the threshold value using the entire sound data.

FIG. 8 is a histogram illustrating the number of occurrences of each amplitude. Such a histogram corresponds to a graph in which the first sound data is represented by a graph in which the horizontal axis represents the amplitude and the vertical axis represents the number of occurrences. The value indicating the amplitude is not limited to the value obtained by the above processing, and may be, for example, a peak to peak value or a standardized value.

Then, the section specifying unit 130 sets a threshold value larger than the mode value in step S136. Specifically, in the histogram, among the values indicating one or more amplitudes having a minimum value, the value indicating the amplitude closest to the mode value is set as the threshold value. The mode in the histogram is a value indicating the smallest amplitude among the values indicating a plurality of amplitudes having a maximum value. In the graph of FIG. 8, the point 505 at which the number of occurrences is maximum and the plurality of minimum values are marked with circles. In the example of this figure, the value indicating the amplitude taking this point 505 is the mode value. Then, a value indicating an amplitude that takes the minimum value 506 on the lowest amplitude side among the minimum values is determined as a threshold value. The mode is considered to be a value indicating an amplitude mainly corresponding to the apnea section. Therefore, by determining the threshold value in this way, a threshold value that can distinguish the apnea section from the other sections can be obtained. Further, since this threshold value is obtained by using the sound data acquired by the acquisition unit 110, highly accurate section identification can be realized regardless of individual differences in the biological sound. The threshold value is not limited to the above example. For example, the threshold value may be a value indicating an amplitude that takes the second or third minimum value from the low amplitude side in the histogram, or may be a value indicating an amplitude that takes the maximum value next to the point 505.

When the threshold value is determined in step S136, or when it is determined in step S134 that the update condition is not satisfied, the section specifying unit 130 performs at least one of the following first and second processes in step S137. The first process is a process of specifying a section of the first sound data in which at least the value indicating the amplitude exceeds the threshold value as the first section. On the other hand, the second process is a process of specifying a section of the first sound data in which at least the value indicating the amplitude is less than the threshold value as the second section. The section that matches the threshold value may be included in the first section or may be included in the second section.

Specifically, the section specifying unit 130 applies a threshold value to the first sound data processed in step S133, and one section in which the value indicating the amplitude continuously exceeds the threshold value is one first section. And. On the other hand, a section in which the value indicating the amplitude is continuously less than the threshold value is defined as one second section. The section specifying unit 130 may specify only one of the first section and the second section. In that case, the remaining section becomes the other section.

9 (a) shows circles at points below the threshold value in the graph of FIG. 7 (d). FIG. 9B is an enlarged view of FIG. 9A on the small amplitude side. Further, in FIG. 9B, a straight line indicating a threshold value is attached.

The section specifying unit 130 specifies a section for the newly acquired sound data, for example, every time _T4 . The T ₄ is not particularly limited, but is, for example, 1 second or more and 10 seconds or less. It is preferable that T ₄ is T ₂ or less as described above.

The section specifying unit 130 may determine the threshold value each time the section is specified. Further, each time the calculation unit 150 calculates the volume information, the section specifying unit 130 may specify the section. For example, the threshold value may be determined, the section may be specified, and the volume information may be calculated for the sound data in the same time range as the processing target.

Further, the section specifying unit 130 may specify the section by another method. For example, the interval may be determined in the same manner using a predetermined threshold value. Further, the section specifying unit 130 may specify the section based on the output of the band sensor attached to the chest or the like of the target person. For example, a band sensor can detect chest swelling and movement during breathing.

Each functional component of the processing device 10 may be realized by hardware that realizes each functional component (eg, a hard-wired electronic circuit, etc.), or a combination of hardware and software (eg, electronic). It may be realized by a combination of a circuit and a program that controls it). Hereinafter, a case where each functional component of the processing device 10 is realized by a combination of hardware and software will be further described.

FIG. 10 is a diagram illustrating a computer 1000 for realizing the processing device 10. The computer 1000 is an arbitrary computer. For example, the computer 1000 is an SoC (System On Chip), a personal computer (PC), a server machine, a tablet terminal, a smartphone, or the like. The computer 1000 may be a dedicated computer designed to realize the processing device 10, or may be a general-purpose computer.

The computer 1000 includes a bus 1020, a processor 1040, a memory 1060, a storage device 1080, an input / output interface 1100, and a network interface 1120. The bus 1020 is a data transmission path for the processor 1040, the memory 1060, the storage device 1080, the input / output interface 1100, and the network interface 1120 to transmit and receive data to and from each other. However, the method of connecting the processors 1040 and the like to each other is not limited to the bus connection. The processor 1040 is various processors such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), or an FPGA (Field-Programmable Gate Array). The memory 1060 is a main storage device realized by using RAM (Random Access Memory) or the like. The storage device 1080 is an auxiliary storage device realized by using a hard disk, an SSD (Solid State Drive), a memory card, a ROM (Read Only Memory), or the like.

The input / output interface 1100 is an interface for connecting the computer 1000 and the input / output device. For example, an input device such as a keyboard or a mouse and an output device such as a display device are connected to the input / output interface 1100. Further, a touch panel or the like that serves as both a display device and an input device may be connected to the input / output interface 1100.

The network interface 1120 is an interface for connecting the computer 1000 to the network. This communication network is, for example, LAN (Local Area Network) or WAN (Wide Area Network). The method of connecting the network interface 1120 to the network may be a wireless connection or a wired connection.

The storage device 1080 stores a program module that realizes each functional component of the processing device 10. The processor 1040 reads each of these program modules into the memory 1060 and executes them, thereby realizing the functions corresponding to each program module.

The sensor 210 is connected, for example, to the input / output interface 1100 of the computer 1000 or to the network interface 1120 via a network.

As described above, according to the present embodiment, as in the first embodiment, the calculation unit 150 includes the first portion of the target sound data determined based on the first section and the second section of the target sound data. Volume information indicating the breathing volume of the target sound data is calculated using the second part determined based on the above. Therefore, it is possible to calculate the breathing volume close to the volume perceived by human hearing from the biological sound data.

(Third embodiment)
FIG. 11 is a diagram illustrating the configurations of the processing apparatus 10 and the system 20 according to the third embodiment. The processing apparatus 10 and the system 20 according to the present embodiment are the same as the processing apparatus 10 and the system 20 according to the second embodiment, respectively, except for the points described below.

The system 20 according to the present embodiment includes a plurality of sensors 210, and the acquisition unit 110 according to the present embodiment acquires a plurality of sound data indicating the sounds detected by the plurality of sensors 210. The plurality of sensors 210 detect biological sounds at a plurality of parts of the living body of the same person, for example. Then, the acquisition unit 110 can acquire the sound data of the biological sound detected at a plurality of parts of the living body of the same person at the same time. Further, the acquisition unit 110 can acquire a plurality of sound data in which at least a part of the recording times overlap each other. The acquisition unit 110 may further acquire the sound data of the biological sounds of a plurality of persons, but at least the processing by the section specifying unit 130 and the calculation unit 150 is performed for each person. Further, the acquisition unit 110 may acquire a plurality of sound data whose recording times do not overlap with each other, but at least the processing by the section specifying unit 130 and the calculation unit 150 is for recording one sound data or at least a part of the sound data. It is performed for each of a plurality of sound data whose times overlap with each other.

FIG. 12 is a diagram illustrating mounting positions of a plurality of sensors 210. In the example of this figure, the sensor 210 is attached from the part A to the part D. For example, the processing device 10 accepts the input of information indicating the attachment portion of the sensor 210 by the user prior to the acquisition of the sound data. Specifically, a diagram showing a living body is displayed on a display device together with candidates for mounting sites of the sensor 210, and the user specifies a position to mount each sensor 210 among the candidates using an input device such as a mouse, keyboard, or touch panel. do. Information indicating a part is associated with the sound data acquired by each sensor 210.

In the present embodiment, the section specifying unit 130 specifies at least one of the first section and the second section based on the first sound data, as described in the second embodiment. That is, the plurality of sound data acquired by the acquisition unit 110 includes the target sound data and the first sound data. Here, the target sound data is not limited to one. Then, in the following, an example in which the target sound data includes at least a second sound data different from the first sound data will be described. That is, the volume information of the second sound data is calculated based on the section specified by the first sound data. In addition, a plurality of second sound data may exist.

For example, the first sound data indicates the sound detected by the first sensor 210 provided at the first position on the surface or inside of the human body. The second sound data indicates the sound detected by the second sensor 210 provided at the second position on the surface or inside of the human body. Here, it is preferable that the first position is located in the neck or the first position is closer to the neck than the second position. Then, the section can be specified more accurately. For example, in the example of FIG. 12, it is preferable that the sound data obtained at the portion A is the first sound data. For example, the section specifying unit 130 selects which of the plurality of sound data acquired by the acquisition unit 110 is to be the first sound data, based on the information indicating the portion associated with each sound data.

The acquisition step S110 and the step S120 according to the present embodiment are performed by the acquisition unit 110 and the filter processing unit 120, respectively, in the same manner as in the second embodiment.

Then, the section specifying unit 130 according to the present embodiment specifies at least one of the first section and the second section in the first sound data in the section specifying step S130, as in the second embodiment. Then, at least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section is generated based on the first sound data.

Further, in the calculation step S150, the calculation unit 150 according to the present embodiment uses at least one of the first time information and the second time information as in the second embodiment, and uses at least one of the first time information and the first part of the sound data of each target. And the second part. By doing so, even in the second sound data included in the target sound data, the first section presumed to be breathing and the other second section can be specified.

Further, the calculation unit 150 calculates the volume information for each target sound data as in the second embodiment. By doing so, it is possible to obtain volume information for each part. The calculation unit 150 may use all the sound data acquired by the acquisition unit 110 as the target sound data, or may use only the sound data corresponding to the portion designated by the user as the target sound data.

FIG. 13 is a diagram showing a display example of volume information of a plurality of parts. In the example of this figure, the volume information of a plurality of parts is displayed in a state where the correspondence with each part can be understood. Specifically, a numerical value indicating the volume is displayed on the map showing the part based on the volume information. In addition, numerical values indicating the volume are shown in the graph in chronological order. In the graph of this figure, the horizontal axis shows the elapsed time from the reference time, and the parts are synchronized with each other. The scale of the axis of the graph may be enlarged or reduced or translated by the user as needed.

The target sound data may further include the first sound data. Further, in the present embodiment, an example in which the target sound data includes at least a second sound data different from the first sound data has been described, but the target sound data may include only the first sound data. The volume information of the first sound data can also be calculated in the same manner as described above.

As described above, according to the present embodiment, as in the first embodiment, the calculation unit 150 includes the first portion of the target sound data determined based on the first section and the second section of the target sound data. Volume information indicating the breathing volume of the target sound data is calculated using the second part determined based on the above. Therefore, it is possible to calculate the breathing volume close to the volume perceived by human hearing from the biological sound data.

(Fourth Embodiment)
The processing apparatus 10 and the system 20 according to the fourth embodiment are the same as the processing apparatus 10 and the system 20 according to the third embodiment, except for the processing contents of the section specifying unit 130 and the calculation unit 150.

Similar to the acquisition unit 110 according to the third embodiment, the acquisition unit 110 according to the present embodiment acquires a plurality of sound data indicating the sounds detected by the plurality of sensors 210. Then, the section specifying unit 130 specifies the first section and the second section in each of two or more sound data among the acquired plurality of sound data. That is, in the present embodiment, the section specifying unit 130 uses two or more sound data among the plurality of sound data acquired by the acquisition unit 110 as the first sound data. By specifying the section using two or more first sound data, the accuracy of specifying the section can be improved.

When the threshold value is determined based on the first sound data as in the section specifying step S130 according to the second embodiment, the section specifying unit 130 sets the threshold value for each first sound data that specifies the section. decide.

The section specifying unit 130 sets the time range as the first section in all the first sound data for which the section is specified, or the time range as the second section in all the first sound data for which the section is specified. Generates the 3rd time information shown.

Here, it is preferable that the two or more first sound data include the sound data detected in the neck or the sound data detected at the position closest to the neck among the plurality of sound data. Then, the section can be specified more accurately.

Then, the calculation unit 150 identifies the first part and the second part of the sound data of each object by using the third time information. Specifically, when the third time information is information indicating a time range set as the first section in all the first sound data, the calculation unit 150 indicates the third time information in each target sound data. The part of the time range is the first part, and the other parts are the second part. On the other hand, when the third time information is the information indicating the time range set as the second section in all the first sound data, the calculation unit 150 is the time range indicated by the third time information in each target sound data. The part is the second part, and the other parts are the first part.

The target sound data may or may not include the first sound data. Further, the target sound data may or may not include a second sound data different from the first sound data.

Further, the calculation unit 150 calculates the volume information for each target sound data as in the second embodiment. By doing so, it is possible to obtain volume information for each part.

As described above, according to the present embodiment, as in the first embodiment, the calculation unit 150 includes the first portion of the target sound data determined based on the first section and the second section of the target sound data. Volume information indicating the breathing volume of the target sound data is calculated using the second part determined based on the above. Therefore, it is possible to calculate the breathing volume close to the volume perceived by human hearing from the biological sound data.

In addition, according to the present embodiment, the section specifying unit 130 specifies the first section and the second section in each of the two or more sound data. Therefore, the accuracy of section identification can be improved.

(Fifth Embodiment)
FIG. 14 is a diagram illustrating the configurations of the processing apparatus 10 and the system 20 according to the fifth embodiment. The processing apparatus 10 and the system 20 according to the present embodiment are the same as at least one of the second to fourth embodiments except for the points described below.

In the present embodiment, the processing device 10 further includes an estimation unit 170. The estimation unit 170 estimates the state of the person in which the biological sound is detected, based on the volume information calculated by the calculation unit 150. This will be described in detail below.

For example, the calculation unit 150 calculates the volume information of the sound data of a plurality of targets in the same manner as at least one of the second to fourth embodiments.

15 and 16 are diagrams showing an example of displaying volume information of a plurality of parts, respectively.

When the calculation unit 150 calculates the volume information, the estimation unit 170 acquires the volume information calculated from the calculation unit 150. Information indicating a part is associated with each volume information. The estimation unit 170 calculates, for example, the rate of decrease in the volume indicated by the volume information of each portion per hour. Then, when the rate of decrease exceeds a predetermined reference value, it is estimated that breathing is weakened. In that case, the estimation unit 170 displays or notifies that the breathing is weak, for example, as shown in FIG. In addition, the estimation unit 170 may presume that breathing is weakened when the rate of decrease in volume is high in a predetermined number or more. Further, the estimation unit 170 may estimate that breathing is weakened when the rate of decrease in volume increases over a predetermined length.

Further, the estimation unit 170 calculates, for example, the difference between two sound data indicating the biological sounds detected at positions symmetrical with each other in the living body. Then, the estimation unit 170 estimates that there is a suspicion of pneumothorax when the magnitude of the difference exceeds a predetermined reference value. It also estimates which lung is suspected of having pneumothorax based on whether the difference is positive or negative. In this way, the estimation unit 170 may estimate the position of the sound source of the abnormal breath sounds based on the calculated plurality of volume information. Then, the estimation unit 170 displays or notifies that there is a suspicion of pneumothorax and the estimated position, as shown in FIG. 16, for example. The estimation unit 170 may estimate that breathing is weakened when the magnitude of the difference exceeds the reference value over a predetermined length.

The processing apparatus 10 according to the present embodiment can also be realized by using the computer 1000 as shown in FIG.

As described above, according to the present embodiment, as in the first embodiment, the calculation unit 150 includes the first portion of the target sound data determined based on the first section and the second section of the target sound data. Volume information indicating the breathing volume of the target sound data is calculated using the second part determined based on the above. Therefore, it is possible to calculate the breathing volume close to the volume perceived by human hearing from the biological sound data.

In addition, according to the present embodiment, the processing device 10 includes an estimation unit 170 that estimates the state of the person in which the biological sound is detected based on the volume information calculated by the calculation unit 150. Therefore, the condition of the patient or the like can be monitored.

Hereinafter, this embodiment will be described in detail with reference to Examples. The present embodiment is not limited to the description of these examples.

Sound data was obtained by measuring biological sounds at 4 sites (neck, upper right chest, upper left chest, and lower right chest) in 22 subjects. Then, the obtained sound data was reproduced, and the auditory sensation was evaluated as to whether or not the breath sounds could be heard. In the hearing evaluation, the case where the breath sounds were not heard at all was set as "0", the case where the breath sounds were barely heard was set as "1", and the case where the breath sounds were heard well was set as "2".

On the other hand, the sound data was processed by each method of the example and the comparative example, and the value indicating the volume was calculated. Then, the calculated value was compared with the result of the hearing evaluation.

In the comparative example, the sound data was subjected to high-pass filter processing with a cutoff frequency of 400 Hz. Then, the RMS was calculated, and the value in which the RMS was displayed in decibels was used as a value indicating the volume. It should be noted that 0 dB = 1 digit.

In the embodiment, a value indicating the volume was calculated as described in the second embodiment. Specifically, a threshold value was set based on each sound data, and a section was specified. Further, the RMS of each section of the first filtered sound data in which f _L1 was set to 100 Hz and f _H1 was set to 1000 Hz was calculated. Then, the value obtained by dividing the RMS of the first section by the RMS of the second section and displaying it in decibels was used as a value indicating the volume. That is, the RMS of the second section was set to 0 dB. The determination of the threshold value, the specification of the section, and the calculation of the value indicating the volume were performed independently for each sound data.

17 and 18 are boxplots showing the relationship between the values indicating the volume calculated in the comparative example and the example and the result of the auditory evaluation, respectively. Further, FIG. 19 is a diagram showing the relationship between the result of the auditory evaluation and the value indicating the volume calculated in the comparative example as a histogram. FIG. 20 is a diagram showing the relationship between the result of the auditory evaluation and the value indicating the volume calculated in the embodiment as a histogram. As shown in FIGS. 17 and 19, in the comparative example, the difference between the sound data of evaluation 1 and the sound data of evaluation 0 did not properly appear as the difference in volume. On the other hand, as shown in FIGS. 18 and 20, in the embodiment, the magnitude of the value indicating the volume correlates well with the evaluation 0, the evaluation 1, and the evaluation 2, and the sound data of the evaluation 0 and the sound of the evaluation 1 are evaluated. The data could also be clearly identified by the value indicating the volume. In this way, by the method of the example, a value having a high correlation with the result of the auditory evaluation could be calculated as the volume. Therefore, it was confirmed that the breathing volume close to the volume perceived by human hearing can be calculated from the sound data by the method of the example.

Although the embodiments of the present invention have been described above with reference to the drawings, these are examples of the present invention, and various configurations other than the above can be adopted. For example, in the flowchart used in the above description, a plurality of steps (processes) are described in order, but the execution order of the steps executed in each embodiment is not limited to the order of description. In each embodiment, the order of the illustrated steps can be changed within a range that does not hinder the contents. In addition, the above-mentioned embodiments can be combined as long as the contents do not conflict with each other.

Hereinafter, an example of the reference form will be added.
1-1. An acquisition unit that acquires one or more sound data including breath sounds,
A section specifying part that specifies at least one of a first section presumed to be breathing and a second section between a plurality of the first sections.
Using the first part of the sound data of the target determined based on the first section and the second part of the sound data of the target determined based on the second section of the target sound data. , A processing device including a calculation unit that calculates volume information indicating the breathing volume.
1-2. 1-1. In the processing apparatus described in
The calculation unit
The first signal strength, which is the strength of the first portion of the target sound data, and the second signal strength, which is the strength of the second portion of the target sound data, are calculated.
A processing device that calculates the volume information of the sound data of the target using the first signal strength and the second signal strength.
1-3. 1-2. In the processing apparatus described in
The calculation unit is a processing device that calculates information for specifying the ratio of the first signal strength to the second signal strength as the volume information of the target sound data.
1-4. 1-1. From 1-3. In the processing apparatus described in any one of
Further provided with a filter processing unit that performs filter processing on at least the target sound data.
The calculation unit calculates the volume information using the first portion and the second portion of the sound data of the target after the filter processing.
The filter processing unit performs bandpass filter processing in which the cutoff frequency on the low frequency side is f _L1 [Hz] and the cutoff frequency on the high frequency side is f _H1 [Hz].
50 ≤ f _L1 ≤ 150 holds,
A processing device in which 500 ≦ f _H1 ≦ 1500 holds.
1-5. 1-1. From 1-4. In the processing apparatus described in any one of
The acquisition unit acquires a plurality of the sound data indicating the sounds detected by the plurality of sensors, and obtains the sound data.
The section specifying unit generates at least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section based on the first sound data.
The calculation unit identifies the first part and the second part of the sound data of the target by using at least one of the first time information and the second time information.
The target sound data is a processing device including at least the second sound data different from the first sound data.
1-6. 1-5. In the processing apparatus described in
The first sound data indicates the sound detected by the first sensor provided at the first position on the surface or inside of the human body.
The second sound data indicates the sound detected by the second sensor provided at the second position on the surface or inside of the human body.
A processing device in which the first position is located in the neck or the first position is closer to the neck than the second position.
1-7. 1-1. From 1-4. In the processing apparatus described in any one of
The acquisition unit acquires a plurality of the sound data indicating the sounds detected by the plurality of sensors, and obtains the sound data.
The section identification part is
The first section and the second section are specified in each of the two or more sound data, and the first section and the second section are specified.
A third time information indicating the time range set as the first section in all of the two or more sound data or the time range set as the second section in all of the two or more sound data is generated.
The calculation unit is a processing device that identifies the first portion and the second portion of the sound data of the target by using the third time information.
1-8. 1-5. From 1-7. In the processing apparatus described in any one of
The calculation unit calculates the volume information of the plurality of sound data of the target, and calculates the volume information.
A processing device further including an estimation unit that estimates the position of a sound source of abnormal breath sounds based on the calculated plurality of volume information.
1-9. 1-1. The processing apparatus according to any one of 1 to 8 and
Equipped with a sensor,
The acquisition unit is a system that acquires the sound data indicating the sound detected by the sensor.
2-1. An acquisition step to acquire one or more sound data including breath sounds,
A section identification step that specifies at least one of a first section presumed to be breathing and a second section between the plurality of first sections.
Using the first part of the sound data of the target determined based on the first section and the second part of the sound data of the target determined based on the second section of the target sound data. , A processing method that includes a calculation step to calculate volume information indicating the breathing volume.
2-2. 2-1. In the processing method described in
In the calculation step,
The first signal strength, which is the strength of the first portion of the target sound data, and the second signal strength, which is the strength of the second portion of the target sound data, are calculated.
A processing method for calculating the volume information of the target sound data using the first signal strength and the second signal strength.
2-3. 2-2. In the processing method described in
In the calculation step, a processing method of calculating information for specifying the ratio of the first signal strength to the second signal strength as the volume information of the target sound data.
2-4. 2-1. From 2-3. In the processing method described in any one of
Further including a filtering step for filtering the target sound data at least.
In the calculation step, the volume information is calculated using the first portion and the second portion of the sound data of the target after the filtering process.
In the filter processing step, bandpass filtering is performed in which the cutoff frequency on the low frequency side is f _L1 [Hz] and the cutoff frequency on the high frequency side is f _H1 [Hz].
50 ≤ f _L1 ≤ 150 holds,
A processing method in which 500 ≦ f _H1 ≦ 1500 holds.
2-5. 2-1. From 2-4. In the processing method described in any one of
In the acquisition step, a plurality of the sound data indicating the sounds detected by the plurality of sensors are acquired, and the sound data is acquired.
In the section specifying step, at least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section is generated based on the first sound data.
In the calculation step, at least one of the first time information and the second time information is used to identify the first part and the second part of the sound data of the target.
A processing method in which the target sound data includes at least the second sound data different from the first sound data.
2-6. 2-5. In the processing method described in
The first sound data indicates the sound detected by the first sensor provided at the first position on the surface or inside of the human body.
The second sound data indicates the sound detected by the second sensor provided at the second position on the surface or inside of the human body.
A treatment method in which the first position is located in the neck, or the first position is closer to the neck than the second position.
2-7. 2-1. From 2-4. In the processing method described in any one of
In the acquisition step, a plurality of the sound data indicating the sounds detected by the plurality of sensors are acquired, and the sound data is acquired.
In the section identification step,
The first section and the second section are specified in each of the two or more sound data, and the first section and the second section are specified.
A third time information indicating the time range set as the first section in all of the two or more sound data or the time range set as the second section in all of the two or more sound data is generated.
In the calculation step, a processing method for specifying the first portion and the second portion of the sound data of the target by using the third time information.
2-8. 2-5. From 2-7. In the processing method described in any one of
In the calculation step, the volume information of the plurality of sound data of the target is calculated.
A processing method further including an estimation step of estimating the position of a sound source of abnormal breath sounds based on the calculated plurality of volume information.
3-1. 2-1. From 2-8. A program that causes a computer to execute each step of the processing method described in any one of the above.
4-1. The acquisition unit that acquires sound data including breath sounds,
At least one of the first section in which breathing is presumed to be performed in the sound data and the second section between the plurality of first sections is used as a threshold value for a value indicating the amplitude of the sound data. Equipped with a section specific part to be specified,
The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the sound data.
The section specifying unit is a processing device that determines the threshold value based on the sound data.
4-2. 4-1. In the processing apparatus described in
The section identification part is
Find the mode of the value indicating the amplitude in the sound data,
Set the threshold value larger than the mode,
Among the sound data, the first process for specifying at least a section in which the value indicating the amplitude exceeds the threshold value is specified as the first section, and the section in which at least the value indicating the amplitude is less than the threshold value is the first section. A processing device that performs at least one of the second processing specified as two sections.
4-3. 4-2. In the processing apparatus described in
The threshold value is the mode among one or more values indicating the amplitude having a minimum value when the sound data is represented in a graph in which the horizontal axis represents the amplitude and the vertical axis represents the number of occurrences. A processing device that is a value indicating the amplitude closest to.
4-4. 4-3. In the processing apparatus described in
When the sound data is represented in the graph, the mode value is a processing device having the smallest value among the plurality of values indicating the amplitude having the maximum value.
4-5. 4-2. From 4-4. In the processing apparatus described in any one of
The section specifying unit obtains the mode value based on the sound data after filtering.
The filter processing is a bandpass filter processing in which the cutoff frequency on the low frequency side is f _L2 [Hz] and the cutoff frequency on the high frequency side is f _H2 [Hz].
150 ≤ f _L2 ≤ 250 holds,
A processing device in which 550 ≤ f _H2 ≤ 650 holds.
4-6. 4-2. From 4-5. In the processing apparatus described in any one of
The section specifying unit is a processing device that obtains the mode value based on data obtained by performing at least downsampling processing on the sound data.
4-7. 4-1. From 4-6. In the processing apparatus described in any one of
The acquisition unit acquires a plurality of the sound data indicating the sounds detected by the plurality of sensors, and obtains the sound data.
The section identification part is
At least one of the first section and the second section in the first sound data included in the plurality of sound data is specified.
At least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section is generated.
The first section and the second section of the second sound data, which is the sound data included in the plurality of sound data and is different from the first sound data, are the first time information and the second. A processing device that identifies based on at least one of the time information.
4-8. 4-7. In the processing apparatus described in
The first sound data indicates the sound detected by the first sensor provided at the first position on the surface or inside of the human body.
The second sound data indicates the sound detected by the second sensor provided at the second position on the surface or inside of the human body.
A processing device in which the first position is located in the neck or the first position is closer to the neck than the second position.
4-9. 4-1. From 4-6. In the processing apparatus described in any one of
The acquisition unit acquires a plurality of the sound data indicating the sounds detected by the plurality of sensors, and obtains the sound data.
The section identification part is
The first section and the second section are specified in each of the two or more sound data, and the first section and the second section are specified.
Processing to generate third time information indicating the time range specified as the first section in all of the two or more sound data, or the time range specified as the second section in all of the two or more sound data. Device.
4-10. 4-1. From 4-9. With the processing device described in any one of
Equipped with a sensor,
The acquisition unit is a system that acquires the sound data indicating the sound detected by the sensor.
5-1. The acquisition step to acquire sound data including breath sounds, and
At least one of the first section in which breathing is presumed to be performed in the sound data and the second section between the plurality of first sections is used as a threshold value for a value indicating the amplitude of the sound data. Including the section specific step to be specified
The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the sound data.
In the section specifying step, a processing method of determining the threshold value based on the sound data.
5-2. 5-1. In the processing method described in
In the section identification step,
Find the mode of the value indicating the amplitude in the sound data,
Set the threshold value larger than the mode,
Among the sound data, the first process for specifying at least a section in which the value indicating the amplitude exceeds the threshold value is specified as the first section, and the section in which at least the value indicating the amplitude is less than the threshold value is the first section. A processing method in which at least one of the second processes specified as two sections is performed.
5-3. 5-2. In the processing method described in
The threshold value is the mode among one or more values indicating the amplitude having a minimum value when the sound data is represented in a graph in which the horizontal axis represents the amplitude and the vertical axis represents the number of occurrences. A processing method that is a value indicating the amplitude closest to.
5-4. 5-3. In the processing method described in
When the sound data is represented in the graph, the mode is the smallest value among the plurality of values indicating the amplitude having the maximum value, which is the processing method.
5-5. 5-2. From 5-4. In the processing method described in any one of
In the section specifying step, the mode is obtained based on the sound data after the filtering process.
The filter processing is a bandpass filter processing in which the cutoff frequency on the low frequency side is f _L2 [Hz] and the cutoff frequency on the high frequency side is f _H2 [Hz].
150 ≤ f _L2 ≤ 250 holds,
A processing method in which 550 ≤ f _H2 ≤ 650 holds.
5-6. 5-2. From 5-5. In the processing method described in any one of
In the section specifying step, a processing method for obtaining the mode value based on data obtained by performing at least downsampling processing on the sound data.
5-7. 5-1. From 5-6. In the processing method described in any one of
In the acquisition step, a plurality of the sound data indicating the sounds detected by the plurality of sensors are acquired, and the sound data is acquired.
In the section identification step,
At least one of the first section and the second section in the first sound data included in the plurality of sound data is specified.
At least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section is generated.
The first section and the second section of the second sound data, which is the sound data included in the plurality of sound data and is different from the first sound data, are the first time information and the second. A processing method that identifies based on at least one of the time information.
5-8. 5-7. In the processing method described in
The first sound data indicates the sound detected by the first sensor provided at the first position on the surface or inside of the human body.
The second sound data indicates the sound detected by the second sensor provided at the second position on the surface or inside of the human body.
A treatment method in which the first position is located in the neck, or the first position is closer to the neck than the second position.
5-9. 5-1. From 5-6. In the processing method described in any one of
In the acquisition step, a plurality of the sound data indicating the sounds detected by the plurality of sensors are acquired, and the sound data is acquired.
In the section identification step,
The first section and the second section are specified in each of the two or more sound data, and the first section and the second section are specified.
Processing to generate third time information indicating the time range specified as the first section in all of the two or more sound data, or the time range specified as the second section in all of the two or more sound data. Method.
6-1. 5-1. From 5-9. A program that causes a computer to execute each step of the processing method described in any one of the above.

This application claims priority on the basis of Japanese Application Japanese Patent Application No. 2018-205536 filed on October 31, 2018 and incorporates all of its disclosures herein.

Claims (11)

The acquisition unit that acquires sound data including breath sounds,
At least one of the first section in which breathing is presumed to be performed in the sound data and the second section between the plurality of first sections is used as a threshold value for a value indicating the amplitude of the sound data. Equipped with a section specific part to be specified,
The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the sound data.
The section specifying unit determines the threshold value based on the sound data, and determines the threshold value.
The section identification part is
Find the mode of the value indicating the amplitude in the sound data,
Set the threshold value larger than the mode,
Among the sound data, the first process for specifying at least a section in which the value indicating the amplitude exceeds the threshold value is specified as the first section, and the section in which at least the value indicating the amplitude is less than the threshold value is the first section. Perform at least one of the second processes specified as two sections
Processing equipment. In the processing apparatus according to claim 1 ,
The threshold value is the mode among one or more values indicating the amplitude having a minimum value when the sound data is represented in a graph in which the horizontal axis represents the amplitude and the vertical axis represents the number of occurrences. A processing device that is a value indicating the amplitude closest to. In the processing apparatus according to claim 2 ,
When the sound data is represented in the graph, the mode value is a processing device having the smallest value among the plurality of values indicating the amplitude having the maximum value. In the processing apparatus according to any one of claims 1 to 3 ,
The section specifying unit obtains the mode value based on the sound data after filtering.
The filter processing is a bandpass filter processing in which the cutoff frequency on the low frequency side is f _L2 [Hz] and the cutoff frequency on the high frequency side is f _H2 [Hz].
150 ≤ f _L2 ≤ 250 holds,
A processing device in which 550 ≤ f _H2 ≤ 650 holds. In the processing apparatus according to any one of claims 1 to 4 .
The section specifying unit is a processing device that obtains the mode value based on data obtained by performing at least downsampling processing on the sound data. In the processing apparatus according to any one of claims 1 to 5 ,
The acquisition unit acquires a plurality of the sound data indicating the sounds detected by the plurality of sensors, and obtains the sound data.
The section identification part is
At least one of the first section and the second section in the first sound data included in the plurality of sound data is specified.
At least one of the first time information indicating the time range of the first section and the second time information indicating the time range of the second section is generated.
The first section and the second section of the second sound data, which is the sound data included in the plurality of sound data and is different from the first sound data, are the first time information and the second. A processing device that identifies based on at least one of the time information. In the processing apparatus according to claim 6 ,
The first sound data indicates the sound detected by the first sensor provided at the first position on the surface or inside of the human body.
The second sound data indicates the sound detected by the second sensor provided at the second position on the surface or inside of the human body.
A processing device in which the first position is located in the neck or the first position is closer to the neck than the second position. In the processing apparatus according to any one of claims 1 to 5 ,
The acquisition unit acquires a plurality of the sound data indicating the sounds detected by the plurality of sensors, and obtains the sound data.
The section identification part is
The first section and the second section are specified in each of the two or more sound data, and the first section and the second section are specified.
Processing to generate third time information indicating the time range specified as the first section in all of the two or more sound data, or the time range specified as the second section in all of the two or more sound data. Device. The processing apparatus according to claim 1 and
Equipped with a sensor,
The acquisition unit is a system that acquires the sound data indicating the sound detected by the sensor. The acquisition step to acquire sound data including breath sounds, and
At least one of the first section in which breathing is presumed to be performed in the sound data and the second section between the plurality of first sections is used as a threshold value for a value indicating the amplitude of the sound data. Including the section specific step to be specified
The value indicating the amplitude is a value indicating the magnitude of vibration at each time of the sound data.
In the section specifying step, the threshold value is determined based on the sound data, and the threshold value is determined .
In the section identification step,
Find the mode of the value indicating the amplitude in the sound data,
Set the threshold value larger than the mode,
Among the sound data, the first process for specifying at least a section in which the value indicating the amplitude exceeds the threshold value is specified as the first section, and the section in which at least the value indicating the amplitude is less than the threshold value is the first section. Perform at least one of the second processes specified as two sections
Processing method. A program that causes a computer to execute each step of the processing method according to claim 10.

Images