JP5939480B1 - Terminal device, diagnostic system and program - Google Patents

Abstract

The present invention makes it easier to identify the cause of abnormal noise as compared with the case of performing frequency analysis without specifying the position from which sound information is acquired. A sound acquisition unit 31 acquires sound information by inputting an abnormal sound generated in an image forming apparatus 20 that is an apparatus to be analyzed. The reception unit 38 receives recording position information for acquiring sound information by the user. The frequency analysis unit 32 performs STFT (short-time Fourier transform) on the sound information acquired by the sound acquisition unit 31 to generate frequency spectrum waveform data. The controller 33 resembles the generated frequency spectrum waveform and the frequency spectrum waveform generated from the plurality of frequency spectral waveforms of the server device 50, and selects the spectrum waveform selected based on the received recording position information. Receive. [Selection] Figure 3

Description

  The present invention relates to a terminal device, a diagnostic system, and a program.

  Patent Document 1 has a RAM or ROM that stores a normal operation sound of the image forming apparatus and a microphone that detects an operation sound generated from the image forming apparatus, and is stored in the RAM or ROM. A system is disclosed that identifies an abnormal part of an image forming apparatus based on first sound information, second sound information detected by a microphone, and operation information of the image forming apparatus.

  In Patent Document 2, in an image processing apparatus having an image forming unit that forms an image on printing paper and a transport unit that transports the printing paper, a sound conversion unit that converts sound inside the device into an electrical signal, An image processing apparatus including a sound analysis unit that analyzes an electrical signal converted by a sound conversion unit to obtain a component for each frequency and an output unit that outputs a component for each frequency obtained by the sound analysis unit is disclosed. Yes.

JP 2007-079263 A1 JP 2008-290288 A

  When abnormal sound (abnormal sound) occurs in a certain device, sound information is acquired by inputting the sound generated in the analysis target device, and it is generated in the past in the acquired sound information and a device equivalent to the analysis target device. There is a case where the cause of the abnormal noise is clarified by comparing the abnormal noise information.

  In such a case, there may be many waveforms similar to the waveform of the frequency analysis result of the acquired sound information, and it is difficult to specify the cause of the abnormal sound.

  An object of the present invention is to provide a terminal device, a diagnostic system, and a program capable of facilitating specification of the cause of abnormal noise as compared with the case of performing frequency analysis without specifying the position from which sound information is acquired. It is.

[Terminal device]
The present invention according to claim 1 is an acquisition unit that acquires sound information, a reception unit that receives position information about a position from which sound information is acquired, and a plurality of analysis results obtained by performing frequency analysis of the sound signal. Display means for displaying an analysis result selected based on position information received by the receiving means among analysis results similar to an analysis result obtained by performing frequency analysis of sound information acquired by the acquiring means; Is a terminal device.

  According to a second aspect of the present invention, there is provided frequency analysis means for generating an analysis result representing a temporal change in intensity distribution for each frequency by performing time-frequency analysis of sound information acquired by the acquisition means, and the frequency analysis Information obtained from the analysis result generated by the means, position information received by the receiving means, transmitting means for transmitting device information relating to the device to be measured to an external device, and frequency analysis of the sound signal Receive from the external device the analysis result selected based on the positional information received by the receiving means among the analysis results similar to the analysis result generated by the frequency analyzing means from among the plurality of obtained analysis results Means for displaying the analysis result generated by the frequency analysis means and the analysis result received by the reception means. A terminal apparatus according to claim 1.

  The present invention according to claim 3 is the terminal device according to claim 1 or 2, wherein the display means displays different analysis results corresponding to the position information received by the receiving means.

  According to a fourth aspect of the present invention, when the display means displays a plurality of analysis results, the order of the analysis results to be displayed is changed corresponding to the position information received by the reception means. 4. The terminal device according to any one of 3 above.

  According to a fifth aspect of the present invention, the display means displays an appearance of a target device that is a measurement target, and the receiving means receives position information of the target device displayed on the display means. It is a terminal device of any one of these.

  According to a sixth aspect of the present invention, the display means displays an appearance in a direction different from the appearance of the target device, and the receiving means displays the target device displayed on the display means for each appearance in a different direction. The terminal device according to claim 5 which receives position information.

[Diagnostic system]
According to a seventh aspect of the present invention, there is provided an acquisition means for acquiring sound information, a reception means for receiving position information relating to a position from which sound information is acquired, and a plurality of analysis results obtained by performing frequency analysis of the sound signal. Display means for displaying an analysis result selected based on position information received by the receiving means among analysis results similar to an analysis result obtained by performing frequency analysis of sound information acquired by the acquiring means; A terminal device including: a storage unit that stores a plurality of analysis results obtained by performing frequency analysis of a sound signal and sound generation position information; and the position information received from the terminal device by the receiving unit When the information obtained from the analysis result obtained by performing the frequency analysis of the sound information obtained by the means is received, the information is received from the plurality of analysis results stored in the storage means. A server device comprising: a transmission unit that transmits to the terminal device an analysis result selected based on position information received by the receiving unit among analysis results similar to the analysis result obtained. It is.

[program]
The present invention according to claim 8 is an acquisition step for acquiring sound information, a reception step for receiving position information relating to a position from which sound information is acquired, and a plurality of analysis results obtained by performing frequency analysis of the sound signal. A display step for displaying the analysis result selected based on the positional information received by the receiving step among the analysis results similar to the analysis result obtained by performing the frequency analysis of the sound information acquired by the acquiring step; Is a program for causing a computer to execute.

  According to the first aspect of the present invention, it is possible to provide a terminal device that can easily identify the cause of abnormal noise as compared with the case of performing frequency analysis without specifying the position from which sound information is acquired. it can.

  According to the second aspect of the present invention, it is possible to provide a terminal device capable of specifying the cause of abnormal noise by comparing two displayed analysis results.

  According to the third aspect of the present invention, it is possible to provide a terminal device that can easily identify the cause of abnormal noise based on the analysis result selected corresponding to the position information.

  According to the fourth aspect of the present invention, it is possible to provide a terminal device that can display an analysis result having a high possibility of causing abnormal noise as compared with a case where the order of analysis results is not changed.

  According to the fifth aspect of the present invention, it is possible to provide a terminal device that can be easily shown to the user as compared with a case where position information is received without displaying the appearance of the target device.

  According to the sixth aspect of the present invention, it is possible to more accurately identify the cause of the abnormal noise based on the position information than when the position information is received without displaying the appearance of the target device in different directions. A terminal device that can be provided can be provided.

  According to the seventh aspect of the present invention, it is possible to provide a diagnostic system that can easily identify the cause of abnormal noise as compared with the case of performing frequency analysis without specifying the position from which sound information is acquired. it can.

  According to the eighth aspect of the present invention, it is possible to provide a program that can easily identify the cause of abnormal noise, as compared with the case of performing frequency analysis without specifying the position from which sound information is acquired. .

It is a system diagram showing a configuration of an abnormal sound diagnosis system of one embodiment of the present invention. It is a block diagram which shows the hardware constitutions of the terminal device 10 in one Embodiment of this invention. It is a block diagram which shows the function structure of the terminal device 10 in one Embodiment of this invention. It is a block diagram which shows the function structure of the server apparatus 50 in one Embodiment of this invention. It is a figure which shows an example of the information stored in the waveform data storage part 53 in FIG. It is a sequence chart for demonstrating operation | movement of the abnormal sound diagnostic system of one Embodiment of this invention. It is a figure which shows the example of a display screen of the terminal device 10 at the time of inputting various information, such as a model name, a serial number, and an operation state. It is a figure which shows the example of a display screen at the time of inputting the recording position with respect to the image forming apparatus 20 of the terminal device 10 by a user. It is a figure which shows the example of a display screen at the time of inputting the recording position with respect to the image forming apparatus 20 of the terminal device 10 by a user. It is a figure which shows the example of a display screen for confirming a recording position with a user. It is a figure for demonstrating the concept of STFT. It is a figure which shows the example of an image of the frequency spectrum waveform based on the analysis result obtained by STFT. It is a figure which shows an example at the time of showing to a user to designate the area | region estimated to be abnormal sound when showing a frequency spectrum waveform to a user. It is a figure which shows an example of the selection area | region 80 selected by the user in the image example of the frequency spectrum waveform of FIG. It is a figure which shows the example of an analysis result of a fast Fourier transform. It is a flowchart for demonstrating the detail of operation | movement of step S107 in FIG. It is a figure which shows an example of the operation | movement which displays the analysis result selected based on position information. It is a figure which shows the example of a screen of the terminal device 10 on which two frequency spectrum waveforms were displayed. It is a figure which shows the example of a screen when another frequency spectrum waveform from which the cause of abnormal noise differs is displayed with respect to the example of a screen shown in FIG. It is a figure which shows the other example of a display screen which displays a noise cause with respect to the example of a screen shown in FIG.

  Next, embodiments of the present invention will be described in detail with reference to the drawings.

  FIG. 1 is a system diagram showing a configuration of an abnormal sound diagnosis system according to an embodiment of the present invention.

  As shown in FIG. 1, the abnormal sound diagnosis system according to an embodiment of the present invention includes a portable terminal device 10 such as a personal computer, a smartphone, and a tablet terminal device, and a server device 50.

  Note that the present invention is applicable to any terminal device 10 as long as it is a device that can be connected to the server device 50 via a communication network. However, in this embodiment, the terminal device 10 will be described using a case of a tablet terminal device including a device such as a microphone capable of acquiring sound information and a touch panel capable of touch input.

  The terminal device 10 is carried by a service person (maintenance personnel) who performs maintenance management, repair, etc. of the image forming apparatus 20 such as a printer used by an end user, and an abnormal sound (abnormal sound) generated in the image forming apparatus 20. In order to acquire a signal and perform frequency analysis on the acquired abnormal sound signal, or to display a frequency analysis result waveform of a past abnormal sound signal acquired from the server device 50 and a frequency analysis result waveform of the acquired abnormal sound signal. Used for.

  The terminal device 10 and the server device 50 are connected via a wireless LAN terminal 30 such as a Wi-Fi router or the Internet communication network 40 to transmit and receive information.

  When the terminal device 10 is a mobile phone device, a smartphone, or the like, it is also possible to connect the terminal device 10 and the server device 50 via a mobile phone line network to transmit / receive defect information. is there.

  In the abnormal sound diagnosis system of the present embodiment, when an abnormal sound occurs in the image forming apparatus 20 that is a target electronic device installed at the end user's place, a service person carries the terminal device 10 and the image forming apparatus 20 Go to the place. And this service person acquires the abnormal sound signal by recording the abnormal sound generated using the terminal device 10, and performs the abnormal sound diagnosis for identifying the cause of the abnormal sound.

  Although it is technically possible to provide a recording function by providing a microphone or the like in the image forming apparatus 20 and when the abnormal sound is generated, the abnormal sound can be recorded by the recording function. Is installed in an end user's office or the like, it is impossible to provide the image forming apparatus 20 with a sound recording function for security reasons.

  Next, FIG. 2 shows a hardware configuration of the terminal device 10 in the abnormal sound diagnosis system of the present embodiment.

  As illustrated in FIG. 2, the terminal device 10 performs wireless communication with the CPU 11, the memory 12 that can temporarily store data, the storage device 13 such as a flash memory, and the wireless LAN terminal 30 to transmit data. And a wireless LAN interface (IF) 14 that performs reception, an input device 15 such as a touch sensor, a display device 16, and a microphone 17. These components are connected to each other via a control bus 18.

  In the terminal device 10 of the present embodiment, a touch panel provided with a touch sensor for detecting a touch position as the input device 15 is provided on the display device 16, and display is performed using the touch panel and from the user. Is entered.

  The CPU 11 controls the operation of the terminal device 10 by executing predetermined processing based on a control program stored in the memory 12 or the storage device 13. The control program can be obtained by downloading via the Internet communication network 40 or the mobile phone network and provided to the CPU 11, or the program can be stored in a storage medium such as a CD-ROM. It is also possible to provide it to the CPU 11.

  The terminal device 10 according to the present embodiment performs operations as described below by executing the control program described above, and assists a service person in identifying the cause of abnormal noise.

  FIG. 3 is a block diagram showing a functional configuration of the terminal device 10 realized by executing the control program.

  As illustrated in FIG. 3, the terminal device 10 according to the present embodiment includes a sound acquisition unit 31, a frequency analysis unit 32, a control unit 33, a sound data storage unit 34, a display unit 35, and a communication unit 36. A sound reproducing unit 37 and a position receiving unit 38.

  The display unit 35 displays various data based on the control by the control unit 33. The communication unit 36 communicates with the server device 50 that is an external device. Based on the control by the control unit 33, the sound reproduction unit 37 reproduces the recorded sound data and converts it into sound information.

  The position receiving unit 38 receives recording position information as position information that is a position for recording (acquiring) abnormal sound generated in the image forming apparatus 20 that is an apparatus to be analyzed.

  The sound acquisition unit 31 acquires sound information by inputting an abnormal sound generated in the image forming apparatus 20 that is an analysis target apparatus.

  The frequency analysis unit 32 performs a time frequency analysis (time-dependent frequency analysis) of the sound information acquired by the sound acquisition unit 31, and represents a frequency spectrum representing a time change of the signal intensity distribution for each frequency of the acquired abnormal sound signal. Waveform (frequency analysis result waveform) data is generated.

  Specifically, the frequency analysis unit 32 generates frequency spectrum waveform data by performing STFT (Short time Fourier transform) on the sound information acquired by the sound acquisition unit 31. The description of this STFT will be described later.

  The control unit 33 stores the frequency spectrum waveform data obtained by the frequency analysis unit 32 in the sound data storage unit 34 together with the sound data. And the control part 33 is controlled to display the frequency spectrum waveform obtained by the result of STFT on the display part 35 which is a touch panel.

  Thereafter, when the user performs a touch operation such as tracing a region that is assumed to be an abnormal signal component in the frequency spectrum waveform displayed on the display unit 35 that is a touch panel, the control unit 33 Based on the user's touch operation, the designation of the region including the abnormal signal component in the displayed frequency spectrum waveform is accepted.

  Then, the control unit 33 performs frequency analysis in the time axis direction on the frequency components in the region designated as the region including the abnormal sound signal component in the frequency spectrum waveform data obtained by the frequency analysis unit 32. The frequency analysis unit 32 is instructed to perform fast Fourier transform (1D-FFT (Fast Fourier Transform)). Therefore, the frequency analysis unit 32 performs fast Fourier transform in the time axis direction on the frequency component included in the designated region.

  Then, the control unit 33 extracts the period and frequency information of the abnormal sound from the analysis result of the fast Fourier transform in the frequency analysis unit 32.

  Even when no abnormal sound is generated, the signal component of the normal operation sound is always included in the low frequency region below the preset frequency. For this reason, the control unit 33 may not accept the designation of a region having a frequency equal to or lower than a preset frequency even when the region is designated as a region including an abnormal sound signal component.

  In addition, the control unit 33 indicates the received recording position information, the acquired sound cycle and frequency information, the model name of the image forming apparatus 20, model information such as a serial number, and the operating state of the image forming apparatus 20. It transmits to the server apparatus 50 via the communication part 36 with operating state information. Specifically, this operation status information includes information such as color printing or monochrome printing, duplex printing or single-sided printing, whether the operation mode is scan, print, or copy, and the type of paper used. Can be included. In this way, the control unit 33 receives the recording position information received from the position receiving unit 38 and the information obtained from the frequency spectrum waveform data obtained by the frequency analyzing unit 32 via the communication unit 36 and the server device 50. Send to.

  In the server device 50, the original sound data and the sound data are acquired from the spectrum waveform data obtained by performing frequency analysis of the sound information of the abnormal sound generated in the past in the device equivalent to the device of the image forming device 20. The information is stored together with information such as the operating state of the device at the time, the cause of the abnormal noise, the method for dealing with the abnormal noise, the occurrence position of the abnormal noise (abnormal noise occurrence position information), and the like.

  Then, the server apparatus 50 extracts the frequency spectrum waveform obtained as a result of the frequency analysis by the frequency analysis unit 32 by extracting from the period and frequency information of the abnormal sound transmitted from the terminal apparatus 10 and further extracting from the recording position information. The frequency spectrum waveform data corresponding to the data is searched, and the found frequency spectrum waveform data is transmitted to the terminal device 10 together with information such as sound data stored as abnormal sample waveform data.

  As a result, the control unit 33 receives the frequency spectrum waveform data corresponding to the frequency spectrum waveform data obtained as a result of the frequency analysis by the frequency analysis unit 32 from the server device 50 via the communication unit 36.

  The control unit 33 controls the display unit 35 to display the frequency spectrum waveform obtained by performing the frequency analysis of the sound information acquired by the sound acquisition unit 31 and the spectrum waveform received from the server device 50 in parallel. .

  The control unit 33 uses the received recording position information among the waveform data similar to the frequency spectrum waveform data obtained by the frequency analysis of the frequency analysis unit 32 from the plurality of frequency spectrum waveform data from the server device 50. The waveform data preferentially selected based on the received data is received and displayed on the display unit 33.

  Next, the functional configuration of the server device 50 in the abnormal sound analysis system of this embodiment will be described with reference to the block diagram of FIG.

  As shown in FIG. 4, the server device 50 according to the present embodiment includes a communication unit 51, a control unit 52, and a waveform data storage unit 53.

  The waveform data storage unit 53 stores a plurality of frequency spectrum waveform data obtained by performing frequency analysis of sound information of abnormal sounds generated in the past in an apparatus equivalent to the image forming apparatus 20 that is an analysis target apparatus.

  Specifically, as shown in FIG. 5, the waveform data storage unit 53 includes frequency spectrum waveform data obtained by analyzing time-frequency analysis of abnormal sound data acquired in advance, and the original sound. Information such as data, causes of abnormal noise, countermeasures, and abnormal noise occurrence positions are stored for each model. Abnormal noise often exists in a plurality of regions of the apparatus, and information on the plurality of regions is stored as the abnormal sound occurrence position.

  When the control unit 52 receives information on the period and frequency of abnormal noise from the terminal device 10, the control unit 52 receives the abnormal period received from the waveform data of a plurality of frequency spectra stored in the waveform data storage unit 53. Based on the information on the frequency and the frequency information, the terminal device 10 selects the one similar to the waveform data of the frequency spectrum based on the abnormal sound, and further communicates the one displayed preferentially based on the received recording position information. It transmits to the terminal device 10 via the unit 51.

  In the present embodiment, the terminal device 10 is described as performing STFT and fast Fourier transform on abnormal sound data, and transmitting the period and frequency information of the abnormal sound to the server device 50. Both the Fourier transform, STFT, and fast Fourier transform may be executed on the server device 50 side.

  In this case, abnormal sound data is transmitted as it is from the terminal device 10 to the server device 50, or frequency spectrum waveform data obtained as a result of performing STFT on the sound data is transmitted. The STFT or fast Fourier transform is performed on the data.

  In the above-described embodiment, among the plurality of analysis results, those similar to the frequency and period information of the abnormal sound are extracted and then extracted based on the position information of the abnormal sound. You may make it extract the thing similar to the information of the frequency of a strange sound, and a period after extracting based on position information.

  Further, although the waveform data stored in the waveform data storage unit 53 has been described using a case where a plurality of regions where there is a high possibility of occurrence of abnormal noise are stored as the abnormal noise occurrence position information, the present invention is However, the present invention is not limited to this, and the number of occurrences may be one, and the occurrence probability for each region may be stored.

  In addition, although it has been described that information on a plurality of areas is stored as an abnormal sound generation position, the present invention is not limited to this, and priority is given to an area where there is a high possibility of generating abnormal sounds for each waveform data. You may make it store in order.

  Next, the operation of the abnormal sound diagnosis system of this embodiment will be described with reference to the sequence chart of FIG.

  When an abnormal sound diagnosis is performed to identify the cause of the abnormal sound of the image forming apparatus 20 as the target device to be measured in the terminal device 10, an image as shown in FIG. Device information such as a number and an operating state is input (step S101).

Next, an illustration image of the appearance of the image forming apparatus 20 corresponding to the input apparatus information as shown in FIG. 8 is displayed on the screen (touch panel) which is the display unit 35 of the terminal apparatus 10.
On the terminal device 10, auxiliary lines 90, 91, and 92 that divide the image forming apparatus 20 into six parts are displayed on the screen on which the image forming apparatus 20 is displayed.
These three auxiliary lines 90, 91 and 92 are displayed so as to divide the image forming apparatus 20 into six areas a, area b, area c, area d, area e and area f. In FIG. The information is displayed so as to be divided into a region Aa, a region Ab, a region Ac, a region Ad, a region Ae, and a region Af. The user can specify the recording position by selecting one of the area Aa, area Ab, area Ac, area Ad, area Ae, and area Af on the screen and performing a touch operation with the finger 65 (hereinafter referred to as a tap). The recording position information is received by the control unit 33.

Further, when the user taps from the front image A of the apparatus shown in FIG. 8 to slide the screen 65 in the horizontal and vertical directions with the finger 65, the appearance of the image forming apparatus 20 in different directions is displayed. The appearance is rotated and changed by 90 degrees. That is, on the screen, the display image of the image forming apparatus 20 can be made to be different from any one of the front image A, the right side image B, the back image C, the left side image D, and the top image E. ing.
Specifically, as shown in FIG. 9, whenever the user taps to slide the image of the image forming apparatus 20 on the screen to the left or right, the posture of the image forming apparatus 20 changes from the front image A to the left side image. D or right side image B, right side image B to front image A or back image C, back side image C to right side image B or left side image D, left side image D to back side image C or front image A And changed. Further, each time tapping is performed to slide up and down, the front image A, the right side image B, the back image C, or the left side image D is changed to the top image E, and the top image E is changed to the front image A and the right side image. B, rear image C or left image D. That is, the recording position information is changed for each appearance of the image forming apparatus 20 on the screen in different directions based on the user's operation. Further, each of the images B to E is displayed by superimposing auxiliary lines 90, 91, and 92 which are divided into six similarly to the front image A, and the right side image B is displayed in the areas Ba, Bb, Bc, Bd, Be, and Bf. The back image C is in the areas Ca, Cb, Cc, Cd, Ce, Cf, the left side image D is in the areas Da, Db, Dc, Dd, De, Df, and the top image E is in the areas Ea, Eb. , Ec, Ed, Ee, Ef. The three auxiliary lines 90, 91, and 92 are arranged so that the area into which the apparatus is divided differs depending on the apparatus information, the orientation of the apparatus, and the like.
Here, the illustration image of the appearance of the image forming apparatus 20 has been described, but a photographic image of the appearance of the image forming apparatus 20 may be used. In addition, although it has been described that the tap is made to slide left and right and up and down on the screen, the present invention is not limited to this, and a rotation arrow key is provided on the screen, and the image can be rotated by tapping the rotation arrow key. Good.
That is, the user designates the direction of the appearance of the image forming apparatus 20 from which sound information is acquired, and further designates the divided area of the appearance of the apparatus, whereby the recording position of the abnormal sound is accepted as the recording position information (step S102). ).

  Then, in the terminal device 10, as shown in FIG. 10, the operation mode is set to the sound recording mode, and recording is started by bringing the microphone 17 close to the abnormal sound generation position where the recording position information of the image forming apparatus 20 is accepted. To obtain sound data (step S103).

  Then, the terminal device 10 generates a frequency spectrum waveform representing the time change of the signal intensity distribution for each frequency by performing STFT on the acquired sound data in the frequency analysis unit 32 (step S104).

  As shown in FIG. 11, the STFT is obtained by performing Fourier transform every short time and calculating the signal intensity for each frequency component according to the time change. FIG. 12 shows a waveform example when the analysis result obtained by this STFT is an image of one frequency spectrum waveform.

  In the frequency spectrum waveform example shown in FIG. 12, the horizontal axis represents time, the vertical axis represents frequency, and the intensity for each frequency is represented by color. In FIG. 12, this color difference is represented by a hatching pattern. FIG. 12 illustrates the case where the intensity for each frequency is expressed by color, but this intensity can also be expressed by gradation.

  In the frequency spectrum waveform example of FIG. 12, it can be seen that the abnormal frequency component 61 is periodically generated at a specific frequency. In the frequency spectrum waveform example shown in FIG. 12, the low frequency component is a normal operation sound and not an abnormal frequency component.

  When the frequency spectrum waveform as shown in FIG. 12 is obtained, the control unit 33 displays the frequency spectrum waveform on the display unit 35. Then, as shown in FIG. 13, the control unit 33 performs a display that prompts the user to designate a region that is estimated to be abnormal sound, with respect to the displayed frequency spectrum waveform. In the example shown in FIG. 13, the text “Please specify an area that seems to be abnormal noise.” Is displayed and the user is prompted to specify an area that is estimated to be abnormal noise. I understand.

  Then, by referring to such a display, the user who is presented with the frequency spectrum waveform specifies the abnormal frequency component 61, and the abnormal frequency component 61 is included by operating the touch panel, for example. Select an area.

  An example of the selection area 80 selected by the user in this way is shown in FIG. In the example shown in FIG. 14, it can be seen that a rectangular area including a plurality of abnormal frequency components 61 is designated as the selection area 80.

  When the selection region 80 is designated in this way, the fast Fourier transform (1D-FFT) for the frequency components included in the selection region 80 is executed by the frequency analysis unit 32 (step S105). An example of the analysis result of the fast Fourier transform executed in this way is shown in FIG.

  In FIG. 15, the period and frequency of the abnormal sound are specified by detecting the period and frequency of the signal of the frequency component subjected to the fast Fourier transform. In addition, since an overtone component etc. are contained in abnormal sound, a some period may be detected, but the period with the strongest signal strength is detected as an abnormal sound period.

  In addition, since a signal component having a long period of a predetermined period or more is considered to be normal operation sound or indefinite period noise, such a long-cycle signal component region is set as a determination exclusion region 62 in the determination exclusion region 62. Analysis results are ignored.

  Furthermore, since the low frequency signal component below the predetermined frequency cannot be distinguished from the normal operation sound, such a low frequency signal component region is set as the determination exclusion region 63, and the analysis result in the determination exclusion region 63 is as follows. It will be ignored.

  Based on the analysis result of the fast Fourier transform, the terminal device 10 transmits the information on the frequency and period of the abnormal sound and the recording position information on the recording position where the abnormal sound was recorded, together with the model information and the operating state information, to the server device 50 ( Step S106). For example, information that the recording position is the region Ab, the abnormal sound frequency is 4 kHz, and the abnormal sound period is 2.0 seconds is transmitted to the server device 50.

  Then, the server device 50 searches the waveform data storage unit 53 based on the received frequency and cycle information of the abnormal sound (step S107).

  Details of the operation in step S107 will be described with reference to an example of an operation for displaying the analysis result selected based on the flowchart in FIG. 16 and the position information in FIG. In FIG. 17, a case where the area Ab is received as the recording position information will be described as an example.

  The server device 50 receives the frequency, period information, and recording position information of the abnormal sound from the terminal device 10 (step S201).

  Next, it is determined whether the frequency and period information of the received abnormal sound is similar to the waveform data stored in the waveform data storage unit 53 (step S202). Waveform data determined to be similar is extracted (step S203). The determination in step S202 is executed for all waveform data stored in the waveform data storage unit 53 (step S204), and an extraction list as shown in FIG. 17A is generated (step S205). Here, in FIG. 17, only the waveform data of the frequency analysis result and the abnormal sound occurrence position information are extracted and described, but the original sound data as shown in FIG. Information such as the cause and how to deal with it is also stored corresponding to the waveform data.

Next, it is determined whether or not any abnormal sound occurrence position information in the waveform data of the extraction list generated in step S205 matches the received recording position information (step S206).
Of the extraction list generated in step S205, the waveform data determined to match the position information is selected and extracted preferentially (step S207). Then, it is determined whether or not the determination in step S206 has been made for all waveform data in the generated extraction list (step S208).

  That is, the waveform data having the region Ab is extracted from the extraction list shown in FIG. 17A as the abnormal sound occurrence position information, and the waveform data 1 and the waveform having the region Ab as shown in FIG. Data 4 and waveform data 5 are preferentially displayed (higher) in the extraction list.

  Then, the server device 50 transmits the extracted frequency spectrum waveform data to the terminal device 10 together with information such as the original sound data, the cause of the abnormal sound, and a coping method thereof (step S108).

  Then, the terminal device 10 receives the frequency spectrum waveform data transmitted from the server device 50 (step S109). And the control part 33 of the terminal device 10 displays the received frequency spectrum waveform and the frequency spectrum waveform obtained by STFT on the display part 35 (step S110).

  FIG. 18 shows a screen example of the terminal device 10 on which two frequency spectrum waveforms are displayed in this way.

  In the screen example shown in FIG. 18, the frequency spectrum waveform obtained by the STFT in the frequency analysis unit 32 is displayed as “analysis result waveform of abnormal sound recorded this time”, and the recording position information transmitted from the server device 50. It can be seen that the frequency spectrum waveform preferentially selected by (i.e., high priority) is displayed as “past abnormal noise data” together with the cause of abnormal noise “photoconductor wear”.

  A serviceman who wants to perform abnormal noise diagnosis compares the two frequency spectrum waveforms and determines whether or not the abnormal noise components in the waveforms are similar, thereby identifying the cause of the abnormal noise.

  Further, when a plurality of frequency spectrum waveforms are transmitted from the server device 50, for example, by tracing a frequency spectrum waveform image displayed as “past abnormal sound data” in the horizontal direction by a touch operation, As shown in FIG. 19, another frequency spectrum waveform having the next highest priority is displayed.

  FIG. 19 shows an example of an image when the frequency spectrum waveform of abnormal noise is displayed when the abnormal noise is caused by “the drive system motor is defective”.

  When a plurality of frequency spectrum waveforms are transmitted as described above, the frequency spectrum waveforms selected from those having a high possibility of causing abnormal noise are displayed. The service person determines the cause of the abnormal noise by determining whether the frequency spectrum waveform of the abnormal noise acquired this time is more similar to the frequency spectrum waveform displayed in order of the high possibility of the occurrence of the abnormal noise. Identify. When identifying the cause of this abnormal noise, not only simply compare the shape of the frequency spectrum waveform, the period of the abnormal noise component, the frequency, the acquisition position of the abnormal noise, etc., but also the original sound data The cause of the abnormal sound is specified by listening to and comparing the abnormal sound reproduced this time by 37 and the sound corresponding to the frequency spectrum waveform transmitted from the server device 50.

  FIG. 20 shows another display screen example that displays the cause of abnormal noise.

In the example of the screen shown in FIG. 20, only the cause of abnormal noise and the countermeasures are displayed. The cause of the abnormal noise is “photoconductor wear” and the countermeasure is “replace the photoconductor”. The example of a screen when it is displayed is shown.
In this way, it is possible to designate and display the part that causes abnormal noise and the part number.

[Modification]
In the above embodiment, the case where the operation based on the recording position information is performed on the server device 50 side has been described. However, the present invention is not limited to this, and the operation may be performed on the terminal device 10 side.

  In the said embodiment, although demonstrated using the case where the terminal device 10 is a tablet terminal device, this invention is not limited to this. For example, in the case where the operation panel of the image forming apparatus 20 is detachable from the main body, is communicable with the server device 50, and has a built-in sound information acquisition function, the operation panel is used as a terminal device. You may make it.

  Moreover, although the said embodiment demonstrated using the case where the terminal device 10 incorporated the microphone 17, if the terminal device 10 is provided with the sound recording function, sound collection devices, such as a microphone, will be outside. It is also possible to realize a sound information acquisition means by connecting to.

  Furthermore, in the above-described embodiment, the case where the target device for abnormal noise analysis is an image forming device has been described. However, the target device for abnormal noise analysis is not limited to the image forming device, and the period The present invention can be similarly applied to other devices as long as they are devices that can generate abnormal noise with the same characteristics.

10 Terminal device 11 CPU
12 Memory 13 Storage Device 14 Wireless LAN Interface (IF)
DESCRIPTION OF SYMBOLS 15 Input apparatus 16 Display apparatus 17 Microphone 18 Control bus 20 Image forming apparatus 30 Wireless LAN terminal 31 Sound acquisition part 32 Frequency analysis part 33 Control part 34 Sound data storage part 35 Display part 36 Communication part 37 Sound reproduction part 38 Position reception part 40 Internet communication network 50 Server device 51 Communication unit 52 Control unit 53 Waveform data storage unit 61 Frequency component of abnormal sound 62, 63 Determination exclusion area 65 Finger 90, 91, 92 Auxiliary line

Claims (10)

An acquisition means for acquiring sound information;
Receiving means for receiving position information relating to a position from which sound information is acquired;
Among the analysis results obtained by performing the frequency analysis of the sound information acquired by the acquisition means from among the plurality of analysis results obtained by performing the frequency analysis of the sound signal, the reception means has received the analysis results similar to the analysis results obtained by performing the frequency analysis of the sound information. Display means for displaying the analysis result selected based on the position information;
A frequency analysis unit that generates an analysis result representing a temporal change in intensity distribution for each frequency by performing a time-frequency analysis of the sound information acquired by the acquisition unit;
Information obtained from the analysis result generated by the frequency analysis means, position information received by the reception means, and transmission means for transmitting device information relating to a measurement target device to an external device;
Analysis selected from among a plurality of analysis results obtained by performing frequency analysis of a sound signal based on position information received by the receiving unit among analysis results similar to the analysis result generated by the frequency analyzing unit Receiving means for receiving results from an external device,
The display unit displays the analysis result generated by the frequency analysis unit and the analysis result received by the reception unit. The display means, the terminal apparatus according to claim 1, wherein the accepting different analysis results corresponding to the position information received by the unit is displayed. 3. The terminal device according to claim 1, wherein, when displaying a plurality of analysis results, the display unit changes the order of the analysis results to be displayed corresponding to the position information received by the receiving unit. An acquisition means for acquiring sound information;
Receiving means for receiving position information relating to a position from which sound information is acquired;
Among the analysis results obtained by performing the frequency analysis of the sound information acquired by the acquisition means from among the plurality of analysis results obtained by performing the frequency analysis of the sound signal, the reception means has received the analysis results similar to the analysis results obtained by performing the frequency analysis of the sound information. Display means for displaying the analysis result selected based on the position information,
The display means displays an appearance of a target device that is a measurement target,
The receiving unit is a terminal device that receives position information based on a position of a target device displayed on the display unit. An acquisition means for acquiring sound information;
Receiving means for receiving position information relating to a position from which sound information is acquired;
An analysis result selected from a plurality of analysis results obtained by performing frequency analysis of the sound signal, the analysis result obtained by performing frequency analysis of the sound information acquired by the acquisition means, and the reception means Display means for displaying at least one of the analysis result selected based on the received position information and the information associated with the selected analysis result;
The display means displays an appearance of a target device that is a measurement target,
The reception unit receives position information based on the position of the target device displayed on the display unit.
Terminal device. The display means displays an appearance in a direction different from the appearance of the target device;
The terminal device according to claim 4 , wherein the reception unit receives position information of a target device displayed on the display unit for each appearance in different directions. An acquisition means for acquiring sound information;
Receiving means for receiving position information relating to a position from which sound information is acquired;
Among the analysis results obtained by performing the frequency analysis of the sound information acquired by the acquisition means from among the plurality of analysis results obtained by performing the frequency analysis of the sound signal, the reception means has received the analysis results similar to the analysis results obtained by performing the frequency analysis of the sound information. Display means for displaying the analysis result selected based on the position information;
A frequency analysis unit that generates an analysis result representing a temporal change in intensity distribution for each frequency by performing a time-frequency analysis of the sound information acquired by the acquisition unit;
Information obtained from the analysis result generated by the frequency analysis means, position information received by the reception means, and transmission means for transmitting device information relating to a measurement target device to an external device;
Analysis selected from among a plurality of analysis results obtained by performing frequency analysis of a sound signal based on position information received by the receiving unit among analysis results similar to the analysis result generated by the frequency analyzing unit Receiving means for receiving results from an external device,
The display means displays the analysis result generated by the frequency analysis means and the analysis result received by the reception means ;
Storage means for storing a plurality of analysis results and sound generation position information obtained by performing frequency analysis of the sound signal;
When the information obtained from the analysis result obtained by performing the frequency analysis of the sound information acquired by the acquisition unit together with the position information received by the reception unit from the terminal device is stored in the storage unit Transmitting means for transmitting, to the terminal device, an analysis result selected based on position information received by the receiving means from among analysis results similar to the analysis results received from the plurality of analysis results. Server device,
Diagnostic system with An acquisition means for acquiring sound information;
Receiving means for receiving position information relating to a position from which sound information is acquired;
Among the analysis results obtained by performing the frequency analysis of the sound information acquired by the acquisition means from among the plurality of analysis results obtained by performing the frequency analysis of the sound signal, the reception means has received the analysis results similar to the analysis results obtained by performing the frequency analysis of the sound information. Display means for displaying the analysis result selected based on the position information ,
The display means displays an appearance of a target device that is a measurement target,
The accepting means is a terminal device for accepting position information based on the position of the target device displayed on the display means ;
Storage means for storing a plurality of analysis results and sound generation position information obtained by performing frequency analysis of the sound signal;
When the information obtained from the analysis result obtained by performing the frequency analysis of the sound information acquired by the acquisition unit together with the position information received by the reception unit from the terminal device is stored in the storage unit Transmitting means for transmitting, to the terminal device, an analysis result selected based on position information received by the receiving means from among analysis results similar to the analysis results received from the plurality of analysis results. Server device,
Diagnostic system with An acquisition step for acquiring sound information;
A reception step for receiving position information regarding a position from which sound information is acquired;
A frequency analysis step for generating an analysis result representing a temporal change in intensity distribution for each frequency by performing a time-frequency analysis of the acquired sound information;
Among the analysis results similar to the analysis results obtained by performing the frequency analysis of the sound information obtained by the obtaining step from among the plurality of analysis results obtained by performing the frequency analysis of the sound signal, the acceptance is accepted by the accepting step. A display step for displaying the analysis result selected based on the position information;
Transmitting the information obtained from the generated analysis result, the position information received by the receiving step, and device information related to the device to be measured to an external device;
A receiving step of receiving from the external device an analysis result selected based on the received position information among analysis results similar to the analysis result generated by the frequency analysis step;
Displaying the analysis result generated by the frequency analysis step and the analysis result received by the reception step;
A program that causes a computer to execute. An acquisition step of acquiring the sound information by displaying the appearance of the target device to be measured on the display means ;
A receiving step for receiving position information related to a position for acquiring sound information based on a position of the target device displayed on the display means ;
Among the analysis results similar to the analysis results obtained by performing the frequency analysis of the sound information obtained by the obtaining step from among the plurality of analysis results obtained by performing the frequency analysis of the sound signal, the acceptance is accepted by the accepting step. A display step for displaying the analysis result selected based on the position information;
A program that causes a computer to execute.