JP5326972B2 - Remote communication system and transmitter - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To locate a fault on a voice communication path for a sound signal input during remote communication. <P>SOLUTION: The following first to fourth determination results are displayed in a list on a display device on a transmitter side: a first determination result for determining whether a sound signal has been input in a voice input device on a transmitter side, a second determination result for converting the sound signal input in the voice input device by using an analog/digital converter to determine the level of a transmission signal transmitted to a receiver, a third determination result for determining the level of the transmission signal transmitted to the receiver from the transmitter, and a fourth determination result for converting the transmission signal transmitted from the transmitter by using the analog/digital converter to determine whether the reproduced sound signal has been output from an output device on the receiver side. <P>COPYRIGHT: (C)2011,JPO&amp;INPIT

Description

  The present invention relates to a remote communication system and a transmission apparatus.

  Conventionally, in a remote communication system using an acoustic signal, the acoustic signal level input to the input device on the speaker side and the acoustic signal when the acoustic signal reproduced on the receiver side is input to the input device on the receiver side A system that feedbacks how a speaker's utterance is heard on the receiving side by comparing and displaying the level is disclosed (for example, Patent Document 1). According to Patent Document 1, when it is determined that the voice of the speaker side does not reach the receiver side, it is possible to grasp whether the sound device of the speaker side is defective or the sound device of the receiver side is defective. it can.

Japanese Patent Laid-Open No. 7-245748

However, in the above-mentioned Patent Document 1, it is possible to grasp whether the sound device on the speaker side is defective or the sound device on the reception side, but it is possible to identify where the problem occurs on the voice communication path There was a problem that I could not.
Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to identify a problem occurrence point on a voice communication path of an acoustic signal input in remote communication. It is an object of the present invention to provide a new and improved remote communication system and transmission apparatus.

  In order to solve the above problems, according to an aspect of the present invention, there is provided a remote communication system in which a transmission device and a reception device are connected via a network, and an acoustic signal is input to a voice input device on a transmission device side. A first determination result for determining whether or not a signal has been received and a second signal for determining the level of a transmission signal to be transmitted to the receiving device by converting the acoustic signal input to the voice input device by the analog / digital converter. The determination result, the third determination result for determining the level of the transmission signal transmitted from the transmission device to the reception device, and the transmission signal transmitted from the transmission device are converted by the digital / analog conversion device and received. The fourth determination result for determining whether or not the reproduced acoustic signal is output from the output device on the device side, and the first to fourth determination results on the display device on the transmission device side. Wherein the display, remote communication system is provided.

  Further, the transmission device is converted from the acoustic signal by the signal input determination unit that determines whether the acoustic signal is input to the voice input device on the transmission device side and outputs the first determination result, and the analog / digital conversion device, A transmission signal level detection unit that detects a level of a transmission signal transmitted to the reception device and outputs a second determination result; and a display control unit that displays a list of the first to fourth determination results on the display device. A receiving device that detects a level of the transmission signal received from the transmitting device and outputs a third determination result; and a reproduced sound converted from the transmission signal by the digital / analog converter. And a signal output determination unit that determines whether the signal is output from the audio output device and outputs a fourth determination result.

  Further, the fifth determination result for determining whether or not an acoustic signal is input to the voice input device on the receiving device side and the acoustic signal input to the voice input device are converted by an analog / digital conversion device, and then the transmission device A sixth determination result for determining the level of the transmission signal to be transmitted to may be further acquired, and the first to sixth results may be displayed in a list on the display device on the transmission device side.

  In addition, the receiving device is converted from the sound signal by the signal input determination unit that determines whether the sound signal is input to the sound input device on the receiving device side and outputs the fifth determination result, and the analog / digital conversion device. A transmission signal level detection unit that detects a level of a transmission signal transmitted to the transmission device and outputs a sixth determination result.

  The remote communication system according to claim 3, wherein the acoustic signal input to the voice input device on the receiving device side is a reproduced acoustic signal output from the voice output device.

  Alternatively, the video signal including the reproduced audio signal input to the video input device on the receiving device side may be transmitted to the transmission device, and the transmitted video signal may be displayed on the display device on the transmission device side.

  The transmission device includes an information addition unit that adds identification information for identifying the transmission device to a transmission signal transmitted from the transmission device to the reception device, and the reception device transmits the transmission signal added to the transmitted transmission signal. You may provide the additional information analysis part which analyzes the identification information which identifies an apparatus.

  The receiving device includes an additional information processing unit that embeds the identification information transmitted by the transmitting device as a watermark in the transmission signal, and the additional information analysis unit analyzes the identification information embedded as a watermark in the transmission signal. Good.

  In order to solve the above-described problem, according to another aspect of the present invention, it is a transmission device connected to a reception device via a network and determines whether an acoustic signal is input to the voice input device. A signal input determination unit that outputs a first determination result, and a transmission signal that is converted from an acoustic signal by an analog / digital conversion device and detects the level of a transmission signal that is transmitted to a reception device and outputs a second determination result Whether the level detection unit, the third determination result output by detecting the level of the transmission signal received by the receiving device, and the acoustic signal reproduced by the receiving device were output from the audio output device on the receiving device side A transmission apparatus comprising: a reception unit that receives a fourth determination result that is output by determining the first and fourth determination results; and a display control unit that displays a list of the first to fourth determination results on the display device. Offer It is.

  As described above, according to the present invention, it is possible to identify a problem occurrence location on the voice communication path of an acoustic signal input in remote communication.

It is explanatory drawing explaining the outline | summary of embodiment of this invention. It is a block diagram which shows the function structure of the remote communication system concerning 1st Embodiment. It is explanatory drawing explaining the example of an output of the determination result concerning this embodiment. It is explanatory drawing explaining the example of an output of the determination result concerning this embodiment. It is explanatory drawing explaining the example of an output of the determination result concerning this embodiment. It is a block diagram which shows the function structure of the remote communication system concerning 2nd Embodiment. It is a block diagram which shows the function structure of the remote communication system concerning 3rd Embodiment. It is a block diagram which shows the function structure of the remote communication system concerning 4th Embodiment. It is a block diagram which shows the function structure of the remote communication system concerning 5th Embodiment.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

Further, the “detailed description of the embodiments” will be described in the order shown below.
[1] Purpose of this embodiment [2] Outline of this embodiment [3] First embodiment [3-1] Configuration of remote communication system [3-2] Details of operation of remote communication system [3-3 ] Example of procedure for identifying problem location [4] Second embodiment [4-1] Configuration of remote communication system [4-2] Details of operation of remote communication system [5] Third embodiment [5- 1) Configuration of remote communication system [5-2] Details of operation of remote communication system [6] Fourth embodiment [6-1] Configuration of remote communication system [6-2] Details of operation of remote communication system [ 7] Fifth embodiment

[1] Purpose of this Embodiment First, the purpose of this embodiment will be described. Conventionally, in a remote communication system using an acoustic signal, the acoustic signal level input to the input device on the speaker side and the acoustic signal when the acoustic signal reproduced on the receiver side is input to the input device on the receiver side A system that feedbacks how a speaker's utterance is heard on the receiver side by comparing and displaying the level is disclosed. According to the system, when it is determined that the voice of the speaker side does not reach the receiver side, it is possible to grasp whether the sound device of the speaker side is defective or the sound device of the receiver side is defective. .

  However, in the above technology, it is possible to grasp whether the sound device on the speaker side is defective or the sound device on the reception side, but it is not possible to specify where the problem has occurred on the voice communication path. There was a problem. Accordingly, the remote communication system 10 according to the embodiment of the present invention has been created with the above circumstances as a focus. According to the remote communication system 10 according to the present embodiment, it is possible to specify a problem occurrence location on the voice communication path of an acoustic signal input in remote communication.

[2] Outline of the Embodiment The object of the embodiment of the present invention has been described above. Next, an outline of the present embodiment will be described with reference to FIG. In the present embodiment, remote communication in which the voice of the speaker on the transmitting side is transmitted via a communication path and the voice of the speaker is reproduced on the receiving side will be described as an example. Specifically, as shown in FIG. 1, the voice (sound source) of the speaker of the transmission device 100 propagates through the air and is input to the microphone. The sound input to the microphone is analog / digital converted (A / D converted) and output. The transmission signal output from the transmission device 100 is transmitted to the reception device 200 via the network (NW).

  The transmission signal transmitted from the transmission device 100 to the reception device 200 is digital / analog converted (D / A converted) and output from the speaker. The sound output from the speaker propagates through the air and reaches the ears of the listener. As described above, when performing remote communication, there are various elements on the voice communication path until the voice of the speaker reaches the receiver.

  For example, when a problem occurs that the voice of the speaker does not reach the receiver, communication is interrupted, so it is required to solve the problem immediately and restart communication. When solving this problem, it is indispensable to identify the location where the problem has occurred, but if there is a problem in either the transmission device 100 or the reception device 200, information alone is often insufficient. . Therefore, in order to identify the problem occurrence location, it is necessary to identify the location where the problem has occurred on the communication path through which the voice is transmitted.

  In the present embodiment, a plurality of elements on the communication path are provided with a function of checking the behavior of each element, and the problem occurrence location can be specified by comparing the operation status between the elements. In the first to third embodiments, a case where remote communication is performed between two sites will be described. In the fourth and fifth embodiments, a case where remote communication is performed between a plurality of sites will be described.

  When remote communication is performed between two sites, the transmission / reception destination of video and audio is uniquely determined. That is, the destination of the voice of the speaker is only the other party's receiver, and the destination of the voice reaching the receiver is only the other party's speaker. However, when performing remote communication between a plurality of bases, the transmission / reception destination is not uniquely determined. That is, there are as many destinations where the voice of the speaker can be reached as many as the locations where remote communication is possible, and there are as many destinations where the voice reaches the receiver as many locations as possible where remote communication is possible.

  Therefore, when performing remote communication between a plurality of bases, voice feedback information indicating which base the voice is from is required. In the fourth and fifth embodiments, predetermined additional information is added to the transmitted audio signal so that it can be identified from which site the audio signal is.

[3] First Embodiment The outline of the embodiment of the present invention has been described above. Before describing the configuration of the remote communication system 10 according to the present embodiment, the hardware configurations of the transmission device 100 and the reception device 200 that configure the remote communication system 10 will be described. The transmission device 100 and the reception device 200 are information processing devices including a voice input device and a display device, and examples thereof include a personal computer.

  In the present embodiment, an information processing apparatus in which a voice input device and a display device are integrated is described as an example, but the present invention is not limited to this example. For example, the information processing device, the voice input device, and the display device may be configured as separate devices. Since the hardware configurations of the transmission device 100 and the reception device 200 have the same configuration, the hardware configuration of the transmission device 100 will be described in detail.

  The transmission device 100 includes, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an input device, an output device, a storage device (HDD), and the like.

  The CPU functions as an arithmetic processing device and a control device, and controls the overall operation of the transmission device 100 according to various programs. The CPU may be a microprocessor. The ROM stores programs used by the CPU, calculation parameters, and the like. The RAM primarily stores programs used in the execution of the CPU, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.

  The input device includes, for example, an input means for a user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and input control that generates an input signal based on the input by the user and outputs the input signal to the CPU. It consists of a circuit.

  The output device includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Display) device and a lamp, and an audio output device such as a speaker and headphones. .

  The storage device can include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device is composed of, for example, an HDD (Hard Disk Drive). This storage device drives a hard disk and stores programs executed by the CPU and various data.

[3-1] Functional Configuration of Remote Communication System The hardware configuration of the transmission device 100 has been described above. Next, a functional configuration of the remote communication system 10 according to the first embodiment will be described with reference to FIG. As shown in FIG. 2, the remote communication system 10 includes a transmission device 100 and a reception device 200. The transmission device 100 is connected via an audio signal transmission path 301a and a return signal transmission path 301b (hereinafter also referred to as a network 301). Are connected to the receiving device 200.

  The network 301 is a communication line network that connects the transmission device 100 and the reception device 200 so that they can communicate with each other. The network 301 is composed of, for example, a public line network such as the Internet, a telephone line network, a satellite communication network, or a dedicated line network such as a WAN, LAN, or IP-VPN, and may be wired or wireless. Moreover, although the audio | voice signal transmission path 301a and the return signal transmission path 301b were illustrated as the network 301, you may comprise by one network.

  In the present embodiment, the voice of the speaker of the transmission device 100 is transmitted to the reception device 200 via the network by one-way communication remote communication. Further, only the audio information is transmitted from the transmission device 100 to the reception device 200. That is, in this embodiment, remote communication during one-way communication in which only voice information is handled will be described.

  The transmission device 100 mainly includes a voice input device 102, a signal input determination unit 103, an A / D conversion device 104, a transmission signal level detection unit 105, a display device 106, and the like. The voice input device 102 is an example of the input device described above, and can be exemplified by a device that inputs voice such as a microphone. The voice input device 102 receives the voice of the speaker uttered by the speaker 101. The voice input device 102 provides the input voice signal of the speaker to the signal input determination unit 103.

  The signal input determination unit 103 has a function of determining whether an acoustic signal is input from the voice input device 102 and outputting a first determination result. Here, the first determination result output by the signal input determination unit 103 is “signal A”. The signal input determination unit 103 provides the display device 106 with a signal A that is a determination result. In addition, the signal input determination unit 103 provides the analog / digital conversion (A / D conversion) device 104 with the acoustic signal provided from the voice input device 102.

  The A / D conversion device 104 converts the acoustic signal provided from the signal input determination unit 103 from an analog signal to a digital signal and provides it to the transmission signal level detection unit 105. The acoustic signal is converted by the A / D conversion device 104, and can be transmitted to the receiving device 200 where the receiver 201 who is a remote communication partner exists through the network 301.

  The transmission signal level detection unit 105 has a function of detecting the level (waveform) of the acoustic signal converted into a digital signal by the A / D conversion device 104 and outputting the second determination result. Here, the second determination result output by the transmission signal level detection unit 105 is “signal B”. The transmission signal level detection unit 105 provides a signal B as a determination result to the display device 106. The acoustic signal determined by the transmission signal level detection unit 105 is transmitted to the reception device 200 through the audio signal transmission path 301a.

  The display device 106 includes a display information adjustment unit 106a and an information display unit 106b. The display information adjustment unit 106a is an example of a display control unit of the present invention. The display information adjustment unit 106a causes the information display unit 106b to display a list of detection signals (signal A and signal B) provided from the signal input determination unit 103 and the transmission signal level detection unit 105. The display information adjustment unit 106a also displays a list of detection signals transmitted from the receiving device 200 on the information display unit 106b.

  The display information adjustment unit 106a is an example of a display control unit of the present invention. The detection signal transmitted from the receiving device 200 will be described in detail later. In the present embodiment, the detection signal serving as feedback information is displayed on the display screen. However, the present invention is not limited to such an example, and other output forms such as the rotational speed of the windmill can be visually recognized. Can do.

  The functional configuration of the transmission device 100 has been described above. Next, the functional configuration of the receiving device 200 will be described. As illustrated in FIG. 2, the reception device 200 includes a voice input device 202, a signal input determination unit 203, an analog / digital conversion (A / D conversion) device 204, a transmission signal level detection unit 205, and a reception signal level detection unit 207. A digital / analog conversion (D / A conversion) device 208, a signal output determination unit 209, an audio output device 210, and the like.

  The reception signal level detection unit 207 has a function of receiving the acoustic signal (digital signal) transmitted from the transmission device 100, detecting the level of the received acoustic signal, and outputting the third determination result. Here, the third determination result output from the reception signal level detection unit 207 is defined as “signal C”. The reception signal level detection unit 207 provides the received acoustic signal to a digital / analog conversion (D / A conversion) device. The signal C output from the reception signal level detection unit 207 is transmitted to the transmission device 100 via the return signal transmission path 301b.

  The D / A converter 208 converts the acoustic signal provided from the received signal level detection unit 207 into an analog signal. The acoustic signal converted into an analog signal by the D / A conversion device 208 becomes a signal that can be output as reproduced sound from the audio output device 210 such as a speaker. The D / A conversion device 208 provides the signal output determination unit 209 with the acoustic signal converted into an analog signal.

  The signal output determination unit 209 has a function of determining whether or not the acoustic signal provided from the D / A conversion device 208 has been output from the audio output device 210 and outputting a fourth determination result. Here, the fourth determination result output from the signal output determination unit 209 is referred to as “signal D”. The acoustic signal determined by the signal output determination unit 209 reaches the ear of the listener output from the audio output device 210 such as a speaker. Further, the signal D output from the signal output determination unit 209 is transmitted to the transmission apparatus 100 via the return signal transmission path 301b.

  The voice input device 202 collects the acoustic signal output from the voice output device 210 and provides it to the signal input determination unit 203. The acoustic signal picked up by the voice input device 202 is substantially the same voice as the sound reaching the receiver 201.

  The signal input determination unit 203 has a function of determining whether an acoustic signal is input to the voice input device 202 and outputting a fifth determination result. Here, the fifth determination result is “signal E”. The signal input determination unit 203 provides the acoustic signal provided from the voice input device 102 to the analog / digital conversion (A / D conversion) device 204. The signal E output from the signal input determination unit 203 is transmitted to the transmission device 100 via the return signal transmission path 301b.

  The A / D conversion device 204 converts the acoustic signal provided from the signal input determination unit 203 from an analog signal to a digital signal, and provides the converted signal to the transmission signal level detection unit 205. The transmission signal level detection unit 205 has a function of detecting the level (waveform) of the acoustic signal converted into a digital signal by the A / D conversion device 204 and outputting the sixth determination result. Here, the sixth determination result output by the transmission signal level detection unit 205 is “signal F”. The signal F output from the transmission signal level detection unit 205 is transmitted to the transmission device 100 via the return signal transmission path 301b.

  The signal C, signal D, signal E, and signal F transmitted from the receiving apparatus are transmitted to the transmitting apparatus 100 together with the signal G including information that the signal is transmitted to the transmitting apparatus 100. Heretofore, the functional configuration of the receiving device site 200 has been described. As described above, the display information adjustment unit 106a of the transmission device 100 displays information on the signals A and B output on the transmission device 100 side and the signals C, D, E, and F output on the reception device 200 side. The information is collectively displayed on the part 106b.

[3-2] Details of Operation of Remote Communication System The functional configuration of the remote communication system 10 has been described above. Next, the details of the operation of the remote communication system 10 will be described with reference to FIG. First, the speaker 101 on the transmission apparatus 100 side speaks. The acoustic signal emitted from the speaker 101 is input to the voice input device 102 and provided to the signal input determination unit 103.

  The signal input determination unit 103 determines whether an acoustic signal is input from the voice input device 102, and provides a determination result (signal A) to the display information adjustment unit 106a. After confirming the input of the acoustic signal, the signal input determination unit 103 provides the acoustic signal to the A / D conversion device 104. The A / D conversion device 104 converts the acoustic signal provided from the signal input determination unit 103 from an analog signal to a digital signal and provides it to the transmission signal level detection unit 105.

  The transmission signal level detection unit 105 provided with the digital acoustic signal from the A / D conversion device 104 detects the level (waveform) of the acoustic signal and provides the detection result (signal B) to the display information adjustment unit 106a. . The acoustic signal whose level is detected by the transmission signal level detection unit 105 is transmitted to the transmission device 200 via the audio signal transmission path 301a.

  The receiving device 200 to which the acoustic signal is transmitted from the transmitting device 100 first detects the level of the acoustic signal by the received signal level detection unit 207 and outputs a detection result (signal C). Then, after the received signal level detection unit 207 detects the level of the acoustic signal, the acoustic signal is converted from a digital signal to an analog signal by a D / A converter. The sound signal converted into the analog signal is determined by the signal output determination unit 209 to determine whether the sound signal is output from the sound output device 210. The signal output determination unit 209 outputs a determination result (signal D) as to whether or not an acoustic signal is output.

  After the acoustic signal is confirmed by the signal output determination unit 209, the signal reaches the ear of the listener 201 from which the acoustic signal is output from the audio output device 210. The acoustic signal output from the audio output device 210 is input to the audio input device 202 and provided to the signal input determination unit 203. The signal input determination unit 203 determines whether an acoustic signal is input to the voice input device 202 and outputs a determination result (signal E).

  The acoustic signal input determined by the signal input determination unit 203 is converted from an analog signal to a digital signal by the A / D conversion device 204 and provided to the transmission signal level detection unit 205. The transmission signal level detection unit 205 detects the level (waveform) of the acoustic signal digitally converted by the A / D conversion device 204, and outputs the detection result (signal F). As described above, the signals C, D, E, and F output from the reception device 200 are transmitted to the transmission device 100 via the return signal transmission path 301b. Then, the signals A to F are input to the display information adjustment unit 106a, and the output results of the signals A to F are displayed on the information display unit 106b.

[3-3] Example of procedure for identifying problem occurrence location The details of the operation of the remote communication system 10 have been described above. Next, with reference to FIG. 3A, FIG. 3B, and FIG. 3C, the example of the output of the determination result displayed on the display apparatus 106 and the procedure which pinpoints a problem location are demonstrated. 3A, 3B, and 3C are explanatory diagrams for explaining an output example of the determination result displayed on the display device 106. FIG.

  The display information adjustment unit 106a controls display on the information display unit 106b according to the types of the signals A to F that are the determination results. For example, the signals A, D, and E are signals for determining whether or not the signals have been input (output), and these signals are output by turning on / off the lamp. The signals B, C, and F are information indicating the level (waveform) of the acoustic signal. These signals are output using a level meter. FIG. 3A shows an output example of the signals A to F by the display information adjustment unit 106a.

  As shown in FIG. 3A, a plurality of lamps 502 and level meters 503 are displayed on the display screen 501 of the information display unit 106b. Depending on the lighting or extinction of the lamp displayed on the information display unit 106b or the level of the level meter, how the speaker's voice is heard by the receiver, or where in the communication is problematic when a problem occurs This is feedback information for specifying whether or not the error occurs.

  In the present embodiment, the signals B, C, and F are output using a level meter, but the present invention is not limited to this example, and may be output by turning on / off the lamp in the same manner as the signals A, D, and E. . Further, the display information adjusting unit 106a may synchronize and output the level meter corresponding to each signal in order to facilitate comparison of the signals. The display information adjustment unit 106a may select information to be displayed on the information display unit 106.

  For example, in order for the speaker on the transmission device 100 side to know whether his / her voice is heard by the receiver on the reception device 200 side, the lamp of the signal B output from the transmission signal level detection unit 105, It is only necessary to compare the ramp of the signal F output from the transmission signal level detection unit 205. Next, information obtained by comparing the determination results will be described with an example.

  Hereinafter, a case where reception of the signal G transmitted from the receiving apparatus 200 to the transmitting apparatus 100 has been confirmed and it has been found that there is no problem in the return signal transmission path 301b will be described. For example, if the signal G does not reach the transmitting device 100, a problem has occurred in the return signal transmission path 301b. Therefore, first, the return signal transmission path 301 needs to be restored. After the transmission device 100 receives the signal G, the determination result of the reception device 200 is output.

Specifically, a method for identifying a problem occurrence location by comparing outputs of determination results will be described. For example, the case where the display states of the signal B output from the transmission signal level detection unit 105 and the signal F output from the transmission signal level detection unit 205 are as follows will be described.
Display status of signal B: Displayed (change in level meter)
Display status of signal F: Not displayed (no change in level meter)
By comparing the display states of the signal B and the signal F, it can be determined that the utterance of the speaker of the transmission device 100 has not reached normally.

  Similar to the above determination, the problem location is identified by comparing the display state of each signal. For example, as shown in FIG. 3B, neither the lamp of the signal E output from the signal input determination unit 203 nor the lamp of the signal D output from the signal output determination unit 209 is lit. In this case, since the lamp of the signal E is not lit, it is understood that the input of the acoustic signal from the voice input device 202 on the receiving device 200 side has not been confirmed. Further, since the lamp of the signal D is not lit, it can be seen that no acoustic signal is output from the audio output device 210 on the receiving device 200 side.

  Further, from the display screen 511, the display state of the level meter of the signal B output from the transmission signal level detection unit 105 and the display state of the level meter of the signal C output from the reception signal level detection unit 207 are the same display. It turns out that it is in a state. From the comparison of the above signals E and D and B and C, it can be seen that the utterance acoustic signal generated from the speaker reaches the receiving apparatus 200 side. However, it can be seen that a problem has occurred when the acoustic signal that has reached the receiving apparatus 200 side is reproduced. Therefore, by adjusting the audio output device 210 on the receiving device 200 side, the problem can be solved, another problem location can be specified, or the process can proceed to the repair step.

  Next, with reference to FIG. 3C, another comparative example of the determination result will be described. As shown in FIG. 3C, the lamp of the signal A output from the signal input determination unit 103 is not lit on the display screen 521 of the information display unit 106b. However, the speaker of the transmission device 100 recognizes that he / she is speaking. In this case, it can be seen that the voice generated from the speaker is not input to the voice input device 102 on the transmission device 100 side. The problem can be solved by adjusting the voice input device 120 on the transmission device 100 side.

  Moreover, in FIG. 3C, since the above-mentioned signal A is not turned on, it turns out that the input of an acoustic signal cannot be confirmed from an audio | voice input apparatus. Further, there is a change in the level meter of the signal B output from the transmission signal level detection unit 105. By comparing the display states of the signal A and the signal B, it is possible to specify that some problem has occurred in the signal input determination unit 103 itself. Thus, by listing and comparing the display states of the output signals, it is possible to quickly recognize that a problem has occurred at a plurality of locations.

  Conventionally, in order to know whether a speaker's utterance has arrived at the receiver side, it has relied on a reaction such as a receiver's nick or nod. However, even in situations where it is difficult to generate feedback information due to listeners' nodding or nodding, or in situations where it is difficult for the speaker to receive such information, feedback information can be easily obtained by viewing the above judgment results. Can be obtained. The example of the procedure for identifying the problem occurrence location in the remote communication system 10 has been described above.

[4] Second Embodiment The first embodiment has been described above. Next, the remote communication system 20 according to the second embodiment will be described. The remote communication 20 in this embodiment includes a transmission device 150 and a reception device 250. As described above, in the second embodiment, remote communication is performed between two sites as in the first embodiment. In the first embodiment, remote communication during one-way communication in which an acoustic signal generated by a speaker is transmitted from the transmission device 100 to the reception device 200 has been described. However, in this embodiment, the transmission device 150, the reception device 250, Are communicating with each other, and the voices of the speakers present in both apparatuses are mutually received.

  Hereinafter, configurations and operations different from those of the first embodiment will be described in detail, and detailed descriptions of configurations and operations similar to those of the first embodiment will be omitted. Note that the hardware configurations of the transmission device 150 and the reception device 250 are the same as those of the transmission device 100 according to the first embodiment, and thus detailed description thereof is omitted.

[4-1] Functional Configuration of Remote Communication System FIG. 4 is a block diagram showing a functional configuration of the remote communication system 20. As described above, the remote communication system 20 includes the transmission device 150 and the reception device 250, and the transmission device 150 and the reception device 250 include the audio signal transmission paths 301a and 302a, the return signal transmission paths 301b and 302b (hereinafter referred to as the network 350). (Also referred to as “also”).

  In the present embodiment, the behavior of each element is checked for a plurality of elements on the communication path when the transmission apparatus 150 and the reception apparatus 250 perform bidirectional communication. That is, the audio output device 110 that receives and outputs an acoustic signal from a speaker on the receiving device 250 side is also provided on the transmitting device 150 side. The transmission device 250 also includes a reception signal level detection unit 107 that detects whether an acoustic signal is received from the reception device 250, and a D / A conversion device 108 that converts the received acoustic signal from a digital signal to an analog signal. Prepare. Furthermore, a signal output determination unit 109 that determines whether an acoustic signal converted into an analog signal is output from the audio output device 110 is also provided. The transmission device 250 also has a display control device 206 that displays an output signal for confirming and determining the behavior of each element.

  In the first embodiment, an acoustic signal generated by a speaker on the transmission device 100 side is confirmed and determined on the transmission device 100 side and the reception device 200 side, and the determination results are collectively output on the transmission device 100 side. However, in this embodiment, not only on the transmission device 150 side but also on the reception device 250 side, the acoustic signal generated by the speaker on the reception device 250 side is confirmed and determined on the transmission device 150 side and the reception device 250 side. The determination results are collectively output on the receiving device 250 side.

  The input determination and level detection of the acoustic signal of the speaker uttered from the reception device 250 side on the transmission device 150 side are the same as the input determination and level detection of the acoustic signal on the reception device 200 side of the first embodiment. Detailed explanation is omitted. In addition, the display control of the determination result display control device 206 on the receiving device 250 side is the same as the display control in the transmission device 100 of the first embodiment, and thus detailed description thereof is omitted.

  Note that when bidirectional communication is performed between the transmission device 150 and the reception device 250, it is necessary to eliminate an echo problem that occurs when an acoustic signal is communicated bidirectionally. For this reason, both the transmitter 150 and the receiver 250 are provided with echo cancellers (EC) 111 and 211.

[4-2] Details of Operation of Remote Communication System The functional configuration of the remote communication system 20 of the present embodiment has been described above. Next, details of the operation of the remote communication system 20 of the present embodiment will be described. Hereinafter, operations different from those of the first embodiment will be described in detail.

  In the present embodiment, in the transmission device 150, an acoustic signal emitted from a speaker on the reception device 250 side is adjusted by the EC 111 and provided to the reception signal level detection unit 107. The reception signal level detection unit 107 receives the acoustic signal transmitted from the reception device 250, detects the level of the received acoustic signal, and outputs the detection result.

  Then, after the received signal level detection unit 107 detects the level of the acoustic signal, the D / A converter 108 converts the digital signal into an analog signal. The acoustic signal converted into the analog signal by the D / A converter 108 determines whether the acoustic signal is output from the audio output device 110 by the signal output determination unit 109. The determination results output from the reception signal level detection unit 107 and the signal output determination unit 109 are transmitted to the reception device 250 via the return signal transmission path 302b.

  In the reception device 250, the determination result output on the transmission device 150 side and a plurality of signals that are the determination result output on the reception device 250 side are provided to the display information adjustment unit 206a. Then, a plurality of signals are input to the display information adjustment unit 206a, and output results of the plurality of signals are displayed on the information display unit 206b. The details of the operation of the remote communication system 20 according to the present embodiment have been described above.

  According to the remote communication system 20 according to the present embodiment, in a remote communication system capable of two-way communication, it is possible to confirm and determine the input / output of acoustic signals transmitted / received to / from both at a plurality of locations on the communication path. Become. As a result, it is possible to quickly identify which part of the communication path of the acoustic signal that is input to or output from both apparatuses has a problem.

[5] Third Embodiment The second embodiment has been described above. Next, a remote communication system 30 according to the third embodiment will be described with reference to FIG. The remote communication system 30 in this embodiment includes a transmission device 160 and a reception device 260. As described above, in the third embodiment, remote communication is performed between two sites as in the first and second embodiments. Further, as in the second embodiment, bidirectional communication is performed between the transmission device 160 and the reception device 260.

  In the first and second embodiments, only audio signals are transmitted / received. However, the present embodiment is different in that image information including video and audio is transmitted / received. Hereinafter, configurations and operations different from those in the first and second embodiments will be described in detail, and detailed descriptions of configurations and operations similar to those in the first and second embodiments will be omitted.

[5-1] Functional Configuration of Remote Communication System FIG. 5 is a block diagram showing a functional configuration of the remote communication system 30. As described above, the remote communication system 30 includes the transmission device 160 and the reception device 260. The transmission device 160 and the reception device 260 are the audio signal transmission paths 301a and 302a, the return signal transmission paths 301b and 302b, and the video signal transmission path. 301c and 302c (hereinafter also referred to as a network 360).

  In the present embodiment, in addition to the functional configurations of the transmission device 150 and the reception device 250 according to the second embodiment, the transmission device 160 further includes a video input device 112 and an audio information visualization device 113. The receiving device 260 is further provided with a video input device 212 and an audio information visualization device 213.

  The video information on the transmission device 160 (reception device 260) side is input to each of the video input devices 112 (212). The video information input to the video input device 112 (212) is video information output to the information display device 113b (213b) described later. The video information input to the video input device 112 (212) is transmitted to the receiving device 160 (transmitting device 260) via the video signal transmission path 301c (302c).

  The voice information visualization device 113 (213) includes a voice input device 113a (213a) and an information display device 113b (213b). The voice input device 113a (213a) has a function of inputting an acoustic signal generated on the transmission device 160 side. The acoustic signal input to the voice input device 113a (213a) is the same acoustic signal as the acoustic signal generated by the speaker input to the voice input device 102 (202).

  The information display device 113b (213b) has a function of displaying, on the display screen, the result of signal input and signal level detection performed on the acoustic signal input to the voice input device 113a (213a). Then, the state of the acoustic signal displayed on the information display device 113b (213b) is input to the video input device 112 (212).

[5-2] Details of Operation of Remote Communication System The functional configuration of the remote communication system 30 of the present embodiment has been described above. Next, details of the operation of the remote communication system 30 of this embodiment will be described. Hereinafter, operations different from the first and second embodiments will be described in detail.

  On the transmission device 160 side, the video information on the reception device 260 acquired by the video input device 212 existing on the reception device 260 side is provided to the display device 106 existing on the transmission device 160 side via the video signal transmission path 301c. Is done. In the information display unit 106b, as in the first and second embodiments, the confirmation result of the acoustic signal, the sound level, and the like are displayed, and the video on the receiving device 260 side is also output.

Also on the receiving device 260 side, similar to the transmitting device 160 side, the video information on the transmitting device 160 side acquired by the video input device 112 existing on the transmitting device 160 side is received via the video signal transmission path 301b. The display device 206 is provided on the 260 side. In the information display unit 206b, the confirmation result of the acoustic signal, the sound level, and the like are displayed, and the video on the transmission device 160 side is also output.

  That is, for example, the acoustic signal acquired by the audio input device 113a is visualized on the transmission device 160 side and transmitted to the reception device 260 as video information. The acoustic signal acquired by the voice input device 102 is transmitted to the receiving device 260 as voice information. Therefore, the sound acquired by any input device is visualized by the display device 206 of the receiving device 260. However, because the sound source sources are different, by comparing the information transmitted via different communication paths, you can identify the location where the problem occurred in the transmission path or the element where the problem occurred. It becomes possible to do.

  The audio information visualization device 113 (213) can be installed at any position on the transmission device 160 side and the reception device 260 side. Also, the audio information visualization device 113 (213) can be installed at a plurality of locations. By changing the installation location of the audio information visualization device 113 (213) or installing the audio information visualization device 113 (213), it is possible to determine the difference in how the sound information is heard depending on the position where the acoustic signal is acquired in the space. .

  As described above, as in the first embodiment and the second embodiment, the problem occurrence location can be specified by confirming and determining the acoustic signal input / output from each element. Furthermore, by feeding back the determination result output to the other party, it is possible to quickly identify the problem occurrence location and improve the reliability of the problem location identification.

[6] Fourth Embodiment The third embodiment has been described above. Next, a remote communication system 40 according to the fourth embodiment will be described with reference to FIG. The remote communication system 40 in this embodiment includes a transmission device 170 and a reception device 270. As described above, in the fourth embodiment, remote communication is performed between a plurality of sites.

  In the present embodiment, as in the third embodiment, audio information and video information are transmitted and received between the transmission device 170 and the reception device 270. However, since remote communication is performed between a plurality of locations, It is necessary to specify whether the information is from the device. Therefore, in this embodiment, predetermined additional information is added to the audio signal output from each device, and it is possible to identify which device has transmitted the signal. Hereinafter, the configuration and operation different from those of the third embodiment will be described in detail, and detailed description of the same configuration and the like will be omitted.

  The transmission device 170 and the reception device 270 can exchange data with a plurality of other devices. However, in order to facilitate the explanation, hereinafter, transmission and reception of data between the transmission device 170 and the reception device 270 will be described. An example will be described.

[6-1] Functional Configuration of Remote Communication System FIG. 6 is a block diagram showing a functional configuration of the remote communication system 40. As described above, the remote communication system 40 includes the transmission device 170 and the reception device 270, and the transmission device 170 and the reception device 270 include the audio signal transmission paths 301a and 302a, the return signal transmission paths 301b and 302b, and the video signal transmission. They are connected via paths 301c and 302c (hereinafter also referred to as network 370).

  In the present embodiment, in addition to the functional configurations of the transmission device 160 and the reception device 260 according to the third embodiment, the transmission device 170 further includes an information addition unit 114, an additional information processing unit 115, and an additional information analysis unit 116. Yes. The receiving device 170 is further provided with an information adding unit 214, an additional information processing unit 215, and an additional information analyzing unit 216.

  By adding the above-described configuration, it is possible to identify from which base the audio signal is transmitted from the transmitting device 170 and the receiving device 270. The information adding unit 114 has a function of adding identification information (additional information) that can be identified as a signal transmitted from the device to the acoustic signal input from the voice input device 112. The acoustic signal to which the additional information is added by the information adding unit 114 is transmitted to the receiving device 270 via the audio signal transmission path 301a.

  The additional information processing unit 115 has a function of embedding additional information as a watermark in an acoustic signal transmitted from the receiving device 270 which is another device. The acoustic signal embedded with the additional information as a watermark by the additional information processing unit 115 is output from the audio output device 110 and reaches the ear of the listener. At this time, information for identifying the transmission base is added to the acoustic signal as a watermark, but this additional information is a signal that cannot be identified by the listener who hears the reproduced acoustic signal.

  The additional information analysis unit 116 has a function of analyzing watermark information added to the acoustic signal input to the voice input device 102. The audio input device 102 receives an acoustic signal output from the audio output device 110 and added with additional information as a watermark. The additional information analysis unit 116 analyzes the watermark information added to the acoustic signal and acquires information for identifying the transmission destination. This makes it possible to determine from which device the acoustic signal output from the audio output device 110 has been transmitted.

  Then, feedback information that is a result of confirmation and examination of each element displayed on the information display unit 106b is selected and transmitted based on the identification information analyzed by the additional information analysis unit 116. In addition, information visualized by the audio information visualization device 112 is also displayed separately for each transmitted device based on the identification information analyzed by the additional information analysis unit 116.

  The information addition unit 214, the additional information processing unit 215, and the additional information analysis unit 216 included in the reception device 270 have the same functions as the information addition unit 114, the additional information processing unit 115, and the additional information analysis unit 116 of the transmission device 170, respectively. Therefore, detailed description is omitted.

[6-2] Details of Operation of Remote Communication System The functional configuration of the remote communication system 40 of the present embodiment has been described above. Next, the detail of operation | movement of the remote communication system 40 of this embodiment is demonstrated. Hereinafter, operations different from those of the third embodiment will be described in detail.

  A voice uttered from a speaker on the transmission device 170 side is input to the voice input device 102. As in the third embodiment, input / output confirmation and level determination are performed at a plurality of locations on the acoustic signal input to the voice input device 102. Then, additional information is added to the acoustic signal input to the voice input device 102 by the information adding unit 114.

  Then, the receiving device 270 receives the acoustic signal to which the additional information is added. Then, the additional information is embedded as a watermark in the acoustic signal by the additional information processing unit 215 on the receiving device 270 side. The additional information embedded here is information for identifying which device has transmitted the information. An acoustic signal in which the additional information is embedded by the additional information processing unit 215 is output from the audio output device 210.

  The acoustic signal output from the audio output device 210 is input to the audio input device 202 or 213a. The acoustic signal input to the voice input device 202 (213a) is analyzed for watermark information added by the additional information analysis unit 216, and information for identifying which device is transmitted is acquired. Based on the information analyzed by the additional information analysis unit 216, feedback information such as confirmation results and determination results of each element is transmitted to the transmission device 170. When the feedback information is transmitted to the transmission device 170, the information adding unit 214 adds information identifying that it has been transmitted from the reception device 270 to the acoustic signal.

  On the transmitting device 170 side that has received the acoustic signal to which information identifying that it has been transmitted from the receiving device 270 has been received, for example, the information that is visualized by the audio information visualizing device 213 is also used for the analyzed additional information. Originally, each device to which sound is transmitted is displayed separately. The details of the operation of the remote communication system 40 have been described above. According to the present embodiment, when remote communication is performed between a plurality of bases, it is possible to specify at which part of which base a problem has occurred.

  In the present embodiment, the information to be embedded in the acoustic signal as a watermark has been described by exemplifying identification information for identifying each device. However, the present invention is not limited to this example, and different information may be embedded for each acoustic signal.

[7] Fifth Embodiment The fourth embodiment has been described above. Next, a fifth embodiment will be described with reference to FIG. When an acoustic signal is transmitted and received between a plurality of devices, the acoustic signal may be transmitted and received via the server device 900 as shown in FIG. The server 900 manages communication of information between the bases. That is, transmission / reception of acoustic signals, feedback information, and the like in the transmission / reception devices 400a, 400b, and 400c (hereinafter referred to as the transmission / reception device 400) is managed.

  Further, the server 900 may manage information for identifying each device described in the fourth embodiment. That is, the identification information of each device is held in the server 900, the identification information is added to the acoustic signal transmitted from each device, and the acoustic signal is transmitted to an appropriate transmission device. Further, the identification information embedded in the acoustic signal may be analyzed, and the feedback information and the identification information may be associated with each other and stored on the server 900 side. Thus, on the server 900 side, it is specified which device has a problem among the transmission / reception devices 400 connected to the server 900, and in which device the problem has occurred. Is possible.

  In the fourth and fifth embodiments, the acoustic signal from which device is identified in remote communication between a plurality of sites is identified, but the same function is also provided in remote communication between two sites. Also good. That is, information for distinguishing between the acoustic signal on the transmission side and the acoustic signal on the reception side between the two sites may be added to the acoustic signal. This makes it possible to distinguish and visualize the acoustic signal on the transmission side reproduced by a speaker or the like and the acoustic signal generated by a person existing on the reception side. The fifth embodiment has been described above.

  In the above embodiment, confirmation results and determination results at a plurality of locations on the communication path location are output by a lamp or level meter, and the location of the problem is identified based on the output results. Not. For example, the output result may be automatically analyzed to identify the problem occurrence location. Further, information about the identified problem occurrence location may be displayed on the display screen.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  In the above embodiment, the case of performing communication between remote locations has been described, but the present invention is not limited to such an example. For example, the present invention can be applied to a case where communication is performed using a microphone or a speaker in a meeting or lecture in a wide hall or the like within a short distance such as in the same space.

  In addition, a computer program for causing hardware such as a CPU, ROM, and RAM incorporated in the transmission device 100 and the reception device 200 to perform the same functions as the components of the transmission device 100 and the reception device 200 described above is also created. Is possible. A storage medium storing the computer program is also provided.

100, 150, 160, 170 Transmitter 102 Audio input device 103 Signal input determination unit 104 A / D conversion device 105 Transmission signal level detection unit 106 Display device 200, 250, 260, 270 Receiver 203 Signal input determination unit 204 A / D conversion device 205 Transmission signal level detection unit 207 Reception signal level detection unit 209 Signal output determination unit 208 D / A conversion device 209 Signal output determination unit 210 Audio output device

Claims (9)

A remote communication system in which a transmitting device and a receiving device are connected via a network,
A first determination result for determining whether an acoustic signal is input to the voice input device on the transmission device side;
A second determination result for determining the level of a transmission signal to be transmitted to the receiving device by converting the acoustic signal input to the voice input device by an analog / digital conversion device;
A third determination result for determining a level of the transmission signal transmitted from the transmission device to the reception device;
A fourth determination result for determining whether or not the acoustic signal reproduced from the output device on the receiving device side is output by converting the transmission signal transmitted from the transmitting device by a digital / analog conversion device; ,
The remote communication system is characterized in that the first to fourth determination results are displayed in a list on the display device on the transmission device side. The transmitter is
A signal input determination unit that determines whether an acoustic signal is input to the voice input device on the transmission device side and outputs the first determination result;
A transmission signal level detection unit that detects the level of the transmission signal that is converted from the acoustic signal by an analog / digital conversion device and is transmitted to the reception device, and outputs the second determination result;
A display control unit for displaying a list of the first to fourth determination results on a display device;
With
The receiving device is:
A received signal level detector that detects the level of the transmission signal received from the transmitter and outputs the third determination result;
A signal output determination unit that determines whether the reproduced acoustic signal converted from the transmission signal by the digital / analog conversion device is output from the audio output device and outputs the fourth determination result;
The remote communication system according to claim 1, comprising: A fifth determination result for determining whether an acoustic signal is input to the voice input device on the receiving device side;
The acoustic signal input to the voice input device is converted by an analog / digital converter, and a sixth determination result for determining the level of a transmission signal to be transmitted to the transmitter is further acquired, The remote communication system according to claim 1, wherein the first to sixth results are displayed in a list on the display device on the transmission device side. The receiving device is:
A signal input determination unit that determines whether or not the acoustic signal is input to the voice input device on the reception device side and outputs the fifth determination result;
A transmission signal level detection unit that detects the level of the transmission signal that is converted from the acoustic signal by an analog / digital conversion device and is transmitted to the transmission device, and outputs the sixth determination result;
The remote communication system according to claim 3, further comprising:   The remote communication system according to claim 3, wherein an acoustic signal input to the audio input device on the receiving device side is the reproduced acoustic signal output from the audio output device. A video signal including the reproduced audio signal input to the video input device on the receiving device side is transmitted to the transmission device;
The remote communication system according to claim 1, wherein the transmitted video signal is displayed on a display device on the transmission device side. The transmitter is
An information adding unit for adding identification information for identifying the transmitting device to the transmission signal transmitted from the transmitting device to the receiving device;
The receiving device is:
The remote communication system according to claim 1, further comprising an additional information analysis unit that analyzes identification information for identifying the transmission device added to the transmitted transmission signal. The receiving device is:
An additional information processing unit that embeds the identification information transmitted by the transmission device as a watermark in the transmission signal;
The remote communication system according to claim 7, wherein the additional information analysis unit analyzes the identification information embedded as a watermark in the transmission signal. A transmitting device connected to a receiving device via a network,
A signal input determination unit that determines whether an acoustic signal is input to the voice input device and outputs the first determination result; and
A transmission signal level detection unit that detects the level of the transmission signal that is converted from the acoustic signal by an analog / digital conversion device and is transmitted to the reception device, and outputs the second determination result;
Whether the third determination result output by detecting the level of the transmission signal received by the receiving device and the acoustic signal reproduced by the receiving device were output from the audio output device on the receiving device side A receiving unit that receives the fourth determination result output by determining
A display control unit for displaying a list of the first to fourth determination results on a display device;
A transmission device comprising:

Images