JP2014176042A - Communication device, and voice input/output unit control method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable user voice to be easy inputted by a microphone irrespective of positional relationship between a user and a device main body.SOLUTION: A communication device for use for sharing information through a communication network, includes: a device main body including a camera 16 for imaging a user; and a voice input/output unit 17 detachably mounted on the main body and including a microphone pair 20 and a speaker 18. The device main body includes control means, including a mount/demount determination unit 123 and a microphone directivity control unit 126, for controlling the directivity of the microphone pair 20 on the basis of the positional relationship between the device main body and the voice input/output unit 17.

Description

  The present invention relates to a communication device and a method for controlling a voice input / output unit. More specifically, the present invention relates to a communication device used for information sharing via a communication network, and a voice input / output unit detachably provided on a main body of the communication device. The present invention relates to a method for controlling an output unit.

  2. Description of the Related Art Conventionally, a conference device (communication device) used for a conference (information sharing) by transmitting and receiving audio data and image data via a communication network between a plurality of bases is known (see, for example, Patent Document 1).

  In this conference apparatus, a camera for photographing an object (for example, a user) and a microphone for inputting a user's voice are integrally provided in the casing.

  However, in the conference apparatus disclosed in Patent Document 1, it is difficult for the user's voice to be input by the microphone depending on the positional relationship between the user and the housing.

  The present invention is a communication apparatus used for information sharing via a communication network, and includes an apparatus main body including a camera for photographing an object, at least one microphone detachably provided on the apparatus main body, and An audio input / output unit including a speaker, and the apparatus main body is a communication apparatus including control means for controlling directivity of the microphone based on a positional relationship between the apparatus main body and the audio input / output unit. .

  According to this, regardless of the positional relationship between the user and the apparatus main body, the user's voice can be easily input by the microphone.

It is a top view of the video conference apparatus of one Embodiment. It is a side view (the 1) of a video conference apparatus. It is a side view (the 2) of a video conference apparatus. It is a block diagram which shows the structure of control of a video conference apparatus. FIG. 6 is a diagram (part 1) for explaining the operation of the image input unit; FIG. 10 is a diagram (part 2) for explaining the operation of the image input unit; It is a figure which shows the state by which the audio | voice input / output unit is removed from the apparatus main body in a video conference apparatus. FIGS. 8A and 8B are diagrams showing a state in which the USB cable is wound around the housing of the audio input / output unit and a state in which the USB cable is pulled out from the housing of the audio input / output unit, respectively. It is a figure which shows schematic structure of the conference system containing a some video conference apparatus. It is a figure which shows the 1st usage condition of a video conference apparatus. It is a figure which shows the 2nd usage condition of a video conference apparatus. It is a figure which shows the sound collection range of the microphone pair of the comparative example 1. It is a figure which shows the sound collection range of the microphone pair of the comparative example 2. It is a flowchart for demonstrating control of an audio | voice input / output unit. It is a figure which shows the sound collection range of the microphone pair of a 1st usage condition. It is a figure which shows the sound collection range of the microphone pair of a 2nd usage condition. It is a flowchart for demonstrating control of the audio | voice input / output unit of a modification. It is FIG. (1) which shows the sound collection range of the microphone pair of a modification. It is a figure (the 2) which shows the sound collection range of the microphone pair of a modification.

  Hereinafter, an embodiment will be described with reference to FIGS. FIGS. 1 to 3 respectively show a top view, a side view (No. 1), and a side view (No. 2) in a non-use state of a video conference device as a conference device according to an embodiment. As can be seen from FIGS. 1 to 3, the video conference apparatus 10 has a thin, substantially rectangular parallelepiped (substantially flat) outer shape as a whole when not in use. In FIG. 1, the video conference device 10 is placed in parallel with a horizontal plane on an upper surface (mounting surface) such as a desk or table. Hereinafter, the longitudinal direction of the video conference apparatus will be described as the X-axis direction, the direction orthogonal to the X-axis direction in the horizontal plane as the Y-axis direction, and the direction orthogonal to the X-axis and Y-axis directions (vertical direction) as the Z-axis direction.

  As an example, the video conference apparatus 10 includes an apparatus main body 11, a voice input / output unit 17 having a microphone pair 20 including a pair of microphones 20 a and 20 b and a speaker 18 detachably provided on the apparatus main body 11; It has.

  The apparatus main body 11 includes, as an example, a housing 25, a control device 24 (see FIG. 4), and an image input unit 19 including a camera 16 (see FIG. 6).

  As an example, the housing 25 is formed of a thin box-shaped hollow member (substantially rectangular parallelepiped member). As shown in FIG. 1, the casing 25 has a rectangular outer shape of, for example, a substantially A4 size in plan view, and the thickness thereof is substantially constant as shown in FIGS. 2 and 3 (for example, 15 mm to 45 mm).

  As an example, as shown in FIG. 1, a plane extending in the vicinity of the −Y side end of the upper wall of the housing 25 over almost the entire region in the X-axis direction and having the X-axis direction as the longitudinal direction. Concave portions 31 that are open to the + Z side and the −X side of the viewing rectangle are formed.

  Further, as an example, the upper wall of the housing 25 has an operation panel portion 25 a provided with a plurality of operation members on the + Y side of the recess 31. The operation panel unit 25a and the plurality of operation members will be described later.

  Also, as an example, the X-axis direction intermediate portion of the side wall (front wall) on the + Y side of the housing 25 is connected to a recording medium M such as a flash memory, an external device, etc. mounted on the main board 12 described later. Two USB terminals 49 for input / output and a LAN terminal 51 for communication are inserted (see FIG. 5).

  Further, as an example, an image output terminal mounted on the main board 12 to be described later, a communication LAN terminal, and the like are fitted in the side wall (rear wall) on the −Y side of the housing 25. Further, a power jack 60 is fitted into the side wall on the −X side of the housing 25 (see FIG. 2).

  Further, as an example, a mounting portion 80 to which the voice input / output unit 17 is mounted is formed on the −X side portion of the operation panel portion 25a (see FIG. 7). Here, the mounting portion 80 is a fitting recess that fits into the voice input / output unit 17.

  Returning to FIG. 1, the operation panel unit 25 a has the power button 35, the line button 37, and the determination button 39 as the plurality of operation members described above in this order from the −Y side to the + Y side in the center in the X-axis direction. , Arranged in a row.

  The power button 35 is an operation member used for switching power ON / OFF for the video conference apparatus 10.

  In addition, a small confirmation lamp 42 that is turned on / off in response to power ON / OFF is attached to a location adjacent to the power button 35 in the operation panel unit 25a (near the −X side of the power button 35). .

  The line button 37 is an operation member used for disconnecting the Internet line with the other party during the two-way communication via the Internet.

  The determination button 39 is an operation member for determining an item selected by operating the cursor 40 in the menu screen displayed on the screen S by the projector P (see FIG. 10), for example. Details of the decision button 39 will be described later. The cursor 40 is arranged around the decision button 39.

  A menu button 45 as an operation member is arranged on the + X side of the cursor 40. The menu button 45 is an operation member used for calling a menu screen on the screen S, for example.

  The control device 24 encodes or decodes audio data and image data, and controls bidirectional audio and image communication via the Internet as a communication network.

  As an example, the control device 24 includes a main board 12 as a control board, a sub board 13 as a voice processing and operation board, and the like.

  As shown in FIG. 4, the main board 12 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 104, an HDD (Hard Disk Drive) 106 (or storage or recording). Device), data input / output I / F 108, network I / F (Interface) 110, image input I / F 112, and image output I / F 114 are connected via a bus line 116 such as an address bus and a data bus. It is mounted in a state where it is connected so that bidirectional communication is possible. Note that the above-described image data is data of moving images or intermittent images (still images with a fixed time interval).

  The CPU 101 controls the overall operation of the video conference apparatus 10 based on a predetermined program (video conference apparatus program). A series of operations related to bidirectional communication of audio and images via the Internet in accordance with instructions from the CPU 101 according to the video conference device program will be described later. The ROM 102 stores a program used for driving the CPU 101 such as an IPL (Initial Program Loader). The RAM 104 is used as a work area for the CPU 101.

  The HDD 106 stores various data such as the video conference device program, image data, and audio data. In addition, not only HDD but SSD (Solid State Drive) etc. may be used, for example. The program for the video conference apparatus may be a file in an installable format or an executable format, and may be recorded and distributed on a computer-readable recording medium such as a recording medium. The video conference device program may be stored in the ROM 102 instead of the HDD 106. The HDD 106 controls reading or writing of various data with respect to the HDD 106 according to the control of the CPU 101.

  The data input / output I / F 108 includes the USB terminal 49 described above, and controls reading or writing (storage) of data with respect to the recording medium M such as a flash memory. The recording medium M is detachable from the USB terminal 49. The recording medium M is not limited to a flash memory as long as it is a non-volatile memory that reads or writes data in accordance with the control of the CPU 101, and may be an EEPROM (Electrically Erasable and Programmable ROM) or the like.

  The network I / F 110 includes the LAN terminal 51 (for example, Ethernet (registered trademark) terminal) described above, and inputs and outputs data (image data and audio data) via a network, for example, the Internet. The image input I / F 112 takes in an image signal output from the camera 16 as predetermined image data. Details of the image input unit 19 including the camera 16 will be described later.

  The image output I / F 114 includes the image output terminal described above, and is received via a menu screen such as an operation icon for adjusting the destination, image quality adjustment, output signal selection, etc. of the other party's conference apparatus that conducts the video conference, via the communication network. The encoded image data of the received data and the image data input by the camera 16 can be received by a display device such as a monitor device, a television set, or a projector P (see FIG. 10) connected to the image output terminal. Are converted into analog or digital image signals and output. The CPU 101 decodes the encoded image data using a predetermined codec. Examples of the predetermined image signal include an analog RGB signal (VGA), a component video signal, a high-definition multimedia interface (HDMI) signal, and a digital video interactive (DVI) signal.

  As an example, the sub-board 13 includes a plurality of operation terminals individually corresponding to a plurality of operation members, a main body side I / F 120, an audio control unit 122, an attachment / detachment determination unit 123, and a microphone directivity control unit 126. Has been implemented. The plurality of operation terminals, the audio control unit 122, the attachment / detachment determination unit 123, and the microphone directivity control unit 126 are connected to each other via the bus line 116 so as to be capable of bidirectional communication with each other and mounted on the main board 12. It is connected to the component so that it can communicate bidirectionally.

  The main body side I / F 120 is connected to a unit side I / F 40 of the audio input / output unit 17 to be described later so as to be capable of bidirectional communication by wire. Here, when the audio input / output unit 17 is attached to the attachment portion, the main body side I / F 120 and the unit side I / F 40 are connected between the terminals. When the audio input / output unit 17 is removed from the mounting portion, the connection between the terminals of the main body side I / F 120 and the unit side I / F 40 is released.

  More specifically, when the voice input / output unit 17 is mounted on the housing 25, the pair of terminals on the unit side I / F 40 and the pair of terminals on the main body side I / F 120 are individually in contact with each other. When the unit 17 is detached from the housing 25, the pair of terminals on the unit side I / F 40 and the pair of terminals on the main body side I / F 120 are separated from each other. Whether or not the audio input / output unit 17 is attached to the housing 25 is detected by the change in the voltage between the terminals at this time, that is, by the presence or absence of the connection between the terminals.

  The main body side I / F 120 takes in the voice input by the microphone pair 20 as predetermined voice data, sends the voice data to the network I / F 110 via the voice control unit 122, and receives the voice data at the network I / F 110. Then, the voice data of another base via the voice control unit 122 is converted into a voice signal that can be reproduced by the speaker 18.

  The sound control unit 122 adjusts the volume of sound output from the speaker 18 when a pair of volume buttons 62a and 62b described later is operated, and a microphone mute button 64 described later is pressed down (ON / OFF). ), The sound input / non-input by the microphone pair 20 is switched. In addition, the voice control unit 122 receives the sound output from the speaker 18 through the microphone pair 20 during two-way communication with the video conference device 10 at another base, and communicates with the video conference device 10 at the other base. It has an echo cancellation processing function that suppresses echoes and howling that are generated by forming sound wave loops at the same time, and a noise cancellation processing function that reduces noise input by the microphone pair 20 such as an operating sound of an indoor air conditioner, for example. .

  The attachment / detachment determination unit 123 determines whether or not the audio input / output unit 17 is attached to the housing 25 according to the presence / absence of connection between the terminals of the main body side I / F 120 and the audio input / output unit 17, and the determination result Is output to the CPU 101. Specifically, the attachment / detachment determination unit 123 determines that the audio input / output unit 17 is attached to the housing 25 when the main body side I / F 120 and the unit side I / F 40 are connected between terminals. When the main body side I / F 120 and the unit side I / F 40 are not connected between the terminals, it is determined that the audio input / output unit 17 is not attached to the housing 25.

  The microphone directivity control unit 126 controls the directivity of the microphone pair 20 according to the determination result of the attachment / detachment determination unit 123, as will be described in detail later.

  As shown in FIG. 6, the image input unit 19 includes a camera housing 63 in which the camera 16 is accommodated in addition to the camera 16, and an elongated flat shape that holds the camera housing 63 at one end via a biaxial torque hinge. It has the arm 34 which consists of a hollow member. The other end of the arm 34 is connected to the housing 25 via a uniaxial torque hinge whose axial direction is the short direction (Y-axis direction) of the arm 34.

  The image input unit 19 configured as described above has an accommodation position (see FIG. 1) that is accommodated in the recess 31 formed at the end of the housing 25 on the −Y side, and a protrusion that protrudes from the inside of the recess 31. It can be rotated around the Y axis with respect to the housing 25 with respect to the position (see FIGS. 5 and 6). The uniaxial torque hinge is provided with an elastic member (for example, a torsion coil spring) that urges the image input unit 19 from the housing position toward the protruding position.

  Here, a locking device including a lock release button 32 a for locking the image input unit 19 to the housing 25 is provided at the center in the X-axis direction at the −Y side end of the operation panel portion 25 a. ing.

  That is, the image input unit 19 is mechanically locked to the housing 25 by the locking device when it is located at the storage position. At this time, when the lock release button 32a is pushed down, the lock of the image input unit 19 with respect to the casing 25 is released, and the image input unit 19 pops up by the action of the elastic member. Therefore, the image input unit 19 can be grasped and rotated around the Y axis by a desired angle. When the hand is released from the rotated image input unit 19, the image input unit 19 is held at that position by the action of the uniaxial torque hinge.

  In the image input unit 19, the camera housing 63 is independently rotated around the axis parallel to the longitudinal direction of the arm 34 and around the axis perpendicular to the arm 34 by the action of the biaxial torque hinge. It is possible to move. When the hand is released from the rotated camera housing 63, the camera housing 63 is held at that position by the action of the biaxial torque hinge.

  The camera 16 captures an image of an object (for example, a user, a document, etc.) as a subject through the photographing lens 16a, converts the captured image into an image signal (electric signal), and outputs the image signal to the image input I / F 112. (See FIG. 2). As an image sensor of the camera 16, for example, a CCD, a CMOS, or the like is used.

  As the photographic lens 16a, for example, a wide-angle lens having a horizontal uniaxial viewing angle of, for example, 120 ° and a viewing angle perpendicular to the uniaxial direction of, for example, 100 ° is used. The viewing angle of the photographic lens 16a can be changed as appropriate.

  As an example, as shown in FIG. 7, the audio input / output unit 17 includes a unit side I / F 40 capable of two-way communication with the main body side I / F 120 in addition to the microphone pair 20 and the speaker 18. (See FIG. 4), including a housing 38 for housing them, a USB cable 82, and the like. The voice input / output unit 17 is also called a microphone speaker.

  The unit side I / F 40 is connected between the terminals of the main body side I / F 120 when the voice input / output unit 17 is mounted on the mounting portion 80, and is connected to the main body side when the voice input / output unit 17 is removed from the mounting portion 80. The terminal-to-terminal connection with the side I / F 120 is released. When the unit side I / F 40 is connected between the main body side I / F 120 and the terminals, power is supplied from the external power source to the microphone pair 20 and the speaker 18 via the control device 24. When the audio input / output unit 17 is removed from the mounting portion 80, the USB connector 84 of the USB cable 82 is connected to the USB terminal 49 so that both the main body side I / F 120 and the unit side I / F 40 are connected. Communication is possible. At this time, power is supplied from the external power source to the microphone pair 20 and the speaker 18 via the apparatus main body 11 and the USB cable 82.

  As an example, as shown in FIGS. 8A and 8B, the housing 38 is formed of a hollow, substantially bobbin (thread-wound) member whose axial direction is the Z-axis direction.

  Specifically, the housing 38 includes a substrate on which the unit-side I / F 40 is mounted, a microphone pair 20 and a housing portion 38a in which the speaker 18 is housed, and a pedestal portion 38b continuous to the −Z side end of the housing portion 38a. And having. A USB connector 84 is attached to one end of the USB cable 82, and the other end of the USB cable 82 is connected to a terminal portion mounted on the substrate (see FIG. 8B).

  A USB cable 82 can be wound around the constricted portion of the housing 38 (see FIG. 8A).

  The speaker 18 is a full-range round type, and is arranged at the center of the housing 38 so that the sound output direction is approximately the + Z direction, that is, the axis is parallel to the Z axis. Note that a speaker other than a round shape (for example, a square shape, an elliptical shape, a polygonal shape, or the like) may be employed as the speaker 18. The speaker 18 is connected to the unit side I / F 40, and outputs an audio signal transmitted from the main body side I / F 120 and received by the unit side I / F 40 as sound (see FIG. 4).

  A protective cover 90 in which an audio emission port composed of a plurality of through holes for emitting audio output from the speaker 18 is attached to the + Z side end of the housing 38.

  As an example, the pair of microphones 20 a and 20 b of the microphone pair 20 has unidirectionality, and is disposed around the speaker 18 in the housing portion 38 a and at a position sandwiching the axis of the speaker 18. Yes. Here, the microphone 20a is disposed on the + Y side, and the microphone 20b is disposed on the -Y side. Each microphone is arranged such that the voice input direction is directed inward in the radial direction of the speaker 18. That is, the microphone 20a has unidirectionality in which the voice input direction is in the -Y direction, and the microphone 20b has unidirectionality in which the voice input direction is in the + Y direction.

  Thus, since the sound input direction of each microphone is substantially orthogonal to the sound output direction of the speaker 18, the sound output from the speaker 18 is hardly input by the microphone, and echo and howling can be effectively suppressed.

  Each microphone is connected to the unit-side I / F 40, converts the input user's voice into a voice signal, and transmits the voice signal to the unit-side I / F 40 (see FIG. 4).

  On the outer peripheral surface of the portion located on the + Z side of the constricted portion of the housing 38, an audio pickup composed of a plurality of (for example, three) through holes for capturing the audio input by the microphone at a position corresponding to each microphone. A slot 69 is formed.

  Here, the directivity of the microphone pair 20 can be controlled using a general directivity control technique. That is, by individually controlling the directivity of the pair of microphones 20a and 20b (controlling the degree of unidirectionality of each microphone), the sound collection range as a whole of the microphone pair 20 is shifted in the Y-axis direction, for example. be able to. In other words, the microphone pair 20 can be set to be unidirectional or omnidirectional. When the microphone pair 20 is set to have a single directivity, the degree of directivity can be adjusted.

  Here, the microphone directivity control unit 126 sets the directivity of the microphone pair 20 to one of unidirectional and non-directional depending on the determination result in the attachment / detachment determination unit 123.

  Further, two openings arranged in the X-axis direction are formed at the + Z side and + Y side edges of the housing 38, and a pair of volume buttons 62a and 62b are individually fitted into the two openings ( (See FIG. 7).

  The pair of volume buttons 62 a and 62 b are operation members for adjusting the volume of the speaker 18. The volume can be lowered by pressing the + X side volume button 62b of the pair of volume buttons 62a and 62b, and the volume can be raised by pressing the -X side volume button 62a. .

  Further, one opening is formed in the + Z side and −X side edges of the housing 38, and the microphone mute button 64 is fitted in the opening.

  The microphone mute button 64 is an operation member for switching ON / OFF of the microphone pair 20. Note that the microphone pair 20 is ON means that a sound is input by the microphone pair 20, and the microphone pair 20 is OFF that a sound is not input by the microphone pair 20.

  Further, as an example, a small confirmation lamp that is turned on / off according to the ON / OFF state of the microphone pair 20 at a location adjacent to the microphone mute button 64 on the edge of the housing 38 on the + Z side and the −X side. 65 is provided.

  As an example, a reference mark indicating a reference for the position of the audio input / output unit 17 around the Z axis is formed on the + Z side and −Y side edges of the housing 38. The user can easily attach the voice input / output unit 17 to the mounting portion 80 depending on the direction of the reference mark.

  In addition, a lock device including a lock release button 30a for attaching / detaching the voice input / output unit 17 to / from the mounting portion 80 is provided on the −X side portion of the operation panel portion 25a. The lock device mechanically connects to the voice input / output unit 17 when the voice input / output unit 17 is inserted into the mounting portion 80, and locks the voice input / output unit 17. When the lock release button 30a is pushed down with the voice input / output unit 17 mounted on the mounting portion 80, the mechanical connection between the voice input / output unit 17 and the lock device is released, and the voice input by the lock device is released. The lock of the output unit 17 is released.

  Further, when the voice input / output unit 17 is mounted on the mounting portion 80, the voice intake port 69 formed in the housing 38 is exposed (see FIGS. 2 and 3).

  Hereinafter, a conference system 100 including a plurality of video conference apparatuses 10 will be described. As shown in FIG. 9, the conference system 100 includes a plurality of terminal (for example, two) routers R1 connected to the Internet, and a plurality of routers R2 connected to each of the plurality of routers R1. LAN (Local Area Network) as a network, a plurality of (for example, three) video conference devices 10 and relay devices 4 connected to each of a plurality of routers R2, a communication management device 5 connected to the Internet, and each television Projector P connected to the conference apparatus 10.

  The relay device 4 is a computer that realizes various functions in accordance with a predetermined control program. The relay device 4 constantly monitors the quality (transmission speed) of the communication network and sets image data with a resolution suitable for the transmission speed. Yes. That is, the relay device 4 causes a shift (delay) between the image data and the audio data between the video conference devices 10 during two-way communication due to the influence of the state of the communication network, the processing status of the video conference device 10, and the like. If there is a discrepancy between the audio data and the image data, the television that has the discrepancy among the high-resolution image data, the medium-resolution image data, and the low-resolution image data. The most suitable resolution is selected for the conference apparatus 10 and transmitted to the video conference apparatus 10 on the other side. As a result, even when the quality of the communication network deteriorates, moving image communication is possible without interruption.

  In addition, in order to eliminate the difference between the image data and the audio data, the relay device 4 can change the frame rate, change the resolution and the frame rate with emphasis on the balance of the two in addition to the resolution change described above. It has become. As described above, the relay device 4 constantly monitors the quality (transmission speed) of the communication network, and performs management related to transfer of moving images and sounds, such as detection of deviation and designation of resolution.

  The communication management device 5 is a computer that manages all the video conference devices 10 according to a predetermined control program, and the current operation status of all the video conference devices 10 (bidirectional communication, communication standby, de-energized state, etc.) ), Device authentication of the video conference device 10, assignment of a destination list to the video conference device 10 that has been device-authenticated, selection of the relay device 4, billing for two-way communication between the video conference devices 10, etc. And the relay device 4 are managed in an integrated manner.

  An example of a video conference using the conference system 100 configured as described above will be described below. This video conference is performed using, for example, the video conference apparatus 10 disposed at each site between 12 sites (see FIG. 9). The number of users (conference participants) at each base is, for example, three or seven.

  As shown in FIG. 10 or FIG. 11, the three users at each base face the table T side to the + X side, + Y side, and −X side of the table T arranged in one room, for example. Sit in state. At the end on the −Y side of the upper surface of the table T, the standard-type video conference device 10 is placed. A short focus type projector P is installed on the −Y side of the table T, and a screen S is disposed obliquely above the −Y side and the + Z side of the projector P. Connection of wiring related to electricity and communication to the video conference device 10 (for example, connection between a LAN terminal and a terminal connected to the Internet, connection between a projector P and an image output terminal, connection between a power jack 60 and an external power source, etc. ) Is performed in advance. Note that wireless connection may be used instead of the wiring connection.

  First, the user presses the lock release button 32 a to pop up the image input unit 19, manually rotate the image input unit 19 around the Y axis, for example, by 90 °, and move the camera housing 63 with respect to the arm 34. For example, it is rotated by 90 ° around the Z axis. As a result, three or seven seated users enter the field of view of the photographing lens 16a (see FIG. 10 or FIG. 11).

  In addition, at a base with seven users, the user removes the voice input / output unit 17 from the apparatus main body 11 and places it near the center of the upper surface of the table T, that is, near the center of the area surrounded by the seven users. The connector 84 of the USB cable 82 is connected to the USB terminal 49 (see FIG. 11). In this case, it is easy for all the users to listen to the sound transmitted from other locations and output from the speaker 18.

  On the other hand, at a base with three users, the voice input / output unit 17 is used in a state of being mounted on the apparatus main body 11 (see FIG. 10). Even in this case, since the three users are seated at a position relatively close to the video conference device 10, it is easy for all the users to hear the sound transmitted from the other bases and output from the speaker 18.

  Next, the user presses the power button 35 to activate the video conference device 10. At this time, a menu screen is displayed on the screen S by the projector P. In this menu screen, various items such as various adjustments, start of a conference (start of bidirectional communication), and the like are displayed with icons and text information. Therefore, the user operates the cursor 40 to select an item related to the start of the conference on the menu screen and presses the determination button 39 to determine the start of the conference.

  When the start of the conference is determined, the one video conference device 10 transmits a signal to that effect to the communication management device 5 via the communication network (LAN, Internet). At this time, the communication management device 5 performs device authentication for the one video conference device 10, and after the authentication, the communication management device 5 gives the one video conference device 10 a plurality of other video conference devices other than the one video conference device 10. 10 (the video conference device 10 registered in the communication management device 5) is transmitted a destination list indicating the current operation status. At this time, the one video conference apparatus 10 displays the destination list on the screen S via the projector P. This destination list includes icon display and character information that can be operated intuitively, and is updated as appropriate.

  Here, the user operates the cursor 40 to select the video conference apparatus 10 at another location where the video conference (two-way communication) is desired from the destination list, and presses the enter button 39 to decide. Here, the other 11 video conference apparatuses 10 are selected.

  In this way, when a video conference device 10 at another location where bi-directional communication is desired is selected and determined from among a plurality of other video conference devices 10 that are not in the de-energized state in the destination list, the communication management device 5 selects the optimum relay device 4 from the plurality of relay devices 4. Normally, the relay device 4 that is physically close to the one video conference device 10 is selected. However, if there is any malfunction in the relay device 4, another relay device 4 is selected. For example, as shown in FIG. 9, when the IP address of one video conference device 10 is (1.2.1.5), the relay device 4 with the IP address (1.2.1.2) is selected. However, when the relay device 4 is down, the relay device 4 whose IP address is (1.2.2.2) is selected. For convenience of explanation, the IP address is a unique IP address assigned to each video conference device 10 (in FIG. 9, the IP address is represented by four numbers in parentheses. For example, the communication management device). 5 is (1.1.1.2)).

  When the relay device 4 is selected by the communication management device 5, a request for bidirectional communication is immediately transmitted to the other video conference device 10 based on the IP address via the relay device 4. In the other video conference apparatus 10, when the request for bidirectional communication is received, items relating to acceptance and rejection of the request are displayed on the menu screen displayed on the screen S via the projector P.

  Therefore, the user at another site operates the cursor 40 and the determination button 39 of the other video conference apparatus 10 to select and determine one of the items regarding the acceptance and rejection. Then, when the item regarding acceptance is selected / determined, bidirectional communication between the one and the other video conference apparatuses 10 is started.

  At this time, as described above, the relay device 4 constantly monitors the quality (transmission speed) of the communication network. If the quality of the communication network deteriorates, the relay device 4 switches to image data having a resolution one step lower than the current resolution. Relay, lower frame rate relay, or both lower relay. The communication management device 5 is for charging for the use of the conference system 100 according to the present embodiment, such as the start of bidirectional communication between the video conference devices 10, the identification of the video conference devices 10, and the measurement of the communication time. Processing is executed.

  When two-way communication is started between the video conference apparatuses 10 at 12 sites, images of three or seven users at the sites captured by the camera 16 of the video conference device 10 at each site are transferred via the Internet. Are displayed on the screen S by the projector P connected to the video conference apparatus 10.

  Further, the voice of the user at the base input by the microphone pair 20 of the video conference apparatus 10 at each base is transmitted to the video conference apparatus 10 at the other 11 bases via the Internet, and the speaker 18 of the video conference apparatus 10 is transmitted. Is output from.

  In this way, a video conference is performed by bidirectional communication (transmission / reception) of image data and audio data between 12 sites.

  Here, as described above, at each site, the video conference apparatus 10 is arranged at a position where all three or seven users are within the field of view of the camera 16. Here, the video conference apparatus 10 is placed on the −Y side end of the upper surface of the table T.

  In this case, if the microphone pair 20 is omnidirectional when the audio input / output unit 17 is attached to the apparatus main body 11, there is a possibility that at least one user may not enter the sound collection range and the sound collection range may be reduced. For example, a projector or the like may enter the sound range, and noise such as an operating sound may be input by the microphone pair 20 (see FIG. 12). As a result, at other sites, it is difficult to hear the voice of at least one user, and annoying noise can be heard. The “sound collection range” means a range in which the user's voice is input with high sensitivity.

  If the microphone input / output unit 17 is unidirectional with the + Y side as the sound collection range, for example, when the audio input / output unit 17 is detached from the apparatus main body 11, at least 2 within the sound collection range. There is a possibility that a human user cannot enter (see FIG. 13). As a result, at other sites, it becomes difficult to hear the voices of at least two users.

  Therefore, the control device 24 controls the voice input / output unit 17 as follows. This control is performed according to the flowchart of FIG. 14 corresponding to the processing algorithm of the CPU 101.

  In the first step S1, it is determined whether or not the audio input / output unit 17 is attached to the apparatus main body 11. This determination is made by the CPU 101 based on the determination result in the attachment / detachment determination unit 123. If the determination in step S1 is affirmed, the process proceeds to step S3. On the other hand, if the determination in step S1 is negative, the process proceeds to step S5.

  In step S <b> 3, the microphone directivity control unit 126 sets the microphone pair 20 to a single directivity with the + Y side as the sound collection range. In this case, all the users can be put in the sound collection range of the microphone pair 20, and the projector P can be removed from the sound collection range (see FIG. 15). As a result, at other sites, it is easy to hear the voices of all the users and no harsh noise is heard.

  In step S5, the microphone directivity control unit 126 sets the microphone pair 20 to be omnidirectional. In this case, all the users can be put in the sound collection range of the microphone pair 20 and the projector P can be removed from the sound collection range (see FIG. 16). As a result, at other sites, it is easy to hear the voices of all the users and no harsh noise is heard.

  As can be seen from the above description, the directivity of the microphone pair 20 is determined based on whether the audio input / output unit 17 is attached to the apparatus main body 11, that is, based on the positional relationship between the audio input / output unit 17 and the apparatus main body 11. Be controlled.

  The video conference apparatus 10 of the present embodiment described above is a communication apparatus used for information sharing via the Internet, and is detachable from the apparatus main body 11 including a camera 16 for photographing a user. And the audio input / output unit 17 including the microphone pair 20 and the speaker 18, and the apparatus main body 11 is based on the positional relationship between the apparatus main body 11 and the audio input / output unit 17. Control means having an attachment / detachment determination unit 123 and a microphone directivity control unit 126 for controlling directivity is included.

  In this case, the apparatus main body 11 is disposed at a position where the user enters the imaging field of view of the camera 16. The directivity of the microphone pair 20 can be appropriately controlled based on the positional relationship between the apparatus main body 11 and the voice input / output unit 17, that is, according to the positional relationship between the user and the voice input / output unit 17.

  As a result, regardless of the positional relationship between the user and the apparatus main body 11, the user's voice can be easily input by the microphone.

  Further, for example, the directivity of the microphone pair 20 can be controlled so that only the user enters the sound collection range of the microphone pair 20 as much as possible. For example, the operation sound of the devices arranged around the user, Noise (noise) such as environmental sound can be made difficult to be input by the microphone pair 20. As a result, it is possible to improve the quality of the sound input by the microphone pair 20 and sent to another base.

  In the above embodiment, the directivity of the microphone pair 20 is controlled according to whether or not the audio input / output unit 17 is attached to the apparatus main body 11, but the present invention is not limited to this.

  For example, as in a modification described below, the control device is provided with a distance information calculation unit that calculates distance information between the voice input / output unit 17 and the device main body 11, and the microphone pair is based on the calculated distance information. The 20 directivities may be controlled.

  More specifically, the distance information calculation unit, when the attachment / detachment determination unit 123 determines that the voice input / output unit 17 is not attached to the apparatus main body 11, in response to a command from the CPU 101, the main body side I / F 120. The distance L between the voice input / output unit 17 and the apparatus main body 11 (for example, the distance between the centers) is calculated based on the reception sensitivity of the radio wave from the voice input / output unit 17 at, and the calculation result is sent to the CPU 101. Here, the reception sensitivity of the main body side I / F 120 decreases as the distance L increases. Here, in order to accurately calculate the distance L, data indicating the correspondence relationship between the reception sensitivity and the distance L is acquired in advance and stored in, for example, a flash memory provided in the control device 24.

  In the modification, the main body side I / F 120 is connected to the audio input / output unit 17 so that bidirectional communication can be performed by wire or wireless. That is, when the voice input / output unit 17 is attached to the casing 25, the unit side I / F 40 and the main body side I / F 120 are connected between the terminals, and the voice input / output unit 17 is removed from the casing 25. At this time, the unit side I / F 40 and the main body side I / F 120 are wirelessly connected. Examples of the wireless connection standard include WiFi, Bluetooth (registered trademark), and the like. When the voice input / output unit 17 is attached to the casing 25, the pair of terminals on the unit side I / F 40 and the pair of terminals on the main body side I / F 120 are in contact with each other, and the voice input / output unit 17 is in the casing. When removed from 25, the pair of terminals on the unit side I / F 40 and the pair of terminals on the main body side I / F 120 are separated from each other. Whether or not the audio input / output unit 17 is attached to the casing 25 is detected by the change in the voltage between the terminals at this time, and depending on the detection result, between the main body side I / F 120 and the audio input / output unit 17. The communication status can be switched. When the main body side I / F 120 and the voice input / output unit 17 are wirelessly connected, the reception sensitivity of radio waves from the voice input / output unit 17 at the main body side I / F 120 is sent to the CPU 101. Here, the audio input / output unit 17 has a battery in the housing 38 for supplying power to the microphone pair 20 and the speaker 18.

  Further, when the unit side I / F 40 and the main body side I / F 120 are connected to each other, power is supplied to the microphone pair 20 and the speaker 18 from an external power source. Further, when the unit side I / F 40 is wirelessly connected to the main body side I / F 120, power is supplied from the battery to the microphone pair 20 and the speaker 18. The voice input / output unit 17 may have a dry battery instead of the battery.

  Hereinafter, the control of the voice input / output unit 17 of the modification will be described. This control is performed according to the procedure shown in the flowchart of FIG. This flowchart corresponds to the processing algorithm of the CPU 101.

  In the first step S11, it is determined whether or not the audio input / output unit 17 is attached to the apparatus main body 11. If this determination is affirmed, the process proceeds to step S27. On the other hand, if the determination in step S11 is negative, the process proceeds to step S13.

  In step S13, it is determined whether distance information between the voice input / output unit 17 and the apparatus main body 11 can be calculated. Here, the CPU 101 determines that the distance information cannot be calculated when the reception sensitivity of the radio wave from the voice input / output unit 17 at the main body side I / F 120 is extremely low, and otherwise, the CPU 101 determines that the distance information cannot be calculated. It is determined that distance information can be calculated. For example, if there is a large obstacle between the voice input / output unit 17 and the apparatus main body 11, the reception sensitivity is remarkably lowered. If the determination in step S13 is affirmed, the process proceeds to step S15. On the other hand, if the determination in step S13 is negative, the process proceeds to step S17.

  In step S15, distance information between the voice input / output unit 17 and the apparatus main body 11 is calculated. Specifically, the distance information calculation unit calculates the distance information based on the reception sensitivity of the radio wave from the voice input / output unit 17 at the main body side I / F 120. In this case, the distance information calculation unit calculates the distance information with reference to data stored in the flash memory and indicating a correspondence relationship between the radio wave reception sensitivity and the distance information. When step S15 is executed, the process proceeds to step S23.

  In step S17, the user is notified that distance information between the voice input / output unit 17 and the apparatus main body 11 cannot be calculated. Here, for example, character information such as “distance information cannot be calculated” is displayed and notified on the screen S by the projector P, for example. Instead of or in addition to this, it may be notified by voice that the distance information cannot be calculated, for example. When step S17 is executed, the process proceeds to step S19.

  In step S19, it is determined whether distance information between the voice input / output unit 17 and the apparatus main body 11 has been set. The setting of the distance information is performed, for example, by the user opening an item relating to the distance information setting in the menu screen displayed on the screen S, selecting a setting value, and determining. At this time, the user measures the distance between the voice input / output unit 17 and the apparatus main body 11 using an eye or a measuring instrument (for example, a measure), and operates the cursor 40 for a setting value corresponding to the eye or the measured distance. And press the decision button 39 to decide. If the determination in step S19 is affirmed, the process proceeds to step S23. On the other hand, if the determination in step S19 is negative, the process proceeds to step S21.

  In step S21, it is determined whether a predetermined time (for example, several tens of seconds to several minutes) has elapsed. If the determination here is affirmed, the process proceeds to step S25. On the other hand, if the determination in step S21 is negative, the flow returns to step S19. In step S21, for example, the timer is built in a timer built in the control device 24.

  In step S23, it is determined whether the calculated or set distance information is greater than or equal to a threshold value. Here, the threshold value is set to 30 cm, for example. If the determination in step S23 is affirmative, the process proceeds to step S25. On the other hand, if the determination in step S23 is negative, the process proceeds to step S27.

  In step S25, the microphone directivity control unit 126 sets the microphone pair 20 to be omnidirectional. As a result, when the distance between the audio input / output unit 17 and the apparatus main body 11 is relatively long, all users are within the sound collection range of the microphone pair 20 and the projector P is removed from the sound collection range of the microphone pair 20. (See FIG. 19).

  In step S <b> 27, the microphone directivity control unit 126 sets the microphone pair 20 to a single directivity with the + Y side as the sound collection range. As a result, when the distance between the audio input / output unit 17 and the apparatus main body 11 is relatively short, all users are within the sound collection range of the microphone pair 20 and the projector P is removed from the sound collection range of the microphone pair 20. (See FIG. 18).

  In the above modification, the control unit controls the directivity of the microphone pair 20 using the threshold value and the reference value corresponding to the threshold value, but the present invention is not limited to this. For example, the longer the calculated distance information, the smaller the degree of unidirectionality of the microphone pair 20 may be. In this case, the quality of the voice input by the microphone pair 20 can be improved by following the change in the distance information between the voice input / output unit 17 and the apparatus main body 11.

  In the modification, the distance information between the voice input / output unit 17 and the apparatus main body 11 is calculated based on the reception sensitivity of the radio wave from the voice input / output unit 17 at the main body side I / F 120. Instead of this, for example, a dedicated distance measuring device (for example, a device having an optical distance measuring function) may be used for measurement.

  Moreover, in the said modification, control based on the flowchart of FIG. 17 is performed, but you may complete | finish a flow, when the determination in step S13 is denied in FIG. That is, steps S17, S19, and S21 need not be performed. In FIG. 17, after the determination in step S21 is affirmed, the process proceeds to step S25. Instead, the process may proceed to step S27.

  Moreover, in the said embodiment and modification, although the control means has set the microphone pair 20 to either unidirectionality or non-directionality, for example, the directivity of the microphone pair 20 is not limited to this. The degree may be adjusted. Specifically, when the voice input / output unit 17 is removed from the apparatus main body 11 or when the distance information between the voice input / output unit 17 and the apparatus main body 11 is equal to or greater than a threshold value, the degree of directivity is set to be higher than the reference value. When the voice input / output unit 17 is attached to the apparatus main body 11 or the distance information between the voice input / output unit 17 and the apparatus main body 11 is less than the threshold value, the degree of directivity is larger than the reference value. You may do it. In this case, the reference value is preferably set to a value corresponding to the threshold value. Specifically, the reference value is preferably set to a larger value as the threshold value is smaller, or conversely, as the threshold value is larger, the reference value is preferably set to a smaller value. It should be noted that adjusting the degree of directivity of the microphone pair 20 includes making the directivity of the microphone pair 20 non-directional.

  Moreover, in the said embodiment and modification, although the unidirectional sound collection range of the microphone pair 20 is set to + Y side, it is not restricted to this but can be changed suitably.

  In the embodiment and the modification, each microphone is turned on when the audio input / output unit 17 is mounted on the apparatus main body 11. However, for example, only the + Y side microphone 20a may be turned on.

  Moreover, in the said embodiment and modification, although the audio | voice input / output unit 17 has two unidirectional microphones, it is not restricted to this. For example, you may have one or three or more unidirectional microphones. In the case of having one unidirectional microphone, the degree of directivity of the microphone can be adjusted. When there are three or more unidirectional microphones, a microphone group including three or more microphones can be set to be unidirectional or omnidirectional as in the above-described embodiment and the modified example. In the case of setting to the directivity, the degree of directivity of the microphone group can be adjusted. The voice input / output unit may have at least one unidirectional microphone and at least one omnidirectional microphone. In this case, only the unidirectional microphone is turned on when the voice input / output unit is attached to the apparatus body, and only the omnidirectional microphone is turned on when the voice input / output unit is removed from the apparatus body. It may be turned on.

  Moreover, in the said embodiment and modification, although the control means has the attachment / detachment determination part, it does not need to have it. In this case, for example, the CPU 101 may determine whether the audio input / output unit 17 is attached to or detached from the housing 25.

  Moreover, in the said embodiment and modification, although the audio | voice input / output unit 17 can be attached or detached to the mounting part 80 formed in the upper wall of the housing | casing 25, it is not restricted to this, For example, a housing is a rectangular parallelepiped shape. It may be formed in a box shape and attached to or detached from the side wall of the housing 25.

  In the embodiment and the modification, whether the audio input / output unit 17 is attached to the housing 25 due to a change in the connection state between the audio input / output unit 17 and the main body side I / F 120, that is, a change in inter-terminal voltage. However, the present invention is not limited to this. For example, a switch mechanism that is mechanically turned on / off when the audio input / output unit 17 is attached to and detached from the housing 25 (for example, in accordance with the operation of the lock device), and a light that detects the presence / absence of the audio input / output unit 17 A sensor such as a sensor or an ultrasonic sensor may be provided in the housing.

  Moreover, in the said embodiment and modification, although the camera 16 is provided in the housing | casing 25 via the arm 34, it is not restricted to this, For example, you may be provided in the housing | casing 25 directly.

  Moreover, in the said embodiment and modification, although the projector P is used as an image display means connected to the video conference apparatus 10, it is not restricted to this. For example, a monitor device, a television, a personal computer, or the like may be used. Moreover, you may employ | adopt as what has a display as an image display part integrally as a video conference apparatus.

  Moreover, in the said embodiment and modification, the video conference is performed between 12 bases, However, Not only this but the point should just be performed between several bases. Also in this case, it is preferable to arrange the video conference apparatus 10 at at least one base.

  In addition, the conference apparatus program used in the video conference apparatus according to the above-described embodiment and the modified example is equivalent to a software-based program using a personal computer, so that an unnecessary conference system of the relay apparatus 4 and the communication management apparatus 5 is constructed. (Conference system using only LAN or WAN can be constructed). Thus, the video conference apparatus 10 according to the present embodiment is not limited to use in the construction of the conference system 100 described above.

  Moreover, in the said embodiment and each modification, although the video conference apparatus 10 is used in one room, it is not limited to this. Since the video conference apparatus 10 is excellent in portability as described above, it is not necessary to be installed in a specific conference room, and can be expected to be freely carried and used in various places.

  Further, in the above-described embodiment and each modified example, the present invention is applied to a so-called portable type (portable) video conference apparatus 10, but the present invention can also be applied to a so-called stationary type video conference apparatus.

  Moreover, in the said embodiment and each modification, although the video conference apparatus 10 is employ | adopted as a communication apparatus, it is not restricted to this. For example, a teleconference device that only transmits and receives audio via a telephone line as a communication network may be employed. That is, the communication device of the present invention can be used in various modes as a communication tool used for information sharing by transmitting and receiving at least one of image and sound between a plurality of bases.

  DESCRIPTION OF SYMBOLS 10 ... Video conference apparatus (communication apparatus) 11 ... Apparatus main body, 16 ... Camera, 17 ... Audio | voice input / output unit, 18 ... Speaker, 20a, 20b ... Microphone, 120 ... Main body side I / F (communication means), 123 ... Attachment / detachment determination unit 123 (part of the control unit), 126... Microphone directivity control unit (part of the control unit).

JP 2012-54813 A

Claims (10)

A communication device used for information sharing via a communication network,
An apparatus body including a camera for photographing an object;
An audio input / output unit including at least one microphone and a speaker, which is detachably provided in the apparatus main body,
The communication device includes a control unit that controls directivity of the microphone based on a positional relationship between the device main body and the voice input / output unit.   The communication apparatus according to claim 1, wherein the apparatus main body is disposed at a position where the object enters within a photographing field of view of the camera.   The control means can determine whether or not the audio input / output unit is attached to the apparatus main body, and when the determination result is affirmative, the degree of directivity of the microphone is set to a reference value or more. 3. The communication device according to claim 1, wherein when the determination result is negative, the degree of directivity of the microphone is less than the reference value.   The control means can acquire distance information between the apparatus main body and the voice input / output unit, and when the acquired distance information is less than a threshold value, the degree of directivity is a reference value corresponding to the threshold value. The communication apparatus according to claim 1 or 2, wherein when the distance information is equal to or greater than the threshold, the degree of directivity is less than the reference value. The apparatus main body further includes a communication means capable of communicating with the voice input / output unit.
When the voice input / output unit is removed from the apparatus main body, the communication means and the voice input / output unit are wirelessly connected,
The control means obtains the distance information when the voice input / output unit is removed from the apparatus main body based on radio wave reception sensitivity from the voice input / output unit in the communication means. The communication apparatus according to claim 4. A method for controlling a voice input / output unit including at least one microphone and speaker, which is detachably provided on a main body of a communication apparatus used for information sharing via a communication network, including a camera for photographing an object. There,
Determining whether the voice input / output unit is attached to the apparatus body; and
Controlling the directivity of the microphone according to the determination result in the determining step.   In the controlling step, when the determination result in the determining step is affirmative, the degree of directivity is set to a reference value or more, and when the determination result is negative, the degree of directivity. 7. The method of controlling a voice input / output unit according to claim 6, wherein is set to be less than a reference value. A method for controlling a voice input / output unit including at least one microphone and speaker, which is detachably provided on a main body of a communication apparatus used for information sharing via a communication network, including a camera for photographing an object. There,
Obtaining distance information between the apparatus main body and the voice input / output unit;
And a step of controlling the directivity of the microphone based on the acquired distance information.   In the controlling step, when the acquired distance information is less than a threshold value, the degree of directivity is set to a reference value or more corresponding to the threshold value, and when the acquired distance information is equal to or more than the threshold value, the directivity is set. The method of controlling a voice input / output unit according to claim 8, wherein the degree of sex is less than the reference value.   The method of controlling a voice input / output unit according to claim 6, wherein the apparatus main body is disposed at a position where the object enters within a photographing field of view of the camera.

Images