JP6172303B2 - INPUT INFORMATION SUPPORT DEVICE, INPUT INFORMATION SUPPORT METHOD, AND INPUT INFORMATION SUPPORT PROGRAM - Google Patents

Description

  The present invention relates to an input information support apparatus, an input information support method, and an input information support program.

  2. Description of the Related Art Conventionally, in a conference or the like, a system has been proposed in which an input by a speaker's voice is recognized as voice and converted into text, and the input content converted into text is displayed. In such a system, for example, the input contents of the speaker are displayed in chronological order.

JP 2006-50500 A

  However, the conventional system may be unusable. For example, if the input content of a speaker is displayed in chronological order, the input content of each speaker is displayed in a discontinuous manner when a plurality of speakers speak. is there. For example, if the speaker B speaks in the middle of the speech of the speaker A, the input content of the speaker B is displayed in the middle of the input content of the speech of the speaker A, and the input content spoken by the speaker A Is difficult to grasp.

  In one aspect, an object of the present invention is to provide an input information support apparatus, an input information support method, and an input information support program that can improve usability.

  In one aspect, the input information support apparatus includes a reception unit and a display control unit. The reception unit receives input from a plurality of target persons. The display control unit performs control to display the input contents of a plurality of subjects received by the receiving unit on the display unit by dividing the frames in the received time-series order. The display control unit performs control to display the input content of the second subject in the second frame after displaying the input content of the first subject in the first frame, and then performs the first control. If the next input content received by the first target person is less than a predetermined first time after the input content of the target person is received, the next input content is added to the first frame. Control to display.

  According to one aspect of the present invention, usability can be improved.

FIG. 1 is a diagram illustrating an example of the configuration of a conference support system. FIG. 2 is a diagram illustrating an example of a hardware configuration of the input information support apparatus. FIG. 3 is a diagram illustrating an example of a conversation screen. FIG. 4 is a diagram illustrating an example of a functional configuration in which the input information support apparatus performs input control. FIG. 5 is a diagram illustrating an example of display according to the order of input. FIG. 6 is a diagram illustrating another example of display according to the order of input. FIG. 7 is a diagram illustrating another example of display according to the order of input. FIG. 8 is a diagram illustrating another example of display according to the order of input. FIG. 9 is a flowchart illustrating an example of the procedure of the input information support process. FIG. 10 is a diagram illustrating an example of the flow of editing. FIG. 11 is a diagram illustrating an example of a functional configuration for editing input content. FIG. 12A illustrates an example of editing input content. FIG. 12B is a diagram illustrating an example of editing input content. FIG. 13 is a diagram for explaining an example in which edited content is displayed in an identifiable manner. FIG. 14 is a diagram for explaining another example in which edited content is displayed in an identifiable manner. FIG. 15 is a flowchart illustrating an example of an editing process procedure.

  Hereinafter, embodiments of an input information support apparatus, an input information support method, and an input information support program according to the present invention will be described in detail with reference to the drawings. Note that the present invention is not limited to the embodiments. Each embodiment can be appropriately combined within a range in which processing contents are not contradictory.

[System configuration]
First, an example of a system that supports input of information using the input information support apparatus according to the first embodiment will be described. In the present embodiment, a case where the input information support apparatus is applied to a conference support system that supports a conference will be described. FIG. 1 is a diagram illustrating an example of the configuration of a conference support system. As shown in FIG. 1, the conference support system 10 includes a plurality of input information support devices 11. In the example of FIG. 1, the case where the number of input information support devices 11 is two is illustrated, but the present invention is not limited to this. Each input information support device 11 is communicably connected via a network and can exchange various types of information. In the example of FIG. 1, each input information support apparatus 11 is communicably connected by a wireless LAN (Local Area Network) network using the wireless base station 12 as an access point. The network is not limited to a wireless LAN, and any type of communication network such as a wired LAN, mobile communication such as a mobile phone, short-range wireless communication such as Bluetooth (registered trademark), and the Internet can be employed.

  The input information support apparatus 11 is an apparatus used by users who participate in the conference. For example, the input information support apparatus 11 is an information processing apparatus such as a personal computer, a tablet terminal, or a smartphone. Each input information support device 11 operates a program that displays the input contents input thereto in chronological order and supports the conference. A user who participates in the conference uses the input information support apparatus 11 to input various information. The input information support apparatus 11 displays the input content that has been input and transmits it to another input information support apparatus 11. Further, the input information support apparatus 11 displays the input content received from the other input information support apparatus 11. As a result, the conference support system 10 can refer to the input content input by each user on each input information support device 11. The conference support system 10 is used, for example, when a conference is performed including users who are impaired in hearing, or when a conference is performed between users at remote locations.

[Hardware Configuration of Input Information Support Device 11]
Next, a hardware configuration of the input information support apparatus 11 according to the first embodiment will be described. FIG. 2 is a diagram illustrating an example of a hardware configuration of the input information support apparatus. FIG. 2 is a diagram illustrating an example of the case where the input information support apparatus 11 is configured by a personal computer. As shown in FIG. 2, the input information support apparatus 11 includes a CPU (Central Processing Unit) 20, a memory 21, a wireless module 22, an HDD (Hard Disk Drive) 23, a display unit 24, and a first input device. 25 and an external I / F (interface) 26. These CPU 20, memory 21, wireless module 22, HDD 23, display unit 24, first input device 25, and external I / F 26 are connected via a bus 28. Note that the input information support apparatus 11 may include various types of hardware included in known computers other than the hardware illustrated in FIG. 2.

  The CPU 20 is a device that controls the input information support apparatus 11. The CPU 20 executes various programs related to input information support, thereby functioning as various processing units and causing the personal computer to function as the input information support apparatus 11. Details of the functions realized by the CPU 20 will be described later.

  The memory 21 is a device that temporarily stores a program executed by the CPU 20 and various data used by the program. In the input information support apparatus 11 according to the present embodiment, the memory 21 is provided with a storage area of the buffer 60 for storing input contents input by the user.

  The wireless module 22 is a communication device that communicates with another input information support apparatus 11. The wireless module 22 exchanges various types of information with another input information support apparatus 11 through wireless LAN communication under the control of the CPU 20. For example, the wireless module 22 transmits the input content input by the user to another input information support apparatus 11. Further, the wireless module 22 receives the input content input from the other input information support apparatus 11 to the other input information support apparatus 11.

  The HDD 23 is a device that stores various programs executed by the CPU 20 and various data. In the input information support apparatus 11 according to the present embodiment, a program for displaying the input contents in time series order and supporting the conference is stored in the HDD 23.

  The display unit 24 is a device that displays various types of information. Examples of the display unit 24 include a display device such as an LCD (Liquid Crystal Display). The display unit 24 displays various information. For example, the display unit 24 displays a conversation screen described later.

  The first input device 25 is a device through which a user inputs various information by operation. For example, the first input device 25 may be an input device such as a keyboard, a mouse, various buttons provided on the input information support apparatus 11, and a transmissive touch sensor provided on the display unit 24. In the example of FIG. 2, since the functional configuration is shown, the display unit 24 and the first input device 25 are separately provided. For example, the display unit 24 such as a touch panel and the first input device 25 are provided integrally. It may be configured with different devices.

  The external I / F 26 is an interface for inputting / outputting data with an external device. For example, the external I / F 26 includes an input / output port such as a USB (Universal Serial Bus) port, a display port, and a video input / output port such as an HDMI (registered trademark) (High-Definition Multimedia Interface). An external device is connected to the external I / F 26. In the example of FIG. 2, a second input device 29 and an external display device 30 are connected to the external I / F 26.

  The second input device 29 is a device by which a user inputs various information by voice. For example, the second input device 29 is a microphone that collects user's voice and outputs voice data.

  The external display device 30 is a device that displays various types of information. Examples of the external display device 30 include a display device that can be attached to and detached from the input information support device 11 such as a projector that projects an image or an external display.

  In the input information support apparatus 11 according to the present embodiment, a program for supporting a conference operates, and the input content input from the first input device 25 or the second input device 29 of the own apparatus or another input information support apparatus 11 is received. Display conversation screens displayed in chronological order.

[Conversation screen]
FIG. 3 is a diagram illustrating an example of a conversation screen. On the conversation screen 40, input contents received from each user are displayed in a frame 41 divided in order of the received time series. The conversation screen 40 is provided with a plurality of input icons 42 for the user to input. In the example of FIG. 3, as the input icon 42, a handwriting input icon 42A, a voice recognition input icon 42B, a keyboard input icon 42C, and a stamp input icon 42D are provided. In the example of FIG. 3, seven frames 41 that are input by the users A and B are displayed. In the frame 41, each input content and the input time are displayed.

  The handwriting input icon 42A is an icon for designating input contents to be input by handwriting. When the handwriting input icon 42A is selected, it becomes possible to input by handwriting by a mouse operation or a touch operation, and an image input by handwriting is set as input content. A frame 41 in the fourth row in the example of FIG. 3 illustrates a case where an image handwritten as “C30” is input.

  The voice recognition input icon 42B is an icon for designating input contents by voice. When the voice recognition input icon 42B is selected, a character obtained by voice recognition of voice data input from the microphone is set as the input content.

  The keyboard input icon 42 </ b> C is an icon that specifies that the input content is input with the keyboard. When the keyboard input icon 42C is selected, characters input from the keyboard are input contents.

  The stamp input icon 42D is an icon for designating input contents as an illustration. When the stamp input icon 42D is selected, a stamp showing various input contents as illustrations is displayed, and the selected illustration is used as the input contents. In the example of FIG. 3, when the stamp input icon 42D is selected, a stamp describing “YES”, “NO”, “OK!”, “STOP!” Is displayed, and an image of the selected stamp is input. The content. A frame 41 on the seventh line in the example of FIG. 3 shows a case where a stamp “OK!” Is input.

  Although the input information support apparatus 11 according to the present embodiment can switch the input type by the input icon 42 on the conversation screen 40, the input type according to the input content may be switched. For example, the input information support apparatus 11 may perform voice recognition of the input voice when a voice having a threshold value or more is input from a microphone, and may use the voice-recognized character as the input content. Moreover, the input information support apparatus 11 is good also considering the input character as input content, when there exists key input from a keyboard. The input information support apparatus 11 may display a plurality of types of stamps on a part of the screen, and when the stamp is selected by a touch operation or a mouse operation, the selected stamp may be used as input content. Further, the input information support apparatus 11 displays a handwritten input area on a part of the screen, and when handwritten input is performed in the input area by touch operation or mouse operation, an input content of an image handwritten in the input area is input. It is good.

  In the conversation screen 40, the input content received from each user is displayed in a vertical direction with a frame 41 divided in chronological order. When the display area is exceeded, the frame 41 is entirely vertical so that the old display content is outside the display area. Move in the direction. In addition, the conversation screen 40 is provided with a scroll bar 43 for moving the display area. By moving the display area with the scroll bar 43, it is possible to display the old display contents once outside the display area. It is said that.

  By the way, when the user input contents are displayed in the frame 41 in time series order, the input contents of each user are displayed in a discontinuous manner when a plurality of users input, so that it may be difficult to grasp the input contents and the usability may be poor. is there. Therefore, the input information support apparatus 11 according to the present embodiment performs input control in which the received input content is added and displayed in the frame 41 displaying the past input content when the specific condition is satisfied.

[Function structure of input control]
A description will be given of a functional configuration for performing input control in which the input information support apparatus 11 adds and displays the received input content in a frame in which past input content is displayed when the specific condition is satisfied. FIG. 4 is a diagram illustrating an example of a functional configuration in which the input information support apparatus performs input control.

  The control unit 50 is a device that controls the input information support apparatus 11 and is, for example, the CPU 20. In addition to the CPU, an electronic circuit such as an MPU (Micro Processing Unit) or an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array) can be used as the control unit 50. The control unit 50 has an internal memory for storing programs defining various processing procedures and control data, and executes various processes using these. The control unit 50 operates as various programs and functions as various processing units. For example, the control unit 50 operates the device stored in the HDD 23 to operate the device processing unit 51, the buffer change sensing unit 52, the transmission unit 53, the reception unit 54, the display control unit 55, and the change unit. 56 functions.

  The device processing unit 51 performs predetermined preprocessing for recognizing the input content on the information input from the first input device 25 and the second input device 29 to recognize the user input content. For example, the device processing unit 51 performs character conversion according to a key input from the keyboard as the first input device 25. The device processing unit 51 generates an image input by handwriting when the first input device 25 is input by handwriting with a mouse or a touch sensor. Further, when a stamp is selected with the mouse or the touch sensor as the first input device 25, the device processing unit 51 extracts an image of the selected stamp. In addition, when voice data is input from the microphone as the second input device 29, the device processing unit 51 performs voice recognition on the input voice data and performs character conversion. In the example of FIG. 4, the device processing unit 51 is illustrated as one processing unit, but may be illustrated separately as another processing unit for each input type. The device processing unit 51 adds the input identification information of the input user and the input time information to the input contents of the recognized user, and stores them in the buffer 60. This user identification information may be used, for example, as a user ID logged on to the system, or the identification information of the input information support apparatus 11 such as the machine name of the input information support apparatus 11 may be used instead.

  The buffer 60 receives input content from the user, and manages and stores the received input content. For example, the buffer 60 manages and stores input content from the user separately for each user and input content. In this embodiment, the buffer 60 is an example of a reception unit.

  The buffer change sensing unit 52 senses a change in the input content stored in the buffer 60. For example, the buffer change sensing unit 52 monitors whether or not the data of the input content from the device processing unit 51 is stored in the buffer 60 and senses the data change. That is, the buffer change sensing unit 52 senses whether or not there is an input from the user in the own device by sensing a change in the data of the user of the own device stored in the buffer 60.

  When the buffer change sensing unit 52 senses that there is an input from the user by the buffer change sensing unit 52, the transmission unit 53 sends data of the input content from the sensed user to the other input information support device 11. Thereby, the input content input from the user by the own device is displayed on the other input information support device 11.

  The receiving unit 54 receives data of input contents input from the other input information support apparatus 11 and transmitted from the other input information support apparatus 11. This input content data is added with the user identification information input by the other input information support apparatus 11 and the input time information. The receiving unit 54 stores the received input content data in the buffer 60.

  The display control unit 55 performs control to display the input contents of a plurality of users stored in the buffer 60 on the display unit 24 by dividing the frames in the received time series. For example, the display control unit 55 performs control to display the input content on the display unit 24 in a time-series order received based on the time information added to each input content stored in the buffer 60. In addition, when the specific condition is satisfied, the display control unit 55 performs control to add and display the received input content in a frame in which past input content is displayed. The specific condition is, for example, that the next input content is received less than a predetermined first time after the previous input content of the same user is received. When the specific condition is satisfied, the display control unit 55 performs control to add and display the received input content in a frame displaying the input content immediately before the same user who satisfies the specific condition. For example, the first time is 3 seconds. When the next input content is received in less than 3 seconds after receiving the previous input content of the same user, the display control unit 55 displays the previous input content of the same user in a frame that displays the input content. Then, the received input content is added and displayed.

  Even when the received input content is added and displayed in the frame displaying the previous input content of the same user, the display control unit 55 displays the display form according to the time when the input content is input. May be divided. For example, the display control unit 55 displays the past input content when the next input content is received within a second time shorter than the first time after receiving the previous input content of the same user. Control is performed to display the received input content in the frame following the past input content. In the case where the received input content is displayed following the past input content, the display control unit 55 displays a predetermined interval such as a blank or a punctuation mark on the frame displaying the past input content in order to indicate a break of the input content. A delimiter may be added, and then the received input content may be added. In addition, when the display control unit 55 receives the previous input content of the same user and then receives the next input content between the first time and the second time, the display control unit 55 displays the past input content. In addition, control is performed to display the received input content after a line feed to the past input content. For example, the first time is 3 seconds and the second time is 2 seconds. When receiving the next input content in less than 2 seconds after receiving the previous input content of the same user, the display control unit 55 displays the past input content in the frame displaying the past input content. Subsequently, control is performed to display the received input contents. Further, when the display control unit 55 receives the next input content within 2 seconds or more and less than 3 seconds after receiving the previous input content of the same user, the display control unit 55 displays the past input content. In addition, control is performed to display the received input content after a line feed to the past input content.

  The change part 56 performs the change which eases specific conditions, when there exists a predetermined change in input. For example, when the input method of input content is changed from the previous input of the same user, the changing unit 56 performs a change that relaxes the specific condition. For example, when the input method is changed such as a change from voice input by voice recognition to keyboard input, the changing unit 56 changes the first time from 3 seconds to 5 seconds. Note that the changing unit 56 may make a change that extends the second time.

  Here, it demonstrates using a specific example. FIG. 5 is a diagram illustrating an example of display according to the order of input. FIG. 5 shows a case where the user B inputs “Yes” while the user A inputs “I am” and “Genki”. In the example of FIG. 5, it is assumed that the time between “I am” and “Genki” is less than 2 seconds.

  In this case, the display control unit 55 displays the input content of the user A “I am” in the frame 41A, and then displays the input content of the user B “Yes” in the frame 41B. Then, since the input of “Energy” by the user A is less than 2 seconds after the input content of “I am” is accepted, the display control unit 55 continues to add “I” to the frame 41A. To display. Thus, “I am fine” is displayed in the frame 41A. In this way, even when the user B inputs in the middle of the input contents of the user A, the input contents of the user A can be easily grasped by displaying the input contents of the user A in the same frame 41A.

  FIG. 6 is a diagram illustrating another example of display according to the order of input. FIG. 6 shows a case where the user B inputs “Yes” while the user A inputs “I am” and “Genki”. In the example of FIG. 6, it is assumed that the interval between “I am” and “Genki” is 2 seconds or more and less than 3 seconds.

  In this case, the display control unit 55 displays the input content of the user A “I am” in the frame 41A, and then displays the input content of the user B “Yes” in the frame 41B. Then, since the input of “Genki” by the user A is 2 seconds or more and less than 3 seconds after receiving the input content of “I am”, the display control unit 55 makes a line break into “I am” in the frame 41A. To add and display “Genki”. As a result, “I am”, a line feed, and “Genki” are displayed in the frame 41A. Thus, even if there is an input by the user B in the middle of the input contents of the user A, the input contents of the user A can be easily grasped by displaying the input contents of the user A in the same frame 41A. Further, by inserting a line break in the input content of the user A, it is possible to visually express that there was a gap between the time when the user A inputs “I am” and “Genki”.

  FIG. 7 is a diagram illustrating another example of display according to the order of input. FIG. 7 shows a case where the user B inputs “Yes” while the user A inputs “I am” and “Genki”. In the example of FIG. 7, it is assumed that the time period between “I am” and “Genki” is 3 seconds or more.

  In this case, the display control unit 55 displays the input content of the user A “I am” in the frame 41A, and then displays the input content of the user B “Yes” in the frame 41B. Then, since the input of “Genki” by the user A is 3 seconds or more after the input content of “I am” is received, the display control unit 55 displays “Genki” in the new frame 41C. As a result, “I am”, “Yes”, and “Genki” are displayed in different frames 41A to 41C. In this way, when there is a gap in the input contents of the user A, it is possible to visually express that there is a gap in the input contents of the user A by displaying them separately.

  FIG. 8 is a diagram illustrating another example of display according to the order of input. FIG. 8 shows a case where the user A inputs “I” and “Genki” after the user B inputs “Yes”. In the example of FIG. 7, it is assumed that the time between “I am” and “Genki” is less than 2 seconds.

  In this case, the display control unit 55 displays the input content of the user B “Yes” in the frame 41A and the input content of the user A “I am” in the frame 41B. Then, since the input of “Genki” by the user A is less than 2 seconds after the input content of “I am” is accepted, the display control unit 55 adds “I am” continuously to the frame 41B. To display. Thus, “I am fine” is displayed in the frame 41B.

[Flow of input control processing]
A flow of input information support processing in which the input information support apparatus 11 according to the present embodiment supports display of input information will be described. FIG. 9 is a flowchart illustrating an example of the procedure of the input information support process. This input information support process is executed at a predetermined timing, for example, when the data of the input content is stored in the buffer 60 from the device processing unit 51 or the receiving unit 54.

  As illustrated in FIG. 9, the display control unit 55 assigns identification numbers to the input content data in the order stored in the buffer 60 for each user in order (S <b> 10). For example, when two users A and B perform input, the display control unit 55 secures variables P and Q each having an initial value of zero. The display control unit 55 increments and assigns the value of the variable P to the input content data every time the data of the input content of the user A is stored in the buffer 60. The display control unit 55 increments and assigns the value of the variable Q to the input content data every time the data of the input content of the user B is stored in the buffer 60.

  The display control unit 55 determines whether or not the frame 41 of the user j who has input the input content most recently stored in the buffer 60 has been displayed (S11). When the frame 41 of the user j has not been displayed so far (No in S11), the display control unit 55 adds the frame 41 of the user j and displays the input content stored most recently in the buffer 60 (S12). Exit. Thereby, the user who has not displayed the input contents once displays the frame 41 by this processing.

  On the other hand, when the frame 41 of the user j has already been displayed (Yes in S11), the changing unit 56 determines whether or not the input content input method has been changed from the previous input of the same user (S13). . When the input method is not changed (No at S13), the process proceeds to S15 described later.

  When the input method is changed (Yes in S13), the changing unit 56 performs a change that relaxes the specific condition (S14). For example, the changing unit 56 changes the first time from 3 seconds to 5 seconds. The display control unit 55 determines whether or not the user j who has input the input content most recently stored in the buffer 60 is the same as the user i who has input the most recent input content (S15). When the user j and the user i are the same (Yes in S15), the display control unit 55 obtains an elapsed time Δt from the previous input with the identification number of the user j (S16). For example, when the most recent input content is by the user A, the display control unit 55 obtains the difference in time when the input content with the variables P and P-1 added to the identification number is input. In this case, since the latest input content and the immediately previous input content are by the same user, the display control unit 55 obtains the elapsed time Δt between the most recent and the most recent previous input content. become.

  The display control unit 55 determines whether or not the elapsed time Δt is less than the second time (S17). If the elapsed time Δt is less than the second time (Yes at S17), the display control unit 55 adds the input content most recently stored in the buffer 60 to the frame displaying the previous input content of the user j. Display (S18), and the process is terminated.

  On the other hand, when the elapsed time Δt is not less than the second time (No at S17), the display control unit 55 determines whether the elapsed time Δt is less than the first time (S19). When the elapsed time Δt is less than the first time (Yes in S19), the display control unit 55 makes a line feed in the frame displaying the input content immediately before the user j and stores the input content most recently stored in the buffer 60. Is displayed (S20), and the process is terminated.

  On the other hand, when the elapsed time Δt is not less than the first time (No at S19), the display control unit 55 adds the frame 41 to display the input content stored most recently in the buffer 60 (S21), and ends the process. To do.

  When the user j and the user i are not the same (No in S15), the display control unit 55 obtains the elapsed time Δt from the previous input with the identification number of the user j (S22). For example, when the most recent input content is by the user A, the display control unit 55 obtains the difference in time when the input content with the variables P and P-1 added to the identification number is input.

  The display control unit 55 determines whether or not the elapsed time Δt is less than the second time (S23). When the elapsed time Δt is less than the second time (Yes at S23), the display control unit 55 adds the input content most recently stored in the buffer 60 to the frame displaying the previous input content of the user j. Display (S24), and the process is terminated.

  On the other hand, when the elapsed time Δt is not less than the second time (No at S23), the display control unit 55 determines whether the elapsed time Δt is less than the first time (S25). When the elapsed time Δt is less than the first time (Yes at S25), the display control unit 55 makes a line feed in the frame displaying the previous input content of the user j and stores the input content most recently stored in the buffer 60. Is displayed (S26), and the process is terminated.

  On the other hand, when the elapsed time Δt is not less than the first time (No at S25), the display control unit 55 adds the frame 41 to display the input content stored most recently in the buffer 60 (S27), and ends the processing. To do.

  In this input information support process, when the next input content is received in less than 3 seconds after receiving the previous input content of the same user, a frame displaying the previous input content of the same user Since the received input content is added and displayed, the input content of the user A can be easily grasped.

  Incidentally, the input content displayed in the frame 41 may have an error due to, for example, an input error from the keyboard, a conversion error, or a voice recognition error. Thus, the input information support apparatus 11 according to the present embodiment can accept editing of the input content displayed in the frame 41. For example, the input information support apparatus 11 according to the present embodiment can accept partial editing by selecting a range for the input content displayed in the frame 41.

[Edit flow]
FIG. 10 is a diagram illustrating an example of the flow of editing. When editing the display content displayed in any of the frames 41, the user selects the frame 41 to be edited (FIG. 10A). This editing can be selected in any frame 41. That is, the user can edit the frame 41 input by another user in addition to the frame 41 input by the user. The user selects a range of a part having an error in the frame 41 to be edited (FIG. 10B). In the range-selected frame 41, the selected input content is displayed in the edit frame 44 (FIG. 10C). The edit frame 44 is provided with “Delete”, “Edit”, and “Cancel” buttons. The “delete” button is a button for designating deletion of the selected frame 41. The “edit” button is a button for designating the reflection of the correction content on the selected input content. The “cancel” button is a button for designating cancellation of editing.

  The user performs editing such as correction, deletion, addition, etc., with the portion displayed in the editing frame 44 as an editing target, and selects the editing button when reflecting the editing. If input by the user who has input in the frame 41 is continued during the editing, the input content continuously input is displayed in the frame P (FIG. 10D). That is, the input information support apparatus 11 allows other users to edit the input content of the frame 41 that is being input by the user.

[Functional structure of editing]
A functional configuration in which the input information support apparatus 11 edits the input content displayed in the frame 41 will be described. FIG. 11 is a diagram illustrating an example of a functional configuration for editing input content. In addition, about the same part as FIG. 4, the same code | symbol is attached | subjected and a different part is mainly demonstrated. The control unit 50 further includes a selection determination unit 57 and an editing unit 58.

  The selection determination unit 57 determines whether a range has been selected for any of the frames 41. When a range is selected for any one of the frames 41, the selection determining unit 57 identifies the selected range selected from the frame 41 from which the range is selected and the input content.

  When a range is selected for the frame 41, the display control unit 55 displays an edit frame 44 for editing the selected range in the frame 41 from which the range is selected, and the input content is displayed in the edit frame 44. Accept edits.

  The editing unit 58 copies the input content in which the editing frame 44 is displayed among the data of the input content of the frame 41 in which the range is selected, stored in the buffer 60, to another storage area in the buffer 60 as an editing target. To do. Then, the editing unit 58 accepts correction of the editing target in response to an operation on the editing frame 44.

  The buffer change sensing unit 52 monitors the change of the data of the input content stored in the buffer 60 by the editing unit 58 and senses the data change by the editing unit 58.

  The transmission unit 53 transmits the data of the portion that has been edited by the editing unit 58 detected by the buffer change detection unit 52 to the other input information support apparatus 11. As a result, the part being edited is also displayed on the other input information support apparatus 11.

  The receiving unit 54 receives data of the part being edited and transmitted from the other input information support apparatus 11. The receiving unit 54 stores the data of the part being edited in the buffer 60. As a result, the portion edited by another input information support apparatus 11 is also displayed on the input information support apparatus 11.

  The display control unit 55 displays the input content reflecting the correction in the frame 41 in which the range is selected in accordance with the correction to the editing target received by the editing unit 58.

  Here, it demonstrates using a specific example. 12A and 12B are diagrams illustrating an example of editing the input content. 12A and 12B show the “I will liven up products and services that are easy to use and allow more people to participate in society” in the “41 There is an error, and the flow of performing editing for correction by the user is shown. In the area of Buffer 1 in the buffer 60, the input content displayed in the frame 41 is stored (FIG. 12A (A)).

  The user selects the frame 41 to be edited. Then, the user selects a range of a part having an error in the frame 41 to be edited. In the example of FIG. 12, the “live up” portion is selected. When the selection determining unit 57 detects that the range has been selected for the frame 41, the editing unit 58 copies the selected “lively going” portion as an editing target and copies Buffer 2 in the buffer 60. (FIG. 12A (B)). The display control unit 55 displays the edit frame 44 describing the selected input content in the frame 41 in which the range is selected (FIG. 12A (C)).

  When the user makes a correction to delete “description” in the editing frame 44, the editing unit 58 stores the corrected editing target in the area of Buffer 3 in the buffer 60. The display control unit 55 displays the modified editing object stored in Buffer 3 in the editing frame 44 (FIG. 12A (D)).

  In addition, when the user makes a correction for deleting “Pleasant” in the editing frame 44, the editing unit 58 deletes “Pleasant” from Buffer 3 in the buffer 60. The display control unit 55 displays the corrected editing object stored in Buffer 3 in the editing frame 44 (FIG. 12B (E)).

  When the user corrects “develop and provide” in the editing frame 44, the editing unit 58 stores “develop and provide” in Buffer 3 in the buffer 60. The display control unit 55 displays the corrected editing object stored in Buffer 3 in the editing frame 44 (FIG. 12B (F)).

  When the user selects the “edit” button in the edit frame 44, the contents input in the edit frame 44 are stored in Buffer 3 (FIG. 12B (G)). The display control unit 55 deletes the edit frame 44 and replaces the part to be edited stored in Buffer 2 out of the input contents stored in Buffer 1 in the buffer 60 with the content stored in Buffer 3 and displays it in the frame 41. (FIG. 12B (H)). Thereby, the input information support apparatus 11 allows each user to edit the input content displayed in the input and input frame 41.

  In FIG. 12B (H), the display control unit 55 displays the edited input content in the frame 41, but the edited content may be displayed in an identifiable manner.

  FIG. 13 is a diagram for explaining an example in which edited content is displayed in an identifiable manner. For example, among the input contents displayed in the frame 41, the display control unit 55 surrounds the edited object to be edited with the frame 45, and displays the edited content as deleted in the edited part. The edited content may be displayed at the location to be edited. In the example of FIG. 13, “Kyoto is” before editing is marked with a deletion line, and “Today” after editing is displayed thereon. Further, the display control unit 55 may indicate the edited user in an identifiable manner. In the example of FIG. 13, the upper right tab “A” indicates that user A has edited.

  FIG. 14 is a diagram for explaining another example in which edited content is displayed in an identifiable manner. For example, the display control unit 55 may display the input content before editing and the input content after editing in the frame 41. In the example of FIG. 14, a tab is added to the frame 41 to display the input content before editing and the input content after editing. In the upper right tab “original data”, the input content before editing is displayed. The upper right tab “1” displays the edited input content edited for the first time. In the upper right tab “2”, the edited input content edited the second time is displayed.

[Editing process flow]
A flow of an editing process in which the input information support apparatus 11 according to the present embodiment accepts editing of input content will be described. FIG. 15 is a flowchart illustrating an example of an editing process procedure. This editing process is executed at a predetermined timing, for example, when any one of the frames 41 is selected.

  The display control unit 55 determines whether or not a range has been selected for the selected frame 41 (S50). When the range is not selected (No in S50), the process proceeds to S50 again to wait for the range selection.

  On the other hand, when the range is selected (Yes at S50), the display control unit 55 displays the edit frame 44 for editing the selected range on the frame 41 where the range is selected (S51). The editing unit 58 copies the input contents in the selected range to Buffer 2, which is another storage area in the buffer 60 (S52).

  The editing unit 58 stores the edited input contents of the editing frame 44 in Buffer 3, which is another storage area in the buffer 60, in response to an operation on the editing frame 44 (S53). When Buffer 3 is added, the display control unit 55 displays the input content stored in Buffer 3 in the edit frame 44 (S54).

  The display control unit 55 determines whether or not there is an addition to Buffer 1 in which the input content before editing is stored (S55). When there is no addition (No at S55), the process proceeds to S57 described later.

  On the other hand, when there is an addition (Yes at S55), the display control unit 55 displays the frame P and displays the added input content (S56).

  The editing unit 58 determines whether a delete button has been selected (S57). When the delete button is selected (Yes at S57), the editing unit 58 deletes the input content of the selected frame 41 from the buffer 60 (S58). The display control unit 55 updates the display of the frame 41 of the conversation screen 40 according to the data in the buffer 60 after deletion (S59), and ends the process.

  On the other hand, when the delete button is not selected (No in S57), the editing unit 58 determines whether or not the cancel button is selected (S60). When the cancel button is selected (Yes at S60), the editing unit 58 deletes the data of Buffers 2 and 3 corresponding to the selected frame 41 (S61). The display control unit 55 deletes the edit frame 44, updates the display of the frame 41 of the conversation screen 40 according to the data in the buffer 60 (S62), and ends the process.

  On the other hand, when the cancel button is not selected (No at S60), the editing unit 58 determines whether the edit button is selected (S63). When the edit button is selected (Yes in S63), the editing unit 58 stores the input content displayed in the edit frame 44 in Buffer 3 (S64). The display control unit 55 deletes the edit frame 44, displays the input content reflecting the correction in the frame 41 whose range is selected (S65), and ends the process.

  On the other hand, when the edit button is not selected (No in S63), the process proceeds to S53 described above and the editing process is continued.

[effect]
As described above, the input information support apparatus 11 according to the present embodiment receives inputs from a plurality of users. The input information support apparatus 11 displays the received input contents of a plurality of users on the display unit by dividing the frames in the order of the received time series, and accepts the input contents of the past when the specific input conditions are satisfied. Control to add and display the input contents. Thereby, the input information support apparatus 11 can make it easier for the user to understand the input content by displaying the input content satisfying the specific condition in the same frame, and thus can improve usability.

  Further, in the input information support apparatus 11 according to the present embodiment, the specific condition is that the next input content is received less than a predetermined first time after the previous input content of the same user is received. . When the specific condition is satisfied, the input information support apparatus 11 performs control to add and display the received input content in a frame displaying the input content immediately before the same user who satisfies the specific condition. As a result, the input information support apparatus 11 accepts the input content immediately before the user but accepts the next input content less than the first time even if another user's input is performed during the user's input. In this case, since the input content can be displayed in the same frame, the input content can be easily grasped.

  Further, the input information support apparatus 11 according to the present embodiment displays the past input content when the next input content is received in less than the second time after receiving the previous input content of the same user. The received input content is displayed in the frame following the past input content. As a result, the input information support apparatus 11 can display the input content immediately before and the next input content of the user in succession, thereby making it easy to grasp the input content. Further, the input information support apparatus 11 displays the past input contents when the next input content is received between the first time and the second time after receiving the previous input content of the same user. Control is performed to display the received input content in a new line in the frame. Thereby, the input information support device 11 can visually express that there is a gap between the input content immediately before the user and the next input content. In particular, a user who is impaired in hearing cannot grasp the input content of another user from the sound. For this reason, it is possible to visually express that there is a gap between the input contents by displaying the input contents received after a line feed in the past input contents. Moreover, since the input content is divided into lines by displaying the input content received with a line feed in the past input content, the input content can be easily read.

  Moreover, the input information assistance apparatus 11 which concerns on a present Example changes 1st time long, when the input method of input content is changed from the input before the same user. The input information support apparatus 11 accepts the next input of the same user when the next input content is received in less than the first time after the first input content of the same user is received. The received input content is added to the frame displaying the content and displayed. Changing the input method loses time. For this reason, even when the user changes the input method, the input information support apparatus 11 can display the input content in the same frame by changing the first time longer.

  Although the embodiments related to the disclosed apparatus have been described so far, the disclosed technology may be implemented in various different forms other than the above-described embodiments. Therefore, another embodiment included in the present invention will be described below.

  For example, in the above-described embodiment, a case has been described in which the specific condition is defined by the elapsed time when the next input content is received after receiving the previous input content of the same user, but the disclosed apparatus is limited to this. Not. For example, the specific condition may be that the input content immediately before the same subject and the received input content are a series of inputs. For example, the display control unit 55 analyzes various natural language processes corresponding to the language used for the input content with respect to the input content immediately before and the received input content of the same subject. Examples of the natural language processing include, but are not limited to, morphological analysis, syntactic analysis, and context analysis. Any analysis method may be used as long as the input content can be determined as a series of inputs. Then, as a result of analysis, the display control unit 55 displays the previous input content when it is determined that the previous input content is highly related to the received input content and is a series of inputs. You may perform control which adds and displays the received input content on a frame. For example, the display control unit 55 analyzes the document structure such as dependency and part-of-speech individually for the previous input content or for the previous input content and the received input content individually. Further, the display control unit 55 analyzes the document structure by connecting the previous input content and the received input content. As a result of analysis, the display control unit 55 connects only the previous input content or the previous input content and the received input content individually when the previous input content and the received input content are connected. If the document structure becomes clearer and the analysis result is better than in the case of analysis, it may be determined that the input is a series of inputs. In addition, for example, the display control unit 55 analyzes the meaning of only the previous input content, or the previous input content and the received input content individually by natural language processing. The display control unit 55 connects the previous input content and the received input content, and analyzes the meaning by natural language processing. As a result of analysis, the display control unit 55 connects only the previous input content or the previous input content and the received input content individually when the previous input content and the received input content are connected. If there are fewer unclear points and the analysis result is better than in the case of analysis, the input may be determined as a series of inputs. Moreover, you may combine elapsed time and analysis. For example, the display control unit 55 receives the previous input content and the received input content in which the elapsed time when the next input content is received after receiving the previous input content of the same user is less than the first time. Various analysis of natural language processing is performed for. Then, as a result of analysis, the display control unit 55 displays the previous input content when it is determined that the previous input content is highly related to the received input content and is a series of inputs. You may perform control which adds and displays the received input content on a frame.

  Further, in the above embodiment, the input content input by each input information support device 11 is transmitted to the other input information support device 11, and the input content of the other input information support device 11 is transmitted to each input information support device 11. However, the disclosed apparatus is not limited to this. For example, the server device is provided and each input information support device 11 transmits the input content input to the server device, and the server device generates the conversation screen 40 from the input content received from each input information support device 11 to input each input. The information may be distributed to the information support apparatus 11. On the other hand, as in the present embodiment, the input content input by each input information support device 11 is transmitted to the other input information support device 11, and the input information of the other input information support device 11 is input to each input information support device 11. By displaying the contents, the conference support system 10 can be configured without providing a server device.

  Further, each component of each illustrated apparatus is functionally conceptual, and does not necessarily need to be physically configured as illustrated. In other words, the specific state of distribution / integration of each device is not limited to the one shown in the figure, and all or a part thereof may be functionally or physically distributed or arbitrarily distributed in arbitrary units according to various loads or usage conditions. Can be integrated and configured. For example, the device processing unit 51, the buffer change sensing unit 52, the transmission unit 53, the reception unit 54, the display control unit 55, the change unit 56, the selection determination unit 57, and the editing unit 58 may be appropriately integrated. Further, the processing of each processing unit may be appropriately separated into a plurality of processing units. Further, all or any part of each processing function performed in each processing unit can be realized by a CPU and a program analyzed and executed by the CPU, or can be realized as hardware by wired logic. .

[program]
The various processes described in the above embodiments can also be realized by executing a program prepared in advance on a computer having a configuration similar to that shown in FIG. 2, such as a personal computer or a workstation. Therefore, in the following, an example of a computer that executes a program having the same function as in the above embodiment will be described.

  In the HDD 23 shown in FIG. 2, a program that exhibits the same functions as the buffer change sensing unit 52, the transmission unit 53, the reception unit 54, the display control unit 55, the change unit 56, the selection determination unit 57, and the editing unit 58 is stored in advance. Remembered. Note that the programs may be separated as appropriate.

  The HDD 23 stores various information. For example, the HDD 23 stores various data used for the OS and various processes.

  Then, the CPU 20 reads and executes the program stored in the HDD 23, thereby executing the same operation as each processing unit of the embodiment. That is, the program performs the same operations as the buffer change sensing unit 52, the transmission unit 53, the reception unit 54, the display control unit 55, the change unit 56, the selection determination unit 57, and the editing unit 58.

  Note that such a program is not necessarily stored in the HDD 23 from the beginning.

  For example, the program is stored in a “portable physical medium” such as a flexible disk (FD), a CD-ROM, a DVD disk, a magneto-optical disk, or an IC card inserted into a computer. Then, the computer may read the program from these and execute it.

  Furthermore, the program is stored in “another computer (or server)” connected to the computer via a public line, the Internet, a LAN, a WAN, or the like. Then, the computer may read the program from these and execute it.

10 Conference Support System 11 Input Information Support Device 20 CPU
DESCRIPTION OF SYMBOLS 21 Memory 24 Display part 25 1st input device 29 2nd input device 30 External display device 40 Conversation screen 41 Frame 44 Edit frame 50 Control part 51 Device processing part 52 Buffer change detection part 53 Transmission part 54 Reception part 55 Display control part 56 Change unit 57 Selection determination unit 58 Editing unit 60 Buffer

Claims (5)

A reception unit for receiving input from a plurality of target persons;
A display control unit that performs control to display the input contents of a plurality of subjects received by the reception unit on the display unit in a time-series order received;
Have
The display controller, after performing control to display the input contents of the second subject to the second frame after displaying the first entry of the first subject to the first frame, the When the next input content by the first subject is received without changing the input method of the input content of the first subject, the first input content of the first subject is accepted and then the first subject When reception of the next input content by the first subject is less than a predetermined first time, the first frame displayed in the first frame where the first input content is displayed When the next input content by the first target person is received by changing the input method of the input content of the first target person and displaying the next input content in addition to Change from one hour long and accept the first input of the first subject before When reception of the next input content by the first subject is less than the first time after the change, the first frame displayed in the first frame in which the first input content is displayed input information support device and performing to Ru control to display the next entry added to the input content of 1. The display control unit receives the first input content of the first target person and then receives the next input content by the first target person for less than a second time shorter than the first time. In this case, the first input content is displayed in the first frame following the first input content, and the first target content is received after the first input content of the first target is received. If the next input content is received between the first time and the second time, control is performed to display the next input content in the first frame with a line feed to the first input content. The input information support apparatus according to claim 1, wherein: The display control unit further determines by language processing analysis that the input content of the first subject displayed in the first frame is related to the next input content by the first subject. When it is, the input information support apparatus according to claim 1 or 2 , wherein control is performed to display the next input content added to the first frame. Accept input from multiple audiences,
Performs control to display the input contents of the received multiple subjects on the display unit in a time-series order received,
After the control to display the input contents of the second subject to the second frame after displaying the first entry of the first subject to a first frame, the first subject When the next input content by the first target person is received without changing the input method of the input content, the first target person receives the first input content after the first target person is received. If reception of the next input content is less than a predetermined first time, the first input content is displayed in the first frame where the first input content is displayed and added to the displayed first input content. The next input content is displayed, and when the input method of the input content of the first subject is changed and the next input content by the first subject is accepted, the first time is lengthened. , After receiving the first input content of the first target person, When reception of the next input content is less than the first time after the change, the first input content is added to the displayed first input content in the first frame in which the first input content is displayed input information support method characterized by the processing for the next input control contents Ru display the computer run. Accept input from multiple audiences,
Performs control to display the input contents of the received multiple subjects on the display unit in a time-series order received,
After the control to display the input contents of the second subject to the second frame after displaying the first entry of the first subject to a first frame, the first subject When the next input content by the first target person is received without changing the input method of the input content, the first target person receives the first input content after the first target person is received. If reception of the next input content is less than a predetermined first time, the first input content is displayed in the first frame where the first input content is displayed and added to the displayed first input content. The next input content is displayed, and when the input method of the input content of the first subject is changed and the next input content by the first subject is accepted, the first time is lengthened. , After receiving the first input content of the first target person, When reception of the next input content is less than the first time after the change, the first input content is added to the displayed first input content in the first frame in which the first input content is displayed to input information support program for causing to execute a process for controlling the Ru to display the next entry into the computer.

Images