JP5477203B2 - Input device - Google Patents

Description

  The present invention relates to an input device.

  2. Description of the Related Art Conventionally, there is a character data input device that inputs characters by an input operation by an operator's contact with a touch panel (see, for example, Patent Document 1).

JP 2008-152441 A

  However, since the above-described character data input device requires at least two input operations when inputting one character, the input operation becomes complicated when inputting a large number of characters. The operation could not be performed.

  The objective of this invention is providing the input device which can perform input operation efficiently, when performing input of input object.

  An input device according to the present invention includes a contact detection unit that simultaneously detects at least a first contact by an operator and a contact position of a second contact following the first contact, and the contact detection unit detects the first contact. When a contact position is detected, video information including input candidates of the first group is generated, and when the contact position of the second contact is detected by the contact detection unit, the input candidates of the first group And a video information generating unit that generates video information including a second group of input candidates subordinate to the input candidate selected by the contact position of the first contact.

The input device of the present invention displays a video image including a first input candidate when the detection unit detects the first contact position and the second contact position, and when the detection unit detects the first contact position. And when the detection unit detects the first contact position and the second contact position, a second subordinate to the input candidate corresponding to the first contact position among the first input candidates. And a control unit that displays an image including input candidates on a display unit .

  According to the present invention, it is possible to efficiently perform an input operation when inputting an input target.

It is a block diagram which shows the system configuration | structure of PDA which concerns on 1st Embodiment. It is a flowchart which shows the character input process in PDA which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a figure which shows the display state in the LCD display part which concerns on 1st Embodiment. It is a perspective view which shows the external appearance of HMD which concerns on 2nd Embodiment. It is a block diagram which shows the system configuration | structure of HMD which concerns on 2nd Embodiment.

  Hereinafter, a PDA (Personal Data Assistant) will be described as an example of an input device according to a first embodiment of the present invention with reference to the drawings. FIG. 1 is a block diagram showing a system configuration of the PDA according to the first embodiment. As shown in FIG. 1, the PDA 2 includes a controller 4 that comprehensively controls each part of the PDA 2. The controller 4 includes a memory 8 used as a work area when data processing is performed, a flash memory 10 that stores programs, video information, setting information, and the like, an LCD driver 12 that drives the LCD display unit 6, and transparent electrodes. The touch panel 14 detects an input operation on the information displayed on the LCD display unit 6 and is placed on the LCD display unit 6. The backlight driver 18 drives the backlight 20 that illuminates the LCD display unit 6 from the back. A speaker 22 that outputs sound for notifying input confirmation, an error, and the like, a measurement unit (not shown) for measuring time, and an operation unit (not shown) are connected. Here, the operation unit includes a power switch for turning on / off the power of the PDA 2, a menu button, a switching button for switching the type of input characters, and the like. Further, the touch panel 14 is configured to be able to simultaneously detect the contact positions of at least two points of contact by the operator.

  Next, character input processing in the PDA according to the first embodiment of the present invention will be described with reference to the flowchart shown in FIG. First, when the operator turns on the power switch of the operation unit, the controller 4 is activated, and the controller 4 displays an image of the menu screen on the LCD display unit 6. In this state, when the touch of the operator with respect to the “character input mode button” displayed on the menu screen is detected on the touch panel 14, the mode shifts to the character input mode.

  In the character input mode, the controller 4 determines whether or not the touch position of the first contact by the operator has been detected by the touch panel 14 (step S1). Here, for example, when the operator's index finger touches the touch panel 14, the controller 4 acquires information on the contact position of the first contact detected by the touch panel 14 and displays the first group of input candidates displayed at that position. Video information including a list of characters is generated (step S2). In other words, video information including a list of characters for displaying the consonant character “Akasana Hamawara” in the hiragana 50 syllabary vertically is generated, and the character list 30 is displayed on the LCD display unit 6 as shown in FIG. (Step S3). The video information is generated so that the character list 30 is arranged at a position corresponding to the contact position of the first contact.

  In this state, when it is detected by the touch panel 14 that the contact position of the first contact has moved to “sa” in the character list 30, the cursor 32 is displayed for “sa” in the character list 30. Video information is generated, and a video in which “sa” in the character list 30 is selected as an input target is displayed on the LCD display unit 6.

  Further, as shown in FIG. 4, the contact position of the first contact is moved by the operator in the character arrangement direction of the character list 30, and the touch position of the first contact is moved to “ When it is detected that the character has been moved from “sa” to “ta”, video information in which the character selected as the input target is changed from “sa” to “ta” is generated, and the character list 30 is selected as the input target. An image for which “TA” is selected is displayed on the LCD display unit 6.

  Next, it is determined whether or not the touch position of the second contact by the operator has been detected by the touch panel 14 (step S4). For example, as shown in FIG. 5, when the operator's middle finger touches the LCD display unit 6 on the right side of the index finger, the controller 4 displays information on the contact position of the second contact detected by the touch panel 14. Obtained (step S4, Yes), and generates video information including a list of characters that are input candidates of the second group to be displayed at that position (step S5). That is, video information including a list of characters for displaying the vowel characters “Tatetsuto” of “Ta Line” subordinate to “Ta” of the character list 30 selected as an input target in a vertical arrangement is generated. As shown in FIG. 5, the character list 34 is displayed on the LCD display unit 6 (step S6). The video information is generated so that the character list 34 is arranged at a position corresponding to the contact position of the second contact. Here, the input candidates of the character list 30 and the input candidates of the character list 34 are arranged in the vertical direction, which is the movable direction of the finger joint, and the length of the input candidates in the vertical direction (: to about 50 mm) is PDA2. Since the range is selectable only by the movement of the finger joint in a state where the wrist position does not move, the operator can perform an input operation efficiently. In addition, the distance between the center axis of the input candidate array of the character list 30 and the center axis of the input candidate array of the character list 34 can be selected within the range of movement of adjacent finger joints ( The character list 30 and the character list 34 are arranged at about 10 mm to 40 mm), and the operator selects the input candidates of the character list 34 simultaneously with the middle finger while touching the input candidates of the character list 30 with the index finger. be able to.

  In this state, when it is detected by the touch panel 14 that the contact position of the second contact has moved to “te” in the character list 34, the cursor 36 is displayed for “te” in the character list 34. Video information is generated, and a video in which “te” in the character list 34 is selected as an input target is displayed on the LCD display unit 6.

  Further, as shown in FIG. 6, the contact position of the second contact is moved by the operator in the character arrangement direction of the character list 34, and the touch position of the second contact is moved to “ When it is detected that the character has been moved from “t” to “to”, video information in which the character selected as the input target is changed from “te” to “to” is generated, and the character list 34 as the input target is generated. The image for which “to” is selected is displayed on the LCD display unit 6.

  Next, the controller 4 determines whether or not the touch positions of the first and second contacts are no longer detected by the touch panel 14 (step S7). When both the index finger and the middle finger of the operator are separated from the LCD display unit 6, that is, when the first touch and the second touch are not detected by the touch panel 14 (Yes in step S7), 1 is measured by the measuring unit. The time after the contact of the second and second points is no longer detected is measured (step S8). When the predetermined time is measured by the measurement unit (step S9), the character selected by the contact position of the first and second points of contact is determined as the input character (step S10). That is, in the case shown in FIG. 6, “to” selected in the character list 34 is confirmed as an input character, input processing of the confirmed character “to” is performed and displayed on the LCD display unit 6 (step S11). ). When the input character is confirmed, a sound for notifying the confirmation is output from the speaker 22.

  In step S4, when the controller 4 determines that the second touch is not detected by the touch panel 14 (No in step S4), it is determined whether the first touch is no longer detected by the touch panel 14 or not. (Step S12). In this state, when the operator's index finger is separated from the LCD display unit 6, the controller 4 determines that the first contact is not detected (step S12, Yes), and stops the character input process. On the other hand, when the operator's index finger is in contact with the LCD display unit 6 (No in step S12), the process returns to step S4 and the process of step S4 is performed again.

  According to the input device according to the first embodiment of the present invention, input character selection, input character determination, and character input processing are intuitively performed by a single input operation with a plurality of fingers of the operator on the touch panel. Can be canceled. Therefore, it is possible to efficiently perform an input operation when inputting an input target.

  In the process of step S7 of the first embodiment, when the controller 4 determines that the touch of the first point or the second point is not detected by the touch panel 14, the image displayed in step S6 is displayed. You may keep doing. That is, even when the operator's index finger or middle finger is separated from the LCD display unit 6, an image including the character list 30 and the character list 34 may be continuously displayed on the LCD display unit 6.

  In this case, in a state where the contact position of one contact is no longer detected, the character input process may be stopped when the other contact is no longer detected. Thus, the character input process can be stopped by releasing the finger from the LCD display unit 6 in the order of the index finger and the middle finger.

  In the first embodiment, the type of the input character may be switched from “Kana input” to “Kana input”, “Alphabet”, “Number”, etc., by operating the switch button by the operator. . For example, when the type of input character is switched to “alphabet” and the alphabet is input, “adgjmptw” indicating the representative character of each group of the alphabet grouped every 3 to 4 characters is displayed in the above character list. 30. Here, the alphabets grouped every 3 to 4 characters are “abc”, “def”, “ghi”, “jkl”, “mno”, “pqrs”, “tuv”, “wxyz”. Here, when “a” of “adgjmptw” is selected as an input target, “abc” indicating characters of a group whose representative character is “a” is displayed as the above-described character list 34.

  In the first embodiment, the type of input character may be switched when the touch position of the third contact is detected by the touch panel 14. For example, as shown in FIG. 6, the operator's ring finger is displayed on the LCD display unit 6 in a state where an image in which “to” of the character list 34 is selected as an input target by the operator is displayed on the LCD display unit 6. When the touch position is detected by the touch panel 14, the type of input character is switched from “kana input” to “kana input” as shown in FIG.

  Further, in the first embodiment, the input character may be determined when the third touch is detected by the touch panel 14. For example, as shown in FIG. 7, the operator's ring finger is displayed on the LCD display unit 6 in a state where an image in which “G” in the character list 34 is selected as an input target by the operator is displayed on the LCD display unit 6. When the touch and the touch panel 14 detect the third contact, “G” may be determined as the input character.

  In the first embodiment, when the third touch is detected by the touch panel 14, video information including a word list related to the character selected as the input target may be generated. For example, as shown in FIG. 7, the operator's ring finger is displayed on the LCD display unit 6 in a state where an image in which “G” in the character list 34 is selected as an input target by the operator is displayed on the LCD display unit 6. When touching and the touch of the third point is detected by the touch panel 14, video information including a word list (third list) related to “G” is generated, and the video of the third list is displayed on the LCD display unit. 6 is displayed. For example, “projection”, “city center”, “shoot”, “take”, and the like are displayed in the third list as words related to “G”. Here, for the third list displayed by the third contact, the distance between the central axis of the input candidate array of the character list 34 and the central axis of the third list array is adjacent to the third list. Since it is arranged at a distance (about 15 mm to 35 mm) of the central axis of the arrangement so that it can be selected within the range of movement of the finger joints, the operator can touch the input candidates of the character list 34 with the middle finger, Alternatively, the third list input candidate can be selected with the ring finger while the index finger touches the input candidate of the character list 30 and the middle finger contacts the input candidate of the character list 34. In this state, if the contact position of the third contact is moved to “projection” in the third list by the operator and the operator's index finger, middle finger, and ring finger are all separated from the LCD display unit 6, the touch panel 14, contact of the first point, the second point, and the third point is not detected. Therefore, “projection” in the third list selected as the input target is determined as the input character.

  In the first embodiment, the operator may select the input target character by touching the LCD display unit 6 in the order of the middle finger and the index finger. In this case, when the operator's middle finger touches the LCD display unit 6 and the first touch is detected by the touch panel 14, video information including the character list 30 is generated, as shown in FIG. The video is displayed on the LCD display unit 6. Here, the video information is generated so that the character list 30 is arranged at the position where the middle finger, which is the contact position of the first contact, is in contact. In addition, in a state where “ta” in the character list 30 is selected as an input target by the operator, the operator's index finger contacts the LCD display unit 6 on the left side of the middle finger, and the touch panel 14 makes a second contact. If detected, a character list 34 is displayed on the LCD display unit 6 as shown in FIG. Here, the video information is generated so that the character list 34 is arranged at a position corresponding to the contact position of the second contact.

  In the first embodiment, as shown in FIG. 8, in the state where “ta” in the character list 30 is selected as an input target by the operator, the operator's index finger is displayed on the LCD display unit 6 on the left side of the middle finger. When the touch panel 14 detects a second contact, the character list 34 corresponds to the contact position of the first contact, and the character list 34 corresponds to the contact position of the second contact. You may produce | generate the image | video which has arrange | positioned the character list 30 in the position. In this case, as shown in FIG. 10, the character list 34 is placed at a position corresponding to the contact position of the first point (middle finger), and the character list is placed at a position corresponding to the contact position of the second point (index finger). The image on which 30 is arranged is displayed on the LCD display unit 6.

  Further, in the first embodiment, when the operator's finger touches the LCD display unit 6 and the first touch is detected by the touch panel 14, video information including the character list 30 and the character list 34 is included. And the character list 30 and the character list 34 may be displayed on the LCD display unit 6.

  In the first embodiment, the video information is generated so that the characters in the character list 30 and the character list 34 are displayed vertically. However, the video information may be generated so that the characters are displayed horizontally. Good.

  In the first embodiment, when the video information relating to the input candidate by the second contact is generated by the third contact, the operator selects a character from the character list 34 as the input target. In such a case, an image in which the character list “projection”, “city center”, “shoot”, and “take” is arranged at a position corresponding to the third contact position may be generated.

  Further, in the first embodiment, the video information is generated so that the character arrangement in the character list 30 and the character list 34 is the same, but the video information may be generated differently. Specifically, when generating the video information so that the characters in the character list 30 are displayed vertically, the video information is generated so that the characters in the character list 34 are displayed horizontally. Further, when generating the video information so that the characters of the character list 30 are displayed side by side, the video information is generated so that the characters of the character list 34 are displayed vertically.

  Here, in the state where the characters are arranged horizontally in the character list 30 and the characters are arranged vertically in the character list 34, the operator's ring finger contacts the LCD display unit 6, and the touch panel 14 makes a third point. When contact is detected, video information including a third list in which words related to characters in the character list 34 are vertically arranged is generated, and the third list is displayed on the LCD display unit 6. Here, the video information is generated so that the third list is arranged at a position corresponding to the third contact position. Further, the words shown in the third list are arranged vertically so that the first character of each word is positioned on the arrangement axis of the third list that is parallel to the central axis of the input candidate array of the character list 34. It is done. Further, the distance between the central axis of the character list 34 and the arrangement axis of the third list is selectable within the range of the indirect movement of the adjacent fingers so that the distance between the central axis of the character list 34 and the arrangement axis of the third list is selectable. The character list 34 and the third list are arranged at (: 15 mm to 35 mm). For this reason, the operator touches the input candidate of the character list 34 with the middle finger, or touches the input candidate of the character list 30 with the index finger and contacts the input candidate of the character list 34 with the middle finger. Can be selected.

  In the first embodiment, the PDA 2 may include a video information output unit that outputs video information to an external device (for example, a television, a PC, or the like) that includes a display unit that displays video. In this case, when the controller 4 generates the video information, the video information output unit outputs the video information to the external device. When the external device receives the video information output from the video information output unit, the external device displays a video based on the received video information on the display unit. That is, an image related to the character input process displayed on the LCD display unit 6 is displayed on the display unit of the external device. Thereby, the operator can perform a character input process by performing the touch operation on the touch panel 14 using the touch panel 14 while visually recognizing the video displayed on the display unit of the external device.

  In the first embodiment, the position, interval, and width of the array of input candidates to be displayed can be set by the operator. On the initial setting screen, the operator may be able to set the length of the input candidate display frame and the distance between the frames to arbitrary values. Further, the interval and width may be set based on information such as the operator's age, gender, dominant arm, etc., and the touch panel 14 is provided with a recognition means capable of recognizing the size of the operator's hand. And the width may be set.

  In the first embodiment, character input processing is performed by performing an operator's contact operation on the touch panel 14, but input processing for images, voice, music, etc. is not limited to characters. It may be. In this case, the operator touches the touch panel 14 from the “character input mode button”, “image input mode button”, “voice input mode button”, “music input mode button”, etc. displayed on the menu screen. The input mode is selected by the operation.

  When inputting an image in the image input mode, an image list in which representative images of each group divided by shooting date are displayed as thumbnails is displayed as an input target of the first group. When an input target image is selected from the image list, an image list in which thumbnail images of the second group of images selected from the selected image are displayed as input targets of the second group. Is done. Therefore, the operator can input an image by the same operation as that for character input. Further, voice, music, etc. can be input by the same input operation.

  Next, an input device according to a second embodiment of the present invention will be described with reference to the drawings, taking an HMD (Head Mounted Display) as an example. FIG. 11 is a perspective view showing the appearance of the HMD according to the second embodiment. As shown in FIG. 11, the HMD 40 has two audio output portions 44 and 46, which are connected by a connecting portion 48. Speakers 62 and 64 (see FIG. 12) are accommodated in the audio output units 44 and 46, respectively. A support arm 50 is attached to a substantially center outside the audio output unit 46 via a rotating shaft (not shown), and an image is input to the user's one eye at the tip of the support arm 50 so that the user can view the image. A display unit 52 to be provided is attached. A touch panel 56 that detects an input operation for information displayed on the display unit 52 is provided outside the audio output unit 44. In addition, a switching button 58 for switching the type of input character is provided on the side surface of the voice output unit 44. The touch panel 56 is configured to be able to simultaneously detect the contact positions of at least two points of contact by the operator.

  FIG. 12 is a block diagram showing a system configuration of the HMD 40 according to the second embodiment. As shown in FIG. 12, the HMD 40 includes a controller 60. The controller 60 includes a touch panel 56, a switching button 58, speakers 62 and 64, a memory 68 for temporarily storing video information to be displayed on the LCD display unit 66, and a flash. An LCD driver 72 for driving an LCD display unit 66 provided in the memory 70 and the display unit 52 and a backlight driver 82 for controlling a backlight 80 provided in the display unit 52 are connected. Inside the display unit 52, a backlight 80 is disposed on the back surface of the LCD display unit 66 that electrically displays video information such as images and videos, and the LCD display unit uses illumination light emitted from the backlight 80. 66 is illuminated. The image displayed on the LCD display unit 66 is reflected by the mirror 80, and then the size is changed by the eyepiece 82 and input to the operator's eyes.

  Next, the character input process of the HMD 40 according to the second embodiment will be described. When the HMD 40 is mounted on the operator's head and a power switch (not shown) is turned on, the controller 60 is activated, and the image displayed on the LCD display unit 66 of the display unit 52 is used by inputting the image to one eye of the user. To provide In this state, the operator performs a touch operation on the touch panel 56 while visually recognizing the video displayed on the display unit 52, thereby performing a character input process. That is, by performing a touch operation on the touch panel 56, the controller 60 performs a character input process similar to the character input process (see FIG. 2) of the PDA 2 according to the first embodiment.

  According to the input device according to the second embodiment of the present invention, input character selection, input character determination, and character input processing are intuitively performed by a single input operation with a plurality of fingers of the operator on the touch panel. Can be canceled. Therefore, it is possible to efficiently perform an input operation when inputting an input target.

  2 ... PDA, 4 ... controller, 6 ... LCD display unit, 14 ... touch panel, 22 ... speaker, 30, 34 ... character list, 40 ... HMD, 52 ... display unit, 56 ... touch panel.

Claims (17)

A contact detection unit for simultaneously detecting at least a first contact by an operator and a contact position of a second contact following the first contact;
When the contact position of the first contact is detected by the contact detection unit, video information including input candidates of the first group is generated, and the contact position of the second contact is detected by the contact detection unit. A video information generation unit that generates video information including a second group of input candidates subordinate to the input candidate selected by the contact position of the first contact in the first group of input candidates. An input device characterized by that. The input device according to claim 1 , wherein input candidates of the second group are selected according to a contact position of the second contact. The video information generation unit changes the input candidate selected in the input candidate of the first group when the contact position of the first contact moves in the arrangement direction of the input candidate of the first group. Information is generated, and when the contact position of the second contact moves in the arrangement direction of the input candidates of the second group, video information obtained by changing the input candidates selected in the input candidates of the second group is displayed. The input device according to claim 2 , wherein the input device is generated. The input device according to claim 3 , wherein an arrangement direction of the input candidates of the first group and an arrangement direction of the input candidates of the second group are the same. The video information generation unit arranges the first group input candidates at a position corresponding to the contact position of the first contact, and inputs the second group at a position corresponding to the contact position of the second contact. 5. The input device according to claim 1 , wherein video information in which candidates are arranged is generated. The image information generating unit, one of claims 1 to 4, characterized in that the relative arrangement of the input candidate in the input candidate with the second group of the first group to generate an always equal image information The input device according to one item. The video information generation unit generates video information including input candidates of the second group even when the contact position of the second contact is not detected by the contact detection unit. The input device according to any one of claims 1 to 6 . A measuring unit for measuring a time after the contact position of the first contact and the contact position of the second contact are not detected by the contact detection unit;
The input candidate selected by the contact position of the first contact and the contact position of the second contact is determined as an input target when a predetermined time is measured by the measurement unit. The input device according to any one of claims 1 to 7 . The input selected by the contact position of the first contact and the contact position of the second contact when the contact position of the third contact following the second contact is detected by the contact detection unit. The input device according to claim 1, wherein a candidate is determined as an input target. If the contact position of the first contact is not detected before the contact position of the second contact is detected after the contact detection unit detects the contact position of the first contact, The input device according to any one of claims 1 to 9, wherein an input target is not confirmed. An input detection unit;
When an input is detected by the input detection unit, the input target input by selecting the input candidate of the first group and the input candidate of the second group is changed to another type of input target. The input device according to any one of claims 1 to 10 . By the contact detection unit, when the contact position of the second third following the contact of contact is detected, input by selection of the input candidate in the input candidate及beauty before Symbol second group of said first group The input device according to claim 1, wherein the input target is changed to another type of input target. The input device according to claim 1, further comprising a display unit that displays the video information generated by the video information generation unit. The input candidate of the first group is a list of characters, and the input candidate of the second group is a character subordinate to a character selected by the contact position of the first contact from the list of characters of the first group. The input device according to claim 1, wherein the input device is a list. A detection unit for detecting the first contact position and the second contact position;
When the first contact position is detected by the detection unit, an image including a first input candidate is displayed on the display unit, and the first contact position and the second contact position are detected by the detection unit. A control unit that causes the display unit to display a video including a second input candidate subordinate to the input candidate corresponding to the first contact position among the first input candidates;
An input device comprising: The control unit causes the display unit to display an image including the first input candidate at a position corresponding to the first contact position, and includes the second input candidate at a position corresponding to the second contact position. The input device according to claim 15, wherein: is displayed on the display unit. 17. The input device according to claim 15, further comprising: a display unit configured to display a video including the first input candidate and a video including the second input candidate by the control unit.

Images