JP2003233465A - Input device and processing program for detecting button-operation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an input device and processing program for detecting button-operation thereof, which is capable of achieving simplification in a screen operation for a visually handicapped person and improving in convenience thereof, and further maintaining normal use state even in the utilization by an able-bodied person. <P>SOLUTION: At the beginning, a fingertip is moved while touching a suitable position on a screen. After moving the fingertip, the movement of the fingertip is kept in a stopped state for a fixed time. Then, it is auditorily judged whether the fingertip touches a desired button display area according to the output voice guide. When auditorily confirming that the fingertip touches the desired button display area according to the voice guide, the fingertip is taken off from the screen at the touch position to perform the button click operation to the desired button display area. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an input device and a button operation detection processing program in which the function of a touch panel found in a terminal device including a cash dispenser such as a cash dispenser of a bank is expanded.

[0002]

2. Description of the Related Art As conventional input devices with extended touch panel functions, there are, for example, an information input device and an automatic transaction device disclosed in JP-A-11-110107. This technique includes a voice output unit that outputs a voice corresponding to the input information when it is detected that the position corresponding to the display position of the input information displayed on the display unit is detected. Further, when the contact position moves while being in contact with the screen search start detection area, there is provided sound output means for outputting a sound indicating the position in the moving direction. That is, when the search start detection area on the screen is touched, the mode shifts to the screen search mode, when the finger moves on the screen as it is and touches the button, the button name is read aloud, and when the finger is released, the screen search mode is canceled. When the button is pressed again at the position, it means that the button has been pressed, and the process can be shifted to the processing corresponding to the pressing of the button. In consideration of the fact that a normal person uses the same screen as a visually impaired person, this technique enables normal use of the screen unless a search start detection area is set and touched there. For this reason, the visually impaired person must first touch the search start detection area, and from this state, move the finger on the screen while touching it, release the finger once at the target button position and tap again. There is.

[0003]

Since the conventional input device is configured as described above, a special finger operation of searching the search start detection area by moving the finger over a wide area by tracing the screen is performed. There was a problem that visually impaired people could not use it unless it was done first.

The present invention has been made in order to solve such problems, and can realize simplification of screen operation and improvement of convenience for visually impaired persons, and further, it can be used normally by persons with normal eyes. An object is to provide an input device and a button operation detection processing program capable of maintaining the form.

[0005]

An input device according to the present invention includes a touch state detecting means for detecting a touch state touching a display screen and a release of the touch state, and a touch operation on the display screen. A touch position determination unit that determines whether the region on the display screen corresponding to the position is a button display region, and a touch operation determination unit that determines whether the touch position is moving or stationary,
Voice guidance means for performing voice guidance corresponding to the button display area for a touch operation determined by the touch operation determination means to be still, and for the touch operation determined to be in the button display area by the touch position determination means; An operation input generation means for generating a button operation signal corresponding to the button display area when the touch state detection means detects the release of the touch state in the button display area voice-guided by the voice guidance means. Is characterized by.

The input device of the present invention detects the touch state touching the display screen and the release of the touch state, and the area on the display screen corresponding to the touch position by the touch operation on the display screen is a button. It is determined whether or not it is a display area, it is determined whether the touch position is moving or stationary, it is determined that the touch position is stationary, on the display screen corresponding to the touch position. For a touch operation that is determined to be a button display area, voice guidance corresponding to the button display area is performed, and by detecting the release of the touch state in the voice-guided button display area, the button display area is detected. A button operation signal corresponding to is generated, and the touch position by the first touch operation is displayed while maintaining the normal usage pattern for use by healthy people. Thereby enabling screen operation by visually impaired users regardless of which position on the screen, simplified screen operation, thereby improving convenience.

A button operation detection processing program according to the present invention corresponds to a touch state detection processing for detecting a touch state touching a display screen and a release of the touch state, and a touch position by a touch operation on the display screen. Touch position determination processing for determining whether the area on the display screen is a button display area, touch operation determination processing for determining whether the touch position is moving or stationary, and touch operation determination Regarding the touch operation determined to be still by the processing and determined to be the button display area by the touch position determination processing, the voice guidance processing for performing voice guidance corresponding to the button display area and the voice guidance processing are performed. By detecting the release of the touch state in the voice-guided button display area by the touch state detection processing, Characterized by comprising an operation input generation process for generating the operation input corresponding to the Tan display area.

The button operation detection processing program of the present invention detects the touch state touching the display screen and the release of the touch state by the touch state detection processing, and corresponds to the touch position by the touch operation on the display screen. Whether the area on the display screen is a button display area is determined by a touch position determination process, whether the touch position is moving or stationary is determined by a touch operation determination process, and the touch position is stationary. It is determined that the touch operation, the area on the display screen corresponding to the touch position is a button display area, voice guidance corresponding to the button display area is performed by voice guidance processing, Corresponding to the button display area by detecting the release of the touch state in the voice guided button display area by the touch state detection processing. Visually impaired regardless of the position on the display screen where the touch position of the first touch operation is generated while the button operation signal is generated by the operation input generation process and the normal usage pattern is maintained for normal use. It enables a person to operate the screen, which simplifies the screen operation and improves convenience.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION An embodiment of the present invention will be described below. FIG. 1 is a block diagram showing the configuration of a terminal device to which the input device according to this embodiment is applied, including a cash dispenser used in a bank or the like. The terminal device to which this input device is applied is a CPU (touch state detection means, touch position determination means, touch motion determination means, voice guidance means, operation input generation means) 1, touch panel device 2, interface 3 of touch panel device 2, display. Device 4, interface 5 of display device 4,
The printer device 6, the interface 7 of the printer device 6,
A currency handling device 8, an interface 9 of the currency handling device 8,
Audio output device (audio guidance means) 10, audio output device 10
Interface 11, a storage device 12 including a ROM and a RAM, a communication device 13, and the like. The input device is configured by the touch panel device 2, the display device 4, the CPU 1, the voice output device 10, the storage device 12, the button operation detection processing program 12A stored in the ROM of the storage device 12, and the like.

The CPU 1 controls the operation of each section, and the touch panel device 2 is a device for detecting the touch position on the display screen and uses a well-known technique. The display device 4 displays operation buttons and guide screens that need to be displayed on the terminal device.
The printer device 6 prints out necessary items on a bankbook or a predetermined paper sheet, and the money handling device 8 controls money related to money including money obtained, counting of money to be obtained and amount of money. Is to do. Audio output device 10
Is to provide voice guidance corresponding to the operated button or display screen. The storage device 12 includes a RAM and a ROM, and stores necessary data and programs. Communication device 1
Reference numeral 3 is for connecting the terminal device to a host computer and transmitting / receiving various data to / from the host computer.

Next, the operation of the input device used in this terminal device will be described. FIG. 2 is a flow chart showing the button operation detection processing operation of this input device,
Hereinafter, description will be given according to this flowchart. A program that defines this button operation detection processing operation is stored in the ROM of the storage device 12 as a button operation detection processing program 12A. Further, in this button operation detection process, buttons such as “withdrawal button”, “deposit button”, “balance inquiry button” and “transfer button” as shown in FIG. 3 are displayed on the screen of the display device 4. It is assumed that the display area is displayed and output. It is also assumed that the visually impaired person wants to operate the “balance inquiry button” on this screen. In this button operation detection process, first, the CPU 1 detects whether or not the touch panel device 2 arranged on the screen of the display device 4 is touched at a predetermined cycle. When a touch operation is performed on the touch panel device 2 in this state, coordinate information of the touched position in the x direction and the y direction is output from the touch panel device 2 and the CP
U1 detects that there is a touch operation (step S
1. Touch state detection processing). Next, it is determined whether or not the touched position is in the button display area (step S2, touch position determination process). This determination is based on the coordinate information output from the touch panel device 2, the "withdrawal button", "deposit button", "balance inquiry button" whose coordinate information is displayed on the display device 4.
Alternatively, it is performed by determining whether or not the “transfer button” is included in any of the display areas.

If the position of the touch operation on the touch panel device 2 on the screen of the display device 4 is a region other than the display region of the various buttons, then the touch panel device 2
It is determined whether or not the touch is on (step S3). At this time, when it is determined in step S3 that the fingertip of the user of the input device is away from the touch panel device 2 and the touch panel device 2 is not touched, the process returns to step S1. On the other hand, if the touch panel device 2 is in a state of being touched, this state continues for a certain period of time (for example, 0 sec to 0.5 sec) following step S3.
It is determined whether or not it is continued, that is, the fingertip is in a stationary state with the fingertip touching the touch panel device 2 for the predetermined time (step S4, touch operation determination process). In the state where the fingertip touches the touch panel device 2 for a certain period of time, it is determined whether the fingertip is stationary or not, and the value of the coordinate information corresponding to the touch position output from the touch panel device 2 is the certain period of time. This is done by detecting whether or not there is a change over time. As a result, when the touch state continues and the value of the coordinate information does not change for the certain period of time, the touched area is an area that is not included in any of the display areas of the various buttons. There is a voice guidance that there is something (step S5, voice guidance processing). Note that the voice guidance in this case may not be performed.

In step S4, the touch position changes before the elapse of the predetermined time, or in step S4.
If there is no change in the touch position for a certain period of time and the voice guidance in step S5 is performed in step S2
Returning to, it is determined again whether or not the touched area is the button display area.

When the touched position moves and enters the button display area, the result of determination in step S2 is that the touched position is the button display area, and subsequently, the fingertip touching from the button display area is touched. It is determined whether or not it is in a separated state (step S6). This step S
If the touched finger is released as a result of the determination in 6, the input signal corresponding to the operation of the button display area is generated as if the button display area was operated, and Execution of processing corresponding to the button display area is realized (step S7, operation input generation processing).

On the other hand, if the result of determination in step S6 is that the fingertip is still touching the button display area, then, while the button display area is being touched,
Further, it is determined whether or not the touch position does not change, that is, whether or not the fingertip touching the touch panel device 2 has been stationary for a certain time or longer within the button display area determined in step S2 (step S8, Touch action determination process). If the result of this determination is that the user has been stationary for a certain period of time or longer, voice guidance corresponding to the touched button display area is performed (step S9, voice guidance processing), and the process returns again to step S2 The process of is repeated. Further, when it is determined in step S8 that the fingertip touching the touch panel device 2 does not stand still in the button display area for a certain period of time or more, the process returns to step S2 again, and the processing from step S2 onward is performed. repeat.

As a result, when the fingertip is released from the touch panel device 2 at the touch position within the button display area after listening to the voice guidance in step S9, the state where the fingertip is released from the button display area in step S6. In step S7, which is detected, a button operation signal corresponding to the operation of the button display area is generated, and the processing corresponding to the button operation of the button display area can be executed.

The above processing operation will be described by focusing on the difference in operation between a normal person and a visually impaired person. Normally, a normal person suddenly touches the desired button display area and immediately touches his or her fingertip from the button display area. Since it is released, a normal person can operate a normal button. Alternatively, even if the fingertip continues to be touched on the target button display area, after listening to the voice guidance in step S9, by releasing the fingertip from the button display area, the touched button display area is displayed. Input operation is possible.

On the other hand, in the input operation performed by the visually impaired person with respect to this input device, first, any place of the touch panel device 2 arranged on the screen of the display device 4 is first touched. The first touched location may be the target button display area, the other button display area, or an area other than the button display area, but if the first touched location is the target button display area, When a certain period of time elapses with the fingertip resting at the position touched on, voice guidance is performed in step S9. Therefore, when the voice guidance is heard and the fingertip is released from the touch panel device 2, the target button display area is immediately input. Can be operated. Further, when the first touched place is a button display area other than the target button display area, it is found from the voice guidance in step S9 that the button is a button display area other than the target button display area. Therefore, the fingertip is moved while touching the touch panel device 2 to move the touch position to a region other than the button display region. FIG. 4 is a screen diagram of a state in which voice guidance is being performed for a "deposit" button display area, which is a button display area other than the button display area for this purpose. Even in a region other than the button display region, voice guidance is given (or voice guidance is not given) in step S5 after a certain period of time with the fingertip still, so that the fingertip is further moved.
Then, when the fingertip moves to the target button display area and remains stationary for a certain period of time, voice guidance corresponding to the target button display area is performed in step S9. Therefore, by listening to the voice guidance, if the fingertip is separated from the touch panel device 2, the input operation to the target button display area can be performed. FIG. 5 is a screen view of a state in which voice guidance of “balance inquiry”, which is a button display area for this purpose, is being performed. FIG. 6 is a screen diagram when the input operation to the target button display area is completed. Also,
If the first touched area is an area other than the button display area, if a certain period of time elapses with the fingertip resting in an area other than the button display area, step S5
Since voice guidance is given at (or no voice guidance is given), the fingertip is moved further. Then, when the fingertip moves to the target button display area and remains stationary for a certain period of time, voice guidance corresponding to the target button display area is performed. Therefore, by listening to this voice guidance, the fingertip is moved to the touch panel device 2 It is possible to perform an input operation to the target button display area by moving away from.

As described above, according to this embodiment,
A healthy person can operate the normal button display area. For the visually impaired, if the fingertip moves on the screen while touching the screen, the fingertip moves to the desired button display area, and if the movement of the fingertip is stopped for a certain time in this state. In the voice guidance output at this time, it can be auditorily confirmed that the fingertip is touching the desired button display area. Then, after aurally confirming that the fingertip is located in the desired button display area by the voice guidance,
By releasing the fingertip from the screen, it is possible to realize the button pressing operation for the desired button display area. Therefore, a visually impaired person does not need to touch a specific area on the screen as in the conventional case, puts his fingertip on an appropriate position on the screen, and moves from this state without releasing the fingertip from the screen, By simply releasing the fingertip from the screen according to the voice guidance, it is possible to perform the button pressing operation for the target button display area. Therefore, with respect to the use by a healthy person, it is possible to provide an input device and a button operation detection processing program that can realize a simplified screen operation and improved convenience for a visually impaired person while maintaining a normal usage pattern. is there.

[0020]

According to the present invention, the area on the display screen corresponding to the touch state touched on the display screen, the release of the touch state, and the touch position by the touch operation on the display screen is the button display area. It is determined whether the touch position is moving or stationary, the touch position is determined to be stationary, and the area on the display screen corresponding to the touch position is the button display area. For the touch operation determined to be, by performing voice guidance corresponding to the button display area, by detecting the release of the touch state in the voice guidance button display area,
Since the button operation signal corresponding to the button display area is generated, for the use by a healthy person, in a state where the normal usage pattern is maintained, the touch position by the first touch operation is at any position on the display screen. Regardless of the existence of the screen, the screen operation can be performed by the visually impaired person, and the screen operation can be simplified and the convenience can be improved.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a terminal device including an automatic teller machine to which an input device according to an embodiment of the present invention is applied.

FIG. 2 is a flowchart showing a button operation detection processing operation in the input device according to the embodiment of the present invention.

FIG. 3 is a screen view of a display device on which a “withdrawal button”, a “deposit button”, a “balance inquiry button”, and a “transfer button” according to the embodiment of the present invention are displayed.

FIG. 4 is a button display area other than a target button display area according to the embodiment of the present invention, which is “deposit”.
It is a screen figure in the state where the voice guidance about the button display area is performed.

FIG. 5 is a screen diagram in a state where voice guidance of “balance inquiry”, which is a target button display area, is being performed in the embodiment of the present invention.

FIG. 6 is a screen diagram when an input operation to a target button display area is completed in the embodiment of the present invention.

[Explanation of symbols]

1 ... CPU (touch state detection means, touch position determination means, touch operation determination means, voice guidance means, operation input generation means), 2 ... touch panel device, 4 ... display device, 10 ... voice output means (voice Guide means), 12 ...
... storage device, 12A ... button operation detection processing program.

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G06F 3/16 330 G06F 3/16 330B 340 340X G07D 1/00 351 G07D 1/00 351 9/00 421 9 / 00 421 G09B 21/00 G09B 21/00 D

Claims (3)

[Claims] 1. A button display area, which is output on the display screen, corresponding to the touch position by detecting a touch position by a touch operation on the display screen by a touch panel device arranged on the display screen. In the input device for generating the button operation signal, the touch state detecting unit detects a touch state touching the display screen and a release of the touch state, and a touch position corresponding to a touch operation on the display screen. Touch position determining means for determining whether the area on the display screen is a button display area, touch operation determining means for determining whether the touch position is moving or stationary, and the touch operation determining means Touch operations determined to be still by the touch position determination means are determined to be in the button display area by the touch position determination means. The voice display means for providing voice guidance corresponding to the button display area, and the touch state detection means detecting the release of the touch state in the button display area voice-guided by the voice guidance means, thereby displaying the button display. An input device comprising: an operation input generation means for generating a button operation signal corresponding to a region. 2. The touch operation determination means determines whether the touch position by a touch operation on the display screen is moving or is stationary for a certain period of time. Input device. 3. A touch panel device arranged on a display screen detects a touch position by a touch operation on the display screen, and a button display area corresponding to the touch position and output on the display screen. Is a button operation detection processing program for generating a button operation signal, and a touch status detection processing for detecting a touch status touched on the display screen and release of the touch status, and a touch operation on the display screen. A touch position determination process for determining whether the area on the display screen corresponding to the touch position is a button display region, and a touch operation determination process for determining whether the touch position is moving or stationary, It is determined to be still by the touch operation determination processing, and it is determined to be the button display area by the touch position determination processing. With respect to the touch operation performed, by performing voice guidance processing for performing voice guidance corresponding to the button display area, and canceling the touch state in the button display area voice-guided by the voice guidance processing by the touch state detection processing. , A button operation detection processing program for causing a computer to execute an operation input generation process for generating an operation input corresponding to the button display area.