JP2005056088A - Display apparatus with touch panel, control method for display apparatus with touch panel, and program for executing the method on computer - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display apparatus with a touch panel that allows a coordinate input device to be connected for use to a standard computer without the installation of a specific driver. <P>SOLUTION: The display apparatus with a touch panel comprises: a coordinate input device controller 3 for calculating coordinates of a touch point detected on a display screen 101; a correction factor calculation part 505 for representing the touch point of at least one touch on the display screen 101 in a touch coordinate space and display coordinates, and in dependence on the difference between the touch coordinates and the display coordinates, calculating correction factors for correcting the touch coordinates to the display coordinates; and a coordinate correction part 506 for correcting the coordinates of the touch point of the detected touch with the calculated correction factors. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display device with a touch panel, a control method for a display device with a touch panel, and a program for causing a computer to execute the method, and in particular, a display device with a touch panel for detecting a touch made on a display screen, and a display device with a touch panel. The present invention relates to a control method and a program for causing a computer to execute the method.

  There is a coordinate input device that inputs coordinates of a point touched by touching a predetermined surface with a finger or a pen to a computer. Examples of such a coordinate input device include a touch panel and a tablet. The computer that has input the coordinates draws a line drawing on the display screen according to the coordinates, or executes control that is set in accordance with the coordinates.

  The coordinate input device basically generates and inputs a signal similar to that of a mouse. For this reason, the standard of the coordinate input device is determined in conformity with the HID (Human Interface Device) class definition of the USB (Universal Serial Bus) standard, and the computer processes the coordinates input by the coordinate input device with a general-purpose USB mouse driver. it can. A general-purpose USB mouse driver is generally installed in the OS of a computer as a standard. For this reason, defining the standard of the coordinate input device in this way makes it possible to connect the coordinate input device to a standard computer and use it in the same manner as a mouse, thereby enhancing the usability of the coordinate input device.

  By the way, there may be a difference between the coordinate space of the coordinates detected by the coordinate input device and the coordinate space displayed on the display screen by a computer such as a PC. In such a case, there is a problem that the touch input using the coordinate input device is not made at the position on the display screen intended by the operator. Such a defect is peculiar to the coordinate input device. In the case of a mouse, the position of the cursor matches the operation coordinates.

As a conventional technique for matching the coordinate space of the coordinate input device and the coordinate space on the display screen, there is a technique for converting coordinates specific to the coordinate input device (for example, touch panel) into a two-dimensional coordinate system for image display (for example, patents). Reference 1). In addition, there is a technique that corrects an input position by detecting a shift of an input position on the touch panel and executing calibration (see, for example, Patent Document 2). Further, there is a technique that calculates a positional deviation between the coordinates detected by the touch panel and the display image, calculates the deviation as an offset value, and corrects the deviation using the offset value (for example, Patent Document 3).
JP 2000-89913 A (paragraphs [0045] to [0047]) JP 2001-67186 A (paragraphs [0007] and [0009]) JP 2001-142645 A (paragraph [0035])

  However, the USB mouse driver does not have a function necessary for processing for matching the coordinate space of the coordinate input device with the coordinate space on the display screen using the above-described conventional technology. For this reason, when the conventional technology is applied to a coordinate input device conforming to the USB mouse driver standard, it is necessary to install a dedicated touch panel driver on the host PC of the coordinate input device. According to such a conventional technique, the time required for preparation for using the display device with a touch panel becomes longer. In addition, there is a problem that management of a CD, a floppy (R) desk, etc. necessary for installing the touch panel driver is complicated.

  The present invention has been made in view of the above points, and enables the coordinate input device to be used by connecting it to a standard computer without installing a unique driver, thereby further improving the usability of the coordinate input device. An object is to provide a display device with a touch panel, a control method for the display device with a touch panel, and a program for causing a computer to execute the method.

  In order to solve the above-described problems and achieve the object, a display device with a touch panel according to claim 1 detects a touch made on a display screen, and displays the display based on coordinates of a touch point at which the touch is made. A display device with a touch panel for controlling a screen, wherein a touch coordinate calculation unit that calculates coordinates of a detected touch point, and a touch point of a touch made at at least one point on the display screen Touch coordinate acquisition means for acquiring touch coordinates represented in a touch coordinate space used for coordinate calculation, and display coordinates representing in a display coordinate space set on the display screen at least a touch point of the touch made at the one point Display coordinate acquisition means, and the difference between the touch coordinates and the display coordinates Based on the correction coefficient calculation means for correcting the touch coordinates to match the display coordinates, and using the correction coefficient calculated by the correction coefficient calculation means, the coordinates of the touch point of the detected touch Touch coordinate correcting means for correcting.

  According to the first aspect of the present invention, touch coordinates representing a touch point of a touch made at at least one point on the display screen in a coordinate space used for coordinate calculation of touch coordinates are acquired. Also, display coordinates representing the touch point of the touch made at the same one point in the display coordinate space set on the display screen are acquired. Then, based on the difference between the touch coordinates and the display coordinates, the touch coordinates are corrected to calculate a correction coefficient for matching the display coordinates, and the coordinates of the touch point of the detected touch are corrected using the calculated correction coefficient. be able to. For this reason, when the icon or button displayed on the display screen is selected by touching the display screen, the coordinates input by the touch exactly match the coordinates indicating the position of the icon or button. Therefore, the operator can select icons and buttons on the display screen as shown while viewing the display screen. In addition, since such a control can be performed by a general-purpose USB mouse, the coordinate input device can be used by connecting it to a standard computer without installing a specific driver, thereby further improving the usability of the coordinate input device. Can be increased.

  The display device with a touch panel according to claim 2, wherein the correction coefficient calculating unit is configured such that when a touch detection unit that detects a touch on the display screen detects that a plurality of touches are made on the display screen, The execution of the calibration, which is the operation related to the calculation of the correction coefficient by, is started.

  According to the second aspect of the present invention, the execution of calibration can be started by touching a plurality of points on the display screen. For this reason, calibration can be performed smoothly and easily during the operation of the display device with a touch panel.

  The display device with a touch panel according to a third aspect of the present invention further includes calibration start notification means for indicating to the operator that the calibration is started.

  According to the third aspect of the invention, the operator can know the start timing of the calibration. For this reason, it is possible to prompt the operator to perform an operation necessary for calibration, and to prohibit an operation that hinders calibration.

  In the display device with a touch panel according to a fourth aspect of the present invention, the calibration start notification means is provided at a position where the operator can visually recognize and blinks, and the light emission means is associated with execution of calibration. And a light emission control means for blinking.

  According to the fourth aspect of the present invention, it is possible to notify the operator of the start of calibration by an easy-to-understand method such as turning on or off and blinking the light emitting means.

  The display device with a touch panel according to the invention of claim 5 is configured such that the touch coordinate calculation unit and the display coordinate calculation unit are configured to detect a stop touch for a predetermined time or more at at least one point on the display screen. Each of the coordinates is acquired when the detachment of the stop touch is detected.

  According to the fifth aspect of the present invention, the calibration can be executed according to the intention of the operator without causing the instruction to execute the calibration to be mistaken for an operation performed for other purposes.

  The display device with a touch panel according to the invention of claim 6 is configured to terminate the calibration and stop the light emission when the stop touch and the detachment of the stop touch are not detected within a predetermined time after the calibration is started. Is characterized in that the light emitting means is turned off.

  According to the sixth aspect of the present invention, even when a plurality of points are touched due to an operator's erroneous operation or the like and the calibration is once started, the started calibration can be terminated halfway.

  In the display device with a touch panel according to claim 7, the correction coefficient calculation unit calculates a correction coefficient based on a difference between the touch coordinates corresponding to the resolution of the display screen and the display coordinates. Features.

  According to the seventh aspect of the present invention, since the correction coefficient can be set according to the resolution of the display screen, the coordinates can be accurately corrected regardless of the resolution of the display screen.

  The display device with a touch panel according to an eighth aspect of the present invention is configured such that the coordinates of the touch point corrected by the touch coordinate correction unit are obtained by the difference between the previously detected coordinate and the currently detected coordinate. Further comprising data conversion means for converting into mouse data based on the movement amount, the data conversion means initializing data conversion processing by setting the origin on the display coordinate space as a movement start point of mouse data. Features.

  According to the eighth aspect of the present invention, touch point correction and conversion into mouse data can be performed using a general-purpose USB mouse. This makes it possible to correct coordinates without installing a dedicated driver.

  In the display device with a touch panel according to the ninth aspect of the present invention, when a touch is detected immediately after the detachment made on the display screen, the data conversion means sets the coordinates from the detachment to the touch, and the data conversion means turns off the mouse button. It is further characterized by further comprising cursor control means for converting the mouse data to the coordinates shown and moving the cursor to the touched coordinates.

  According to the ninth aspect of the present invention, even when the pointing member is detected between the detachment and the touch (when the coordinate pointing member and the display screen are closer than the predetermined distance between the detaching and the touching). In some cases, a touch may be detected even if the user is not touching), and an unintended program can be prevented from being activated by an icon or button between the detach and touch.

  A control method for a display device with a touch panel according to claim 10 is a display with a touch panel that calculates coordinates of a touch point of a touch made on a display screen and controls the display screen based on the calculated coordinates. A method for controlling an apparatus, comprising: a touch coordinate acquisition step of acquiring a touch coordinate indicated by a touch coordinate space used for calculating coordinates of a touch point of a touch made on at least one point on the display screen; A display coordinate acquisition step of acquiring a display coordinate indicating a touch point of a touch made at a point by a display coordinate set on the display screen, and based on a difference between the touch coordinate and the display coordinate, Correction unit for calculating a correction coefficient to be corrected and matched with the display coordinates A calculation step, using a correction coefficient calculated in the correction coefficient calculating step, characterized in that it comprises a touch coordinate correction step of correcting the coordinate of the touch point of the detected touch.

  According to the tenth aspect of the present invention, touch coordinates representing a touch point of a touch made at at least one point on the display screen in a coordinate space used for coordinate calculation of touch coordinates are acquired. Also, display coordinates representing the touch point of the touch made at the same one point in the display coordinate space set on the display screen are acquired. Then, based on the difference between the touch coordinates and the display coordinates, the touch coordinates are corrected to calculate a correction coefficient for matching the display coordinates, and the coordinates of the touch point of the detected touch are corrected using the calculated correction coefficient. be able to. For this reason, when the icon or button displayed on the display screen is selected by touching the display screen, the coordinates input by the touch exactly match the coordinates indicating the position of the icon or button. Therefore, the operator can select icons and buttons on the display screen as shown while viewing the display screen. In addition, since such a control can be performed by a general-purpose USB mouse, the coordinate input device can be used by connecting it to a standard computer without installing a specific driver, thereby further improving the usability of the coordinate input device. Can be increased.

  A program according to the invention described in claim 11 calculates a control method for a display device with a touch panel, which calculates coordinates of touch points of touches made on a display screen, and controls the display screen based on the calculated coordinates. A touch coordinate acquisition step of acquiring a touch coordinate indicated by a touch coordinate space used for calculating coordinates of a touch point of a touch made on at least one point on the display screen; A display coordinate acquisition step of acquiring a display coordinate indicating a touch point of the touch made at the one point by a display coordinate set on the display screen; and the touch based on a difference between the touch coordinate and the display coordinate. Correct the coordinates to calculate the correction coefficient to match the display coordinates A correction coefficient calculating step that the use of a correction coefficient calculated in the correction coefficient calculation step, the touch coordinate correction step of correcting the coordinate of the touch point of the detected touch, characterized in that it comprises a.

  According to the eleventh aspect of the present invention, the touch coordinates representing the touch point of the touch made at at least one point on the display screen in the coordinate space used for coordinate calculation of the touch coordinates are acquired. Also, display coordinates representing the touch point of the touch made at the same one point in the display coordinate space set on the display screen are acquired. Then, based on the difference between the touch coordinates and the display coordinates, the touch coordinates are corrected to calculate a correction coefficient for matching the display coordinates, and the coordinates of the touch point of the detected touch are corrected using the calculated correction coefficient. be able to. For this reason, when the icon or button displayed on the display screen is selected by touching the display screen, the coordinates input by the touch exactly match the coordinates indicating the position of the icon or button. Therefore, the operator can select icons and buttons on the display screen as shown while viewing the display screen. In addition, since such a control can be performed by a general-purpose USB mouse, the coordinate input device can be used by connecting it to a standard computer without installing a specific driver, thereby further improving the usability of the coordinate input device. Can be increased.

  According to the first aspect of the present invention, the coordinate input device can be used by connecting it to a standard computer without installing a specific driver, and an icon on the display screen or the like can be displayed as the operator looks at the display screen. There is an effect that it is possible to provide a display device with a touch panel that makes it possible to select a button and enhance the usability of the coordinate input device.

  According to the second aspect of the present invention, the calibration can be executed smoothly and easily during the operation of the display device with a touch panel, and the operability of the coordinate input device can be further improved.

  According to the third aspect of the present invention, there is an effect that the operability of the coordinate input device can be further improved by prompting the operator to perform an operation necessary for calibration and prohibiting an operation that hinders the calibration.

  The invention according to claim 4 has an effect that the operability of the coordinate input device can be further improved by notifying the operator of the start of calibration by an easy-to-understand method such as turning on or off and blinking the light emitting means. Play.

  The invention according to claim 5 has an effect that the operability of the coordinate input device can be further improved by executing calibration according to the intention of the operator.

  According to the sixth aspect of the present invention, the calibration started by the operator's erroneous operation or the like can be terminated in the middle, so that the operability of the coordinate input device can be further improved.

  The invention according to claim 7 has an effect that the coordinates can be accurately corrected regardless of the resolution of the display screen.

  According to the eighth aspect of the present invention, it is possible to correct the coordinates without installing a dedicated driver.

  According to the ninth aspect of the present invention, it is possible to prevent an unintended program from being activated by an icon or button between detachment and touch, and to enable control as intended by the operator.

  According to the tenth aspect of the present invention, the coordinate input device can be used by connecting it to a standard computer without installing a specific driver. There is an effect that it is possible to provide a control method of a display device with a touch panel that enables selection of a button and further enhances usability of the coordinate input device.

  According to the eleventh aspect of the present invention, the coordinate input device can be used by connecting it to a standard computer without installing a specific driver, and an icon on the display screen can be displayed as the operator looks at the display screen. It is possible to provide a program for causing a computer to execute a control method of a display device with a touch panel that enables selection of buttons and buttons to further improve the usability of the coordinate input device.

  Exemplary embodiments of a coordinate input device control method and a program for causing a computer to execute the method according to the present invention will be explained below in detail with reference to the accompanying drawings. Note that in this specification, a touch from a state in which a pointing member such as a finger or a pen is not in contact with the coordinate input surface is called a touch, and a point on the coordinate input surface where the touch is made is called a touch point. Further, the fact that the pointing member does not move from the touch point for a predetermined time after the touch is referred to as a stop touch, and the touching pointing member leaving the coordinate input surface is referred to as detaching. Furthermore, the movement of the touched pointing member to another point without detaching is referred to as a moving touch.

  FIG. 1 is a diagram for explaining a display device with a touch panel to which a control method of a coordinate input device according to an embodiment of the present invention can be applied. The illustrated display device with a touch panel includes a coordinate input device 1, a display device 2, a coordinate input device controller 3, and a host device (personal computer, hereinafter referred to as PC) 4. The coordinate input device 1 includes a coordinate detector, which is an optical device that optically detects the coordinates of a point (touch point) touched by a pointing member such as a finger or a pen on a display screen 101 serving as a coordinate input surface. (Fig. 2).

  The display device 2 inputs R, G, B image data from the host device 4 and displays the input image data on the display screen 101. The display screen 101 is configured by arranging pixels (pixels) in two directions x and y. In this embodiment, it is assumed that 1024 pixels are arranged in the x direction and 768 pixels are arranged in the y direction. As the display screen 101, a screen using liquid crystal or PDP (Plasma Display Panel) is used.

  The coordinate input device controller 3 has a central processing unit 117 and is controlled in an integrated manner by the central processing unit 117. The ROM 119 is configured to store applications and data used by the central processing unit 117, and the RAM 121 functions as a working memory of the central processing unit 117 and temporarily stores work data. A timer (TIMER) 123 measures time and periodically notifies the central processing unit 117 of the time. The NVRAM 125 is a non-volatile memory that can store data even when the power of the apparatus is turned off, and stores calibration coordinate values and correction coefficients described later.

  The coordinate input device controller 3 also includes a left coordinate detector I / F 107 and a right coordinate detector I / F 109 that input analog data detected by the coordinate detector and convert it into digital data. FIG. 2 shows a left coordinate detector and a right coordinate detector, and a coordinate detection method of the coordinate input device will be described. The left coordinate detector 201L and the right coordinate detector 201R shown in FIG. 2 are provided with a distance W between the left end and the right end of one side of the display screen, and the detected analog data is sent to the coordinate input device controller 3 respectively. input. In addition, retroreflective members are provided on the three sides of the display screen 101 where the left coordinate detector 201L and the right coordinate detector 201R are not provided, and the reflected light passes through the same optical axis as that during irradiation. Reflects as light.

  Each of the left coordinate detector 201L and the right coordinate detector 201R includes a light source and a light receiving unit in which a plurality of light receiving elements such as a CCD (Charge Coupled Device) are arranged (not shown). The light source emits light in a fan shape that requires a light source over the entire area of the display screen 101, and irradiates light over substantially the entire area of the display screen 101. The irradiated light passes through the same l ′ (shown in parallel in the figure) as the optical axis l at the time of irradiation by the retroreflective member, returns to the left coordinate detector 201L or the right coordinate detector 201R, and is received by the light receiving unit. The

In such a configuration, when a finger or pen touches the display screen 101 with a point P (x, y), light passing through the touch point blocks light, and the shielded light is received by the light receiving unit. Disturb that. Since the light irradiation angles θL and θR correspond to the light receiving positions where the reflected light is received among the light receiving portions, the light receiving angles can be specified based on the positions of the elements that did not receive the light from the light receiving portions. The central processing unit 117 specifies the irradiation angle θL of the left coordinate detector 201L and the irradiation angle θR of the right coordinate detector 201R, substitutes θL and θR into the following formulas, and coordinates (x, y) of the point P. calculate.
x = W × tan θR / (tan θL + tan θR)
y = H−W × tan θL × tan θR (tan θL + tan θR)
W: distance between the light source center of the left coordinate detector 201L and the light source center of the right coordinate detector 201R
H: Length of display screen 101 in the vertical direction in the figure

  The coordinate input device controller 3 has a USB (Universal Serial Bus) host I / F 111, converts the coordinates described above into coordinates indicated by using pixels (number of pixels) on the display screen 101, and is as short as 10 ms or 20 ms. The data is output to the host device 4 at a cycle.

  The LED switch 113 is a switch that controls the blinking of the LED 103 that is a blinking light emitting means provided at the position of the coordinate input device 1 that can be visually recognized by the operator. The display device I / F 115 detects the resolution of the display screen 101 from the R, G, and B signals (horizontal synchronization signal and vertical synchronization signal) of the display device 2. Since the NVRAM 125 does not lose data even when the power is turned off, the NVRAM 125 is used to store calibration coordinate values and correction coefficients described later.

  The host device 4 is a PC on which a general-purpose OS that supports USB, such as Windows (R), Linux (R), and MAC (R), is mounted. The host device 4 is connected to the coordinate input device 1 with a USB cable and inputs coordinate data. The image data developed by the OS or application program is sent to the display device 2 via an R, G, B cable (not shown).

  FIG. 3 is a diagram for explaining installation of the USB mouse driver. The host device 4 has a route HUB 305 connected to the coordinate input device controller 3 via the USB cable 303. The root HUB 305 mediates USB device detection and communication with the device of the coordinate input device controller 3. The coordinate input device controller 3 also has a USB system driver 307 that controls the root HUB 305. The USB system driver 307 loads a control driver of the detected USB device, and mediates communication between the control driver and the USB device.

  The HID mouse driver 309 is a standard driver provided by the OS, and incorporates all USB mice 301 compliant with the HID (Human Interface Device) class specification into a connected system (in this embodiment, a coordinate input device controller). According to such an HID mouse driver 309, a general PC is connected to the coordinate input device controller 3, mouse data is input to the PC by the coordinate input device 1 without installing a dedicated driver, and the APL 313 is controlled. be able to. When the touch panel driver 315 is installed in the host device 4, the mouse driver can be emulated and the mutual communication with the coordinate input device can be performed, and the extended function of the coordinate input device 1 can be provided. .

  The USB mouse 301 incorporated in the coordinate input device controller 3 is configured by hardware and software conforming to the USB HID standard, and functions as a mouse controlled by the OS of the host device 4. Further, when an extended function is provided by the touch panel driver 315, the provided extended function is controlled. The above configuration is stored, for example, in the ROM 119 shown in FIG. 1 and controlled by the central processing unit 117.

  Next, the USB device driver search sequence (emulation) of the host device 4 will be described. When installing the USB driver, the driver program and OS of the host device 4 determine the USB device. Then, “vendor ID”, “product ID”, “device release number”, “class code”, “subclass code”, “protocol code”, and “interface number” necessary for loading the USB device driver are registered. . When the USB device is connected, the root HUB 305 detects the connection and notifies the central processing unit 117 of the connection. In response to the notification, a “device request” is sent from the host device 4 and responses of “configuration descriptor”, “interface descriptor”, “endpoint descriptor”, and “string descriptor” are sent to the host device 4 from the connected USB device. Made. In response, the USB device control driver is loaded, and device initialization and data input / output start. It should be noted that a more detailed description of the descriptor is omitted because it is well known in the standard document.

In the above operation, the host device 4 searches for the USB device driver in the priority order of the USB standard descriptor diagrams shown in Tables 1 to 4. The device-specific dedicated driver is searched based on the “vendor ID”, “product ID”, and “device release number” of the device descriptor shown in Table 1. Also, a generic driver common to the entire USB class is searched by “class code”, “subclass code”, and “protocol code” of the device descriptor (when the class code is “FF”, the vendor ID, subclass code, and protocol code are used. Search for vendor-supplied drivers).

  Also, a unique dedicated driver is searched for by the device descriptor “vendor ID”, “product ID”, “device release number”, and interface descriptor “interface number”. Further, a general-purpose driver is searched from the interface descriptor “class code”, “subclass code”, and “protocol code”.

  Next, the coordinates of the touch point of the touch made at at least one point on the display screen 101 are set on the display screen 101 by the coordinate space (touch coordinate space) used for the coordinate calculation of the coordinate input device controller 3 and the host device 4. The coordinate space (display coordinate space) will be described. FIG. 4 shows a touch coordinate space 401 and a display coordinate space 402 in the coordinate input device 1. In the present embodiment, it is assumed that the coordinate input device controller 3 can detect 2048 points in the x direction and 1536 points in the y direction in the touch coordinate space 401. Therefore, the points p1, p2, p3, and p4 in the touch coordinate space 401 take the coordinates of (0, 0), (0, 1535), (2047, 1535), and (2047, 0).

  The display coordinate space 402 coincides with the entire range on the display screen 101, and the coordinates of the point q 1, the point q 2, the point q 3, and the point q 4 in the display coordinate space 402 change depending on the resolution of the display screen 101. When the resolution of the display screen 101 is 1024 × 768, the points q1, q2, q3, and q4 of the display coordinate space 402 are (0, 0), (0, 767), (1023, 767), (1023, respectively). Take the coordinates of 0). The touch coordinate space and the display coordinate space exist independently from each other, and the point p1 in the touch coordinate space and the point q1 in the display coordinate space may have the same coordinates (0, 0) but may not match. Furthermore, since the display screen can set other resolutions such as 600 × 800 and 1280 × 1024, the touch coordinate space 401 and the display coordinate space 402 may not correspond one-to-one. The purpose of this embodiment is to eliminate such points and make the touch coordinate space 401 coincide with the display coordinate space 402 and control the display content of the display screen 101 as intended by the operator.

  FIG. 5 is a functional block diagram for explaining the calibration execution unit 500 that controls the touch coordinate space 401 and the display coordinate space 402 to coincide with each other in the coordinate input device according to the present embodiment. Note that the calibration execution unit 500 of the present embodiment is stored in the ROM 119 of the controller 3 as an application program.

  As described above, the display device with a touch panel according to the present embodiment includes the coordinate input device controller 3 that is a touch coordinate calculation unit that calculates the coordinates of the touch points detected by the left coordinate detector 201L and the right coordinate detector 201R. I have. Furthermore, the coordinate input device controller 3 includes a calibration execution unit 500. The calibration execution unit 500 acquires a touch coordinate that represents a touch point of a touch made on at least one point on the display screen 101 in a touch coordinate space. A calibration touch input unit 503 that functions as a coordinate acquisition unit and a display coordinate acquisition unit that acquires display coordinates representing the coordinates of the same touch point in the display coordinate space, and corrects the touch coordinates based on the difference between the touch coordinates and the display coordinates The correction coefficient calculation unit 505 that calculates a correction coefficient that matches the touch coordinates and the display coordinates, and the correction coefficient calculation unit 505 that corrects the coordinates of the detected touch point using the correction coefficient calculated by the correction coefficient calculation unit. And.

  Further, when the coordinate input device controller 3 detects that a plurality of touches have been made on the display screen 101, the calibration execution unit 500 activates the calibration execution unit 500 and performs operations related to calculation of correction coefficients (calibration). Start). For this purpose, the calibration execution unit 500 according to the present embodiment includes a start determination unit 501 for determining whether to execute calibration based on a plurality of detected coordinates.

  6 and 7 are diagrams for explaining calibration performed by the calibration execution unit 500 shown in FIG. In the present embodiment, the calibration is executed by the operator touching two points on the display screen 101 substantially simultaneously. According to such a setting, calibration can be executed by a relatively simple operation of touching the display screen 101 using two fingers. Further, in the coordinate input device 1 of the present embodiment, when two points are touched, four points are detected, and two points actually touched among the four points cannot be identified. Therefore, in this embodiment, the two-point touch is not performed for other purposes, and the possibility of erroneously recognizing an operation performed for other purposes as a calibration instruction can be reduced.

  However, in the present embodiment, the start determination unit 501 determines whether the detected four points are made by two fingers or accidentally input by an operator's erroneous operation or the like by the following process. . That is, as shown in FIG. 6, the start determination unit 501 detects coordinate data obtained by detecting four points of A (x0, y0), B (x1, y1), C (x2, y2), and D (d1, d2). When d is received, XL, which is the difference between the maximum value and the minimum value of all the x coordinates, and YL, which is the difference between the maximum value and the minimum value of all the y coordinates, are calculated. Then, it is determined whether both XL and YL are equal to or shorter than a predetermined length L. When it is determined that the length L is equal to or shorter than the length L, it is determined that calibration is started. The predetermined length L is generally set to such a length that a human can touch with a finger of one hand almost simultaneously.

  In the present embodiment, the start of calibration is notified to the central processing unit 117 (the notification is described as data c). When central processing unit 117 receives data c, it controls LED switch 113 and causes LED 103 to blink. The operator recognizes the start of calibration by turning on the LED 103. In the present embodiment, after the calibration is performed, if the coordinate input device controller 3 does not detect a stop touch and a detachment within a predetermined time, the calibration execution unit 500 ends the calibration. Also at this time, the end of calibration is notified to the central processing unit 117, and the central processing unit 117 controls the LED switch 113 to turn off the LED 103.

  When recognizing the start of calibration, the operator touches at least one point on the display screen. In the present embodiment, these points are defined as point q 1 and point q 3 in the display coordinate space 402. The calibration touch input unit 503 receives a stop touch at a point q1 and a point q3 for a predetermined time (which may be a time recognized as a stop touch or a time longer than that). Is detected, the touch point (x0, y0) of the stop touch made on the point q1 and the touch point (x1, y1) of the stop touch made on the point q3 are acquired and stored in the NVRAM 125 as calibration coordinates. To do.

  In the present embodiment, the touch point of the stop touch is stored as calibration coordinates even when the stop touch is not completely performed on the points q1 and q3. An effective touch range 601 as calibration coordinates is indicated by a broken line in FIG. A broken line range (effective range) 601 is a range of about 100 × 100 in the touch coordinate space.

Next, a method for calculating the correction coefficients A, B, C, and D will be described. Here, it is assumed that two calibration coordinates (xd0, yd0) and (xd1, yd1) are input to the coordinate input device 1 and stored in the NVRAM 125 of the coordinate input device controller 3. When the coordinate in the display coordinate space of the point (xd0, yd0) is the point (x0, y0) and the coordinate in the display coordinate space of the point (xd1, yd1) is the point (x1, y1), the correction coefficients A, B, C and D are calculated by the following formulas (1) to (8).
xd0 = A × x0 + B (1)
yd0 = C × y0 + D (2)
xd1 = A × x1 + B (3)
yd1 = C * y1 + D (4)
A = (xd1-xd0) / (x1-x0) (5)
B = xd0− (xd1−xd0) / (x1−x0) × x0 (6)
C = (yd1−yd0) / (y1−y0) (7)
D = yd0− (yd1−yd0) / (y1−y0) × y0 (8)
When the resolution of the display screen 101 is (1024, 768), the point (xd0, yd0) becomes the point (0, 0), and the point (xd1, yd1) becomes the point (1023, 767).

Using the correction coefficients A, B, C, and D calculated as described above, the coordinate input device controller 3 determines the point (x, y) detected by the coordinate detector using the following equations (9) and (10). The point (xd, yd) obtained by correction using is sent to the host device 4.
xd = A × x + B (9)
yd = C * y + D (10)
The correction coefficient used for the correction of the coordinates is stored in the NVRAM 125 and is updated according to the resolution of the display screen 101. Alternatively, the correction coefficient may be stored for each resolution, and the correction coefficient may be switched according to the resolution of the display screen connected to the coordinate input device controller.

  Incidentally, the USB mouse 301 outputs the coordinate data of the touch coordinates detected by the coordinate detector to the host device 4 as mouse data input using the mouse. The touch is performed by directly moving the pointing member to the touch point, and the touch point is an absolute coordinate that always indicates the origin on the coordinate input area. On the other hand, the mouse data is relative coordinates indicating the current position of the mouse based on the previously detected position. This embodiment is a data conversion that converts the coordinates of the touch point corrected as described above into mouse data based on the movement amount of the touch point obtained by the difference between the detected coordinate and the currently detected coordinate. Means are further provided. In the present embodiment, an application program for converting mouse data is stored in the ROM 119, and the central processing unit 117 functions as data conversion means using this application program.

  8 and 9 are diagrams for explaining processing for converting coordinate data into mouse data. As shown in FIG. 8, the coordinate data detected and stored last time is (x0, y0), and the coordinates detected this time and corrected by the above method are (x, y). A movement amount 364 in the x direction of the coordinate data is obtained from x−x0, and a movement amount 237 in the y direction is obtained from y−y0. Assuming that the amount of movement that can be transmitted at one time in both the x and y directions is 127, the movement amounts of 364 in the x direction and 127 in the y direction are (+127, +127), (+127, +120), (+127, 0), ( +110,0) is sent to the host device 4 four times. FIG. 9 shows the format of data for transmitting the movement amount. In the data shown in FIG. 9, the movement amount has + and − directions, and a general touch is converted into the left button ON.

  The coordinate input device controller 3 initializes the data conversion process by setting the origin on the display coordinate space as the movement start point of the mouse data at the time of the conversion process to the mouse data or the calibration described above. According to such processing, the mouse always starts to move from the origin on the display space, and mouse data is created based on the amount of movement based on the origin.

  Further, in the present embodiment, when a touch is detected immediately after the detachment performed on the display screen 101 and immediately after the detachment, the coordinate input device controller 3 turns off the mouse button for the coordinates at which the pointing member moves from the detachment to the touch. It is assumed to be converted into mouse data indicating In addition, an application program (for example, APL 313) that displays the cursor at the coordinates input in the host device 4 moves the cursor to the coordinates at which the touch is made. According to such a process, when the pointing member from the detachment to the touch passes over the icon or button, it is possible to prevent a program unintended by the operator from being activated by the icon or button.

  Next, processing performed by the above-described display device with a touch panel will be described with reference to a flowchart. FIG. 10 is a diagram for explaining processing when the coordinate input device controller 3 (integrated in the coordinate input device 1 in this embodiment) connected to the host device 4 with a USB cable detects coordinates. It is a flowchart of. A device descriptor, a configuration descriptor, an interface descriptor, an endpoint descriptor, and a string descriptor are transmitted from the coordinate input device controller 3 according to a USB standard setup sequence in response to a device request of the host device 4. The coordinate input device is recognized as a USB mouse by transmission (step S901).

  Next, the coordinate input device controller 3 converts the absolute coordinate detected by the coordinate input device 1 into relative coordinates (X-axis direction movement amount, Y-axis direction movement amount) to the upper left origin (0, 0). Moving. After the initialization performed in step S901, the x-axis movement amount (x0-0) and the y-axis movement amount (y0-0) are calculated based on the first detected touch coordinates (x0, y0). Further, the x-axis movement amount (x1−x0) and the y-axis movement amount (y1−y0) are calculated based on the next detected coordinates (x1, y1), and the coordinates are sequentially converted into movement amounts (step S902). ).

  When the host device 4 recognizes that the USB device is a general-purpose USB mouse (step S904: Yes), it issues a mouse data input request with the endpoint descriptor “data transfer polling period” (step S905). In response to the input request, the coordinate input device controller 3 transmits the coordinate data as mouse data to the host device 4 (step S906). Further, the coordinate input device controller 3 transmits the coordinates of the touch point to the host device 4 as left button OFF mouse data at the time of touch detachment (when the detected coordinate indicator is in a non-detected state) (step S909).

  When the coordinate input device controller 3 determines that an instruction to perform two-point simultaneous touch, that is, calibration is given (step S911: Yes), the coordinate input device controller 3 enters a calibration control subroutine (step S912). Note that the calibration starts when both touched points are detached. When a touch on another point is detected during the touch detection of one point (step S907: Yes), this touch becomes invalid because the touch coordinates cannot be calculated (step S916). On the other hand, if this touch is a two-point simultaneous touch (step S916: Yes), the status is set to calibration (step S917). If it is determined that one of the two simultaneous touches has been detached first and the touch has become one point, the coordinates of this touch point become invalid (step S918: Yes).

  When a coordinate indicator (member) such as a finger or a pen is detected (step S907: Yes), and the status is not a two-point touch (step S915: No) and is not a calibration (step S918: No), the display screen A coordinate detector provided at the left and right ends of one side of 101 detects a touch point based on the light blocking angle, and the coordinate input device controller 3 calculates the coordinates (step S1001). In the coordinate input device controller 3, the host device 4 acquires the resolution of the display screen 101 from the display device 2 (step S1002).

  The calibration execution unit 500 of the coordinate input device controller 3 corrects the calculated coordinates using the correction coefficients A, B, C, and D corresponding to the resolution of the display screen 101 (step S1003). Further, the corrected coordinates are converted into mouse data (steps S1006 and S1007). In this process, the coordinate input device controller 3 moves the cursor from the touch point at which the previous detach was detected to the touch point touched this time (step S1006). Further, mouse data is created from the correction coordinates (x0, y0) of the touch point detected last time and the correction coordinates (x, y) of the touch point detected this time (step S1007).

  11, 12 and 13 are flowcharts of the calibration control subroutine shown as step S912 in FIG. The coordinate input device controller 3 starts a timer 123 that monitors the calibration timeout (step S1101). At this time, when the time during which no touch or detachment is detected reaches a predetermined time (about 10 seconds), the calibration is stopped as shown in FIG. 12 (steps S1201 to 1205).

  Further, when executing the calibration, the coordinate input device controller 3 blinks the LED 103 to indicate that it has shifted to the calibration mode (step S1102). Next, the coordinate input device controller 3 starts measuring the specific time (about 3 seconds) of the stop touch in order to confirm the calibration (step S1108). If the touch coordinates have moved before the elapse of the specific time (step S1110: No), the stop touch is cleared and the time measurement of the stop touch is started again (step S1111). On the other hand, when the specific time is counted from the touch of the stop touch to the detach (step S1112: Yes), it is determined that the stop touch is a touch for calibration, and the time measurement of the stop touch is ended ( Step S1113).

  Next, the coordinate input device controller 3 determines whether or not a stop touch has been made within the effective range 601 (shown by a broken line in FIG. 7) (step S1114). If it is determined that the stop touch is made within the effective range (step S1114: Yes), and if there is a stop touch within the effective range, the LED for notifying completion of the calibration is turned on (step S1115). The calibration operation is completed by acquiring and storing the two calibration coordinates (step S1118).

  Moreover, as shown in FIG. 13, when there is no stop touch more than a specific time (step S1201: Yes), the calibration mode is cleared (steps S1208 to 1210). If there is a stop touch within a specific time and it is not determined that a timeout has occurred (step S1202: No), the calibration touched coordinates are stored (step S1206), and the standard resolution correction coefficient is calculated. The corrected coefficient is stored (step S1207).

  Next, the mouse point initialization subroutine shown in step S902 of FIG. 10 will be described. FIG. 14 is a flowchart showing a subroutine for mouse point initialization. The coordinate input device controller 3 acquires the display resolution (the number of X-axis pixels, the number of Y-axis pixels: SVGA (800, 600), XGA (1024, 768), SXGA (1280, 1024)) detected by the display device 2. (Step S1301).

  Next, the coordinate input device controller 3 transmits mouse data to the host device 4 to move the mouse point to the X coordinate origin (x = 0) (step S1306). After the mouse point reaches the origin, it does not move any more and maintains the origin coordinates. Further, the mouse point is moved to the Y coordinate origin (y = 0) (step S1313). After the mouse point reaches the origin, it does not move any more and maintains the origin coordinates. The origin coordinates (0, 0) are stored as initial coordinates (step S1316). With the above processing, conversion from touch coordinates (absolute coordinates) to relative coordinates starts.

Next, the mouse data creation subroutine shown in step S909 in FIG. 10 and step S1006 in FIG. 11 will be described. FIG. 15 is a flowchart of a mouse data creation subroutine. The coordinate input device controller 3 acquires the following data in order to create mouse data (steps S1401 to S1404).
x-axis remaining travel (current x-coordinate-previous x-coordinate)
x-axis movement direction (+: current x coordinate> = previous x coordinate), (−: current x coordinate <previous x coordinate)
Y-axis remaining travel (current y-coordinate-previous y-coordinate)
Y axis movement direction (+: current y coordinate> = previous y coordinate), (−: current y coordinate <previous y coordinate)
Next, the coordinate input device controller 3 converts the acquired information as shown in FIG. 16, and creates and stores mouse data (step S1409). The stored mouse data is sequentially transmitted in response to an input request from the host device 4.

  A program for causing a computer to execute the display device control method with a touch panel executed by the display device with a touch panel according to the present embodiment is a CD-ROM, floppy (R) in an installable format or an executable format file. It is provided by being recorded on a computer-readable recording medium such as a disc (FD) or DVD. Further, a program for causing a computer to execute the control method of the display device with a touch panel according to the present embodiment is stored on a computer connected to a network such as the Internet, and is provided by being downloaded via the network. May be.

  As described above, a display device with a touch panel according to the present invention, a control method for a display device with a touch panel, and a program for causing a computer to execute the method are a touch panel that directly touches a display screen and inputs coordinates to a PC or the like. Display device with touch panel, method for controlling display device with touch panel, and program for causing computer to execute the method, especially display device with touch panel and display with touch panel that can be connected to various computers not dedicated to display device with touch panel The present invention is suitable for a device control method and a program for causing a computer to execute the method.

It is a figure for demonstrating the display apparatus with a touch panel which can apply the control method of the coordinate input device which is one embodiment of this invention. It is a figure for demonstrating the left coordinate detector and right coordinate detector of one embodiment of this invention. It is a figure for demonstrating installation of a general USB mouse driver. It is a figure which shows the touch coordinate space and display coordinate space in the coordinate input device of one embodiment of this invention. It is a figure for demonstrating the calibration execution part of one embodiment of this invention. It is a figure for demonstrating the calibration which the calibration execution part shown in FIG. 5 performs. It is another figure for demonstrating the calibration which the calibration execution part shown in FIG. 5 performs. It is a figure for demonstrating the process which converts the coordinate data of one embodiment of this invention into mouse data. It is another figure for demonstrating the process which converts the coordinate data of one embodiment of this invention into mouse data. It is a flowchart for demonstrating the process which detects the coordinate of one embodiment of this invention. 11 is a flowchart of a calibration control subroutine shown in FIG. 10. 12 is another flowchart of the calibration control subroutine shown in FIG. 10. 12 is another flowchart of the calibration control subroutine shown in FIG. 10. 11 is a flowchart of a mouse point initialization subroutine shown in FIG. 10. 11 is a flowchart of a mouse data creation subroutine shown in FIG. 10. It is a figure for demonstrating the process which converts coordinate data into mouse data.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Coordinate input device 2 Display apparatus 3 Coordinate input device controller 4 Host apparatus 101 Display screen 113 LED switch 117 Central processing unit 123 Timer 201R Right coordinate detector 201L Left coordinate detector 307 System driver 309 Mouse driver 315 Touch panel driver 401 Touch coordinate space 402 Display coordinate space 500 Calibration execution unit 501 Start determination unit 503 Calibration touch input unit 505 Correction coefficient calculation unit

Claims (11)

A display device with a touch panel that detects a touch made on a display screen and controls the display screen based on coordinates of a touch point at which the touch is made,
Touch coordinate calculation means for calculating the coordinates of the detected touch point;
Touch coordinate acquisition means for acquiring touch coordinates representing a touch point of a touch made on at least one point on the display screen in a touch coordinate space used for coordinate calculation of the touch coordinate calculation means;
Display coordinate acquisition means for acquiring display coordinates representing a touch point of a touch made at least at the one point in a display coordinate space set on the display screen;
Correction coefficient calculating means for correcting the touch coordinates to match the display coordinates based on the difference between the touch coordinates and the display coordinates;
Touch coordinate correction means for correcting the coordinates of the touch point of the detected touch using the correction coefficient calculated by the correction coefficient calculation means;
A display device with a touch panel, comprising:   When touch detection means for detecting a touch on the display screen detects that a plurality of touches have been made on the display screen, calibration is performed as an operation related to calculation of correction coefficients by the correction coefficient calculation means. The display device with a touch panel according to claim 1, wherein the display device starts.   The display device with a touch panel according to claim 1, further comprising a calibration start notification unit that indicates to an operator that the execution of the calibration is started.   The calibration start notifying means includes: a light emitting means that is provided at a position that can be visually recognized by an operator, and capable of blinking; and a light emission control means that causes the light emitting means to blink as the calibration is performed. The display device with a touch panel according to claim 3.   The touch coordinate calculation means and the display coordinate calculation means acquire coordinates when a stop touch for at least one point on the display screen is detected after a stop touch for a predetermined time or longer and a detachment of the stop touch is detected. The display device with a touch panel according to claim 1, wherein the display device has a touch panel.   2. The calibration is terminated when the stop touch and the detachment of the stop touch are not detected within a predetermined time after the start of calibration, and the light emission control means turns off the light emission means. The display apparatus with a touchscreen as described in any one of -5.   The correction coefficient calculation unit calculates a correction coefficient based on a difference between the touch coordinates corresponding to the resolution of the display screen and the display coordinates. Display device with touch panel.   Data conversion means for converting the coordinates of the touch point corrected by the touch coordinate correction means into mouse data based on the amount of movement of the touch point determined by the difference between the previously detected coordinate and the currently detected coordinate. The data conversion means initializes a data conversion process by setting the origin on the display coordinate space as a movement start point of mouse data. Display device with touch panel.   When a touch is detected immediately after the detachment performed on the display screen, the coordinate from the detachment to the touch is converted into mouse data indicating that the mouse button is turned off by the data conversion means, and the cursor is moved to the coordinate at which the touch is made. The display device with a touch panel according to claim 8, further comprising cursor control means for moving the touch panel. A control method for a display device with a touch panel that calculates coordinates of touch points of touches made on a display screen and controls the display screen based on the calculated coordinates,
A touch coordinate acquisition step of acquiring a touch coordinate indicated by a touch coordinate space used for calculating coordinates of a touch point made at least at one point on the display screen;
A display coordinate acquisition step of acquiring a display coordinate indicating a touch point of a touch made at least at the one point by a display coordinate set on the display screen;
A correction coefficient calculating step for calculating a correction coefficient for correcting the touch coordinates to match the display coordinates based on the difference between the touch coordinates and the display coordinates;
A touch coordinate correction step for correcting the coordinates of the touch point of the detected touch using the correction coefficient calculated in the correction coefficient calculation step;
A control method for a display device with a touch panel, comprising: A program for causing a computer to execute a control method of a display device with a touch panel that calculates the coordinates of a touch point of a touch made on a display screen and controls the display screen based on the calculated coordinates,
A touch coordinate acquisition step of acquiring a touch coordinate indicated by a touch coordinate space used for calculating coordinates of a touch point made at least at one point on the display screen;
A display coordinate acquisition step of acquiring a display coordinate indicating a touch point of a touch made at least at the one point by a display coordinate set on the display screen;
A correction coefficient calculating step for calculating a correction coefficient for correcting the touch coordinates to match the display coordinates based on the difference between the touch coordinates and the display coordinates;
A touch coordinate correction step for correcting the coordinates of the touch point of the detected touch using the correction coefficient calculated in the correction coefficient calculation step;
The program characterized by including.

Images