JP2005092538A - Display control method of display device with touch panel, program for making computer execute its method, and display device with touch panel - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display control method of a display device with touch panel capable of surely switching an operation mode with high operability in switching operation modes. <P>SOLUTION: A coordinate determination part 1103 determines whether a coordinate input to a coordinate input surface (mouse data dm) is on a control area displayed on a display screen or not. When the coordinate on the control area is determined, a drag determination part 1105 determines whether the drag length on the control area of a touch point shown by the coordinate is shorter than a predetermined length or not. When it is determined that the drag length is shorter than the predetermined length is determined, an APL transfer part 1101 transfers to an operation mode by an application corresponding to the control area including the coordinate. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a display control method for a display device with a touch panel, a program for causing a computer to execute the method, and a display device with a touch panel.

  Currently, there is a display device with a touch panel that inputs information by touching a coordinate input surface with a finger or a pen and controls display on a display screen. A display device with a touch panel draws a line drawing (including characters) with a finger or pen in the same way as writing on paper on a coordinate input surface (also called handwriting mode, or handwritten line drawing as handwriting characters). It can be displayed on the display screen. For this reason, it may be used as an electronic blackboard instead of a blackboard for presentations and education. When used as an electronic blackboard, the display device with a touch panel is required to have higher operability so as not to hinder the smooth progress of the presentation or the like.

  By the way, many display devices with a touch panel use both the handwriting mode described above and an operation (APL mode) by an application program (APL) generally used in a PC (Personal Computer) or the like. As a conventional configuration of such a display device with a touch panel, for example, when switching between the handwriting mode and the APL mode, a handwritten character has already been written in an area where the operator desires to write the handwritten character. If the handwritten characters are not written, the mode shifts to the handwritten mode, and if the handwritten characters are already written, the APL mode is returned (for example, see Patent Document 1).

  According to such a conventional technique, it is possible to automatically switch between the handwriting mode and the APL mode without performing an operation for starting a program for executing the handwriting mode or the APL mode. For this reason, the operativity of the display apparatus with a touch panel can be improved, and a smooth presentation etc. can be performed.

JP 2000-353049 A (paragraphs [0036] to [0040])

  However, according to the above-described prior art, it is necessary to perform processing for recognizing a line drawing drawn for switching modes. For this reason, there is a possibility that the line drawing cannot be recognized depending on the shape and state of the line drawing previously drawn, and switching as intended by the operator may not be performed.

  The present invention has been made in view of the above, and has a high operability when switching between the handwriting mode and the APL mode, and a display device with a touch panel that can reliably switch between the handwriting mode and the APL mode. It is an object to provide a display control method, a program for causing a computer to execute the method, and a display device with a touch panel.

  In order to solve the above-described problems and achieve the object, the invention according to claim 1 displays a coordinate input surface that receives input of coordinates by touch and an image controlled according to the coordinates input by the coordinate input surface. A display control method for a display device with a touch panel, comprising: a display screen for performing a handwriting drawing process for drawing a line drawing on the display screen according to coordinates input on the coordinate input surface; In the coordinate determination step for determining whether or not the coordinates are on the control region displayed on the display screen, and in the coordinate determination step, if the input coordinates are determined to be on the control region, The touch point indicated by the coordinates moves and stops from touch to detach, and the touch point moves from touch to detach A drag determination step for determining whether or not the drag length is shorter than a predetermined length; and in the drag determination step, if it is determined that the drag length is shorter than the predetermined length, the coordinates are And an application mode transition step for transitioning to an operation mode by an application corresponding to the control area.

  According to the first aspect of the present invention, during execution of the handwriting drawing step, it is determined whether or not the coordinates input on the coordinate input surface are on the control area displayed on the display screen, and the control area If it is above, the touch point indicated by the coordinates moves and stops from touch to detach, and the drag length that the touch point moves from touch to detach is shorter than a predetermined length Judge whether or not. When it is determined that the drag length is shorter than the predetermined length, the operation mode can be shifted to the operation mode by the application corresponding to the control area including the coordinates.

  According to the first aspect of the present invention, the operation mode can be switched from handwritten drawing to control by an application by the same operation (touch on the coordinate input surface) as the handwriting drawing operation. Therefore, switching to application control can be performed smoothly without touching a specific button or the like. Furthermore, since the application mode is changed only when the drag length on the control area is shorter than the predetermined length, the operation mode is changed when the control area is touched for a purpose other than the button touch. The operation mode of the display device with a touch panel can be switched according to the operator's intention. Therefore, the invention described in claim 1 has high operability when switching between the handwriting mode and the APL mode, and can surely switch between the handwriting mode and the APL mode.

  In the display control method for a display device with a touch panel according to a second aspect of the present invention, in the coordinate determination step, it is determined that coordinates are input into a scroll bar of a window screen provided by an application as the control area. In the drag operation determining step, it is determined whether or not the touch point indicating the coordinate has moved or stopped in the scroll bar. If it is determined that the touch has moved or stopped in the scroll bar, the application In the mode transition step, the mode is shifted to an operation mode by an application corresponding to the window screen having the scroll bar.

  According to the second aspect of the present invention, when the operator tries to operate the scroll bar during handwriting drawing, the display control of the display screen can be switched to the application mode. For this reason, the operation to shift to the application mode for the scroll bar operation is unnecessary, and the operation mode of the display device with a touch panel can be switched easily and smoothly.

  The display control method for a display device with a touch panel according to a third aspect of the present invention provides the display control method for a display device with a touch panel, in the drag operation determining step, when a touch point of a touch made inside the scroll bar moves outside the scroll bar, or outside the scroll bar. When it is determined that the touch point of the touch that has been made has moved into the scroll bar, the handwriting drawing operation mode is maintained in the application mode transition step.

  According to the third aspect of the present invention, it is possible to prevent the display control of the display screen from being switched to the application mode when the operator touches the scroll bar for the purpose other than operating the scroll bar during handwriting drawing. Can do. For this reason, it is possible to automatically prevent display control switching unintended by the operator.

  The display control method for a display device with a touch panel according to a fourth aspect of the invention notifies the application program of the coordinates input in the handwriting drawing process when the application mode transition process shifts to the operation mode by the application program. It is characterized by that.

  According to the fourth aspect of the present invention, there is no need to perform the touch operation performed by the operator for operating in the operation mode by the application program again after shifting to the operation mode. For this reason, the operativity of the display apparatus with a touch panel can be improved.

  The display control method for a display device with a touch panel according to claim 5 is a control region in which the coordinate determination step acquires and registers information related to the control region based on a touch performed on the control region. The method further includes a registration step.

  According to the fifth aspect of the present invention, accurate control region information can be acquired even when the size of the control region changes or the display position moves.

  The display control method for a display device with a touch panel according to a sixth aspect of the invention is characterized in that, in the window screen provided by an application, only information related to an area selected by moving or stopping touch is registered as a control area. And

  According to the sixth aspect of the present invention, only a necessary area can be registered as a control area even in a control area of a type that is not created independently as a window screen.

  In the display control method for a display device with a touch panel according to claim 7, in the control area registration step, the origin of the control area is set as relative coordinates with the upper left vertex of the title bar of the window screen as the origin. And is registered as a numerical value converted according to the resolution of the display screen.

  According to the seventh aspect of the present invention, the position of the control area can be specified regardless of the size of the window screen and the display position.

  The display control method for a display device with a touch panel according to an eighth aspect of the present invention detects a scroll bar not included in the window screen in the control area registration step, and includes the display area of the scroll bar in the control area. It is characterized by registering with.

  According to the eighth aspect of the present invention, a scroll bar that is not created as a window screen can be registered as a control area.

  The display control method for a display device with a touch panel according to claim 9 is the control area registration step when the application control mode controlled by the application program shifts to handwriting control in which handwriting is executed. The method further includes a frame line display step of acquiring information related to the control area that has been the target of handwriting drawing and displaying a range registered ahead of the control area.

  According to the ninth aspect of the present invention, it is possible to prevent the operation of registering the control area from being repeated, and to improve the operability of the display device with a touch panel.

  The display control method for a display device with a touch panel according to a tenth aspect of the invention is characterized in that the frame line display step can be arbitrarily omitted.

  According to the tenth aspect of the present invention, it is possible to select whether or not to display a frame line according to the preference of the operator, and to improve the operability of the display device with a touch panel.

  In the display control method for a display device with a touch panel according to an eleventh aspect, in the coordinate determination step, it is determined whether or not the input coordinates are on the control area based on information on the control area registered in advance. It is characterized by doing.

  According to the eleventh aspect of the present invention, the user does not need to register the control area again, and the versatility of the display device with a touch panel can be enhanced.

  A program according to claim 12 is a display device with a touch panel, comprising: a coordinate input surface that receives input of coordinates by touch; and a display screen that displays an image controlled according to the coordinates input by the coordinate input surface. This display control method is a program for causing a computer to execute the handwriting drawing process for drawing a line drawing on the display screen according to the coordinates input on the coordinate input surface. In the coordinate determination step of determining whether or not the coordinates are on the control area displayed on the display screen, and in the coordinate determination step, if the input coordinates are determined to be on the control area, the coordinates The touch point indicated by is moved or stopped from touch to detach, and whether the touch point is a touch. A drag determination step for determining whether or not the drag length moved before detaching is shorter than a predetermined length; and when the drag length is determined to be shorter than the predetermined length in the drag determination step And an application mode transition step of transitioning to an operation mode by an application corresponding to the control area including the coordinates.

  According to the twelfth aspect of the present invention, the operation mode can be switched from handwritten drawing to control by the application by the same operation (touch on the coordinate input surface) as the handwriting drawing operation. Therefore, switching to application control can be performed smoothly without touching a specific button or the like. Furthermore, since the application mode is changed only when the drag length on the control area is shorter than the predetermined length, the operation mode is changed when the control area is touched for a purpose other than the button touch. The operation mode of the display device with a touch panel can be switched according to the operator's intention. Therefore, the invention described in claim 1 has high operability when switching between the handwriting mode and the APL mode, and can surely switch between the handwriting mode and the APL mode.

  A display device with a touch panel according to a thirteenth aspect of the present invention is a touch panel including a coordinate input surface that receives input of coordinates by touch, and a display screen that displays an image controlled according to the coordinates input by the coordinate input surface. The display device is a display device, and the coordinates input on the coordinate input surface are displayed on the display screen during a handwriting drawing process for drawing a line drawing on the display screen according to the coordinates input on the coordinate input surface. A coordinate determination unit that determines whether or not the input coordinate is on the control region; and when the coordinate determination unit determines that the input coordinate is on the control region, the touch point indicated by the coordinate is detached from the touch. The drag length that moved and stopped until the touch point moved from touch to detach is Corresponding to the control area including the coordinates when the drag determining means for determining whether or not the predetermined length is shorter than a predetermined length, and when the drag determining means determines that the drag length is shorter than the predetermined length Application mode transition means for transitioning to an operation mode by the application to be performed.

  According to the thirteenth aspect of the present invention, the operation mode can be switched from handwritten drawing to control by the application by the same operation (touch on the coordinate input surface) as the handwriting drawing operation. Therefore, switching to application control can be performed smoothly without touching a specific button or the like. Furthermore, since the application mode is changed only when the drag length on the control area is shorter than the predetermined length, the operation mode is changed when the control area is touched for a purpose other than the button touch. The operation mode of the display device with a touch panel can be switched according to the operator's intention. Therefore, the invention described in claim 1 has high operability when switching between the handwriting mode and the APL mode, and can surely switch between the handwriting mode and the APL mode.

  As described above, the invention described in claim 1 has a high operability when switching between the handwriting mode and the APL mode, and can reliably switch between the handwriting mode and the APL mode. The display control method can be provided.

  According to the second aspect of the present invention, the operation of shifting to the application mode for the scroll bar operation is unnecessary, and the operation mode of the display device with a touch panel can be switched easily and smoothly.

  According to the third aspect of the present invention, there is an effect that it is possible to automatically prevent display control switching unintended by the operator.

  The invention according to claim 4 has an effect that the operability of the display device with a touch panel can be enhanced.

  According to the fifth aspect of the present invention, there is an effect that accurate control region information can be acquired even when the size of the control region is changed or the display position is moved.

  The invention described in claim 6 can improve the operability of the display device with a touch panel by registering only a necessary area as a control area even in a control area of a type that is not independently created as a window screen. There is an effect.

  The invention according to claim 7 has an effect that the position of the control region can be specified relatively easily regardless of the size of the window screen and the display position.

  According to the eighth aspect of the present invention, a scroll bar that is not created as a window screen can be registered as a control area, so that the operability of the display device with a touch panel can be improved.

  According to the ninth aspect of the present invention, it is possible to prevent the operation of registering the control region from being repeated, and to improve the operability of the display device with a touch panel.

  According to the tenth aspect of the present invention, it is possible to select whether or not to display a frame line according to the preference of the operator, and to improve the operability of the display device with a touch panel.

  According to the eleventh aspect of the present invention, there is no need for the user to register the control area again, and the versatility of the display device with a touch panel can be enhanced.

  According to a twelfth aspect of the present invention, there is provided a display control method for a display device with a touch panel, which has high operability when switching between the handwriting mode and the APL mode and can reliably switch between the handwriting mode and the APL mode. It is possible to provide a program for causing the program to be executed.

  The invention according to claim 13 has an effect that it is possible to provide a display device with a touch panel that has high operability when switching between the handwriting mode and the APL mode, and can reliably switch between the handwriting mode and the APL mode. Play.

  Exemplary embodiments of a display control method for a display device with a touch panel, a program for causing a computer to execute the method, and the display device with a touch panel according to the present invention will be described below in detail with reference to the accompanying drawings.

  Prior to the description of the present invention, a display device with a touch panel to which the display control method of the present invention can be applied will be described. FIG. 1 is a diagram showing an optical touch panel display device. The illustrated display device with a touch panel controls the image data based on the touch panel type coordinate input device 1, the coordinate detection device 3 that detects the coordinates input to the coordinate input device 1, and the coordinates detected by the coordinate detection device 3. Host device 4 (PC (Personal Computer) is used in this embodiment), and image data (R, G, B) controlled by the host device 4 is displayed on a liquid crystal screen or PDP (Plasma Display Panel). And a display device 2 for displaying on a screen 112. A configuration in which the coordinate input device 1 and the coordinate detection device 3 are combined is a configuration called a touch panel.

  In the display device with a touch panel shown in FIG. 1, a display screen 112 is provided so as to overlap the coordinate input surface 113 of the coordinate input device 1. The coordinate input surface is an area where the coordinate detection device 3 can detect coordinates, and the display device with a touch panel in FIG. 1 is configured to directly touch the display screen 112, so the coordinate input surface 113 is a virtual surface. is there. Such a display device with a touch panel can be similarly controlled by a touch operation on the display screen 112 or a mouse operation on the host device 4.

  The coordinate input device 1 includes an optical detector described later, and optically detects a touch on the display screen 112. The data detected by the optical detector is input to the coordinate detection device 3, and the coordinate detection device 3 calculates the coordinates (x, y) of the point (touch point) t on the coordinate input surface 113 that has been touched. The calculated coordinates are represented by the number of pixels on the display screen 112 (for example, x: 1024, y: 768), and are periodically output to the host device 4 at a time such as 10 ms or 20 ms. The calculation of the coordinates of the touch point of the coordinate detection device 3 will be described in detail later.

  The coordinate detection device 3 also includes a left optical detector I / F 101, a right optical detector I / F 102 for inputting data detected by an optical detector, which will be described later, and a central processing unit 104 that controls the coordinate detection device 3 in general. A ROM 105 storing a program used by the central processing unit 104, a RAM 106 temporarily storing work data of the central processing unit 104, and a timer (TIMER) for periodically measuring time and inputting to the central processing unit 104 107.

  The host device 4 is a PC (Personal Computer) and is equipped with a general-purpose OS such as Windows (R), Macintosh (R), and Linux (R), and image data is controlled under the control of the OS. It is running. A driver 108 that is a program (driver software) that controls peripheral devices of the computer under the control of a general-purpose OS, an APL 111 that includes a plurality of application groups that operate under the control of a common general-purpose OS, and an image And an image RAM 115 in which data is temporarily stored.

  Here, detection of touch points and calculation of coordinates in the display device with a touch panel shown in FIG. 1 will be described. FIG. 2 is a diagram showing the coordinate input device shown in FIG. The coordinate input device 1 includes a rectangular coordinate input surface 113 having a vertical length H and a horizontal length W in the figure, a retroreflective member 201 provided on three sides of the coordinate input surface, The left optical detector 202 </ b> L and the right optical detector 202 </ b> R are provided at both ends of one side where the reflective reflector 201 is not provided.

  Each of the left optical detector 202L and the right optical detector 202R is a unit in which a light source (not shown) that is a semiconductor laser and a light receiving unit (not shown) using, for example, a CCD (Charged Coupled Device) are integrated. It is. The light source irradiates the entire area of the coordinate input surface 113 in a fan shape that requires a light source. The left optical detector 202 </ b> L and the right optical detector 202 </ b> R irradiate fan-shaped light, so that the laser light is irradiated on the entire coordinate input surface 113.

  The light applied to the coordinate input surface 113 is reflected by the retroreflection member 201. The retroreflective member 201 is a member that reflects light at an angle of 180 degrees. For example, the retroreflective member 201 reflects reflected light p1 shown in the drawing and reflects reflected light p2 passing through an optical axis parallel to the optical axis of the irradiated light p1. To do. When there is no light blocking object on the coordinate input surface 113, the left optical detector 202L and the right optical detector 202R receive all the reflected light of the irradiated light. However, for example, when a finger or pen touches the coordinate input surface 113, light passing through the touch point is not received by the left optical detector 202L and the right optical detector 202R.

Information on the light detected by the left optical detector 202L and the right optical detector 202R is input to the coordinate detection device 3 as analog data. At this time, the coordinate detection device 3 includes the left optical detector 202L and the right optical detector from the optical axis of the light that should be originally received at the position where the light of the light receiving unit is not received among the light irradiated in a fan shape. Angles (light shielding angles) θL and θR between straight lines passing through the light receiving part 202R and straight lines passing through each light receiving part and the touch point t are obtained. The coordinates (x, y) of the touch point t are calculated as follows using the angles θL and θR.
x = W × tan θR / (tan θL + tan θR)
y = H−W × tan θL × tan θR / (tan θL + tan θR)

  Next, an electromagnetic induction type tablet personal computer (hereinafter, tablet PC) will be described as a display device with a touch panel to which the display control method of the present invention can be applied. 3 to 8 are diagrams for explaining the tablet PC. FIGS. 3 to 5 are diagrams for explaining the configuration of the tablet PC, and FIGS. 6 to 8 are the functions of the tablet PC and the principle of coordinate detection. It is a figure explaining. As shown in FIG. 3, the tablet PC has a main body 303 having a display 301 and a keyboard 305, and a mouse (not shown). Furthermore, a touch panel operation using an electronic pen 307 instead of a mouse is possible. Further, “Windows® PC Tablet PC Edition”, which is an OS for tablet PCs, has been released from Microsoft, and handwritten character recognition engines, speech recognition engines, and the like are provided.

  FIG. 4 shows a state in which the display screen 301 is rotated 180 degrees and folded. When the display screen 301 in such a state is touched with the electronic pen 307, the position (coordinates) of the electronic pen 307 on the display 301 is detected by the sensor built in the electronic pen 307 and the tablet PC, and a mouse click or drag operation is performed. Is emulated. With the horizontal display screen 301 and the electronic pen 307, handwritten characters that are difficult to operate with a mouse can be drawn as if writing on paper.

  As shown in FIG. 5, a tempered glass 309 is installed on the surface of the display screen 301 with which the electronic pen 307 is in direct contact to prevent the liquid crystal display unit 311 from being damaged. An electromagnetic induction sensor unit 313 that detects the position of the electronic pen is installed under the liquid crystal display unit 311. Note that FIG. 3 shows a tablet PC in which the display screen 301 is rotated and folded, but there is a type in which the display portion can be removed.

  As shown in FIG. 6, the electronic pen 307 includes a resonance circuit 401, a capacitor 403, and a sensor coil 405. Further, as shown in FIG. 7, the electromagnetic induction sensor unit 313 is provided with a plurality of sensor coils 405. The sensor coil 405 is installed at a density proportional to the coordinate detection accuracy. The figure shows a part of the sensor coil 405 for detecting the X-axis direction, and a sensor coil (not shown) for detecting the Y-axis direction is installed in a direction orthogonal to the illustrated sensor coil 405. .

  When the tip of the electronic pen 307 touches the display screen 301, an induced electromotive voltage is generated in the sensor coil 405 due to a current magnetic field flowing in the sensor coil 405, and a resonance circuit including the capacitor 403 is excited and a resonance current flows. The coordinate detection of the electronic pen 307 is performed by the central processing unit 421 of the electromagnetic induction coordinate detection unit 413.

  The electromagnetic induction coordinate detection unit 413 first controls the transmission / reception changeover switch 411 by the transmission / reception changeover switch I / F 419, and connects the transmission / reception changeover switch 411 to the contact A and the contact C. With this connection, a current flows from the AC power source 409 to the sensor coil 405. Further, the X-axis coil changeover switch 410 is controlled by the X-axis coil changeover switch I / F 415, and the switch is switched at a high speed so that a current is passed through the sensor coil 405 sequentially. A magnetic field is sequentially generated in the sensor coil 405, and the electronic pen 307 resonates due to the generated magnetic field. Next, the central processing unit 421 connects the transmission / reception changeover switch 411 to the contact B and the contact C, and sequentially switches the X-axis coil changeover switch 410 at high speed. At this time, a magnetic field is generated by the resonance current in the electronic pen 307, and an induced electromotive voltage is generated in the sensor coil 405. The induced electromotive voltage generated in the sensor coil 405 is amplified and measured by the X axis detection I / F 417.

  FIG. 8 is a diagram illustrating the distribution of the induced electromotive force to be measured. When the electronic pen 307 is on the sensor coil 405 with “2” attached, the induced electromotive voltage received by the sensor coil “2” is the highest. As described above, the electromagnetic induction coordinate detection unit 413 determines the X coordinate of the touch point by detecting the highest point of the measured induced electromotive voltage distribution. Similarly, the touch point of the Y coordinate is determined. The coordinates of the confirmed touch point are notified to the main body 303 of the tablet PC by PCI / F 427 (RS232C, general-purpose I / F such as USB, or dedicated I / F). When the tablet PC driver receives the coordinate data, it converts it into mouse data. Then, it passes through the general-purpose mouse I / F and is passed to the APL 111.

  In this embodiment, in the display device with a touch panel described above, a touch of a finger or a pen from a non-contact state on the coordinate input surface (display screen in this embodiment) is called a touch. A point indicating the made position is called a touch point. In addition, the separation of the finger or the pen from the touch point is called detaching, and the movement of the touch point without detaching is called moving touch. Stopping a finger or pen at one point for a predetermined time (stop touch time) after a touch or a moving touch is called a stop touch, and a stop touch made following a moving touch is called a moving / stop touch.

  Touch and detach correspond to a click operation with a mouse, and move / stop touch corresponds to a drag operation with a mouse. Furthermore, a double touch is a double touch when two touches are made continuously within a predetermined time and within a predetermined range, and the double touch corresponds to a double click of the mouse.

  As described above, any touch detected by the display device with a touch panel is converted into a mouse data format including coordinates input by the mouse and processed on the device side. As described above, the touch operation can correspond to the mouse operation on a one-to-one basis, and can be handled in the same manner as the mouse operation. For this reason, in the present embodiment, double touch and double click are simply different input tools and are regarded as the same operation. Similarly, the movement / stop touch is regarded as the same operation as dragging with a mouse.

  Next, a method for converting the coordinates of the touch point into mouse data will be specifically described. FIG. 9 is a diagram for explaining the format of detected touch point data (coordinate data) and the format of mouse data. FIG. 10 is a flowchart for explaining mouse emulation. Mouse emulation refers to an operation in which a driver converts coordinates detected by a coordinate detection device into mouse data.

  Further, as shown in the lower part of FIG. 9, the mouse data includes the x-coordinate and y-coordinate of the touch point and information on the mouse status. The mouse status indicates ON or OFF of the right button of the mouse and ON or OFF of the left button by 1 or 0. Touch, detach, and move / stop touch are set in association with any one of ON / OFF of the right button of the mouse and ON / OFF of the left button.

  The coordinate input device detects a finger, a pen, or the like (coordinate indicator) periodically (about 10 ms). The coordinate detection device calculates coordinate data related to the coordinates of the touch point from the information of the coordinate indicator detected by the coordinate input device 1, and notifies the host device. The control driver of the host device communicates with the coordinate detection device using communication means such as RS232C or USB, and inputs coordinate data (step S1001).

  As shown in the upper part of FIG. 9, the detected coordinate data includes the x-coordinate and y-coordinate of the touch point, and further information on the coordinate status of the touch point. The coordinate status indicates by 1 or 0 whether the detection data is touch, detach, or move / stop touch. When a touch, detach, or move / stop touch is detected in the display device with a touch panel, 1 is set in the field indicating each touch.

  For the touch operation, the right button and the left button cannot be specified with the mouse. For this reason, the coordinate data is notified to the mouse I / F provided by the OS as notification of the ON coordinates of the right button and the left button specified by the touch panel settings (steps S1005 and S1006). Further, the driver notifies the mouse I / F of the coordinates of the detached point along with the button OFF (steps S1009 and S1010).

  Next, a display control method for a display device with a touch panel according to the present embodiment, which is applied to the above-described display device with a touch panel, a program for causing a computer to execute the method, and, among the display devices with a touch panel, A configuration unique to the embodiment will be described. In the present embodiment, an example in which the display control method of the present invention is applied to the optical display device with a touch panel shown in FIG. 1 among the display devices with a touch panel will be described.

  FIG. 11 is a functional block diagram of the APL transition unit 1101 that is a program application that executes the display control method of the present embodiment. The APL transition unit 1101 is built in the host device 4 as an APL 111 together with other APLs that control images displayed on the display screen 112. The APL transition unit 1101 includes a coordinate determination unit 1103 having a control region registration unit 1104, a drag determination unit 1105, and a mode switching unit 1107. Applications for controlling an image displayed on the display screen 112 are overwritten by APL 1109 and APL 111. Are switched among APLs 1111a, 1111b (for example, Word (R), Office (R), Excel (R), and PowerPoint (R)) included in the application group 1111 stored as applications other than the overwriting APL. In the present embodiment, the line drawing drawn by hand is written on the window screen displayed by another application, and is thus overwritten. A state in which a line drawing is overwritten on the display screen 112 is referred to as an overwrite mode, and a state in which an image displayed on the display screen 112 is controlled by another application is referred to as an APL mode.

  The APL transition unit 1101 controls the display of a display device with a touch panel that includes a coordinate input surface that accepts input of coordinates by touching and a display screen that displays an image controlled according to the coordinates input by the coordinate input surface. . The overwriting APL 1109 draws a line drawing on the display screen 112 according to the mouse data dm indicating the coordinates input on the coordinate input surface. APL 1111a, APL 1111b,..., For example, create a document according to information input by keyboard input (not shown) of the host device 4 or create a table and display it on the display screen 112.

  The coordinate determination unit 1103 determines whether the coordinates input to the display screen 112 are on the control area displayed on the display screen 112 during execution of image control by the overwriting APL 1109. The determination is made based on the control area information of the application registered in the control area registration unit 1104. Note that the control area of the present embodiment is provided by an application and is all or part of the window screen displayed on the display screen 112. The registration of the control area will be described later.

  When the coordinate determination unit 1103 determines that the input coordinates are on the registration area, the drag determination unit 1105 determines whether the touch point indicated by the coordinates is a move / stop touch (drag operation). . The determination as to whether or not the drag is made is based on whether or not the length (drag length) that the touch point has moved from touch to detach is shorter than a predetermined length. The mode switching unit 1107 controls the display screen 112 by an application program (APL 1111a, APL 1111b,...) Corresponding to the control area only when it is determined that the drag length of the drag starting from the touch point is shorter than a predetermined length. Shifts to a state (operation mode).

  Hereinafter, the overwriting mode performed by the overwriting APL 1109 will be described. FIG. 12 is a diagram for explaining an operation performed in the overwrite mode. An overwriting toolbar 1201 is displayed on the display screen 112. The overwriting toolbar 1201 has a plurality of buttons, and enters the overwrite mode when the operator touches the pen button or the eraser button. In the overwriting mode, the overwriting APL 1109 displays a transparent window having the same size as the entire area of the display screen 112, and acquires window information of an application to be overwritten (an application corresponding to the frontmost window). Then, in the acquired information, it is determined whether or not this window screen is registered as a control area of the application from the window title. If it is registered, a frame line 1206 of the control area is displayed. The control area frame 1206 can be arbitrarily hidden by the operator's selection.

  The mouse cursor 1203 is moved by the operator's touch, and a line drawing 1200 such as “important” characters and arrow lines is drawn according to the touch point. By selecting the eraser button on the overwriting toolbar 1201, displaying the eraser cursor 1205, and touching the line drawing 1200, the line drawing touching the eraser cursor 1205 is deleted. The overwritten line drawing data (drawing data) and the image (APL image) displayed on the window screen are sequentially added and saved by selecting the save button on the overwriting toolbar. By selecting the end button, the overwritten drawing data is deleted. Also, the overwriting APL 1109 closes the transparent window and deletes the overwrite toolbar.

  Note that the thickness and color of a line when drawing a line drawing are set by an overwrite setting dialog box shown in FIG. The overwrite setting dialog box is displayed when the setting button of the overwrite toolbar 1201 is selected. The thickness and color set in the dialog box are set as the thickness and color of pen 1 or pen 2, and when the pen 1 or pen 2 button is selected, a line of the color and thickness set for the pen is drawn. The The size of the set eraser cursor is used to set the range of line drawings to be erased at once.

  As described above, the present embodiment shifts to the APL mode only when the drag length of the drag performed on the control area is shorter than the predetermined length. The predetermined length to be compared with the drag length can be set by the operator on the overwrite setting screen shown in FIG. The overwrite setting screen shown in FIG. 14 is also displayed by selecting the setting button on the overwrite toolbar 1201 as in the dialog box shown in FIG. In the illustrated drag length setting, when the setting value is 10 pixels, for example, if there is a drag of 10 pixels (dots) or more from touch to detach, the transition to the APL mode is not performed. The drag length setting value set in this way can be confirmed by actually touching and moving the lower rectangular surface 1401.

FIG. 15 is a diagram for explaining a method of calculating the drag length of the touch point. The illustrated example shows a case where coordinates are input by moving coordinates (x0, y0), (x1, y1), (x2, y2), (x3, y3), (x4, y4). . Coordinates (x0, y0) are touch points where a touch is made, and (x4, y4) is a detach point. The movement distance (drag length) Ld at this time is calculated by the following equation.
Ld = [(x1-x0) ^2- (y1-y0) ² ] ^1/2 + [(x2-x1) ^2- (y2-y1) ² ] ^1/2
+ [(X3−x2) ² − (y3−y2) ² ] ^1/2 + [(x4−x3) ² − (y4−y3) ² ] ^1/2

  When the control area of the window screen shown in FIG. 12 is touched, the window screen is switched to the APL mode by the touch detachment. The APL mode is also switched by a drag operation on the scroll bar in the window screen. Dragging in the scroll bar is performed when the touch touch point made inside the scroll bar moves outside the scroll bar or when it is determined that the touch touch point made outside the scroll bar moves inside the scroll bar. Switching to the APL mode is not performed, and the operation mode by handwriting is maintained. This is to prevent the operation mode from being switched by a touch made on the scroll bar for purposes other than the operation of the scroll bar.

  In the APL mode, the overwritten line drawing is erased from the window screen, and the operation provided by the application becomes possible. The erased line drawing is displayed again by switching to the overwrite mode.

Next, a control area registration method will be described. FIG. 16 is a diagram for explaining a control region registration method according to the present embodiment. The upper diagram shown in FIG. 16 shows a window screen provided by the application and an overwriting toolbar 1201. In the example shown in FIG. 16, the command bar 1604 is also created as an independent window, and the scroll bar is not created as a window. When the operator registers the control area, the operator touches the overwriting toolbar 1201 to display the control area registration toolbar 1601. Then, the control area information of the control area information is acquired using the window including the point P touched by the operator as the control area. As the control area information of the present embodiment, for example, the following information is included.
Window title (normal application name)
Window class (type)
Window style (type: different style if there is the same class)
Window left origin coordinate (X, Y) (value varies depending on the display position of the window)
Window width (W) (This value varies depending on the window size adjustment)
Window height (H) (different value depending on window size adjustment)
Table 1 shows an example of an application control area registration file.

  In the example shown in FIG. 16, the touch P is made on the command bar 1604. Therefore, the window width W and height H of the command bar and the coordinates of the upper left vertex (upper left origin coordinates) are registered as control area information. At this time, a frame line 1605 of a window registered as a control area is displayed.

  When the registration button 1602 of the control region registration toolbar 1601 is touched with the frame line 1605 displayed, the control region registration unit 1104 saves and registers the window information described above. Further, when an area other than the control area registration toolbar 1601 is touched in the window frame display state, the window frame is deleted and excluded from registration targets.

  If the touched control area has already been registered, the control area registration unit 1104 changes the display color of the frame line of the registered control area. When the delete button 1603 of the control area registration toolbar 1601 is selected while the display color of the frame line is changed, the information of the control area is deleted from the registered information. When a region other than the control region registration toolbar 1601 is touched while the frame line display color is changed, the control region registration unit 1104 restores the frame line display color.

  Further, in the display device with a touch panel of the present embodiment, the control region of an application program that is generally considered to be frequently used in advance on the manufacturing side of the display device with a touch panel is not limited to a configuration in which the user registers control region information. It is also possible to register information. Examples of application programs that are generally considered to be frequently used include Word (R), Office (R), Excel (R), and PowerPoint (R).

  FIG. 17 shows an example of registering a control area by selecting a part from a window screen (integrated window) in which a title bar and a display area are configured as an integrated window in addition to a command bar. (The range indicated by the frame 1701 is the window screen). As described above, when an unnecessary area is included in the window screen as the control area, the manual button 1702 of the control area registration toolbar 1601 can be touched to manually select the range to be the control area. The control area is selected by touching the upper left origin of the range (command bar 1604) to be selected and moving as it is, as indicated by the cursor 1703 in the middle part of FIG. This operation is transmitted to the host device 4 as a drag operation.

  FIG. 18 is a diagram for explaining a method for calculating information on a control region when a range is manually selected. When the point A of the integrated window in FIG. 18 is touched, the acquired window information is (X, Y), W, and H. When there is no scroll bar at the touch point, the whole is determined as the control region. If this is inappropriate, the manual button 1702 of the control area registration toolbar 1601 is selected, and the range of the control area is selected. In FIG. 18, it is assumed that the upper left origin coordinate (Wx, Wy), height (Wh), and width (Ww) range (command bar 1801) is an area selected by a manual button. The above numerical values are calculated by the following procedure.

The upper left origin coordinate (X, Y) of the control area (window screen) before the range is selected is acquired.
The height (H) of the control area (window screen) before the range is selected is acquired.
The width (W) of the control area (window screen) before the range is selected is acquired.
The display resolution (pixel) (PX, PY) of the display screen 112 is acquired.
The relative coordinates of the origin of the range selection area (relative coordinates with the upper left vertex (X, Y) of the title bar of the window screen as the origin: Xw, Yw), height (Hw), and width (Ww) To convert to standard resolution (1024, 768).
Xw = (Wx−X) × PX / 1024
Yw = (Wy−Y) × PY / 768
Ww = Ww × PX / 1024
Hw = Wh × PY / 768

  When the scroll bar is not created as a window, as shown in the lowermost diagram of FIG. 17, an area 1901 in which the scroll bar is displayed is acquired as a window by touch B on the scroll bar. In such a case, the control area registration unit 1104 searches for whether there is a touch point on the scroll bar, and if it determines that there is a touch point, the control area registration unit 1104 sets the scroll bar area as the control area.

  FIG. 19 is a diagram for explaining a method of calculating information related to the control area when the scroll bar is used as the control area. When the scroll bar is not created as a window, window information obtained by touching point C or point D becomes (X, Y), W, H, and cannot be acquired as scroll bar window information. For this reason, the control area registration unit 1104 first detects whether or not a scroll bar exists at the touch point as follows.

The upper left origin coordinates (X, Y) of the window having the scroll bar area are acquired by the I / F provided by the OS.
Get the height (H) of a window with a scroll bar.
Get the width (W) of the window with the scroll bar.
It is detected whether or not a scroll bar exists in the vicinity of the touch point, and if it exists, the width (Vw) of the vertical scroll bar 1901 is acquired.
The upper left origin coordinates (Vx, Vy) of the vertical scroll bar 1901 are calculated using the following equations.
Vx = X + W-Vw
Vy = Y

Further, the control area registration unit 1104 calculates the height (Vh) of the vertical scroll bar 1901.
Vh = H-Vw
[7] Detect whether there is a scroll bar near the touch point, and obtain the horizontal scroll bar height (Hh).
The upper left origin coordinate (Hx, Hy) of the horizontal scroll bar 1902 is calculated using the following equation.
Hx = X
Hy = Y + H-Hh
The width (Hw) of the horizontal scroll bar is calculated using the following formula.
Hw = W-Hh

Next, the flowchart of the display control method of the display apparatus with a touch panel performed by the display apparatus with a touch panel according to the present embodiment will be shown and described. The information described in the flowcharts described below is as shown in Tables 2 to 5.

  FIG. 20 is a flowchart of the overwriting drawing control, and mainly describes processing executed by the overwriting APL 1109. The overwriting APL 1109 is activated by, for example, double-clicking on an icon provided by the OS, and displays an overwriting toolbar (step S1901). Further, an APL mode (a mode in which display is controlled by an APL other than the overwriting APL 1109) is set (step S1902), and a function provided by any one of the APL 1111a, APL 1111b,. In the APL mode, the coordinates of the touch on the overwriting toolbar are notified from the OS to the overwriting APL 1109 in the overwriting mode (step S1908).

  If the coordinates of the touch point (touch made from the detached state) are on the overwriting toolbar (step S1917: Yes), “overwriting toolbar control” is executed until the detachment is made (step S1921). If the touch coordinates (touch made from the detached state) are outside the overwriting toolbar (step S1917: No), “overwrite drawing control” is executed until the touch is detached (step S1921).

  21, 22, and 23 are flowcharts of the overwriting toolbar control shown in step S1909 of FIG. The overwriting APL 1109 highlights the selected button among the buttons on the overwriting toolbar as an effective button (step S2004). When dragging outside the button is detected after the button is touched (step S2005: No), the touch button is returned from the reverse display to the normal display (step S2007). If the detach (mouse button OFF) coordinates are on the touched button detected as the mouse button ON in step S2001 (step S2008: Yes), the function corresponding to the OFF button is executed. When shifting to the APL mode (step S2011), the overwriting drawing is cleared (step S2012). Further, the overwrite transparent window is closed (step S2013), and the process proceeds to the APL operation mode.

  If it is determined in step S2014 to step S2016 that the overwriting mode (pen 1, pen 2, eraser) has been changed, the button indicating the setting before the change is displayed correctly (step S2018). Then, the overwriting mode transition control is executed (step S2020).

  When the delete button on the overwrite toolbar is selected (step S2023: Yes), the overwrite APL 1109 deletes the displayed control area frame of the APL (step S2026). When the display button is selected (step S2027: Yes), the registered APL control area frame is displayed (step S2029). If the control button is selected (step S2032: Yes) and the APL mode is selected (step S2033: Yes), an overwrite transparent window is displayed (step S2034). Then, APL control window registration control is executed (step S2035).

  The overwrite APL 1109 displays the overwrite mode setting dialog box and sets the pen color, thickness, eraser size, and drag length when the setting button on the overwrite toolbar is selected (step S2041: Yes). (Step 2042. Further, when the save button is selected (Step S2043: Yes), the overwrite drawing data and the overwrite APL image are sequentially added and saved (Step S2204). Is deleted (step S2047), the overwriting tool bar is deleted (step S2048), the overwrite transparent window is closed (step S2049), and the APL mode is entered.

  FIG. 24 is a flowchart of the overwrite mode transition control shown in step S2020 of FIG. At the time of transition to the overwriting mode, the overwriting APL 1109 displays a transparent window equal to the full screen size of the display screen 112 (step S2301). At this time, the image controlled by the APL remains displayed, and all the coordinates of the touch made are notified to the overwriting APL 1109.

  Next, the overwriting APL 1109 acquires APL control area information in which the APL (frontmost window) to be overwritten is registered (step S2302). If the APL control area frame is currently displayed (step S2304: YES), the acquired APL control area frame of the upper left origin coordinate, the control area width, and the control area height is displayed (step S2305). Furthermore, when shifting from the overwriting mode to the APL mode (step S2306: Yes), the overwriting drawing is cleared, and the overwriting drawing is displayed again when returning from the APL mode to the overwriting mode (step S2307).

  FIG. 25 is a flowchart of the overwriting drawing control shown in step S1921 of FIG. In the overwriting control, first, the input touch and mouse data until the touch is detached are stored (step S2401). Then, using the color and thickness set for the pen 1, a line is drawn between the previously input coordinates and the currently input coordinates (step S2404), and the overwritten line data is saved as drawing data. (Step S2405). If the eraser is set in the overwrite mode (step S2409: YES), the line drawing drawn in the area touched by the eraser cursor is erased (step S2410). At this time, the overwritten drawing data of the erased area is also deleted (step S2411).

  Also, when the mouse button is turned OFF (step S2402: OFF), the drag determination unit 1105 of the APL transition unit 1101 calculates the drag length from touch to detach (step S2412). When the calculated drag length is equal to or less than the drag length set in the overwrite mode setting dialog box (step S2413: Yes), and when it is determined that the drag is performed within the APL control area (step S2414: Yes). ), The drawing mode is shifted to the APL mode.

  On the other hand, when the drag length is equal to or longer than the drag length set in the overwrite mode setting dialog box (step S2413: No), and when it is determined that the drag is performed within the scroll area (step S2419: Yes), the APL mode is set. To move to. Therefore, the overwrite drawing data from touch to detach is deleted (step S2415), the mouse data from touch to detach is notified to the mouse I / F provided by the OS (step S2417), and the overwrite transparent window is closed (step S2417). S2418). With the above processing, the notified mouse data is transferred to the APL, and the APL function according to the touch coordinates is executed.

  FIG. 26 is a flowchart of the APL control area window registration control shown in step S2305 of FIG. In this process, the control area registration unit 1104 acquires control area information in which the overwriting target APL (frontmost window) is registered (step S2501). At this time, the registered APL control area frame is displayed (step S2502), and the APL area registration toolbar is displayed (step S2504).

  In step S2511, when a touch is made outside the APL control area registration toolbar, the control area registration unit 1104 executes control area registration control until the touch is detached (step S2511). If a touch is made in the APL control area registration toolbar, APL control area registration toolbar control is executed until the touch is detached (step S2515).

  FIG. 27 is a flowchart of the APL control area registration control shown in step S2511 of FIG. When the range of the APL control area is selected, the control area registration unit 1104 determines that the upper left origin coordinates (X0, Y0), width (X1-X0), high from the touch point (X0, Y0) and detach point (X1, Y1). The rectangular area (Y1-Y0) is set as the operation area (step S2603). Then, the operation area information is acquired from the touch point, and when the operation area by the touch operation is changed, the operation area frame display is changed (step S2608). When the operation area of the touch point is a registered control area (step S2618: Yes), the operation area frame is deleted in red (step S2619). When the operation area of the touch point is not a registered control area (step S2618: No), the operation area frame is displayed in blue (step S2621).

  28 and 29 are flowcharts of the APL control area registration toolbar control shown in step S2520 of FIG. The control area registration unit 1104 sets the touched button among the buttons on the APL control area registration toolbar as a control button (step S2704). When range selection is selected as the operation mode (step S2709: YES), this operation is invalidated (step S2710). If the detach coordinates are on the button at the time of touch (step S2711: Yes), the button function is executed. That is, the range selected by the touch or drag operation is registered as a control area in the APL control area registration file (step S2714).

  In step S2718, the control area registration unit 1104 deletes the selected control area from the APL control area registration file. If the manual button is selected (step S2720: YES), the range selection mode is entered (step S2722). At this time, the operation area frame being operated is cleared (step S2725).

  FIG. 30 is a flowchart of the APL control area acquisition control shown in step S2608 of FIG. The coordinate determination unit 1103 acquires information on the control area (window screen) touched (step S2901). Subsequently, information of all window screens on which the line drawing drawn by the overwriting APL 1109 is displayed is acquired (step S2902), and the touch point is not on the window screen on which the line drawing is drawn (step S2903: No). This touch is invalidated (step S2904).

  On the other hand, if the touch point is on the window screen on which the line drawing is drawn (step S2903: Yes), it is determined whether it is a scroll bar window from the window class and the window style (step S2905). Then, it is determined whether there is a horizontal scroll bar in the vicinity of the touch point (step S2907). If there is (step S2907: Yes), a horizontal scroll bar area is calculated (step S2908). Also, it is determined whether there is a vertical scroll bar near the touch point (step S2910). If there is (step S2910: Yes), a vertical scroll bar area is calculated (step S2911). After the above processing, the touched window is stored as a control area (step S2913).

  FIG. 31 is a flowchart of the APL control region search control shown as step S2501 in FIG. In the APL control area search control, the coordinate determination unit 1103 reads the APL control area registration file (step S3001), and acquires the window title of the overwrite APL (frontmost window screen) (step S3002). Next, all window information in which the overwritten line drawing is displayed is acquired (step S3004). Then, it is searched from the window title, window style, and window class whether the window screen registered in the APL control area registration file is registered in the window acquired in step S3004 (step S3006). When the retrieved window screen is registered in the control area (step S3007: Yes), information regarding the window screen is stored as control window APL control area information (step S3009).

  If the window screen is not a control window (step S3009) and is a scroll bar window (step S3012: Yes), it is stored as scroll bar window APL control area information (step S3011). Furthermore, when the searched window screen is a horizontal scroll bar (step S3012: Yes), a horizontal scroll area is calculated (step S3014) and saved as horizontal scroll APL control area information (step S3015). If the retrieved window screen is a vertical scroll bar (step S3016: Yes), the vertical scroll area is calculated and the vertical scroll APL control area information is stored (step S3019).

Further, when the searched window screen has a range selection area, the display resolution (PX, PY) is acquired, the upper left origin coordinates (X, Y) of the window including the range selection area, and the range selection origin relative coordinates (Wx, Wy). The range selection APL control region is calculated from the range selection width (Ww) and the range selection height (Wh).
Upper left origin X coordinate = X + Wx × 1024 / PX
Upper left origin Y coordinate = Y + Wy x 768 / PY
Control area width = Ww × 1024 / PX
Control area height = Wh x 768 / PY

  As described above, a display control method for a display device with a touch panel according to the present invention, a program for causing a computer to execute the method, and a display device with a touch panel use both handwriting drawing and a general application program. It is useful for the configuration, and is particularly suitable for a configuration that requires smooth switching between the operation of drawing a handwritten character and the operation mode of another application.

It is a figure which shows a display apparatus with an optical touch panel. It is a figure which shows the coordinate input device shown in FIG. It is a figure for demonstrating the structure of tablet PC. It is another figure for demonstrating the structure of tablet PC. It is another figure for demonstrating the structure of tablet PC. It is a figure explaining the function of tablet PC, and the principle of coordinate detection. It is another figure explaining the function of tablet PC, and the principle of coordinate detection. It is another figure explaining the function of tablet PC, and the principle of coordinate detection. It is a figure for demonstrating the format of the coordinate data in a display apparatus with a touch panel, and the format of mouse data. It is a flowchart for demonstrating mouse emulation in a display apparatus with a touch panel. It is a functional block diagram of the structure which performs the display control method of one embodiment of this invention. It is a figure for demonstrating operation performed in the overwrite mode of one embodiment of this invention. It is a figure which shows the setting dialog box of the overwrite of one embodiment of this invention. It is a figure which shows the overwrite setting screen of one embodiment of this invention. It is a figure for demonstrating the calculation method of the drag length of the touch point of one embodiment of this invention. It is a figure for demonstrating the registration method of the control area of one embodiment of this invention. It is another figure for demonstrating the registration method of the control area of one embodiment of this invention. It is a figure for demonstrating the calculation method of the information of the control area of one embodiment of this invention. It is another figure for demonstrating the calculation method of the information of the control area of one embodiment of this invention. It is a flowchart of the overwriting drawing control of one embodiment of this invention. FIG. 21 is a flowchart of overwriting toolbar control shown in step S1909 of FIG. FIG. 21 is a flowchart of overwriting toolbar control shown in step S1909 of FIG. FIG. 21 is a flowchart of overwriting toolbar control shown in step S1909 of FIG. 22 is a flowchart of overwriting mode transition control shown in step S2020 of FIG. 21. FIG. 21 is a flowchart of overwriting drawing control shown in step S1921 of FIG. It is a flowchart of APL control area window registration control shown to step S2305 of FIG. 27 is a flowchart of APL control region registration control shown in step S2511 of FIG. 27 is a flowchart of APL control area registration toolbar control shown in step S2520 of FIG. 27 is a flowchart of APL control area registration toolbar control shown in step S2520 of FIG. It is a flowchart of APL control area | region acquisition control shown to step S2608 of FIG. FIG. 26 is a flowchart of APL control region search control shown as step S2501 in FIG.

Explanation of symbols

2 Display device 3 Coordinate detection device 4 Host device 104 Central processing unit 108 Driver 112 Display screen 113 Coordinate input surface 201 Retroreflective member 202R Right optical detector 202L Left optical detector 301 Display 303 Main body 305 Keyboard 307 Electronic pen 311 Liquid crystal display Unit 313 Electromagnetic induction sensor unit 401 Resonance circuit 403 Capacitor 405 Sensor coil 409 AC power supply 410 Axis coil changeover switch 411 Transmission / reception changeover switch 413 Electromagnetic induction coordinate detection unit 421 Central processing unit 1101 APL transition unit 1103 Coordinate judgment unit 1104 Control region registration unit 1105 Drag determination unit 1107 Mode switching unit 1111 Application group 1201 Overwrite toolbar 1203 Mouse cursor 1205 Eraser cursor 120 Control region frame 1601 control region registered toolbar 1901 vertical scroll bar 1902 horizontal scroll bar

Claims (13)

A display control method for a display device with a touch panel, comprising: a coordinate input surface that receives input of coordinates by touch; and a display screen that displays an image controlled according to coordinates input by the coordinate input surface,
Whether the coordinates input on the coordinate input surface are on the control area displayed on the display screen during the handwriting drawing process of drawing a line drawing on the display screen according to the coordinates input on the coordinate input surface. A coordinate determination step for determining whether or not,
In the coordinate determination step, when it is determined that the input coordinates are on the control area, the touch point indicated by the coordinates moves and stops from touch to detach, and the touch point is from touch to detach. A drag determination step for determining whether the drag length moved to is shorter than a predetermined length,
In the drag determination step, when it is determined that the drag length is shorter than the predetermined length, an application mode transition step of shifting to an operation mode by an application corresponding to the control area including the coordinates;
A display control method for a display device with a touch panel.   In the coordinate determination step, when it is determined that coordinates are input into the scroll bar of the window screen provided by the application as the control area, the touch point indicating the coordinate is the scroll bar in the drag operation determination step. In the application mode transition step, the operation mode by the application corresponding to the window screen having the scroll bar is determined in the application mode transition step. The display control method for a display device with a touch panel according to claim 1, wherein   In the drag operation determining step, when the touch point of the touch made in the scroll bar moves outside the scroll bar, or when it is determined that the touch point of the touch made outside the scroll bar moves in the scroll bar, The display control method for a display device with a touch panel according to claim 2, wherein an operation mode of handwriting drawing is maintained in the application mode transition step.   The coordinate input in the handwriting drawing step is notified to the application program when the application mode shift step shifts to the operation mode by the application program. A display control method for a display device with a touch panel.   The coordinate determination step further includes a control region registration step of acquiring and registering information related to the control region based on a touch performed on the control region. The display control method of the display apparatus with a touch panel as described in one.   6. The control region registration step of registering only information related to a region selected by moving or stopping touch among window windows provided by an application as a control region. The display control method of the display apparatus with a touch panel as described in 2.   In the control area registration step, the origin of the control area is shown as relative coordinates with the upper left vertex of the title bar of the window screen as the origin, and is registered as a numerical value converted according to the resolution of the display screen. A display control method for a display device with a touch panel according to claim 6.   The display with a touch panel according to claim 6 or 7, wherein in the control area registration step, a scroll bar not included in the window screen is detected, and the display area of the scroll bar is included and registered in the control area. Device display control method.   When shifting from the application control mode controlled by the application program to handwriting control in which handwriting is executed, in the control area registration step, information on the control area that has been the target of handwriting drawing is acquired. The display control method for a display device with a touch panel according to any one of claims 1 to 8, further comprising a frame display step for displaying a range registered in front of the control region.   The display control method for a display device with a touch panel according to claim 9, wherein the frame line display step can be arbitrarily omitted.   The said coordinate judgment process judges whether the coordinate input based on the information regarding the control area registered previously exists on the said control area, It is any one of Claims 1-10 characterized by the above-mentioned. A display control method for a display device with a touch panel. A method for causing a computer to execute a display control method for a display device with a touch panel, which includes a coordinate input surface that receives input of coordinates by touch and a display screen that displays an image controlled according to coordinates input by the coordinate input surface. A program,
Whether the coordinates input on the coordinate input surface are on the control area displayed on the display screen during the handwriting drawing process of drawing a line drawing on the display screen according to the coordinates input on the coordinate input surface. A coordinate determination step for determining whether or not,
In the coordinate determination step, when it is determined that the input coordinates are on the control area, the touch point indicated by the coordinates moves and stops from touch to detach, and the touch point is from touch to detach. A drag determination step for determining whether the drag length moved to is shorter than a predetermined length,
In the drag determination step, when it is determined that the drag length is shorter than the predetermined length, an application mode transition step of shifting to an operation mode by an application corresponding to the control area including the coordinates;
The program characterized by including. A display device with a touch panel, comprising: a coordinate input surface that accepts input of coordinates by touch; and a display screen that displays an image controlled according to the coordinates input by the coordinate input surface,
Whether the coordinates input on the coordinate input surface are on the control area displayed on the display screen during the handwriting drawing process of drawing a line drawing on the display screen according to the coordinates input on the coordinate input surface. Coordinate determination means for determining whether or not,
When the coordinate determination unit determines that the input coordinates are on the control area, the touch point indicated by the coordinates moves and stops from touch to detach, and the touch point is from touch to detach. Drag determining means for determining whether or not the drag length moved to is shorter than a predetermined length,
Application mode transition means for transitioning to an operation mode by an application corresponding to the control area including the coordinates, when the drag determination means determines that the drag length is shorter than the predetermined length;
A display device with a touch panel, comprising:

Images