KR20130080941A - Method and apparatus for processing a function of terminal having a touch panel - Google Patents

Abstract

The terminal device has a touch panel, the sensor for generating a touch signal of the touch portion and the non-touch portion of the touch panel, the touch position from the sensor, the change of the touched portion and the non-touched portion is detected And a control unit for detecting a touch angle, executing a function set according to the change of the touch position and angle, and a display unit for displaying data of a function executed under control of the control unit.

Description

TECHNICAL AND APPARATUS FOR PROCESSING A FUNCTION OF TERMINAL HAVING A TOUCH PANEL}

The present invention relates to an apparatus and method for processing a function of an apparatus having a touch panel, and more particularly, to an apparatus and a method capable of performing a specific function by analyzing touch and non-touch inputs.

In general, a device having a touch panel may control an operation of the device or control displayed data according to a touch event of the touch panel. In this case, the user could call a menu using a touch button on the screen of the terminal device or a hard key mounted on the terminal device to perform a desired function. Therefore, when performing a specific function in the device using the touch panel, a number of touch events had to be generated.

The present invention proposes an apparatus and method for processing a function mapped to a portable terminal by analyzing touch and non-touch input of a touch panel in a device having a touch panel. An embodiment of the present invention proposes an interaction utilizing a contact angle of a non-touched hand at a touch position when an input occurs through a touch panel. In addition, the embodiment of the present invention proposes an interaction utilizing a touch angle and a direction of a non-touched hand at a touch position when an input occurs through the touch panel.

The terminal device has a touch panel, the sensor for generating a touch signal of the touch portion and the non-touch portion of the touch panel, the touch position from the sensor, the change of the touched portion and the non-touched portion is detected And a control unit for detecting a touch angle, executing a function set according to the change of the touch position and angle, and a display unit for displaying data of a function executed by the control unit.

A data display method of a terminal device having a touch panel may include: detecting a touch position from a touch panel; detecting a touch angle by detecting a change of a portion touched and a portion not touched by the touch panel; Characterized in that the process of displaying the data according to the change in the touch position and angle.

In a device equipped with a touch panel, touch and non-touch inputs can be analyzed to perform specific functions of the device. This allows a user to press various combinations of keys or perform menus of various steps in order to perform actions mapped to each interaction. There is an advantage that can easily perform the function in one step without having to call.

1 shows a configuration of an apparatus according to an embodiment of the present invention.
2 is a diagram illustrating a configuration of a terminal apparatus according to the first embodiment of the present invention.
3A-3C illustrate a method of controlling the display of 3D data by detecting an angle change in an embodiment of the present invention.
4 is a flowchart illustrating an operation procedure of a terminal apparatus according to the first embodiment of the present invention.
5 is a diagram illustrating a configuration of a terminal device according to a second embodiment of the present invention.
6A-6B illustrate a method of detecting a change in direction in an embodiment of the present invention.
7 is a view for explaining a method of controlling the display of the 3D data according to the change of angle and direction according to an embodiment of the present invention.
8 is a flowchart illustrating an operation procedure of a terminal apparatus according to a second embodiment of the present invention.
9 is a diagram illustrating an example of detecting and processing an angle of a hand touched by a terminal device according to an exemplary embodiment of the present invention.
10 is a diagram illustrating a configuration of a portable terminal according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same configurations of the drawings denote the same reference numerals as possible whenever possible.

The present invention can execute or control the function of the device by analyzing the touch and non-touch input in the device having a touch panel. The touch and non-touch input is finally determined by analyzing the relationship between the non-touched hands while the finger or the palm is touched. According to an exemplary embodiment of the present invention, a change in an angle between a position where the touch panel is touched and an area that is not touched (not touched) is detected while an area equal to or larger than a size area set in the touch panel is touched, and the detected angle change is utilized. An apparatus and method for mapping a specific function are proposed. To this end, the terminal device according to an embodiment of the present invention includes a touch panel, and when the device detects that the touch panel is touched by a specific size area or more, it determines the proximity information of the hand in the area not touched by the touch panel. The controller detects a change in angle between a portion touched by the touch panel and a portion not touched, and controls the execution of a set function (mapping function) using the detected angle change.

In addition, the embodiment of the present invention detects a change in the angle between the touched position of the touch panel and the non-touched (non-touched) area in a state where an area equal to or larger than the size area set in the touch panel is touched, and further, the touched area ( Or an apparatus and method for detecting a change in the direction (non-touch area), and mapping a specific function by using the detected angle and direction change. To this end, the terminal device according to an embodiment of the present invention includes a touch panel, and when the device detects that the touch panel is touched by a specific size area or more, after determining proximity information of the hand in an area not touched by the touch panel, Detects a change in angle between a portion touched and a portion not touched by the touch panel, detects a change in the direction of the touched region (or a non-touched region), and sets a function set using the detected angle and the change of direction ( control the execution of mapped functions).

1 is a diagram showing the configuration of an apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the sensor 120 may be a touch panel, and may be configured as a touch panel and a sensor capable of detecting a non-touch of the touch panel. The sensor 120 senses the intensity of the touch area and the non-touched part. The controller 100 controls the overall operation of the terminal device, and also detects a state of the touch area and the non-touched part from the sensor 120 and controls execution of a function set according to the detected result. The memory 110 includes a program memory for storing a program for controlling an operation according to an exemplary embodiment of the present invention, and a data memory for storing data for executing a program and data generated while executing the program. The display unit 130 displays the operation and data of the terminal device under the control of the controller 100. The display unit 130 may be integrated with the sensor 120 (for example, may be a touch screen), and the user may view a screen displayed on the display unit 130 and perform a touch function. The touch input on the screen of the display unit 130 may be sensed.

In the device having the configuration as described above, when the control unit 100 detects that the touch panel has touched a specific size area or more from the sensor 120, the controller 100 determines proximity information of the hand at a portion not touched by the touch panel, and touches the touch panel. The change of the portion and the portion not touched is detected, and the execution of the set function is controlled according to the detected change. The detection may detect a change of an angle formed by the non-touch part in the touch area by detecting a proximity state between the touch panel and the non-touch part. The detection may detect a proximity state between the non-touch portion and the touch panel to detect a change in the angle formed by the non-touch portion in the touch area and a change in the direction of the touched area on the touch channel. In addition, the controller 100 detects a change in angle and direction from the output of the sensor 120 and controls execution of a mapped specific function.

In the following description, it is assumed that a function executed according to a change in the touch area, angle, and / or direction is a display function of three-dimensional (3D) data. The 3D data may be map data.

2 is a diagram showing the configuration of a terminal apparatus according to the first embodiment of the present invention. 3A-3C illustrate a method of controlling the display of 3D data by detecting an angular change in an embodiment of the invention.

2 to 3C, the touch sensor 120 may be a touch panel. Then, the touch panel may generate touch signals having different intensities in the touch area and the non-touch area of the user's hand. In addition, the sensor 120 may include a touch panel and a distance sensor that detects a distance between the touch panel and the touch area and the non-touch area. In this case, the touch panel may generate a strong signal in the touch area of the user's hand, and the distance sensor has a signal having different intensities according to the distance (interval) between the touch panel and the user's hand in the area where the user's hand is not touched. May occur. The distance sensor for detecting the distance between the touch area and the non-touch area may be a proximity sensor, and the proximity sensor may be an infrared sensor. In the following description, the sensor 120 will be described with an example in which a touch panel and a proximity sensor are configured.

The touch sensor 210 detects a position of a hand touched by the touch panel on the sensor 120. The angle detector 220 detects a distance between the touch area detected by the touch sensing unit 210 and the hand (finger or palm) of the non-touch part (non-touch part) and the touch panel from the touch area, and does not touch the touch panel. Detect the angle of the hand of the part that is not. That is, the user may touch the touch panel as shown in 311, 313, and 315 of FIG. 3A. In this case, when touching the 311, the palm may touch the touch panel as shown in 321, and the touch sensing unit 210 may generate a touch sense signal such as 321. In addition, when touching as shown in 313, the touch sensing unit 210 may detect the touch position of the finger, and the proximity sensor has different intensities according to the distance between the untouched area and the touch panel, such as 323. Generate a signal. Therefore, when touched as shown in 313 of FIG. 3A, the angle detector 220 receives a signal as shown in FIG. 3B. In this case, the angle detector 220 outputs the touch panel and the proximity sensor at an angle θ1 in the non-touch area. The angle can be detected. In addition, when touching as shown in 35, the touch sensing unit 210 may detect the touch position of the finger, and the proximity sensor has different intensities according to the distance between the untouched area and the touch panel as shown in 325. Generate a signal. Therefore, when touched as shown in 315 of FIG. 3A, the angle detector 220 receives a signal as shown in FIG. 3B. In this case, the angle detector 220 outputs the touch panel and the proximity sensor at an angle θ2 in the non-touch area. The angle can be detected. Therefore, the angle detector 220 may detect a change in the angle formed by the user's hand and the touch panel by using signals detected in the user's touch and non-touch areas.

The 3D data storage unit 290 may be provided in the memory 110. The 3D data can be expressed in various forms in three dimensions. In the embodiment of the present invention, the representation of the 3D data may be controlled according to the user's touch input. The data processor 230 controls the data of the 3D data storage 290 by the output of the touch detector 210 and the angle detector 220 to process the display data. That is, the data processor 230 changes the display form of the 3D data by applying an angle change output from the angle detector 220 around the touch area determined by the touch detector 210.

The 3D data of FIG. 3C may be, for example, map data. In this case, the 3D data, such as 331 of FIG. 3C, may be a case where the user views the plan from the top to the bottom. When the user performs a touch operation as shown by 313 of FIG. 3A while 3D data such as 311 of FIG. 3C is displayed on the display unit 130, the data processor 230 senses a change in the θ1 angle and displays 3D as shown in 333 of FIG. 3C. Adjust the display angle of the data. In addition, when the user performs a touch operation as shown at 331 of FIG. 3C, the data processor 230 detects a change in the θ2 angle and adjusts the display angle of the 3D data as shown at 335 of FIG. 3C. Adjust. Then, the display controller 240 can display the 3D data output from the data processor 230 as shown in FIG. 3C through the display unit 130.

As described above, the terminal apparatus according to an embodiment of the present invention detects the angle of the touched part and the non-touched part while the hand is touched to an area of a size or more set on the screen (ie, a touch panel integrally formed with the display unit). If the detected angle changes, the mapped function is performed. For example, if you change the view mode on the map, you can change the viewing angle of the map by placing your finger on the screen and changing the proximity of the screen to the palm (by changing the angle).

4 is a flowchart illustrating an operation procedure of a terminal apparatus according to the first embodiment of the present invention. In the first embodiment, the mapped function is executed according to the change of the angle of the touch input, and FIG. 4 assumes that the mapped function is a display function of 3D data.

Referring to FIG. 4, the control unit 100 performs a mode of displaying 3D data in step 411. In the 3D data display mode as described above, the user may perform a touch operation by looking at a screen displayed on a touch screen in which the display unit 130 and the sensor 120 are integrally formed. When the touch input is sensed through the sensor 120 in the above state, the controller 100 detects the touch input in step 413. At this time, the control unit 100 detects that the touch input is generated when the touch detection signal output from the sensor 120 is generated over the set size area. When the touch input is detected, the control unit 100 detects a position where the touch input is generated in step 415 and detects an angle in step 417. 3A and 3B, the angle detection method checks the distance between the sensor 120 (that is, the touch panel) and the portion where the user's hand is not touched at the position where the user's hand is touched. The distance at which the user's hand is touched is detected using the distance value between the touch panel and the non-touch part of the user.

Thereafter, the controller 100 checks whether the angle is changed in step 419, and if the angle is changed, in step 421, the controller 100 processes the displayed 3D data by reflecting the changed angle. That is, the controller 100 changes the 3D data displayed on the display unit 130 in which the angle is changed to the changed angle, and displays the 3D data in which the angle is changed through the display unit 130 in step 423.

In addition, the displayed 3D data should be able to change the display data even if the touched position other than the angle is changed. That is, when the user wants to change the position of the displayed data, the user changes the touch position or performs a scroll operation. In this case, the data displayed on the display unit 130 is displayed by being moved left and right and / or up and down. Therefore, upon receiving the touch detection signal from the sensor 120, the controller 100 checks whether the touch position is changed in step 425, and if the touch position is changed, the 3D data displayed on the display unit 130 reflects the changed touch position in step 427. Change the display position of.

The above operation is maintained until the touch release operation occurs, and the controller 100 may change the position and angle of the displayed 3D data by checking whether the user changes the touch angle and the touch position. In this case, when the user releases the touch, the controller 100 detects this in step 429 and returns to step 411 to perform the 3D data display mode. In this case, the 3D data display mode performs all functions of displaying 3D data, and also includes a procedure of terminating the procedure as shown in FIG. 4 when the user commands the end of the 3D data display mode.

5 is a diagram illustrating a configuration of a terminal device according to a second embodiment of the present invention. 6A and 6B are diagrams for describing a method of detecting a change in direction in an embodiment of the present invention, and FIG. 7 is a method for controlling display of 3D data according to an angle and a change in direction according to an embodiment of the present invention. It is a figure explaining.

5 through 7, the touch sensor 120 may be a touch panel as described above, and may generate touch signals having different intensities in the touch area and the non-touch area of the user's hand. A distance sensor may be further provided.

The touch sensor 210 detects a position of a hand touched by the touch panel on the sensor 120. The angle detector 220 detects a distance between the touch area detected by the touch sensing unit 210 and the hand (finger or palm) of the non-touch part (non-touch part) and the touch panel from the touch area, and does not touch the touch panel. Detect the angle of the hand of the part that is not. That is, the angle detector 220 may detect the angle as shown in FIG. 3B according to the touch operation as shown in FIG. 3A. The direction detector 250 detects a direction of the treatment area output from the touch detector 210. That is, the user may touch the touch panel as shown in 611 and 613 of FIG. 6A. In this case, when touching 611, the touch sensing unit 210 may generate a touch sensing signal such as 621. In addition, when touching as shown in 613, the touch sensing unit 210 may sense a touch position of the finger, and the touch sensing unit 210 may generate a touch sensing signal such as 623. In this case, the touch signal as shown in FIG. 6B has a touch center line parallel to the X axis, and the touch signal as shown in 623 of FIG. 6B has a predetermined angle θ12 between the X and Y axes as shown in 625. That is, the touch signal such as 611 of FIG. 6A has a direction angle close to 0 degrees, and the treatment signal such as 613 of FIG. 6A has a θ12 angle. Therefore, the direction detection unit 250 may detect the direction angle according to the user's touch direction.

The 3D data storage unit 290 may be provided in the memory 110. As described above, the 3D data may be represented in various forms in three dimensions. In the embodiment of the present invention, the representation of the 3D data may be controlled according to the position of the user's touch input, the angle of the hand, and the touch direction. The data processor 230 controls the data of the 3D data storage 290 by the output of the touch detector 210, the angle detector 220, and the direction detector 250 to process the display data. That is, the data processor 230 applies a change in the angle of the hand output from the angle detector 220 and a change in the touch direction output from the direction detector 250 around the touch area determined by the touch detector 210 to display the 3D data. Change it.

The 3D data of FIG. 7 may be, for example, map data. In this case, 710 of FIG. 7 may be a case where the 3D data is viewed from top to bottom. When performing a touch operation such as 313 of FIG. 3A and 611 of FIG. 6A, which displays 3D data as shown in 710 of FIG. 7, the data processor 230 senses that the user's hand is changed at an angle of θ1 and the user's touch direction. 6B, the data processor 230 adjusts the display angle and direction of the 3D data as shown in 720 of FIG. 7. In addition, when the 3D data is displayed as shown in 710 of FIG. 7, when the touch operation such as 313 of FIG. 3A and 613 of FIG. 6A is performed, the data processor 230 detects that the user's hand is changed by θ1 angle. The touch direction of the user may be sensed as 623 of FIG. 6B. In this case, the data processor 230 adjusts the display angle and direction of the 3D data as shown in 730 of FIG. 7.

In addition, when performing a touch operation such as 315 of FIG. 3A and 611 of FIG. 6A, which displays 3D data as shown in 710 of FIG. 7, the data processor 230 detects that the user's hand is changed at an angle of θ2 and the user's touch 6B may detect that the direction is the same as that of 621 of FIG. 6B. In this case, the data processor 230 adjusts the display angle and direction of the 3D data as shown in 740 of FIG. 7. In addition, when the 3D data is displayed as shown in 710 of FIG. 7, when the touch operation such as 315 of FIG. 3A and 613 of FIG. 6A is performed, the data processor 230 detects that the user's hand is changed by θ2 angle. The touch direction of the user may be sensed as 623 of FIG. 6B. In this case, the data processor 230 adjusts the display angle and direction of the 3D data as shown in 750 of FIG. 7.

As described above, the terminal apparatus according to an embodiment of the present invention detects the angle of the touched part and the non-touched part while the hand is touched to an area of a size larger than the size set on the screen (ie, a touch panel integrally formed with the display unit). , Detects a change in the direction of the area where the hand is touched. Thereafter, when the detected angle and the touch direction of the hand change, the terminal device applies a change in the angle and the touch direction of the hand to perform a mapped function. For example, when changing the view mode on a map, the display of the map is changed by changing the proximity of the screen and the palm and the touch direction (by changing the angle and direction) by placing a finger on the screen.

8 is a flowchart illustrating an operation procedure of a terminal apparatus according to a second embodiment of the present invention. In the second embodiment, the mapped function is executed according to the change of the angle and the touch direction of the touched hand. FIG. 8 assumes that the mapped function is a display function of 3D data.

Referring to FIG. 8, the controller 100 performs a mode of displaying 3D data in step 811. In the 3D data display mode as described above, the user may perform a touch operation by looking at a screen displayed on a touch screen in which the display unit 130 and the sensor 120 are integrally formed. When the touch input is sensed through the sensor 120 in the above state, the controller 100 checks whether the touch input is performed in step 813. In this case, the controller 100 determines that the touch input is generated when the touch detection signal output from the sensor 120 is generated over the set size region. When the touch input is detected, the controller 100 detects a location where the touch input is generated in step 815, and detects an angle and a touch direction of the touched hand in step 817. 3A and 3B, the angle detection method checks the distance between the sensor 120 (that is, the touch panel) and the portion where the user's hand is not touched at the position where the user's hand is touched. The distance at which the user's hand is touched is detected using the distance value between the touch panel and the non-touch part of the user. 6A and 6B, the detection of the touch direction is performed by comparing the center axis of the touch area with a reference value (here, X and Y coordinates) to detect a value (that is, a direction angle). Can be.

Thereafter, the controller 100 checks whether the angle of the touched hand is changed in steps 819 and 821. If the angle is changed, the controller 100 processes the displayed 3D data by reflecting the changed angle of the hand. In addition, in step 825 and 827, the controller 100 detects a change in the direction of the touch area (that is, a direction in which the user touches), and if a change in the direction is detected, applies the change in the touch direction to process the displayed 3D data. . If the touch position is changed, the controller 100 processes 3D data by reflecting the changed touch position while performing steps 829 and 831. The controller 100 displays the 3D data processed according to the change (the angle of the touched hand, the touch direction and / or the touch position) through the display 130 after performing the operations 821, 827, or 831. In this case, the 3D data processed according to the touch position, the touch direction, and the angle of the touched hand may be displayed as shown in FIG. 7.

The above operation is maintained until the touch release operation occurs. When the user releases the touch, the control unit 100 detects it in step 833 and returns to step 811 to perform the 3D data display mode. In this case, the 3D data display mode performs all functions of displaying 3D data, and also includes a procedure of terminating the procedure as shown in FIG. 8 when the user commands the end of the 3D data display mode.

9 is a diagram illustrating an example of detecting and processing an angle of a hand touched by a terminal device according to an exemplary embodiment of the present invention.

Referring to FIG. 9, when the user's hand touches an area of a predetermined size or more on the sensor 120, the terminal device may detect this by a touch input. In this case, the touch input may be generated when the palm, a plurality of fingers and the blade are touched. FIG. 9 rotates the 3D coordinate axis by changing the proximity of the screen and the palm (by changing the angle) by placing the blade on the screen (when the touch panel and the display unit are integrally provided). At this time, the direction and position of the user's finger may be the rotation axis. In this case, the configuration of the terminal device can be configured as shown in FIG.

10 may be a configuration of a portable terminal according to an embodiment of the present invention. The portable terminal may be a mobile phone, a tablet PC, a slate PC, a notebook PC, or the like.

Referring to FIG. 10, the communication unit 1020 performs a wireless communication function with a terminal device and an external device or a communication network. The communication unit 1020 may be a WCDMA, GSM, LTE communication unit, etc., may also be a WiFi, Wibro, Wimax communication unit, etc., may also be a Bluetooth, NFC communication unit and the like. In the touch screen 1030, the display panel 1031, the proximity sensor 1033, and the touch panel 1035 may be integrated.

The controller 1000 detects a position touched by the user, an angle of the hand, and / or a touch direction from the outputs of the touch panel 1035 and the proximity sensor 1035, and displays the touched position, the touch direction, and / or the angle of the hand. The data to be changed is changed, and the changed data is controlled to be displayed through the display panel 1031. The memory 1010 stores the 3D data and is accessed under the control of the controller 1000.

Embodiments of the present invention disclosed in the specification and drawings are only specific examples to easily explain the technical contents of the present invention and aid the understanding of the present invention, and are not intended to limit the scope of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

Claims (12)

A sensor having a touch panel and generating touch signals of the touch portion and the non-touch portion of the touch panel;
A controller for detecting a touch angle by detecting a touch position and a change of the touched portion and a non-touched portion from the sensor, and executing a function set according to the change of the touch position and angle;
And a display unit for displaying data of a function executed by the control unit. The method of claim 1, wherein the sensor
A touch panel,
Apparatus comprising a proximity sensor for sensing the distance between the portion touched on the touch panel and the portion not touched. The apparatus of claim 2, wherein the touch panel, the proximity sensor, and the display unit are integrally formed. The apparatus of claim 3, wherein the proximity sensor is an infrared sensor. 4. The apparatus of claim 3, wherein the control unit
A touch sensing unit sensing a touch position from the touch panel;
An angle detector for detecting a touch angle by analyzing a distance between the touch panel and the non-touch portion;
And a data processor for processing the display data according to the touch position and the touch angle. 6. The apparatus of claim 5, wherein the data is 3D data. 4. The apparatus of claim 3, wherein the control unit
A touch sensing unit sensing a touch position from the touch panel;
An angle detector for detecting a touch angle by analyzing a distance between the touch panel and the non-touch portion;
A direction detecting unit detecting a direction of the touch position;
And a data processor for processing the display data by the touch position, the touch angle, and the touch direction. Detecting a touch position from the touch panel;
Detecting a touch angle by detecting a change in the touched portion and the non-touched portion from the touch panel;
And executing and displaying a function set according to the change of the touch position and angle. The method of claim 8, wherein the touch panel further comprises a proximity sensor configured to sense a distance between a portion touched by the touch panel and a portion not touched. 10. The method of claim 9, wherein the proximity sensor is an infrared sensor. The method of claim 10, wherein the set function is a 3D data display function.
The executing and displaying the set function may include changing and displaying a display position and an angle of the 3D data according to a touch position and a touch angle. The method of claim 11,
And detecting a direction of the touch position.
And executing the displayed function by changing the display position, angle, and direction of the 3D data by changing the touch position, touch angle, and touch direction.

Images