JP6012636B2 - Terminal operation method according to integrated input and portable terminal supporting the same - Google Patents

Description

  The present invention relates to a portable terminal, and more particularly to controlling user functions by integrated input.

  Mobile terminals are used in a wide range of fields mainly because of their flexibility and mobility. In particular, among mobile terminals, mobile communication terminals capable of making voice calls while moving are mobile terminals that are very popular enough to be used by a considerable number of people. Meanwhile, the mobile communication terminal can have various functions other than the function of transferring and receiving call information between speakers. For example, a conventional portable terminal can have an MP3 function corresponding to a file reproduction function, and a video collection function corresponding to a digital camera capable of collecting video. In addition, in the case of a conventional mobile terminal, a function that can execute a mobile game, an arcade game, and the like is supported.

  A touch screen scheme that accepts touch events in a manner similar to a keypad works like a current input signal generator. The user can control the mobile terminal control operation by the mobile terminal using the touch screen and the keypad. However, such an input signal generation method requires a delicate touch and a delicate click operation. That is, in the conventional input signal generation method, if the user cannot accurately press the specific key provided on the specific situation keypad or cannot accurately touch the touch area output on the touch screen, The input signal cannot be generated correctly. Recently, as full-touch screen type portable terminals are widely used, a separate keypad area is not provided. Although this trend supports the generation of input signals by outputting various input keymaps to a full touch screen, the display unit is used for both the input means and output means at the same time. Has occurred. As a result, there is a demand for the development of technology that supports the generation of more diverse input signals.

  An object of the present invention is to support a wider variety of input signal generation methods by enabling integrated operation of touch event signals and sensor signals generated in a mobile terminal. It is an object of the present invention to provide a terminal operation method according to an integrated input that supports user functions so that user functions can be more easily controlled and operated, and a portable terminal that supports the terminal operation method.

  According to an embodiment of the present invention, a mobile terminal that supports operation according to an integrated input may include at least one touch point associated with the touch and a corresponding position in response to a touch determination on the touch panel. The touch panel 143 that generates a touch event including information related to the number (1P1, 1P2), the motion sensor unit 170 that generates a sensor signal according to the operation determination, the touch event when the processor is accessed, and the sensor A signal is received and communicated with a storage that includes code for determining that the sensor signal is received while the touch event is maintained, and the sensor signal is transmitted while the touch event is maintained. If received, based on a combination of at least one or more touch events and sensor events. There was generated an integrated command, a display panel 141 for outputting the operation result of the control unit 160, and the instruction words comprising said processor executing a user function associated with the command.

  According to an embodiment of the present invention, the mobile terminal includes the touch screen 140, the motion sensor unit 170 including at least one sensor, and the number of touch points and position information when a touch event occurs on the touch screen. The touch event collection unit 161 that collects, the sensor signal collection unit 163 that collects information on the form and type of the sensor that generates the sensor signal generated by the sensor unit, and the touch signal after the touch signal is no longer maintained If the sensor signal is received, the associated touch event and the command word respectively distinguished by the sensor signal are generated. If the sensor signal is received while the touch event is maintained, the touch event and the touch event are generated. Generates integrated input commands based on touch sensor signals That includes a command generating unit 165, and a control unit 160 including performing function control unit 167 controls operated by the generated command.

  An operation method of a mobile terminal based on integrated input and a mobile terminal according to an embodiment of the present invention generate a command word for controlling a specific user function requested in various drawings or simple drawings, and the mobile terminal Operate the machine for convenience.

  According to the terminal operation method according to the integrated input according to the embodiment of the present invention and the portable terminal supporting the same, the present invention is for a specific user function control desired by the user by a more diverse method and a simpler method. Therefore, it is supported so that more convenient mobile terminal operation can be performed.

1 is a diagram schematically illustrating a configuration of a mobile terminal according to an embodiment of the present invention. FIG. 3 is a diagram illustrating a configuration of a control unit of a portable terminal according to an embodiment of the present invention in more detail. 7 is a flowchart illustrating a terminal processing process according to an integrated input according to an exemplary embodiment of the present invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 1st Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 2nd Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 3rd Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 4th Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 5th Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 6th Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 7th Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 8th Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 9th Embodiment of this invention. It is a figure which shows an example of the screen interface for the terminal operation according to the integrated input according to 10th Embodiment of this invention.

  Preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. The same reference numbers are generally used throughout the drawings to refer to the same parts. Detailed descriptions of well-known functions and structures may be omitted here to prevent distortion of the inventive subject matter.

  FIG. 1 is a block diagram illustrating a schematic configuration of a mobile terminal according to an embodiment of the present invention.

  Referring to FIG. 1, the portable terminal 100 of the present invention includes a communication (RF) unit 110, an input unit 120, an audio processing unit 130, a motion sensor unit 170, a touch screen 140, a storage unit 150, and a control unit 160. including.

  If a touch occurs on the screen (hereinafter, touchdown event), the mobile terminal 100 of the present invention determines the number of points on the touched screen according to the touchdown event, and the touchdown event is maintained. In addition, the sensor signal of the motion sensor unit 170 generated in a state of being detected is integratedly recognized, a corresponding command word is generated, and the function execution is controlled. Accordingly, the mobile terminal 100 may support the specific user function based on the command words distinguished from each other for the composite input signals collected in an integrated manner. Accordingly, since the mobile terminal 100 can support unique command word generation even in various user function operation situations, the user can perform easier operation control based on the mobile terminal 100. Support as you can. Hereinafter, the role and function of each component of the mobile terminal 100 for the operation of the integrated input infrastructure of the present invention will be described in more detail.

  The communication (RF) unit 110 supports data transmission and reception related to voice signals and data communication related to the call function under the control of the control unit 160. The communication unit 110 includes a radio frequency transmission unit (not shown) that performs up-conversion and amplification of the frequency of a signal to be transmitted, and a radio frequency reception unit that performs low-noise amplification and down-conversion of the received signal (see FIG. (Not shown). In particular, the communication (RF) unit 110 of the present invention can be activated or deactivated in a specific situation by a composite input signal collected by the touch panel 143 and the motion sensor unit 170. For example, when a single point touchdown event occurs by performing a “shaking” operation while performing a touchdown on a single point, the communication (RF) unit 110 may detect a “swing” signal. And a preset function in response to the combination of the single point touchdown event. For example, an automatic communication connection function with another mobile terminal having a specific telephone number can be performed in response to a combination of a swing and a touchdown event. At this time, the communication (RF) unit 110 can perform different user functions according to command words generated by being distinguished according to the number of touch points and the type of sensor signal. For example, image call connection with a specific other portable terminal, automatic connection of a web page having a designated web address, and the like may be performed based on a touchdown event and a type of a sensed sensor signal.

  The input unit 120 is configured to support generation of various input signals related to the control of the mobile terminal 100. The input unit 120 includes a number of input keys and function keys for receiving various numbers or character information and setting various functions. The function keys may include direction keys, side keys, and shortcut keys set to perform a specific function. When the mobile terminal 100 is provided as a full touch type input unit, the input unit 120 is formed only by side keys, and functions for inputting numbers and characters are configured by a key map. Output above and can be configured. The input unit 120 controls the input signal for controlling to activate or deactivate the integrated input mode according to the number of touch points of the touchdown event according to the embodiment of the present invention and the type and form of the sensor signal. Can be generated by The input unit 120 can transmit the generated input signal to the control unit 160. The input unit can be recognized as a selective feature of the apparatus shown in FIG.

  The audio processing unit 130 includes a speaker (SPK) for reproducing audio data transmitted and received during the call and a microphone (MIC) for collecting user's voice or other audio signals during the call. In particular, the audio processing unit 130 can support the motion sensor unit 170 and the guidance message output indicating the “integrated-input” mode state according to the touch panel 143. (For example, “enter into integration-input mode”, “cancel integration-input mode”). In addition, the audio processing unit 130 can support the output of a guidance sound or a sound effect corresponding to execution of a specific command generated by the integrated input in the integrated input mode state. The guidance sound or sound effect according to the integrated input of the audio processing unit 130 described above may be omitted by user control.

  The touch screen 140 outputs a screen activated by a function of the mobile terminal and supports a function of collecting a touch event activated by the control of the control unit 160. For this, the touch screen 140 may include a display panel 141 and a touch panel 143.

  The display panel 141 can output a booting screen, a standby screen, a menu screen, a call screen, and the like. As such a display panel 141, a thin-film transistor-based flat panel display technology such as OLED (Organic Light Emitting Diode) or LCD (Liquid Crystal Display) can be applied. When the LCD is applied, the display panel 141 is , An LCD controller, a memory capable of storing data, an LCD display element, and the like. In particular, the display panel 141 according to the present invention displays various screen outputs or changes in the form of screens that have already been output depending on the operation of user functions performed based on a command word (“integration-input”) generated by integrated input. Can be supported. The change in the screen output by the display panel 141 will be described in more detail together with the description of an embodiment described later.

  The touch panel 143 is configured to generate a touch event according to a touch provided on the upper or lower portion of the display panel 141. Such a touch panel 143 can be configured using different types of technology. For example, it can be configured by a resistance film method, a capacitance method, or a mixed method of a resistance film and a capacitance. In particular, the touch panel 143 may generate a touchdown event for each of at least one or more touch points, and provide the control unit 160 with position information and touch state information of the generated touch points. The touch panel 143 can operate independently of the motion sensor unit 170. Accordingly, the touch panel 143 can generate a touch event (for example, a touch-down event) according to the user's touch even while the motion sensor unit 170 generates a specific type of sensor signal. In particular, the touch panel 143 can detect a change in the touch state by scanning the touch state in units of a certain period, and can detect a change in the number of points where the touch-down event is canceled or a point where the touch-down occurs. The touch events collected by the touch panel 143 can be transmitted to the control unit 160.

  The storage unit 150 includes application programs necessary for the operation of the touch panel 143, application programs for the operation of each sensor module of the motion sensor unit 170, as well as application programs necessary for the functional operation according to the embodiment of the present invention. Store. The storage unit 150 includes a buffer 151 that temporarily stores a touch event generated from the touch panel 143 and a sensor signal input from the motion sensor unit 170, and uses the buffer 151 to store at least one of the touch event and the sensor signal. Can be supported to buffer. The storage unit 150 may include a program area (not shown) and a data area (not shown).

  The program area relates to an operating system (OS) for booting the mobile terminal 100, an application program for operating a sensor unit included in the motion input device, and other functions of the mobile terminal 100. Stores application programs. For example, the program area may include application programs such as a sound reproduction function, an image and / or a moving picture reproduction function. In particular, the program area of the present invention can store an integrated input support program. The “integrated-input” support program is distinguished from each other by a routine for operating each sensor included in the motion sensor unit 170, a routine for operating the touch panel 143, a collected touch event, and a sensor signal ( A routine for generating “integrated input”) command words and a control routine for controlling the activation of user functions corresponding to the generated command words or the operation of user functions that have been pre-activated. The integrated input support program can be loaded into the controller 160 by selecting the integrated input mode of the mobile terminal 100.

  The data area is an area where data generated by using the mobile terminal 100 is stored, and user data related to various function options provided by the mobile terminal 100 can be stored. For example, the data can collect and store work such as video, phonebook data, audio data, and information corresponding to the corresponding content or user data. In particular, the data area of the present invention can store an instruction word table that supports generation of an instruction word corresponding to an integrated input (“integration-input”). The command table may include commands that are distinguished according to the number of touch points and the types of sensor signals of the touchdown event, and the number of touch points, the types of sensor signals, and the currently activated command table. It is possible to include instruction words that are distinguished by the type of application program. Such an instruction word table can be referred to by the corresponding “integrated input” support program if the “integrated-input” support program is loaded into the control unit 160.

  The motion sensor unit 170 includes various sensors. For example, the motion sensor unit 170 includes at least one motion sensor, a speed sensor, an acceleration sensor, a gyro sensor, a pressure sensor, and a vibration sensor. Such various sensors operate based on the power supplied by the control unit 160 and generate corresponding sensor signals according to the movement of the mobile terminal 100 or the pressure transmitted to the mobile terminal 100. The motion sensor unit 170 can transmit a sensor signal generated by a corresponding sensor to the control unit 160. In addition, the motion sensor unit 170 of the present invention may include additional sensors such as a geomagnetic sensor, an optical sensor, and a photo sensor.

  The controller 160 controls the power supply of the mobile terminal 100, the activation of each device, and the flow of signals transmitted and received between the devices. In particular, the controller 160 of the present invention controls the power supply of the motion sensor unit 170 and the touch panel 143 according to the “integrated-input” mode selection request, and the number of touch points of touch events collected by the touch panel 143 and the motion sensor unit 170. Can generate an “integrated-input” command based on the sensor signal generated by The control unit 160 supports the user function of the mobile terminal 100 by using the generated “integrated-input” command. For this, the controller 160 of the present invention may include a configuration as illustrated in FIG.

  FIG. 2 is a diagram illustrating the configuration of the controller 160 in more detail in the configuration of the mobile terminal 100 according to the present invention.

  Referring to FIG. 2, the control unit 160 of the present invention may include a touch event collection unit 161, a sensor signal collection unit 163, a command word generation unit 165, and a function control unit 167.

  The touch event collection unit 161 is configured to collect touch events that occur on the touch panel 143. In particular, the touch event collection unit 161 can collect information on the number of touch points of a touchdown event that occurs on the touch panel 143, and can transmit the collected information to the command word generation unit 165. In addition, the touch event collection unit 161 can collect position information on the touch area of the touchdown event that occurs on the touch panel 143, and can transmit the position information together with information on the number of touch points to the command word generation unit 165.

  The sensor signal collection unit 163 collects various sensor signals generated from the motion sensor unit 170 according to the operation state of the mobile terminal 100. For this reason, the sensor signal collection unit 163 can monitor various sensors included in the motion sensor unit 170 to check what sensor signals are generated. Accordingly, the sensor signal collection unit 163 can transmit information on the type of sensor that generated the signal and the sensor signal value transmitted from the corresponding sensor to the command word generation unit 165. For example, among the sensors included in the motion sensor unit 170, when the acceleration sensor is disposed inside the case of the mobile terminal 100, the sensor signal collection unit 163 may “swing” or “snap” the mobile terminal 100. It is possible to detect a signal generated by. Here, the sensor signal collection unit 163 can distinguish the swing operation and the snap operation through a change in frequency generated by the movement of the mobile terminal. That is, the sensor signal collection unit 163 classifies the amplitude variation curve of the frequency generated by the movement of the mobile terminal 100 as slow (continuous), and divides it into “swing” when many occur. If the frequency amplitude change curve is sharp and occurs once, it can be classified as a “snap” operation. The sensor signal collection unit 163 may detect a sensor signal corresponding to a change in direction such as the tilt of the mobile terminal 100 using a gyro sensor included in the motion sensor unit 170. In addition, the sensor signal collection unit 163 may monitor a vibration sensor of the motion sensor unit 170 to detect a signal corresponding to the shaking of the mobile terminal 100 or vibration generated in the mobile terminal 100 due to an external impact. it can. The sensor signal collecting unit 163 may detect a sensor signal generated by pressure applied to the case of the mobile terminal 100 from the outside using the pressure sensor of the motion sensor unit 170. The sensor signal collection unit 163 can transmit a sensor signal collected from at least one of the sensors as described above to the command word generation unit 165.

  The command word generation unit 165 is configured to generate command words corresponding to signals collected by the touch event collection unit 161 and the sensor signal collection unit 163 and to transmit the generated command words to the function control unit 167. The command generation unit 165 controls to temporarily store the collected touchdown event in the buffer 151 when the touchdown event is collected from the touch event collection unit 161 by the “integrated-input” mode setting. be able to. Then, the command generation unit 165 can check whether the sensor signal is transmitted from the sensor signal collection unit 163 while the touchdown event is maintained. If a sensor signal is received while the touchdown event is maintained, the command generator 165 may perform “integrated input” corresponding to the type and form of the sensor signal corresponding to the number of touch points of the touchdown event. Generate an instruction word. The type and form of the sensor signal corresponding to the number of touch points of the touchdown event can be transmitted to the function control unit 167. That is, the command generation unit 165 can generate an “integration-input” command corresponding to the integrated input corresponding to the touchdown event and the sensor signal. For this purpose, the command word generation unit 165 refers to the command word table stored in the storage unit 150, and selects a command word preset in correspondence with the command word table provided with the “integrated-input” command word. It can be controlled to generate and transmit. Further, the command word generation unit 165 generates “integrated-input” command words not only according to the number of touch points of the touchdown event and the type and form of the sensor signal, but also according to the type of the currently activated user function. Can be supported to do.

  However, the command generation unit 165 generates a command corresponding to the collected touchdown event when no additional sensor signal is transmitted for the preset time while the touchdown event is maintained. This can be transmitted to the function control unit 167. In addition, if another touch event, for example, a touch drag event or a touch release event is collected before separate sensor signal transmission occurs, the command generator 165 may collect the touch down event and the touch drag event collected before. The command word corresponding to the touch release event can be generated, and the command word can be sensed and / or transmitted to the function control unit 167. Accordingly, the command generation unit 165 does not receive the touchdown event and the sensor signal substantially simultaneously in the “integrated-input” mode, that is, collects only the touch event, or collects only the sensor signal. , A “single” command word corresponding to each signal can be generated and transmitted to the function control unit 167.

  However, if the “integrated-input” mode is not set, the command generation unit 165 generates individual command corresponding to each signal even if the touch event and the sensor signal are received substantially simultaneously. The generated command word can be transmitted to the function control unit 167 to support the operation of the specific user function corresponding to each individual command word.

  The function control unit 167 (for example, a processor) can control the operation of the user function corresponding to the command word transmitted by the command word generation unit 165. The function control unit 167 activates a corresponding user function using an “integrated-input” command generated by the command generating unit 165 so as to be distinguished according to various environments of the mobile terminal 100. It is possible to control or control the operation of user functions that are already activated. An embodiment of a user function activated or operated by the function control unit 167 will be described in detail with reference to the drawings described later.

  As described above, the mobile terminal 100 according to the embodiment of the present invention is distinguished according to the number of touch points of the touchdown event and the type and form of the sensor signal depending on whether or not the “integrated-input” mode is set. More complex, by generating the “integrated-input” command word to be generated and controlling the activation of the user function or the operation of the activated user function based on the generated command word, and It can support the operation of simple user functions. In particular, when such an “integrated-input” support function is applied to move to a screen that is often used by the user when operating the mobile terminal 100, or to return to a specific user function, it is easier to carry the mobile phone. The operation of the terminal 100 can be supported.

  FIG. 3 is a flowchart illustrating a terminal operation method according to an integrated input according to an embodiment of the present invention.

  Referring to FIG. 3, in the terminal operation method according to the integrated input of the present invention, when power is supplied to the mobile terminal 100, the control unit 160 of the mobile terminal 100 distributes the supplied power to the mobile terminal. When each configuration of 100 is initialized and the initialization process is completed, it can be supported to activate a specific user function. Here, the user function can be a standby screen output function, a menu screen output function, a web connection function, or the like set by the schedule information, and corresponds to an input signal input from the input unit 120 by user control. Thus, the user function can be activated. Accordingly, the control unit 160 can control to output a screen according to the set function execution to the display panel 141 as in step 301.

  Next, in step 303, the control unit 160 can check whether a touchdown event occurs. Therefore, the control unit 160 can control the touch panel 143 to be activated, and can scan the touch panel 143 for a certain period or interval to check whether a touchdown event occurs. If a separate touchdown event does not occur at this step, the controller 160 may perform control before branching to step 301 to repeat the following process. However, when an input signal for terminating the mobile terminal 100 is generated, the controller 160 may perform control so as to terminate the operation of the terminal.

  If a touchdown event occurs in step 303, the control unit 160 can branch to step 305 and check whether a sensor signal is generated. If no separate sensor signal is generated in step 305, the controller 160 may branch to step 307 and control the function execution according to the touch event. That is, the control unit 160 generates an individual command word according to the touch event, and applies the generated command word to the currently activated user function or operates the corresponding user function. Can do.

  On the other hand, if it is determined in step 305 that a sensor signal is generated, the sensor signal is actually generated during a preset time after sensing the touchdown event or while the touchdown event is maintained. In the case (for example, when the touch-release event has not been detected yet), the controller 160 branches to step 309 to determine the number of touch points and the type of sensor signal while the touch-down event is detected. Can be carried out. For this, the control unit 160 collects the number of touch points and the position information of the touch-down event maintained by scanning the touch panel 143. Then, the control unit 160 can recognize the type and form of the sensor signal and check what sensor signal is generated.

  Thereafter, the controller 160 branches to step 311 to control to generate a command word according to the number of touch points and the type of sensor signal, and to control the function execution according to the corresponding command word generated at step 313. . At this time, the control unit 160 controls to operate the “integrated-input” command word according to the integrated input corresponding to the currently activated user function, or to activate a new user function. Can do. Such user function operation will be described in more detail in an embodiment described later.

  Next, the control unit 160 can branch to step 315 to check whether a touch release event occurs (for example, the touchdown event is removed from the touch panel). If a separate touch release event is not detected, the controller 160 may perform a branch before step 303 to perform the following process repeatedly.

  However, if a touch release event occurs in step 315, the control unit 160 branches to step 317 to check whether there is an input signal for termination of the terminal, and a separate input signal. If it is not detected, control may be performed so as to branch before step 301 and repeat the following process.

  However, if an input signal (or integrated-input mode) for ending the operation of the mobile terminal 100 is detected in step 317, the controller 160 may operate to end the operation of the mobile terminal 100 ( Alternatively, the integration-input mode) is controlled.

  Meanwhile, the terminal operation method according to the above-described integrated input can be performed in a state where the “integrated-input” mode is activated, and if the “integrated-input” mode is not set, the controller 160 performs step 309. The generation of a separate command according to the touch event and the sensor signal and the function execution according to the touch event and the sensor signal can be controlled without performing the above process.

  As described above, the terminal operation method based on the integrated input base of the mobile terminal according to the embodiment of the present invention is distinguished according to the number of touch points maintained on the touch panel 143 and the type and form of the sensor signal. An “integrated-input” command can be generated and controlled to perform a function based on the generated command. In this case, the terminal operation method according to the present invention can distinguish the generated command word according to the type of the currently activated user function and can support the user function operation according to the corresponding command word. .

  The mobile terminal supporting the “integrated-input” mode and the operation method of the terminal according to the embodiment of the present invention have been described above. Hereinafter, various embodiments for terminal operation based on the integrated input mode of the present invention will be described.

  FIG. 4 is a diagram illustrating an example of a screen interface for terminal operation according to the integrated input according to the first embodiment of the present invention. In the following description, the 41, 43, and 45 screen areas may correspond to virtual layout screen areas instead of actual screen areas.

  Referring to FIG. 4, the user of the mobile terminal 100 may generate an input signal for activating a message or memo creation function through the terminal control using the input unit 120. At this time, the mobile terminal 100 can provide a computer function, a file playback function, and a calendar function in an already activated state according to a user request, thereby supporting the multitasking function. To come.

  For example, the portable terminal 100 can support the display panel 141 to output a screen corresponding to the calendar function, such as 43 screens of 401 screens, in response to a calendar function activation request. Meanwhile, the user can generate an input signal for activating the message or memo creation function by operating the input unit 120 or the touch panel 143. Then, the mobile terminal 100 can control to output a screen corresponding to the corresponding message or memo function to the display panel 141 as illustrated in the 401 screen. At this time, the mobile terminal 100 can control the 43 screens corresponding to the calendar function that has been activated before, by the background processing based on the multitasking function.

  On the other hand, the control unit 160 can control activation of the touch panel for character input in a state where a screen corresponding to the message creation or memo creation function is output on the display panel 141 as in the 401 screen. At this time, as shown in the figure, the user can generate a touchdown event having one touch point (1P) on one side of the display panel 141, for example, on the side of the area where the input characters are output. Then, the mobile terminal 100 can change the type of the selected user function by the integrated input that will be input later. For example, when the user performs tilting of the mobile terminal 100 in a certain direction, for example, rightward, with a touchdown event having one touch point (1P), the motion sensor unit 170 of the mobile terminal 100 supports tilting operation. Sensor signals to be collected.

  Then, if the right tilt sensor signal is collected while the touchdown event having one touch point (1P) is maintained, the mobile terminal 100 displays the 43 screens corresponding to the calendar function like the 403 screen. It is possible to control the output to 141. Alternatively, 41 screens corresponding to the computer function can be output to the display panel 141 according to the tilt direction, that is, when the touchdown event having one touch point (1P) signal and the generation of the left tilt sensor signal are generated. When a touchdown event having one touch point (1P) signal and a downward tilt sensor signal are generated, 45 screens corresponding to the file playback function can be output to the display panel 141.

  Meanwhile, if a touchdown event having one touch point (1P) on the 401 screen occurs in the character output area or the like, the mobile terminal 100 can select according to the tilting direction to support the “integrated-input” mode. It can be controlled to output icons (51, 53, 55) that can identify other user functions to one side of the display panel 141. Here, other user functions are pre-activated by the multitasking function, but can be unselected user functions. Accordingly, the number and form of the icons (51, 53, 55) can be changed according to the number and type of other user functions performed by the multitasking function. For example, when the file playback function is not performed, the icon 55 may not be output to the display panel 141 even if a touch event including one touch point (1P) occurs. On the other hand, when four user functions are activated by the multitasking function except for the user functions currently output to the display panel 141, the screen is switched to the corresponding user function by tilting upward or lifting. The icon corresponding to the upward tilt direction can be output on the display panel 141 when a touchdown event having one touch point (1P) is output. The icons indicating the multitasking-based user functions can be output to a certain area of the display panel 141 on the sensor signal generation direction side.

  In the above screen switching, when the screen corresponding to the message or memo creation function is switched to the 43 screen, the screen corresponding to the message or memo creation function is virtually arranged in the 41 screen area, and the computer function is displayed in the 43 screen area. The screen can be placed virtually. This allows the user to perform a touchdown event and a left tilt that is opposite to the right tilt previously performed for the return to previous screen function.

  FIG. 5 is a diagram illustrating an example of a screen interface for terminal operation according to an integrated input according to the second embodiment of the present invention.

  Referring to FIG. 5, the mobile terminal 100 of the present invention can output a screen on which at least one specific menu icon or widget icon is output, such as a 501 screen, to the display panel 141 by user control. In addition, the mobile terminal 100 may support switching to another menu page or a widget page by user control, in particular, by generating a left sweep or right sweep event on the touch panel 143.

  In particular, in the mobile terminal 100 of the present invention, a sensor signal corresponding to a swing is generated in a state in which a touch down event occurs at the first touch point (1P1) and a command corresponding to the first touch is generated as in the 501 screen. When collected, it is possible to control screen movement to the first first menu page among a large number of menu pages such as 503 screens. Such a screen movement to the first menu page can be performed regardless of the number of menu pages. That is, if the touchdown event and the swing sensor signal of the first touch point (1P1) are collected while the 2-9 menu pages are output to the display panel 141, the controller 160 of the mobile terminal 100 may collect the first menu page. Can be controlled to be output to the display panel 141.

  Meanwhile, when the mobile terminal 100 collects a sensor signal corresponding to a swing in a state where a touchdown event occurs at the second touch point (1P2) on the 501 screen and a command corresponding to the second touch is generated, It is possible to control screen movement to the last page (for example, the ninth menu page) of a large number of menu pages like a 505 screen. Such screen movement to the last menu page can be performed if the above-described second touch and generation of the swing sensor signal are generated in a state where 1 to 8 menu pages are displayed regardless of the number of menu pages.

  The first touch point (1P1) and the second touch point (1P2) may be any points on the display panel 141, and the controller 160 may recognize the user's area and corresponding input. Based on the center line of the display panel 141, the left area can be easily assigned to the area for generating the first touch, and the right area can be easily assigned to the area for generating the second touch.

  As described above, the mobile terminal 100 according to the present invention performs control so that a specific user function, for example, a page view function, can easily move to the first page or move to the last page by an integrated input signal. can do.

  FIG. 6 is a diagram illustrating an example of a screen interface for terminal operation according to the integrated input according to the third embodiment of the present invention. The integrated input mode is set by a user setting or a basic mode, or activated by a specific program.

  Referring to FIG. 6, the mobile terminal 100 according to the present invention can output an e-book screen under user control. Therefore, the user can control generation of an input signal for the mobile terminal 100 to select e-book content. If the user generates an input signal for activating the e-book content, the control unit 160 of the mobile terminal 100 activates the corresponding e-book content and displays a specific page corresponding to the e-book content activation. It can be controlled to output to the display panel 141.

  On the other hand, in the e-book content playback function, the control unit 160 displays a touchdown event in which the user has one touch point (1P) in a state where a specific page is output on the display panel 141. As shown in the figure, various auxiliary icons (31, 33, 35, 37) that support the page turning function can be controlled to be output to a specific area of the display panel 141. For example, the control unit 160 displays the previous page selection icon 31 in the left center portion of the display panel 141, the next page selection icon 33 in the right center portion of the display panel 141, and the upper center portion of the display panel 141. It is possible to support the icon 35 for supporting the next turning by two pages at a time, and the icon 37 for supporting the previous turning by two pages at the lower center of the display panel 141.

  As a result, the user generates an icon (31, 33, 35, 37) output on the display panel 141 after generating a touchdown event having one touch point (1P) in a specific area of the display panel 141. The mobile terminal 100 may be supported to perform tilting for the page turning operation. That is, the controller 160 can support the page turning control of the e-book content according to the touchdown event corresponding to one touch point (1P) and the tilt direction. For example, if the user controls the portable terminal 100 to generate a touchdown event and a downward tilt sensor signal, the control unit 160 outputs a page corresponding to the previous two pages from the current page to the display panel 141. Can be controlled. Here, when there is no previous page, the control unit 160 can also control to temporarily output a message indicating that the current page is the first or second previous page.

  FIG. 7 is a diagram illustrating an example of a screen interface for terminal operation according to the integrated input according to the fourth embodiment of the present invention.

  Referring to FIG. 7, the mobile terminal 100 according to the present invention can be controlled to output a menu screen to the display panel 141 like a 701 screen according to presetting after user control or initialization. When the user performs an input signal for activating a specific user function (for example, MP3 function) on the menu screen, for example, a menu selection is performed, the mobile terminal 100 supports MP3 function activation as in the 703 screen. The screen to be output can be controlled to be output to the display panel 141. In this process, the mobile terminal 100 may control to play a specific content selected by sensing an input signal or a preset content and output the corresponding audio signal through the audio processing unit 130.

  On the other hand, the user can generate an input signal for activating the user function for the message creation or memo creation function through the multitasking function operation while the MP3 function is performed. Then, the mobile terminal 100 can control to output a user interface for message creation or memo creation function to the display panel 141 as in a screen 705. In this state, when the user desires to return to the first user function screen, that is, the 701 screen corresponding to the menu page, it corresponds to a touchdown event having one touch point (1P) on a specific area of the display panel 141. The swing sensor signal can be controlled to be generated together with the first touch. Then, the mobile terminal 100 can perform screen restoration from the 705 screen to the 701 screen as illustrated. At this time, the control unit 160 of the mobile terminal 100 can support the MP3 function and the message or memo creation function as a multitasking function.

  As described above, the integrated input operation of the present invention is a home screen for switching to a page of a desired specific user function through generation of a specific “integrated-input” signal even if the user operates the specific user function of the mobile terminal 100. Can support the function. Here, in the page switching to the home screen function, the corresponding user function can be adjusted by a user setting. For example, when a swing sensor signal is generated together with a touch event having one touch point (1P), the mobile terminal 100 has a “standby screen” or “menu screen” designated as a home screen, a “lock function screen”, or the like. As described above, the home screen designation screen can be adjusted by user settings. That is, the present invention performs a plurality of user functions based on multitasking, maintains the touchdown event in a state where a screen corresponding to the specific user function is output, and generates a specific sensor signal. It can be controlled to switch to a specific user function screen set according to the position on the touch panel where the down event has occurred and the direction in which the specific sensor signal is generated.

  FIG. 8 is a diagram illustrating an example of a screen interface for terminal operation according to the integrated input according to the fifth embodiment of the present invention.

  Referring to FIG. 8, the mobile terminal 100 according to the present invention can maintain a “Lock State” like a screen 801 by user control or by preset schedule information. Meanwhile, when the mobile terminal 100 receives a call call requesting connection of a call in the “locked state” or receives a message, the user cannot receive the call call or does not confirm the message. In this case, as shown in the screen 801, control is performed so that an icon representing a guidance message for guiding at least one of the unreceived call (Missed Call) and the unread message (Unread Message) is output to the display panel 141 in the locked state. can do. The user can confirm an unreceived call or an unconfirmed message through confirmation on the display panel 141.

  Here, if the user receives an unreceived call icon, a first touch corresponding to a touchdown event having the first touch point (1P1) and a specific sensor signal, for example, a sensor signal corresponding to a swing are generated. In this case, the mobile terminal 100 may control to output to the display panel 141 a screen interface for confirming an unreceived call as in the 803 screen. Then, the user can check the unreceived call list through the 803 screen. On the other hand, after confirming the unreceived call list, the user may enter an “integrated-input” command, for example, in a specific area of the display panel 141 area of the 803 screen for transition to a locked state such as the 801 state. Can be controlled to generate a touchdown event and a specific sensor signal, for example, a swing sensor signal. Then, the controller 160 of the mobile terminal 100 can control the transition from the 803 screen to the 801 screen. At this time, the control unit 160 can output the 801 screen and control to remove the corresponding unreceived call icon from the 801 screen by the process of confirming the unreceived call. In this case, only the “Unread Message” icon area can be output on the 801 screen.

  Meanwhile, on the 801 screen, the user performs the second touch corresponding to the touchdown event having the second touch point (1P2) where the unconfirmed message icon is output and the mobile terminal 100 operation corresponding to the swing sensor signal collection. The control unit 160 can control the display panel 141 to output a screen for outputting an unconfirmed message list such as the 805 screen. After completing the process of confirming the unconfirmed message on the 805 screen, the user can perform generation of a touchdown event and a swing sensor signal as mentioned in the description of the 803 screen for returning to the 801 screen. At this time, the controller 160 of the portable terminal 100 may perform control so as to remove the unconfirmed message icon (Unread Message) from the screen 801 by the unconfirmed message confirmation process.

  On the other hand, the touchdown event is performed on another area excluding the area where the user outputs the third touch point (1P3), that is, the unreceived call icon (Missed Call) and the unconfirmed message icon (Unread Message). When the control unit 160 performs the swing operation, the control unit 160 may perform control so as not to perform a separate operation change.

  Meanwhile, the mobile terminal 100 may generate a specific sensor signal generated after the touchdown event is generated by the user on the touch screen 140, for example, if a sensor signal is generated according to the swinging operation before and after, It can be controlled to release the “lock state”. At this time, the portable terminal 100 can be controlled to output at least one of the unreceived call list and the unconfirmed message list on the display panel together with the unlocked state. That is, the mobile terminal 100 according to the present invention generates not only a touchdown event and a specific swing of the mobile terminal 100 but also a touchdown event having one or two touch points on the touch screen 140 and a predetermined specific sensor signal generation. It is also possible to control the specific user function to be performed along with the touch lock release. In addition, the mobile terminal 100 of the present invention may be controlled to transition to the touch lock state when a touchdown event having one touch point or two touch points and a specific sensor signal are generated in the touch lock release state. .

  FIG. 9 is a view for explaining an example of a screen interface according to terminal operation according to the integrated input according to the sixth embodiment of the present invention.

  Referring to FIG. 9, the portable terminal 100 according to the present invention can support a specific image file to be output on the display panel 141 like a 901 screen by user control. For this purpose, the user can control to generate an input signal for activating the photo file search function or the gallery function.

  On the other hand, in a state where the specific image file is output on the display panel 141, the user touches the touch panel 143 with two touch points (2P1, 2P2) corresponding to a touchdown event and a certain direction, for example, The mobile terminal 100 can be controlled to generate a sensor signal corresponding to the upward tilt. Then, the control unit 160 can perform control so that an image output on the display panel 141 is zoomed out (Zoom Out) as in the case of the 903 screen. In addition, when the sensor signal corresponding to the above-described two touches and the downward tilt is generated, the control unit 160 zooms in the image output on the display panel 141 as in the case of the 905 screen. It can be controlled to output.

  Here, the upper direction may be a direction in which the upper edge of the mobile terminal 100 is tilted outward (away from the user) about the body of the user holding the mobile terminal 100. On the contrary, the downward direction may be a direction in which the upper edge of the mobile terminal 100 is tilted inward (toward the user) around the body of the user holding the mobile terminal 100. Here, the type of sensor signal is described as being tilted upward or downward, but the present invention is not limited to this. That is, the switching function from the 901 screen to the 903 screen is performed when two touches corresponding to a touchdown event having two touch points (2P1, 2P2) and the moving direction of the mobile terminal 100, for example, moving away from the user. The zoom-in function can be controlled so that the zoom-in function is performed during zoom-out and movement toward the user. For example, when the user holds the portable terminal 100 with both hands and pulls the portable terminal 100 toward the body while maintaining the two touch points (2P1, 2P2) in the touch-down state, the control unit 160 enlarges the image. In the case where the image is controlled to be output and pushed out from the body, the control unit 160 can control the image to be reduced and output. On the other hand, the zoom-in and zoom-out functions according to the integrated input of the present invention can be applied not only to an image enlargement and reduction function, but also to an enlargement / reduction function for a subject at the time of taking a picture.

  FIG. 10 is a view illustrating an example of a screen interface for terminal operation according to integrated input according to the seventh embodiment of the present invention.

  Referring to FIG. 10, the mobile terminal 100 according to the present invention can output a phone book menu to the display panel 141 like a screen 1001 by user control. For this reason, the user can select an item that can be selected from the phone book menu among the menu items. On the other hand, while the telephone directory menu is output on the display panel 141, the user generates a second touch corresponding to a touchdown event having two touch points (2P1, 2P2) in a certain area of the display panel 141. The mobile terminal 100 can be controlled to generate a specific sensor signal, for example, a tilt sensor signal corresponding to an upward tilt. Then, the control unit 160 can control to output a menu screen corresponding to the upper item of the corresponding phone book menu, such as a 1003 screen. In addition, the user generates a second touch corresponding to a touchdown event having two touch points (2P1, 2P2) in a certain area of the display panel 141, and a specific sensor signal, for example, a tilt corresponding to a downward tilt. The mobile terminal 100 can be controlled to generate a sensor signal. Then, the control unit 160 outputs to the display panel 141 a specific item selected from the corresponding phone book menu, for example, a “search by search term” screen corresponding to a detailed item of the “phone number search” item, as in the screen 1005. Can be controlled.

  As described above, the terminal operation based on the “integrated-input” command according to the embodiment of the present invention generates a specific sensor signal while maintaining a touchdown event having two touch points (2P1, 2P2). In this case, the movement of the upper category or the movement of the lower category can be supported quickly depending on the type or form of the sensor signal.

  FIG. 11 is a diagram illustrating an example of a screen interface for integrated input-based terminal operation according to the eighth embodiment of the present invention.

  Referring to FIG. 11, the mobile terminal 100 according to the present invention may be controlled to output an image file to the display panel 141 by user control. Therefore, the user can control generation of an input signal for reproducing a specific image stored in the storage unit 150, such as a photo file or a moving image file. Then, the mobile terminal 100 controls to reproduce the file selected by the user and output the corresponding photographic image or moving image on the display panel 141 as in the screen 1101.

  On the other hand, the user generates a second touch corresponding to a touchdown event including two touch points (2P1, 2P2) on the display panel 141 in a state where the image is output to the display panel 141 as in the case of the 1101 screen. In addition, a specific sensor signal, for example, an operation of tilting the portable terminal 100 upward or downward can be performed. Then, the mobile terminal 100 can control to capture or enlarge a certain area (SP) of the display panel 141 on the basis of two touch points (2P1, 2P2) as shown in the screen 1103. Here, the fixed region (SP) by two touch points (2P1, 2P2) connects the virtual left and right axes around the two touch points (2P1, 2P2), and is within the closed curve generated by connecting the corresponding axes. Can become an area.

  Meanwhile, in the above description, the sensor signal is described as a signal corresponding to the operation of tilting the portable terminal 100 in a certain direction, but the present invention is not limited to this. That is, the user can control to generate a swing sensor signal by performing an operation of shaking the mobile terminal 100 with two touches. Here, the swinging motion can include not only a left-right swinging but also a back-and-forth swinging motion.

  FIG. 12 is a diagram illustrating an example of a screen interface for terminal operation according to the integrated input according to the ninth embodiment of the present invention.

  Referring to FIG. 12, the mobile terminal 100 according to the present invention controls a standby screen to be output to the display panel 141 like a 1201 screen according to user control or preset schedule information, or displays a specific image on the display panel. It is possible to control the output to 141.

  Meanwhile, the user may perform an operation for generating an “integrated-input” signal to activate a specific user function on the standby screen or the display panel 141 on which the specific image is output. For example, the user generates a second touch corresponding to a touchdown event including two touch points (2P1, 2P2) in a specific area of the display panel 141 as illustrated, and the mobile terminal is in a state where the touchdown event is maintained. An operation of tilting the machine 100 in a certain direction can be performed. The controller 160 resizes the image output from the 1201 screen or the standby screen to a certain size when a second touch and a tilt sensor signal in a certain direction are actually collected at the same time. It is possible to control to output a specific menu icon to a part of the display panel 141 that is arranged in the center and is generated by adjusting the image or the standby screen size. At this time, the specific menu icon can be output in the direction in which the tilt sensor signal is collected, that is, on the empty area of the upper display panel 141 as illustrated. The additional area where the menu icon is arranged can change the size on the display panel 141 according to the size of the sensor signal, that is, the angle of inclination. That is, when the tilt angle is large, the additional area where the specific menu icon is arranged can be output larger on the display panel 141, and when the tilt angle is small, the arranged additional area can be output small. Further, the number of menu icons output to the corresponding additional area can be changed according to the size of the arranged additional area. That is, when a large additional area is output, a larger number of menu icons can be output in the additional area. In the opposite case, a smaller number of menu icons are allocated in the additional area. Can be output.

  Accordingly, the user can select any one of the menu icons output on the display panel 141 and operate the specific user function. At this time, if a specific user function is selected, the 1203 screen can be replaced with a screen corresponding to the selected user function.

  In the above description, the output direction of the specific menu icon has been described as the margin of the upper display unit. However, the present invention is not limited to this, and the menu icon is displayed on the display unit in the tilt direction or the direction opposite to the tilt direction. Can also be output. On the other hand, the user can cancel the touchdown event in order to select a specific icon among the menu icons output on the display unit. Accordingly, the mobile terminal 100 can support the screen state to be maintained even if the touch is canceled at least at a part of the touchdown event in the 1203 screen state.

  FIG. 13 is a diagram illustrating an example of a screen interface for terminal operation according to an integrated input according to the tenth embodiment of the present invention.

  Referring to FIG. 13, the portable terminal 100 of the present invention controls the standby screen to be output to the display panel according to the user control or the preset schedule information, or displays the preset menu screen such as the 1301 screen. It can be controlled to output to the display panel. For example, the mobile terminal 100 may support the output of a menu screen corresponding to the first page among menu pages including a large number of pages. The first page can be composed of a screen on which a large number of menu items, for example, three menus are arranged.

  In this state, the user of the portable terminal 100 may desire to move a specific menu item, for example, the “3” menu item to another menu page. Then, the user can generate a touchdown event on the touch screen 140 on which the corresponding item, that is, the “3” menu item is output. In particular, the user can operate to generate a long touch type touch event having a touchdown state for a predetermined time or longer on an area where the “3” menu item is output.

  Then, the mobile terminal 100 can control the selected “3” menu item as shown in the screen 1303 so as to be separated on the menu page and layer previously arranged. At this time, the mobile terminal 100 changes the illuminance and the saturation of the menu page on which the “1” and “2” menu items are arranged, and expands the size of the selected “3” menu item to the “3” menu. It can be controlled to visually represent that the item is separated from the menu page on the layer. In this state, the user can operate to maintain the touchdown event persistently.

  On the other hand, the user controls to tilt the mobile terminal 100 in a certain direction, for example, to the right, in a state where the touchdown event is maintained in order to search for a menu page to which the “3” menu item is to be moved. can do. Then, the mobile terminal 100 performs control to perform page turning of the menu page, and at this time, a screen change according to the page turning can be output on the display panel. In this process, the “3” menu item can be continuously output at the position where the touchdown event is maintained. When the user stops the tilting operation at the menu 3 page in an attempt to place the “3” menu item on the menu 3 page, the menu 3 page can be output on the touch screen as in the 1305 screen. Then, the user of the portable terminal 100 can move the “3” menu item by performing a drag operation in a space where the “3” menu item is arranged while maintaining the touch-down state. If a separate movement is unnecessary, the drag operation may not be performed.

  Thereafter, the user of the mobile terminal 100 may operate to generate a touch release event (release) in order to apply the “3” menu item to the menu 3 page. Then, the mobile terminal 100 can arrange the “3” menu item at a fixed position on the third page of the menu as shown in 1307 screen. At this time, the portable terminal 100 can control the size of the “3” menu item to be adjusted similarly to the sizes of the other menu items. In particular, the mobile terminal 100 changes the illuminance and saturation of the menu page on the screen on which the “3” menu item is output for movement, that is, the 1303 and 1305 screens, and the “3” menu item is separated on the layer. If the menu item is arranged so that the “3” menu item belongs to the moved menu page, the selected “3” menu item can be displayed on the same layer. It can be displayed to indicate that it is arranged together with other menu items.

  As described above, the portable terminal 100 according to the present invention can perform the operation more easily through the touchdown event and the tilting operation when the menu item is moved to another page. In the above description, the “3” menu item on the screen 1303 can be moved to another area of the same menu page when a user drag event occurs. In the above description, the menu page is described as an example. However, the menu item can be a widget item or an item for operating a specific user function.

  On the other hand, in the above description, the configuration output by the integrated input on the empty area of the display unit has been described as the menu icon, but the present invention is not limited to this. That is, the item output by the integrated input on the margin of the display unit can be a user function item according to the multitasking function currently performed in the mobile terminal 100. Accordingly, an icon output on an empty area of the display unit can be an icon corresponding to a user function item according to the multitasking function, and as a result, depending on the type and number of user functions being performed. The number and type of icons output on the display margin can be changed.

  As described above, in the terminal operation according to the integrated input of the present invention, when a touchdown event including two touch points (2P1 and 2P2) occurs, the image is output on the display panel 141 as a primary screen conversion. It is possible to support an icon output function, which is an additional function, by performing a size adjustment of the touch panel and a continuous input of a touchdown event and a sensor signal.

  As described above, the operation of the mobile terminal according to the integrated input according to the embodiment of the present invention and the mobile terminal that supports the same are distinguished according to the number of touch points of the touchdown event and the type and form of the sensor signal. It is possible to support the generation of “integrated-input” command words, and to support each user function operation by the distinguished command words. In addition, the present invention generates a command word that is distinguished according to the type of user function that is currently activated as the same touchdown event and sensor signal, thereby generating a faster input signal and a convenient input signal. Generation can be supported.

  The mobile terminal 100 described above includes a short-range communication module for short-range communication, a camera module for shooting a stop video / moving video of a subject as described above, and a wired communication system for the mobile terminal 100 as described above. Or, it is not mentioned above, such as an interface for data transmission / reception by a wireless communication system, an Internet communication module that performs an Internet function by communicating with an Internet network, and a digital broadcast module that performs a digital broadcast receiving and reproducing function. A configuration can also be included. All such components vary greatly depending on the convergence trend of the digital equipment, so it is not necessary to list them all in order to explain the operation of the claims of the invention, but the configurations mentioned above A component equivalent to the element can be further included in the device. Of course, the mobile terminal 100 according to the present invention may have a specific configuration excluded from the configuration described above, or may be replaced with another configuration depending on the form of provision. This should be readily understood by those having ordinary knowledge in the art.

  Also, the mobile terminal 100 according to the embodiment of the present invention is an apparatus including various sensors, and all mobile communication terminals (operating based on communication protocols corresponding to various communication systems) ( mobile communication terminals), PMP (Portable Multimedia Player), digital broadcasting player, PDA (Personal Digital Assistant), music player (for example, MP3 player), portable game terminal, smartphone, notebook (notebook), and handheld It can include all information communication devices such as PCs, multimedia devices and application devices therefor.

  The above method according to the present invention is hardware, firmware, or software or computer code stored in a recording medium such as a CD ROM, RAM, floppy disk, hard disk, or magneto-optical disk, It can be installed in computer code downloaded over a network stored in a remote recording device or non-transitory machine reader, and the method described here can be programmed such as ASIC or FPGA or dedicated The corresponding software stored on the recording medium can be rendered using hardware, a special processor, or a general-purpose computer. As can be appreciated from the prior art, a computer, processor, microprocessor controller, or programmable hardware is connected to and executed by a computer, processor or hardware such as RAM, ROM, Flash, etc., as described herein. A memory component that stores or receives software or computer code embodying the processed method. Also, if a general purpose computer connects to code to implement the process here, the execution of the code should be recognized by the special purpose computer to perform the process here.

  Although the present invention has been described using several preferred embodiments, these embodiments are illustrative and not limiting. As described above, a person who has ordinary knowledge in the technical field to which the present invention pertains can make various changes and changes according to the doctrine without departing from the spirit of the present invention and the scope of rights presented in the appended claims. It should be understood that modifications can be made.

DESCRIPTION OF SYMBOLS 100 Portable terminal device 110 Communication part 120 Input part 130 Audio processing part 140 Touch screen 141 Display panel 143 Touch panel 150 Storage part 151 Buffer 160 Control part 161 Touch event collection part 163 Sensor signal collection part 165 Command word generation part 167 Function control part 170 Motion sensor section

Claims (15)

A touch panel 143 that generates a touch event including information related to at least one touch point related to the touch and a corresponding position in response to a determination of a touch on the touch panel;
A motion sensor unit 170 for generating a sensor signal according to the determination of the operation;
A storage unit that includes code for receiving the touch event when the processor is accessed, receiving the sensor signal, and determining that the sensor signal is received while the touch event is maintained; If the sensor signal is received while communicating and the touch event is maintained, an integrated command is generated based on a combination of the at least one touch event and the sensor event, and is associated with the command A control unit 160 including the processor for executing a user function performed;
And a display panel 141 to output the operational result of the instruction word, only including,
If the sensor signal is received while the touch event is maintained, the user function to be executed is a change from the first menu page to the second menu page, and the maintenance of the touch event after the change is released. When this is done, the portable terminal supporting the operation according to the integrated input, wherein the menu item of the touch point on the first menu page and the second menu page are displayed in an integrated manner .   The portable terminal supporting operation according to the integrated input according to claim 1, wherein the integrated command word is based on a currently activated user function.   The motion sensor unit 170 may be at least one of a speed sensor, a motion sensor, an acceleration sensor, a gyro sensor, a pressure sensor, a vibration sensor, a geomagnetic sensor, an optical sensor, and a photo sensor. A portable terminal that supports operations according to the integrated input according to Item 1. If the sensor signal is received after the touch signal is no longer maintained, further comprising executing each user function associated with at least one of the received touch event and the received sensor signal. The portable terminal which supports the operation | movement according to the integrated input of Claim 1 characterized by the above-mentioned. The touch event is maintained until a touch release event is detected,
The touch panel 143 includes a position where at least one touch event is detected,
The mobile terminal according to claim 1, wherein the number of positions on the touch panel corresponding to the at least one touch event varies according to a related user function. Characterized in that it is pre-set based on the position related user functionality on the touch panel, a portable terminal supporting a operation according integration input of claim 1. A touch screen 140;
A motion sensor unit 170 including at least one sensor;
A touch event collecting unit 161 that collects the number and position information of touch points when a touch event occurs on the touch screen;
A sensor signal collecting unit 163 that collects information on a sensor type and a sensor type that generates a sensor signal generated by the sensor unit;
If the sensor signal is received after the touch signal is no longer maintained, the associated touch event and a command word respectively distinguished by the sensor signal are generated, and the sensor signal is maintained while the touch event is maintained. Is received, a command word generation unit 165 that generates an integrated input command word based on the touch event and the sensor signal ;
And a control unit 160 including performing function control unit 167 controls operated by the generated command, only including,
If the sensor signal is received while the touch event is maintained, a change from the first menu page to the second menu page is performed, and when the maintenance of the touch event is released after the change, A portable terminal that displays the menu item of the touch point on the first menu page and the second menu page in an integrated manner .   The mobile terminal of claim 7, wherein the touch event is maintained until a touch release event is detected.   The mobile terminal of claim 7, wherein the integrated input command is further based on a currently activated user function.   The mobile terminal according to claim 7, wherein the display panel 141 represents a result of control operation according to the generated command. A method that can be operated by the control unit,
Receiving a touch event including information on one or more touch points and a corresponding position of each touch point from the touch panel; receiving the sensor signal including information on a type and form of a sensor generating a sensor signal from the sensor unit; While the touch event is maintained, an operation for determining whether the sensor signal is received and causing the control unit to occur,
If the sensor signal is received while the touch event is maintained, an operation for generating an integrated command based on at least a combination of the touch event and the sensor event , a user function associated with the integrated command is executed. Operation and
Look including the, and the operation to output the operational result of the integrated command,
If the sensor signal is received while the touch event is maintained, the user function to be executed is a change from the first menu page to the second menu page, and the maintenance of the touch event after the change is released. If so, the menu item of the touch point on the first menu page and the second menu page are displayed in an integrated manner.   The method of claim 11, wherein the integrated command word is further based on a currently activated user function.   12. The sensor unit according to claim 11, wherein the sensor unit is at least one of a speed sensor, a motion sensor, an acceleration sensor, a gyro sensor, a pressure sensor, a vibration sensor, a geomagnetic sensor, an optical sensor, and a photo sensor. The method described in 1.   If the sensor signal is received after the touch signal is no longer maintained, the method further comprises performing each user function associated with at least one of the received touch events and the constantly received sensor signal. The method according to claim 11, wherein: The touch event is maintained until a touch release event is sensed, and the touch panel includes a location where at least one touch event is sensed;
The at least one position on the touch panel corresponding to a touch event varies according to a related user function,
The method according to claim 11, wherein the position on the touch screen is preset based on the related user function.

Images