KR101720498B1 - Mobile terminal and operation control method thereof - Google Patents

Abstract

The present invention relates to a portable terminal and a method for controlling the operation thereof. An operation control method of the present portable terminal displays an operation screen on a display unit and sets an Apple board area where an execution screen of a specific application can be displayed in one area of the operation screen. When detecting the preset gesture input through the Apple board area, the application corresponding to the preset gesture input is executed, and the execution screen corresponding to the execution of the application is displayed on the Apple board area. According to the present invention, an application desired by a user can be conveniently executed using the Apple board area.

Description

[0001] The present invention relates to a mobile terminal and an operation control method thereof,

The present invention relates to a portable terminal and an operation control method thereof, and more particularly, to a portable terminal capable of setting an Apple board area in one area of a screen and executing an application selected by the user, and a method of controlling the operation thereof.

A portable terminal is a portable device having one or more functions capable of carrying out voice and video communication, capable of inputting and outputting information, and storing data, while being portable. As the functions of the portable terminal have diversified, they have complicated functions such as photographing and photographing, playing music files and video files, receiving games, receiving broadcasts, and wireless internet, and have developed a comprehensive multimedia player, .

In order to implement a complex function in a portable terminal implemented in the form of multimedia devices, various attempts have been made in terms of hardware and software. For example, there is a user interface environment in which a user can easily and conveniently search for or select a function. In addition, while the portable terminal is regarded as a personal portable device for expressing the user's personality, various forms of design changes such as a double-sided LCD (Liquid Crystal Display) or a front touch screen are required.

On the other hand, in the case of a portable terminal having a front touch screen such as a tablet type, characters can be input by touch input through a touch screen or various other functions can be performed. In such a portable terminal, since the operation can be controlled using a touch screen, even if a separate key pad or keyboard is not provided, the portable terminal is more suitable for design considering mobility and portability.

However, even in the case of such a portable terminal, there is a need to sequentially select related menus in order to execute a plurality of applications, such as a case of executing a plurality of functions or operation menus, do.

Accordingly, there is a need to control the operation of the portable terminal through a new input method different from the conventional input method in order to conveniently execute a plurality of applications in the portable terminal having the touch screen.

Accordingly, it is an object of the present invention to provide a portable terminal and an operation control method thereof, which can set an apple board area in one area of a screen and execute an application in an apple board area according to a preset gesture input.

According to another aspect of the present invention, there is provided a method of controlling an operation of a portable terminal, the method including displaying an operation screen on a display unit, setting an Apple board area capable of displaying an execution screen of a specific application in one area of the operation screen, And executing an application corresponding to the predetermined gesture input when a predetermined gesture input is sensed through the Apple board area and displaying an execution screen corresponding to the execution of the application on the Apple board area .

According to another aspect of the present invention, there is provided a portable terminal comprising: a display unit for displaying an operation screen; and an apple board area for displaying an execution screen of a specific application in one area of the operation screen, And a control unit for executing an application corresponding to the predetermined gesture input when the set gesture input is sensed and displaying an execution screen corresponding to the execution of the application on the apple board area.

According to the present invention, it is possible to set an Apple board area by using a touch input or the like in one area of an operation screen, execute a corresponding application in accordance with a preset gesture input, Can be displayed. Accordingly, the user can conveniently execute several applications on the touch screen.

1 is a block diagram of a portable terminal according to an embodiment of the present invention;
FIG. 2 is a perspective view of a mobile terminal according to an exemplary embodiment of the present invention,
FIG. 3 and FIG. 4 are flowcharts illustrating a method of controlling an operation of a mobile terminal according to an exemplary embodiment of the present invention;
FIGS. 5 to 11 are views referred to the description of a process of setting an Apple board area according to an embodiment of the present invention, and FIGS.
12 to 29 are diagrams for explaining a process of executing various applications using an Apple board area according to an embodiment of the present invention.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The portable terminal described in the present specification may be used in various applications such as a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a camera, tablet computers, e-book terminals, and the like. In addition, suffixes "module" and " part "for the components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

FIG. 1 is a block diagram of a portable terminal according to an exemplary embodiment of the present invention. Referring to FIG. Referring to FIG. 1, a mobile terminal according to an embodiment of the present invention will be described in terms of components according to functions.

1, the portable terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. When such components are implemented in practical applications, two or more components may be combined into one component, or one component may be divided into two or more components as necessary.

The wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 113, a wireless Internet module 115, a short distance communication module 117, and a GPS module 119.

The broadcast receiving module 111 receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. At this time, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may refer to a server for generating and transmitting at least one of a broadcast signal and broadcast related information and a server for receiving at least one of the generated broadcast signal and broadcast related information and transmitting the broadcast signal to the terminal.

The broadcast-related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal. The broadcast-related information can also be provided through a mobile communication network, in which case it can be received by the mobile communication module 113. Broadcast-related information can exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems. In particular, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S) ), Digital Video Broadcast-Handheld (DVB-H), Integrated Services Digital Broadcast-Terrestrial (ISDB-T), and the like. In addition, the broadcast receiving module 111 may be configured to be suitable for all broadcasting systems that provide broadcasting signals, as well as the digital broadcasting system. The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 113 transmits and receives a radio signal to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The wireless Internet module 115 refers to a module for wireless Internet access, and the wireless Internet module 115 can be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 117 refers to a module for short-range communication. Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ultra wideband (UWB), ZigBee, and the like can be used as the short distance communication technology.

A GPS (Global Position System) module 119 receives position information from a plurality of GPS satellites.

The A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 123. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. Then, the processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ The camera 121 may be equipped with two or more cameras according to the configuration of the terminal.

The microphone 123 receives an external sound signal by a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 113 and output when the voice data is in the call mode. The microphone 123 may be a variety of noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 130 generates key input data that the user inputs to control the operation of the terminal. The user input unit 130 may include a key pad, a dome switch, and a touch pad (static / static) capable of receiving commands or information by a push or touch operation of a user. Also, the user input unit 130 may be a jog wheel for rotating a key, a jog type or a joystick, or a finger mouse. Particularly, when the touch pad has a mutual layer structure with the display unit 151 described later, it can be called a touch screen.

The sensing unit 140 senses the current state of the portable terminal 100 such as the open / close state of the portable terminal 100, the position of the portable terminal 100, Thereby generating a sensing signal. For example, when the portable terminal 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. In addition, a sensing function related to whether or not the power supply unit 190 is powered on, whether the interface unit 170 is coupled to an external device, and the like can be handled.

The sensing unit 140 may include a sensing sensor 141, a pressure sensor 143, a motion sensor 145, and the like. The detection sensor 141 detects the presence of an object approaching the portable terminal 100 or an object existing in the vicinity of the portable terminal 100 without mechanical contact. The detection sensor 141 can detect a nearby object by using a change in the alternating magnetic field or a change in the static magnetic field, or a rate of change in the capacitance. More than two detection sensors 141 may be provided according to the configuration.

The pressure sensor 143 can detect whether the pressure is applied to the portable terminal 100, the magnitude of the pressure, and the like. The pressure sensor 143 may be installed at a portion where the pressure of the portable terminal 100 is required depending on the use environment. When the pressure sensor 143 is installed on the display unit 151, the touch input through the display unit 151 and the pressure applied by the touch input The pressure touch input can be identified. Also, the magnitude of the pressure applied to the display unit 151 at the time of the pressure touch input can be determined according to the signal output from the pressure sensor 143. [

The motion sensor 145 detects the position and movement of the portable terminal 100 using an acceleration sensor, a gyro sensor, or the like. An acceleration sensor that can be used for the motion sensor 145 is a device that converts an acceleration change in one direction into an electric signal and is widely used along with the development of MEMS (micro-electromechanical systems) technology. The acceleration sensor measures the acceleration of a small value built in the airbag system of an automobile and recognizes the minute motion of the human hand and measures the acceleration of a large value used as an input means such as a game There are various kinds. Acceleration sensors are usually constructed by mounting two or three axes in one package. Depending on the usage environment, only one axis of Z axis is required. Therefore, when the acceleration sensor in the X-axis direction or the Y-axis direction is used instead of the Z-axis direction for some reason, the acceleration sensor may be mounted on the main substrate by using a separate piece substrate.

The gyro sensor is a sensor for measuring the angular velocity, and it can sense the direction of rotation with respect to the reference direction.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, an audio output module 153, an alarm unit 155, and a haptic module 157.

The display unit 151 displays and outputs the information processed by the portable terminal 100. For example, when the portable terminal 100 is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with a call is displayed. When the portable terminal 100 is in the video communication mode or the photographing mode, the photographed or received images can be displayed individually or simultaneously, and the UI and the GUI are displayed.

Meanwhile, as described above, when the display unit 151 and the touch pad have a mutual layer structure to constitute a touch screen, the display unit 151 may be an input device capable of inputting information by a user's touch in addition to the output device Can also be used.

If the display unit 151 is configured as a touch screen, it may include a touch screen panel, a touch screen panel controller, and the like. In this case, the touch screen panel is a transparent panel attached to the outside, and can be connected to the internal bus of the portable terminal 100. The touch screen panel keeps a watch on the contact result, and if there is a touch input, sends the corresponding signals to the touch screen panel controller. The touch screen panel controller processes the signals, and then transmits corresponding data to the controller 180 so that the controller 180 can determine whether the touch input has been made and which area of the touch screen has been touched.

The display unit 151 may be formed of an e-paper. Electronic paper (e-Paper) is a kind of reflective display, and has excellent visual characteristics such as high resolution, wide viewing angle and bright white background as conventional paper and ink. The electronic paper (e-paper) can be implemented on any substrate such as plastic, metal, paper, and the image is retained even after the power is shut off, and the battery life of the portable terminal 100 is long Can be maintained. As the electronic paper, a hemispherical twist ball filled with a telephone can be used, or an electrophoresis method and a microcapsule can be used.

In addition, the display unit 151 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three- (3D display). There may be two or more display units 151 according to the implementation mode of the portable terminal 100. [ For example, the portable terminal 100 may include an external display unit (not shown) and an internal display unit (not shown) at the same time.

The audio output module 153 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 153 outputs sound signals related to functions performed in the portable terminal 100, for example, a call signal reception tone, a message reception tone, and the like. The sound output module 153 may include a speaker, a buzzer, and the like.

The alarm unit 155 outputs a signal for notifying the occurrence of an event of the portable terminal 100. Examples of events occurring in the portable terminal 100 include call signal reception, message reception, and key signal input. The alarm unit 155 outputs a signal for notifying the occurrence of an event in a form other than an audio signal or a video signal. For example, it is possible to output a signal in a vibration mode. The alarm unit 155 can output a signal to notify when a call signal is received or a message is received. Also, when the key signal is inputted, the alarm unit 155 can output the signal as the feedback to the key signal input. The user can recognize the occurrence of an event through the signal output by the alarm unit 155. A signal for notifying the occurrence of an event in the portable terminal 100 may also be output through the display unit 151 or the sound output module 153. [

The haptic module 157 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 157 is a vibration effect. When the haptic module 157 generates vibration with a haptic effect, the intensity and pattern of the vibration generated by the haptic module 157 can be converted, and the different vibrations can be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 157 may be provided with a function of stimulating by a pin arrangement vertically moving with respect to the contact skin surface, an effect of stimulating air through the injection or suction force of the air through the injection port or the suction port, The effect of stimulation through contact of an electrode (eletrode), the effect of stimulation by electrostatic force, and the effect of reproducing a cold sensation using a device capable of endothermic or exothermic can be generated. The haptic module 157 can be implemented not only to transmit the tactile effect through direct contact but also to feel the tactile effect through the muscular sense of the user's finger or arm. The haptic module 157 may include two or more haptic modules 157 according to the configuration of the portable terminal 100.

The memory 160 may store a program for processing and controlling the control unit 180 and may store a function for temporarily storing input or output data (e.g., a phone book, a message, a still image, .

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM , And a ROM. ≪ / RTI > In addition, the portable terminal 100 may operate a web storage for storing the memory 150 on the Internet.

The interface unit 170 serves as an interface with all external devices connected to the portable terminal 100. Examples of the external device connected to the portable terminal 100 include a wired / wireless headset, an external charger, a wired / wireless data port, a memory card, a SIM (Subscriber Identification Module) card, a UIM An audio input / output (I / O) terminal, a video I / O (input / output) terminal, and an earphone. The interface unit 170 receives data from the external device or receives power from the external device and transmits the data to each component in the portable terminal 100 so that data in the portable terminal 100 can be transmitted to the external device .

The interface unit 170 is a path through which power from the cradle connected when the portable terminal 100 is connected to the external cradle is supplied to the portable terminal 100 or various command signals inputted from the cradle by the user are carried And may be a passage to be transmitted to the terminal 100.

The controller 180 typically controls the operation of the respective units to control the overall operation of the mobile terminal 100. For example, voice communication, data communication, video communication, and the like. In addition, the control unit 180 may include a multimedia playback module 181 for multimedia playback. The multimedia playback module 181 may be configured in hardware in the controller 180 or separately from software in the controller 180. [

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The mobile terminal 100 having such a configuration can be configured to be operable in a communication system capable of transmitting data through a frame or a packet, including a wired / wireless communication system and a satellite-based communication system. have.

The portable terminal according to the present invention has been described in terms of components according to functions. Hereinafter, with reference to FIG. 2, a portable terminal, particularly a tablet computer, related to the present invention will be described in more detail from the viewpoint of external components.

2 is a perspective view of a portable terminal according to an embodiment of the present invention. Referring to FIG. 2, the case constituting the outer appearance of the portable terminal 100 is formed by the front case 100-1 and the rear case 100-2. Various electronic components are incorporated in the space formed by the front case 100-1 and the rear case 100-2. The front case 100-1 and the rear case 100-2 may be formed by injection molding synthetic resin or may be formed of a metal material such as stainless steel (STS) or titanium (Ti).

The display unit 151, the sound output module 153, the camera 121, and the user input unit 130 may be disposed in the main body, specifically, the front case 100-1.

The display unit 151 may be constructed such that the touch pad is overlapped with the layer structure so that the display unit 151 operates as a touch screen so that information can be input by a user's touch.

The sound output module 153 may be implemented in the form of a receiver or a speaker. The camera 121 may be implemented in a form suitable for taking an image or moving picture of a user or the like.

Other user inputs (not shown), a microphone (not shown), and an interface (not shown) may be additionally arranged on the side of the prototy case and the rear case.

The user input unit 130 may be employed in any manner as long as the user operates in a tactile manner with a tactile impression. For example, the user input unit 130 may be embodied as a dome switch or a touch pad capable of receiving a command or information by a push or touch operation of a user, or may be a wheel, a jog type, a joystick, Or the like. In a functional aspect, the user input unit 130 may include a user input unit for inputting commands such as start, end, and scroll, inputting characters or numbers, special symbols, etc., selecting an operation mode, Key (hot-key) or the like. Further, the microphone may be implemented in a form suitable for receiving the user's voice, other sounds, and the like.

Another camera (not shown) may be additionally mounted on the rear surface of the rear case 100-2. The other cameras to be mounted at this time have photographing directions substantially opposite to those of the camera 121 disposed on the front surface, Pixel. For example, the camera 121 is arranged on the front side, and the camera 121 has low pixels so as to capture a face of a user in case of a video call or the like and transmits the face to the other party. On the rear face, It is preferable to have a high pixel.

Other sound output modules (not shown) may be further disposed in the rear case 100-2. The sound output module disposed in the rear case 100-2 may implement a stereo function together with the sound output module 153 disposed on the front side, and may be used for a call in a speakerphone mode.

In addition, antennas for receiving broadcast signals (not shown) may be disposed in one area of the proton case 100-1 and the rear case 100-2, in addition to the antennas for communication and the like. The antenna may be installed to be capable of being drawn out from the rear case 100-2.

A power supply unit (not shown) for supplying power to the portable terminal 100 may be mounted on the rear case 100-2. The power supply unit may be a rechargeable battery, for example, and may be detachably coupled to the rear case 100-2 for charging or the like.

3 is a flowchart illustrating a process of setting an Apple board area and executing an application in a method of controlling an operation of a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 3, the control unit 180 displays an operation screen corresponding to the selected menu or operation on the display unit 151 (S200). Examples of the displayed operation screen include a standby screen, a message reception screen, a message transmission screen, a main menu screen, an image or video viewer screen, a broadcast screen, a map screen, a web page screen, and the like.

If there is an input for setting the Apple board area in the state that the operation screen is displayed (S205), the controller 180 sets an area corresponding to the input for setting the Apple board area on the operation screen as the Apple board area (S210 ).

The Apple board area is a kind of window for running a new application, and can display the execution screen of a specific application in the Apple board area. The input for setting the Apple board area may be a touch and drag input, a multi-touch input, a long touch input, or the like. Using this input, the Apple board area can be set to the shape and size desired by the user in one area of the operation screen.

After the Apple board area is set, the controller 180 determines whether a preset gesture input is detected through the set Apple board area (S215).

Here, the gesture input refers to an input corresponding to a shape of a dragged path among touch and drag inputs through the display unit 151. [ If a proximity touch input is possible using the proximity sensor 141 or the like, a gesture input in which a user's finger or the like is moved in a predetermined form within a predetermined distance to the display unit 151 may be used . The form of the gesture input may be preset by the user or stored in the form of a default setting in the manufacture of the portable terminal.

If it is determined in step S215 that the predetermined gesture input is detected, the control unit 180 executes a predetermined application corresponding to the gesture input (S220), displays an execution screen corresponding to the execution of the application on the Apple board area (S225).

In this way, an apple board area can be set in one area of the current operation screen in accordance with a preset input, and an application corresponding to the gesture input can be executed according to a gesture input through the apple board area. In addition, it is also possible to execute one or more Apple board areas by repeatedly performing the above-described processes, thereby executing various applications at the same time.

4 is a flowchart illustrating a process of setting an Apple board area and transmitting content to another device in a method of controlling an operation of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 4, after the Apple board area is set according to the procedure described in the above embodiment (S300), the controller 180 detects a gesture input corresponding to the specific device through the set Apple board area (S305)

Here, the specific device refers to a device that can be connected to the portable terminal 100 in a communicable manner through a short distance communication or other wired / wireless communication.

If it is determined in step S305 that the gesture input corresponding to the specific device is detected, the controller 180 searches for a device corresponding to the gesture input and connects the device corresponding to the gesture input (S310). At this time, there may be one or more devices that are communicatively connected.

Then, a content candidate window is displayed on the display unit 151 in which a content icon corresponding to a content that can be transmitted to a device that is communicably connected is displayed (S315).

If there is an input for dragging a content icon in the content candidate window to the set Apple board area (S320), the controller 180 transmits the content corresponding to the dragged content icon to the connected device (S325).

With this process, the content can be transferred to another device by setting the Apple board area. It is also possible to display contents or the like transmitted from a device communicably connected to the set Apple board area.

5 to 29 are diagrams for explaining a method of controlling an operation of a portable terminal according to an embodiment of the present invention.

5 to 11 are views referencing a process of setting an Apple board area according to an embodiment of the present invention.

5 shows a case where a touch and drag input 405 for touching and dragging a point on the operation screen 400 is present. Thus, the Apple board area 410 can be set according to the touch-and-drag input 405.

6 shows a case where there is a multi-touch input including a first touch input 413 and a second touch input 415 on the operation screen 400. In FIG. The Apple board area 420 can be set according to the multi-touch input.

Fig. 7 shows a case where there is an input 423 for touching a point on the operation screen 410 at a long time. The long touch input can be recognized when the touch time is longer than a predetermined time, or when a predetermined pressure or more is applied. The Apple board area 430 can also be set by the long touch input 423. When the long touch input is used, the size of the apple board area 430 can be increased in proportion to the touch time or pressure.

In addition, the Apple board area can be set using the proximity touch input or the continuous touch input.

8A, the apple board area on the operation screen 450 can be set to various shapes and sizes such as a square, a triangle, a circle, a heart shape, and the like. In addition, as shown in FIG. 8B, one or more Apple board areas may be set by overlapping each other on the operation screen 460.

The Apple board area can be set in a 3D form such as a trapezoid shape as shown in the operation screen 470 of FIG. 9A and the operation screen 480 of FIG. 9B.

10 shows a case where the size of the apple board area 493 is adjusted according to the input 495 for touching and dragging the border of the apple board area 493 set on the operation screen 490. [ In this way, the size of the Apple board area can be adjusted according to the input to touch and drag the border of the Apple board area.

11 (a), when the apple board area 510 is set according to the input 505 for touching and dragging a point on the operation screen 500, The displayed icons and the like can be rearranged and moved to any one area on the operation screen 500 so as not to overlap the set Apple board area 510 as shown in FIG.

12 to 29 are diagrams for explaining a process of executing various applications using an Apple board area according to an embodiment of the present invention.

12A shows a case where the apple board area 530 is set according to an input 525 for touching and dragging a point on the operation screen 520. [ When the Apple board area 530 is set as described above, icons 535 for selecting a background screen in the Apple board area 530 can be displayed as shown in FIG. 12 (b). If there is an input 535 for touching any one of the displayed icons 533, the background screen corresponding to the touched icon is displayed on the apple board area 530, as shown in Fig. 12C can do.

As shown in FIG. 13A, when the Apple board area 550 is set on the operation screen 540 and the gesture input 555 in the form of 'web' is present in the Apple board area 550 , The web page function can be performed to display the web page screen in the apple board area 550 as shown in Fig. 13 (b).

As shown in FIG. 14A, when an apple board area 570 is set in one area of the operation screen 560 and there is a gesture input 575 such as 'DMB' The DMB broadcast screen can be displayed on the Apple board area 570 as shown in FIG.

In this way, the corresponding application can be executed according to the gesture input through the Apple board area. At this time, if the start point of the gesture input is within the Apple board area, the gesture input can be regarded as a gesture input for executing the application even if the gesture input is out of the Apple board area. Also, the size of the Apple board area may be automatically adjusted according to the size of the gesture input, and the execution screen of the corresponding application may be displayed.

15A shows a state in which the candidate group 585 of the application corresponding to the recently input touch input is displayed when the Apple board area 583 set in one area of the operation screen 580 is touched. The candidate application may be displayed in an icon form 593 as shown in FIG. 15 (b).

When one of these candidate applications is selected, the corresponding application can be executed.

16A shows a case where a gesture input 603 is present in the Apple board area set in one area of the operation screen 600. FIG. In this case, if there is no application corresponding to the gesture input, a guidance message 610 can be displayed as shown in Fig. 16 (b).

However, if there is an application corresponding to the gesture input, the execution screen 613 of the corresponding application can be displayed as shown in Fig. 16 (c). If there are two or more applications corresponding to the gesture input, as shown in Fig. 16 (d), the Apple board area 615 in which an application to be executed can be selected can be displayed.

FIG. 17A shows a case where the gesture input 623 is present in the Apple board area. In this case, if the gesture input can not recognize the type, as shown in FIG. 17B, the candidate window 630 in which the input gesture type can be selected can be displayed.

18 (a) shows an operation screen 640 in which a plurality of Apple board areas are set. In this operation screen 640, the Apple board area can be aligned and displayed by selecting an alignment menu or by shaking the portable terminal 100 or the like.

For example, as shown in Fig. 18 (b), the Apple board area may be displayed in the order of size, or may be displayed as shown in Fig. 18 (c) or (d) It is also possible to display screens 660 and 670 in which the board areas are arranged in order of creation or frequency of use.

As shown in Fig. 19 (a), the first Apple board area 710 is set as shown in Fig. 19 (b) by an input 703 for touching and dragging one area of the operation screen Can be set. When a gesture input 705 such as 'TV' is present in the first Apple board area 710, as shown in (c) of FIG. 19, Screen can be displayed.

20B, the second Apple board area 720 is set according to the first and second touch inputs 713 and 715, as shown in FIG. 20A, The gallery screen 730 can be displayed on the second Apple board area 730 as shown in FIG. 20 (c).

As shown in Fig. 21 (a), in accordance with an input 7330 for touching a point on the operation screen 700 at a long time, as shown in Fig. 21 (b), the third Apple board area 740). If there is a gesture input 735 such as 'book', it is possible to display a northbook screen in the third Apple board area 740 as shown in FIG. 21 (c).

A trapezoidal fourth Apple board area 780 is set in accordance with the multi-touch inputs 743 and 745 as shown in Fig. 22 (a) If there is a gesture input 777 such as 'web' in the fourth Apple board area 780, a web page screen is displayed on the fourth Apple board area 780 as shown in FIG. 22 (c) .

As described above, it is possible to set various Apple board areas in various forms, and to execute different applications using each Apple board area.

As shown in Fig. 23, a plurality of apple board areas 803 and 805 may be set on the operation screen 800, and different chat windows may be displayed on each apple board area to perform the messenger function. As shown in FIG. 23 (b), the portable terminal having the projector function can also select the image to be projected through the Apple board area 813 set on the operation screen 810.

24A, an Apple board area 823 is set in one area of the operation screen 820, and then the Apple board area 823 is set as shown in FIG. 24B. If there is a gesture input 825 such as 'device', the Apple board area corresponding to the device can be set.

FIG. 24C shows a screen 830 in which a device capable of communicably connecting is searched and an Apple board area corresponding to five devices is displayed. At this time, a content candidate window 840 including a content icon corresponding to a content that can be transmitted to another device can be displayed together.

The selected content can be transferred to the specific device in accordance with the input 843 for selecting one of the content icons in the content candidate window 840 and dragging the selected content icon to one of the apple board areas as shown in FIG. 24 (d) .

In this way, content can be transmitted to or received from another device using the Apple board area corresponding to the device.

25 (a), after the Apple board area 850 is set on the operation screen 840, as shown in Fig. 25 (b), handwriting recognition is performed on the Apple board area 850 If there is a gesture input 853 corresponding to the gesture input 853, characters can be input using the apple board area 850 as a handwriting recognition input window, as shown in FIG. 25 (c).

26 (a), after the Apple board area 870 is set on the operation screen 860, as shown in Fig. 26 (b), the Apple board area 870 is set in the Apple board area 870 If there is a gesture input 875 corresponding to the key pad recognition, a character can be input by displaying a keypad on the apple board area 870 as shown in Fig. 26 (c).

As described above, the Apple board area can be set as a keypad input window, a handwriting recognition input window, a continuous handwriting input window, a Qwerty input window, and the like.

As shown in FIG. 27A, after the Apple board area 890 is set on the operation screen 880, a mouse function (not shown) is added to the Apple board area 890 as shown in FIG. 27 (b) The user can use the Apple board area 890 as an area corresponding to the mouse operation to move the cursor 895 to display a desired function .

28 (a), when there is a gesture input 913 requesting a call in the Apple board area 910 set on the operation screen 900, as shown in FIG. 28 (b) , And the window 915 in which the call candidate group is displayed can be displayed. At this time, as shown in FIG. 28C, the changed operation screen 920 and the changed Apple board area 930 are displayed according to the movement of the portable terminal, and a call candidate group is displayed in the changed Apple board area 930 The number displayed in the displayed window 935 can also be displayed in a modified form

In addition, the Apple board area can be used for various purposes. In addition, the configuration and method of the embodiments described above can be applied to a portable terminal and its operation control method according to the present invention, Or some of them may be selectively combined.

Meanwhile, the present invention can be implemented as a processor-readable code in a processor-readable recording medium provided in a portable terminal. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium readable by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also a carrier wave such as transmission over the Internet. In addition, the processor readable recording medium may be distributed over networked computer systems so that code readable by the processor in a distributed manner can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It should be understood that various modifications may be made by those skilled in the art without departing from the spirit and scope of the present invention.

110: wireless communication unit 120: A / V input unit
130: user input unit 140: sensing unit
150: output unit 151: display unit
160: memory 170: interface section
180:

Claims (20)

Displaying an operation screen on a display unit;
Setting an apple board area capable of displaying an execution screen of a specific application in one area of the operation screen;
Inputting characters by setting the Apple board area as a character input window; And
And displaying an execution screen corresponding to the execution of the application on the Apple board area when a predetermined gesture input is sensed through the Apple board area, . The method according to claim 1,
Wherein the Apple board area is set according to any one of an input for touching and dragging the operation screen, an input for multi-touching the operation screen, and an input for long touching the operation screen. Way. The method according to claim 1,
And displaying an icon for selecting a background screen of the Apple board area. The method according to claim 1,
And the Apple board area is set to a plurality of. The method according to claim 1,
Further comprising changing a size of the AppleBoard according to a size of the gesture input. The method according to claim 1,
And displaying an executable candidate application corresponding to the gesture input. The method according to claim 1,
And arranging and displaying the Apple board area displayed on the display unit according to a predetermined criterion according to an alignment command. 8. The method of claim 7,
Wherein the predetermined criterion is any one of a magnitude order, a generation order, and a use frequency order. The method according to claim 1,
Further comprising changing the size of the Apple board according to movement of the main body. The method according to claim 1,
Searching for a device capable of being communicatively connected and displaying an Apple board area corresponding to the searched device when the device search has a gesture input defined as a function. 11. The method of claim 10,
When a user touches a content icon in the content candidate window including at least one content icon and drags the content icon to the Apple board area corresponding to the first device, transmitting the content corresponding to the dragged content icon to the first device The method comprising the steps of: delete The method according to claim 1,
Wherein the character input window includes a keypad input window, a handwriting recognition input window, a continuous handwriting input window, and a Qwerty input window. The method according to claim 1,
And setting the Apple board area as a mouse control window to control a pointer displayed on the operation screen. The method according to claim 1,
And displaying a guide message for requesting another gesture input if there is no application corresponding to the gesture input sensed through the apple board area. A display unit for displaying an operation screen; And
An apple board area capable of displaying an execution screen of a specific application is set in one area of the operation screen and an application corresponding to the predetermined gesture input is executed when detecting a predetermined gesture input through the apple board area And a control unit for displaying an execution screen corresponding to execution of the application on the Apple board area,
Wherein the control unit sets the Apple board area as a character input window for inputting a character by a user. 17. The method of claim 16,
Wherein the controller sets the apple board area according to any one of an input for touching and dragging the operation screen, an input for multi-touching the operation screen, and an input for touching the operation screen for a long time. 17. The method of claim 16,
And a sensing unit for outputting a sensing signal corresponding to the movement of the main body,
Wherein the controller displays the Apple board displayed on the operation screen by aligning the Apple board according to a predetermined criterion when motion of the main body is detected according to the detection signal. 17. The method of claim 16,
And a wireless communication unit for providing a communication interface,
The control unit searches for a device capable of communicably connecting through the wireless communication unit and displays an Apple board area corresponding to the searched device on the display unit when there is a gesture input defined as a function in the device search . 20. The method of claim 19,
The control unit displays the content candidate window including the content icon on the display unit. If there is an input for dragging the selected content icon in the content candidate window to the Apple board area corresponding to the first device, To the first device via the wireless communication unit.

Images