KR20150041546A - The mobile terminal and the control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal capable of touch input, and a control method thereof. The mobile terminal comprises: a display unit outputting a graphic object; a sensing unit sensing touch input applied to the display unit; and a control unit outputting at least one other graphic object related to a graphic object in which output is maintained on at least one area of the display unit by corresponding to a second touch input when a first touch input applied to the display unit, and the second touch input which is different with the first touch input while the first touch input is maintained are sensed, and output of the graphic objet outputted to the area in which the first touch input is applied is maintained.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a mobile terminal,

The present invention relates to a mobile terminal capable of sensing a touch and a control method thereof.

As the information age rapidly develops, it is emphasized the importance of functions for inputting and outputting information in electronic devices and for storing data. Electronic devices capable of having such functions can be divided into portable electronic devices such as electronic devices and fixed electronic devices such as video display devices.

As the functions of portable electronic devices become diversified, they are implemented in the form of multimedia devices having complicated functions such as photographing and photographing of movies, reproduction of music or video files, and reception of games and broadcasting. These complex functions can also be applied to fixed electronic devices for the convenience of the user.

On the other hand, as the function of the portable electronic device is complicated, the user is experiencing a lot of inconvenience in using the function of the portable electronic device. To alleviate this inconvenience, it is necessary to provide a more intuitive interface to the user.

The intuitive interface of the user may have an interface via a touch. Therefore, it is necessary to develop various interfaces through touch.

An object of the present invention is to provide a method of controlling screen information output to a display unit using a multi-touch input.

It is still another object of the present invention to provide a method of controlling each region of a display unit divided into a plurality of regions in a different manner by using a multi-touch input.

The present invention relates to a mobile terminal and a control method thereof, and more particularly, to a mobile terminal and a control method therefor. The mobile terminal includes a display unit for outputting graphic objects, a sensing unit for sensing a touch input applied to the display unit, And a control unit for controlling the display unit in a state where the output of the graphic object being output in the area to which the first touch input is applied is maintained when the second touch input other than the first touch input is sensed while the first touch input is being held, And a controller for outputting at least one other graphic object related to the graphic object in which the output is held in at least one region of the display unit corresponding to the second touch input.

In one embodiment, when the first and second touch inputs are detected, the controller divides the display unit into a plurality of regions, and the first region of the plurality of regions is divided into a plurality of regions, The graphic object being output is outputted and a graphic object different from the graphic object is output to a second area of the plurality of areas.

In one embodiment, when the second touch input is applied again to the display unit, corresponding to the second touch input again, in the second area, a graphic object different from the graphic object output in the second area And an object is output.

In one embodiment, the first and second touch inputs are different types of touch inputs, and the display unit is divided into a plurality of regions based on the first and second touch inputs being sensed, When the second touch input is applied to the first area in a state where the first touch input is applied to the second area, the graphic object output to the second area is maintained by the first touch input, And the graphic object output to the first area is changed to another graphic object related to the graphic object output in the second area.

In one embodiment, when the graphic object output to the first area is enlarged corresponding to the application of at least one touch to the first area, the control unit causes the graphic object of the second area to be enlarged And enlarges the area corresponding to the enlargement of the graphic object output to the area.

In one embodiment, the display unit includes a plurality of graphic objects, and the control unit controls the first touch input of the plurality of graphic objects based on the first and second touch inputs to be applied The output position of the graphic object is fixed and the output position of the graphic object except for the graphic object to which the output position is fixed is changed based on the second touch input being applied.

In one embodiment, the control unit controls at least one graphic object of the plurality of graphic objects output to the display unit on the display unit in response to the output position of the graphic object being changed by the second touch input, And at least one new graphic object that has not been output to the display unit is output in response to disappearance of the at least one graphic object.

In one embodiment, the graphic object is a plurality, and the control unit sets at least two graphic objects of the plurality of graphic objects as a group according to a user's selection, And outputting the graphic object included in the set group.

In one embodiment, the setting of the group is performed by a third touch input different from the first and second touch inputs to the plurality of graphic objects.

In one embodiment, the display unit includes a graphic object included in the set group, and when the first and second touch inputs are detected with respect to the graphic object included in the set group, Wherein the first touch input of the first touch input is maintained and the graphic object other than the first touch input of the graphic object set in the group corresponding to the second touch input is output .

The present invention can output the graphic object related to the graphic object to another area of the display unit while maintaining the output state of the graphic object output to one area of the display unit using the multi-touch input applied to the display unit . Through this, the user can compare the graphic objects output in the two areas at a time.

In addition, the present invention can change the output position of the remaining graphic objects while fixing the output position of any one of the plurality of graphic objects, in a display unit including a plurality of graphic objects. Through this, the user can change the output of the remaining graphic objects while maintaining the output of the desired graphic object.

1 is a block diagram illustrating a mobile terminal according to one embodiment disclosed herein.
2A is a perspective view illustrating a front surface of a mobile terminal according to an exemplary embodiment of the present invention.
2B is a perspective view illustrating a rear surface of a mobile terminal according to an exemplary embodiment of the present invention.
3 is a flowchart illustrating a method of controlling a graphic object output to a display unit using a multi-touch in a mobile terminal according to an exemplary embodiment of the present invention.
4 is a conceptual diagram showing the control method of FIG.
5A and 5B are conceptual diagrams illustrating that a graphic object is changed by a second touch.
6 is a conceptual diagram for explaining how to change a graphic object whose output is fixed to the display unit.
7A, 7B, and 7C are conceptual diagrams illustrating a method of editing a graphic object output to the first area and the second area.
8A and 8B are conceptual diagrams illustrating a method of controlling the output of a plurality of graphic objects.
9A and 9B are conceptual diagrams illustrating a method of grouping at least some of a plurality of graphic objects.
10A and 10B are conceptual diagrams illustrating a method of using a grouped graphic object.
11 is a conceptual diagram for explaining a method of controlling a display unit on which the camera application is running when the camera application is running.
FIG. 12 is a perspective view of a mobile terminal having a front surface covered with a display unit according to an embodiment of the present invention; FIG.
13 is a flowchart illustrating a control method using a plurality of function keys in a mobile terminal having a front surface covered with a display unit according to an embodiment of the present invention.
14A and 14B are conceptual diagrams illustrating the control method of FIG.
FIG. 15 is a conceptual diagram for determining whether to output information according to whether or not the first touch is detected.
16A, 16B, and 16C are conceptual diagrams illustrating a method of controlling information output by the second touch.
17 is a conceptual diagram for explaining a method of editing an output memo in a mobile terminal on which a memo application is executed.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. In addition, it should be noted that the attached drawings are only for easy understanding of the embodiments disclosed in the present specification, and should not be construed as limiting the technical idea disclosed in the present specification by the attached drawings.

The electronic devices described herein may be used in various applications such as mobile phones, smart phones, laptop computers, digital broadcasting electronics, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation, ), Tablet PC, Ultra Book and so on. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiments described herein may be applied to a fixed electronic device such as a digital TV, a desktop computer, and the like, except when it is applicable only to an electronic device.

1 is a block diagram illustrating an electronic apparatus according to an embodiment disclosed herein.

The electronic device 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, A controller 170, a controller 180, a power supply 190, and the like. The components shown in FIG. 1 are not essential, and an electronic device having components having more or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the electronic device 100 and the wireless communication system or between the electronic device 100 and the network in which the electronic device 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short range communication module 114, and a location information module 115 .

The broadcast receiving module 111 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may refer to a server for generating and transmitting broadcast signals and / or broadcast-related information, or a server for receiving broadcast signals and / or broadcast-related information generated in advance and transmitting the broadcast signals and / or broadcast- related information to electronic devices. The broadcast signal may include a TV broadcast signal, a radio broadcast signal, a data broadcast signal, and a broadcast signal in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast-related information may refer to a broadcast channel, a broadcast program, or information related to a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, an EPG (Electronic Program Guide) of DMB (Digital Multimedia Broadcasting) or an ESG (Electronic Service Guide) of Digital Video Broadcast-Handheld (DVB-H).

For example, the broadcast receiving module 111 may be a Digital Multimedia Broadcasting-Terrestrial (DMB-T), a Digital Multimedia Broadcasting-Satellite (DMB-S), a Media Forward Link Only And a Digital Broadcasting System (ISDB-T) (Integrated Services Digital Broadcast-Terrestrial). Of course, the broadcast receiving module 111 may be adapted to other broadcasting systems as well as the digital broadcasting system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The mobile communication module 112 is configured to implement a video communication mode and a voice communication mode. The video call mode refers to a state of talking while viewing a video of the other party, and the voice call mode refers to a state in which a call is made without viewing the other party's video. In order to implement the video communication mode and the voice communication mode, the mobile communication module 112 is configured to transmit and receive at least one of voice and image.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built in or enclosed in the electronic device 100. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used as a short range communication technology.

The position information module 115 is a module for obtaining the position of the electronic device, and a representative example thereof is a Global Position System (GPS) module.

Referring to FIG. 1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame can be displayed on the display unit 151. [

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ Two or more cameras may be provided depending on the usage environment.

The microphone 122 receives an external sound signal through a microphone in a communication mode, a recording mode, a voice recognition mode, or the like, and processes it as electrical voice data. The processed voice data can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 when the voice data is in the call mode, and output. Various noise reduction algorithms may be implemented in the microphone 122 to remove noise generated in receiving an external sound signal.

The user input unit 130 generates input data for a user to control operation of the electronic device. The user input unit 130 may include a key pad, a dome switch, a touch pad (static / static), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the electronic device 100, such as the open / close state of the electronic device 100, the position of the electronic device 100, the presence or absence of user contact, the orientation of the electronic device, And generates a sensing signal for controlling the operation of the electronic device 100. For example, when the electronic device 100 is in the form of a slide phone, it is possible to sense whether the slide phone is opened or closed. It is also possible to sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154, for example, for generating output related to visual, auditory, have.

The display unit 151 displays (outputs) information to be processed by the electronic device 100. For example, when the electronic device is in the call mode, a UI (User Interface) or a GUI (Graphic User Interface) associated with the call is displayed. When the electronic device 100 is in the video communication mode or the photographing mode, the photographed and / or received video or UI and GUI are displayed.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

Some of these displays may be transparent or light transmissive so that they can be seen through. This can be referred to as a transparent display, and a typical example of the transparent display is TOLED (Transparent OLED) and the like. The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the electronic device body through the area occupied by the display portion 151 of the electronic device body.

There may be two or more display units 151 according to the embodiment of the electronic device 100. [ For example, in the electronic device 100, a plurality of display portions may be spaced apart from one another or may be disposed integrally with each other, or may be disposed on different surfaces.

(Hereinafter, referred to as a 'touch screen') in which a display unit 151 and a sensor for sensing a touch operation (hereinafter, referred to as 'touch sensor') form a mutual layer structure, It can also be used as an input device. The touch sensor may have the form of, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in a pressure applied to a specific portion of the display unit 151 or a capacitance generated in a specific portion of the display unit 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the pressure at the time of touch.

If there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like.

Referring to FIG. 1, a proximity sensor may be disposed in an inner area of an electronic device to be wrapped by the touch screen or in the vicinity of the touch screen. The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or a nearby object without mechanical contact using the force of an electromagnetic field or infrared rays. The proximity sensor has a longer life span than the contact sensor and its utilization is also high.

Examples of the proximity sensor include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. And to detect the proximity of the pointer by the change of the electric field along the proximity of the pointer when the touch screen is electrostatic. In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the act of recognizing that the pointer is positioned on the touch screen while the pointer is not in contact with the touch screen is referred to as "proximity touch & The act of actually touching the pointer on the screen is called "contact touch. &Quot; The position where the pointer is proximately touched on the touch screen means a position where the pointer is vertically corresponding to the touch screen when the pointer is touched.

The proximity sensor detects a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, and the like). Information corresponding to the detected proximity touch operation and the proximity touch pattern may be output on the touch screen.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output module 152 also outputs sound signals associated with functions (e.g., call signal reception sound, message reception sound, etc.) performed in the electronic device 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the electronic device 100. Examples of events that occur in electronic devices include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for notifying the occurrence of an event in a form other than the video signal or the audio signal, for example, vibration. The video signal or the audio signal may be output through the display unit 151 or the audio output module 152 so that they may be classified as a part of the alarm unit 153.

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity and pattern of the vibration generated by the hit module 154 can be controlled. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 154 can be implemented not only to transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sensation of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the electronic device 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data on vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 160 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), a RAM (Random Access Memory), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable read- A disk, and / or an optical disk. The electronic device 100 may operate in association with a web storage that performs a storage function of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the electronic device 100. The interface unit 170 receives data from an external device or supplies power to each component in the electronic device 100 or allows data in the electronic device 100 to be transmitted to an external device. For example, a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, an audio I / O port, A video input / output (I / O) port, an earphone port, and the like may be included in the interface unit 170.

The identification module is a chip for storing various information for authenticating the usage right of the electronic device 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module a universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Thus, the identification device can be connected to the electronic device 100 through the port.

The interface unit 170 may be a path through which power from the cradle is supplied to the electronic device 100 when the electronic device 100 is connected to an external cradle, A signal may be a path through which the electronic device is transmitted. Various command signals input from the cradle or the power source may be operated as a signal for recognizing that the electronic device is correctly mounted on the cradle.

The controller 180 typically controls the overall operation of the electronic device. For example, voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [

 In addition, the control unit 180 may perform a pattern recognition process for recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively.

In addition, if the state of the electronic device meets a set condition, the controller 180 can execute a lock state for restricting input of a user's control command to applications. Also, the controller 180 can control the lock screen displayed in the locked state based on the touch input sensed through the display unit (hereinafter, referred to as 'touch screen') 151 in the locked state.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be implemented as application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays , Microprocessors, microprocessors, microprocessors, and other electronic units for carrying out other functions. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein.

The software code may be implemented in a software application written in a suitable programming language. The software code is stored in the memory 160 and can be executed by the control unit 180. [

Hereinafter, a structure of an electronic device or an electronic device in which components of the electronic device or the electronic device according to an embodiment of the present invention shown in FIG. 1 are arranged will be described.

FIG. 2A is a perspective view of an electronic device or an electronic device of the present invention as viewed from the front, and FIG. 2B is a rear perspective view of the electronic device shown in FIG. 2A.

FIG. 2A is a perspective view of an electronic device or an electronic device related to the present invention as viewed from the front, and FIG. 2B is a rear perspective view of the electronic device shown in FIG. 2A.

The disclosed electronic device 100 includes a bar-shaped electronic device body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

According to the drawing, the electronic device main body 100 (hereinafter, referred to as a "body") has a front surface, a side surface, and a rear surface. Further, the body has both ends formed along the longitudinal direction.

The body 100 includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In this embodiment, the case may be divided into a front surface (hereinafter referred to as a 'front case') 101 and a rear surface (hereinafter referred to as a 'rear case'). A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding a synthetic resin, or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The electronic device body 100 mainly includes a display unit 151, an audio output unit 152, a camera 121, user input units 130/131 and 132, a microphone 122, an interface 170, Can be arranged.

The display unit 151 occupies most of the main surface of the front case 101. A sound output unit 152 and a camera 121 are disposed in an area adjacent to one end of both ends of the display unit 151 and a user input unit 131 and a microphone 122 are disposed in an area adjacent to the other end. The user input unit 131 and the interface 170 may be disposed on the side surfaces of the front case 101 and the rear case 102. On the other hand, the microphone 122 is disposed at the other end of the body 100.

The user input unit 130 is operated to receive a command for controlling the operation of the electronic device, and may include a plurality of operation units 131 and 132. The operation units 131 and 132 may be collectively referred to as a manipulating portion and may be employed in any manner as long as the user operates in a tactile manner.

The contents inputted by the first or second operation unit 131 or 132 may be variously set. For example, the first operation unit 131 receives commands such as start, end, scroll, and the like, and the second operation unit 132 controls the size of the sound output from the sound output unit 152 or the size of the sound output from the display unit 151 To the touch recognition mode of the touch screen.

Referring to FIG. 2B, the rear surface of the electronic device body, that is, the rear case 102, may further include an acoustic output portion 152 '. The sound output unit 152 'may implement the stereo function together with the sound output unit 152 (see FIG. 2A), and may be used for the implementation of the speakerphone mode during a call.

The electronic apparatus body is equipped with a power supply unit 190 for supplying power to the electronic apparatus 100. The power supply unit 190 may be embedded in the electronic device body or may be detachable from the outside of the electronic device body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

Further, a camera 121 'may be additionally mounted on the rear case 102 of the electronic device body. The camera 121 may be a camera having a different image from the camera 121, having a photographing direction substantially opposite to the camera 121 (see FIG. 2A) mounted on the front case of the camera 121 '.

For example, the camera 121 may have a low pixel so that the face of the user can be photographed and transmitted to the other party in case of a video call or the like, and the camera 121 ' It can be made to have a high number of pixels. The camera 121 'may be installed in the electronic device body 100 so as to be rotatable or pop-upable.

A flash 123 and a mirror 124 are additionally disposed adjacent to the camera 121 '. The flash 123 illuminates the subject when the subject is photographed by the camera 121 '. The mirror allows the user to illuminate the user's own face or the like in the case where the user intends to photograph (self-photograph) himself / herself using the camera 121 '.

An acoustic output portion 252 'may be additionally disposed on the rear surface of the electronic device body. The sound output unit 252 'may implement the stereo function together with the sound output unit 252 (see FIG. 2A), and may be used for the implementation of the speakerphone mode in a call.

The electronic apparatus body is equipped with a power supply unit 190 for supplying power to the electronic apparatus 100. The power supply unit 190 may be embedded in the electronic device body or may be detachable from the outside of the electronic device body.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may also be of a light transmission type like the display unit 151. [ In this case, if the display unit 151 is configured to output time information on both sides, the time information can be recognized through the touch pad 135 as well. The information output on both sides may be all controlled by the touch pad 135. [ Alternatively, a display may be additionally mounted on the touch pad 135, and a touch screen may be disposed on the rear case 102 as well.

In addition, the mobile terminal according to an embodiment of the present invention, which can include at least one of the above-described components, can perform various control functions using the multi-touch input.

Hereinafter, a method of controlling the output of the graphic object output to the display unit based on the touch input will be described. FIG. 3 is a flowchart illustrating a method of controlling an output of a graphic object output to a display unit based on a touch input. FIG. 4 is a conceptual diagram illustrating the control method of FIG.

The mobile terminal according to an exemplary embodiment of the present invention may perform a step of outputting a graphic object to a display unit (S310).

The display unit 151 may output graphic objects related to various functions operating in the mobile terminal. The graphic object may be a variety of images that can be output to the display unit 151. For example, when a home screen page is output to the display unit 151, the icon may correspond to an application included in the home screen page, a widget, or the like. As another example, if the mobile device is running a gallery application associated with an image file, the graphic object may be the image file itself.

Meanwhile, in the mobile terminal according to the embodiment of the present invention, a first touch input is applied to the display unit, and a second touch input different from the first touch input is sensed while the first touch input is maintained (S320).

The mobile terminal according to an embodiment of the present invention may further include a sensing unit 140 for sensing a touch input applied to the display unit 151. The sensing unit 140 may be a touch sensor. The touch input that can be sensed by the sensing unit 140 may be various types of touch inputs. For example, the touch input may be a short-touch, a long-touch, a double-touch, a drag, a flicking, or the like.

Meanwhile, the sensing unit 140 may sense a multi-touch input. The multi-touch input is an input to which at least two touch inputs are simultaneously applied. For example, the multi-touch input may include a first touch input and a second touch input. At this time, the first and second touch inputs may have different touch input methods. For example, the first touch input may be a long touch input, and the first touch input may be a flicking input.

The control unit 180 can execute a function corresponding to the multi-touch input based on the detection of the multi-touch input. For example, when the multi-touch input is detected, the controller 180 may control the output of the graphic object output to the display unit 151 in response to the multi-touch input.

Meanwhile, when the first and second touch inputs are detected, the mobile terminal according to an exemplary embodiment of the present invention maintains the output of the graphic object to which the first touch input is applied, And outputting at least one graphic object related to the graphic object in which the output is held in at least one region of the region (S330).

The control unit 180 controls the output state of the graphic object output to the display unit 151 based on the first and second touch inputs when the first and second touch inputs applied to the display unit are simultaneously detected can do. At this time, the output state may be to maintain the output or not to maintain the output. In addition, the output state may change the shape, color, position, etc. of the graphic object.

In one embodiment, when the first and second touch inputs are applied, the control unit 180 can control to maintain or output the output of the graphic object currently being output to the display unit 151 . For example, the sensing unit 140 can sense the first touch input and the second touch input different from the first touch input while the first touch input is maintained. In this case, when the second touch input is sensed while the first touch input is sensed, the controller 180 determines that the first touch input is currently being held, You can maintain the output of the object. In response to the second touch input, the controller 180 may output at least one graphic object related to the graphic object that is currently being output to the display unit 151.

At this time, the controller 180 may divide the display unit 151 into a plurality of regions when the first and second touch inputs are applied. For example, the plurality of regions may include a first region and a second region. At this time, the graphic object in which the output is held may be output in the first region, and at least one graphic object related to the graphic object in which the output is held may be output in the second region.

The first region and the second region may be distinguished in various ways. For example, the first and second regions may be classified according to a user's selection, or may be classified according to a predetermined method. At this time, if the user is divided according to the selection, the user can select any one of a plurality of previously stored schemes, and can distinguish areas by touch input. At this time, the method of dividing the area by the touch input of the user can be divided based on the touch trajectory corresponding to the touch input of the user. For example, when a user applies a dragging operation to the center of the display unit 151 in the horizontal direction, the region corresponding to the trajectory corresponding to the drag can be distinguished.

The graphic object that can be output in the second area may be at least one graphic object associated with the graphic object in which the output is maintained. At this time, the graphic object related to the graphic object in which the output is held can be set according to various criteria.

At this time, the various criteria may be preset. For example, the various criteria may be a graphic object belonging to the same group, a graphic object satisfying a predetermined criterion, a type of graphic object being the same or the like.

For example, when the graphic object is an image, the various criteria may be a shooting time and a photographing position of the image. In one embodiment, if multiple shots are taken for the same object at a time, the associated graphics object may be a plurality of images shot within the predetermined time.

As another example, when a plurality of images are stored in the memory of the mobile terminal, the related graphic object can be determined using the image recognition function. For example, when it is determined that an image of the plurality of images is identical to a predetermined level or higher through the image recognition function when the image is set as a graphic object whose output is maintained by the first touch input, The output may be determined as a graphic object related to the graphic object on which the output is maintained.

Meanwhile, the graphic object output to the second area may be a graphic object related to the graphic object output in the first area, but is not necessarily limited to the related graphic object. In this case, various graphic objects other than the graphic object related to the first area may be output to the second area.

Also, although not shown, the display unit 151 may not be divided into a plurality of units. In this case, at least one graphic object output corresponding to the second touch input may be overlapped on the graphic object whose output is maintained by the first touch input.

In the above description, a method of controlling the output state of the graphic object output to the display unit in response to the predetermined touch input to the display unit has been described. Hereinafter, a method of controlling the output state will be described in detail with reference to the drawings.

The control unit 180 may control an output state of the graphic object output to the display unit 151 on the basis of the multi-touch input applied to the display unit 151.

For example, referring to FIG. 4A, the display unit 151 may output an image file. At this time, the user can apply the first touch input to the display unit 151. [ For example, the first touch input may be a long touch input.

In a state where the first touch input is maintained, the user may apply a second touch input, which is different from the first touch input, to one area of the display unit. For example, the second touch input may be a flicking input different from the long touch input when the first touch input is a long touch input.

When the second touch input is sensed, the controller 180 may execute a function corresponding to the second touch input. For example, the function corresponding to the second touch input may be a function of outputting a graphic object that is not output to the display unit 151.

In one embodiment, the controller 180 may display at least one graphic object associated with the graphic object whose output is maintained by the first touch input, in response to the second touch input, It can be outputted to at least one area.

At this time, the controller 180 may divide the display unit into a plurality of areas. For example, the plurality of regions may include a first region 151a and a second region 151b.

4B, when the display unit is divided into a first area 151a and a second area 151b, the first area 151a and the second area 151b are divided into a first area 151a and a second area 151b, And at least one graphic object related to the graphic object in which the output is held may be output in the second area. At this time, at least one graphic object related to the graphic object in which the output is held may be a graphic object similar to the graphic object in which the output is maintained. For example, referring to FIG. 4 (b), an image similar to the image in which the output is held may be output to the second area.

On the other hand, although not shown, only one related image may be output in the second area, as shown in (b) of FIG. 4, but a plurality of related images may also be simultaneously output. At this time, the number of outputting the related image may be set by the user or preset. The second area may be divided into a plurality of areas according to the number of related images.

In the above, a method of outputting at least one other graphic object related to the graphic object in which the output is maintained, while maintaining the output of the graphic object output to the display unit, based on the first touch input and the second touch input being applied Respectively. Through this, a user can compare a plurality of graphic objects at a glance.

Hereinafter, a method of outputting a graphic object by touch input will be described in more detail. 5A and 5B are conceptual diagrams illustrating a method of controlling each area when the display unit is divided into a plurality of areas.

The mobile terminal according to an embodiment of the present invention can control the output of the graphic object output to the display unit 151 based on the multi-touch input being sensed. For example, referring to FIG. 5A, a first touch input and a second touch input may be applied to the display unit 151. FIG. At this time, the controller 180 maintains the output of the graphic object output to the display unit 151 based on the first touch input, and controls the operation of the display unit 151 based on the second touch input. And output at least one other graphic object related to the graphic object in which the output is held in one area.

When the touch input is applied to the first and second touch inputs, the control unit 180 may divide the display unit 151 into a plurality of areas, as shown in FIG. 5A. For example, the display unit 151 may be divided into a first area 151a and a second area 151b. At this time, the graphic object in which the output is held can be output in the first area 151a, and the graphic object related to the graphic object in which the output is held can be output in the second area 151b.

Thereafter, the second touch input may be applied again to the second area 151b. In this case, the controller 180 may change the graphic object output to the second area 151b to another graphic object. At this time, the graphic object output to the first area 151a can be continuously output. The other graphic object output to the second area may be a graphic object related to the graphic object whose output is maintained in the first area 151a. For example, as shown in FIG. 5A (c), the other graphic object may be an image related to the image in which the output is being held.

On the other hand, although not shown, the first touch input may be maintained in the first area. For example, in the case of (b) of FIG. 5A, the user can keep the first touch input in the first area. In this case, the maintenance of the output of the graphic object in the first area may be performed only in a state where the first touch input is maintained.

In addition, the control unit 180 may delete the graphic object from the memory unit based on the direction of the second touch input, as well as whether the graphic object is output or not. For example, when the second touch input is a drag input that is directed to the outside of the area of the display unit 151 within the area of the display unit 151, the controller 180 transmits the graphic object, .

In one embodiment, referring to FIG. 5B, the controller 180 may maintain the output of the graphic object to which the first touch input is applied. At this time, the user can apply the second touch input to the graphic object 430 other than the graphic object 420 to which the first touch input is applied. For example, the second touch input may be a drag input directed to an area of the display unit 151 within the area of the display unit 151 with respect to the other graphic object.

When the second touch input is applied, the controller 180 may not output the graphic object 430 to which the second touch input is applied. At this time, the graphic object 430 to which the second touch input is applied may be deleted from the memory.

When the graphic object 430 is deleted, as shown in FIG. 5B, the controller 180 controls the graphic object 430 to display the graphic object 430 in which the output is held, And may output a graphic object 440 different from the deleted graphic object.

In the above description, when the display unit 151 is divided into a plurality of regions, the graphic object being output to the second region is changed when the second touch is input again to the second region. Accordingly, the user can change the graphic object in the second area while maintaining the output of the graphic object output in the first area, and compare the graphic object output in the first area with the plurality of graphic objects.

In addition, in a state in which a plurality of graphic objects are output, a user can conveniently delete a graphic object to which the touch input is applied only by touch input to any one of the plurality of graphic objects.

Hereinafter, a method of changing a graphic object whose output is maintained will be described. 6 illustrates a method of changing a graphic object whose output is held based on the touch input being sensed.

The control unit 180 can divide the display unit 151 into a plurality of areas based on the first and second touch inputs. For example, as shown in FIG. 6 (a), the display unit 151 may be divided into a first area 151a and a second area 151b. At this time, a graphic object in which the output is maintained is output to the first area 151a, and a graphic object related to the graphic object in which the output is maintained in the first area is output to the second area 151b. At this time, the graphic object output to the second area may be changed to another graphic object by the second touch input to the second area 151b. The other graphic object may be a graphic object related to the graphic object whose output is held in the first area.

At this time, the controller 180 may set a graphic object related to the graphic object on which the output is held. For example, the controller 180 may group a plurality of graphic objects satisfying predetermined criteria in advance. At this time, the predetermined criteria may be various types of graphic objects, photographing time of graphic objects, photographing positions, and the like. Accordingly, the controller 180 may group a plurality of graphic objects according to one of the various criteria.

At this time, as shown in FIG. 6 (b), the user can apply the first touch input to the second area 151b. In addition, the user can apply the second touch input to the first area 151a in a state where the first touch input is held in the second area 151b. In this case, the output of the graphic object output to the first area 151a may be changed while the output of the graphic object output to the second area 151b is maintained. For example, in the first area 151a, a graphic object related to the graphic object whose output is maintained in the second area 151b may be output. At this time, the graphical object related to the graphic object in which the output is held may be any one of the plurality of graphic objects belonging to the group.

Through this, the user can change the graphic object whose output is maintained by using the touch input.

Hereinafter, a method of controlling a plurality of graphic objects at the same time by at least one touch input to any one region when graphic objects are respectively output to a display unit divided into a plurality of regions will be described. FIGS. 7A, 7B, and 7C are conceptual diagrams illustrating a method for simultaneously controlling a plurality of graphic objects output to the display unit.

The control unit 180 may divide the display unit into a plurality of areas by a multi-touch input (for example, an input to which the first touch input and the second touch input are simultaneously applied). At this time, the display unit 151 may be divided into a first area 151a and a second area 151b.

Also, the controller 180 may output graphic objects related to each other in the first area and the second area. For example, the graphic objects output to the first area and the second area may be images of the same object.

At this time, the user may apply at least one touch input to edit the graphic object output to the first area 151a. The at least one touch input may be a pinch-in, a pinch-out, a double touch, or a drag input. For example, as shown in FIG. 7 (a), the at least one touch input may be a pinch-in input.

When the at least one touch input is applied, the control unit 180 may execute an editing function corresponding to the at least one touch input. The editing function may include enlarging, reducing, cutting, pasting, and moving a graphic object output to the display unit. For example, the editing function corresponding to the at least one touch input may be a function of enlarging a graphic object being output in an area to which the at least one touch input is applied.

Meanwhile, the at least one touch input may be applied to only one of the first area 151a and the second area 151b. At this time, the controller 180 not only controls the area (e.g., the first area) to which at least one touch input is applied, but also the area (e.g., the second area) The output graphic object can also apply an editing function corresponding to the at least one touch input.

For example, referring to Figure 7 (b), the user may apply a pinch-in input to the first area. At this time, as shown in (c) of FIG. 7, the controller 180 may enlarge the graphic object 700a output in the first area. In addition, the controller 180 may enlarge the graphic object 700b of the second area corresponding to the enlarged graphic object.

Although not shown, the controller 180 may output a guide image to each area so that the graphic objects output to the display unit 151 divided into the plurality of areas can be more easily compared. The guide image may be a line image segmented by a grid.

When the graphic object is enlarged, the controller 180 may recognize at least one region of the remaining graphic objects different from any one of the graphic objects based on one of the graphic objects of the enlarged graphic objects. In an embodiment, in order to recognize at least one other area, the control unit 180 may use an image recognition function.

If the at least one other area is recognized, the control unit 180 may output notification information informing at least one other area on the plurality of graphic objects. For example, the notification information may be a circular indicator in the changed area portion.

For example, as shown in (c) of FIG. 7, when one area of two graphic objects output to the display unit 151 is enlarged, the controller 180 controls the enlarged areas 700a and 700b ), It is possible to detect different image areas using the image recognition function. At this time, the controller 180 may output circular indicators 710a and 710b to the different image areas.

When a plurality of images are output to the display unit 151, the control unit 180 controls the display unit 151 to display at least one different image Area can be detected.

For example, as shown in FIG. 7C, two graphic objects may be output to the display unit 151. At this time, the controller 180 may detect at least one different image area 720a, 720b, 730a, and 730b using the image recognition function for the two graphic objects.

When the at least one different image area 720a, 720b, 730a, 730b is detected, the control unit 180 controls the at least one different image area 720a , 720b, 730a, and 730b. In this case, the user may apply touch input to any one of the at least one image region 720a, 720b, 730a, and 730b.

When the touch input is applied, the controller 180 enlarges the area 720 to which the touch input is applied and outputs the enlarged area 720a and 740b. At this time, the touch input may be applied to any one of the two graphic objects 720a and 720b. In this case, when any one of the two graphic objects 720a and 720b is applied, the controller 180 controls the area 720a of the graphic object to which the touch input is applied and the area 720b of the graphic object to which the touch input is applied It is possible to enlarge and output the area 720b of the graphic object to which the touch input is not applied.

For example, as shown in FIG. 7C, a user may apply a touch input to a graphic object 720a of one of two graphic objects 720a and 720b. At this time, the controller 180 determines whether or not the area 720a of the graphic object to which the touch input is applied and the area 720b of the graphic object to which the touch input is not applied, which corresponds to the area of the graphic object, It is possible to enlarge and output (740a, 740b).

 In the above, a method of editing a graphic object divided into a plurality of regions has been described. Accordingly, the user can simultaneously control the remaining graphic objects by touching only one graphic object.

Further, in the present invention, when the plurality of graphic objects are output, different image regions may be detected, and the detected result may be notified to the user. This makes it possible to compare the graphical objects of the user or the plurality of graphical objects more conveniently and intuitively.

Hereinafter, a method of controlling a plurality of graphic objects when they are output to the display unit will be described. 8A and 8B are conceptual diagrams illustrating a case where a plurality of graphic objects are output as a list on the display unit.

The control unit 180 may change the output states of the plurality of graphic objects according to the first and second touch inputs applied to the display unit. For example, while the control unit 180 maintains the output position of the graphic object output in the first touch input region among the plurality of graphic objects, the control unit 180 controls the output position of the graphic object other than the graphic object, Can be changed.

Referring to FIG. 8A, a plurality of graphic objects may be output to the display unit 151. FIG. At this time, a first touch input may be applied to any one of the plurality of graphic objects. The second touch input may be applied to the display unit 151 while the first touch input is being held. In this case, the control unit 180 may set the output position of the graphic object to which the first touch input is applied to be fixed, and, in response to the second touch input, The output position of the graphic object of the graphic object can be changed.

Here, referring to FIG. 8 (b), it can be seen that the output positions of graphical objects other than the graphic object to which the output position is fixed are changed. At this time, at least one graphic object of the plurality of graphic objects other than the graphic object to which the output position is fixed may no longer be output to the display unit 151. At the same time, at least one graphic object that has not been output to the display unit 151 may be output.

On the other hand, the graphic object to which the output position is fixed can be changed. For example, in (a) and (b) of FIG. 8, it can be seen that the output position of the first graphic object is fixed. At this time, as shown in (c) of FIG. 8B, the user can apply the first touch input to the third graphic object. The user can apply the second touch input to the display unit 151 while keeping applying the first touch input to the third picture. In this case, the controller 180 may fix the output position of the third graphic object to which the first touch input is applied. In addition, the output position of the graphic object other than the third graphic object whose output position is fixed can be changed.

Meanwhile, the method of changing the output position of the plurality of graphic objects may be performed in a predetermined order. For example, as shown in FIG. 8A, when the second touch input is a flicking input moving from the lower end to the upper end of the display unit, the position of the plurality of graphic objects is changed in a direction corresponding to the second touch input Lt; / RTI >

In the above, a method of controlling the output state of each graphic object when a plurality of graphic objects are output has been described. Accordingly, the user can change the output position of the remaining graphic objects while fixing the output position of the desired graphic object among the plurality of graphic objects.

Hereinafter, a method of selectively grouping a plurality of graphic objects will be described. Figures 9A and 9B illustrate a method of grouping at least some of a plurality of graphical objects.

The control unit 180 may group at least some of the plurality of graphic objects output to the display unit 151 in order to select a comparison object. At this time, the user can select a graphic object to be grouped among a plurality of graphic objects. The selection of the graphic object to be grouped may be performed by a third touch input different from the first and second touch inputs. For example, the third touch input may be a short touch input different from the first and second touch inputs.

Referring to FIG. 9A, a user may select at least a part of a plurality of graphic objects output to the display unit 151 by a third touch input. When the selection is completed, the controller 180 may output only the selected graphic objects 910a, 910b, and 910c to the display unit 151 as shown in FIG. 9 (b).

 As another method of grouping at least some of the plurality of graphic objects, referring to FIG. 9B, there may be a method using a multi-touch. For example, the user may apply a first touch input to any one of the plurality of graphic objects, as shown in (a) of FIG. 9B. The third touch input may then be applied to at least a portion of the remaining graphics objects. At this time, the controller 180 may group the graphic objects to which the first and third touch inputs are applied, based on the third touch input being applied while the first touch input is maintained. Then, the control unit 180 may output only the grouped graphic objects among the plurality of graphic objects, as shown in (b) of FIG. 9B.

In the above, a method of grouping a plurality of graphic objects has been described. Hereinafter, a method of using the grouped graphic objects will be described in more detail. 10A and 10B are conceptual diagrams illustrating a method of controlling the grouped graphic objects.

Referring to FIGS. 10A and 10B, the control unit 180 may group at least some of the plurality of graphic objects. At this time, only the grouped graphic objects may be output to the display unit 151. [

The user may apply a first touch input to any one of the graphic objects output to the display unit 151. [ If the second touch input is applied while the first touch input is maintained, the display unit 151 may display the first area 151a and the second area 151b as shown in FIG. 10 (c) And 151b, respectively. At this time, in one embodiment, a graphic object located in the area to which the first touch input is applied may be output to the first area, and a graphic object of any one of the grouped graphic objects may be output to the second area.

Thereafter, the user can again apply the second touch input to the second area 151b. In this case, as shown in FIG. 10 (d), the controller 180 may output a graphic object that is not output to the current display unit among the grouped graphic objects, corresponding to the second touch input . That is, the controller 180 may output only the grouped graphic objects as related graphic objects.

10B, when the selection of the group is completed, the controller 180 displays any one of the graphic objects belonging to the group on the front side of the display unit 151 And output the graphic object belonging to the remaining group to one area of the display unit 151. [

Thereafter, the controller 180 may delete or store the graphic object using the touch input of the graphic object of the user. For example, as shown in (b) of FIG. 10, it is possible to move the position of one of the grouped graphic objects output to one area of the display unit 151 through a drag input have. At this time, when moving to the area for selecting the graphic object, the graphic object can be selected. For example, the selection area of the graphic object may be the upper area of the display unit 151.

 As another example, as shown in (c) of FIG. 10, it is possible to move to a region to be deleted through a drag input for any one of graphic objects output to one area of the display unit 151 have.

When the selection of the grouped graphic object is completed, only the selected graphic object can be output to the display unit 151 as shown in (d) of FIG.

In the above, a method of controlling grouped graphic objects has been described. A user can group only desired graphic objects among a plurality of graphic objects, and edit only the grouped graphic objects.

Hereinafter, a case where multi-touch input is performed during execution of the camera application will be described. 11 is a conceptual diagram for explaining a case where a multi-touch input is applied during execution of a camera application.

The user can run the camera application to take an image. For example, as shown in FIG. 11 (a), the user can execute the camera application.

Thereafter, the user can apply the first touch input to the photographing button during execution of the camera application. In addition, the user can apply the second touch input to the display unit 151 while the first touch input is maintained. For example, as shown in FIG. 11 (b), the user may apply a flicking input to at least one area of the display unit 151 in a state in which a long touch input is applied to the photographing button.

The controller 180 may output an image captured immediately before at least one area of the display unit in response to the second touch input.

At this time, referring to FIG. 11C, the controller 180 may divide the display unit into a plurality of areas. For example, the display unit 151 may be divided into a first area for outputting the image received from the camera and a second area for outputting the previously captured image.

In the foregoing, a method of controlling the display unit using the multi-touch input during the execution of the camera application has been described. Thus, the user can shoot the image while comparing with the previous shooting amount in real time even during shooting of the camera.

Meanwhile, the mobile terminal according to an exemplary embodiment of the present invention may include a display unit 151 on the front side of the mobile terminal. For example, referring to FIG. 12, the mobile terminal of the present invention may not include the configuration of the user input unit 131 on the front surface of the mobile terminal, unlike the mobile terminal of FIG. Instead, the display unit 151 may be located at the position of the user input unit 131. [

In the case of a mobile terminal having no configuration of the user input unit 131, screen information having the function of the user input unit 131 may be output to an area corresponding to an area where the user input unit 131 is located. Accordingly, the user can use the function of the user input unit 131 without using the user input unit 131, using the screen information output to the display unit.

Hereinafter, it is assumed that the mobile terminal does not include the user input unit 131 but is a mobile terminal including a display unit 151. FIG. 13 is a flowchart illustrating a method of controlling a mobile terminal according to an embodiment of the present invention. FIG. 14 is a conceptual diagram illustrating the control method of FIG.

The mobile terminal according to an exemplary embodiment of the present invention may perform a step of outputting a plurality of function keys associated with the operation of the mobile terminal to the display unit (S1310).

The operation of the mobile terminal may be any operation that can be performed in the mobile terminal, such as an operation of executing an application, an operation of outputting a home screen screen, an operation of setting a system, and the like.

At this time, a plurality of function keys associated with the operation of the mobile terminal may be output to at least a part of the display unit. At this time, the function associated with the operation of the mobile terminal may correspond to the function key. For example, the function associated with the operation of the mobile terminal may include an execution cancel function of the operation being performed in the mobile terminal, a function of returning to the home screen screen of the mobile terminal, a function of entering the system setting of the mobile terminal This can be.

Meanwhile, when the application is currently being executed in the mobile terminal, the plurality of function keys may be changed to the function corresponding to the application being executed. For example, when the web browser application is executed on the mobile terminal, the plurality of function keys may be changed to a function key having a function related to the web browser. For example, the function associated with the web browser may be a function of returning to a previous screen of a currently displayed screen.

Thereafter, when a first touch is applied to any one of the plurality of function keys, the mobile terminal according to the embodiment of the present invention outputs information related to the one function key to one area of the display unit (S1320).

In the mobile terminal according to the present invention, the plurality of function keys may be output to the display unit. At this time, the user can execute functions corresponding to the plurality of function keys through touch input to the plurality of function keys.

The functions corresponding to the plurality of function keys may be performed in different functions depending on the type of the touch input. For example, when a short-touch input is applied to the plurality of function keys, the basic functions of the plurality of function keys can be executed. Here, the basic function may mean a function inherently possessed by the plurality of function keys.

At this time, when the short touch input and the long touch input are applied to the plurality of function keys, information related to the plurality of function keys may be output. The information associated with the plurality of function keys may be information related to the basic function. For example, if the basic function is a function returning to the immediately preceding function of the currently executed function, the related information may be a list of functions that have been previously executed. As another example, if the basic function is a function of outputting the address of a frequently visited website, the related information may be a list of the frequently visited website addresses. As another example, if the basic function is a function to return to the home screen page, the related information may be a list of applications currently running on the mobile terminal.

When a first touch is applied to any one of the plurality of function keys, information associated with the one function key may be output to one area of the display unit. At this time, the related information can be overlapped on the screen currently being output to the display unit 151 and output. The related information may be output to one area of the display unit and may be output together with other information that may be output to the display unit 151. [

In the state where the first touch is maintained, the mobile terminal according to an embodiment of the present invention may correspond to the second touch different from the first touch with respect to the output information, The function may be executed (S1230).

The mobile terminal according to the present invention may further include a sensing unit sensing at least two touch inputs at the same time. At this time, as described above, the input to which the at least two touch inputs are simultaneously applied may be a multi-touch input.

When a second touch is applied to the related information in a state where the first touch is continuously detected with respect to the display unit 151, the control unit 180 controls the function corresponding to the information to which the second touch is applied Can be executed.

The function corresponding to the information to which the second touch is applied may be a function of executing an application corresponding to the information. For example, when the second touch is a frequently visited website address (e.g., a favorite address), the second touch may access the web site represented by the information based on the second touch being applied . In this case, the display unit 151 may output an execution screen of the connected website.

Here, the second touch may be a predetermined type of touch input. For example, the second touch may be an input for dragging the output information. The drag input may be an input that moves in various directions, such as top to bottom, top to bottom, left to right, right to left, and diagonal.

In the meantime, the present invention can perform different functions according to the direction of the second touch. For example, if the second touch is a drag input that moves the output information downward, a function of deleting the output information may be performed.

The control method will be described in more detail with reference to FIGS. 14A and 14B. Referring to FIG. 14A, a web browser application 1430 may be executed in the mobile terminal according to the present invention.

When the web browser application is executed 1430, a plurality of function keys associated with the mobile terminal may have functions related to the web browser application. For example, the functions related to the web browser application may be a function of returning to the previous screen of the current screen, a function of returning to the next screen of the current screen, a function of returning to the home, a function of adding a new window, .

At this time, the user can apply the first touch 1410 to any one of the plurality of function keys. The first touch may have various touching methods such as a long touch, a double touch, and a flicking. For example, as shown in FIG. 14 (a), the first touch 1410 may be a long touch. For example, the key to which the user applies the first touch may be a function key that returns to the previous screen among the plurality of function keys.

In the state where the first touch is maintained, referring to FIG. 14B, information 1440 related to the first touch may be output. At this time, the information may be output in various ways. For example, the information can be overlapped on the screen information output to the display unit 151 at present. Further, the information may be output to an area adjacent to the area where a plurality of function keys are output. Further, the information may be output in a thumbnail image format.

As shown in FIG. 4B, when the information is output, the user can apply a second touch 1420 different from the first touch to the information in a state where the first touch is maintained have. For example, the second touch may be a drag input different from the long touch. The drag input may be an input for moving the output information to the center of the display unit 151. [

When the second touch is applied, the controller 180 can execute a function corresponding to the second touch. For example, referring to (c) of FIG. 14, when the second touch is applied, the controller 180 may execute an application corresponding to the information to which the second touch is applied (1440). For example, if the information to which the second touch is applied is a web browser address, the controller 180 can access the web browser. At this time, the display unit 151 may display an execution screen 1440 of the connected web browser.

In another embodiment of the present invention, referring to (a) of FIG. 14, a home screen page 1450 may be output to the display unit 151. In this case, the plurality of function keys associated with the mobile terminal may be a function key for canceling a currently executed function, a function key for entering a home screen page, and a system setting function key of the mobile terminal.

In one embodiment, a user may apply a first touch 1410 to a key that enters the home screen page 1450 of the plurality of function keys, as shown in FIG. 14B (a). At this time, the controller 180 may output information related to a key entering the home screen page in response to the first touch 1410. For example, referring to Figure 14 (b), the functionality associated with the home screen page may be a list of applications currently running on the mobile terminal.

Referring to (b) of FIG. 14, in a state in which the application list is output, the user can apply a second touch 1420 to any item 1460 of the list. At this time, the second touch may be a touch input different from the first touch. For example, the second touch may be a drag input for moving any one of the items to the center of the display unit 151.

Referring to (c) of FIG. 14, when the second touch is applied, the controller 180 can execute a function corresponding to any one of the items. For example, if any of the items corresponds to a web browser application, the controller 180 may execute the web browser application 1460.

In the above description, based on the first touch for a plurality of function keys, information relating to any one of the keys to which the first touch has been applied is output, and in a state where the first touch is maintained, The function corresponding to the information to which the second touch has been applied is executed based on that the second touch different from the first touch is applied. The present invention provides a mobile terminal including a display unit having a front surface of a mobile terminal and a plurality of function keys associated with an operation of the mobile terminal in one area of a display unit, Can be used in combination.

Hereinafter, it is determined whether or not information related to the function key to which the first touch is applied is determined depending on whether the first touch input is maintained or not. FIG. 15 is a conceptual diagram for explaining whether or not the information is output according to whether or not the first touch is maintained.

The user may apply the first touch 1410 to any one of the plurality of function keys. When the first touch 1410 is applied, the controller 180 may output information related to the function key to which the first touch 1410 is applied. For example, referring to FIG. 15A, the plurality of function keys include a function of returning to the previous screen of the current screen, a function of returning to the next screen of the current screen, a function of returning to the home, A favorite function, and the like. At this time, the user can apply the first touch 1410 to the function key returning to the previous screen of the current screen, as shown in (a) of FIG.

When the first touch 1410 is applied, the controller 180 may output information related to the function key, that is, the function key returning to the previous screen of the current screen 1430. At this time, the related information may be a plurality of web browser information previously accessed by the user. The web browser information may be output in various ways. For example, referring to FIG. 15B, the web browser information 1470a, 1470b, and 1470c may be output in a thumbnail format.

At this time, the user may not apply the first touch. If the first touch is no longer detected, referring to FIG. 15 (c), the controller 180 may not output the information related to the function key.

In the above, a method of outputting information related to the function key only in a state in which the first touch is maintained has been described. Accordingly, the user can output information only when the first touch is applied.

Hereinafter, different functions are executed according to the second touch method. 16A, 16B, and 16C are conceptual diagrams showing a method of editing the output information using a second touch.

The mobile terminal according to an exemplary embodiment of the present invention may match various functions according to a touch method. For example, according to the second touch method, functions such as addition, deletion, position change, grouping, etc. of output information can be matched.

In one embodiment, referring to FIG. 16A, a web browser application 1430 may be running in a mobile terminal according to the present invention. Referring to FIG. 16A, a plurality of function keys may be output to one area of the display unit 151. FIG. For example, the plurality of function keys may be a function of returning to a previous screen of the current screen, a function of returning to the next screen of the current screen, a function of returning to the home, a function of adding a new window, a favorite function, and the like. At this time, the user can apply the first touch 1410 to any one of the plurality of function keys. For example, the user may apply a first touch 1410 to a function key having a favorite function.

The control unit 180 may output information 1610a, 1610b, and 1610c related to the function key to which the first touch 1410 is applied, corresponding to the first touch 1410. [ Information 1610a, 1610b, and 1610c associated with the function key to which the first touch 1410 is applied may be information related to the favorite function. For example, the information related to the favorite function may be a plurality of pre-stored favorite web browser address lists 1610a, 1610b, and 1610c.

At this time, the user can apply the second touch to the web browser page being currently displayed on the display unit 151 while maintaining the first touch. When the second touch is applied, the control unit 180 can execute the matched function on the information related to the applied function key of the first touch. For example, the control unit 180 may add an item to the information list related to the function key to which the first touch is applied.

For example, as shown in (b) of FIG. 16, an input for dragging a page currently displayed on the display unit 151 to the areas 1610a, 1610b, and 1610c to which information related to the favorite function is output Can be added. Thereafter, referring to (c) of FIG. 16, corresponding to the second touch being applied, the control unit can execute the function matched to the second touch. For example, the matching function may be a function of adding a current web browser address to a favorite. In one embodiment, as shown in FIG. 16 (c), the controller 180 may add 1610d the currently output web browser page to the favorite web browser address list. In addition, as shown in (c) of FIG. 16, when the web browser is added to the web browser address list, the controller 180 may output notification information 1600 indicating that the web browser is added to the web browser list.

The second touch may correspond to a function of grouping the output information. In one embodiment, referring to FIG. 16B, the second touch may have a function of grouping the output information.

For example, as shown in FIG. 16B (a), the control unit 180 determines whether any one of the plurality of function keys is operated based on the first touch 1410 for one of the plurality of function keys Information on the function key of the display unit 151 can be output to one area of the display unit 151. [ For example, one of the function keys may be a function key for returning to a previous screen in the current screen. At this time, the information related to any one of the function keys may be a list of web browser addresses to which the user has previously accessed.

At this time, when the second touch is detected for an arbitrary item in the web browser address list, the controller 180 may execute the matching function of the second touch 1420. [ For example, the second touch may be a drag input for moving one of the output information to an area where the other one is output. At this time, the function matched to the second touch 1420 may be a function of grouping the items to which the second touch is applied.

For example, as shown in (a) of FIG. 16B, an input to drag one of the items of the web browser address list to another item may be applied. The control unit 180 may group and output one or more pieces of information. For example, as shown in (b) of FIG. 16B, the controller 180 groups (1470e) another item different from any one of the items to which the second touch 1420 is applied .

Also, the second touch 1420 may correspond to a function of deleting any one of the output information. Referring to FIG. 16C, the second touch 1420 may have a function of deleting information applied by the second touch 1420 from the output information.

For example, as shown in (a) of FIG. 16C, when the first touch 1410 is applied to the function key returning to the previous page of the current page, The web browser page list 1470a, 1470b, and 1470c that were accessed before the current page.

At this time, a second touch input may be applied to any one of the web browser page lists 1470a, 1470b, and 1470c to the web browser page 1470c. For example, the second touch 1420 may be an input for dragging any one of the web browser pages 1470c toward the lower side of the display unit 151. [ In this case, the control unit 180 may not output any one of the web browser pages 1470c to the display unit 151 as shown in (c) of FIG.

In the foregoing, a method of editing the output information using the second touch has been described. Through this, the user can conveniently edit the information with only the touch.

Hereinafter, a method of controlling the information output from the display unit using the multi-touch input will be described. 17 illustrates a method of editing a memo stored using a multi-touch in a mobile terminal on which a memo application is executed.

The control unit 180 may perform various control operations using the multi-touch input applied to the display unit 151. In one embodiment, the control unit 180 may execute a function of merging information using the multi-touch input.

For example, referring to FIG. 17A, a memo list 1710a, 1710b, 1710c, 1710d, 1710e, and 1710f stored in a memo application may be output to the display unit 151. [ At this time, in order to store similar memos of the memorized memorized memories together, the user can use multi-touch input. In one embodiment, the controller 180 may sense a first touch on any item 1710a of the memo list output to the display unit 151. [ At this time, the first touch may be a long touch. In a state in which the first touch 1410 is sensed, the controller 180 may sense the second touch with respect to the other item 1710b. At this time, the second touch 1420 may be a drag. The second touch may be a drag input for moving the first touch to one of the items to which the first touch is applied.

When the multi-touch input is sensed, the controller 180 may execute a function corresponding to the multi-touch input. For example, as shown in (b) of FIG. 17, the controller 180 may merge the items to which the first touch is applied and the items to which the second touch is applied, and store them together (1720).

In the foregoing, a method of editing information using multi-touch has been described. With this, information can be edited only by touching without entering a separate editing mode.

The present invention can output the graphic object related to the graphic object to another area of the display unit while maintaining the output state of the graphic object output to one area of the display unit using the multi-touch input applied to the display unit . Through this, the user can compare the graphic objects output in the two areas at a time.

In addition, the present invention can change the output position of the remaining graphic objects while fixing the output position of any one of the plurality of graphic objects, in a display unit including a plurality of graphic objects. Through this, the user can change the output of the remaining graphic objects while maintaining the output of the desired graphic object.

In the mobile terminal of the present invention, when a front surface is constituted by a display unit, a plurality of function keys associated with the operation of the mobile terminal are outputted to one area of the display unit, thereby linking the plurality of function keys with the screen information output to the display unit And a method of using it.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

Claims (10)

A display unit for outputting a graphic object;
A sensing unit for sensing a touch input applied to the display unit,
When the first touch input and the first touch input applied to the display unit are held by the sensing unit and a second touch input different from the first touch input is sensed,
In a state in which the output of the graphic object being output in the area to which the first touch input is applied is maintained,
And outputting at least one other graphic object related to the graphic object in which the output is held in at least one region of the display unit corresponding to the second touch input. The method according to claim 1,
Wherein the controller divides the display unit into a plurality of areas when the first and second touch inputs are sensed,
The graphic object being output in the first area of the plurality of areas to which the first touch input is applied is output,
And a graphic object different from the graphic object is output to a second area of the plurality of areas. 3. The method of claim 2,
When the second touch input is applied to the display unit again,
Wherein the second area displays a graphic object different from the graphic object output in the second area corresponding to the second touch input. 3. The method of claim 2,
Wherein the first and second touch inputs are different touch inputs,
After the first and second touch inputs are detected, the display unit is divided into a plurality of areas,
When the second touch input is applied to the first area in a state where the first touch input is applied to the second area,
Wherein the graphic object output to the second area is maintained by the first touch input,
Wherein the graphic object output to the first area is changed to another graphic object related to the graphic object output to the second area. 3. The method of claim 2,
When a graphic object output to the first area is enlarged corresponding to at least one touch applied to the first area,
Wherein the controller enlarges the graphic object of the second area in accordance with the enlargement of the graphic object output in the first area. The method according to claim 1,
Wherein the display unit includes a plurality of graphic objects,
The control unit
Based on that the first and second touch inputs are applied,
The output position of the graphic object to which the first touch input is applied is fixed,
And changes the output position of the graphic object excluding the graphic object to which the output position is fixed based on the second touch input being applied. The method according to claim 6,
The control unit
Wherein at least one graphic object of the plurality of graphic objects output to the display unit disappears on the display unit in response to the output position of the graphic object being changed by the second touch input,
And outputs at least one new graphic object that has not been output to the display unit in response to disappearance of the at least one graphic object. The method according to claim 1,
Wherein the graphic object is plural,
The control unit
Sets at least two graphic objects of the plurality of graphic objects as a group according to a user's selection,
And outputs the graphic object included in the set group among the plurality of graphic objects on the display unit. 9. The method of claim 8,
Wherein the setting of the group is performed by a third touch input different from the first and second touch inputs of the plurality of graphic objects. 9. The method of claim 8,
Wherein the display unit includes graphic objects included in the set group,
When the first and second touch inputs are detected for the graphic objects included in the set group,
Wherein the control unit maintains the output of the graphic object to which the first touch input is applied among the graphic objects included in the set group and selects one of the graphic objects other than the graphic object to which the first touch input is applied, And outputs the graphic object.

Images