KR20140005636A - Mobile terminal and control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal for controlling a screen image output to a display unit by using a touch input, and a control method thereof, the display unit outputting a first screen image, and a first touch input to the first screen image. Alternatively, when the user input unit receives a second touch input and the first touch input, the display unit converts the first screen image into a second screen image and receives the second touch input. The display unit may include a controller configured to output information regarding the second screen image (hereinafter, “additional information”) together with the first screen image.

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal for controlling a screen image output to a display unit using a touch input and a control method thereof.

A terminal can be divided into a mobile or portable terminal and a stationary terminal depending on whether the terminal is movable or not. The mobile terminal may be further classified into a handheld terminal and a vehicle mount terminal according to whether a user can directly carry it.

As the functions of such terminals are diversified, they are implemented in the form of a multimedia player having complex functions such as photographing and photographing of movies, reproduction of music and video files, games, and broadcasting reception . Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

Thanks to this improvement, contents including text, images, video, audio, and the like may be output to the display unit of the terminal. In this case, since the amount of data of the contents is larger than the size of the display, only some data of the contents may be output to the display.

In this case, the remaining data not displayed on the display unit may be output to the display unit only when a separate control input is received. For example, when a click input or a scroll input for link information is received in the first screen image, data not included in the first screen image may be output to the display unit.

However, even in this case, due to the limitation of the display unit, a screen image completely different from the first screen image may be displayed on the display unit. Therefore, in order to check the information related to the first screen image, the user has no choice but to repeatedly move the screen image using a user input or the like. That is, it is impossible to check related contents in one screen image.

The present invention is to solve the above problems, and to implement a mobile terminal and its control method for outputting the first screen image and the additional information associated with the first screen image together with the display unit.

One embodiment of the invention relates to a mobile terminal. The mobile terminal may include a display unit for outputting a first screen image, a user input unit for receiving a first touch input for the first screen image, or a second touch input for reducing the first screen image, and the first touch input When receiving the first screen image is converted to the second screen image to the display unit, when receiving the second touch input, the reduced first screen image is output to the display unit, the reduced And a controller configured to output information (hereinafter, “additional information”) related to the second screen image to the remaining areas other than the first screen image.

As an example related to the present disclosure, when the second touch input is received, the controller may output the first screen image to the preset first area of the display unit. The user input unit may receive an input for at least one of a position and a size of the first area, and the controller may reset the first area in response to the input for the at least one. The controller may change a region for outputting the additional information according to at least one of a position and a size of the first region.

As another example related to the present invention, the first touch input is a scroll input of moving the first screen image vertically or horizontally, and the additional information is not included in the first screen image, but the first touch is performed. It may be a thumbnail for at least one of an image and a video included in the second screen image which is switched by an input.

As another example of the present invention, the first screen image may include link information configured to move to the second screen image, and the first touch input may be a touch input for the link information. The additional information may be a screen shot of capturing the second screen image.

As another example of the present invention, the additional information may be output to the entire area of the display unit, and the first screen image may be output on the additional information. The additional information may include a plurality of pieces of additional information, any one of the plurality of pieces of information may be output to the entire area, the user input unit may receive a third touch input for any one of the plurality of pieces, and the control unit may include the third touch. In response to the input, the one may be switched to the other of the one of the plurality.

As another example related to the present disclosure, the user input unit may receive a transparency setting value for at least one of the first screen image and the additional information and the at least one, and the controller may be configured according to the transparency setting value. The at least one transparency setting state may be changed.

As still another example of the present disclosure, the user input unit may receive a fourth touch input for the additional information while the additional information is output to the display unit, and the controller may include the fourth touch input. In response, the reduced first screen image may be converted into the second screen image.

In addition, an embodiment of the present invention relates to a control method of a mobile terminal. The control method of the mobile terminal may include outputting a first screen image to a display unit, receiving a second touch input for reducing the first screen image or the first screen image for the first screen image, and the first screen image. When the touch input is received, the first screen image is converted into a second screen image, and when the second touch input is received, the reduced first screen image is output to the display unit, and the reduced first screen is displayed. And outputting information about the second screen image (hereinafter, “additional information”) to the remaining regions other than the image.

As an example related to the present disclosure, the outputting of the additional information may include searching for at least one of an image and a video included in the second screen image that is switched by the first touch input. The method may include generating a thumbnail and outputting the additional information corresponding to the generated at least one thumbnail along with the first screen image to the display unit.

As another example related to the present disclosure, the additional information may include a plurality of pieces of information, one of the plurality of pieces of information being output to the entire area of the display unit, and a third touch input for the one of the plurality of pieces of the plurality of pieces of additional information. In response to a touch input, the method may further include converting one of the plurality of devices from one of the plurality to another.

As another example of the present invention, in the state where the additional information is output to the display unit, receiving a fourth touch input for the additional information and in response to the fourth touch input, the reduced first The method may further include converting a first screen image into the second screen image.

According to the present invention, since the additional information related to the first screen image is output to the display unit together with the first screen image, the user can check the related information in one screen image.

Further, according to the present invention, since at least one of the position and the size of the first region where the first screen image is output can be reset, additional information can be output in various ways, and user convenience can be increased. .

According to the present invention, since the first screen image and the additional information are output, the first screen image can be converted into a second screen image corresponding to the additional information. I can move it.

1 is a block diagram illustrating a mobile terminal according to an embodiment of the present invention;
2A and 2B are perspective views showing the appearance of a mobile terminal according to the present invention.
3 is a conceptual diagram illustrating a mobile terminal according to an embodiment of the present invention;
4 is a flowchart illustrating a control method of a mobile terminal according to an embodiment of the present invention.
5 is a flowchart illustrating a control method of outputting additional information along with a first screen image to a display unit according to an exemplary embodiment.
6a to 6f are exemplary views illustrating a mobile terminal according to an embodiment of the present invention.
7A to 7D are conceptual views illustrating a mobile terminal for resetting a first area according to an embodiment of the present invention.
8 is a conceptual diagram illustrating a mobile terminal to which hidden information is output according to an embodiment of the present invention.
9A to 9D are conceptual views illustrating a mobile terminal in which link information is output according to an embodiment of the present invention.
10A to 10B are conceptual views illustrating a mobile terminal to which data structure information is output according to an embodiment of the present invention.
11A and 11B are conceptual views illustrating a mobile terminal according to an embodiment of the present invention.
12 is a conceptual diagram illustrating a mobile terminal according to an embodiment of the present invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art may easily implement the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

Overall configuration

1 is a block diagram illustrating a mobile terminal 100 according to an embodiment of the present invention. 1, a mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, A controller 160, an interface unit 170, a controller 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The position information module 115 is a module for acquiring the position of the mobile terminal 100, and a representative example thereof is a Global Position System (GPS) module.

1, an A / V (Audio / Video) input unit 120 is for inputting an audio signal and a video signal, and may include a camera 121, a microphone 122, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure and static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor may be configured to detect a touch pressure as well as a touched position and area.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, signals corresponding thereto are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

In the case where the touch screen is electrostatic, it can be configured to detect the proximity of the sensing object by a change of the electric field along the proximity of the sensing target. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This can be referred to as a transparent display. A typical example of such a transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The display unit 151 and the sound output module 152 may be classified as a part of the alarm unit 153 because the video signal or the audio signal can also be output through the display unit 151 or the sound output module 152. [

The haptic module 154 generates various tactile effects that the user can feel. Vibration is a representative example of the haptic effect generated by the haptic module 154. The intensity, pattern, and the like of the vibration generated by the hit module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 154 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device, receives power, transfers the power to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software code may be stored in the memory 160 and executed by the controller 180.

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

Organization description

2A and 2B are perspective views showing an appearance of a mobile terminal 100 according to the present invention. FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, the size of the transmission data may be reduced when the user's face is photographed and transmitted to the counterpart in real time. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 'may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). Further, a back display unit for outputting time information can be additionally mounted on the touch pad 135. [ At this time, information output from both sides of the front display unit 151 and the rear display unit can be controlled by the touch pad 135. [

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be positioned parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Referring back to the display unit 151 of the present invention, the controller 180 can adjust the amount of data output to the display unit 151 in consideration of the size of the display unit 151. For example, in outputting one web page, some data may be output to the display unit 151 as a first screen image. The user may output the remaining data to the display unit 151 by moving the first screen image using a scroll input. This is because the total amount of data of the content to be output is larger than the amount of data that the display can output.

In addition, an application or a server may connect data related to the first screen image with the first screen image by using a link such as a hyperlink. For example, in the additional information that is not output on the first screen image, when the user clicks a link such as "detail view", the additional information may be output to the display unit 151.

As described above, due to the limitation of the display unit 151, in order to confirm additional information related to the first screen image, the first screen image may be converted into the screen image including the additional information. Hereinafter, a mobile terminal for outputting a first screen image and additional information related to the first screen image together with the display unit based on the configuration of the mobile terminal described above in detail with reference to FIG. 3. FIG. see.

The first screen image and the additional information related to the first screen image together Output  Mobile terminal

3 is a conceptual diagram illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 3A, the mobile terminal 100 according to the present invention may include a display unit 151 and a screen image output to the display unit 151. In this case, the first screen image 200 corresponds to the screen image output to the entire area of the display unit 151.

When a first touch input with respect to the first screen image 100 is received by the user input unit 130, the controller 180 displays the screen image output to the display unit 151 and the first screen image 200. You can switch to the second screen image from.

The first touch input may be, for example, a touch input such as a click for outputting a second screen image connected by a link with the first screen image. For another example, the touch screen may be a touch input such as a scroll for outputting data not included in the first screen image 200.

In addition, when the second touch input for the first screen image is received by the user input unit 130, the controller 180 provides the additional information 300 together with the first screen image 200 to the display unit 151. ) Can be printed.

In this case, the additional information 300 may be information using data included in the second screen image. For example, the additional information 300 may be a thumbnail of an image or a video included in the second screen image. Alternatively, the additional information 300 may include at least one of text, an image, a video, and audio included in the second screen image. Alternatively, the additional information 300 may be the same as the second screen image or may be a screen shot of capturing or capturing the second screen image by reducing the second screen image.

For example, a thumbnail may refer to an image displayed on a screen by reducing the entire page so that the layout of the entire page may be examined.

For example, the screenshot may refer to an image containing the text as it is output to the display unit of the terminal.

The additional information 300 may be displayed on the display unit using a popup window or an object. The pop-up window may be displayed on the display unit 151 and may refer to a new window that is displayed on the top of data in which layers are accumulated. The object may mean a graphic element such as an icon, a widget, or a thumbnail image. In addition, the additional information 300 may be output as a background screen image on the entire area of the display unit 151.

In this case, the mobile terminal in which the first screen image 200 and the additional information 300 are output to the display unit 151 together will be described later with reference to FIGS. 6A to 6F.

As described above, according to the present invention, since the mobile terminal 100 may output the additional information 200 to the display unit 151 together with the first screen image 200, the user may select one image from one screen image. 1 screen image and related information can be checked. Therefore, information that can be output to the display unit 151 can be easily checked without moving the screen image. In addition, this additional information may be utilized as a bird's eye view.

4 is a flowchart illustrating a control method of a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 4, the method for controlling a mobile terminal includes outputting a first screen image to a display unit (S100). The first screen image may be one of the screen images output to the display unit 151. Accordingly, the first screen image may be, for example, a screen image output to the entire area of the display unit 151 by a browser, a searcher, an application, or the like.

Next, an operation (S200) of receiving a touch input for the first screen image may be performed. Next, a step (S300) of comparing whether the touch input corresponds to one of the first and second touch inputs may be performed. Such a touch input may be received by the user input unit 130.

As described above, the first touch input refers to a user input for converting the first screen image into the second screen image. For example, the first touch input may be one of a click on a link and a scroll that moves the screen image of the display unit 151 to the left or right or up and down.

The second touch input refers to a user input for simultaneously outputting the first screen image and the additional information. An embodiment of the second touch input is as follows.

For example, the second touch input may be a touch input for reducing the first screen image. That is, the second touch input may be a touch input in which a touch input is received at the first and second touch points and the interval between the first and second touch points is narrowed.

For another example, the second touch input may be a touch input for a control menu output to the display unit 151. A control menu for separately outputting the first screen image and the additional information may be provided, and a touch input for the control menu may be referred to as a second touch input.

As another example, the second touch input may be a multi-touch input for the first screen image. When a predetermined number of touch inputs are repeatedly received in a predetermined region, this may be referred to as a second touch input.

Next, when the touch input is the first touch input, the step S420 of converting the first screen image into the second screen image may be performed. In contrast, when the touch input is the second touch input, the step S460 of simultaneously outputting the first screen image and the additional information may be performed.

5 is a flowchart illustrating a control method of outputting additional information along with a first screen image to a display unit according to an exemplary embodiment.

Referring to FIG. 5, the step of outputting the first screen image and the additional information together (S460) may include searching for at least one of an image and a video included in the second screen image (S462). The controller 180 may search for at least one of an image and a video included in the second screen image, and exclude the overlapping image or video from the search target.

In this case, the controller 180 may search for the second screen image. This is because there may be a plurality of second screen images that are switched from the first screen image in response to the first touch input. The controller 180 may search for an image or the like with respect to the screen images corresponding to the second screen image. Alternatively, an image included in any one of all screen images corresponding to the second screen image may be searched. Embodiments related to this will be described later with reference to FIGS. 8 to 10.

Next, the method may include generating a thumbnail for at least one of an image and a video included in the second screen image (S464). For example, if an image is found, the size of the image may be reduced and generated as a thumbnail. In contrast, if a video is searched, any one of several images constituting the video may be generated as a thumbnail. Alternatively, a preview screen of the video may be generated as thumbnails.

Next, the method may include outputting the thumbnail to the display unit together with the first screen image (S464). There may be at least one thumbnail. An embodiment in which at least one thumbnail is output to the display unit together with the first screen image will be described later with reference to FIGS. 6A to 6F.

Although not shown in the drawings, the mobile terminal 100 according to the present invention may receive a transparency setting value for at least one of the first screen image and the additional information using the user input unit 130.

A mobile terminal for outputting the first screen image and additional information together

6A to 6F are exemplary views illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 6A, the first screen image 200 and the additional information 300 may be output together on the display unit 151 of the mobile terminal 100. The additional information 300 may be output as a background screen on the entire area of the display unit 151, and the first screen image 200 may be output on the additional information 300.

In this case, the first screen image may be output to the preset first area of the display unit 151. The first screen image may be reduced according to the size of the first area. At least one of the position and size of the first area may be reset by a user input, and the reset method will be described later with reference to FIGS. 7A to 7D.

Referring to FIG. 6B, a plurality of additional information 300 and 310 may be provided. In this case, the first screen image 200 may be output to a partial area of the display unit 151 and additional information 300 and 310 may be output to the remaining area of the display unit 151. In this case, as the area of the first screen image 200 is reduced, the number of additional information output to the remaining area of the display unit 151 may increase, or the size of the additional information output may increase.

Referring to FIG. 6C, the first screen image 200 and the additional information 300 and 310 are output together on the display unit 151, and the first screen image 200 and the additional information 300 and 310 are input by a user input. ) 302 may be output as a background screen on the entire area of the display unit 151.

Referring to FIG. 6D, additional information 300 and 310 may be output at upper and lower ends of the first screen image 200, respectively. In addition, referring to FIG. 6E, additional information 300 and 310 may be output at left and right ends of the first screen image 200, and the first screen image 200 may be output on the additional information 300 and 310. have.

Referring to FIG. 6F, the first screen image 200 and the additional information 300 to 320 may be output together to the display unit 151. In this case, when there is a touch input to any one of the additional information 300 to 320, the first screen image 200 may be switched to any one of the above. Accordingly, information 202 about the first screen image 200 may also be output to the display unit 151.

In addition, in switching the first screen image 200, shortcut icons 710 to 730 may be output to the display unit 151 in order to increase user convenience. At least one icon of the previous screen image 710, the next screen image 720, and the first screen image 730 may be output to the display unit 151.

Mobile terminal for resetting the first area

7A to 7D are conceptual views illustrating a mobile terminal for resetting a first area according to an embodiment of the present invention.

As described above, the first screen image may be output to the first area of the display unit 151. This first region may be preset and stored in the memory 160 from the release stage. Alternatively, the user may set or reset the first area. 7A to 7D illustrate the display unit 151 of the mobile terminal 100 that is output when the user resets the first area.

Referring to FIG. 7A, the controller 180 may classify and output n areas on the display unit 151. The user may select any one of the n areas as the first area 400. The selection of the first area 400 may use a touch input for the area to be selected. The n areas may be preset or may be changed by user input. The n areas may be regularly divided according to the aspect ratio of the display unit 151.

Referring to FIG. 7B, the controller 180 may output the indicator lines 412 to 418 to the display unit 151. The user may move at least one of the leader lines 412 to 418 on the entire area of the display unit 151 using the user input unit 130. The user may reset the areas of the display unit 151 using the leader lines 412 to 418 and select a first area to be used from the reset areas. Referring to FIG. 7B, it can be seen that the first region 400 in which the vertical length is increased.

Referring to FIG. 7C, the user may reset the position of the first area 400 by using the user input unit 130. For example, referring to FIG. 7C, the user may reset the position by dragging the first region output in the middle to the lower left. The controller 180 may reset the position of the first region according to the drag input of the first region received using the user input unit 130 using the coordinates of the display unit 151.

Referring to FIG. 7D, the user may reset the size of the first area 400 by using the user input unit 130. The user may input a touch input corresponding to enlargement or reduction in the first area output in the middle to the user input unit 130. For example, the magnification may be a touch input in which a distance between touch inputs input at the first and second touch points is far from each other. The reduction may be a touch input in which a touch input is received at the first and second touch points and the interval between the first and second touch points is narrowed.

Hereinafter, a specific embodiment to which the present invention is applied to a mobile terminal will be described with reference to FIGS. 8 to 10.

Embodiment of a mobile terminal to which the present invention is applied

8 is a conceptual diagram illustrating a mobile terminal to which hidden infromation is output according to an embodiment of the present invention.

Since the amount of data is larger than the amount of data output to the display unit 151, some data of the content may be output to the display unit 151 as the first screen image 200. In this case, the remaining data that is not output to the first screen image 200 may be referred to as hidden information.

That is, the hidden information may mean information that is output to the display unit 151 when a scroll input for moving the first screen image left or right or up and down is input. When the first touch input to the first screen image 200 is received, the hidden information may be output to the display unit 151 as the second screen image 300.

Referring to FIGS. 8A and 8B, some data of the content 350 corresponding to the web page may be output to the display unit 151 as the first screen image 200. In this case, when a second touch input to the first screen image 200 is input, additional information may be output to the display unit 151 together with the first screen image 200. For example, a thumbnail of at least one of an image and a video included in the hidden information may be output as additional information.

Referring to FIG. 8C, the controller 180 displays thumbnails 332 and 342 corresponding to the images 330 and 340 included in the hidden information together with the first screen image 200 and the display unit 151. ) Can be output.

9A to 9D are conceptual views illustrating a mobile terminal in which link information is output according to an embodiment of the present invention.

The first screen image may include link information connecting the second screen image. When the first touch input for the link information is input, the screen image output to the display unit 151 may be converted from the first screen image to the second screen image. The first screen image including the link information may be applied to various applications.

For example, referring to FIG. 9A, the chat list screen of the chat application may correspond to the first screen image. The chat list screen may include at least one chat item including link information.

Referring to FIG. 9A, chat items 510 and 520 with A and B may be displayed on a chat list screen. At this time, when the first touch input to the chat item 510 with A is input, the controller 180 displays a chat record with A on the chat list screen in the screen image output to the display unit 151. You can switch to Therefore, the screen displaying the chat record with A may correspond to the second screen image. For the same reason, the screen displaying the chat record with B may correspond to the second screen image.

In the chat list screen, when the second touch input is input, the controller 180 can output additional information 512 and 522 to the display unit 151 together with the chat list screen (first screen image 200). have.

In this case, the additional information 512 and 522 may correspond to some data included in the second screen image. For example, referring to FIG. 9A, the controller 180 considers the size of the area for outputting additional information in the display unit 151 and converts chat record contents with A and B into additional information 512 and 522. You can print

For another example, referring to FIGS. 9B and 9C, a mail list screen of a mail application may correspond to the first screen image 200. The mail list screen may include at least one mail item including link information.

9B, the activated mail items 530 and 540 and the deactivated mail item 550 may be displayed on the mail list screen. At this time, for example, when a first touch input for “id@lge.com” 530 is input, the mail list screen may be switched to a mail box screen corresponding to “id@lge.com” 530. have. Therefore, the mail box screen for each mail item constituting the mail list screen may correspond to the second screen image.

In the mail list screen, when the second touch input is input, the controller 180 may output additional information 542 and 552 to the display unit 151 together with the mail list screen (first screen image 200). have. 9B, the additional information may include at least one piece of information such as a sent mail, a received mail, and a trash corresponding to “id@lge.com” 530. The controller 180 may output only the additional information about the activated mail items 530 and 540 to the display unit 151.

Referring to FIG. 9C, the first screen image 200 includes link information of “INBOX” 560, “OUTBOX” 570, and “UPDATES” 580. When there is a first touch input with respect to any one of the link information, the controller 180 converts the first screen image 200 output to the display unit 151 into a second screen image corresponding to any one of the link information. Can be.

When the second touch input to the first screen image 200 is received, the controller 180 outputs at least one of the plurality of screen images corresponding to the second screen image to the display unit 151 as additional information. Can be. Referring to FIG. 9C, the controller 180 may output additional information 562 and 5725 corresponding to the “INBOX” 560 and the “OUTBOX” 570 together with the first screen image 200.

For another example, referring to FIG. 9D, the first screen image corresponding to the whip page may include at least one link information 590, 592, 594, 596, and 598. When the second touch input for the first screen image is input, due to the limitation of the display unit 151, the controller 180 may not output all the additional information corresponding to the second screen images.

In this case, the controller 180 may output shortcut icons or indicators 602 and 604 capable of moving the additional information together with the additional information. The user may output additional information not displayed on the display unit 151 to the display unit 151 by using the shortcut icons or indicators 602 and 604.

For example, when there is a touch input to the left indicator 602, the controller 180 may perform an event of moving additional information one by one to the left. As a result, the additional information 591 for the article 1 590 disappears to the left of the display unit 151, and the additional information for the article 4 596 may appear from the right side of the display unit 151.

For another example, in the entire area of the display unit 151, when a drag input in a left or right direction with respect to a region in which additional information is output is received, the controller 180 outputs according to the direction and intensity of the drag input. You can change additional information.

10A to 10B are conceptual views illustrating a mobile terminal to which data structure information is output according to an embodiment of the present invention. Data structure information may refer to information conceptually setting the relationship between the data. The data structure information may correspond to, for example, a linear structure, a tree structure and a network structure.

Referring to FIG. 10A, data structure information 620 that can be confirmed using a searcher or the like is illustrated. Referring to FIG. 10B, the controller 180 may output information regarding the “B” folder 624 to the display unit 151. In this case, the display unit 151 may output information about subfolders 630 and 640 included in the “B” folder 624 and files as a first screen image. In this case, the subfolders 630 and 640 may include link information. When a first touch input to any one of the subfolders 630 and 640 is received, the controller 180 may output the second screen image corresponding to the one to the display unit 151.

Referring to FIG. 10B, when a second touch input for the first screen image 200 is received, the controller 180 converts file information included in the subfolders 630 and 640 into additional information 632 and 642. The first screen image 200 may be output together with the first screen image 200.

In addition, in an application in which data structure information such as a browser is provided, the controller 180 may use the data structure information to display a previous screen image 740, a next screen image 760, and a top screen image 750. The shortcut icon or indicator for outputting the data may be output to the display unit 151.

For example, when a user input for an indicator for outputting the top screen image 750 is received, the controller 180 displays the first screen image 200 as a "My Computer" folder 622 corresponding to the top parent node. You can switch to the screen image corresponding to. As another example, when a user input for an indicator for outputting the previous screen image 740 is received, the screen image corresponding to the “A” folder 626 may be output to the display unit 151. As another example, when a user input for an indicator for outputting the next screen image 760 is received, the screen image corresponding to the “C” folder 628 may be output to the display unit 151.

Mobile terminal receiving a third touch input for additional information

11A and 11B are conceptual views illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 11A, the mobile terminal 100 according to the present invention may include a display unit 151 and include a first screen image 200 and a plurality of additional information 300 and 310. The controller 180 may output any one of the plurality of additional information 300, 310 to the entire area of the display unit 151. In addition, the first screen image 200 may be output to the first area.

In this case, when the user input unit 130 receives the third touch input for the additional information, the controller 180 displays additional information different from the additional information that receives the third touch input from among the plurality of additional information. You can output to the whole area. Referring to FIG. 11A (a), in response to the third touch input, the controller 180 may convert the first additional information 300 into the second additional information 310.

The third touch input may be, for example, a drag input for additional information. In this case, the screen switching may vary according to the direction and intensity of the drag input. Referring to FIG. 11A (a), if the intensity of the third touch input is weaker than the preset intensity, the controller 180 can output the first additional information 300 and the second additional information 310 together. have.

Referring to FIG. 11B, the controller 180 may output at least one additional information 300 and 310 to the remaining area except the area where the first screen image 200 is output on the display unit 151. . In this case, when receiving the third touch input for the area where the additional information is output, the controller 180 may change the additional information and output the changed information to the display unit 151.

Alternatively, as described above with reference to FIG. 9D, the controller 180 may output a shortcut icon or an indicator together with additional information to the display unit 151 and receive the touch input as a third touch input. have.

Mobile terminal receiving a fourth touch input for additional information

12 is a conceptual diagram illustrating a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 12, the user input unit 130 may receive a fourth touch input with respect to additional information output to the display unit 151. At least one additional information may be output to the display unit 151 and a fourth touch input may be received for any one of them. The fourth touch input may be, for example, a touch input such as a click on additional information or a multi touch.

Referring to FIG. 12, when the fourth touch input for the additional information 310 is received, the controller 180 displays the first screen image 200 output on the display unit 151 corresponding to the additional information 310. It may be switched to the second screen image 312. In addition, the controller 180 may output additional information 202 about the first screen image 200 to the display unit 151. This is to output the first screen image to the display unit 151.

When the fourth touch input for the additional information 310 is received, the controller 180 outputs the second screen image 312 corresponding to the additional information 310 to the entire area of the display unit 151 or the first screen. The screen image 200 may be output instead of the first screen image 200 in the area where the screen image 200 was output.

As described above, according to the present invention, the mobile terminal 100 may output additional information related to the first screen image to the display unit 151 together with the first screen image. Therefore, the user can check related information in one screen image and can quickly search for desired information. According to the present invention, since the first screen image and the additional information are output, the first screen image can be converted into a second screen image corresponding to the additional information. I can move it.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Claims (16)

A display unit configured to output a first screen image;
A user input unit configured to receive a first touch input for the first screen image or a second touch input for reducing the first screen image; And
When receiving the first touch input, the display unit converts the first screen image into a second screen image,
When the second touch input is received, the reduced first screen image is output to the display unit, and information about the second screen image (hereinafter, “addition” is added to the remaining area except the reduced first screen image). Information "). The method of claim 1,
When the control unit receives the second touch input,
And outputting the first screen image to a predetermined first area of the display unit. 3. The method of claim 2,
The user input unit receives an input for at least one of a position and a size of the first area,
The controller is configured to reset the first area in response to an input to the at least one. The method of claim 3, wherein
The control unit changes the area for outputting the additional information according to at least one of the position and size of the first area. The method of claim 1,
The first touch input is a scroll input of moving the first screen image vertically or horizontally.
The second screen image is a mobile terminal, characterized in that the screen image is switched from the first screen image by the scroll input. The method of claim 5, wherein
The additional information is not included in the first screen image, but is a thumbnail for at least one of an image and a video included in the second screen image. The method of claim 1,
The first screen image includes link information set to move to the second screen image.
And the first touch input is a touch input for the link information. The method of claim 7, wherein
And the additional information is a screen shot of capturing the second screen image. The method of claim 1,
The additional information is output to an entire area of the display unit, and the first screen image is output on the additional information. The method of claim 9,
The additional information is plural, and any one of the plural is output to the entire area,
The user input unit receives a third touch input for the one,
The control unit, in response to the third touch input, the mobile terminal, characterized in that for switching the one to the other of the one of the plurality. The method of claim 1,
The user input unit may receive at least one of the first screen image and the additional information and a transparency setting value for the at least one,
The control unit changes the at least one transparency setting state according to the transparency setting value. The method of claim 1,
The user input unit, in a state in which the additional information is output to the display unit, receives a fourth touch input for the additional information,
The controller is configured to convert the reduced first screen image into the second screen image in response to the fourth touch input. Outputting a first screen image to a display unit;
Receiving a first touch input for reducing the first screen image or the first screen image for the first screen image; And
When the first touch input is received, the first screen image is converted into a second screen image,
When the second touch input is received, the reduced first screen image is output to the display unit, and information about the second screen image in the remaining area except the reduced first screen image (hereinafter, “additional information”). Outputting the "). The method of claim 13,
The outputting of the additional information may include:
Searching for at least one of an image and a video included in the second screen image that is switched by the first touch input;
Generating a thumbnail for the at least one; And
And outputting the additional information corresponding to the generated at least one thumbnail along with the first screen image to the display unit. 15. The method of claim 14,
The additional information is plural, and any one of the plural is output to the entire area of the display unit,
Receiving a third touch input for the one; And
And in response to the third touch input, switching the one to the other of the one of the plurality. The method of claim 13,
Receiving a fourth touch input for the additional information while the additional information is output to the display unit; And
And in response to the fourth touch input, converting the reduced first screen image into the second screen image.

Images