KR20150141048A - Mobile terminal and method of controlling the same - Google Patents

Abstract

The present invention is to offer a control method for a mobile terminal by applying control commands to a touch-sensitive unit provided on a side of the terminal, which may include: a main body comprising a front part and a side part; a display unit which includes a first region provided in the front part and a second region that is connected to the first region and is provided on the side part; and a control unit which outputs screen information having a different direction from an output direction of screen information including information related to the screen information at least on a part of the first region when a touch of a previously set method with respect to the second region is sensed in a state in which screen information related to a function running in the terminal is displayed in the first region, wherein the screen information having the different direction is displayed at least on a part of the first region corresponding to the touch of the previously set method with respect to the second region.

Description

[0001] MOBILE TERMINAL AND METHOD OF CONTROLLING THE SAME [0002]

The present invention relates to a mobile terminal including a display unit for receiving a touch input for outputting time information of a terminal.

A mobile terminal is a portable electronic device that is portable and has one or more functions of voice and video call function, information input / output function, and data storing function.

As the functions of the mobile terminal are diversified, the mobile terminal is implemented in the form of a multimedia device having complicated functions such as photographing and photographing of a moving picture, reproduction of a music or video file, and reception of a game and a broadcast.

Researches have been continuing to expand or extend the structure to which the user's control command is applied for design and functional modification of the terminal and to widen the display area for outputting the visual information. Recently, a structure in which a display unit area is extended to a mobile terminal is being developed.

SUMMARY OF THE INVENTION Accordingly, the present invention is directed to a control method of controlling a mobile terminal by applying a control command to a display unit formed on a side of a terminal.

Another aspect of the present invention is to display screen information having at least two output directions on a display unit.

According to an aspect of the present invention, there is provided a display device including a main body having a front surface and a side surface, a first area disposed on a front surface of the main body, and a second area connected to the first area, part; And displaying information related to the screen information in at least a part of the first area when a touch of a predetermined method for the second area is detected in a state where screen information related to a function being executed in the terminal is displayed in the first area, And a control unit for outputting screen information having a direction different from a direction in which the screen information is output, wherein the screen information having the different direction is at least a part of a first area corresponding to a touch of a predetermined method for the second area Is displayed.

In one embodiment, the screen information having the different direction may include information indicating that the screen information has a first output direction, when the screen information is output in a second output direction different from the first output direction, And is screen information to be displayed.

In one embodiment, the control unit may visually distinguish the area including the same information as the screen information having the first output direction among the screen information having the second output direction.

In one embodiment, the control unit controls the display unit to display the screen information having the first output direction and the screen information having the second output direction together.

In one embodiment, when the touch is applied to any one of the areas in which the screen information having the second output direction is displayed, the control unit displays a screen corresponding to the one of the screen information having the first output direction And scrolls the screen information having the first output direction so that information is centered on the first area.

In one embodiment, the second region includes a first sub-region disposed on either side of both sides of the main body and a second sub-region disposed on the other side of the main body, And outputting information related to the screen information in a direction that is different from an output direction of the screen information in an area corresponding to the dragged area of the first area when it is detected that a touch is applied to the second sub area .

In one embodiment, when the touch of at least two points is sensed with respect to any one of the second regions provided on both sides, the control unit may determine that the other direction is a region corresponding to the sensed region And displays the information on the display screen.

In one embodiment, the controller determines a direction in which information related to the screen information is to be output according to a direction in which the predetermined touch is applied.

In one embodiment, the second region includes a first sub-region disposed on either side of both sides of the main body and a second sub-region disposed on the other side of the main body, And a position where information related to the screen information is output is determined on the basis of detection of drag input in different directions with respect to each of the first sub region and the second sub region.

In one embodiment, the screen information displayed in the first area is maintained at an output position independently of the information associated with the screen information being output to at least a part of the first area.

In one embodiment, the image capturing apparatus further includes at least two camera units having different imaging directions, and the control unit is configured to, when the image received from any one of the at least two cameras is displayed on the display unit, When a touch of a preset method is detected in the second area, the camera unit having the photographing direction different from the above one is activated, and the image received from the camera unit having the different photographing direction is outputted to at least a part of the display unit .

In one embodiment, at least two images received from camera units having different photographing directions are displayed together on the display unit, and the control unit displays, based on a request from a user, at least two images And an image of one of the images is captured.

In one embodiment, the controller analyzes screen information displayed in the first area when a touch of a predetermined method is detected in the second area, and analyzes at least a part of the screen information, The screen information of the display device is determined.

In one embodiment, the control unit may be configured such that, in a state in which the screen information having different output directions and information related to the screen information are displayed together in the first area, And does not output information related to the screen information in response.

A method of controlling a mobile terminal having a display unit on a front surface and a side surface, the method comprising: displaying, in a first area disposed on the front surface, screen information related to a function being executed in the terminal, Sensing a touch of a set method; And outputting information related to screen information displayed in the first area to at least a part of the first area in a direction different from a direction in which the screen information is output in response to the touch of the predetermined method, And the information having the different direction is determined in accordance with the direction in which the touch of the predetermined type is applied to the second area.

In one embodiment, the information to be output in the other direction is output to a region of the first region corresponding to an area to which a touch of a predetermined type is applied.

In one embodiment, when the screen information has a first output direction, the information having the different direction is displayed in the first area when the screen information is output in a second output direction different from the first output direction Information to be transmitted.

In one embodiment, an area including the same information as the screen information having the first output direction among the information having the second output direction is visually distinguished from other information and output.

In one embodiment, the screen information having the first output direction and the information having the second output direction are displayed together.

In one embodiment, the information having the second output direction is superimposed on at least a part of the screen information output in the first output direction.

According to the present invention, the direction of the screen information output to the display unit can be made only by a simple operation, and an image having various output directions can be provided to the user.

In addition, the present invention can provide a highly readable screen to the user by changing the output direction of the screen information output to the display unit through the operation on the side display unit.

1A is a block diagram illustrating a mobile terminal according to the present invention.
FIGS. 1B and 1C are conceptual diagrams illustrating an example of a mobile terminal according to the present invention in different directions.
1D is a perspective view of another example of a mobile terminal according to the present invention.
1E is a rear perspective view of the mobile terminal shown in FIG. 1D.
2 is a flow chart illustrating a method for controlling both side display portions of the present invention.
3 is a conceptual diagram showing the control method of FIG.
4A and 4B are conceptual diagrams illustrating the relationship between screen information related to each other.
5A and 5B are conceptual diagrams illustrating an embodiment for outputting screen information having a second output direction.
6A and 6B are conceptual diagrams illustrating a method of determining at least one of output positions of at least a part of screen information having the first and second output directions.
7A, 7B, 7C, and 7D are conceptual diagrams showing one kind of screen information having a second output direction.
8A and 8B are conceptual diagrams illustrating a method of displaying an image received from a camera having the different photographing directions.
9 is a conceptual diagram showing that a specific area of screen information having a first output direction is set as screen information having a second output direction.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like or similar elements are denoted by the same reference numerals, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

The mobile terminal described in this specification includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC A tablet PC, an ultrabook, a wearable device such as a smartwatch, a smart glass, and a head mounted display (HMD). have.

However, it will be appreciated by those skilled in the art that the configuration according to the embodiments described herein may be applied to fixed terminals such as a digital TV, a desktop computer, a digital signage, and the like, will be.

1A to 1C are block diagrams for explaining a mobile terminal according to the present invention, and FIGS. 1B and 1C are conceptual diagrams showing an example of a mobile terminal according to the present invention in different directions.

The mobile terminal 100 includes a wireless communication unit 110, an input unit 120, a sensing unit 140, an output unit 150, an interface unit 160, a memory 170, a control unit 180, ), And the like. The components shown in FIG. 1A are not essential for implementing a mobile terminal, so that the mobile terminal described herein may have more or fewer components than the components listed above.

The wireless communication unit 110 may be connected between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and another mobile terminal 100 or between the mobile terminal 100 and the external server 100. [ Lt; RTI ID = 0.0 > wireless < / RTI > In addition, the wireless communication unit 110 may include one or more modules for connecting the mobile terminal 100 to one or more networks.

The wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115 .

The input unit 120 includes a camera 121 or an image input unit for inputting a video signal, a microphone 122 for inputting an audio signal, an audio input unit, a user input unit 123 for receiving information from a user A touch key, a mechanical key, and the like). The voice data or image data collected by the input unit 120 may be analyzed and processed by a user's control command.

The sensing unit 140 may include at least one sensor for sensing at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information. For example, the sensing unit 140 may include a proximity sensor 141, an illumination sensor 142, a touch sensor, an acceleration sensor, a magnetic sensor, A G-sensor, a gyroscope sensor, a motion sensor, an RGB sensor, an infrared sensor, a finger scan sensor, an ultrasonic sensor, A microphone 226, a battery gauge, an environmental sensor (for example, a barometer, a hygrometer, a thermometer, a radiation detection sensor, A thermal sensor, a gas sensor, etc.), a chemical sensor (e.g., an electronic nose, a healthcare sensor, a biometric sensor, etc.). Meanwhile, the mobile terminal disclosed in the present specification can combine and utilize information sensed by at least two of the sensors.

The output unit 150 includes at least one of a display unit 151, an acoustic output unit 152, a haptic tip module 153, and a light output unit 154 to generate an output related to visual, auditory, can do. The display unit 151 may have a mutual layer structure with the touch sensor or may be integrally formed to realize a touch screen. The touch screen may function as a user input unit 123 that provides an input interface between the mobile terminal 100 and a user and may provide an output interface between the mobile terminal 100 and a user.

The interface unit 160 serves as a path to various types of external devices connected to the mobile terminal 100. The interface unit 160 is connected to a device having a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, And may include at least one of a port, an audio I / O port, a video I / O port, and an earphone port. In the mobile terminal 100, corresponding to the connection of the external device to the interface unit 160, it is possible to perform appropriate control related to the connected external device.

In addition, the memory 170 stores data supporting various functions of the mobile terminal 100. The memory 170 may store a plurality of application programs or applications running on the mobile terminal 100, data for operation of the mobile terminal 100, and commands. At least some of these applications may be downloaded from an external server via wireless communication. Also, at least a part of these application programs may exist on the mobile terminal 100 from the time of shipment for the basic functions (e.g., telephone call receiving function, message receiving function, and calling function) of the mobile terminal 100. Meanwhile, the application program may be stored in the memory 170, installed on the mobile terminal 100, and may be operated by the control unit 180 to perform the operation (or function) of the mobile terminal.

In addition to the operations related to the application program, the control unit 180 typically controls the overall operation of the mobile terminal 100. The control unit 180 may process or process signals, data, information, and the like input or output through the above-mentioned components, or may drive an application program stored in the memory 170 to provide or process appropriate information or functions to the user.

In addition, the controller 180 may control at least some of the components illustrated in FIG. 1A in order to drive an application program stored in the memory 170. FIG. In addition, the controller 180 may operate at least two of the components included in the mobile terminal 100 in combination with each other for driving the application program.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power to the components included in the mobile terminal 100. The power supply unit 190 includes a battery, which may be an internal battery or a replaceable battery.

At least some of the components may operate in cooperation with one another to implement a method of operation, control, or control of a mobile terminal according to various embodiments described below. In addition, the operation, control, or control method of the mobile terminal may be implemented on the mobile terminal by driving at least one application program stored in the memory 170. [

Hereinafter, the various components of the mobile terminal 100 will be described in detail with reference to FIG. 1A.

First, referring to the wireless communication unit 110, the broadcast receiving module 111 of the wireless communication unit 110 receives broadcast signals and / or broadcast-related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. Two or more broadcast receiving modules may be provided to the mobile terminal 100 for simultaneous broadcast reception or broadcast channel switching for at least two broadcast channels.

The mobile communication module 112 may be a mobile communication module or a mobile communication module such as a mobile communication module or a mobile communication module that uses technology standards or a communication method (e.g., Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution And an external terminal, or a server on a mobile communication network established according to a long term evolution (AR), a long term evolution (AR), or the like.

The wireless signal may include various types of data depending on a voice call signal, a video call signal or a text / multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be built in or externally attached to the mobile terminal 100. The wireless Internet module 113 is configured to transmit and receive a wireless signal in a communication network according to wireless Internet technologies.

Wireless Internet technologies include, for example, wireless LAN (WLAN), wireless fidelity (Wi-Fi), wireless fidelity (Wi-Fi) Direct, DLNA (Digital Living Network Alliance), WiBro Interoperability for Microwave Access, High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE) and Long Term Evolution-Advanced (LTE-A) 113 transmit and receive data according to at least one wireless Internet technology, including Internet technologies not listed above.

The wireless Internet module 113 for performing a wireless Internet connection through the mobile communication network can be used for wireless Internet access by WiBro, HSDPA, HSUPA, GSM, CDMA, WCDMA, LTE or LTE- May be understood as a kind of the mobile communication module 112.

The short-range communication module 114 is for short-range communication, and includes Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB) (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology. The short-range communication module 114 is connected to the mobile terminal 100 and the wireless communication system through the wireless area networks, between the mobile terminal 100 and another mobile terminal 100, or between the mobile terminal 100 ) And the other mobile terminal 100 (or the external server). The short-range wireless communication network may be a short-range wireless personal area network.

Here, the other mobile terminal 100 may be a wearable device (e.g., a smartwatch, a smart glass, etc.) capable of interchanging data with the mobile terminal 100 according to the present invention (smart glass), HMD (head mounted display)). The short range communication module 114 may detect (or recognize) a wearable device capable of communicating with the mobile terminal 100 around the mobile terminal 100. [ If the detected wearable device is a device authenticated to communicate with the mobile terminal 100 according to the present invention, the control unit 180 may transmit at least a part of the data processed by the mobile terminal 100 to the short- 114 to the wearable device. Therefore, the user of the wearable device can use the data processed by the mobile terminal 100 through the wearable device. For example, according to this, when a telephone is received in the mobile terminal 100, the user performs a telephone conversation via the wearable device, or when a message is received in the mobile terminal 100, It is possible to check the message.

The position information module 115 is a module for obtaining the position (or current position) of the mobile terminal, and a representative example thereof is a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, when the mobile terminal utilizes the GPS module, it can acquire the position of the mobile terminal by using a signal transmitted from the GPS satellite. As another example, when the mobile terminal utilizes the Wi-Fi module, it can acquire the position of the mobile terminal based on information of a wireless access point (AP) that transmits or receives the wireless signal with the Wi-Fi module. Optionally, the location information module 115 may perform any of the other functions of the wireless communication unit 110 to obtain data relating to the location of the mobile terminal, in addition or alternatively. The location information module 115 is a module used to obtain the location (or current location) of the mobile terminal, and is not limited to a module that directly calculates or obtains the location of the mobile terminal.

Next, the input unit 120 is for inputting image information (or signal), audio information (or signal), data, or information input from a user. For inputting image information, Or a plurality of cameras 121 may be provided. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video communication mode or the photographing mode. The processed image frame may be displayed on the display unit 151 or stored in the memory 170. [ A plurality of cameras 121 provided in the mobile terminal 100 may be arranged to have a matrix structure and various angles or foci may be provided to the mobile terminal 100 through the camera 121 having the matrix structure A plurality of pieces of image information can be input. In addition, the plurality of cameras 121 may be arranged in a stereo structure to acquire a left image and a right image for realizing a stereoscopic image.

The microphone 122 processes the external acoustic signal into electrical voice data. The processed voice data can be utilized variously according to a function (or a running application program) being executed in the mobile terminal 100. Meanwhile, the microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated in receiving an external sound signal.

The user input unit 123 is for receiving information from a user and when the information is inputted through the user input unit 123, the control unit 180 can control the operation of the mobile terminal 100 to correspond to the input information . The user input unit 123 may include a mechanical input means (or a mechanical key such as a button located on the front, rear or side of the mobile terminal 100, a dome switch, a jog wheel, Jog switches, etc.) and touch-type input means. For example, the touch-type input means may comprise a virtual key, a soft key or a visual key displayed on the touch screen through software processing, And a touch key disposed on the touch panel. Meanwhile, the virtual key or the visual key can be displayed on a touch screen having various forms, for example, a graphic, a text, an icon, a video, As shown in FIG.

Meanwhile, the sensing unit 140 senses at least one of information in the mobile terminal, surrounding environment information surrounding the mobile terminal, and user information, and generates a corresponding sensing signal. The control unit 180 may control the driving or operation of the mobile terminal 100 or may perform data processing, function or operation related to the application program installed in the mobile terminal 100 based on the sensing signal. Representative sensors among various sensors that may be included in the sensing unit 140 will be described in more detail.

First, the proximity sensor 141 refers to a sensor that detects the presence of an object approaching a predetermined detection surface, or the presence of an object in the vicinity of the detection surface, without mechanical contact by using electromagnetic force or infrared rays. The proximity sensor 141 may be disposed in the inner area of the mobile terminal or in proximity to the touch screen, which is covered by the touch screen.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. In the case where the touch screen is electrostatic, the proximity sensor 141 can be configured to detect the proximity of the object with a change of the electric field along the proximity of the object having conductivity. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the act of recognizing that the object is located on the touch screen in proximity with no object touching the touch screen is referred to as "proximity touch & The act of actually touching an object on the screen is called a "contact touch. &Quot; The position at which the object is closely touched on the touch screen means a position where the object corresponds to the touch screen vertically when the object is touched. The proximity sensor 141 can detect a proximity touch and a proximity touch pattern (e.g., a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, have. Meanwhile, the control unit 180 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 141 as described above, and further provides visual information corresponding to the processed data It can be output on the touch screen. Furthermore, the control unit 180 can control the mobile terminal 100 such that different operations or data (or information) are processed according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch .

The touch sensor senses a touch (or touch input) applied to the touch screen (or the display unit 151) by using at least one of various touch methods such as a resistance film type, a capacitive type, an infrared type, an ultrasonic type, do.

For example, the touch sensor may be configured to convert a change in a pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion to an electrical input signal. The touch sensor may be configured to detect a position, an area, a pressure at the time of touch, a capacitance at the time of touch, and the like where a touch object touching the touch screen is touched on the touch sensor. Here, the touch object may be a finger, a touch pen, a stylus pen, a pointer, or the like as an object to which a touch is applied to the touch sensor.

Thus, when there is a touch input to the touch sensor, the corresponding signal (s) is sent to the touch controller. The touch controller processes the signal (s) and transmits the corresponding data to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched or the like. Here, the touch controller may be a separate component from the control unit 180, and may be the control unit 180 itself.

On the other hand, the control unit 180 may perform different controls or perform the same control according to the type of the touch object touching the touch screen (or a touch key provided on the touch screen). Whether to perform different controls or to perform the same control according to the type of the touch object may be determined according to the current state of the mobile terminal 100 or an application program being executed.

On the other hand, the touch sensors and the proximity sensors discussed above can be used independently or in combination to provide a short touch (touch), a long touch, a multi touch, a drag touch ), Flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, and the like. Touch can be sensed.

The ultrasonic sensor can recognize the position information of the object to be sensed by using ultrasonic waves. Meanwhile, the controller 180 can calculate the position of the wave generating source through the information sensed by the optical sensor and the plurality of ultrasonic sensors. The position of the wave source can be calculated using the fact that the light is much faster than the ultrasonic wave, that is, the time when the light reaches the optical sensor is much faster than the time the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generating source can be calculated using the time difference with the time when the ultrasonic wave reaches the reference signal.

The camera 121 includes at least one of a camera sensor (for example, a CCD, a CMOS, etc.), a photo sensor (or an image sensor), and a laser sensor.

The camera 121 and the laser sensor may be combined with each other to sense a touch of the sensing object with respect to the three-dimensional stereoscopic image. The photosensor can be laminated to the display element, which is adapted to scan the movement of the object to be detected proximate to the touch screen. More specifically, the photosensor mounts photo diodes and TRs (Transistors) in a row / column and scans the contents loaded on the photosensor using an electrical signal that varies according to the amount of light applied to the photo diode. That is, the photo sensor performs coordinate calculation of the object to be sensed according to the amount of change of light, and position information of the object to be sensed can be obtained through the calculation.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

In addition, the display unit 151 may be configured as a stereoscopic display unit for displaying a stereoscopic image.

In the stereoscopic display unit, a three-dimensional display system such as a stereoscopic system (glasses system), an autostereoscopic system (no-glasses system), and a projection system (holographic system) can be applied.

The sound output unit 152 may output audio data received from the wireless communication unit 110 or stored in the memory 170 in a call signal reception mode, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, The sound output unit 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output unit 152 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 153 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 153 may be vibration. The intensity and pattern of the vibration generated in the haptic module 153 can be controlled by the user's selection or the setting of the control unit. For example, the haptic module 153 may synthesize and output different vibrations or sequentially output the vibrations.

In addition to vibration, the haptic module 153 may be configured to perform various functions such as a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or suction force of the air through the injection port or the suction port, a touch on the skin surface, And various tactile effects such as an effect of reproducing a cold sensation using an endothermic or exothermic element can be generated.

The haptic module 153 can transmit the tactile effect through the direct contact, and the tactile effect can be felt by the user through the muscles of the finger or arm. The haptic module 153 may include two or more haptic modules 153 according to the configuration of the mobile terminal 100.

The light output unit 154 outputs a signal for notifying the occurrence of an event using the light of the light source of the mobile terminal 100. Examples of events that occur in the mobile terminal 100 may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like.

The signal output from the light output unit 154 is implemented as the mobile terminal emits light of a single color or a plurality of colors to the front or rear surface. The signal output may be terminated by the mobile terminal detecting the event confirmation of the user.

The interface unit 160 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 160 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data in the mobile terminal 100 to an external device. For example, a port for connecting a device equipped with a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, an audio I / O port, a video I / O port, an earphone port, and the like may be included in the interface unit 160.

The identification module is a chip for storing various information for authenticating the use right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM) A universal subscriber identity module (USIM), and the like. Devices with identification modules (hereinafter referred to as "identification devices") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the interface unit 160. [

The interface unit 160 may be a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, And various command signals may be transmitted to the mobile terminal 100. The various command signals or the power source input from the cradle may be operated as a signal for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The memory 170 may store a program for the operation of the controller 180 and temporarily store input / output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 170 may store data related to vibration and sound of various patterns outputted when a touch is input on the touch screen.

The memory 170 may be a flash memory type, a hard disk type, a solid state disk type, an SDD type (Silicon Disk Drive type), a multimedia card micro type ), Card type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read memory, a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and / or an optical disk. The mobile terminal 100 may operate in association with a web storage that performs the storage function of the memory 170 on the Internet.

Meanwhile, as described above, the control unit 180 controls the operations related to the application program and the general operation of the mobile terminal 100. [ For example, when the state of the mobile terminal meets a set condition, the control unit 180 can execute or release a lock state for restricting input of a user's control command to applications.

In addition, the control unit 180 performs control and processing related to voice communication, data communication, video call, or the like, or performs pattern recognition processing to recognize handwriting input or drawing input performed on the touch screen as characters and images, respectively . Further, the controller 180 may control any one or a plurality of the above-described components in order to implement various embodiments described below on the mobile terminal 100 according to the present invention.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components. The power supply unit 190 includes a battery, the battery may be an internal battery configured to be chargeable, and may be detachably coupled to the terminal body for charging or the like.

In addition, the power supply unit 190 may include a connection port, and the connection port may be configured as an example of an interface 160 through which an external charger for supplying power for charging the battery is electrically connected.

As another example, the power supply unit 190 may be configured to charge the battery in a wireless manner without using the connection port. In this case, the power supply unit 190 may use at least one of an inductive coupling method based on a magnetic induction phenomenon from an external wireless power transmission apparatus and a magnetic resonance coupling method based on an electromagnetic resonance phenomenon Power can be delivered.

In the following, various embodiments may be embodied in a recording medium readable by a computer or similar device using, for example, software, hardware, or a combination thereof.

Referring to FIGS. 1B and 1C, the disclosed mobile terminal 100 includes a bar-shaped terminal body. However, the present invention is not limited thereto and can be applied to various structures such as a folder type, a flip type, a slide type, a swing type, and a swivel type in which a watch type, a clip type, a glass type or two or more bodies are relatively movably coupled . A description of a particular type of mobile terminal, although relevant to a particular type of mobile terminal, is generally applicable to other types of mobile terminals.

Here, the terminal body can be understood as a concept of referring to the mobile terminal 100 as at least one aggregate.

The mobile terminal 100 includes a case (for example, a frame, a housing, a cover, and the like) that forms an appearance. As shown, the mobile terminal 100 may include a front case 101 and a rear case 102. Various electronic components are disposed in the inner space formed by the combination of the front case 101 and the rear case 102. At least one middle case may be additionally disposed between the front case 101 and the rear case 102.

A display unit 151 is disposed on a front surface of the terminal body to output information. The window 151a of the display unit 151 may be mounted on the front case 101 to form a front surface of the terminal body together with the front case 101. [

In some cases, electronic components may also be mounted on the rear case 102. Electronic parts that can be mounted on the rear case 102 include detachable batteries, an identification module, a memory card, and the like. In this case, a rear cover 103 for covering the mounted electronic components can be detachably coupled to the rear case 102. Therefore, when the rear cover 103 is separated from the rear case 102, the electronic parts mounted on the rear case 102 are exposed to the outside.

As shown, when the rear cover 103 is coupled to the rear case 102, a side portion of the rear case 102 can be exposed. In some cases, the rear case 102 may be completely covered by the rear cover 103 during the engagement. Meanwhile, the rear cover 103 may be provided with an opening for exposing the camera 121b and the sound output unit 152b to the outside.

These cases 101, 102, and 103 may be formed by injection molding of synthetic resin or may be formed of metal such as stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

The mobile terminal 100 may be configured such that one case provides the internal space, unlike the above example in which a plurality of cases provide an internal space for accommodating various electronic components. In this case, a unibody mobile terminal 100 in which synthetic resin or metal is connected from the side to the rear side can be realized.

Meanwhile, the mobile terminal 100 may include a waterproof unit (not shown) for preventing water from penetrating into the terminal body. For example, the waterproof portion is provided between the window 151a and the front case 101, between the front case 101 and the rear case 102, or between the rear case 102 and the rear cover 103, And a waterproof member for sealing the inside space of the oven.

The mobile terminal 100 is provided with a display unit 151, first and second sound output units 152a and 152b, a proximity sensor 141, an illuminance sensor 142, a light output unit 154, Cameras 121a and 121b, first and second operation units 123a and 123b, a microphone 122, an interface unit 160, and the like.

1B and 1C, a display unit 151, a first sound output unit 152a, a proximity sensor 141, an illuminance sensor 142, an optical output unit (not shown) A second operation unit 123b, a microphone 122 and an interface unit 160 are disposed on a side surface of the terminal body, And a mobile terminal 100 having a second sound output unit 152b and a second camera 121b disposed on a rear surface thereof.

However, these configurations are not limited to this arrangement. These configurations may be excluded or replaced as needed, or placed on different planes. For example, the first operation unit 123a may not be provided on the front surface of the terminal body, and the second sound output unit 152b may be provided on the side surface of the terminal body rather than the rear surface of the terminal body.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, the display unit 151 may display execution screen information of an application program driven by the mobile terminal 100 or UI (User Interface) and GUI (Graphic User Interface) information according to the execution screen information .

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

In addition, the display unit 151 may exist in two or more depending on the embodiment of the mobile terminal 100. In this case, the mobile terminal 100 may be provided with a plurality of display portions spaced apart from each other or disposed integrally with one another, or may be disposed on different surfaces, respectively.

The display unit 151 may include a touch sensor that senses a touch with respect to the display unit 151 so that a control command can be received by a touch method. When a touch is made to the display unit 151, the touch sensor senses the touch, and the control unit 180 generates a control command corresponding to the touch based on the touch. The content input by the touch method may be a letter or a number, an instruction in various modes, a menu item which can be designated, and the like.

The touch sensor may be a film having a touch pattern and disposed between the window 151a and a display (not shown) on the rear surface of the window 151a, or may be a metal wire . Alternatively, the touch sensor may be formed integrally with the display. For example, the touch sensor may be disposed on a substrate of the display or inside the display.

In this way, the display unit 151 can form a touch screen together with the touch sensor. In this case, the touch screen can function as a user input unit 123 (see FIG. 1A). In some cases, the touch screen may replace at least some functions of the first operation unit 123a.

The first sound output unit 152a may be implemented as a receiver for transmitting a call sound to a user's ear and the second sound output unit 152b may be implemented as a loud speaker for outputting various alarm sounds or multimedia playback sounds. ). ≪ / RTI >

The window 151a of the display unit 151 may be provided with an acoustic hole for emitting the sound generated from the first acoustic output unit 152a. However, the present invention is not limited to this, and the sound may be configured to be emitted along an assembly gap (for example, a gap between the window 151a and the front case 101) between the structures. In this case, the appearance of the mobile terminal 100 can be made more simple because the hole formed independently for the apparent acoustic output is hidden or hidden.

The optical output unit 154 is configured to output light for notifying the occurrence of an event. Examples of the event include a message reception, a call signal reception, a missed call, an alarm, a schedule notification, an email reception, and reception of information through an application. The control unit 180 may control the light output unit 154 to terminate the light output when the event confirmation of the user is detected.

The first camera 121a processes an image frame of a still image or a moving image obtained by the image sensor in the photographing mode or the video communication mode. The processed image frame can be displayed on the display unit 151 and can be stored in the memory 170. [

The first and second operation units 123a and 123b may be collectively referred to as a manipulating portion as an example of a user input unit 123 operated to receive a command for controlling the operation of the mobile terminal 100 have. The first and second operation units 123a and 123b can be employed in any manner as long as the user is in a tactile manner such as touch, push, scroll, or the like. In addition, the first and second operation units 123a and 123b may be employed in a manner that the user operates the apparatus without touching the user through a proximity touch, a hovering touch, or the like.

In this figure, the first operation unit 123a is a touch key, but the present invention is not limited thereto. For example, the first operation unit 123a may be a mechanical key, or a combination of a touch key and a touch key.

The contents input by the first and second operation units 123a and 123b can be variously set. For example, the first operation unit 123a receives a command such as a menu, a home key, a cancellation, a search, and the like, and the second operation unit 123b receives a command from the first or second sound output unit 152a or 152b The size of the sound, and the change of the display unit 151 to the touch recognition mode.

On the other hand, a rear input unit (not shown) may be provided on the rear surface of the terminal body as another example of the user input unit 123. The rear input unit is operated to receive a command for controlling the operation of the mobile terminal 100, and input contents may be variously set. For example, commands such as power on / off, start, end, scrolling, and the like, the size adjustment of the sound output from the first and second sound output units 152a and 152b, And the like can be inputted. The rear input unit may be implemented as a touch input, a push input, or a combination thereof.

The rear input unit may be disposed so as to overlap with the front display unit 151 in the thickness direction of the terminal body. For example, the rear input unit may be disposed at the rear upper end of the terminal body such that when the user holds the terminal body with one hand, the rear input unit can be easily operated using the index finger. However, the present invention is not limited thereto, and the position of the rear input unit may be changed.

When a rear input unit is provided on the rear surface of the terminal body, a new type of user interface using the rear input unit can be realized. When the first operation unit 123a is not disposed on the front surface of the terminal body in place of at least a part of the functions of the first operation unit 123a provided on the front surface of the terminal body, The display unit 151 may be configured as a larger screen.

Meanwhile, the mobile terminal 100 may be provided with a fingerprint recognition sensor for recognizing the fingerprint of the user, and the controller 180 may use the fingerprint information sensed through the fingerprint recognition sensor as authentication means. The fingerprint recognition sensor may be embedded in the display unit 151 or the user input unit 123.

The microphone 122 is configured to receive the user's voice, other sounds, and the like. The microphone 122 may be provided at a plurality of locations to receive stereophonic sound.

The interface unit 160 is a path through which the mobile terminal 100 can be connected to an external device. For example, the interface unit 160 may include a connection terminal for connection with another device (for example, an earphone or an external speaker), a port for short-range communication (for example, an infrared port (IrDA Port), a Bluetooth port A wireless LAN port, or the like), or a power supply terminal for supplying power to the mobile terminal 100. The interface unit 160 may be implemented as a socket for receiving an external card such as a SIM (Subscriber Identification Module) or a UIM (User Identity Module) or a memory card for storing information.

And a second camera 121b may be disposed on a rear surface of the terminal body. In this case, the second camera 121b has a photographing direction which is substantially opposite to that of the first camera 121a.

The second camera 121b may include a plurality of lenses arranged along at least one line. The plurality of lenses may be arranged in a matrix form. Such a camera can be named an array camera. When the second camera 121b is configured as an array camera, images can be taken in various ways using a plurality of lenses, and a better quality image can be obtained.

The flash 124 may be disposed adjacent to the second camera 121b. The flash 124 shines light toward the subject when the subject is photographed by the second camera 121b.

And a second sound output unit 152b may be additionally disposed in the terminal body. The second sound output unit 152b may implement a stereo function together with the first sound output unit 152a and may be used for implementing a speakerphone mode in a call.

The terminal body may be provided with at least one antenna for wireless communication. The antenna may be embedded in the terminal body or formed in the case. For example, an antenna constituting a part of the broadcast receiving module 111 (see FIG. 1A) may be configured to be able to be drawn out from the terminal body. Alternatively, the antenna may be formed in a film type and attached to the inner surface of the rear cover 103, or a case including a conductive material may be configured to function as an antenna.

The terminal body is provided with a power supply unit 190 (see FIG. 1A) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 built in the terminal body or detachable from the outside of the terminal body.

The battery 191 may be configured to receive power through a power cable connected to the interface unit 160. In addition, the battery 191 may be configured to be wirelessly chargeable through a wireless charger. The wireless charging may be implemented by a magnetic induction method or a resonance method (magnetic resonance method).

The rear cover 103 is coupled to the rear case 102 so as to cover the battery 191 to restrict the release of the battery 191 and to protect the battery 191 from external impact and foreign matter . When the battery 191 is detachably attached to the terminal body, the rear cover 103 may be detachably coupled to the rear case 102.

The mobile terminal 100 may be provided with an accessory that protects the appearance or supports or expands the function of the mobile terminal 100. [ One example of such an accessory is a cover or pouch that covers or accommodates at least one side of the mobile terminal 100. [ The cover or pouch may be configured to interlock with the display unit 151 to expand the function of the mobile terminal 100. Another example of an accessory is a touch pen for supplementing or extending a touch input to the touch screen.

Meanwhile, the mobile terminal according to the present invention may have various design forms. Hereinafter, a mobile terminal having a side display unit and a user interface using the same will be described as one of structural changes and improvements. FIG. 1D is a perspective view of another example of a mobile terminal according to the present invention, and FIG. 1E is a rear perspective view of the mobile terminal shown in FIG. 1D.

The disclosed mobile terminal 200 has a bar-shaped mobile phone body. However, the present invention is not limited thereto, and can be applied to various structures such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are relatively movably coupled.

The body includes a case (a casing, a housing, a cover, and the like) which forms an appearance. In this embodiment, the case may be divided into a front case 201 and a rear case 202. [ Various electronic components are embedded in the space formed between the front case 201 and the rear case 202. At least one intermediate case may be additionally disposed between the front case 201 and the rear case 202. [

The cases may be formed by injection molding a synthetic resin or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti) or the like.

The display unit 251, the sound output unit 252, the camera module 221, and the like may be disposed in the terminal body, mainly the front case 201. The interfaces 270 and the like may be disposed on the side surfaces of the front case 201 and the rear case 202.

The display unit 251 occupies most of the main surface of the front case 201. That is, the display unit is disposed on the front side of the terminal and is configured to display time information. The display unit 251 of the present invention is extended not only to the front surface of the terminal but also to the other surface of the terminal. More specifically, the display unit 251 includes a first region 261 disposed on the front surface and a second region 262 and 263 extending from the first region 261 and disposed on a side surface of the main body 261 do. Here, the side may be a side that is visible to the user when the user looks at the side (or side) of the mobile terminal.

On the other hand, at least a part of the second regions 262 and 263 may be disposed on the front surface. For example, the second areas 262 and 263 may be formed across the side and front of the terminal. Whether or not the second areas 262 and 263 are visible from the front is determined according to the structure in which the first and second areas 261, 262 and 263 are formed on the display part 251.

For example, the window disposed on the upper surface of the display unit 251 is bent in both sides, and the front and side surfaces of the main body are formed by the window. Accordingly, the first region 261 and the second regions 262 and 263 may be connected to each other without a physical interface. In this case, the display unit 251 may include a display device formed in a curved shape and embedded in the window.

As another example, the display unit 251 may be a flexible display. The flexible display portion includes a display that can be bent, twistable, collapsible, and curlable, which can be bent by an external force. Here, the flexible display unit may include both a general flexible display and an electronic paper.

Here, a typical flexible display refers to a durable display that is lightweight and does not break, made on a thin and flexible substrate that can be bent, bent, folded or rolled like paper while maintaining the display characteristics of conventional flat panel displays.

In addition, the electronic paper may be a display technology to which general ink characteristics are applied, and the point of using reflected light differs from a general flat panel display. The electronic paper can be changed by using a twist ball or electrophoresis (electrophoresis) using a capsule.

In this manner, the terminal main body can be configured such that both side surfaces of the display portion are bent by the flexible material property.

In the above description, the flexible display unit is extended to the front and both sides, but the present invention can be configured such that three independent display units are disposed on the front and both sides. For example, the front display unit 261 and the side display units 262 and 263 may be independent display units, and may be arranged adjacent to each other.

An acoustic output unit 252 and a camera module 221 are disposed in an area adjacent to one end of the display unit 251 at one end thereof and a front input unit and a microphone 222 are disposed in an area adjacent to the other end of the display unit 251 .

The front input unit may include a plurality of operation units as an example of the user input unit 230 (see FIG. 1). The operating units may also be referred to as manipulating portions and may be employed in any manner as long as the user is operating in a tactile manner with a tactile impression.

In addition, the display unit 251 may form a touch screen together with the touch sensor. In this case, the touch screen may be a user input unit. Accordingly, it is possible to provide a configuration without a front input unit on the front surface of the terminal. In this case, the mobile terminal can be configured such that the input operation to the main body of the mobile terminal can be performed only through the display unit 251 and the rear input unit 232 described later.

Referring to FIG. 1E, a camera module 221 'may be further mounted on the rear surface of the terminal body, that is, the rear case 202. The camera module 221 'may have a photographing direction substantially opposite to the camera 221 (see FIG. 1D), and may be a camera having different pixels from the camera module 221.

For example, the camera module 221 has low pixels so that it is easy to capture a face of a user in the case of a video call or the like and send it to the other party, and the camera module 221 ' It is preferable to have a high pixel. The camera modules 221 and 221 'may be installed in the terminal body such that they can be rotated or pop-up.

A flash and a mirror may be additionally disposed adjacent to the camera module 221 '. The flash illuminates the subject when the subject is photographed by the camera module 221 '. The mirror enables the user to illuminate the user's own face or the like when the user intends to take a picture of himself / herself (self-photographing) using the camera module 221 '.

An acoustic output unit (not shown) may be further disposed on the rear surface of the terminal body. The rear sound output unit may implement a stereo function together with the front sound output unit 252 (see FIG. 1D), and may be used for implementing a speakerphone mode in a call.

That is, a second sound output unit including the rear surface or the speaker may be formed together with the sound output unit 252 (first sound output unit) on the front surface of the terminal, which is configured by a receiver. However, the present invention is not limited to this, and a second sound output unit may be provided on a side surface of the terminal.

A power supply unit 290 for supplying power to the portable terminal 200 is mounted on the terminal body. The power supply unit 290 may be built in the terminal body or may be detachable from the outside of the terminal body.

The rear input unit 232 may be disposed on the rear surface of the terminal body. The rear input unit 232 may be located, for example, below the camera module 221 '.

The rear input unit 232 is operated to receive a command for controlling the operation of the mobile terminal 200, and input contents can be variously set. For example, a command such as a command such as power on / off, start, end, scrolling and the like, adjustment of the size of sound outputted from the sound output unit 252, or switching to the touch recognition mode of the display module 251 Can receive. However, the present invention is not limited thereto, and the terminal may include only one or both of the front input unit and the rear input unit 232.

Meanwhile, as described above, the control unit 180 (see FIG. 1A) can control the functions of the terminal using the display unit disposed on the side of the terminal.

Hereinafter, a method of controlling functions of a terminal using display units disposed on both sides will be described in detail with reference to the accompanying drawings.

For convenience of explanation, the second area 262 refers to a display area disposed on the left side of both sides with respect to the front side, and the third area 263 refers to a display area disposed on the right side of both sides with respect to the front side. Area. Also, the first area 261 means a display (front display) disposed on the front side.

Alternatively, the display unit 251 may include a display area on both the left and right sides of the display unit 251. The display unit 251 may include a first area corresponding to the front of the display unit 251 261 may be further provided with a side display unit on either the left side or the right side. However, for convenience of description, the display unit 251 including a display area (or a display unit) on each of the front, left, and right sides will be described in this specification.

Further, in the present specification, the front display unit (or the first area) is described by using the reference numeral 261 and the side display unit (or the second area) by using the reference numeral 262 or 263 Explain. Furthermore, contents that can be applied to both the front and side display portions without needing to distinguish between the front and side display portions will be described as "display portion 251" instead of the reference numerals for indicating the front and side display portions.

Hereinafter, a method of performing various functions using both side display units will be described in detail with reference to the accompanying drawings. FIG. 2 is a flowchart illustrating a method of controlling the both-sided display unit of the present invention, and FIG. 3 is a conceptual diagram illustrating the control method of FIG.

The mobile terminal according to the present invention may proceed to a step of displaying screen information in a first area disposed on a front surface of the main body (S210).

A mobile terminal according to the present invention includes a display unit 251 having a first area 261 disposed on a front surface of a main body and connected to the first area and having second areas 262 and 263 disposed on a side surface of the main body, As shown in FIG.

On the display unit 251, screen information related to a function that can be operated by the mobile terminal can be displayed. For example, the screen information may be execution screen information of an application installed in the mobile terminal. In addition, the display unit 251 may display a graphic object such as an icon, a widget, or the like indicating an application installed in the mobile terminal.

On the other hand, the screen information related to the function that can be operated by the mobile terminal can be displayed not only in the first area 261 but also in the second area.

In a state where screen information is displayed in the first area, the mobile terminal according to the present invention can detect that a predetermined type of touch is applied to a second area disposed on a side of the main body (S220).

The control unit 180 may control the first and second areas in cooperation with each other. For example, the control unit 180 may control the screen information displayed in the first area using a touch applied to the second area. Here, it can be understood that controlling the screen information performs a function related to the screen information. For example, in a state where screen information representing a web page is output to the first area 261, the controller 180 scrolls the web page according to a drag input applied to the second area 262 Function can be performed.

To this end, the mobile terminal according to the present invention may further include a sensing unit 140 capable of sensing a touch applied to the first and second areas. The sensing unit 140 may be a touch sensor that senses a touch applied to the display unit 251.

The display unit disposed on the side of the main body may include a second area 262 disposed on the left side and a third area 263 disposed on the right side.

The controller 180 may sense the touch applied to at least a portion of the second and third regions using the sensing unit 140. [ At this time, the controller 180 may determine whether or not a predetermined type of touch is detected in the second and third areas. The touch of the preset method may be various touch input methods such as a drag input and a multi-touch applied to at least a part of the second and third regions. For example, the control unit 180 may sense a drag input applied to the second and third regions at the same time. At this time, the direction of the drag input may be the same direction in the second and third regions, or may be different directions.

If a predetermined type of touch is detected for at least a part of the second and third areas, the mobile terminal displays information related to the screen information displayed in the first area in at least a part of the first area, And outputting the information in a direction different from the direction in which the information is output (S230).

The mobile terminal according to the present invention can output together screen information having output directions in at least two directions in the first area. That is, the user can simultaneously view at least two pieces of screen information having different directions.

For this, the control unit 180 may display screen information having a second output direction different from the second output direction in at least a part of the first area in a state in which screen information having a first output direction is displayed in the first area Can be output.

Here, the output direction of the screen information may be a direction output to the display unit 251. [ More specifically, the output direction of the screen information may be determined according to the posture of the mobile terminal body. For example, when the output direction of the screen information output from the posture in which the front surface of the display unit 251 is laid horizontally is defined as the first output direction, The output direction of the screen information output from the posture can be defined as the second output direction. That is, the second output direction may be output at a 90-degree difference from the first output direction.

In the present invention, the screen information having different directions may mean screen information output according to the attitude of the main body. For example, as shown in FIG. 3A, the screen information 310 having the first output direction means screen information output when the main body is laid horizontally, and the screen information 310 having the second output direction The information 320 can be understood as screen information output when the main body is laid down vertically.

In addition, the output direction of the screen information may be determined by a touch of a predetermined method. For example, the output direction of the screen information can be determined according to the direction of the drag input applied to the second area.

At this time, in a state in which the screen information having the first output direction is output, the second output direction may be determined by a direction in which the predetermined touch is applied. For example, the controller 180 may determine the direction corresponding to the direction of the drag input applied to the second area to be the second output direction.

In this case, the screen information having the first output direction and the screen information having the second output direction may be screen information related to each other. For example, if the screen information having the first output direction is screen information indicating transmission / reception recording of an SMS text message, the screen information having the second output direction may include screen information indicating a list of recipients Lt; / RTI >

As another example, the screen information having the second output direction may be screen information to be displayed in the first area when the screen information having the first output direction is outputted in the second output direction. More specifically, the screen information output to the first area may be output in any one of the first output direction and the second output direction. In this case, the controller 180 may output the same screen information in the second output direction in a state in which the screen information having the first output direction is output to the first area.

The screen information having the first output direction and the screen information having the second output direction may be screen information irrelevant to each other. For example, if the screen information having the first output direction is screen information related to the execution of the first application installed in the mobile terminal, the screen information having the second output direction may be screen information related to the execution of the second application And may be screen information related to execution. At this time, the second application may be any one of a plurality of applications currently running on the mobile terminal, different from the first application.

Meanwhile, the present invention can output screen information having various output directions such as the third and fourth output directions in addition to the first and second output directions. Hereinafter, a case in which two pieces of screen information having two directions are output together is described, but the present invention is also applicable to a case where a plurality of pieces of screen information having a plurality of output directions are output.

The control unit 180 may output the screen information having the second output direction to at least a part of the screen information having the first output direction in a state in which the screen information having the first output direction is output.

More specifically, the controller 180 may output the screen information having the second output direction in an area corresponding to the touch detected area of the predetermined method. At this time, the screen information having the first output direction can maintain the output state as it is. In this case, the screen information having the second output direction may be superimposed on the screen information having the first output direction.

Here, the area in which the screen information having the second output direction is outputted may be determined based on the area of the first area where the touch of the predetermined type is sensed. For example, when the touch of the predetermined type is a drag input applied to the second and third regions 262 and 263, the second output is applied to an area corresponding to a length corresponding to the detected length of the drag input, Screen information having a direction can be output.

The controller 180 may switch the screen information having the first output direction to the screen information having the second output direction when the predetermined type of touch is sensed. In this case, the user can switch the output direction of the screen information without changing the posture of the display unit 251. [ Here, the posture of the display unit 251 may be any one of a posture in which the display unit 251 is raised and a posture in which the display unit 251 is laid flat.

If the screen information having the first and second output directions is associated with the first area 261 and the screen information having the first and second output directions is related to the screen information And outputting an indicator indicating the association to at least one of the screen information having the first and second output directions.

More specifically, when at least some of the screen information having the first output direction and the screen information having the second output direction are the same, the controller 180 can output the same portion visually distinguishable from the remaining screen information have.

For example, if the screen information having the first output direction is screen information indicating map information, and the screen information having the second output direction is screen information indicating more extended map information including the map information, The control unit 180 may highlight the area of the screen information having the second output direction and the same information as the screen information having the first output direction to visually distinguish the remaining area from the remaining screen information.

If the screen information having the first output direction and the screen information having the second output direction are screen information related to each other, the controller 180 may display any one of the screen information having the first and second output directions In response to the touch operation, another screen information can be controlled. Here, the control of the screen information may mean performing various functions related to screen information such as scrolling screen information, switching screen information, and the like.

Hereinafter, the screen information having the different output directions is output to the first area in more detail.

3A, the mobile terminal according to the present invention may include a display unit 251 including a first area 261 and a second area 262 and 263. [ At this time, as shown in FIG. 3A, an execution screen related to an application being executed in the mobile terminal may be output to the first area 261. [ For example, the execution screen may be screen information 310 related to the map information. At this time, the screen information 310 related to the map information may have a first output direction.

At this time, the controller 180 may sense touches applied to the second areas 262 and 263. More specifically, when the second region is divided into the first sub-region 262 and the second sub-region 263, a touch applied to at least one of the first and second sub-regions 262 and 263 Can be detected. For example, as shown in FIG. 3A, the controller 180 may sense a drag input applied to the first and second sub regions 262 and 263.

The controller 180 may output information having a second output direction different from the first output direction to at least a part of the first area when the sensed touch is a predetermined type of touch. For example, as shown in (c) of FIG. 3A, the controller 180 may control the information output in the first output direction to at least a part of the first area, It is possible to output the screen information of the output form in the case of having the direction. More specifically, when the screen information having the first output direction is the screen information 310 outputting the map information in the horizontal direction based on the front face of the display unit 251, the screen information having the second output direction is The map information may be screen information 320 that is output in the vertical direction with reference to the front surface of the display unit 251. [

Accordingly, the user can be provided with screen information having various output directions without changing the posture of the mobile terminal body or performing any other operation.

Meanwhile, the controller 180 may determine an area in which the screen information having the second output direction is displayed based on a region where the predetermined touch is sensed. For example, as shown in FIG. 3B, the controller 180 may detect a drag input in the second areas 262 and 263. At this time, the controller 180 determines an area for outputting the screen information having the second output direction based on the length of the first area 261 detected by the drag input in the second areas 262 and 263 .

For example, as shown in (c) of FIG. 3, in the area corresponding to the length of the drag input applied to the second area 262, 263 of the first area 261, Screen information having an output direction can be output.

Accordingly, the user can determine the size of the area in which the screen information with different output direction is to be displayed by adjusting the length of the drag input applied to the second area.

Also, the controller 180 may output the screen information 320 having the second output direction in an area corresponding to the area to which the drag input is applied. More specifically, the control unit 180 can detect a start point and an end point of the drag input applied to the second areas 262 and 263. For example, as shown in (b) of FIG. 3, the controller 180 detects an area from a point corresponding to a start point of the drag input to a point corresponding to the end point of the first area can do.

At this time, as shown in (c) of FIG. 3C, the controller 180 may output the screen information 320 having the second output direction to the detected area.

Through this, the user can determine the area in which the screen information having the second output direction is to be output.

In response to the detection of the predetermined touch in the first region 2610 while the screen information having the first and second output directions are displayed together, the control unit 180 displays the screen having the second output direction The information may no longer be output.

For example, as shown in (a) of FIG. 3d, when the controller 180 detects a drag input in a predetermined direction, the control unit 180 dismisses the screen information 320 having the second output direction from the first area can do. At this time, only the screen information 310 having the first output direction may be output to the first area 261. [

The method of outputting the screen information having the first and second output directions together has been described above. Thus, the user can view the screen information output in a plurality of directions together without any additional operation such as changing the posture of the display unit.

Hereinafter, when the screen information having the first and second output directions are screen information related to each other, a method of indicating the relationship with the screen information related to each other will be described. 4A and 4B are conceptual diagrams illustrating the relationship between screen information related to each other.

The mobile terminal according to the present invention can display screen information having first and second output directions together. In this case, the screen information having the first and second output directions may be screen information related to each other. For example, when the first screen information is screen information indicating a part of the document, the second screen information may be screen information indicating another part of the document including the document content of the first screen information. That is, the screen information having the first and second output directions may be screen information in which a part of the same document is made different in the output direction.

On the other hand, when the screen information having the first and second output directions is related, the controller 180 can visually output the relationship with the related screen information. More specifically, the control unit 180 can output the area in which the same information is output, from the other areas, in the screen information having the first and second output directions.

For example, as shown in FIG. 4A, when the screen information 410 having the first output direction is output, the control unit 180 determines whether or not the screen information 410 having the first output direction is set in the second areas 262 and 263 The screen information 420 having the second output direction different from the first output direction may be output to at least a part of the first area.

At this time, the controller 180 can detect the area in which the same information is output in the screen information having the first output direction and the screen information having the second output direction. For example, when the screen information having the first output direction is information indicating a part of the document, the control unit 180 displays screen information having the first output direction in the screen information having the second output direction It is possible to detect an area where the same information as the information is displayed.

When the area where the same information is displayed is detected, the controller 180 can visually distinguish the area where the same information is displayed on at least one of the screen information having the first and second output directions from the other area.

At this time, the control unit 180 may visually distinguish one of the screen information having the first and second output directions, and may process the screen information having the first and second output directions visually As shown in FIG.

In addition, the control unit 180 can select the screen information to be visually distinguished based on predetermined conditions. Here, the predetermined condition may be a condition including more screen information among the screen information having the first and second output directions. That is, if more screen information is included, it may mean that one screen information includes all screen information displayed on the other screen.

For example, as shown in FIG. 4A, when the screen information 420 having the second output direction is superimposed on the screen information 410 having the first output direction, the controller 180 Can highlight the area 430 in which the same information as the screen information 410 having the first output direction is displayed, among the screen information 420 having the second output direction. The highlight processing may be expressed using a contrast, a color, a graphic object, or the like of the area.

In addition, the controller 180 may highlight an area of the screen information having the first output direction, in which the same information as the screen information having the second output direction is displayed. 4B, when the screen information having the first output direction is displayed on the screen information having the second output direction, the controller 180 displays the screen having the second output direction, It is possible to perform highlight processing on the area 430 in which the same information is displayed.

That is, the control unit 180 detects screen information including more information including the area where the same information is displayed among the screen information having the first and second output directions, and detects the same information Can be highlighted with respect to the area in which the mark is displayed.

Also, the controller 180 may control the other one using a touch of any one of the screen information having the first and second output areas. For example, as shown in (b) of FIG. 4C, the second output region may be highlighted in the region 430 corresponding to the current first output region. At this time, the controller 180 can detect that one of the areas where the screen information 420 having the second output direction is displayed is touched.

When the touch is detected, as shown in (c) of FIG. 4C, the controller 180 displays the information displayed in the area where the touch is sensed on the screen information having the first output direction The screen information having the first output direction can be scrolled. In this case, the area 430 corresponding to the area where the touch is sensed can be highlighted.

A method of controlling another one by touching any one of the screen information having the first and second output directions while the screen information having the first and second output directions are displayed together in the first area Respectively. Accordingly, the user can organically use the screen information having the first and second output directions.

Hereinafter, a method of outputting screen information having a second output direction in a state in which screen information having a first output direction is output will be described. 5A and 5B are conceptual diagrams illustrating an embodiment for outputting screen information having a second output direction.

The control unit 180 may display screen information having an output direction different from the output direction of the screen information output to the first area on at least a part of the screen information output to the first area, Can be output.

At this time, the touch of the preset method is a touch applied on the display unit 251, and is a touch applied to the display unit 251, such as an area to be touched, a time to apply a touch, a method of applying a touch, As shown in FIG.

For example, the predetermined type of touch may be a drag input applied to the second areas 262 and 263 together. Also, the touch of the predetermined method may be determined by the direction of the drag input.

As another example, as shown in FIG. 5A, when the second region includes the first sub-region 262 and the second sub-region 263, And the second sub regions 262 and 263, as shown in FIG.

As another example, as shown in (a) of FIG. 5B, the touch of the preset method may be a touch applied to the first and second sub regions together. At this time, directions of the touches applied to the first and second sub regions may be the same or different directions. For example, as shown in (a) of FIG. 5B, touches applied to the first and second sub regions may be applied in different directions.

5A and 5B, the controller 180 outputs the screen information having the different direction to at least a part of the first area 261 when the predetermined type of touch is sensed can do.

In the above example, screen information having different output directions is output by the touch applied to the second areas 262 and 263. Accordingly, the user can view at least two pieces of screen information in at least two directions at a time by a simple operation. However, the present invention is not limited to this, and screen information having different output directions can be output by various control commands. For example, various methods such as a predetermined touch, a button input, and a voice input applied to the first area may be used.

Hereinafter, a method of determining at least one of output positions of at least a part of screen information having the first and second output directions in a state in which screen information having first and second output directions is output to the first area is described do. 6A and 6B are conceptual diagrams illustrating a method of determining at least one of output positions of at least a part of screen information having the first and second output directions.

The control unit 180 determines whether or not the screen information having the first output direction and the screen information having the second output direction are displayed together in the first area based on the predetermined method applied to the second areas 262 and 263 So that the output position of at least one of the screen information having the first and second output directions can be changed.

For example, as shown in (a) of FIG. 6A, the controller 180 may sense touches applied to the second areas 262 and 263 in different directions at the same time. In this case, as shown in (b) of FIG. 6, in response to the touch, the control unit 180 may display a screen having a position in which the screen information 310 having the first output direction is displayed, Information 320 can be changed. That is, the user can see that the output position of the screen information 310 having the first output direction and the screen information 320 having the second output direction are changed and displayed.

6B, the controller 180 may change the output position of the screen information 310 having the first output direction to a screen having the second output direction without changing the output position of the screen information 310 having the first output direction, The output position of the information 320 can be changed.

6B, the controller 180 controls the second regions 262 and 263 to display the second output direction according to the magnitude of the drag input applied to the second regions 262 and 263 in different directions, Information 320 can be rotated and displayed. In this case, the screen information 320 having the second output direction may overlap and be displayed on the screen information 310 having the first output direction.

In the above description, when screen information having first and second output directions is outputted, when it is detected that a predetermined type of touch is applied to the second area, the screen information having the first and second output directions And changing at least one output position has been described. Accordingly, the user can receive screen information having different output directions at various output positions.

Hereinafter, when the screen information having the second output direction is displayed on the basis of the fact that the screen information having the first output direction is displayed in the first area and the touch of the predetermined manner is applied to the second area, The types of screen information having the second output direction will be described in more detail with reference to the drawings. 7A, 7B, 7C, and 7D are conceptual diagrams showing one kind of screen information having a second output direction.

The control unit 180 displays screen information having a second output direction in at least a part of the first area 261 when screen information having a first output direction is displayed in the first area 261, And output it.

At this time, the screen information having the second output direction may be preset or may be set by the user. More specifically, the screen information having the second output direction may correspond to each screen information having the first output direction. Also, the user can directly set the screen information having the second output direction for each screen information having the first output direction.

The screen information having the second output direction may be screen information related to the screen information having the first output direction. For example, as shown in FIG. 7A, the screen information having the first output direction may be screen information 700a related to transmission / reception of a message. 7A, the screen information having the second output direction may be screen information 700b indicating a list of identification information of an external terminal capable of transmitting and receiving the message.

As another example, as shown in FIG. 7B, the screen information having the first output direction may be screen information 710a related to schedule management. In this case, as shown in FIG. 7B, the screen information having the second output direction may be screen information 710b indicating a to-do list associated with a schedule.

As another example, as shown in FIG. 7C, the screen information having the first output direction may be any one of a plurality of images 720a stored in the memory unit 170 of the mobile terminal . 7B, the screen information having the second output direction may be screen information 720b indicating at least a part of a plurality of images stored in the memory unit 170. [

As another example, as shown in FIG. 7D, the screen information having the first output direction may be any one of the PPT slides 730a. Here, as shown in FIG. 7D, the screen information having the second output direction may be screen information 730b indicating the PPT list.

That is, the screen information having the second output direction is information related to the screen information having the first output direction, and is output in the second output direction rather than in the first output direction, Information.

In the above description, when screen information having first and second output directions are displayed together, the kind of screen information having the second output direction has been described.

Hereinafter, a method of displaying images received from cameras having different shooting directions in a mobile terminal having cameras having different shooting directions will be described. 8A and 8B are conceptual diagrams illustrating a method of displaying an image received from a camera having the different photographing directions.

The mobile terminal according to the present invention may further include a camera unit 121. [ At this time, the camera unit 121 can change the shooting direction. In addition, the present invention may include at least two camera units 121a and 121b having different shooting directions. Hereinafter, the term of the camera unit 121 may be used as a term including at least two camera units 121a and 121b having different shooting directions.

The control unit 180 may output the image 810 received from the camera unit 121a to the display unit 251. [ At this time, when the predetermined type of touch is received, the controller 180 can activate the camera unit 121b in which the received image 810 has a photographing direction different from the photographing direction. Also, the controller 180 may superimpose the image 820 received from the camera unit 121b having the different photographing direction on at least a part of the received image 810 and output the combined image.

For example, as shown in (a) to (c) of FIG. 8A, when the predetermined type of touch is applied, the controller 180 receives The first area 261 can be output together. Here, the predetermined type of touch may be a touch applied to the second areas 262 and 263. At this time, the camera units 121a and 121b having different shooting directions may be used. However, the present invention may be performed by receiving images taken by one camera unit 121 by rotation.

As another example, as shown in (a) to (c) of FIG. 8B, the control unit 180 may be configured to select any one of the camera units 121a and 121b having imaging directions opposite to each other in the first area 262 It is possible to display the image 810 received through one camera unit 121a. At this time, if the predetermined type of touch is sensed, the control unit 180 displays an image received from one of the camera units 121a and the other camera unit 121b at least a part of the displayed image 810 830).

On the other hand, the image received from the camera unit 121b having the different photographing direction is applicable to all of the embodiments of the screen information having the second output direction described above.

In the foregoing, a method of displaying an image received from a camera unit having different shooting directions has been described. In this way, the user can activate the camera unit only by a touch operation. In addition, the user can view the images photographed in various photographing directions at a time, thereby providing convenience of photographing.

Hereinafter, it is explained that the specific area of the screen information having the first output direction is set as the screen information having the second output direction. 9 is a conceptual diagram showing that a specific area of screen information having a first output direction is set as screen information having a second output direction.

When the touch of a preset method applied to the second areas 262 and 263 is sensed while the screen information having the first output direction is output to the first area 261, The output direction of at least a part of the screen information having the direction can be changed.

At this time, the screen information in which the output direction is changed may be superimposed on the screen information having the first output direction.

On the other hand, the screen information in which the output direction is changed may be screen information determined to be output so as to have the second output direction among the screen information having the first output direction. For example, if the screen information having the first output direction is document information, the screen information having the second output direction may be an image included in the document information.

For example, as shown in FIG. 9A, in a state where document information 910 is displayed in the first area 261, a drag input may be detected in the second areas 262 and 263 have. At this time, the controller 180 may determine the contents of the document information 910 and detect object information to be output in a second output direction different from the first output direction. For example, the object information may be an image 920. 9 (b), the control unit 180 may output the detected image 920 to at least a part of the document information 910. In this case,

Accordingly, the user can receive screen information with higher readability by viewing screen information whose output direction is changed only in at least a part of the screen information.

According to the present invention, the direction of the screen information output to the display unit can be made only by a simple operation, and an image having various output directions can be provided to the user.

In addition, the present invention can provide a highly readable screen to the user by changing the output direction of the screen information output to the display unit through the operation on the side display unit.

The present invention described above can be implemented as computer readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (20)

A body having a front surface and a side surface;
A display unit including a first area disposed on a front surface of the main body and a second area connected to the first area and disposed on the side surface; And
When information on the screen information related to the function being executed in the terminal is displayed in the first area and at least a part of the first area is detected by touching the second area, And a control unit for outputting screen information having a direction different from a direction in which the screen information is output,
Wherein the screen information having the different direction is displayed in at least a part of a first area corresponding to a touch of a predetermined method for the second area. The method according to claim 1,
The screen information having the different direction is screen information to be displayed in the first area when the screen information has the first output direction and when the screen information is outputted in the second output direction different from the first output direction The mobile terminal comprising: 3. The method of claim 2,
The control unit
And outputting an area including the same information as the screen information having the first output direction among the screen information having the second output direction so as to be visually distinguished. The method according to claim 1,
Wherein the control unit controls the display unit to display the screen information having the first output direction and the screen information having the second output direction together. 5. The method of claim 4,
When the touch is applied to any one of the areas where the screen information having the second output direction is displayed, the screen information corresponding to the one of the screen information having the first output direction is displayed on the first area And scrolls the screen information having the first output direction so as to be centered on the screen. The method according to claim 1,
The second region includes a first sub-region disposed on either side of both sides of the body and a second sub-region disposed on the other side,
Wherein when the touch is detected to be applied to the first and second sub regions, the control unit displays information related to the screen information in an area corresponding to the dragged area of the first area, And outputs the output signal so as to have a different direction. The method according to claim 6,
The control unit
And displays the information having the different direction in an area corresponding to the area where the touch is sensed when a touch on at least two points is detected with respect to any one of the second areas provided on both sides. Mobile terminal. The method according to claim 1,
The control unit
And determines a direction in which information related to the screen information is output according to a direction in which the touch of the preset method is applied. 9. The method of claim 8,
The second region includes a first sub-region disposed on either side of both sides of the body and a second sub-region disposed on the other side,
The control unit
Wherein a position at which information related to the screen information is outputted is determined based on a drag input of a different direction being detected for each of the first and second sub regions. 10. The method of claim 9,
Wherein the screen information displayed in the first area maintains an output position independently of the information associated with the screen information being output to at least a part of the first area. The method according to claim 1,
Further comprising at least two camera units having different shooting directions,
The control unit
When a predetermined type of touch is sensed in the second area while an image received from any one of the at least two cameras is displayed on the display unit, Activated,
And outputs the image received from the camera unit having the different photographing direction to at least a part of the display unit. 11. The method of claim 10,
At least two images received from different camera units in the photographing direction are displayed together on the display unit,
Wherein the control unit photographs any one of at least two images having different photographing directions based on a user's request. The method according to claim 1,
The control unit
And analyzing the screen information displayed in the first area and determining at least a part of the screen information outputted in a direction different from a current output direction of the screen information when a touch of a predetermined method is detected in the second area. . The method according to claim 1,
The control unit
In response to a touch in a direction opposite to that of the predetermined type of touch being applied while the screen information having different output directions and information related to the screen information are displayed together in the first area, Is not output any more. A method of controlling a mobile terminal having a display unit on a front surface and a side surface,
Sensing a predetermined type of touch with respect to a second area disposed on the side surface in a state where screen information related to a function being executed in the terminal is displayed in a first area disposed on the front surface; And
And outputting information related to screen information displayed in the first area to at least a part of the first area in a direction different from a direction in which the screen information is output in response to the touch of the predetermined method,
Wherein the output position of the information having the different direction is determined according to a direction in which the touch of the predetermined method is applied to the second area. 16. The method of claim 15,
Wherein the information to be output in the other direction is output to an area corresponding to an area to which the touch of the predetermined type is applied in the first area. 16. The method of claim 15,
Wherein the information having the different direction is information to be displayed in the first area when the screen information is output in a second output direction different from the first output direction when the screen information has a first output direction, To the mobile terminal. 18. The method of claim 17,
Wherein the area including the same information as the screen information having the first output direction among the information having the second output direction is visually distinguished from other information and outputted. 18. The method of claim 17,
Wherein the screen information having the first output direction and the information having the second output direction are displayed together. 20. The method of claim 19,
Wherein the information having the second output direction is superimposed on at least a part of the screen information output in the first output direction.

Images