KR102183445B1 - Portable terminal device and method for controlling the portable terminal device thereof - Google Patents

Abstract

A display method of a portable terminal having a cover including a transparent area and a method of operating the same are provided. In the display method of the present mobile terminal, while a portion of the display area is covered with a cover including a transparent area and a portion of the display area is exposed outside the cover, while the UI element is displayed in the exposed display area, a UI element is selected. In response to a user input, the display area corresponding to the transmissive area may be controlled.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention TECHNICAL FIELD [0001] A portable terminal device and method for controlling the portable terminal device thereof having a cover including a transparent area

The present disclosure relates to a display method of a portable terminal having a cover for protecting the display of the portable terminal and a method of operating the same, and more particularly, to a display method of a portable terminal having a cover including a transparent area and a method of operating the same.

With the recent development of digital technology, a variety of portable terminals that can communicate and process personal information while moving, such as mobile communication terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, and tablet PCs (Personal Computers), have been released. These portable terminals are reaching the stage of mobile convergence, which does not remain in their own traditional domain, but encompasses the domains of other terminals. Typically, mobile terminals include voice calls, video calls, SMS (Short Message Service)/MMS (Multimedia Message Service) messages, electronic organizers, shooting, e-mail transmission and reception, broadcast playback, video playback, Internet, e-commerce, and music. Various functions such as playback, schedule management, social networking service (SNS), friend search service, messenger, and dictionary may be provided.

Such a portable terminal can be carried along with various types of accessories. For example, a storage device, USB, or a portable cradle for convenient viewing (DMB mode or TV mode) by mounting the portable terminal in an inclined manner may be provided in the portable terminal by a connection device, and a wallet while protecting the portable terminal A cover may be provided that performs a role.

The cover can protect the portable terminal from impacts such as falls that occur frequently due to the characteristics of the portable terminal. In addition, the cover is composed of various colors or designs in addition to shock absorption, so that the individuality of the user can be expressed. In particular, when the cover has a transmissive area, the user can check simple information through the transmissive area of the cover while the mobile terminal is protected by the cover. For example, the user can check the current time or whether or not a message is received through the transparent area of the cover. However, although the transmissive area of the cover is a display area that can be quickly and easily checked by the user, functions using the transmissive area of the cover are not diverse and limited.

An object of the present disclosure is to provide various display functions of a portable terminal through a transparent area of a cover.

In addition, in the present disclosure, an object of the present disclosure is to provide various display functions of a portable terminal according to the opening and closing of a cover having a transparent area.

In particular, an object of the present disclosure is to provide various display functions by interlocking the display area exposed outside the cover and the display area corresponding to the transparent area of the cover while the display area of the portable terminal is covered with a cover.

According to an embodiment, a display method performed by a portable terminal connectable to a cover including a transparent area and having a display area having a size larger than that of the cover includes a portion of the display area as a cover including the transparent area. Displaying a UI element in the exposed display area while a part of the display area is covered outside the cover; And controlling a display area corresponding to the transparent area in response to a user input for selecting the UI element while the UI element is being displayed.

The controlling of the display area corresponding to the transparent area may include displaying information on execution of an application related to the UI element on a display area corresponding to the transparent area.

While the UI element is being displayed, in response to a user input moving along a long side of the exposed display area, the step of moving the UI element to another location of the exposed display area and displaying it may be further included. .

The user input for selecting the UI element includes a tap gesture of releasing the touch after touching the UI element, a flick gesture of flicking in the direction in which the cover is located after touching the UI element, and dragging the UI element to a transparent area after touching the UI element. A drag gesture may be one of a drag gesture of touching the UI element and then dragging from the exposed display area to a position corresponding to the transparent area of the cover.

The display area may be a display area provided as a flexible display having a front area and a side area corresponding to the front and side surfaces of the portable terminal.

When the UI element is phone application identification information, the controlling of the display area corresponding to the transparent area may include a keypad, a call button, a text message switch button, a video call button, or a delete button in the display area corresponding to the transparent area. It may include the step of displaying at least one of.

When the UI element is the camera application identification information, the controlling of the display area corresponding to the transparent area includes at least one of a preview screen before shooting, an image after shooting, or a video after shooting in the display area corresponding to the transparent area. It may include the step of displaying.

According to another embodiment, a display method performed by a portable terminal capable of being connected to a cover including a transmissive area and having a display area having a larger size than the cover includes a cover including the transmissive area. Displaying a UI element in a display area corresponding to the transparent area while a part of the display area is exposed outside the cover by being covered with a cover; And controlling a display area exposed outside the cover in response to a user input for selecting the UI element while the UI element is being displayed.

The controlling of the display area exposed outside the cover includes displaying another UI element capable of controlling information related to the UI element in the display area exposed outside the cover in response to a user input for selecting the UI element. It may include steps.

When the UI element is a keypad, controlling the display area exposed outside the cover may include displaying an input result through the keypad on the display area exposed outside the cover.

When the UI element is a folder, controlling the display area exposed outside the cover may include displaying at least one thumbnail included in the folder in the display area exposed outside the cover.

When the UI element is video content, controlling the display area exposed outside the cover may further include displaying a UI element capable of controlling the video content in the display area exposed outside the cover. .

According to another embodiment, in a display method performed by a portable terminal connectable to a front cover including a transmissive area, in a state in which the front display area is covered with the front cover including the transmissive area, the side display area is Displaying a UI element; And controlling a display area corresponding to the transparent area in response to a user input for selecting the UI element while the UI element is being displayed.

According to another embodiment, a portable terminal capable of being connected to a cover including a transmissive area and having a display area having a size larger than that of the cover, includes: a sensing unit detecting a user input; A display unit providing a display area having a size larger than that of the cover for displaying a UI element in the exposed display area while a part of the display area is exposed outside the cover by being covered with the cover including the transmissive area; And a controller configured to control a display area corresponding to the transparent area provided by the display unit in response to the user input through the sensing unit selecting the UI element while the UI element is being displayed.

The control unit may control the display unit to display information on execution of an application related to the UI element in a display area corresponding to the transparent area.

The control unit, while the UI element is displayed, in response to the user input through the sensing unit moving along a long side of the exposed display area, the UI element is moved to another location of the exposed display area It may be characterized by controlling the display unit to be displayed.

The user input may include a tap gesture of touching the UI element and then releasing the touch, a flick gesture of flicking in a direction in which the cover is located after touching the UI element, a drag gesture of touching the UI element and dragging to a transparent area, and the UI It may be one of drag gestures of touching an element and then dragging it from the exposed display area to a position corresponding to the transparent area of the cover.

The display area may be a display area provided as a flexible display having a front area and a side area corresponding to the front and side surfaces of the portable terminal.

When the UI element is phone application identification information, the control unit controls the display unit to display at least one of a keypad, a call button, a text message switch button, a video call button, or a delete button in a display area corresponding to the transparent area. It can be characterized by that.

When the UI element is camera application identification information, the controller controls the display unit to display at least one of a preview screen before shooting, an image after shooting, or a video after shooting in a display area corresponding to the transparent area. can do.

According to another embodiment, a portable terminal connectable to a front cover including a transmissive area includes: a sensing unit detecting a user input; A display unit for displaying a UI element in a side display area while the front display area is covered with the front cover including the transmissive area; And a controller configured to control a display area corresponding to the transparent area provided by the display unit in response to a user input for selecting the UI element while the UI element is being displayed.

According to another embodiment, a portable terminal capable of being connected to a cover including a transmissive area and having a display area having a size larger than that of the cover includes: a sensing unit configured to detect a user input; A display unit configured to display a UI element in a display area corresponding to the transmissive area while a part of the display area is exposed outside the cover by being covered with a cover including the transmissive area; And a controller configured to control a display area exposed outside the cover provided by the display unit in response to a user input through the sensing unit selecting the UI element while the UI element is being displayed.

The control unit, in response to a user input for selecting the UI element, controls the display unit to display another UI element capable of controlling information related to the UI element in a display area exposed outside the cover. I can.

When the UI element is a keypad, the control unit may control the display unit to display an input result through the keypad in a display area exposed outside the cover.

When the UI element is a folder, the controller may control the display unit to display at least one thumbnail included in the folder in a display area exposed outside the cover.

When the UI element is image content, the controller may control the display unit to display a UI element capable of controlling the image content in a display area exposed outside the cover.

As described above, according to various embodiments of the present disclosure, the user may check information through the display area exposed outside the cover while the cover is covered, and check detailed information related to the identified information through the transparent area of the cover. . As a result, the user can additionally check various information simply and easily while the display area in front of the portable terminal is protected. In particular, when the display area on the front side of the portable terminal is deactivated and only the display area on the side is activated, power consumption of the battery of the portable terminal required to operate the display unit can be reduced.

In addition, while the cover is covered, the user can quickly and conveniently control the display area corresponding to the transparent area of the cover by using the UI element displayed in the display area exposed outside the cover. In addition, the user can quickly and conveniently control information displayed in the display area exposed outside the cover by using the UI element displayed in the display area corresponding to the transparent area of the cover. In this way, by implementing an optimal environment for controlling and displaying functions of a portable terminal while the cover is covered, the embodiments of the present disclosure may contribute to improving usability, convenience, and competitiveness of the portable terminal.

1 is a block diagram illustrating a detailed configuration of a portable terminal according to an embodiment of the present disclosure.
2 is a diagram illustrating a structure of software stored in a portable terminal according to an embodiment of the present disclosure.
3A to 3F are diagrams illustrating an example of a portable terminal according to an embodiment of the present disclosure.
4 is a diagram illustrating movement of a mobile terminal according to an embodiment of the present disclosure.
6A to 6H are diagrams illustrating various embodiments of a cover having a transmissive area according to an embodiment of the present disclosure.
7 to 25 are diagrams illustrating various embodiments of displaying information in a mobile terminal according to an embodiment of the present disclosure.
26 to 27 are diagrams illustrating user interaction using a palm in a side display area according to an embodiment of the present disclosure.
28 to 30 are flowcharts illustrating various display methods of the present disclosure.
31 is a block diagram schematically illustrating a configuration of a portable terminal according to another embodiment of the present disclosure.

The terms used in the present specification will be briefly described, and the present disclosure will be described in detail.

Terms used in the embodiments of the present disclosure have selected general terms that are currently widely used as possible while taking functions of the present disclosure into consideration, but this may vary according to the intention or precedent of a technician working in the field, the emergence of new technologies, etc. . In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning of the terms will be described in detail in the description of the corresponding invention. Therefore, the terms used in the present disclosure should be defined based on the meaning of the term and the contents of the present disclosure, not the name of a simple term.

Since the embodiments of the present disclosure may apply various transformations and may have various embodiments, specific embodiments will be illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of the specific embodiment, it is to be understood to include all conversions, equivalents, or substitutes included in the disclosed spirit and technical scope. In describing the embodiments, if it is determined that a detailed description of a related known technology may obscure the subject matter, the detailed description thereof will be omitted.

Terms such as first and second may be used to describe various components, but the components should not be limited by terms. The terms are only used for the purpose of distinguishing one component from another component.

Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprise" or "comprise" are intended to designate the existence of features, numbers, steps, actions, components, parts, or a combination thereof described in the specification, but one or more other It is to be understood that the presence or addition of features, numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance the possibility of being excluded.

In an embodiment of the present disclosure, a'module' or'unit' performs at least one function or operation, and may be implemented as hardware or software, or a combination of hardware and software. In addition, a plurality of'modules' or a plurality of'units' are integrated into at least one module except for'modules' or'units' that need to be implemented with specific hardware and implemented as at least one processor (not shown). Can be.

In an embodiment of the present disclosure, when a part is said to be "connected" with another part, it is not only "directly connected" but also "electrically connected" with another element interposed therebetween. Also includes. In addition, when a part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

Hereinafter, exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the exemplary embodiments. However, the present disclosure may be implemented in various different forms and is not limited to the exemplary embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present disclosure, and similar reference numerals are attached to similar parts throughout the specification.

In an embodiment of the present disclosure, the cover may be an object or device for protecting the display by covering part or all of the display area of the portable terminal. The cover may be electrically or non-electrically connected to the mobile terminal. In addition, the cover may be communicatively connected with the mobile terminal in some cases. In addition, the cover may be sold separately because it is detachable/attachable with the mobile terminal, or may be configured as an integral part and sold together with the mobile terminal.

In addition, in an embodiment of the present disclosure, the user input may include at least one of a touch input, a bending input, a voice input, a button input, and a multimodal input, but is not limited thereto.

In addition, in an embodiment of the present disclosure, "touch input" refers to a touch gesture, etc. performed by a user on a display and a cover to control a device. In addition, "touch input" may include a touch (eg, floating or hovering) in a state that is not in contact with the display and is spaced apart by a predetermined distance or more. The touch input may include a touch & hold gesture, a tap gesture to release after a touch, a double tap gesture, a pan gesture, a flick gesture, a touch drag gesture to move in one direction after touching, a pinch gesture, etc., but is not limited thereto.

In addition, in an embodiment of the present disclosure, "button input" means an input for controlling a device by a user using a physical button attached to the device.

In addition, in an embodiment of the present disclosure, “motion input” refers to a motion that a user applies to a device to control the device. For example, the motion input may include an input for the user to rotate the device, tilt the device, or move the device up, down, left and right.

In addition, in the exemplary embodiment of the present disclosure, "multiple input" means that at least two input methods are combined. For example, the device may receive a user's touch input and motion input, or the user's touch input and voice input.

In addition, in an embodiment of the present disclosure, "application" refers to a set of computer programs designed to perform a specific task. In an embodiment of the present disclosure, applications may be various. For example, there may be a game application, a video playback application, a map application, a memo application, a calendar application, a phone book application, a broadcast application, an exercise support application, a payment application, a photo folder application, and the like, but is not limited thereto.

In addition, in an embodiment of the present disclosure, “application identification information” may be unique information for distinguishing an application from other applications. For example, the identification information of the application may be an icon, an index item, link information, or the like, but is not limited thereto.

In addition, in an embodiment of the present disclosure, the UI (User Interaction) element means an element capable of interacting with a user and providing feedback such as visual, auditory, olfactory, etc. according to a user input. If the UI element is expressed in at least one of an image, text, and video, or if the above-described information is not displayed but there is an area in which feedback is possible according to a user input, this area may be referred to as a UI element. In addition, the UI element, for example, may be the aforementioned application identification information.

1 is a block diagram showing a detailed configuration of a portable terminal 100 according to an embodiment of the present disclosure.

The portable terminal 100 is, for example, a smartphone, a notebook, a PDA, a media player, an MP3 player, a micro server, a GPS device, an e-book terminal, a digital broadcasting terminal, a kiosk, an electronic picture frame, a navigation system, and a wrist watch. ) Or a wearable device such as a Head-Mounted Display (HMD), and other mobile or non-mobile computing devices.

As shown in FIG. 1, the portable terminal 100 includes an image receiving unit 110, an image processing unit 120, a display unit 130, a communication unit 140, a storage unit 150, an audio processing unit 160, and a speaker. It includes a unit 170, a sensing unit 180 and a control unit 190.

Meanwhile, FIG. 1 shows a case where the portable terminal 100 is a device having various functions such as a content providing function and a display function, as an example, and comprehensively shows various components. Accordingly, depending on embodiments, some of the components illustrated in FIG. 1 may be omitted or changed, and other components may be further added.

The image receiving unit 110 receives image data through various sources. For example, the image receiving unit 110 may receive broadcast data from an external broadcasting station, VOD data from an external server in real time, and image data from an external device.

The image processing unit 120 is a component that processes image data received by the image receiving unit 110. The image processing unit 120 may perform various image processing such as decoding, scaling, noise filtering, frame rate conversion, and resolution conversion on image data.

The display unit 130 displays at least one of a video frame processed by the image processing unit 120 or various screens generated by the graphic processing unit 194 of image data.

The implementation method of the display unit 130 is not limited, for example, a Liquid Crystal Display (LCD), an Organic Light Emitting Diodes (OLED) display, an Active-Matrix Organic Light-Emitting Diode (AM-OLED), a Plasma Display Panel (PDP). ) Can be implemented in various types of displays. The display unit 120 may additionally include an additional component according to the implementation method. For example, when the display unit 120 is a liquid crystal type, the display unit 120 drives an LCD display panel (not shown), a backlight unit (not shown) that supplies light thereto, and a panel (not shown). It may include a panel driving substrate (not shown). The display unit 110 may be combined with the touch sensing unit 181 of the sensing unit 180 to be provided as a touch screen.

The display unit 130 may be coupled to at least one of a front area, a side area, or a rear area of the portable terminal 100 in the form of a bent display. The bent display may be implemented as a flexible display or a general display that is not flexible. For example, the bent display may be implemented by connecting a plurality of flat displays.

When the bent display is implemented as a flexible display, the flexible display may be characterized in that it can be bent, bent, or rolled without damage through a paper-thin and flexible substrate. Such a flexible display may be manufactured using a plastic substrate as well as a commonly used glass substrate. In the case of using a plastic substrate, it may be formed using a low-temperature manufacturing processor without using a conventional manufacturing processor in order to prevent damage to the substrate. In addition, for flexible displays, glass substrates that wrap liquid crystals in LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diodes) display, AM-OLED (Active-Matrix Organic Light-Emitting Diode), PDP (Plasma Display Panel), etc. By replacing it with a film, you can give it the flexibility to fold and unfold. Such a flexible display is not only thin and light, but also strong against impact, and has an advantage that it can be bent or bent as before and can be manufactured in various forms.

The flexible display has an active matrix screen of a specific screen size (eg, 3 inches, 4 inches, 4.65 inches, 5 inches, 6.5 inches, 8.4 inches, etc.) according to the size of the mobile terminal 100, and Extends to at least one side of the terminal 100 (e.g., at least one of the left, right, upper, and lower sides), the flexible display is operable radius of curvature (e.g., radius of curvature 5 cm, 1 cm, 7.5mm, 5mm, 4mm, etc.) can be folded to be fastened to the side of the mobile terminal 100.

The communication unit 140 is a component that communicates with various types of external devices according to various types of communication methods. The communication unit 140 includes a WiFi chip 141, a Bluetooth chip 142, a wireless communication chip 143, and an NFC chip 144. The controller 190 communicates with various external devices using the communication unit 140.

In particular, the WiFi chip 141 and the Bluetooth chip 142 perform communication in a WiFi method and a Bluetooth method, respectively. In the case of using the Wi-Fi chip 141 or the Bluetooth chip 142, various types of connection information, such as an SSID and a session key, may be first transmitted/received, and then various types of information may be transmitted/received after a communication connection using the same. The wireless communication chip 143 refers to a chip that performs communication according to various communication standards such as IEEE, ZigBee, 3rd Generation (3G), 3rd Generation Partnership Project (3GPP), and Long Term Evoloution (LTE). The NFC chip 144 refers to a chip that operates in an NFC (Near Field Communication) method using a 13.56 MHz band among various RF-ID frequency bands such as 135 kHz, 13.56 MHz, 433 MHz, 860 to 960 MHz, and 2.45 GHz.

The storage unit 150 may store various programs and data necessary for the operation of the portable terminal 100. It may include a non-volatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The storage unit 150 is accessed by the control unit 190, and data read/write/modify/delete/update data by the control unit 190 may be performed. In the present disclosure, the term storage unit refers to a memory card (not shown) installed in the storage unit 150, a ROM (not shown), a RAM (not shown), or the portable terminal 100 (for example, micro SD card, memory stick).

Specifically, the storage unit 150 may store programs and data for configuring various screens to be displayed on the display area.

Hereinafter, the structure of the software stored in the portable terminal 100 will be described with reference to FIG. 2. According to FIG. 2, software including an OS 110, a kernel 220, a middleware 230, an application 240, and the like may be stored in the storage unit 150.

The operating system (OS) 210 controls and manages the overall operation of the hardware. That is, the OS 210 is a layer responsible for basic functions such as hardware management, memory, and security.

The kernel 220 serves as a path through which various signals including a touch signal sensed by the display unit 130 are transmitted to the middleware 230.

The middleware 230 includes various software modules that control the operation of the portable terminal 100. According to FIG. 2, the middleware 230 includes an X11 module 230-1, an APP manager 230-2, a connection manager 230-3, a security module 230-4, a system manager 230-5, and It includes a multimedia framework 230-6, a UI framework 230-7, a window manager 230-8, and a handwriting recognition module 230-9.

The X11 module 230-1 is a module that receives various event signals from various hardware included in the portable terminal 100. Here, the event may be variously set, such as an event in which a user gesture is detected, an event in which a system alarm occurs, an event in which a specific program is executed or terminated, and the like.

The APP manager 230-2 is a module that manages execution states of various applications 240 installed in the storage unit 150. When an application execution event is detected from the X11 module 230-1, the APP manager 230-2 calls and executes an application corresponding to the event.

The connection manager 230-3 is a module for supporting wired or wireless network connection. The connection manager 230-3 may include various detailed modules such as a DNET module and a UPnP module.

The security module 230-4 is a module that supports certification, permission, and secure storage for hardware.

The system manager 230-5 monitors the state of each component in the portable terminal 100 and provides the monitoring result to other modules. For example, when the remaining battery power is insufficient, an error occurs, the communication connection status is disconnected, the system manager 230-5 reports the monitoring result to the main UI framework 230-7 or the subUI frame. It can be provided as a work 230-9 to output a notification message or a notification sound.

The multimedia framework 230-6 is a module for playing multimedia contents stored in the portable terminal 100 or provided from an external source. The multimedia framework 230-6 may include a player module, a camcorder module, and a sound processing module. Accordingly, it is possible to perform an operation of reproducing various multimedia contents to generate a screen and sound.

The main UI framework 230-7 is a module for providing various UIs to be displayed in the main area of the display unit 130, and the sub UI framework 230-9 provides various UIs to be displayed in the sub-area. This module is for. The main UI framework 230-7 and the sub UI framework 230-9 include an image compositor module that configures various UI elements, a coordinate synthesizer that calculates coordinates in which UI elements are to be displayed, and a configured UI element. It may include a rendering module that renders to the calculated coordinates, a 2D/3D UI toolkit that provides a tool for configuring a 2D or 3D UI.

The window manager 230-8 may detect a touch event or other input event using a user's body or a pen. When such an event is detected, the window manager 230-8 transmits an event signal to the main UI framework 230-7 or the sub UI framework 230-9 to perform an operation corresponding to the event.

In addition, when the user touches and drags the screen, a writing module for drawing a line according to the drag trajectory or a pitch angle, roll angle, yaw angle, etc. are calculated based on a sensor value sensed by the motion detection unit 182 Various program modules, such as an angle calculation module, etc. may be stored.

The application module 240 includes applications 240-1 to 240-n for supporting various functions. For example, it may include a program module for providing various services such as a navigation program module, a game module, an electronic book module, a calendar module, an alarm management module, and the like. These applications may be installed by default, or users may install and use them arbitrarily during use. When a UI element is selected, the main CPU 194 may execute an application corresponding to the selected UI element using the application module 240.

The software structure shown in FIG. 2 is only an example and is not necessarily limited thereto. Therefore, it goes without saying that some may be omitted, modified, or added as necessary. For example, the storage unit 150 includes a sensing module for analyzing signals sensed by various sensors, a messaging module such as a messenger program, a short message service (SMS) & multimedia message service (MMS) program, an e-mail program, etc., and phone information. Various programs may be additionally provided, such as a Call Info Aggregator program module, a VoIP module, and a web browser module.

Again, referring to FIG. 1, the audio processing unit 160 is a component that processes audio data of image content. The audio processing unit 160 may perform various processing such as decoding, amplification, noise filtering, or the like for audio data. Audio data processed by the audio processing unit 160 may be output to the audio output unit 170.

The audio output unit 170 is a component that outputs not only various audio data on which various processing tasks such as decoding, amplification, and noise filtering have been performed by the audio processing unit 160, but also various notification sounds or voice messages. In particular, the audio output unit 170 may be implemented as a speaker, but this is only an embodiment, and may be implemented as an output terminal capable of outputting audio data.

The detector 180 detects various user interactions. The sensing unit 180 may detect at least one of various changes such as a change in posture, a change in illuminance, and a change in acceleration of the portable terminal 100 and transmit an electrical signal corresponding thereto to the control unit 390. That is, the detection unit 180 may detect a state change based on the mobile terminal 100, generate a detection signal accordingly, and transmit the detection signal to the control unit 190. In the present invention, the sensing unit 180 may be composed of various sensors, and when the mobile terminal 100 is driven (or based on user settings), power is supplied to at least one sensor set according to the control of the sensing unit 180 to carry A change in the state of the terminal 100 may be detected.

The sensing unit 180 may be configured to include at least one of all types of sensing devices capable of detecting a state change of the portable terminal 100. For example, the sensing unit 180 is a touch sensor, an acceleration sensor, a gyro sensor, an illumination sensor, a proximity sensor, a pressure sensor. ), a noise sensor (eg, a microphone), a video sensor (eg, a camera module), and at least one of various sensing devices such as a timer.

The sensing unit 180 may be classified into a touch sensing unit 181, a motion sensing unit 182, and a cover opening/closing sensing unit 183, as shown in FIG. 1, depending on the sensing purpose, but is not limited thereto. They can be classified according to more diverse purposes. This does not mean a physical distinction, and at least one sensor may be combined to serve as the sensing units 181, 182, and 183. In addition, a part of the configuration or function of the sensing unit 180 may be included in the controller 190 according to an implementation method.

For example, the touch sensing unit 181 may detect a user's touch input using a touch sensor attached to the back side of the display panel. The control unit 190 acquires information such as touch coordinates and touch time from the touch sensing unit 181, and determines the type of touch input (for example, a tap gesture, a double tap gesture, a pan gesture, a flick gesture, a touch drag gesture, etc.). You can decide. Alternatively, the type of the touch input may be directly determined by using the touch coordinates and the touch time acquired by the touch sensing unit 181.

The cover opening/closing detection unit 183 may determine opening/closing of a cover connected to the portable terminal 100 by using at least one of, for example, a hall sensor, an illuminance sensor, and a pressure sensor. The Hall sensor is an element whose voltage changes according to the strength of a magnetic field, and can detect a potential difference that occurs when a cover is opened or closed when a current flowing through a conductor flows. The control unit 190 may obtain a potential difference generated when the cover is opened or closed from the cover opening/closing detection unit 183, and determine the opening/closing of the cover using information related to the obtained potential difference.

Alternatively, in the case of using the illuminance sensor, the illuminance sensor may detect an electrical signal generated according to a change in ambient illuminance due to the opening and closing of the cover. The control unit 190 may determine the opening/closing of the cover by comparing the detection result obtained from the cover opening/closing detection unit 183 with a preset reference value. For example, if the brightest illuminance measured by the illuminance sensor is 100, the darkest illuminance is 0, and the illuminance of the preset reference value is 30, the illuminance value measured by the illuminance sensor is less than or equal to the reference value 30. In this case, the controller 190 may determine that the cover is covered.

The motion detection unit 182 uses at least one of an acceleration sensor, a tilt sensor, a gyro sensor, and a 3-axis magnetic sensor to move the mobile terminal 100. (For example, rotational movement, tilting movement, etc.) can be detected. The generated electrical signal may be transmitted to the controller 190. For example, assuming an acceleration sensor, the motion detection unit 182 may measure gravitational acceleration for each of the X-axis, Y-axis, and Z-axis based on the portable terminal 100 as shown in FIG. 4. . In particular, the motion detection unit 182 measures the acceleration obtained by adding the movement acceleration and the gravitational acceleration of the mobile terminal 100, but may measure only the gravitational acceleration when the mobile terminal 100 does not move. As an example, a description will be made on the premise that the front of the mobile terminal 100 facing upward is the positive (+) direction of gravitational acceleration, and the rear of the mobile terminal 100 facing upward is the negative (-) direction of gravitational acceleration. do.

As shown in FIG. 4, when the rear surface of the mobile terminal 100 is placed so as to contact a horizontal surface, the acceleration of gravity measured by the motion detection unit 182 is 0 m/sec2 in the X-axis and Y-axis components. It is measured, and only the Z-axis component can be measured for a specific positive value (eg, +9.8 m/sec2). Conversely, when the front surface of the mobile terminal 100 is placed so as to contact a horizontal surface, the acceleration of gravity measured by the motion detection unit 182 is measured as 0m/sec2 in the X-axis and Y-axis components, and the Z-axis component Only a specific negative value (eg -9.8m/sec2) can be measured.

In addition, assuming that the portable terminal 100 is placed at an angle to the surface of the table, the gravitational acceleration measured by the motion detection unit 182 is measured as a value other than 0m/sec2 in at least one axis. , The square root of the sum of squares of the components of the three axes, that is, the magnitude of the vector sum may be the specific value (eg, 9.8 m/sec2). In the above case, the motion detection unit 182 detects each acceleration in the X-axis, Y-axis and Z-axis directions in the coordinate system. It goes without saying that the respective axes and the corresponding gravitational acceleration may be changed depending on the position where the sensor is attached.

), 피치각(pitch angle)(

), 및 요각(yaw angle)(

)으로 나타낼 수 있다. 상기 롤각(

)은 도 4에서 X축을 중심으로 한 회전 각도를 나타내고, 상기 피치각(

)은 상기 도 4에서 Y축을 중심으로 한 회전 각도를 나타내며, 상기 요각(

)은 상기 도 4에서 Z축을 중심으로 한 회전 각도를 나타낼 수 있다. 상기 도 4에 도시된 예시의 경우, 움직임 감지부(182)로부터 전달된 중력 가속도 중 Z축 중력 가속도가 +9.8m/sec2이면, 휴대 단말기(100)이 놓인 자세는 상기 롤각(

), 및 피치각(

)은 '0'에 해당하므로, 상기 휴대 단말기(100)이 놓이는 자세는 Z축의 중력 가속도를 받는 후면이 중력 방향으로 놓인 자세임을 알 수 있다. 상기와 같은 방식에 의해 휴대 단말기(100)이 놓이는 어떠한 자세라도 감지 할 수 있으며, 또한 휴대 단말기(100)의 자세 검출을 위한 자세 검출부가 추가적으로 구현될 수 있다.When the gravitational acceleration transmitted from the motion detection unit 182 is measured by at least one axis component, the controller 190 checks (calculates) the posture in which the portable terminal 100 is placed using the acceleration for each axis. can do. The posture is roll angle (

), pitch angle(

), and yaw angle(

) Can be represented. The roll angle (

) Represents the rotation angle around the X axis in FIG. 4, and the pitch angle (

) Represents the rotation angle around the Y-axis in FIG. 4, and the yaw angle (

) May represent a rotation angle about the Z axis in FIG. 4. In the case of the example shown in FIG. 4, if the Z-axis gravitational acceleration among the gravitational accelerations transmitted from the motion detection unit 182 is +9.8m/sec2, the position in which the mobile terminal 100 is placed is the roll angle (

), and pitch angle (

) Corresponds to '0', so it can be seen that the posture in which the portable terminal 100 is placed is a posture in which the rear surface receiving the gravity acceleration of the Z axis is placed in the direction of gravity. Any posture in which the portable terminal 100 is placed may be detected by the above method, and a posture detection unit for detecting the posture of the portable terminal 100 may be additionally implemented.

The controller 190 may determine the posture of the mobile terminal using an algorithm such as a posture calculation algorithm using an Euler angle, a posture calculation algorithm using an extended Kalman filter, and an acceleration prediction switching algorithm. That is, according to the present invention, a method of measuring a posture of a portable terminal using an accelerometer or the like may be implemented in various ways according to embodiments.

The controller 190 controls the overall operation of the portable terminal 100 by using various programs stored in the storage unit 150.

As shown in FIG. 1, the control unit 190 includes a RAM 191, a ROM 192, a graphic processing unit 193, a main CPU 194, the first to n interfaces 195-1 to 195-n, It includes a bus 196. At this time, the RAM 191, the ROM 192, the graphic processing unit 193, the main CPU 194, the first to n interfaces 195-1 to 195-n, and the like may be connected to each other through the bus 196. .

The ROM 192 stores an instruction set for booting a system, and the like. When power is supplied by inputting the turn-on command, the main CPU 194 copies the O/S stored in the storage unit 150 to the RAM 191 according to the instruction stored in the ROM 192 and executes the O/S. To boot the system. When booting is completed, the main CPU 194 copies various application programs stored in the storage unit 150 to the RAM 191 and executes the application programs copied to the RAM 191 to perform various operations.

The graphic processing unit 193 generates a screen including various objects such as items, images, and texts using an operation unit (not shown) and a rendering unit (not shown). The calculation unit calculates attribute values such as coordinate values, shape, size, color, and the like in which each object is to be displayed according to the layout of the screen by using the control command received from the detection unit 180. The rendering unit generates screens of various layouts including objects based on the attribute values calculated by the calculation unit. The screen generated by the rendering unit is displayed in the display area of the display unit 130.

The main CPU 194 accesses the storage unit 150 and performs booting using the O/S stored in the storage unit 150. In addition, the main CPU 194 performs various operations using various programs, contents, data, etc. stored in the storage unit 150.

The first to nth interfaces 195-1 to 195-n are connected to the various components described above. One of the interfaces may be a network interface that is connected to an external device through a network.

In particular, the control unit 190 selects a UI element through the sensing unit 180 while the UI element is displayed in the exposed display area while a part of the display area is exposed outside the cover covered with a cover including the transmissive area. In response to a user input, the controller 190 may control a display area corresponding to the transparent area provided by the display 130.

In another embodiment, while a portion of the display area is exposed outside the cover covered with a cover including the transmissive area, while the UI element is displayed in the display area corresponding to the transmissive area, the UI element through the sensing unit 180 is In response to a selected user input, the controller 190 may control a display area exposed outside the cover provided by the display 130.

In another embodiment, while the front display area is covered with the front cover including the transmissive area, while the UI element is displayed on the side display area, responding to a user input of selecting a UI element through the sensing unit 180 Thus, the control unit 190 may control a display area corresponding to the transmissive area provided by the display unit 130.

3A to 3F are diagrams illustrating an example of a portable terminal 100 according to an embodiment of the present disclosure.

Like the 　 bar and 　 shown in FIGS. It is formed in 300) and is configured to include an additional device for performing functions of the portable terminal 100. The additional device includes a speaker 321, a sensor (eg, an illuminance sensor 322, a front camera module 323, etc.), a connection interface (eg, a charging port, a data input/output port, an audio input/output). An output port, etc.) 324, a microphone 325, and a physical button (not shown) may be included.

In the exemplary embodiment of the present disclosure, the “bend display area” refers to an area in which data is displayed on the bent display 310. In addition, the "display area" refers to an area in which data is displayed on a bent display and a flat display that is not bent. Data refers to all information that can be displayed on a display area such as images, texts, and videos, and data can be displayed through various screens. The screen may be composed of one layer or a plurality of layers. A plurality of layers may be sequentially overlapped to compose a screen, and in this case, a user may recognize various types of data arranged on the plurality of layers as if they were one screen.

In addition, in the portable terminal 100 having a bent display as shown in FIGS. 3A to 3C, the bent display area 311 corresponding to the front of the portable terminal 100 is a front display area 311 or a main display area. It will be referred to as 311 and the display area 312 corresponding to the side of the portable terminal 100 will be referred to as a side display area 312 or an auxiliary display area 312.

In addition, in the portable terminal 100 having both a bent display and a cover as shown in FIG. 3D, when the front of the portable terminal 100 is covered with a cover, the display area covered with the cover on the front of the portable terminal 100 Will be referred to as the front display area 311, the main display area 311, or the display area 311 in the cover. On the other hand, the display area not covered by a cover on the side of the mobile terminal 100 is referred to as a side display area 312, an auxiliary display area 312, a display area 312 outside the cover or an exposed display area 312. To

In addition, as shown in FIG. 3E, the bent display area 313 covered by the cover of the portable terminal 100 will be referred to as a main display area 313 or a display area 313 in the cover. On the other hand, a display area on the side of the mobile terminal 100 that is not covered by a cover and a partial display area in front of the mobile terminal 100 are a secondary display area 314, a display area 314 outside the cover, or an exposed display area ( 312).

In addition, as shown in FIG. 3F, in the mobile terminal 100 having a flat display, when a part of the front display area of the mobile terminal 100 is covered by a cover, the display area 315 covered by the cover is It will be referred to as the display area 315 or the display area 315 in the cover. On the other hand, a partial display area on the front side of the portable terminal 100 and a display area not covered by a cover on the side of the portable terminal 100 are the auxiliary display area 316, the display area 316 outside the cover, or the exposed display. It will be referred to as a region 316.

In addition, in an embodiment of the present disclosure, the cover may include not only a cover covering the front display area of the portable terminal 100, but also a cover covering all or at least a portion of the side display area of the portable terminal 100. In this case, the cover covering the front display area will be referred to as a front cover, and the cover covering the side display area will be referred to as a side cover. In addition, the front cover and the side cover may be provided in an integrated form or may be provided in separate forms.

In addition, in an embodiment of the present disclosure, that the portable terminal 100 has a front cover means that the portable terminal 100 may have a side cover as well as a front cover.

5 is a diagram illustrating a portable terminal 100 providing notification information according to an embodiment of the present disclosure.

Referring to FIG. 5, the portable terminal 100 may provide notification information 501 using a side display area. The notification information 501 may mean information that the mobile terminal 100 receives from another external device. For example, the notification information 501 includes call reception, message reception (e.g., SMS (Short Message Service) / MMS (Multimedia Message Service)-based message reception), mail reception, push service information reception, social It may include an event such as receiving a notification of a network service (SNS, Social Networking Service). Alternatively, the notification information 501 is information generated in the portable terminal 100 and may mean information related to the current state of the portable terminal 100. For example, the notification information 501 includes the remaining battery capacity of the portable terminal 100, the current time, the connection status of the remote or local network of the portable terminal 100, and the receiving mode status of the portable terminal 100 (e.g., vibration mode). , Silent mode, sound mode, etc.) or the presence or absence of alarm information set by the user.

According to an embodiment of the present disclosure, the mobile terminal 100 does not use the front display area (eg, the front display area is covered by other objects (eg, the cover of the mobile terminal 100), notes, etc.). When the notification information 501 is lost or when the notification information 501 is generated in a state in which the front surface is in contact with the surface of the table, etc.), the portable terminal 100 may provide the notification information 501 through the side display area. Such a situation may include, for example, a situation in which the user turns the portable terminal 100 upside down on a table for a conference. That is, the user can change the state of the portable terminal 100 as the front display area of the portable terminal 100 faces downward and contacts the surface of the table. Alternatively, as shown in FIG. 3D, the front display area of the portable terminal 100 may be covered with a separate cover or note.

In this situation, the portable terminal 100 may detect the state of the portable terminal 100 and enter the side display use mode. The state detection of the portable terminal 100 includes an illuminance sensor that detects a change in the amount of light, a sensor that detects the attitude of the portable terminal 100 (eg, a geomagnetic sensor, an acceleration sensor, etc.), a hall sensor, or a timer. It can be detected by or the like. Here, the sensors may be integrated into one chip, or a plurality of sensors may be implemented as separate chips. For example, the portable terminal 100 may determine a current state according to an illuminance value detected by an illuminance sensor. Alternatively, the portable terminal 100 may determine the current state according to the posture information detected by the motion sensor (eg, measured values for the x-axis, y-axis, and z-axis). Alternatively, the portable terminal 100 may determine the current state according to the current time detected by the timer. In the case of using a timer, it is determined whether the current time of the mobile terminal 100 corresponds to a time zone set by the user to automatically execute the manner notification mode, and entering the manner notification mode when the current time corresponds to the user set time. May correspond to the operation.

In this way, when the front display area of the portable terminal 100 is covered and the side display area is in the use mode, the front display area is processed as a single color (eg, black), or the front display area and the side display area are A method of disconnecting power to cut off the power supply to the front display area may be used. In this case, in the side display use mode, only screen output is performed, and sound output and vibration output may be omitted, but this may be variously defined according to user settings.

In addition, the right-hand mode and the left-hand mode of the mobile terminal 100 may be defined through environment settings provided by the mobile terminal 100 or a separate application. In this case, the portable terminal 100 may operate only the side display area corresponding to the determined mode. As an example, as shown in FIG. 3B, in a situation where the mobile terminal 100 has both a right side display area and a left side display area, when set to the right-hand mode, alarm information is output using the right side display area, and the left hand When the mode is set, alarm information may be output using the left side display area.

6A to 6H are diagrams illustrating various embodiments of a cover having a transmissive area. The transmissive area is an area through which the user can see the display area corresponding to the transmissive area. That is, the transmissive area may include not only an area in which a hole of the cover is made, but also an area in which a part of the cover is made of a transparent or translucent material so that the display area is visible.

Referring to FIG. 6A, the transmissive area 611 of the cover may be located within the cover and may be spaced apart from the display area exposed outside the cover. In this case, the transmissive region 611 of the cover may have a circular shape as shown in 610 of FIG. 6A, or may have a rectangular shape as shown in 610-2 of FIG. 6A. In addition, the transparent region 611 of the cover may have a polygonal shape, a rounded polygonal shape, or an ellipse shape, but is not limited thereto.

In addition, referring to FIG. 6B, the transmissive area 611 of the cover may be connected to the display area 612 exposed outside the cover, so that a part of the cover may be opened. In this case, the transmission area 611 of the connection type cover may have a circular shape as shown in 610-3 of FIG. 6B or a square shape as shown in 610-4 of FIG. 6B. In addition, the transmission region of the connection type cover may have a polygonal shape, a rounded polygonal shape, or an ellipse shape, but is not limited thereto. As shown in FIG. 6B, when the transmissive area 611 of the cover is connected to the display area 612 exposed outside the cover, the display area in the cover refers to the transmissive area 611 of the cover. That is, even if the entire transmissive area 611 of the cover is not surrounded by the cover, if one side of the cover is substantially depressed and can be viewed as an area included in the cover, the transmissive area 611 of the cover is referred to as a display area in the cover I can.

In addition, as shown in FIGS. 6C and 6D, a cover having a transmissive area 611 may cover a part of the front display area of the bent display. Alternatively, as shown in FIGS. 6E and 6F, the cover having the transmissive area 611 may cover a part of the front display area of the flat display. Alternatively, as shown in FIGS. 6G and 6H, a cover having a transmissive area 611 may cover both the front display area and the side display area of the bent display. In this case, the cover covering the front display area among the covers having the transmissive area 611 is referred to as a front cover, and the cover covering the side display area is referred to as a side cover. In addition, the front cover and the side cover may be provided in an integrated form or may be provided in separate forms.

Hereinafter, various embodiments of displaying information in the mobile terminal 100 according to an embodiment of the present disclosure will be described with reference to FIGS. 7 to 25.

The various embodiments of FIGS. 7 to 25 are mainly disclosed for a portable terminal 100 having a bent display, but can also be applied to a portable terminal 100 having a flat display as shown in FIG. 3F. Of course it is possible. In this case, the front display area of the bent display may correspond to the display area in the cover of FIG. 3F. The side display area of the bent display may correspond to the display area outside the cover of FIG. 3E.

In one embodiment, the control unit 190 includes a UI element (eg, application identification information) on the exposed display area in a state in which a part of the display area is covered with a cover including a transparent area and a part of the display area is exposed outside the cover. Can be displayed. In addition, while the UI element is being displayed, in response to a user input for selecting the UI element, the display area corresponding to the transparent area may be controlled.

In another embodiment, the controller 190 may display the UI element in the display area corresponding to the transparent area while a part of the display area is covered with a cover including the transmissive area and a part of the display area is exposed outside the cover. have. And, while the UI element is displayed, in response to a user input for selecting the UI element, the display area exposed outside the cover may be controlled.

First, in FIGS. 7A to 7C, in a state in which a plurality of UI elements are displayed in the display area 712 exposed outside the cover, the sensing unit 180 selects an element 712-1 from among the plurality of UI elements. User input can be detected. In response to a user input for selecting the UI element 712-1, the control unit 190 displays information related to the UI element 712-1 in the display area 711 corresponding to the transparent area of the cover. The unit 130 can be controlled.

As an example, the user input for selecting the UI element 712-1 is a tap gesture of a user touching the UI element 712-1 in the display area 712 exposed outside the cover, referring to 710 of FIG. 7A It may include.

As another example, the user input for selecting the UI element 712-1 is the direction in which the cover is located after touching the UI element 712-1 in the display area 712 exposed outside the cover, referring to 720 of FIG. 7A. It may include a flick gesture of the user to flick with.

In another embodiment, the user input for selecting the UI element 712-1 is a long side after touching the UI element 712-1 of the display area 712 exposed outside the cover, referring to 730 of FIG. 7B. It may include a drag gesture of a user dragging along. In response to the user's drag gesture, as shown in 740 of FIG. 7B, the UI element 712-1 is moved to a position close to the display area 711 corresponding to the transparent area, and a predetermined time (about 0.5 seconds to 1.5 seconds) In the case where no user input is received during the period, the controller 190 may control the display 130 to automatically display information related to the UI element 712-1 on the display area 711 corresponding to the transparent area. have. In this case, the proximity of the transmissive region may be, for example, a horizontal position from the central portion 711-1 of the transmissive region in the display region exposed outside the cover.

In another embodiment, the user input for selecting the UI element 712-1 is a transparent area after touching the UI element 712-1 of the display area 712 exposed outside the cover, referring to 750 of FIG. 7C. A drag gesture of a user dragging to the corresponding display area 711 may be included. In this case, since the display area 711 corresponding to the transparent area and the display area 712 exposed outside the cover are connected to each other, the user can drag the UI element 712-1 without interruption. And, when the touch of the UI element 712-1 is released in the display area 711 corresponding to the transmissive area, as shown in 760 of FIG. 7C, the control unit 190 controls the UI in the display area 711 corresponding to the transmissive area. The display unit 130 may be controlled so that information related to the element 712-1 is displayed.

Referring to 810 of FIG. 8, when the cover of the portable terminal 100 is opened, the display 130 may display application identification information on the display area 811. In this state, when the user covers the cover, as shown in 820 of FIG. 8, the controller 190 may control the display 130 to display application identification information on the exposed display area 812. In this case, the application identification information on the exposed display area 812 may be at least some of the identification information of the application displayed on the front display area 811 before being covered with the cover. For example, the size of the application identification information on the exposed display area 812 may be smaller than the size of the application identification information displayed on the front display area 811 before being covered with a cover, or may be a UI element of another type. have.

Referring to 910 of FIG. 9, in a state in which an application identification information list including application identification information is displayed on the exposed display area 912, the detection unit 180 follows the long side of the exposed display area 912. It can detect moving user input. The user input may be, for example, a touch and drag gesture in a vertical direction. In response to a user input, the controller 190 may move application identification information included in the application list.

As a result of the movement, as shown in 920 of FIG. 9, the controller 190 may control the display 130 to display an application list including identification information whose location is moved in the exposed display area 912. At this time, in response to the user history, the identification information may be circulated and displayed. For example, when the piece of identification information disappears from one side of the exposed display area 912, the piece of identification information may be displayed again on the opposite side of the exposed display area 912. Alternatively, when one identification information disappears from one side of the exposed display area 912, the new identification information may be displayed on one side opposite to the exposed display area 912.

Again, in 920 of FIG. 9, the application identification information 912-1 may be moved to a position close to the display area 911 corresponding to the transparent area of the cover. In this state, when the sensing unit 180 does not receive a user input for a predetermined period of time (about 0.5 to 1 second), the controller 190 turns the display area 911 corresponding to the transparent area from the off state to the on state. The display unit 130 may be controlled to switch. In addition, the controller 190 may control the display 130 to display information related to execution of an application in the display area 911 corresponding to the transparent area. The information related to execution of an application may be, for example, at least one of an execution screen of an application, summary information of an application, and a menu screen capable of executing an application. For example, if the one application identification information is the weather icon 912-1, the information related to execution of the application may be an execution screen of the weather application related to the weather icon.

Referring to 1010 of FIG. 10A, in a state in which an application identification information list including phone application identification information (eg, a phone application icon) is displayed on the exposed display area 1012, the detection unit 180 provides phone application identification information. User input selecting (1012-1) can be detected. The user input may be, for example, a tap gesture to release after touching the identification information. In response to a user input, as shown in 1020 of FIG. 10A, the controller 190 displays at least one of a keypad, a call button, a text message switch button, a video call button, or a delete button on the display area 1011 corresponding to the transparent area. can do. In addition, the controller 190 may control the display 130 to display information related to the phone application (eg, a UI element capable of controlling the phone application) on the exposed display area 1012. The UI element capable of controlling the phone application may include, for example, at least one of a keypad UI element, a recent phone record search UI element, a favorite phone number search UI element, and a contact search UI element.

When the keypad is displayed on the display area 1012 corresponding to the transparent area, the detection unit 180 may detect a user input for selecting at least one of numbers or characters of the keypad. In response to the user's input, as shown in 1030 of FIG. 10B, the control unit 190 displays phone number information related to the input number or character as a result of performing the auto-complete function on the exposed display area 1012. The unit 130 can be controlled. For example, in response to a user's input for selecting a plurality of numbers, the controller 190 searches for a phone number including the selected number, and the searched phone number is displayed on the exposed display area 1012. 130) can be controlled. Next, as shown in 1040 of FIG. 10B, when the sensing unit 180 detects a user input for selecting a call button, the controller 190 may perform a call connection to the searched phone number in response to the user input. .

Referring to 1110 of FIG. 11A, when a message is received by the mobile terminal 100, the control unit 190 controls the display unit 130 to display at least a part of the received message on the exposed display area 1112. I can. While a message is displayed on the exposed display area 1112, the detection unit 180 may detect a user input on the exposed display area 1112. For example, the sensing unit 180 may detect a user input moving along the long side of the exposed display area 1112 of the exposed area. The user input may be, for example, a downward or upward touch and drag gesture. When the user input is the touch and drag gesture 1118 in the downward direction, the controller 190 may delete the message and control the display so that the message is not displayed on the exposed display area 1112.

On the other hand, when the user input is the touch and drag gesture 1119 in the upward direction, as shown in 1120 of FIG. 11A, the controller 190 may display information related to the message on the display area 1111 corresponding to the transparent area. have. The information related to the message may be, for example, a message having more information. For example, when the title of the message is displayed on the exposed display area 1112, the body of the message may be displayed on the display area 1111 corresponding to the transparent area. Alternatively, when a part of the body of the message is displayed on the exposed display area 1112, a larger amount of the message body than the entire body of the message or a part of the message body is displayed on the display area 1111 corresponding to the transparent area. Can be.

Here, as an example, when information related to a message is displayed on the display area 1111 corresponding to the transmissive area, the sensing unit 180 may detect a user input on the display area 1111 corresponding to the transmissive area. I can. The user input may be, for example, a touch drag gesture. In response to a user input, the controller 190 may control the display 130 to display other information related to the message on the display area 1111 corresponding to the transparent area. Here, other information related to the message may be a body of a message including content different from the content of the message being displayed, or a UI element capable of controlling the message.

Again, while information related to the message is displayed in the display area 1111 corresponding to the transparent area in 1120 of FIG. 11A, the controller 190 includes a UI element capable of controlling the message application in the exposed display area 1112 The display unit 130 may be controlled to be displayed. The UI element may include, for example, at least one of a message storage UI element, a message deletion UI element, a message sender storage UI element, a message spam registration UI element, and a keypad UI element for creating a message. While the UI element is displayed on the exposed display area 1112, the controller 190 may detect a user input of selecting the keypad UI element 1112-1 to reply to a received message. In response to a user input, as shown in 1130 of FIG. 11B, the controller 190 may control the display 130 to display a keypad on the display area 1111 corresponding to the transparent area.

In 1130 of FIG. 11B, while the keypad is displayed on the display area 1111 corresponding to the transmissive area, the sensing unit 180 may detect a user input for selecting at least one of numbers or characters of the keypad. In response to a user's input, as shown in 1140 of FIG. 11B, the control unit 190 may control the display unit to display an input result through the keypad. For example, the controller 190 may control the display 130 to display at least a part of a reply message according to an input character on the exposed display area 1112. Next, when the detection unit 180 detects a user input for selecting the send button, the controller 190 can transmit the reply message written using the keypad to the contact that sent the received message in response to the user input. have.

Referring to 1210 of FIG. 12A, in a state in which an application identification information list including camera application identification information (for example, a camera application icon) is displayed on the exposed display area 1212, the detection unit 180 provides camera application identification information. User input selecting (1212-1) can be detected. In response to a user input, as shown in 1220 of FIG. 12A, the controller 190 may control the display 130 to display information related to the camera application on the display area 1211 corresponding to the transparent area. The information related to the camera application may be, for example, a preview screen before shooting. In addition, the control unit 190 may control the display unit 130 to display a UI element capable of controlling a camera application on the exposed display area 1212. The UI element may include, for example, at least one of a zoom in UI element, a zoom out UI element, a shooting UI element, a setting UI element or a camera application end UI element, a flash on/off UI element, and a shooting effect setting UI element. . In a state in which information related to the camera application is displayed on the display area 1211 corresponding to the transparent area, the sensing unit 180 may sense a user input of opening the cover so that the entire display area is exposed. In response to a user input, as shown in 1230 of FIG. 12B, the controller 190 may control the display 130 to display information related to the camera application in the display area 1231 covered by the cover. The information related to the camera application may be, for example, at least one of a preview screen before an enlarged photographing or a UI element capable of controlling the preview screen before photographing.

Referring to 1310 of FIG. 13A, while the preview screen is displayed in the display area 1311 corresponding to the transparent area, the sensing unit 180 is a UI element for photographing a subject of the preview screen in the exposed display area 1312. User input selecting (1312-1) can be detected. When a subject is photographed, as shown in 1320 of FIG. 13A, the controller 190 may control the display so that the photographed image content (eg, an image or a moving image) is displayed on the display region 1311 corresponding to the transparent region. In this situation, the sensing unit 180 may detect a user input on the display area 1311 corresponding to the transparent area. The user input may be, for example, a flick gesture of touching the display area 1311 corresponding to the transparent area and flicking in the direction of the exposed display area 1312. In response to a user input, as shown in 1330 of FIG. 13B, the controller 190 may control the display 130 so that the thumbnail 1312-2 of the image is displayed on the exposed display area 1312. In this way, in response to a user's flick gesture targeting the captured image content, the controller 190 sequentially accumulates and displays the thumbnails of the image content on the exposed display area 1312. ) Can be controlled.

Referring to 1340 of FIG. 13C, in a state in which the thumbnails 1341 of an image are stacked on one side of the exposed display area 1312, the sensing unit 180 displays one thumbnail 1341 among the thumbnails 1341 of the image. User input to select 1) can be received. The user input may be, for example, a touch & hold gesture that maintains the touch for a predetermined time or longer after touching the thumbnail 1341-1. In response to a user input, as shown in 1350 of FIG. 13C, the controller 190 displays the image content of the selected thumbnail 1341-1 in the display area 1311 corresponding to the transparent area, and the exposed display area 1312 The display unit 130 may be controlled to display UI elements capable of editing image content or transmitting image content to a third party. UI elements that can edit video content include, for example, a UI element that adjusts the size of the video content, a UI element that edits the color of the video content, a UI element that applies a filter effect of the video content, and adds information to the video content. It may include at least one of a UI element for storing the edited video content, a UI element for deleting the video content, or a UI element for deleting/moving/deforming a part of the video content when the video content is a video.

Referring to 1410 of FIG. 14A, the controller 190 controls the display 130 to display at least one folder in which content (eg, images, audio, or video) is stored in the display area 1411 corresponding to the transparent area. Can be controlled. In addition, the control unit 190 may control the display unit 130 to display UI elements capable of searching for content by type on the exposed display area 1412. The UI element may include, for example, at least one of a document search UI element, a video search UI element, an image search UI element, and an audio search UI element. In this state, the detection unit 180 may detect a user input for selecting a folder 141-1 in the display area 1411 corresponding to the transparent area. In response to a user input, as shown in 1420 of FIG. 14A, the controller 190 may control the display 130 to display thumbnails of contents included in the selected folder in the exposed display area 1412. While thumbnails of images are displayed, the sensing unit 180 may detect a user input for selecting one thumbnail 1412-1. In response to a user input, as shown in 1430 of FIG. 14B, the controller 190 displays the image content of the selected thumbnail in the display area 1411 corresponding to the transparent area, and the image content in the exposed display area 1412. The display unit 130 may be controlled so that UI elements capable of transmitting edited or video content to a third party are displayed.

Referring to 1510 of FIG. 15, when the gallery application is executed, the controller 190 displays the most recently stored image, the most frequently searched image, or an image previously designated by the user in the display area 1511 corresponding to the transparent area. The display unit 130 may be controlled as possible. While the image is displayed, the sensing unit 180 may detect a user input for selecting an image. In response to a user input, as shown in 1520 of FIG. 15, the controller 190 may control the display 130 to display UI elements capable of editing an image or transmitting an image to a third party itself. have. UI elements that can edit an image include, for example, a UI element that adjusts the size of an image, a UI element that edits the color of an image, a UI element that applies a filter effect to an image, a UI element that adds information to the image, and edits. It may include at least one of a UI element for storing an image or a UI element for deleting an image.

Referring to 1610 of FIG. 16A, while the application identification information list including the web application identification information 1612-1 is displayed on the exposed display area 1612, the detection unit 180 displays the web application identification information 1612. User input to select -1) can be detected. The user input may be, for example, a touch drag gesture of touching the web application identification information 1612-1 and then dragging it to a predetermined position. Here, the predetermined position is a position corresponding to the transmissive area of the cover, for example, may be a position closest to the center of the display area 1611 corresponding to the transmissive area in the exposed area. In response to a user input, as shown in 1620 of FIG. 16A, the controller 190 may display information related to the web application on the display area 1611 corresponding to the transparent area. Information related to the web application may be, for example, identification information of a plurality of web pages. The web page identification information may include, for example, at least one of an image of a web page, web page link information, or a web page name. While a plurality of web page identification information is displayed, the detection unit 180 may detect a user input for selecting one web page identification information 161-1 from among the plurality of web page identification information. The user input may be, for example, a tap gesture of touching the web page identification information 161-1. In a state in which the web page identification information 161-1-1 is touched, the sensing unit 180 may sense a user input of opening the cover so that the entire display area is exposed. In response to a user input, as shown in 1630 of FIG. 16B, the controller 190 displays the web page corresponding to the web page identification information 161-1-1 on the display area 1631 covered with the cover. ) Can be controlled.

Referring to 1710 of FIG. 17, while the application identification information list including the music application identification information 1712-1 is displayed on the exposed display area 1712, the detection unit 180 may determine the music application identification information 1712. User input to select -1) can be detected. The user input may be, for example, a touch drag gesture of touching the music application identification information 1712-1 and dragging to a predetermined position and then releasing the touch. Here, the predetermined position may be the display area 1711 corresponding to the transparent area of the cover. In response to a user input, as shown in 1720 of FIG. 17, the controller 190 automatically plays the music content, and a UI element or music capable of controlling the music content in the display area 1711 corresponding to the transparent area of the cover The display unit 130 may be controlled to display information related to content (eg, an image or a music title). Here, the played music content may be, for example, music content recently played by the user or music content previously designated by the user. Further, the controller 190 may control the display 130 to display other information related to music content (eg, music title, music lyrics, composer, etc.) on the exposed display area 1712.

Referring to 1810 of FIG. 18, while a message (eg, an SNS message) is displayed on the exposed display area 1812, the detection unit 180 may detect a user input for selecting a message. At this time, when content or content identification information is connected to the message, in response to a user input, as shown in 1820 of FIG. 18, the controller 190 includes the content connected to the message in the display area 1811 corresponding to the transparent area. The display unit 130 may be controlled to be displayed. For example, if the content connected to the message is an image, the controller 190 may control the display 130 so that the connected image is displayed on the display area 1811 corresponding to the transparent area. In this case, the control unit 190 controls the display unit 130 to display additional information related to the content (eg, the source of the content, the title of the content, the author of the content, etc.) or the content of the message on the exposed display area 1812. Can be controlled.

Referring to 1910 of FIG. 19, while an application list including one application (eg, map application) identification information is displayed, the detection unit 180 detects a user input for selecting the one application identification information 1912-1. can do. In response to a user input, as shown in 1920 of FIG. 19, the controller 190 may control the display to display image content (eg, a map image) related to an application in the display area 1911 corresponding to the transparent area. . In this case, the controller 190 may control the display 130 so that image content is not displayed in an area of the front display area except for the display area 1911 corresponding to the transparent area. Alternatively, the controller 190 may control the display 130 so that an area other than the display area 1911 corresponding to the transparent area is not activated among the areas covered by the front display cover. While the image content is displayed, the sensing unit 180 may sense a user input for opening the cover. In response to a user input, as shown in FIG. 20, the controller 190 may control the display unit to display information related to image content on the front display area. The information related to the image content may be at least one of an enlarged image content, another image content connected to the image content, detailed information of the image content, or a map image of an adjacent area when the image content is a map image.

In another embodiment, when notification information is obtained while the cover is covered, the controller 190 may control the display 130 to display the notification information in a display area exposed outside the cover.

Alternatively, if the portable terminal 100 has a bent display, the controller 190 may control the display 130 so that notification information is displayed on the side display area. In this case, the portable terminal 100 may or may not have a cover.

Conventionally, if notification information was displayed in a certain area of the display area in the front of the mobile terminal (for example, in the upper part of the display area), according to an embodiment of the present disclosure, notification information is displayed in the side display area, so that more information is displayed in the front display area. Information can be displayed.

Referring to 2110 of FIG. 21, the controller 190 may control the display 130 to display notification information on the side display area 2112. In this case, the notification information may be displayed in a horizontal text mode or a vertical text mode according to preset information. In addition, when there are a plurality of notification information, the notification information may be automatically sorted according to a preset priority or from top to bottom or from bottom to top according to the order in which they occur.

The detector 180 may detect a user input for controlling display of notification information. The user input may be, for example, a touch drag gesture of releasing the touch from the front display area 2111 by touching and then dragging the side display area 2112. In response to a user input, as shown in 2120 of FIG. 21, the control unit 190 controls the display 130 to display detailed information of notification information and other notification information together with a sliding animation effect on the front display area 2111 can do. In addition, as shown in 2130 of FIG. 21, the controller 190 may control the display 130 to display detailed information of the notification information and other notification information on the front display area 2111. In this case, the detailed information of the notification information includes a UI element indicating a state of the mobile terminal 100 related to the notification information, a UI element capable of changing the state of the mobile terminal 100, and a UI element indicating identification information of the notification information. It may include at least one of. For example, if one UI element 2131-1 is selected from among UI elements capable of changing the state of the mobile terminal 100, the state of the mobile terminal 100 will be changed from the non-power saving mode state to the power saving mode state. I can.

In this way, when frequently used notification information is displayed using the side display area 2112, the user can easily select the notification information when necessary and easily check detailed information of the notification information through the front display area 2111. have.

Referring to FIG. 22, the control unit 190 may control the display unit 130 so that notification information in various forms is displayed in the area 2212 on the side display. For example, referring to 2210 of FIG. 22, only notification information 2213 may be displayed in the side display area 2212. As another example, referring to 2220 of FIG. 22, notification information 2213 and application identification information 2214 may be displayed together in the side display area 2212. At this time, since the area in which the notification information 2213 is displayed is reduced, the notification information 2213 may be displayed in two or three lines arranged or displayed instead of a simplified UI element. As another example, referring to 2230 of FIG. 22, in the side display area 2212, notification information 2213-1 and 2213-2 and a UI element 2215 capable of controlling a screen being displayed or content being displayed. Can be displayed. The UI element may be, for example, a soft key 2215. The soft key may be a key that controls a screen displayed on the display area in place of the existing physical button. The soft key may include at least one of a soft key for executing a home screen, a soft key for displaying a menu related to a screen being displayed, or a soft key for returning to a previous screen of the screen being displayed. In this case, the notification information 2213-1 and 2213-2 may be displayed separately at the top and bottom around a UI element such as a soft key.

Referring to FIG. 23, the controller 190 may control the display 130 to display a soft key on the side display area 2312. In this way, when the soft key is displayed on the side display area 2312, the user can easily and quickly control the screen being displayed by using the soft key. In a conventional portable terminal that did not have a side display area, since the soft key is located at the bottom of the display area in front of the portable terminal 100, information in the display area may be partially hidden or omitted. In addition, in the conventional portable terminal 100, which did not have a side display area, it was difficult for a user to operate the soft keys with one hand. In particular, as the display area increases, the user may feel more difficult to select a soft key at the bottom of the front display area by using one hand.

While the soft key is displayed on the side display area 2312, the detection unit 180 may detect a user input for selecting a soft key to execute a function of the soft key. In this case, since the side display area 2312 is easily touched by a user due to physical characteristics, the sensing unit 180 may take into account a malfunction that occurs when the touch is performed. For example, when the sensing unit 180 uses an input sensor, the sensing unit 180 may determine that the soft key is selected when the soft key is pressed over a predetermined pressure. Alternatively, if the soft key is touched for a predetermined time or longer, the detector 180 may determine that the soft key is selected. Alternatively, when detecting a user input of touching the soft key within a certain period of time (for example, 1 second to 3 seconds) after the soft key is displayed on the side display area 2312 by the user's touch drag, the detection unit 180 may determine that the soft key is selected.

24 is a diagram illustrating examples of screens displayed on the side display area 2412. Since the vertical length of the side display area 2412 is about 1.5 to 2 times longer than the horizontal length of the front display area 2412, various pieces of information displayed in different areas of the front display area of the existing mobile terminal are It may be provided together through the display area. For example, notification information and soft keys are displayed at the top and bottom of the front display area of the conventional portable terminal, respectively. However, according to an embodiment of the present disclosure, as shown in 2410 of FIG. 24, objects 2413 representing soft keys are displayed in the center of the side display area 2412, and notification information is displayed at the bottom and top of the soft keys. I can. Alternatively, referring to 2420 of FIG. 24, text 2414 representing a soft key may be displayed in the center of the side display area 2412, and notification information may be displayed at the bottom and top of the soft key.

Referring to 2510 of FIG. 25A, when notification information is displayed on the side display area 2512, the detection unit 180 may detect a user input for selecting one notification information 2512-1 among the notification information. . The user input may be, for example, a tap gesture of touching the day notification information 2512-1 or a flick gesture of flicking the day notification information 2512-1 in the direction in which the front display is located. In response to a user input, as shown in 2520 of FIG. 25A, the controller 190 may control the display 130 so that detailed information 2521 of notification information is displayed on the front display area 2511. For example, when the notification information is an icon indicating that a message has been received, the detailed information 2521 of the notification information may be the body of the message or the title of the message. Alternatively, as shown in 2530 of FIG. 25B, when the front area of the portable terminal 100 is covered with a cover having a transparent area, the controller 190 displays the detailed information 2521 of the notification information in the display area 2531 corresponding to the transparent area. The display unit 130 may be controlled to be displayed on ).

26 to 27 are diagrams illustrating user interaction using a palm in a side display area according to an embodiment of the present disclosure.

As an example, various user inputs using the side display area may be considered.

In this case, since the frequency of touching the front display area of the portable terminal 100 is reduced, the front display area may be less contaminated.

In particular, when a user input using a palm on the front display area is replaced with a user input on the side display, contamination of the front display area can be prevented. Moreover, since the side front display area and the side display area are divided by a certain curvature, it is difficult for the palm to touch the front display area on the side display area.

In addition, conventionally, if the touch area of the palm in the front display area is not large enough, it is difficult to distinguish it from the finger touch, and a malfunction may occur. When a user input using the palm in the side display area is performed, the palm is Because it can cover the whole, the probability of malfunctions can be reduced.

In an embodiment of the present disclosure, a display unit 130 coupled to the detection unit 180 may be provided on the side of the mobile terminal 100, or provided with only the detection unit 180 without the display unit 130. It could be. Alternatively, a part of the side of the portable terminal 100 may be provided with only the sensing unit 180, and another part may be provided with only the display unit 130.

In 2610 of FIG. 26A, while a screen including image content is displayed on the front display area 2611, the sensing unit 180 drags from the bottom up along the long side in the side display area 2612 using the palm. User gestures can be detected. In response to a user gesture, as shown in 2620 of FIG. 26A, the controller 190 may capture a screen being displayed on the front display area 2611. In addition, the display 130 may be controlled so that the thumbnails 261-1 and 2612-1 of the captured image are displayed on one side of the front display area 2611 or on the side display area 2612.

In 2630 of FIG. 26B, while the screen including the image content is displayed on the front display area 2631, the sensing unit 180 drags from top to bottom along the long side using the palm in the side display area 2632. User gestures can be detected. In response to a user gesture, the control unit 190 may capture a screen being displayed on the front display area 2631 and control the display 130 so that the captured image is continuously displayed on the front display area 231 . In addition, the controller 190 may control the display 130 so that a UI element capable of editing the captured image is displayed in the side display area 2262. UI elements include, for example, a UI element that adjusts the size of the captured screen, a UI element that edits the color of the captured screen, a UI element that applies a filter effect to the captured screen, and a UI element that adds information to the captured screen. , It may include at least one of a UI element for storing the captured screen or a UI element for deleting the captured screen without storing.

In this way, the controller 190 may control the display 130 so that UI elements providing different functions are displayed on the side area according to the drag direction of the side area using the palm. As another example, even when a finger other than a palm is used, the controller 190 may control the display 130 so that UI elements providing different functions according to the drag direction are displayed on the side area.

In 2710 of FIG. 27A, while the portable terminal 100 outputs the volume at the first size, the sensing unit 180 covers the side display area 2712 with a palm or in a predetermined direction in the side display area 2712. The dragging user gesture can be detected. In response to a user gesture, as shown in 2720 of FIG. 27A, the controller 190 may control the display 130 to mute the volume being output and display notification information 2711-1 indicating that the volume is muted. . Alternatively, the controller 190 may reduce the volume of the volume being output from the first volume to the second volume.

In 2730 of FIG. 27B, while the volume being output to the portable terminal 100 is muted, the detection unit 180 covers the side display area 2712 with a palm or drags the side display area 2712 in a predetermined direction. User gestures can be detected. In response to the user gesture, as shown in 2740 of FIG. 27D, the controller 190 may output the volume being output again at a volume before the volume is muted. Alternatively, the controller 190 may output the volume at a preset third size.

28 to 30 are flowcharts illustrating various display methods of the present disclosure.

Referring to FIG. 28, when a part of the display area is covered with a cover including a transparent area and a part of the display area is exposed outside the cover, the mobile terminal 100 may display a UI element in the exposed display area ( S2801). In addition, while the UI element is displayed in the exposed display area, the portable terminal 100 may determine whether a user input for selecting the UI element is detected (S2803). User input includes, for example, a tap gesture of touching a UI element and then releasing the touch, a flick gesture of touching the UI element and flicking in the direction in which the cover is located, a drag gesture of touching the UI element and dragging to the transparent area, and after touching the UI element It may be one of the drag gestures of dragging from the exposed display area to a position corresponding to the transparent area of the cover.

As a result of the determination, when a user input is detected (S2803-Y), the portable terminal 100 may control a display area corresponding to the transparent area (S2805). For example, the portable terminal 100 may display information on execution of an application related to a UI element in a display area corresponding to the transparent area.

Referring to FIG. 29, when a part of the display area is covered with a cover including a transmissive area and a part of the display area is exposed outside the cover, the mobile terminal 100 displays a UI element in the display area corresponding to the transmissive area. Can (2901). In addition, while the UI element is displayed in the display area corresponding to the transparent area, the portable terminal 100 may determine whether a user input for selecting the UI element is detected (S2903).

As a result of the determination, when a user input is detected (S2903-Y), the portable terminal 100 may control the display area exposed outside the cover (S2905). For example, the mobile terminal 100 may display another UI element capable of controlling information related to the UI element in a display area exposed outside the cover.

Referring to FIG. 30, in a state in which the front display area is covered with the front cover including the transmissive area, the mobile terminal 100 may display a UI element on the side display area (S3001). While the UI element is displayed on the side display area, the portable terminal 100 may determine whether a user input for selecting the UI element is detected (S3003).

As a result of the determination, when a user input is detected (S3003-Y), the portable terminal 100 may control a display area corresponding to the transparent area (S3005). For example, the portable terminal 100 may display information on execution of an application related to a UI element in a display area corresponding to the transparent area.

31 is a block diagram schematically illustrating a configuration of a portable terminal 100 according to another embodiment of the present disclosure.

Referring to FIG. 31, the portable terminal 100 includes a display unit 130, a sensing unit 180, and a control unit 190. An example of the configuration of the display unit 130, the sensing unit 180, and the control unit 190 has already been described in the above-described part, and thus redundant description is omitted.

In an embodiment, when a part of the display area is exposed outside the cover by being covered with a cover including the transparent area, the display unit 130 may display the UI element in the exposed display area. While the UI element is displayed, the detection unit 180 may detect a user input for selecting the UI element. In response to a user input through the sensing unit 180, the controller 190 may control a display area corresponding to the transparent area provided by the display unit 130.

In another embodiment, when a part of the display area is exposed outside the cover by being covered with a cover including the transparent area, the display unit 130 may display the UI element in the display area corresponding to the transparent area. While the UI element is displayed, the detection unit 180 may detect a user input for selecting the UI element. In response to a user input through the sensing unit 180, the controller 190 may control a display area exposed outside the cover provided by the display unit 130.

In another embodiment, while the front display area is covered with the front cover including the transmissive area, the display 130 may display a UI element in the side display area. While the UI element is displayed, the detection unit 180 may detect a user input for selecting the UI element. In response to a user input through the sensing unit 180, the controller 190 may control a display area corresponding to the transparent area provided by the display unit 130.

The display method of the portable terminal 100 according to the various embodiments described above may be implemented as a program and provided to the portable terminal 100. Specifically, a non-transitory computer readable medium in which a program including a display method of the portable terminal 100 is stored may be provided.

The non-transitory readable medium refers to a medium that stores data semi-permanently and can be read by a device, not a medium that stores data for a short moment, such as a register, cache, or memory. Specifically, the above-described programs may be provided by being stored in a non-transitory readable medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, or the like. Also, the above-described programs may be stored and provided in the storage unit 150 of the portable terminal 100 as an example of a non-transitory readable medium.

In addition, although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and the technical field to which the present invention belongs without departing from the gist of the present disclosure claimed in the claims. In addition, various modifications are possible by those of ordinary skill in the art, and these modifications should not be individually understood from the technical idea or perspective of the present disclosure.

Claims (26)

A method for controlling an electronic device having a display including a main display area and a curved auxiliary display area having a size smaller than the main display area and integrally extending from the main display area and bent toward one side of the main display area. In,
Displaying a user interface on the curved auxiliary display area exposed while the main display area is covered by a cover;
When a user input for the user interface is received, displaying information related to the user interface in a partial area of the main display area provided through a transparent area of the covered cover; And
And when the cover is opened, displaying information related to the user interface displayed on a partial area of the main display area on the main area. The method of claim 1,
Displaying the information related to the user interface,
And displaying information on execution of an application related to the user interface in a partial area of the main display area. The method of claim 1,
While the user interface is being displayed, in response to a user input moving along a long side of the exposed curved auxiliary display area, moving the user interface to a different position of the exposed curved auxiliary display area and displaying it; Control method comprising more. The method of claim 1,
User input to the user interface,
A tap gesture for releasing a touch after touching the user interface, a flick gesture for flicking in the direction in which the cover is located after touching the user interface, a drag gesture for dragging the user interface to a transparent area after touching the user interface, and the And a drag gesture of dragging from the exposed curved auxiliary display area to a position corresponding to the transparent area of the cover. delete The method of claim 1,
When the user interface is phone application identification information, displaying information related to the user interface includes:
And displaying at least one of a keypad, a call button, a text message switch button, a video call button, and a delete button in a partial area of the main display area. The method of claim 1,
When the user interface is camera application identification information, the step of displaying information related to the user interface,
And displaying at least one of a preview screen before shooting, an image after shooting, or a video after shooting on a partial area of the main display area. delete delete delete delete delete delete In the electronic device,
A display including a main display area and a curved auxiliary display area integrally extending from the main display area and bent toward one side of the main display area and having a size smaller than that of the main display area; And
The main display area is provided through a transparent area of the covered cover when a user interface is displayed on the curved auxiliary display area exposed while the main display area is covered by a cover, and when a user input for the user interface is received And a controller configured to display information related to the user interface in a partial area of and when the cover is opened, display information related to the user interface displayed in a partial area of the main display area on the main area. The method of claim 14,
The control unit,
And controlling the display to display information on execution of an application related to the user interface in a partial area of the main display area. The method of claim 14,
The control unit,
While the user interface is displayed, in response to a user input moving along a long side of the exposed curved auxiliary display area, the display is configured so that the user interface is moved to another position of the exposed curved auxiliary display area and displayed. Electronic device, characterized in that to control. The method of claim 14,
The user input,
A tap gesture for releasing a touch after touching the user interface, a flick gesture for flicking in the direction in which the cover is located after touching the user interface, a drag gesture for dragging the user interface to a transparent area after touching the user interface, and the An electronic device comprising one of a drag gesture of dragging from an exposed curved auxiliary display area to a position corresponding to a transparent area of the cover. delete The method of claim 14,
When the user interface is phone application identification information,
The control unit,
And controlling the display to display at least one of a keypad, a call button, a text message switch button, a video call button, and a delete button in a partial area of the main display area. The method of claim 14,
When the user interface is camera application identification information,
The control unit,
And controlling the display to display at least one of a preview screen before shooting, an image after shooting, or a moving picture after shooting in a partial area of the main display area.
delete delete delete delete delete delete

Images