KR20090126141A - Mobile terminal and image capture method - Google Patents

Abstract

PURPOSE: A mobile terminal and an image photographing method thereof are provided to photograph a subject in the front so that the subject cannot be inclined/viewed toward one side through a display unit. CONSTITUTION: A camera(121) is arranged in a transparent display to photograph a object which is externally viewed through the transparent display. A controller(180) detects interference image information included in the subject image by the image displayed on the transparent display, and corrects the subject image. A memory(160) stores correction data for correcting the subject image and a correction function for correcting the subject image based on a mathematical algorithm.

Description

MOBILE TERMINAL AND IMAGE CAPTURE METHOD}

The present invention relates to a method of arranging a camera in an inner center of a transparent display, and to photographing from the front so that a subject viewed through the display does not appear to one side, and a mobile terminal having the same.

The mobile terminal may be configured to perform various functions.

Examples of such various functions include data and voice communication functions, taking pictures or videos through a camera, storing voices, playing music files through a speaker system, and displaying images or videos.

In addition, some mobile terminals include additional functions for playing games, and some mobile terminals are also implemented as multimedia devices. Moreover, recent mobile terminals can receive broadcast or multicast signals to watch video or television programs.

In addition, efforts to support and increase the function of the mobile terminal continue. The foregoing efforts include not only changes and improvements in the structural components forming the mobile terminal, but also improvements in software or hardware. As such a design form, a folder form, a slide form, a bar form or a rotation form design is applied to the mobile terminal.

In addition, the recent mobile terminal is equipped with a plurality of cameras for use in video recording and video call, the camera for use for video call has to be arranged outward from the display area structurally, The image of the user tends to be photographed biased to one side.

An object of the present invention is to provide a mobile terminal and a method of arranging a camera at an inner center portion of a transparent display so that a subject viewed through the display can be photographed from the front so as not to be biased to one side.

Another object of the present invention is to provide a mobile terminal and a method capable of correcting the subject image by removing interference image information included in the subject image when the subject is photographed through the transparent display.

The present invention also provides a mobile terminal and a method for increasing transparency of a display area of a display corresponding to a position where a camera is disposed when the interference image information is further included than a criterion for correcting the subject image. It is to provide.

A mobile terminal according to an embodiment of the present invention for realizing the above object includes a transparent display, a camera disposed inside the transparent display and photographing a subject viewed from the outside through the transparent display, and included in the subject image. And a controller for detecting the interference image information and correcting the subject image.

In addition, the present invention for realizing the above object is to shoot a subject visible to the outside of the transparent display using a camera disposed inside the transparent display, detect the interference image information included in the image of the photographed subject, The subject image is corrected using the detected interference image information.

The mobile terminal according to the present invention configured as described above has an effect of arranging a camera in the inner center of the transparent display so as to photograph a subject seen through the display from the front.

In addition, the mobile terminal according to the present invention configured as described above has an effect of correcting the subject image by removing the interference image information included in the subject image when photographing the subject through the transparent display.

In addition, the mobile terminal according to the present invention configured as described above, when the interference image information is further included than the reference for correcting the subject image, the transparency of the display area of the display corresponding to the position where the camera is disposed It is effective to reduce the interference image information below the correctable reference by increasing the.

Hereinafter, various embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the detailed description of the well-known technology and its configuration which are determined to obscure the gist of the present invention will be omitted. In addition, in describing the present invention with reference to the drawings, components that perform the same function will be described with the same reference numerals.

Hereinafter, a mobile terminal according to the present invention will be described in more detail with reference to the accompanying drawings.

1 is a block diagram of a mobile terminal according to an embodiment of the present invention.

The mobile terminal can be implemented in various forms. For example, the mobile terminal described herein may be a mobile phone, a smart phone, a notebook computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), navigation, or the like. have.

The illustrated mobile terminal 100 includes a wireless communication unit 110, an A / V input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, The interface unit 170 may include a controller 180, a power supply unit 190, and the like. 1 illustrates a mobile terminal having various components. However, not all illustrated components are essential components. The mobile terminal may be implemented by more components than the illustrated components, or the mobile terminal may be implemented by fewer components.

Hereinafter, the components will be described in turn.

The wireless communication unit 110 may include one or more components for wireless communication between the mobile terminal 100 and the wireless communication system or wireless communication between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless internet module 113, a short range communication module 114, a location information module 115, and the like. .

The broadcast receiving module 111 receives a broadcast signal and / or broadcast related information from an external broadcast management server through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and / or broadcast related information or a server that receives a previously generated broadcast signal and / or broadcast related information and transmits the same to a terminal. The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal having a data broadcast signal combined with a TV broadcast signal or a radio broadcast signal.

Meanwhile, the broadcast related information may be provided through a mobile communication network, and in this case, may be received by the mobile communication module 112.

The broadcast related information may exist in various forms. For example, it may exist in the form of Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 receives broadcast signals using various broadcasting systems, and in particular, digital multimedia broadcasting-terrestrial (DMB-T), digital multimedia broadcasting-satellite (DMB-S), and media forward link (MediaFLO). Digital broadcast signals can be received using digital broadcasting systems such as only), digital video broadcast-handheld (DVB-H), integrated services digital broadcast-terrestrial (ISDB-T), and the like. Of course, the broadcast receiving module 111 is configured to be suitable for all broadcast systems providing broadcast signals as well as the digital broadcast system described above.

The broadcast signal and / or broadcast related information received through the broadcast receiving module 111 may be stored in the memory 160.

In addition, the mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The wireless internet module 113 refers to a module for wireless internet access, and the wireless internet module 113 may be internal or external.

The short range communication module 114 refers to a module for short range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like may be used.

In addition, the location information module 115 is a module for checking or obtaining the location of the mobile terminal. One example is the Global Position System (GPS) module. The GPS module receives location information from a plurality of satellites. Here, the location information may include coordinate information represented by latitude and longitude. For example, the GPS module can measure the exact time and distance from three or more satellites and accurately calculate the current position by triangulating three different distances. A method of obtaining distance and time information from three satellites and correcting the error with one satellite can be used. In particular, the GPS module can obtain not only the location of latitude, longitude, and altitude but also accurate time together with three-dimensional speed information from the location information received from the satellite.

Meanwhile, the A / V input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes image frames such as still images or moving images obtained by the image sensor in the video call mode or the photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. Two or more cameras 121 may be provided according to the configuration aspect of the terminal.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes the external sound signal into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the mobile communication module 112 and output in the call mode. The microphone 122 may implement various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data for the user to control the operation of the terminal. The user input unit 130 may include a key pad dome switch, a touch pad (static pressure / capacitance), a jog wheel, a jog switch, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 151 described later, this may be referred to as a touch screen.

The sensing unit 140 detects a current state of the mobile terminal 100 such as an open / closed state of the mobile terminal 100, a location of the mobile terminal 100, presence or absence of a user contact, orientation of the mobile terminal, acceleration / deceleration of the mobile terminal, and the like. To generate a sensing signal for controlling the operation of the mobile terminal 100. For example, when the mobile terminal 100 is in the form of a slide phone, it may sense whether the slide phone is opened or closed. In addition, it is responsible for sensing functions related to whether the power supply unit 190 is supplied with power or whether the interface unit 170 is coupled to an external device.

The interface unit 170 serves as an interface with all external devices connected to the mobile terminal 100. For example, wired / wireless headset ports, external charger ports, wired / wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input / output (I / O) ports, Video I / O (Input / Output) port, earphone port, etc. may be included.

Here, the identification module is a chip that stores various types of information for authenticating the use authority of the mobile terminal 100, and includes a user identification module (UIM) and a subscriber identify module (SIM). ), A Universal Subscriber Identity Module (“USIM”), and the like. In addition, the device equipped with the identification module (hereinafter, 'identification device') may be manufactured in the form of a smart card. Therefore, the identification device may be connected to the terminal 100 through a port. The interface unit 170 receives data from an external device or receives power and transmits the data to each component inside the mobile terminal 100 or transmits the data inside the mobile terminal 100 to an external device.

The output unit 150 is for outputting an audio signal, a video signal, or an alarm signal. The output unit 150 may include a display unit 151, a sound output module 152, an alarm unit 153, and the like.

The display unit 151 displays and outputs information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphic user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the mobile terminal 100 displays a photographed and / or received image, a UI, or a GUI.

Meanwhile, as described above, when the display unit 13 and the touch pad form a mutual layer structure to form a touch screen, the display unit 151 may be used as an input device in addition to the output device. The display unit 151 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a transparent organic light emitting diode, and a flexible display. The display device may include at least one of a flexible display and a 3D display. In addition, two or more display units 151 may exist according to the implementation form of the mobile terminal 100. For example, an external display unit (not shown) and an internal display unit (not shown) may be simultaneously provided in the mobile terminal 100.

The sound output module 152 outputs audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 152 outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed in the mobile terminal 100. The sound output module 152 may include a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying occurrence of an event of the mobile terminal 100. Examples of events occurring in the mobile terminal include call signal reception, message reception, and key signal input. The alarm unit 153 may output a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. When a call signal is received or a message is received, the alarm unit 153 may output a vibration to inform this. Alternatively, when a key signal is input, the alarm unit 153 may output a vibration in response to the key signal input. Through the vibration output as described above, the user can recognize the occurrence of the event. Of course, the signal for notification of event occurrence may be output through the display unit 151 or the voice output module 152.

The memory 160 may store a program for processing and controlling the controller 180 and may provide a function for temporarily storing input / output data (for example, a phone book, a message, a still image, a video, etc.). It can also be done.

The memory 160 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory, etc.), Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM) magnetic memory, Magnetic disk It may include at least one type of storage medium of the optical disk. In addition, the mobile terminal 100 may operate a web storage that performs a storage function of the memory 160 on the Internet.

The controller 180 typically controls the overall operation of the mobile terminal. For example, perform related control and processing for voice calls, data communications, video calls, and the like. In addition, the controller 180 may include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

The power supply unit 190 receives an external power source and an internal power source under the control of the controller 180 to supply power for operation of each component.

The various embodiments described herein may be implemented in a computer readable recording medium using, for example, software, hardware or a combination thereof.

According to a hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), and the like. It may be implemented using at least one of processors, controllers, micro-controllers, microprocessors, and electrical units for performing the functions. It may be implemented by the controller 180.

In a software implementation, embodiments such as procedures or functions may be implemented with separate software modules that allow at least one function or operation to be performed. The software code may be implemented by a software application written in a suitable programming language. In addition, the software code may be stored in the memory 160 and executed by the controller 180.

 In the above, the mobile terminal related to the present invention has been described in terms of components according to functions. Hereinafter, referring to FIGS. 2 and 3, the mobile terminal related to the present invention will be further described in terms of components according to appearance. Hereinafter, for simplicity, a slider type mobile terminal is described as an example among various types of mobile terminals such as a folder type, a bar type, a swing type, a slider type, and the like. Therefore, the present invention is not limited to the slider type mobile terminal, but can be applied to all types of mobile terminals including the above-described type.

2 is a front perspective view of an example of a mobile terminal according to the present invention;

The mobile terminal of the present invention includes a first body 200 and a second body 205 configured to be slidable in at least one direction on the first body 200.

A state in which the first body 200 is disposed to overlap with the second body 205 may be referred to as a closed configuration, and as shown in the drawing, the first body 200 may be referred to as the second body 205. The exposed state of at least a portion of the N may be referred to as an open configuration.

The mobile terminal mainly operates in a standby mode in a closed state, but the standby mode may be released by a user's operation. In addition, although the mobile terminal operates mainly in a call mode or the like in an open state, the mobile terminal may be switched to a standby mode by a user's manipulation or a lapse of a predetermined time.

The case (casing, housing, cover, etc.) forming the exterior of the first body 200 is formed by the first front case 220 and the first rear case 225. Various electronic components are embedded in the space formed by the first front case 220 and the first rear case 225. At least one intermediate case may be further disposed between the first front case 220 and the first rear case 225.

The cases may be formed by injecting a synthetic resin or may be formed of a metal material, for example, a metal material such as stainless steel (STS) or titanium (Ti). The display module 151, the audio output module 152, the camera 121, or the first user input unit 210 may be disposed on the first body 200, specifically, the first front case 220.

The display module 151 includes a liquid crystal display (LCD), organic light emitting diodes (OLED), a transparent OLED (TOLED), and the like, which visually express information.

In addition, since the touch pad is superimposed on the display module 151 in a layer structure, the display module 151 may operate as a touch screen to enable input of information by a user's touch.

The sound output module 152 may be implemented in the form of a speaker.

The camera 121 may be implemented to be suitable for capturing an image or a video of a user or the like.

Like the first body 200, the case forming the exterior of the second body 205 is formed by the second front case 230 and the second rear case 235.

The second user input unit 215 may be disposed on the second body 205, specifically, on the front face of the second front case 230.

The third user input unit 245, the microphone 122, and the interface unit 170 may be disposed in at least one of the second front case 230 or the second rear case 235.

The first to third user inputs 210, 215, and 245 may be collectively referred to as a manipulating portion 130, and may be any type as long as the user is tactile in a tactile manner. Can be employed.

For example, the user input unit may be implemented as a dome switch or a touch pad capable of receiving a command or information by a user's push or touch operation, or a wheel or jog method of rotating a key, or a manipulation method such as a joystick. Can also be implemented.

In functional terms, the first user input unit 210 is for inputting a command such as start, end, scroll, etc., and the second user input unit 215 is for inputting numbers, letters, symbols, and the like.

In addition, the third user input unit 245 may operate as a hot key for activating a special function in the mobile terminal.

The microphone 122 may be implemented in a form suitable for receiving a user's voice, other sounds, and the like.

The interface unit 170 serves as a passage for allowing the mobile terminal according to the present invention to exchange data with an external device. For example, the interface unit 170 is wired or wirelessly, a connection terminal for connecting with an earphone, a port for short-range communication (for example, an infrared port (IrDA port), a Bluetooth port, a wireless LAN port) wireless LAN port), or at least one of power supply terminals for supplying power to the mobile terminal.

The interface unit 170 may be a card socket that accommodates an external card such as a subscriber identification module (SIM) or a user identity module (UIM) and a memory card for storing information.

The power supply unit 190 for supplying power to the mobile terminal is mounted on the second rear case 235 side.

The power supply unit 190 may be detachably coupled for charging, for example, as a rechargeable battery.

3 is a rear perspective view of the mobile terminal of FIG.

Referring to FIG. 3, a camera 121 may be additionally mounted on the rear surface of the second rear case 235 of the second body 205. The camera 121 of the second body 205 has a photographing direction substantially opposite to the camera 121 of the first body 200, and the camera 121 and the camera 121 of the first body 200. And may have different pixels.

For example, the camera 121 of the first body 200 has a low pixel so that it is easy to take a picture of the user's face and transmit it to the counterpart in the case of a video call, and the camera 121 of the second body is generally It is desirable to have a high pixel because the subject is often photographed and not immediately transmitted.

The flash 250 and the mirror 255 may be further disposed adjacent to the camera 121 of the second body 205. The flash 250 illuminates the subject when the subject is photographed by the camera 121 of the second body 205. The mirror 255 allows the user to see the user's face or the like when photographing (self-photographing) the user by using the camera 121 of the second body 205.

The sound output module 152 may be further disposed on the second rear case 235.

The sound output module 152 of the second body 205 may implement a stereo function together with the sound output module 152 of the first body 200, and may be used for a call in a speakerphone mode.

In addition, an antenna 260 for receiving a broadcast signal may be disposed on one side of the second rear case 235. The antenna 260 may be installed to be pulled out of the second body 205.

A portion of the slide module 265 that slidably couples the first body 200 and the second body 205 is disposed on the side of the first rear case 225 of the first body 200.

The other part of the slide module 265 may be disposed on the second front case 230 side of the second body 205 and may not be exposed to the outside as shown in this drawing.

In the above description, the second camera 121 and the like have been described as being disposed on the second body 205, but the present invention is not limited thereto.

For example, at least one or more of the components 260, 121 to 250, and 152 described as disposed on the second rear case 235, such as the camera 121 of the second body, may be the first body 200. May be mounted on the first rear case 225. In such a case, there is an advantage that the configuration (s) disposed in the first rear case 225 in the closed state are protected by the second body 205. In addition, even if the camera 121 of the second body is not provided separately, the camera 121 of the first body may be rotatably formed so that the camera 121 of the second body may be photographed up to the photographing direction of the camera 121. .

The terminal 100 illustrated in FIGS. 1 to 3 may operate in a communication system capable of transmitting data through a frame or packet, including a wired / wireless communication system and a satellite-based communication system. It can be configured to.

Hereinafter, referring to FIG. 4, a communication system capable of operating a terminal according to the present invention will be described.

The communication system may use different air interfaces and / or physical layers. For example, a radio interface usable by a communication system may include frequency division multiple access (FDMA), time division multiple access (TDMA), and code division multiple access (Code Division). Multiple Access (CDMA), Universal Mobile Telecommunications Systems (UMTS) (especially Long Term Evolution (LTE), Global System for Mobile Communications (GSM), etc.) In the following, for convenience of explanation, the description will be limited to CDMA, but the present invention is naturally applicable to all communication systems including the CDMA wireless communication system.

As shown in FIG. 4, the CDMA wireless communication system includes a plurality of terminals 100, a plurality of base stations (BSs) 270, and base station controllers (BSCs) 275. ), And a mobile switching center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and is also configured to be connected to BSCs 275. The BSCs 275 may be coupled to the BS 270 through a backhaul line. The backhaul line may be provided according to at least one of E1 / T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, a plurality of BSCs 275 may be included in the system shown in FIG.

Each BS 270 may include at least one sector, and each sector may include an omnidirectional antenna or an antenna pointing radially out of BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, each of which has a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sectors and frequency assignments may be called a CDMA channel. BS 270 may be referred to as a base station transceiver subsystem ('BTSs'). In this case, the word "base station" may be called the sum of one BSC 275 and at least one BS 270. The base station may also indicate “cell site”. Alternatively, each of the plurality of sectors for a particular BS 270 may be called a plurality of cell sites.

As shown in FIG. 4, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, FIG. 4 illustrates several satellite positioning systems (GPS) satellites 300. The satellites 300 help to locate the at least one terminal of the plurality of terminals 100. Although two satellites are shown in FIG. 4, useful location information may be obtained by two or less or more satellites. The GPS module 115 shown in FIG. 1 cooperates with the satellites 300 to obtain desired location information. Here, the location can be tracked using all the techniques that can track the location, not just the GPS tracking technology. In addition, at least one of the GPS satellites 300 may optionally or additionally be responsible for satellite DMB transmission.

During typical operation of a wireless communication system, BS 270 receives a reverse link signal from various terminals 100. At this time, the terminals 100 are connecting a call, transmitting or receiving a message, or performing another communication operation. Each of the reverse link signals received by a particular base station 270 is processed within by the particular base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functionality, including the organization of soft handoffs between base stations 270. In addition, the BSC 275 transmits the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. Similarly, PSTN 290 connects with MSC 280, MSC 280 connects with BSCs 275, and BSCs 275 send BSs 270 to transmit a forward link signal to terminals 100. ).

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

Hereinafter, operations and operations of the mobile terminal according to the present invention will be broadly divided into a structure and an interface method.

1. Structure of a mobile terminal according to the present invention

When the mobile terminal according to the present invention is classified according to the structure of the display device, the mobile terminal may be divided into a terminal having a dual display and a terminal having a single display. 5 is a diagram illustrating a mobile terminal having a single display by type, and FIG. 6 is a diagram illustrating a mobile terminal having a dual display by type.

The terminals of the dual display and the terminal of the single display illustrated in FIGS. 5 and 6 are respectively a folder form (a), a flip form (b), a slide form (c), and a bar. It can be applied to (Bar) form (d), rotation form (Swivel, Swing (e), or Watch (f).

Hereinafter, in all embodiments, the mobile terminal having the single display or the dual display has a transparent display. And a non-transparent display can be further provided. The transparent display and the non-transparent display may be configured to overlap or may be separately separated.

That is, the single display shown in FIG. 5 is configured as a single module by overlapping a transparent display with a non-transparent display, or only a transparent display is configured. The dual display shown in FIG. 6 separates a transparent display from a non-transparent display. It is configured separately as a display module.

Hereinafter, in all embodiments, the transparent display 154 may be referred to as a transparent OLED (TOLED), and the non-transparent display may be described as a display module 151 or a liquid crystal display (LCD). However, it is not intended to limit the transparent display and the non-transparent display to TOLED and LCD, respectively. The transparent display is a transmissive display capable of displaying on both sides (inner surface-outer surface, lower surface-top surface).

Hereinafter, although the embodiments described in the present invention are applicable to all types of terminals described above, a terminal having a shape which is the easiest to describe according to the embodiments will be described with reference to the drawings.

* Dual display-folder type mobile terminal

7A and 7B are exemplary views showing a mobile terminal having a dual display having a transparent display according to the present invention, and which can change the display direction of information according to a posture.

As shown in FIGS. 7A and 7B, the folder-type mobile terminal according to the present invention arranges the TOLED 154 in the folder unit 410 and the LCD 151 in the main body unit 400. The LCD 151 may act as a main display and the TOLED 154 may act as a sub display.

The TOLED 154 and the LCD 151 may be disposed to be interchanged in position. And the role of Main / Sub can be changed accordingly. For example, when the TOLED 154 is used as the main display and the LCD 151 is used as a sub display in the open state of the folder unit 410, the LCD 151 has an interactive keypad. Can be displayed.

In addition, when the TOLED 154 is operated by itself while the folder unit 410 of the terminal is closed, the main body 400 may block driving of the LCD 151 so as not to disturb the display of the TOLED 154. Can be.

The touch pad may be superimposed on either side of the top or bottom surface of the TOLED 154 and the LCD 151 to be used as a touch screen. Hereinafter, in all embodiments of the present disclosure, the TOLED 154 and the LCD 151 are assumed to operate as a touch screen, unless otherwise noted.

The folder-type mobile terminal may open or close (open / close) a folder in a vertical direction (up / down direction) or open or close it in a horizontal direction (left / right direction) according to its posture. Accordingly, the mobile terminal of the present invention detects the posture (ie, the rotational direction) of the terminal and rotates and outputs information output to the TOLED 154 or the LCD 151 according to the posture (rotational direction) of the terminal. Can be.

FIG. 7A is an exemplary view illustrating an information display method when the folder unit 410 is opened and closed in the vertical direction, and FIG. 7B illustrates an information display method when the folder unit 410 is opened and closed in the horizontal direction. It is an exemplary view shown for the sake of simplicity.

8 is a foldable terminal having a dual form of a transparent display according to the present invention, an exemplary view showing a mobile terminal further comprising a display and a keypad.

As shown in FIG. 8, the mobile terminal according to the present exemplary embodiment arranges TOLED in the folder unit 410 and arranges an LCD window 401 and a keypad 131 in the main body unit 400. The TOLED acts as the main display.

The main display made of TOLED executes and displays most functions and operations in the terminal, including multimedia functions and call functions. On the other hand, the LCD window 401 of the main body 400 preferably executes functions and operations related to the call with the keypad 131. When the TOLED operates alone while the folder of the terminal is closed, it is preferable to block the backlight emission of the dome keypad so as not to disturb the display of the TOLED.

Figure 8 (a) is a front perspective view of a folder-type mobile terminal having a transparent display of the present invention, (b) is a perspective view seen from the rear.

9 is an exemplary view showing a mobile terminal having a folder which can be rotated 360 degrees as a terminal having a transparent display in dual form according to the present invention.

In the mobile terminal according to the present embodiment, as shown in FIG. 9, the TOLED 154 is disposed in the folder unit 410, and the LCD 151 and the keypad 131 are disposed in the main body unit 400.

The TOLED 154 and the LCD 151 may classify and display the types of information according to the purpose.

For example, the TOLED 154 is a main display and displays information related to most functions and operations performed in a terminal, including a multimedia function and a call function. The LCD 151 may display a phone number or additional information input for a phone call as a sub display.

The mobile terminal according to the present embodiment forms a hinge 402 that can be rotated 360 degrees between the folder unit 410 and the main body unit 400, thereby enabling a dual look. That is, as illustrated in FIGS. 9A to 9D, the main body 400 may be rotated 360 degrees around the hinge 402 to be folded.

FIG. 10 is an exemplary view showing a mobile terminal having a transparent display in a dual form according to the present invention, and capable of photographing even when a folder is closed.

As shown in FIG. 10, the mobile terminal according to the present exemplary embodiment arranges the TOLED 154 in the folder unit 410 and the LCD 151 and the keypad in the main body unit 400.

The TOLED 154 may act as a main display and the LCD 151 may act as a sub display. For example, the TOLED 154 displays information related to most functions and operations performed in a terminal, including a multimedia function and a call function, as a main display, and the LCD 151 displays a telephone number input for a telephone call from a keypad. Additional information such as indicators can be displayed.

In addition, the mobile terminal of the present invention may arrange the camera 121 between the LCD 151 and the keypad 131 of the main body 400. By arranging the camera 121 between the LCD 151 and the keypad 131 as described above, subject shooting and self photographing can be performed not only in the open state of the folder part 410 but also in the closed state of the folder part. Self-camera shooting is possible. This is because the camera can be photographed through the transparent display 154.

In addition, as described above, when the folder unit 410 is closed, the camera 121 is positioned at the rear (bottom) center of the transparent display 154. Therefore, when the video call is made while the folder unit 410 is closed as described above, the image of the other party is displayed on the transparent display 154, and the camera 121 is the other party displayed on the transparent display 154. It is located just below the image.

Accordingly, when the user looks at the image of the counterpart displayed on the transparent display 154, an effect such that the direction of the user looks toward the front of the camera occurs. Therefore, the controller 180 may transmit the front image of the user to the counterpart terminal through the camera 121. Accordingly, the other party can feel as if the user is looking at the user in front of the phone.

As another example, in the bar-type mobile terminal, the camera 121 may be disposed in the center of the inner side (lower and lower end) of the transparent display 154 and photograph the subject visible through the transparent display. In this case, an image (interference image) displayed on the transparent display may be photographed together with the subject, and in this case, the subject image may be corrected using preset correction data. If the interference image is included in a subject image having a specific criterion or higher, the interference image may be reduced to a level capable of correction by increasing the transparency of the transparent display.

In addition, when using the self-camera function, the mobile terminal having the transparent display may display a preview image of the camera on a portion where the camera and the transparent display do not overlap. For example, when the slide-type terminal slides a folder unit equipped with a transparent display for taking a selfie, a preview image of the camera may be displayed on the sliding portion of the transparent display.

If other information (eg, multimedia image information) is already displayed on the transparent display, the controller 180 simultaneously adjusts the transparency or color of the transparent display to simultaneously display the multimedia image information and the preview image of the camera. Can also be displayed. In this case, the image to be displayed on the transparent display may be manually changed by a user's manipulation. In order to receive the user's manipulation, the mobile terminal may include a sensor for detecting information such as tilt, touch, key input, pressure, proximity distance, and voice.

11 is a perspective view of a mobile terminal for explaining a method of controlling a size of information output as a folder is opened or closed as a terminal having a transparent display in a dual form according to the present invention.

The mobile terminal arranges the TOLED 154 in the folder unit 410 and separately configures the LCD 151 in the main body unit 400. In addition, the touch pad may be superimposed on the upper (upper surface) or the lower (lower surface) of the TOLED 154 and the LCD 151 to operate as a touch screen.

As described above, either the TOLED 154 or the LCD 151 may be operated as the main display, and the other may be operated as the sub display. For example, the TOLED may be used to show an operating state of the terminal or to display menu information for controlling multimedia playback in a state in which the terminal is closed, and as a secondary display in the state where the terminal is open, according to various scenarios of the user interface. Example: LCD) can be used as a supplementary role.

12A and 12B are exemplary views showing a swivel foldable mobile terminal having a transparent display in dual form according to the present invention.

As shown in the drawing, the mobile terminal in the form of a swivel folder according to the present invention is disposed separately from the TOLED 154 and the LCD 151. Like the mobile terminal having the dual display of the other type described above, the TOLED 154 and the LCD 151 can display different information by distinguishing the main display and the sub display.

For example, when the TOLED 154 is used as the main display in the open state of the folder unit 410, the LCD 151 may display a keypad as a sub display in a software manner.

In addition, the mobile terminal shown in FIGS. 12A and 12B includes a swivel hinge 403. The swivel hinge 403 allows the folder portion 410 to rotate and move at a specific angle (or position).

Dual display--flip type mobile terminal

Figure 13 is an exemplary view showing a flip-type mobile terminal having a transparent display in a dual form according to the present invention.

As shown therein, the flip type mobile terminal according to the present invention arranges a keypad on the flip part 510 and arranges a TOLED 154 and an LCD 151 on the main body 500.

The TOLED 154 and the LCD 151 may operate as either a main display or a sub display. For example, when displaying various types of information (eg, current time, missed incoming call, message arrival, additional service information display, etc.) of the terminal through the TOLED 154, the user is located at the front or rear of the terminal even in the closed state. You can also check the information.

FIG. 14 illustrates another embodiment of the flip type mobile terminal illustrated in FIG. 13, and a separate sub-keypad 511 may be disposed on an outer surface (upper surface) of the flip unit 510. As the auxiliary keypad 511 is disposed on the outer surface of the flip unit as described above, the user may control the operation of the terminal with reference to the information displayed on the TOLED 154 even when the flip unit is closed.

FIG. 15 is another exemplary view illustrating a flip type mobile terminal having a transparent display in a dual form according to the present invention. As shown therein, a TOLED 154 is disposed on a flip part 510 and a main body part 500 is shown. LCD 151 is disposed.

The TOLED 154 and the LCD 151 may operate as either a main display or a sub display. For example, assuming that the TOLED 154 operates as the main display in the open state of the flip unit 510, the LCD 151 may display a software keypad as a sub display.

In addition, when it is assumed that the TOLED 154 operates as an auxiliary display in the closed state of the flip unit 510, the TOLED 154 is a software key for operating the terminal, an operating state of the terminal, and transmitted / received to and from the terminal. Wireless information and various additional information (eg, current time, missed incoming call, message arrival, additional service information display, etc.) may be displayed.

* Dual display--slide type mobile terminal

Figure 16 is a terminal having a transparent display in a dual form according to the present invention, an exemplary view for explaining the information display method of the transparent display as the slide is opened or closed.

As shown in the drawing, the mobile terminal of the slide type according to the present invention arranges the TOLED 154 in the first body 200 and the LCD 151 in the second body 205.

The TOLED 154 and the LCD 151 may operate as either a main display or a sub display, and may display different kinds of information. As an example, when the user takes a self shot, the self shot may be facilitated by referring to the image information output to the TOLED 154.

For example, in the conventional case, the user took a self-camera shot by using a mirror 255 positioned around the camera. However, according to the present invention, as shown in Fig. 16C, the image projected on the camera to a part of the display area (display area visible on the rear side when the terminal is slid) of the TOLED 154 is output as a preview image. Can be. Accordingly, the user may easily take a self-camera photograph by referring to the image displayed on the TOLED 154.

In addition, as shown in FIG. 16A, the TOLED 154 transmits the image output to the LCD 151 in the closed state, and thus outputs basic information necessary for controlling the terminal even when the slide is closed. Enable control.

 ** Dual Display--Bar Type Mobile Terminal

17 is an exemplary view showing a bar type mobile terminal having a dual display in a dual form according to the present invention.

As shown in the drawing, the bar-type mobile terminal arranges the TOLED 154 in the upper part (upper part) of the terminal body and the LCD 151 in the lower part (lower part) thereof. The TOLED 154 and the LCD 151 may operate as either a main display or a sub display, and may display different kinds of information.

FIG. 18 is a diagram illustrating another example of a mobile terminal configured to utilize a rear surface of the terminal as another mobile terminal.

As shown in the drawing, the mobile terminal of the present invention may configure the LCD 151 in the lower portion (lower portion) of the front TOLED 154 and the keypad 131 in the lower portion (lower portion) of the rear TOLED 154. have. Here, the information displayed on the TOLED 154 is shown to explain that the information displayed on the front surface is transmitted through the rear surface, and the information may be displayed by changing or rotating the display direction according to a user's manipulation.

* Watch type terminal

19 is an exemplary view showing a watch type mobile terminal having a transparent display in dual form according to the present invention.

As shown in the drawing, the watch-type terminal is largely connected to a second body 205 including a band unit 133 and including an LCD 151 therein, and one side of the second body 205 and a hinge ( It is connected to the 201, it can be opened or closed, it is composed of a first body 200 including a TOLED (154). Hereinafter, the first body 200 may also be described as a cover.

Like the mobile terminal having the dual display of the other type described above, the TOLED 154 and the LCD 151 may operate as either a main display or a sub display, and may display different kinds of information.

Meanwhile, since the TOLED 154 is transmissive, the TOLED 154 may transmit and display information displayed on the LCD 151 while the cover (ie, the first body 200) is closed. In addition, different information may be displayed on the TOLED 154 and the LCD 151 when the first body 200 is opened, and when the first body 200 is opened, the TOLED 154 and the LCD ( The 151 may be used for any one of a display or a touch pad.

* Single display--folder type mobile terminal

20 is an exemplary view showing a foldable mobile terminal having a transparent display in a single form according to the present invention.

As shown, the mobile terminal according to the present exemplary embodiment may arrange the TOLED 154 in the folder unit 410 and the keypad 131 in the main body unit 400. The keypad may be formed of a dome key and may include a backlight (not shown).

The user may input information by pressing the keypad 131 while the folder unit 410 is opened, and refer to the position of each key of the keypad 131 which is transmitted through the TOLED 154 while the folder unit is closed. The information may be input by touching a key of the corresponding position.

21 is an exemplary diagram for explaining an information input method for a clamshell terminal having a transparent display in a single form according to the present invention.

As shown therein, the mobile terminal according to the present exemplary embodiment arranges the TOLED 154 in the folder unit 410 and a keypad or a touch pad 155 in the main body unit 400. The TOLED 154 may operate as a touch screen by attaching a touch pad (or touch film) to an upper surface (top) or a lower surface (bottom).

The keypad may be formed of a dome key, or may be formed of a printing pattern having various key shapes (for example, numeric keys, direction keys, symbol keys, and character keys). In addition, the keypad or touch pad 155 may include a backlight (not shown). The backlight may be configured using a light emitting diode (LED) or an electroluminescence sheet (EL).

The backlight may be automatically driven by the controller 180 according to a user's manipulation or an opening / closing operation of the folder unit.

For example, when the folder part is closed while specific information is displayed on the TOLED 154, the backlight may not drive the backlight to prevent the keypad from being transmitted through the background. In order to prevent the keypad from being transmitted through the background even when the backlight is not driven, the keypad or the touch pad 155 may be configured with a flat dark color.

Meanwhile, the user may input information by touching the keypad or the touch pad 155 while the folder unit 410 is open. That is, in the situation where the backlight is not driven, the touch pad may receive a user's touch such as handwriting input or dragging.

22 is an exemplary diagram for explaining a keypad configuration for a clamshell terminal having a transparent display in a single form according to the present invention.

As shown therein, the mobile terminal according to the present exemplary embodiment arranges the TOLED 154 in the folder unit 410, and the touch pad 155, the key patterns 156 and various shapes of the various shapes in the main body unit 400. It is possible to place an electroluminescence (EL: 157) for.

The electroluminescent material 157 refers to a material that emits light in a space where electric force is applied, and the EL sheet is a paper-type planar light source using EL (electric light emitting material). This item is used in various industries. It is an ultra-thin material with flexibility, low power consumption, and can be cut and used in various forms.

The input unit 130 activates an EL sheet suitable for each backlight control algorithm by using an EL sheet formed of a multi-layer.

For example, the EL sheet may include a key pattern, a symbol key pattern, a QWERTY key pattern, etc., which are combined with numeric keys and navigation keys, and the controller 180 controls the user or preset backlight control. Depending on the algorithm, one of the key patterns can be activated.

The input unit 130 using the EL sheet may be implemented by a keypad or a touch pad.

FIG. 23 is an exemplary view showing a mobile terminal having a transparent display according to the present invention, the mobile terminal having a configuration capable of limiting information displayed on either side of the transparent display.

As shown in Fig. 23A, the mobile terminal according to the present embodiment arranges the TOLED 154 in the folder portion 410, and the dome keypad, the touch keypad, and the EL sheet in the main body 400. The input unit 130 using the back is disposed.

The back side of the folder portion 410 is designed such that only a part of the TOLED 154 is exposed, as shown in FIG. Thus, with the terminal closed, a portion of the TOLED 154 is exposed to the user. The folder unit 410 according to the present exemplary embodiment may include the TOLEDs 154 on both surfaces (inner surface & outer surface) to perform display in both the open and closed states of the terminal.

24A and 24B are exemplary views showing a swivel foldable mobile terminal having a transparent display in a single form according to the present invention.

As shown in the drawing, the mobile terminal in the form of a swivel folder according to the present invention includes a swivel hinge 403 that separately arranges the TOLED 154 and the keypad 131 and connects the folder portion and the main body portion. The swivel hinge 403 allows the folder portion 410 to rotate and move at a specific angle (or position).

The controller 180 may change the display direction of the information output to the TOLED 154 according to the rotation of the folder unit 410.

In addition, since the TOLED 154 may be double-sided display, the controller 180 may display information displayed on the front surface (first surface) of the TOLED 154 as the folder unit 410 is rotated or opened / closed. Can be displayed on the rear (second side).

* Single display--slide type mobile terminal

25 is an exemplary slide type terminal having a transparent display in a single form according to the present invention, illustrating an information display method of the transparent display as the slide is opened or closed.

As shown therein, the slide-type mobile terminal according to the present invention arranges the TOLED 154 in the first body 200 and the keypad 131 in the second body 205. In addition, the camera 121 is disposed on the rear surface of the second body 205.

When the user wants to take a self-camera shot using the camera 121 disposed on the rear surface, the controller 180 may display a partial display area of the TOLED 154 as shown in FIG. 25C. The image projected on the camera in the display area visible on the rear side when sliding is output as a preview image. Accordingly, the user can check his / her own image displayed on the TOLED 154 and take a self-camera more easily.

In addition, as shown in FIG. 25A, since the keypad 131 provided in the second body is transmitted through the TOLED 154 while the slide is closed, the user may see through the TOLED 154. By referring to the position of each key, information can be input by touching a key of the corresponding position. As described above, the mobile terminal of the present invention enables basic operation control of the terminal even when the slide is closed.

* Single Display--Bar Type Mobile Terminal

FIG. 26 is an exemplary view showing a bar type mobile terminal having a transparent display in a single form according to the present invention.

As shown in the drawing, the bar-type mobile terminal may arrange the TOLED 154 on the front (top) of the body and the keypad 131 on the bottom (bottom) of the body. The TOLED 154 is also exposed to the rear of the terminal.

Thus, as shown in FIG. 27, the keypad 131 may be further disposed below the bottom (bottom) of the TOLED 154 on the rear of the terminal body. Accordingly, when an error occurs in the keypad on one side, the user can use the keypad on the other side. And, it may be used as another mobile terminal.

Here, the information displayed on the TOLED 154 is shown to explain that the information displayed on the front side is transmitted through the rear surface, and the information is displayed on either side of both sides of the TOLED 154 according to a keypad operated by a user. It may be displayed at or may be displayed by simply changing or rotating the display direction.

FIG. 28 is an exemplary view illustrating a configuration of a single display formed by superposing a transparent display and a non-transparent display according to the present invention. For convenience, a description will be given with reference to a bar-type mobile terminal configured with the single display.

As shown in the drawing, the single display according to the present invention overlaps the TOLED 154 and the LCD 151 and constitutes one module. The touch pad (or touch film) 155 may be attached to the upper surface of the touch pad to be used as a touch screen.

As described above, the LCD 151 and the TOLED 154 configured as a single display may be operated as either a main display or a sub display. That is, different information may be output to the LCD 151 and the TOLED 154, or the same information may be output, and various effects may be visually produced according to a method of outputting the information. For example, when a user manipulates and outputs a menu or an image, a stereo effect may be applied to the image or the menu.

The display may be applied not only to a bar-type mobile terminal but also to a folder form, flip form, slide form, rotation form (Swivel, Swing form) or watch form.

FIG. 29 is an exemplary view illustrating a bar type mobile terminal having keypads having different functions on both sides of the terminal in FIG.

As shown in the drawing, the mobile terminal of the present invention configures a first keypad 131a at the bottom (bottom) of the front TOLED 154, and a second keypad (bottom) at the bottom (bottom) of the TOLED 154. 131b). Here, the information displayed on the TOLED 154 is shown to explain that the information displayed on the front surface is transmitted through the rear surface, and the information may be displayed by changing or rotating the display direction according to a user's manipulation.

The first keypad 131a may arrange keys for inputting letters and numbers and shortcut keys for immediately executing some specific functions, and the second keypad 131b may directly execute direction keys and some other specific functions. You can place shortcuts that you can. The shortcut keys may be disposed to overlap the first and second keypads 131a and 131b.

By arranging keys for different functions on the front and rear of the mobile terminal as described above, the keys can be arranged more widely, so that the keypad structure is not complicated, thereby preventing a key input error. For example, a surface on which the first keypad (eg, a keypad composed of alphanumeric keys) is disposed is effective for performing a communication function, and a surface on which the second keypad (eg, a keypad composed of direction keys or function keys) is disposed Effective for performing various multimedia functions such as games.

* Watch type terminal

30 is an exemplary view showing a watch-type mobile terminal having a single transparent display and a solar cell at the rear thereof according to the present invention.

As shown in the drawing, the watch-type terminal is largely connected to a second body 205 including a band cell 133 and a solar cell 191 therein, and one side and the hinge of the second body 205. It is connected to the 201 can be opened or closed, it is composed of a first body 200 including a TOLED (154). Hereinafter, the first body 200 may also be described as a cover.

The solar cell 191 is disposed inside the second body 200, and the TOLED 154 is structurally disposed on the top (outside) of the solar cell 191. In addition, the first body 200 including the TOLED 154 is configured using a sliding means or a hinge 201 so that at least one side can be opened or closed in the terminal body.

In the state in which the first body 200 is closed, the controller 180 may receive a user's command through the touch pad 155 configured at the upper side (top, top, outer side) of the TOLED 154.

In addition, a dome key 132 may be disposed on an upper portion (top, top, and outside) of the solar cell 191, and the controller 180 controls the dome key 132 while the TOLED 154 is open. You can receive the user's command. The execution result of the command input through the dome key 132 may be output on either side of both sides of the TOLED 154 under the control of the controller 180.

On the other hand, since the solar cell 191 is structurally configured to overlap the lower end (lower, lower surface, the inner side) of the TOLED 154, the solar cell 191 may generate electricity using light incident through the TOLED 154. . By arranging the solar cell 191 at the bottom of the TOLED 154 as described above, the area of the solar cell 191 can be widened, and accordingly, the amount of power generation can be increased.

FIG. 31 is an exemplary view illustrating a mobile terminal having a touch pad on a top surface of a solar cell in FIG. 30.

As shown in the drawing, the second body 205 includes a solar cell 191 therein, and a touch pad 155 is disposed on an upper surface (upper, upper, outer surface) of the solar cell 191. . In addition, the first body 200 including the TOLED 154 is configured using a sliding means or a hinge 201 so that at least one side can be opened or closed at the second body 205.

On the other hand, since the solar cell 191 is structurally configured to overlap the lower end (lower, lower, inner side) of the TOLED 154, the first body 200 is transmitted through the TOLED 154 even when the first body 200 is closed. Light can be used to generate electricity.

The controller 180 may receive a user's command through the touch pad 155 while the first body 200 is open. The execution result of the command input through the touch pad 155 may be output on either side of both surfaces of the TOLED 154 under the control of the controller 180.

32 is a watch-type terminal having a transparent display according to the present invention, and is an exemplary view showing a mobile terminal having a touch pad on an upper surface of the transparent display.

As shown in the drawing, the second body 205 includes a solar cell 191 therein, and the first body 200 overlaps the upper portion of the second body 205. The first body 200 includes a TOLED 154, and the TOLED 154 is structurally positioned on an upper surface (upper, upper, outer surface) of the solar cell 191. The touch pad 155 is disposed on an upper surface (upper, upper, outer surface) of the TOLED 154.

Accordingly, a user may input a command to the TOLED 154 through a touch pad 155 disposed on an upper surface thereof, and the solar cell 191 may display the TOLED (regardless of whether the TOLED 154 is displayed). Electricity may be generated using light incident through the light 154. Of course, there is a difference in the amount of light transmitted according to the transmittance of the TOLED 154 and accordingly there may be a difference in the amount of power generated. On the other hand, when the solar cell 191 is configured in black has the effect of improving the color of the TOLED (154).

2. Operation of the mobile terminal according to the present invention (user interface (UI) operation)

As described above, the single display terminal is a terminal composed of one display module by overlapping a transparent display and a non-transparent display, and a dual display terminal is a terminal composed of two display modules separately separating a transparent display and a non-transparent display. to be.

The terminal in the form of a folder is a representative type of mobile terminal that can be configured as the dual display. The terminal in the form of a folder may display independent information on each display as the folder is opened or closed, or by overlapping each display. It may also display associated information. As described above, when each display is overlapped to display related information, a new visual effect may occur.

Therefore, in the following embodiment, the operation and operation of the mobile terminal configured by overlapping a transparent display and a non-transparent display like the single display will be described. In this case, the operation and action may be applied to the mobile terminal of all the above-described types (eg, flip, folder, bar, slide, swivel, watch) unless otherwise noted.

Hereinafter, a display control method according to an operating state of a mobile terminal having a transparent display according to the present invention, a power saving method, and a method for controlling a specific function (eg, a camera function) provided in the terminal will be described in detail.

* Display method of transparent display terminal

Screen display method of a mobile terminal having a transparent display according to the present invention can be divided into a control method related to the three-dimensional display of the LCD 151 and TOLED 154, a control method related to the touch operation, a control method related to the display operation have.

** Display method of LCD (151) and TOLED (154)

Hereinafter, a description will be given of a method of executing a photo album function by a user, selecting one of the photo image items to display a preview screen, or associating the photo image with another function. The present invention relates to a method of dividing the LCD 151 and the TOLED 154 into a main display and a sub display, and dividing and displaying information to be displayed on each display to obtain a stereoscopic effect.

33 to 38 are diagrams for explaining a display control method of a mobile terminal having a transparent display in a single form according to the present invention. In particular, the LCD 151 and the TOLED 154 when the photo album function is executed are shown in FIG. It is an exemplary view for explaining a display control method.

33 to 38 are diagrams illustrating a mobile terminal in the form of a bar, a flip, a slide, a swivel, a folder, and a watch, respectively. Hereinafter, a display control method provided in the above-described mobile terminal of each type will be described with reference to the mobile terminal of the bar type shown in FIG.

As shown in FIG. 33, the display provided in each type of mobile terminal is configured by overlapping the TOLED 154 and the LCD 151 up and down.

The controller 180 may display the execution screen of the photo album on the TOLED 154.

The execution screen of the photo album displays photo image items 331, a direction key 332 for moving the photo image items, a cursor 333 for selecting one of the photo image items, and an operation state. An indicator 334 may be included.

The user may select any one of the photo image items displayed on the photo album execution screen.

The controller 180 may display the selected photo image 335 as a preview image on the LCD 151. In addition, the controller 180 may change the selected photo image into a standby screen image of the LCD 151.

Here, the controller 180 may give an animation effect such that the selected photo image is unfolded after falling downward, and the photo album execution screen is displayed on the TOLED 154 because the TOLED 154 is transparent. Even in the state, the user can see the standby screen image set in the LCD 151.

On the other hand, when the TOLED 154 can be displayed on both sides, it is possible to execute the same operation described above by controlling the front and rear of the TOLED 154, respectively, instead of the LCD 151.

The control entity for the operation and display operation of the LCD 151 and the TOLED 154 according to the present invention described above may be a separate processor having a multimedia processor or a control function.

Hereinafter, an operation and an operation of a mobile terminal including two display modules by separately separating the transparent display and the non-transparent display will be described. In this case, the operation and action of the mobile terminal for driving the dual display may be applied to all the above-described mobile terminals (eg, flip, folder, bar, slide, swivel, watch) unless otherwise mentioned.

39 to 44 are exemplary diagrams for explaining a display control method of a mobile terminal having a transparent display according to the present invention. In particular, an LCD 151 is executed when the photo album function is executed in a mobile terminal having a dual display. It is an exemplary view for explaining a display control method of the TOLED 154.

39 to 44 illustrate a mobile terminal in a folder form, a swivel form, a flip form, a slide form, a bar form, and a watch form, respectively. Hereinafter, a display control method provided in each of the above-described types of mobile terminals will be described with reference to the folder type mobile terminal shown in FIG.

As shown in FIG. 39, in the mobile terminal in which the TOLED 154 and the LCD 151 are separately separated, the controller 180 may display the execution screen of the photo album on the TOLED 154.

The execution screen of the photo album displays photo image items 331, a direction key 332 for moving the photo image items, a cursor 333 for selecting one of the photo image items, and an operation state. An indicator 334 may be included.

The user can select any one of the photo image items displayed on the photo album execution screen, and drag the selected photo image from the TOLED 154 to the LCD 151 as shown in FIG. 39 (b). Flicking can be done. Accordingly, the controller 180 can display the dragged or flicked photo image 335 as a preview image on the LCD 151. In addition, the controller 180 may change the selected photo image into a standby screen image of the LCD 151.

Here, the controller 180 may give an animation effect such that the selected photo image is unfolded after moving to the LCD 151.

The present invention may be provided with a separate function key (hereinafter, referred to as a screen switching function key) for displaying the contents displayed on the TOLED 154 and the LCD 151 interchangeably. The screen switching function key has a toggle function and may be configured as a software key (or an execution icon) on one side of a screen (eg, an indicator area, etc.) of the TOLED 154. It can also be provided as a hardware key.

When the screen switching function key is selected, the controller 180 may change the icon shape of the screen switching function key, and at the same time, display contents of the TOLED 154 and the LCD 151 are interchanged and displayed. That is, it may display that the screen switching function key is selected. Subsequently, when the screen switching function key is selected again, the controller 180 may switch the screen switching function key to its original shape and change the display contents of the TOLED 154 and the LCD 151 again.

** How to control touch operation of LCD and TOLED

The method of controlling the touch operation may be divided into a form of a complete overlap, a part of a overlap form, and a completely separated form according to the degree to which the LCD 151 and the TOLED 154 overlap each other. A mobile terminal having a transparent display according to the present invention requires different touch operations according to the degree of overlap between the LCD 151 and the TOLED 154.

45 is a terminal having a transparent display according to the present invention in a dual form, and is an exemplary view for explaining a display control method according to whether each display overlaps, and the LCD 151 and the TOLED 154 completely overlap. Is an example of form (a), some overlap form (b), and completely separated form (c).

*** Complete overlap of LCD and TOLED

46A to 46C are exemplary views for explaining a method of controlling a touch operation when each display is completely overlapped in FIG. 45.

Hereinafter, a touch operation detected in a fully overlapped form will be described by dividing it into touch (or proximity touch), long touch, long touch, and drag.

If a touch from the outside (real touch) or proximity-touch is detected, the controller 180 displays a display (eg, an upper surface of the corresponding touch point 341 as shown in FIG. 63A). : Assuming that the TOLED 154 is superimposed on the upper surface of the LCD 151, the image list displayed on the TOLED 154 is selected or run.

The mobile terminal according to the present invention may include various sensors to perform various sensing functions, and may include a proximity sensor or a tactile sensor in the sensing unit 140 to detect a proximity-touch.

When the touch sensed from the outside is a long touch (at least 2 seconds to 3 seconds or more), the controller 180 displays a display superimposed on the lower surface (lower, lower, inner surface) of the corresponding touch point as shown in FIG. 63B. (For example, assuming that the LCD 151 overlaps the bottom surface of the TOLED 154, the image list displayed on the LCD 151 is selected. The selected image is then displayed on the TOLED 154.

If the drag is detected together with the long touch from the outside, the controller 180 may display the preview screen of the image selected by the long touch on the TOLED 154 as shown in FIG. 46C.

The selection cursor (or selection bar 342) of the LCD 151 is moved according to the drag, and the selection cursor 342 displays the selected image on the preview screen. Thereafter, when the touch from the outside disappears, the first image selected by the long touch is displayed. The touch operation (long touch + drag) of FIG. 46C is the same even when a slide (movement of the proximity touch corresponding to the drag) is detected from the outside together with the long proximity touch (the proximity touch lasting at least 2 seconds to 3 seconds). Is applied.

If touch operations other than those mentioned above are detected, the controller 180 may operate in the same manner as a general touch control method.

The touch operation control method in the completely overlapped form includes all types of terminals having a single display (for example, a folder type having a single display, a flip type, a slide type, a rotation type (Swivel, It can be applied to swing type, bar type, watch type, etc. In addition, a terminal having a dual display (for example, a closed state of a folder type terminal, a closed state of a flip type terminal, a closed state of a slide type terminal, and a rotation type (swivel, swing type) terminal) Closed state, closed state of watch type terminal, etc.).

*** Some overlap of LCD 151 and TOLED 154

47A and 47B are exemplary diagrams for describing a method of controlling a touch operation in a form in which portions of the displays overlap with each other in FIG. 45.

Hereinafter, a touch operation detected in a partially overlapped form will be described by being divided into touch (or proximity touch), long touch, long touch & drag, touch & drag, and the like.

FIG. 47A illustrates a popup selection window area of the TOLED 154. As shown therein, the controller 180 senses a touch (real touch) or a proximity-touch from the outside. do. When the touch is detected, the touched position is detected. That is, it is detected whether the pop-up selection window area 345 displayed on the TOLED 154 is touched or the external area 346 of the pop-up selection window is touched, and performs different processing operations according to the detected touch positions. .

For example, when the touch is detected in the popup selection window area 345, the controller 180 selects a specific object (eg, a menu list, an execution icon, etc.) or performs the selected function. When the touch is detected at the outer area 346 of the popup selection window of the TOLED 154, the touch may be no action or the popup selection window may be closed or canceled.

FIG. 47B illustrates the overlapped area 347 and the non-overlapped area 348. When the touch detected from the outside is a long touch as shown in FIG. Different processing may be performed depending on whether the non-overlap area 348 is detected or the overlap area 347.

For example, if the touch is detected in the non-overlap area 348, the controller 180 selects a specific object (eg, a menu list, an execution icon, etc.) or performs a function thereof, and is detected in the overlap area 347. In this case, the touch motion control method in the completely overlapped form may be applied in the same manner.

In addition, even when the slide of the proximity touch is detected along with the long proximity touch from the outside, the process is the same as the touch operation (long touch + drag) described above.

On the other hand, when a drag is sensed together with a real touch from the outside, the controller 180 may control a touch operation in a form in which the LCD 151 and the TOLED 154 are separated from each other. The same can be applied. Also, when the proximity touch and the slide of the proximity touch are sensed from the outside, the method of controlling the touch operation in the form in which the LCD 151 and the TOLED 154 are separated from each other may be applied in the same manner.

As described above, the method of controlling the touch operation in the form where the LCD 151 and the TOLED 154 overlap with each other includes a terminal having a dual display (eg, an open state of a slide type terminal, a rotation type ( Swivel, Swing type) open terminal, etc.) can be applied.

*** LCD (151) and TOLED (154) are completely separated

Hereinafter, the touch operation detected in the form in which the LCD 151 and the TOLED 154 are completely separated will be described by dividing the touch operation into touch (or proximity touch), long touch, long touch and drag.

When an actual touch (or proximity touch) or long touch from the outside is detected, the controller 180 selects a specific object (eg, a menu list, an execution icon, etc.) located at the corresponding touch point of the TOLED 154 or performs a function thereof. To perform.

If a drag is detected together with a touch (actual touch) from the outside, the controller 180 may select or move an object (eg, a menu list, an execution icon, etc.) selected by the touch or perform a function thereof. have. For example, the copied contents (or the contents of the clipboard) are displayed on the TOLED 154 and pasted onto the LCD 151 by the above-described operation (touch + drag).

As another example, the object displayed on the TOLED 154 may be moved to the LCD 151 by the above-described operation (touch + drag).

As another example, the web page of the LCD 151 may be enlarged (or reduced) and displayed on the TOLED 154 by the above-described operation (touch + drag). At this time, control such as scrolling is also possible.

When a touch operation other than the above-described form is sensed, the controller 180 may operate in the same manner as a general touch control method.

As described above, 'the method of controlling the touch operation in the form in which the LCD 151 and the TOLED 154 are separated from each other' includes a terminal having a dual display (for example, an open state of a folder type terminal and an open state of a flip type terminal). State, open state of a bar type terminal, open state of a watch type terminal, etc.).

** Control method related to setting of LCD 151 and TOLED 154

The present invention can have a separate vibration feedback or sound feedback in accordance with the operation of the LCD 151 or TOLED 154.

By differently setting the vibration feedback or the sound feedback of the LCD 151 or the TOLED 154, it is possible to know which display (LCD 151 or the TOLED 154) the user has operated. For example, if a user's touch (usually a touch or a long touch) is input while the LCD 151 and the TOLED 154 are completely overlapped (or partially overlapped), the controller 180 may determine the type (or the touch) of the input touch. The operation of the LCD 151 or the operation of the TOLED 154 according to the intention of the user. When controlling the operation of the LCD 151 and controlling the operation of the TOLED 154, different vibration feedback (or sound feedback) is generated.

In addition, the present invention may set the transparency, color or brightness of the TOLED 154 according to the surrounding situation.

Also, in order to solve the problem that the information displayed on the TOLED 154 does not appear clear by displaying the background on the TOLED 154 according to the surrounding situation, the color or brightness of the TOLED 154 is controlled according to the surrounding situation. can do.

In addition, when a camera or a solar cell is disposed on the rear surface (inside, bottom, bottom) of the TOLED 154, a problem affecting the operation of the camera or the solar cell depends on information or transparency displayed on the TOLED 154. In order to solve the problem, transparency of a specific area of the TOLED 154 may be selectively controlled.

As described above, the control of the vibration (or sound) feedback related to the TOLED 154, the transparency, the brightness, and the color according to the surrounding situation may be automatically performed by the controller 180 according to a preset algorithm, and the configuration option is provided. You can also set it yourself.

** Main / sub window concept of LCD and TOLED

According to the present invention, a display may be operated such that the LCD 151 and the TOLED 154 operate as a main window (or a first window) and a sub window (or a second window).

In order to help understand the display method of the main / sub window, an internet browsing method will be described as an example. The main / sub window can be applied to a terminal having a dual display (eg, a folder type, a slide type, a rotation type (swivel or swing type), a watch type, etc.).

48 is an exemplary view illustrating a web browsing method for explaining a main / sub window operating method in a mobile terminal according to the present invention.

As shown in Fig. 48, a web page (for example, a main web page) that is first opened by executing a browser is displayed in a main window (for example, TOLED 154), and is linked to and opened for the first opened web page. Web pages and pop-up pages can be displayed in sub windows (eg, LCDs).

The web pages displayed in the main window or the sub-window can be displayed by swapping the windows according to a configuration option. When only one of the two displays provided in the terminal is used, the web pages displayed in the main window or the sub-window are provided at the bottom (lower, lower, inner side) of the terminal. The web page displayed on the displayed display (for example, a sub-window) can be displayed on the display (for example, a main window) provided on the upper side (upper, upper, outer) of the terminal. For example, when the terminal is closed, the web page displayed in the sub window may be moved to the main window for display.

49A to 49B are exemplary views for explaining a web page display method according to a main / sub window operating method in a mobile terminal according to the present invention.

As shown in FIG. 49A, when a specific text (or a specific object) is selected by a user's touch input (or proximity touch) in the web page # 1 displayed on the main window (eg, the TOLED 154), the controller ( 180 may display a web page (eg, web page # 3) linked to the text in a sub-window (eg, LCD 151).

If the specific text (or the specific object) displayed on the web page # 2 displayed in the sub-window is selected as shown in FIG. 49B, the controller 180 controls the web page (eg, the web page #) linked to the text. 3) can be displayed in the sub window.

The main / sub window can switch the display according to the user's selection, and can also switch the content displayed in each window.

In addition, when the user's input is a proximity touch and a touch is detected on a specific content (eg, text, English word, image, video, flash, etc.) displayed on the main window (eg, TOLED 154), the controller 180 ) May display information on the corresponding content on a sub window (eg, the LCD 151). The sub-window may be returned to its original state when the sensed proximity distance of the proximity touch increases.

* Display control according to the opening and closing operation of the terminal

The opening and closing operation of the mobile terminal includes at least two bodies such as a folder type mobile terminal, a flip type mobile terminal, a slide type mobile terminal, a rotation type (swivel, swing type) mobile terminal, and a watch type mobile terminal. By folding or sliding (slide), or rotating (rotate, Swivel, or Swing) the body of the terminal having a terminal, it means to open or close the terminal (close).

50A and 50B are exemplary views illustrating a method of moving a display object according to an opening / closing operation of a mobile terminal having a dual type transparent display according to the present invention.

When the mobile terminal having the TOLED 154 and the LCD 151 is closed, the information (or object) displayed on each display overlaps, and the overlapped information is displayed on either of the two displays. Hereinafter, a display in which the overlapped information is displayed is called a main display.

In addition, when the terminal is opened, the controller 180 may move and display some objects displayed on the main display (eg, the LCD 151) on the sub display (eg, the TOLED 154).

As described above, an object displayed while moving each display in accordance with opening and closing of the terminal is called a moving object. The moving object may include an indicator, a clock, a calendar, a background memo, a multitasking menu, and input windows as shown in (a) of FIG. 68B.

In addition, as shown in (b) of FIG. 50B, when an object such as a virtual input device (for example, a keypad or a wheel) is displayed on the sub display, the object overlaps with the objects of the main display, thereby making input difficult. Since there is a problem, it is preferable to display it on the main display. Since the input window is small in size and difficult to identify at a glance, the input window is displayed large on the sub display. The positions of the virtual input device and the input window may be interchanged and displayed.

51A and 51B are exemplary views illustrating a method of generating a display object according to an opening and closing operation of a mobile terminal having a dual type transparent display according to the present invention.

As shown in FIG. 51A, when a mobile terminal is opened, a new object may be created on a sub display (eg, TOLED 154). Such objects are called new objects. The new object may not be displayed when two displays overlap each other due to lack of display space, but may be added to a sub display (eg, TOLED 154) when the terminal is opened and the two displays are separated.

For example, as shown in FIG. 51B, new information may be detailed information (additional information) about specific information, a sub menu (or sub menu) for a specific list, or a multimedia player.

** Change the display direction of information on the terminal screen

A mobile terminal having a transparent display according to the present invention may display the information displayed on the display by inverting (or rotating) the display according to the user's point of view according to an opening / closing operation (or a rotating operation of the terminal body).

52 to 55 are diagrams for explaining a method of changing the information display direction of a mobile terminal having a transparent display according to the present invention, each of which has a folder form, a flip form, a rotation (swivel, swing) form, and a bar. It is an exemplary view showing a mobile terminal of the form.

Each type of mobile terminal can rotate or invert information displayed on the display in the same manner according to the attitude of the terminal.

For example, the controller 180 detects this when the folder unit 410 or the flip unit 510 starts to open, and the folder unit 410 when the folder unit 410 is opened at a predetermined angle or more with the main body unit 400. You can rotate or invert the information displayed in). The predetermined angle may be set differently according to the terminal manufacturer or the design.

If the mobile terminal includes a tilt sensor (or gyro sensor), the direction of information displayed on at least one of the two displays may be changed according to the posture of the terminal detected by the tilt sensor. For example, when the posture of the terminal, which was in the vertical direction, is changed in the horizontal direction, the terminal may display the information by changing the display direction from the vertical direction to the horizontal direction. In addition, the mobile terminal of the present invention may be provided with a separate software key (or hardware key) that allows the user to arbitrarily change the display direction of the information.

** Automatic execution of specific functions according to the opening and closing operation of the terminal

When the terminal is opened while the terminal is locked to prevent privacy or other people's access, the controller 180 automatically displays a pop-up window for inputting a password, and when the correct password is input, Release the lock.

If the terminal is closed again when the lock function is not released, the controller 180 closes the pop-up window for receiving the password.

When the lock function is simply set to prevent an unintended touch input or to protect the screen, the controller 180 automatically unlocks the terminal without requiring a password input when the terminal is opened, and automatically locks the terminal when the terminal is closed. You can reset the function.

Fig. 56 is an exemplary view for explaining an operation related to movement of a display object executed in accordance with an opening and closing operation of a mobile terminal having a dual type transparent display according to the present invention. It relates to a function to be automatically reflected in the image displayed on (151).

As shown in Fig. 56A, it is assumed that the terminal in the form of a folder is currently closed and the image editor is running in the TOLED 154.

The user refers to an image displayed on the LCD 151 that is visible through the TOLED 154, and through the image editor a specific image (e.g. hat image) associated with the image displayed on the LCD 151 (e.g., snowman image). You can draw (or edit). At this time, the drawing operation does not directly affect the image displayed on the LCD 151 while the user is drawing (editing) the image.

When the opening of the folder unit 410 is detected during the drawing operation, the controller 180 can apply the drawn image to the image displayed on the LCD 151. For example, a hat image is displayed on the head of the snowman image displayed on the LCD 151. When the folder unit 410 is closed, the application of the image may be released.

As described above, the user may repeat the application and release of the image by opening or closing the folder unit 410 during the drawing operation, and check whether the drawing operation is correctly performed.

In addition to the above-described functions, the mobile terminal according to the present invention may output information related to a plurality of functions executed through a dual display (for example, the TOLED 154 and the LCD 151). For example, it can output navigation and digital multimedia broadcasting, navigation and web browser functions, dual e-book function, display of original photos during photo editing, automatic display of device list for transmission, dual (eg TOLED 154 + LCD 151 web page display and the like.

* Display Control Method for Power Saving

In addition, the mobile terminal according to the present invention controls the TOLED 154 according to an external environment such as ambient illumination, ambient color, time zone, and the like.

The mobile terminal 100 adjusts the background transparency of the TOLED 154 according to the ambient illumination sensed by the illumination sensor. For example, the mobile terminal 100 decreases the background transparency of the TOLED 154 when the peripheral illumination increases, and increases the background transparency of the TOLED 154 when the peripheral illumination decreases.

In addition, the mobile terminal 100 detects the ambient color through the color sensor and the image sensor, and adjusts the brightness and the saturation of the corresponding color if the same color as the detected ambient color exists in the information object displayed on the TOLED 154. do.

In addition, the mobile terminal 100 adjusts the background transparency of the TOLED 154 for each time zone. For example, the background transparency of the TOLED 154 is reduced during the day time when the ambient brightness is bright, and the background transparency of the TOLED 154 is increased during the night time when the ambient brightness becomes dark.

57 is an exploded perspective view illustrating an arrangement structure of a transparent display module and a camera of a mobile terminal according to the present invention. Hereinafter, the display module in the present embodiment will be described on the assumption that the transparent display module 154 configured using the transparent organic light emitting diode (TOLED) is applied.

Since the touch pad 155 is superimposed on the transparent display module 154 in a layer structure, the transparent display module 154 may operate as a touch screen to enable input of information by a user's touch.

In addition, the camera 121 may be disposed on the rear surface (bottom) of the transparent display module 154. That is, the camera 121 may photograph a subject that is viewed to the outside through the transparent display module 154. Therefore, when the display area of the display corresponding to the photographing position of the camera is transparent, a clear image can be captured.

However, in the present invention, when the display area corresponding to the photographing position of the camera is not transparent by the image information output to the transparent display module 154, the transparency of the transparent display module 154 is controlled or the You can sharpen the video recorded by the camera. Image information output to the transparent display module 154 may be used to correct the image.

Specific methods for the transparency control or image correction will be described with reference to other drawings.

On the other hand, the camera 121 is preferably located in the middle (middle) of the rear (bottom) of the transparent display module 154, the position can be changed according to the configuration of the user interface for video call. In addition, the configuration of disposing the camera 121 on the rear (bottom) of the transparent display module 154, although not shown in the drawings, to any mobile terminal of any design form, such as folder form, slide form, bar form or rotation form Application is possible.

58 is a flowchart illustrating an image capturing method of a mobile terminal according to the present invention. In particular, a capturing method according to image information output to the transparent display module 154 during a video call will be described.

The controller 180 sets the operation mode of the terminal to the video call mode according to a user's command (S101). The user's command may be input by a specific key, touch, voice, pressure, access to a specific menu, a finger gesture of the user, or posture (tilt) information of the mobile terminal.

The memory 160 stores correction data generated by using image information output to the transparent display module 154. The correction data is data for correcting an image photographed by the camera 121. That is, since the camera 121 is structurally disposed on the rear (bottom) of the transparent display module 154, the camera 121 photographs a subject through the transparent display module 154.

Therefore, the image captured by the camera 121 may take a distorted image under the influence of the transparency of the transparent display module 154 itself and the image information output to the transparent display module. Therefore, the correction data for correcting the distorted image is stored in the memory 160.

The correction data includes at least one of color information (R, G, B), luminance information, brightness information, gamma control information, and contrast information. In addition, the correction data may be stored as a table of correction information for the output image, and may be stored as a mathematical function to obtain the same correction result in order to save the capacity of the memory in which the correction data is stored.

In the video call mode, the controller 180 outputs the counterpart image to the transparent display module 154 and simultaneously controls the camera 121 to capture a user (subject) visible to the outside of the transparent display module 154 ( S102).

Then, the image information output to the transparent display module 154 is detected (S103). Since the controller 180 controls the transparent display module 154 to output image information, the controller 180 can know image information that is currently output even without a separate hardware sensor.

Therefore, the controller 180 determines whether the detected image information is within a range capable of correcting an image of a subject (user) (S104). The detected image information may be compared with correction data stored in the memory 160 to determine whether the detected image information is within a range (or reference) for correcting an image of a subject (user).

For example, when the transparency of the image information output to the display area exceeds a predetermined reference (or correctable range), that is, the display area corresponding to the photographing position of the camera is too opaque to correct the distorted image. If it is determined that it is difficult, the controller 180 can control the transparency (or transmittance) of the display area (S108). The controller 180 may adjust the transparency by changing the shape, size, brightness, or color of the image output to the transparent display module 154.

As described above, the controller 180 controls the transparency of the display area of the display corresponding to the photographing position of the camera. That is, the output image is controlled to be in a correctable state.

Meanwhile, if the detected image information is within a range (or reference) for correcting an image of a subject (user), the controller 180 stores the correction data (or a correction function) corresponding to the detected image information. It draws out at 160 (S105).

Then, the image data (interference image) output to the transparent display module 154 is included using the correction data or a correction function to correct the photographed subject image (S106), and the corrected image is being called. It transmits to the other terminal (S107).

59A is an exemplary view seen from the front in order to explain a camera arrangement structure of a mobile terminal according to the present invention. FIG. 59B is an exemplary diagram for explaining an effect of a video call when the camera is disposed in a mobile terminal according to the present invention. FIG.

When the camera is arranged in the same structure as in the present embodiment, it is possible to solve the problem that the user's image is taken to one side during the video call. For example, when the camera performs a video call using a general terminal provided on the outside of the terminal body, even if the user views the image of the other party displayed on the transparent display module 154 in front, the user's gaze direction and the camera And the difference occurs over a certain angle. Therefore, the image photographed without the user's gaze direction facing forward is transmitted to the counterpart terminal.

However, in the present invention, as shown in Fig. 59A, the camera 121 is disposed at the center of the rear surface (bottom) of the transparent display module 154. More specifically, the transparent display module 154 arranges the camera at a position directly below the display area where the image of the counterpart is output.

Accordingly, when the user views the image of the other party displayed on the transparent display module 154 in front, the same effect as the user looking at the camera in front occurs. Therefore, the controller 180 may transmit an image photographed from the front of the user through the camera 121 to the counterpart terminal.

As described above, in order to obtain an effect of the user looking at the other party in front of the video call, it is preferable to configure the video call interface so that the video of the other party can be output corresponding to the position where the camera 121 is disposed.

The video call interface may be configured in various ways according to the terminal.

For example, as illustrated in (a) of FIG. 59B, the image 820 of the user may not be output, but only the counterpart image 810 may be output to the entire transparent display module. In addition, as illustrated in (b) of FIG. 59B, an image 810 of the other party may be output to the entire transparent display module, and the image 820 of the user may be slightly output on one side. In addition, as illustrated in (c) of FIG. 59B, the image 820 of the user and the image 810 of the counterpart may be divided and output in the same size.

In addition, various video call interfaces not shown in the drawings may be configured. However, when the camera 121 is placed at the bottom of the center of the transparent display module 154 even in the video call interface in any case, even if the video of the other party is not displayed in the center of the transparent display module, the user faces the other video to the front. You can get the same effect as you see. This is because the user's face, that is, the user's gaze direction is directed toward the transparent display module even if the user's gaze does not exactly match the photographing direction of the camera.

On the other hand, the center portion in which the camera is disposed does not necessarily mean the middle of the transparent display module. For example, as illustrated in FIG. 59A, the center of the transparent display module is located at the center of the left and right sides, but may be disposed at the upper side of the transparent display module. That is, the arrangement position of the camera can be changed according to the video call interface. However, when disposed in the center of the transparent display module can be obtained a better effect.

60A to 60B are exemplary diagrams for describing a process of distorting an image photographed for a video call using a mobile terminal according to the present invention. In particular, FIG. 60B illustrates an enlarged view of the distorted image 830 captured by the partial image 811 interfered with the original subject image 820.

Camera 121 of the present invention is disposed on the rear (bottom) of the transparent display module 154. Therefore, since the image of the subject viewed from the outside is photographed through the transparent display module, the original subject image to be photographed by the user and the image output from the transparent display module are simultaneously photographed.

That is, in the mobile terminal of the present invention, the original subject image 820 and the image 810 output to the transparent display module interfere with each other, thereby photographing the distorted subject image 830. Therefore, before transmitting the subject image to the counterpart terminal, the controller 180 must remove the image 811 of the interfered portion from the distorted subject image 830.

61A to 61B are exemplary views for explaining correction data stored in a memory of a mobile terminal according to the present invention.

As described above, when the image captured by the camera is corrected, correction data is stored in the memory in order to remove an image of the transparent display module that is interfered with the original subject image.

The correction data may be generated through experiments.

For example, the gray subject is set as a photographing target, and the color (R, G, B) of the image output to the transparent display module is changed to at least 256 colors, and the image is captured by the interference between the subject and the image output to the transparent display module. Analyze the image.

More specifically, as illustrated in FIG. 61B, the photographed image is divided into a plurality of regions (n * m regions) so as to correct the luminance difference of the image photographed by the camera 121. As described above, a specific area of the image captured by the camera or the amount of information per pixel is acquired to analyze the interfered image information, and an inverse matrix table having color information that can be adjusted to be the same as or similar to the color of the subject is generated (840). ).

When the subject is photographed while the image is output to the transparent display module after generating the inverse matrix table as described above, the image output from the transparent display module is removed from the photographed image by using the inverse matrix table.

In the present embodiment, an image correction method using an inverse matrix table (or a correction data table) generated by an experiment is described. However, the image correction may be performed by a correction function including a correction algorithm. In this case, the correction function is also stored in the memory 160. As described above, the correction data further includes at least color information (R, G, B), luminance information, brightness information, gamma control information, contrast information. The more realistic color correction can be achieved by using the correction.

On the other hand, the correction data is limited to a data range such that the subject can be photographed through the transparent display module. If the image output from the transparent display module is too dark to exceed the correction data range (or correctable range), the image of the original subject cannot be restored even if the image is corrected. Therefore, when image correction is difficult as described above, the transparency of the transparent display module may be controlled.

62A to 62B are exemplary views for explaining a method of controlling transparency of some display areas of a transparent display in the mobile terminal according to the present invention.

The reason for the image correction in the above embodiment is to shoot the image output to the transparent display module while not distorting and at the same time the subject is not distorted. However, when the image output from the transparent display module exceeds the correctable range, the transparency (or transmittance) may be controlled with respect to some display areas of the transparent display corresponding to the photographing position of the camera.

Transparency control of the display area may be automatically controlled by the controller 180 according to a predetermined algorithm, or may be manually controlled while a user refers to an image captured by a camera.

For example, as an example for controlling the transparency, a method of completely controlling the display area 850 of the transparent display corresponding to the photographing position of the camera is illustrated in FIG. 10A. Another example for controlling the transparency is a method of increasing the transparency of the interference image by watermarking the display area 850 of the transparent display corresponding to the photographing position of the camera. As described above, the transparency control method using the watermark process is to adjust the interference image within a correctable range, and is to increase the transparency of the image output to the entire display area 850.

As another example for controlling the transparency, a method of performing a gradation processing from the center to the outside of the display area of the transparent display corresponding to the photographing position of the camera is illustrated in FIG. 10B. The shape for the gradation process may be designed in various shapes in addition to the shape shown in the drawings. As described above, the method of controlling the transparency by the gradation process increases the transparency of a part of the image displayed on the display area 850 (the part corresponding to the shape processed by the gradation) to adjust the interference image within a correctable range. It is a way.

FIG. 63 is an exemplary diagram for describing a process of transmitting a user's image to a counterpart terminal during a video call using a mobile terminal according to the present invention. The controller 180 displays an image 830 of a subject that is distorted through the camera 121. ). Then, the interfering image 811 is removed from the image 830 of the distorted subject using previously stored correction data. Then, the original subject image 820 from which the interfered image 811 is removed is transmitted to the counterpart terminal through the wireless communication unit 110. Accordingly, the counterpart who receives the subject image 820 may feel that the user is looking at himself in front of him.

As described above, in the mobile terminal having the camera 121 at the lower side (inner side, lower side, lower end) of the transparent display 154, when the camera is photographed, the image displayed on the transparent display acts as an interference image and the original subject image is distorted. If so, a correction method for removing the interference image has been described.

Hereinafter, in a mobile terminal having a transparent display on the upper side (outer side, upper side, upper end) of the camera 121, a method of controlling a image displayed on the transparent display so that a special effect can be applied when shooting a camera Explain.

64A to 64B are exemplary views illustrating an image capturing method of a mobile terminal having a transparent display according to the present invention. As shown in the drawing, the camera 121 and the flash 123 may be disposed below (inner, lower, lower) of the transparent display 154. The flash 123 is a light emitting device for capturing an image in a dark place.

The controller 180 may control transparency of some display areas (the display area corresponding to the position of the camera 850) of the transparent display 154. The shape of the display area to control the transparency may be applied in the same manner as the shape of the camera 121 (for example, circular), or may be applied in a rectangular shape regardless of the shape of the camera 121.

The width of the display area 850 to control the transparency may be adjusted to correspond to the sizes of the camera 121 and the flash 123. For example, as shown in FIG. 12A (a), only the display area corresponding to the camera 121 is transparently adjusted, or as shown in (b), only the display area corresponding to the flash 123 is transparently adjusted. , as shown in (c), the camera 121 and the flash 123 may transparently adjust all corresponding display areas.

In addition, the controller 180 controls to display a specific color in the display area 850 corresponding to the position of the camera 121 or the flash 123, thereby controlling the color of the image of the subject to be photographed. For example, when a red image is displayed on the display area 850, an image having a red color may be taken.

In addition, as shown in FIG. 64B, the specific image is displayed on the display area 850 corresponding to the position of the camera 121, thereby simultaneously capturing the image using the camera 121. At the same time, the effect can be obtained. In this case, the specific image may be text such as a date, place, or content of capturing an image, or may be a picture or a picture to be used as a background of the image.

For example, as illustrated in FIG. 64B, when the specific image 850a and the text 850b are displayed in advance in the display area 850 corresponding to the position of the camera 121 of the transparent display 154, the image is taken. As soon as the image is taken, the specific image and text are automatically inserted. Therefore, the user does not have to perform a post-editing operation.

According to an embodiment of the present invention, the above-described method may be embodied as computer readable codes on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of computer readable media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, and the like, and also implemented in the form of a carrier wave (eg, transmission over the Internet). It includes being. In addition, the computer may include the controller 180 of the terminal.

The above-described mobile terminal is not limited to the configuration and method of the above-described embodiments, but the embodiments may be configured by selectively combining all or some of the embodiments so that various modifications can be made. It may be.

1 is a block diagram of a mobile terminal associated with one embodiment of the present invention;

Figure 2 is a front perspective view of an example of a mobile terminal according to the present invention.

3 is a rear perspective view of the mobile terminal of FIG. 2;

4 is an exemplary diagram of a communication system operable by a terminal according to the present invention;

Figure 5 is an exemplary view showing a mobile terminal consisting of a single transparent display according to the present invention.

Figure 6 is an exemplary view showing a mobile terminal having a dual display of a transparent display according to the present invention.

7A and 7B are foldable terminals having a transparent display in dual form according to the present invention.

8 is a foldable terminal having a dual display with a transparent display according to the present invention, an exemplary view showing a mobile terminal further comprising a keypad.

Figure 9 is an exemplary view showing a mobile terminal having a folder capable of rotating 360 degrees, a terminal having a transparent display in a dual form according to the present invention.

10 is an exemplary view showing a mobile terminal having a transparent display in a dual form according to the present invention, which can take a photograph even when a folder is closed.

11 is a perspective view of a mobile terminal for explaining a method of controlling a size of information output as a folder is opened or closed as a terminal having a transparent display according to the present invention.

12A and 12B are exemplary views showing a swivel clamshell mobile terminal having a transparent display in dual form according to the present invention.

13 is an exemplary view showing a flip type mobile terminal having a transparent display in dual form according to the present invention;

FIG. 14 is another exemplary diagram of the flip type mobile terminal shown in FIG. 13; FIG.

15 is another exemplary view illustrating a flip type mobile terminal having a transparent display in dual form according to the present invention;

16 is a terminal having a transparent display in a dual form according to the present invention, an exemplary view for explaining the information display method of the transparent display according to the opening or closing of the slide.

FIG. 17 is an exemplary view illustrating a bar type mobile terminal having a transparent display in dual form according to the present invention; FIG.

FIG. 18 is an exemplary view illustrating a mobile terminal configured to utilize a rear surface of a bar type mobile terminal illustrated in FIG. 17.

19 is an exemplary view showing a watch type mobile terminal having a transparent display in dual form according to the present invention.

20 is an exemplary view showing a foldable mobile terminal having a transparent display in a single form according to the present invention.

21 is an exemplary view for explaining an information input method for a clamshell terminal having a transparent display in a single form according to the present invention.

22 is an exemplary diagram for explaining a keypad configuration for a clamshell terminal having a transparent display in a single form according to the present invention.

FIG. 23 is an exemplary view showing a mobile terminal having a transparent display according to the present invention, the mobile terminal having a configuration capable of limiting information displayed on either side of the transparent display; FIG.

24 is an exemplary view showing a swivel clamshell mobile terminal having a transparent display in a single form according to the present invention.

25 is an exemplary slide type terminal having a transparent display in a single form according to the present invention, illustrating an information display method of the transparent display according to whether a slide is opened or closed.

FIG. 26 is an exemplary view showing a bar type mobile terminal having a transparent display in a single form according to the present invention. FIG.

27 is an exemplary view showing a bar type mobile terminal having keypads of the same shape on both sides of the terminal in FIG.

28 is an exemplary view shown to explain the configuration of a single display formed by superposing a transparent display and a non-transparent display according to the present invention.

FIG. 29 is an exemplary view showing a bar type mobile terminal having keypads having different functions on both sides of the terminal in FIG.

30 is an exemplary view showing a watch type mobile terminal having a single type transparent display and a solar cell at the rear thereof according to the present invention;

FIG. 31 is an exemplary view illustrating a mobile terminal having a touch pad on a top surface of a solar cell in FIG. 30.

32 is a watch-type terminal having a transparent display according to the present invention, an exemplary view showing a mobile terminal having a touch pad on the upper surface of the transparent display.

33 to 38 are exemplary views for explaining a display control method of a mobile terminal having a transparent display according to the present invention in a single form.

39 to 44 are exemplary views for explaining a display control method of a mobile terminal having a transparent display in dual form according to the present invention;

45 is a terminal provided with a dual display in a dual form according to the present invention, an exemplary view for explaining a display control method according to whether or not each display overlaps.

46A to 46C are exemplary views for explaining a method of controlling a touch operation when each display is completely overlapped in FIG. 45;

47A and 47B are exemplary views for explaining a method of controlling a touch operation in a form in which portions of the displays overlap with each other in FIG. 45;

FIG. 48 is a view illustrating a web browsing method for explaining a main / sub window operating method in a mobile terminal according to the present invention; FIG.

49A to 49B are exemplary views for explaining a web page display method according to a main / sub window operating method in a mobile terminal according to the present invention;

50A and 50B are exemplary views illustrating a method of moving a display object according to an opening and closing operation of a mobile terminal having a dual-type transparent display according to the present invention.

51A and 51B are exemplary views illustrating a method of generating a display object according to an opening and closing operation of a mobile terminal having a dual type transparent display according to the present invention.

52 and 53 are views for explaining a method of changing the information display direction of a mobile terminal having a dual-type transparent display according to the present invention.

54 and 55 are views for explaining a method of changing the information display direction of the mobile terminal having a single transparent display according to the present invention.

FIG. 56 is a view for explaining an operation related to movement of a display object executed according to an opening / closing operation of a mobile terminal having a dual type transparent display according to the present invention; FIG.

57 is an exploded perspective view illustrating an arrangement structure of a transparent display module and a camera of a mobile terminal according to the present invention;

58 is a flowchart for explaining an image capturing method of a mobile terminal according to the present invention;

59A is an exemplary view seen from the front in order to explain a camera arrangement structure of a mobile terminal according to the present invention;

FIG. 59B is an exemplary diagram for explaining an effect of a video call when the camera is disposed in a mobile terminal according to the present invention. FIG.

60A to 60B are exemplary views for explaining a process of distorting an image photographed for a video call using a mobile terminal according to the present invention;

61A to 61B are exemplary views for explaining correction data stored in a memory of a mobile terminal according to the present invention.

62A to 62B are exemplary views for explaining a method of controlling transparency of some display areas of a transparent display in a mobile terminal according to the present invention;

63 is an exemplary view for explaining a process of transmitting a user's video to a counterpart terminal during a video call using a mobile terminal according to the present invention;

64A to 64B are exemplary views illustrating an image capturing method of a mobile terminal having a transparent display according to the present invention.

Claims (16)

A transparent display; A camera disposed inside the transparent display, the camera photographing a subject viewed through the transparent display; And a controller which detects the interference image information included in the subject image and corrects the subject image based on the image displayed on the transparent display. The method of claim 1, wherein the mobile terminal, And a memory configured to store correction data for correcting the subject image. The method of claim 2, wherein the correction data, A mobile terminal comprising at least one of color information (R, G, B), luminance information, brightness information, gamma control information, contrast information. The method of claim 2, wherein the memory, And a correction function for further correcting the subject image by a mathematical algorithm. The method of claim 1, wherein the control unit, And if the interference image information included in the subject image is equal to or less than a preset reference, correcting using correction data or a correction function. The method of claim 1, wherein the control unit, And when the interference image information included in the subject image is greater than or equal to a predetermined reference, controlling the transparency of the transparent display to a high level. The method of claim 6, wherein the control unit, And controlling the transparency by changing the shape, size, or color of the information displayed on the transparent display. The method of claim 6, wherein the control unit, And dividing the transparent display into a plurality of display regions, and controlling transparency of the display region corresponding to the position where the camera is disposed. The method of claim 8, wherein the control unit, And controlling to display a specific image or text to be inserted when capturing an image in a display area corresponding to a position where the camera is disposed. The method of claim 8, wherein the control unit, And the camera controls transparency of a display area having a width corresponding to the size. Photographing a subject seen outside of the transparent display by using a camera disposed inside the transparent display; Detecting interference image information included in an image of the subject based on the image displayed on the clear display; And correcting the subject image by using the detected interference image information. The method of claim 11, wherein the correcting of the subject image comprises: Comparing whether the interference image information included in the subject image is less than a predetermined reference; And if the interference image information is included below a reference level, correcting using preset correction data or a correction function. The method of claim 11, wherein the correcting of the subject image comprises: Comparing whether the interference image information included in the subject image is equal to or less than a preset reference; and And controlling the transparency of the transparent display to be higher if the interference image information is included in a reference or higher. The method of claim 13, wherein the transparency, And controlling the shape, size, or color of the information displayed on the transparent display. The method of claim 13, wherein the transparency, And dividing the transparent display into a plurality of display areas, and controlling the display area corresponding to the position where the camera is disposed. The method of claim 15, wherein the transparency, And controlling a display area having a width corresponding to the size of the camera.

Images