KR101967647B1 - Mobile terminal and control method thereof - Google Patents

Abstract

The present invention relates to a mobile terminal capable of acquiring an image and a control method thereof. A mobile terminal according to an embodiment of the present invention includes: a terminal body; A memory unit configured to store images; A camera unit configured to capture an image; And acquiring an image from at least one of the memory unit and the camera unit, analyzing the obtained image, recognizing the status information of the main body using the analysis result, and setting information corresponding to the status information of the main body And a control unit for controlling the main body by using the main body.

Description

[0001] MOBILE TERMINAL AND CONTROL METHOD THEREOF [0002]

The present invention relates to a mobile terminal, and more particularly, to a mobile terminal capable of acquiring an image and a control method thereof.

The terminal is movable And may be divided into a mobile / portable terminal and a stationary terminal depending on whether the mobile terminal is a mobile terminal or a mobile terminal. The mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry the mobile terminal.

As the functions of the terminal are diversified, the terminal is implemented in the form of a multimedia device having a combination of functions such as photographing and photographing of a moving picture, reproduction of a music or video file, reception of a game and broadcasting, have. Further, in order to support and enhance the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

On the other hand, the setting information of the terminal desired by the user may vary according to the current location information of the user and the current time information. Nevertheless, there is a problem that the setting information of the terminal is always constant unless the user directly changes the setting of the terminal there was. That is, there has been an inconvenience that the user has to directly change the setting of the terminal according to the current location information and the current time information of the user.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a mobile terminal and a control method thereof that can improve user's convenience in changing a setting of a terminal.

A mobile terminal according to an embodiment of the present invention includes: a terminal body; A memory unit configured to store images; A camera unit configured to capture an image; And acquiring an image from at least one of the memory unit and the camera unit, analyzing the obtained image, recognizing the status information of the main body using the analysis result, and setting information corresponding to the status information of the main body And a control unit for controlling the main body by using the main body.

In an embodiment, the control unit may acquire at least one of images selected through the camera unit and images selected from the images stored in the memory unit, based on a control command input from the outside.

In an embodiment, the control unit may detect at least one object included in the acquired image, analyze the detected object, and determine one of the plurality of status information as the status information of the main body.

In the embodiment, the controller may receive context information and setting information matched to the main body when there is no context information matching the main body among the plurality of context information as a result of the detection of the detected object, The received status information and setting information can be stored in the memory unit.

In an exemplary embodiment, the mobile terminal may further include a user input unit for receiving a control command for releasing the sleep mode, and the control unit may receive a control command for releasing the sleep mode through the user input unit , The camera unit may be activated and the camera unit may be controlled to photograph the camera unit.

In an exemplary embodiment, the mobile terminal may further include a wireless communication unit that receives at least one of position information and time information of the main body, and the control unit controls the wireless communication unit based on at least one of the received position information and time information, It is possible to determine whether to activate the camera unit.

In an exemplary embodiment, the control unit may use at least one of position information received from a Global Positioning System (GPS) and location information collected through wireless communication with an Access Point (AP) Can be determined.

In an exemplary embodiment, the controller may monitor the generated event and determine whether to activate the camera unit according to the type of the generated event.

In an embodiment, the mobile terminal may further include a microphone for receiving a voice signal, the control unit may analyze the voice signal input through the microphone and determine whether to activate the camera unit according to the analysis result have.

In an embodiment, the control unit may activate the camera unit and control the camera unit to photograph the camera unit image after a predetermined time elapses after determining the status information of the main body.

In an embodiment, the control unit may recommend at least one application using setting information corresponding to the status information of the main body, and may control the main body using the recommended application.

In an embodiment, the control unit may execute the recommended application, change the setting of the main body using the recommended application, or display an icon corresponding to the recommended application on the display unit.

In an embodiment, the memory unit may store information of an application optimized for each of the plurality of context information, and the control unit may recommend an application matching the context information of the main body from the memory unit.

In an embodiment, the control unit may determine information of an application optimized for each of the plurality of situation information based on at least one of user selection and use history information, and store the determined information in the memory unit .

An embodiment of the present invention relates to a control method of a mobile terminal having a terminal main body. The control method of the mobile terminal includes: acquiring an image; Analyzing the acquired image and recognizing the status information of the main body using the analysis result; And controlling the main body using setting information corresponding to the status information of the main body.

In one embodiment, the step of acquiring the image may include acquiring at least one of the images selected through the camera unit and images selected from the images stored in the memory unit based on a control command input from the outside .

The step of analyzing the acquired image and recognizing the status information of the main body using the analysis result may include detecting at least one object included in the acquired image, And analyzing the detected object to determine any one of the plurality of pieces of context information as the context information of the main body.

The step of controlling the main body using the setting information corresponding to the status information of the main body may include recommending at least one application using the setting information corresponding to the main body status information, And controlling the main body using the recommended application.

According to the present invention, the setting information of the mobile terminal can be automatically changed based on the status information of the mobile terminal. That is, a user interface considering the current state of the user can be provided to the user. Accordingly, in changing the setting of the mobile terminal to be optimized for the current situation, the operation of the user can be reduced.

In addition, according to the present invention, the status information of the current mobile terminal body can be detected using the image photographed from the camera unit of the mobile terminal. Accordingly, even when the mobile terminal can not receive the position information using the wireless communication, the approximate position information of the mobile terminal body can be determined using the photographed image. As a result, the convenience of the user can be improved.

1 is a block diagram illustrating a mobile terminal according to the present invention.
2A and 2B are perspective views showing an appearance of a mobile terminal according to the present invention.
3 is a flowchart for explaining an embodiment of a mobile terminal according to the present invention.
FIGS. 4 to 6 are conceptual diagrams showing an example of an operation of acquiring an image.
FIG. 7 is a flowchart illustrating a method of determining status information of a main body using the obtained image.
8 to 10 are conceptual diagrams illustrating an example of an operation of determining the status information of the main body using the acquired image.
FIGS. 11 to 15 are conceptual diagrams illustrating an example of an operation for determining an acquisition time point of an image.
16 to 18 are conceptual diagrams showing an example of an operation of controlling the main body using setting information.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art can easily carry out the technical idea of the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly explain the present invention, parts not related to the description are omitted, and like parts are denoted by similar reference numerals throughout the specification.

The mobile terminal described herein may include a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigator, have. However, it should be understood that the configuration according to the embodiments described herein may be applied to a fixed terminal such as a digital TV, a desktop computer, and the like, unless it is applicable only to a mobile terminal. It will be easy to see.

1 is a block diagram illustrating a mobile terminal 100 according to the present invention.

1, a mobile terminal 100 includes a wireless communication unit 110, an audio / video (A / V) input unit 120 (hereinafter referred to as a user tracking unit), a user input unit 130, An input unit 140, an output unit 150, a memory 160, an interface unit 170, a control unit 180, and a power supply unit 190. The components shown in Fig. 1 are not essential, so that a mobile terminal having more or fewer components can be implemented.

Hereinafter, the components 110 to 190 of the mobile terminal 100 will be described in order.

The wireless communication unit 110 may include one or more modules for enabling wireless communication between the mobile terminal 100 and the wireless communication system or between the mobile terminal 100 and the network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short distance communication module 114, and a location information module 115.

The broadcast receiving module 111 receives broadcast signals and broadcast related information from an external broadcast management server through a broadcast channel. Here, the broadcast-related information means information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information can also be provided through a mobile communication network. In this case, the broadcast-related information may be received by the mobile communication module 112. The broadcast signal and the broadcast-related information received through the broadcast receiving module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Such wireless signals may include various types of data depending on a voice call signal, a video call signal, a text message, or a multimedia message transmission / reception.

The wireless Internet module 113 is a module for wireless Internet access, and may be embedded in the mobile terminal 100 or externally. WLAN (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) and the like can be used as wireless Internet technologies.

The short-range communication module 114 refers to a module for short-range communication. As a short range communication technology, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and the like can be used.

The position information module 115 is a module for acquiring the position of the mobile terminal 100, and a representative example thereof is a Global Position System (GPS) module.

1, the user tracking unit 120 receives an audio signal and a video signal and tracks a user using the received signal. The user tracking unit 120 includes a camera 121, a microphone 122, A sensor 123, and the like. The camera 121 processes image frames such as still images and moving images obtained by the image sensor in the video communication mode or the photographing mode. The image frame processed by the camera 121 can be displayed on the display unit 151. [ The image frame may be stored in the memory 160 or transmitted to the outside through the wireless communication unit 110. [ More than two cameras 121 may be provided depending on the use environment.

The microphone 122 processes the sound signal input from the outside in the communication mode, the recording mode, the voice selection mode, and the like as electrical voice data. The voice data processed by the microphone 122 in the communication mode can be converted into a form that can be transmitted to the mobile communication base station through the mobile communication module 112 and output. The microphone 122 may be implemented with various noise reduction algorithms for eliminating noise generated when an external sound signal is input.

The user input unit 130 generates input data for controlling the operation of the mobile terminal 100 by a user. The user input unit 130 may include a key pad, a dome switch, a touch pad (static pressure and static electricity), a jog wheel, a jog switch, and the like.

The sensing unit 140 senses the current state of the mobile terminal 100 such as presence or absence of a user, the open / close state of the mobile terminal 100, position, orientation, acceleration, deceleration, And generates a sensing signal. For example, when the mobile terminal 100 is in the form of a slide phone, the sensing unit 140 may detect whether the slide phone is opened or closed. The sensing unit 140 may sense whether the power supply unit 190 is powered on, whether the interface unit 170 is connected to an external device, and the like.

The sensing unit 140 may include a proximity sensor 141. The sensing unit 140 may include a touch sensor (not shown) for sensing a touch operation with respect to the display unit 151.

The touch sensor may have the form of a touch film, a touch sheet, a touch pad, or the like. The touch sensor may be configured to convert a pressure applied to a specific portion of the display portion 151 or a change in capacitance generated at a specific portion of the display portion 151 into an electrical input signal. The touch sensor can be configured to detect not only the position and area to be touched but also the touch pressure.

When the touch sensor and the display unit 151 have a mutual layer structure, the display unit 151 can be used as an input device in addition to the output device. The display unit 151 may be referred to as a 'touch screen'.

If there is a touch input via the touch screen, corresponding signals are sent to a touch controller (not shown). The touch controller processes the signals transmitted from the touch sensor, and then transmits data corresponding to the processed signals to the controller 180. Thus, the control unit 180 can know which area of the display unit 151 is touched.

In the case where the touch screen is electrostatic, it can be configured to detect the proximity of the sensing object by a change of the electric field along the proximity of the sensing target. Such a touch screen may be classified as proximity sensor 141. [

The proximity sensor 141 refers to a sensor that detects the presence or absence of an object to be sensed without mechanical contact using an electromagnetic force or infrared rays. The proximity sensor 141 has a longer life than the contact type sensor and its utilization is also high. Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

Hereinafter, for convenience of explanation, a proximity action is referred to as " proximity touch " while an object to be sensed does not touch the touch screen, and an action of touching the sensing object on the touch screen is called & touch ".

The proximity sensor 141 detects the presence or absence of a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, The information corresponding to the presence / absence of proximity touch and the proximity touch pattern can be output to the touch screen.

The output unit 150 generates an output related to visual, auditory, tactile, and the like. The output unit 150 may include a display unit 151, an audio output module 152, an alarm unit 153, and a haptic module 154.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal 100 operates in the call mode, the display unit 151 displays a UI (User Interface) or a GUI (Graphic User Interface) related to the call. When the mobile terminal 100 operates in the video communication mode or the photographing mode, the display unit 151 displays the photographed image, the received image, the UI, the GUI, and the like.

The display unit 151 may be a liquid crystal display (LCD), a thin film transistor liquid crystal display (TFT-LCD), an organic light emitting diode (OLED), a flexible display display, a 3D display, and an e-ink display.

At least one display (or display element) included in the display unit 151 may be configured to be transparent or light transmissive so that the display can see the outside through it. This can be referred to as a transparent display. A typical example of such a transparent display is TOLED (Transparent OLED). The rear structure of the display unit 151 may also be of a light transmission type. With this structure, the user can see an object located behind the terminal body through the area occupied by the display unit 151 in the terminal body.

There may be two or more display units 151 according to the embodiment of the mobile terminal 100. [ For example, in the mobile terminal 100, a plurality of display portions may be spaced apart from each other or positioned integrally with one another, and may be located on different surfaces.

The audio output module 152 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception mode, a call mode or a recording mode, a voice selection mode, a broadcast reception mode, The sound output module 152 also outputs sound signals related to functions (e.g., call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. [ The audio output module 152 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 153 outputs a signal for notifying the occurrence of an event of the mobile terminal 100. Examples of events generated in the mobile terminal 100 include call signal reception, message reception, key signal input, touch input, and the like. The alarm unit 153 may output a signal for informing occurrence of an event in a form other than a video signal or an audio signal, for example, vibration. The display unit 151 and the sound output module 152 may be classified as a part of the alarm unit 153 because the video signal or the audio signal can also be output through the display unit 151 or the sound output module 152. [

The haptic module 154 generates various tactile effects that the user can feel. A typical example of the haptic effect generated by the haptic module 154 is vibration. The intensity, pattern, and the like of the vibration generated by the hit module 154 are controllable. For example, different vibrations may be synthesized and output or sequentially output.

In addition to the vibration, the haptic module 154 may include a pin arrangement vertically moving with respect to the contact skin surface, a spraying force or a suction force of the air through the injection port or the suction port, a touch on the skin surface, contact with an electrode, Various effects can be generated such as the effect of heat generation and the effect of reproducing the cold sensation using the heat absorbing or heatable element.

The haptic module 154 can be configured to not only transmit the tactile effect through the direct contact but also to allow the user to feel the tactile effect through the muscular sense of the finger or arm. At least two haptic modules 154 may be provided according to the configuration of the mobile terminal 100.

The memory 160 may store a program for the operation of the controller 180 and temporarily store input and output data (e.g., a phone book, a message, a still image, a moving picture, etc.). The memory 160 may store data related to vibrations and sounds of various patterns that are output upon touch input on the touch screen.

The memory 160 may be a flash memory, a hard disk, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM) And may include at least one storage medium. The mobile terminal 100 may operate in association with a web storage that performs storage functions of the memory 160 on the Internet.

The interface unit 170 serves as a path for communication with all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or supplies power to each component in the mobile terminal 100 or transmits data to the external device. For example, the interface unit 170 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device having an identification module, Input / output ports, video I / O ports, earphone ports, and the like.

The identification module is a chip for storing various information for authenticating the usage right of the mobile terminal 100 and includes a user identification module (UIM), a subscriber identity module (SIM), a general user authentication module Universal Subscriber Identity Module (USIM)). A device equipped with an identification module (hereinafter referred to as "identification device") can be manufactured in a smart card format. Accordingly, the identification device can be connected to the terminal 100 through the port.

The interface unit 170 may be a path through which the power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle or various command signals input from the cradle by the user, (Not shown). The various command signals or power supplied from the cradle may also act as a signal for recognizing that the mobile terminal 100 is correctly mounted in the cradle.

The controller 180 controls the overall operation of the mobile terminal 100. For example, control and processing related to voice communication, data communication, video communication, and the like. The control unit 180 may include a multimedia module 181 for multimedia playback. The multimedia module 181 may be implemented in the control unit 180 or may be implemented separately from the control unit 180. [ The control unit 180 may perform pattern selection processing for selecting handwriting input and drawing input on the touch screen as characters and images, respectively.

The power supply unit 190 receives external power and internal power under the control of the controller 180 and supplies power necessary for operation of the respective components.

The various embodiments described herein may be implemented in a recording medium readable by a computer or similar device using software, hardware, or a combination thereof.

According to a hardware implementation, the embodiments described herein may be applied to various types of application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays Microprocessors, microprocessors, and other electronic units for performing other functions, as will be appreciated by those skilled in the art. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to a software implementation, embodiments such as the procedures and functions described herein may be implemented with separate software modules. Each of the software modules may perform one or more of the functions and operations described herein. Software code may be implemented in a software application written in a suitable programming language. Such software codes may be stored in the memory 160 and executed by the control unit 180. [

Hereinafter, a method of processing user input to the mobile terminal 100 will be described.

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100, and may include a plurality of operation units. The operating units may also be referred to as manipulating portions and may be employed in any manner as long as they are operated in a tactile manner by the user's tactile sense.

Various kinds of time information can be displayed on the display unit 151. [ Such visual information can be displayed in the form of letters, numbers, symbols, graphics, icons, and the like, and can be formed as a three-dimensional stereoscopic image. At least one of a character, a number, a symbol, a graphic, and an icon may be displayed in a predetermined arrangement for inputting time information, thereby being implemented as a keypad. Such a keypad may be referred to as a so-called " soft key ".

The display unit 151 may operate as an entire area or may be divided into a plurality of areas and operated. In the latter case, the plurality of areas can be configured to operate in association with one another. For example, an output window and an input window may be displayed on the upper and lower portions of the display unit 151, respectively. The output window and the input window are areas allocated for outputting or inputting information, respectively. In the input window, a soft key with a number for inputting a telephone number may be output. When the soft key is touched, the number corresponding to the touched soft key is displayed in the output window. When the operating unit is operated, a call connection to the telephone number displayed in the output window may be attempted, or the text displayed in the output window may be entered into the application.

The display unit 151 or the touch pad may be configured to detect touch scrolling. The user can move the cursor or the pointer positioned on the displayed object, for example, the icon, on the display unit 151 by scrolling the display unit 151 or the touch pad. Further, when the finger is moved on the display unit 151 or the touch pad, the path along which the finger moves may be visually displayed on the display unit 151. [ This will be useful for editing the image displayed on the display unit 151. [

One function of the mobile terminal 100 may be executed in response to a case where the display unit 151 and the touch pad are touched together within a predetermined time range. In the case of being touched together, there may be a case where the user clamps the main body of the mobile terminal 100 using the thumb and index finger. At this time, one function of the mobile terminal 100 to be executed may be activation or deactivation for the display unit 151 or the touch pad, for example.

2A and 2B are perspective views showing the appearance of the mobile terminal 100 related to the present invention.

FIG. 2A shows a front side and one side of the mobile terminal 100, and FIG. 2B shows a rear side and the other side of the mobile terminal 100. FIG.

Referring to FIG. 2A, the mobile terminal 100 includes a bar-shaped terminal body. However, the mobile terminal 100 is not limited thereto, and may be realized in various forms such as a slide type, a folder type, a swing type, and a swivel type in which two or more bodies are movably coupled to each other.

The terminal body includes a case (a casing, a housing, a cover, and the like) that forms an appearance. In the embodiment, the case may be divided into a front case 101 and a rear case 102. A variety of electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102. [

The cases may be formed by injection molding of a synthetic resin or may be formed to have a metal material such as stainless steel (STS), titanium (Ti) or the like.

The display unit 151, the sound output unit 152, the camera 121, the user input unit 130 (see FIG. 1), the microphone 122, the interface 170, can do.

The display unit 151 occupies a main portion of the front case 101. [ The audio output unit 152 and the camera 121 are located in a region adjacent to one end of the display unit 151 and the first user input unit 131 and the microphone 122 are located in a region adjacent to the other end. The second user input unit 132 and the interface 170 may be located on the sides of the front case 101 and the rear case 102. [

The user input unit 130 is operated to receive a command for controlling the operation of the mobile terminal 100. [ The user input unit 130 may include a plurality of operation units 131 and 132.

The first or second operating units 131 and 132 can receive various commands. For example, the first operation unit 131 can receive commands such as start, end, scroll, and the like. The second operation unit 132 can receive commands such as adjusting the size of the sound output from the sound output unit 152, switching to the touch selection mode of the display unit 151, and the like.

Referring to FIG. 2B, a rear camera 121 'may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The rear camera 121 'has a photographing direction opposite to that of the front camera 121 (see FIG. 2A), and may be configured to have pixels different from those of the front camera 121.

For example, the front camera 121 may be configured to have a low pixel, and the rear camera 121 'may be configured to have a high pixel. Accordingly, when the front camera 121 is used during a video call, when the user's face is photographed and the photographed image is transmitted to the other party in real time, the size of the transmitted data can be reduced. On the other hand, the rear camera 121 'can be used for the purpose of storing a high-quality image.

Meanwhile, the cameras 121 and 121 'may be installed in the terminal body so as to be rotated or popped up.

The flash 123 and the mirror 124 may be further positioned adjacent to the rear camera 121 '. The flash 123 emits light toward the subject when the user photographs the subject with the rear camera 121 '. The mirror 124 illuminates the user's face when the user photographs himself (self-photographing) using the rear camera 121 '.

A rear sound output unit 152 'may be additionally disposed on the rear surface of the terminal body. The rear sound output unit 152 'may perform a stereo function together with the front sound output unit 152 (see FIG. 2A), and may perform a speakerphone function during a call.

In addition to the antenna for communication, an antenna 116 for receiving broadcast signals may be additionally provided on the side surface of the terminal body. The antenna 116 constituting a part of the broadcast receiving module 111 (see FIG. 1) can be installed to be able to be drawn out from the terminal body.

A power supply unit 190 for supplying power to the mobile terminal 100 is mounted on the terminal body. The power supply unit 190 may be built in the main body of the terminal or may be detachable from the outside of the main body of the terminal.

The rear case 102 may further include a touch pad 135 for sensing a touch. The touch pad 135 may be of a light transmission type like the display unit 151 (see FIG. 2A). Further, a back display unit for outputting time information can be additionally mounted on the touch pad 135. [ At this time, information output from both sides of the front display unit 151 and the rear display unit can be controlled by the touch pad 135. [

The touch pad 135 operates in correlation with the display unit 151. [ The touch pad 135 may be positioned parallel to the rear of the display unit 151. The touch pad 135 may have a size equal to or smaller than that of the display unit 151.

Meanwhile, the setting information of the mobile terminal 100 desired by the user may vary according to the current location information and the current time information of the user. Nevertheless, unless the user directly changes the setting of the mobile terminal 100, There is a problem that the setting information of the display device 100 is always constant. That is, there is an inconvenience that the user has to directly change the setting of the mobile terminal 100 according to the current location information and the current time information of the user.

Hereinafter, a mobile terminal 100 and a control method thereof that can improve user's convenience in changing the setting of the mobile terminal 100 will be described with reference to the accompanying drawings.

FIG. 3 is a flowchart for explaining an embodiment of the mobile terminal 100 (see FIG. 1) according to the present invention. The mobile terminal 100 includes a main body, a memory unit 160 (see FIG. 1), a camera unit 121 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 3, first, an image is acquired (S110).

The control unit 180 can acquire an image using at least one of the memory unit 160 and the camera unit 121. [ Whether the image is acquired using the memory unit 160 or the camera unit 121 may be selected by the user or may be determined by the control unit 180. [ The control unit 180 can determine which of the memory unit 160 and the camera unit 121 should acquire an image based on at least one of the frequency of use information and the recently used history information.

The memory unit 160 may store images. When it is determined that the image is to be acquired using the memory unit 160, the user can select at least one of the images stored in the memory unit 160. The control unit 180 can acquire the selected image.

The camera unit 121 can take a picture. When it is determined to acquire an image using the camera unit 121, the camera unit 121 can capture a still image or a moving image. The control unit 180 can acquire the photographed image.

Next, the acquired image is analyzed, and the state information of the main body is recognized using the analysis result (S120).

The control unit 180 can separate the background from the acquired image. At this time, the AMF (Approximated Median Filtering) algorithm can be used. The control unit 180 can separate the background from the acquired image using the AMF algorithm and detect the objects included in the acquired image.

The control unit 180 may compare and analyze the object frame image stored in the memory unit 160 with the detected object. The controller 180 can use the analysis result to select the context information matching the main body among the plurality of context information stored in the memory unit 160. [

Meanwhile, the control unit 180 may select the situation information matching the main body by detecting the object included in the image acquired through the camera unit 121, but may collect information through other sensors. For example, the controller 180 may collect the voice of the user, the body temperature of the user, the heart rate information of the user, and the like and may select the situation information matched to the body.

Thereafter, the main body is controlled using the setting information corresponding to the main body status information (S130).

The memory unit 160 may store setting information of a main body corresponding to each of a plurality of pieces of status information. The control unit 180 may extract setting information corresponding to the status information of the main body, and may control the main body using the extracted setting information.

Specifically, the control unit 180 can change the setting of the main body using the extracted setting information. In addition, the control unit 180 can execute a specific application or display an icon corresponding to a specific application on the home screen.

As described above, according to the present invention, the setting information of the main body can be automatically changed based on the status information of the main body. That is, a user interface considering the current state of the user can be provided to the user. Thus, in changing the setting of the main body so as to be optimized to the current situation, the operation of the user can be reduced.

In addition, according to the present invention, status information of the current main body can be detected using the image photographed from the camera unit 121. [ Accordingly, even when the mobile terminal 100 can not receive the position information using the wireless communication, the approximate position information of the main body can be determined using the photographed image. As a result, the convenience of the user can be improved.

FIGS. 4 to 6 are conceptual diagrams showing an example of an operation of acquiring an image. The mobile terminal 100 includes a main body, a memory unit 160 (see FIG. 1), a camera unit 121 (see FIG. 1), and a control unit 180 (see FIG. 1).

4 (a) and 5 (a), the display unit 151 may display a home screen. The home screen may include a plurality of objects. The object may include at least one of an icon, a widget, a thumbnail image, and an execution menu of an application.

When the icon 252 corresponding to any one of the objects included in the home screen, for example, an application for detecting the status information of the main body (hereinafter referred to as a " smart eye application & The control unit 180 may execute a smart eye application. At this time, an icon indicating that the Smart Eye application is being executed may be displayed on the indicator bar at the upper part of the display unit 151, although it is not shown.

4B and 5B, when the Smart Eye application is executed, the control unit 180 acquires a video image from the user using either the memory unit 160 or the camera unit 121 Can be selected. To this end, an icon (hereinafter referred to as "first icon") 253 corresponding to a function of acquiring an image using the memory unit 160 and a function of acquiring an image using the camera unit 121 (Hereinafter referred to as " second icon ") 254 may be displayed on the display unit 151. [

Although not shown, the control unit 180 may determine whether to acquire an image using either the memory unit 160 or the camera unit 121 based on at least one of the frequency of use information and the recently used history information .

4 (c), the controller 180 displays thumbnail images corresponding to the images stored in the memory unit 160 on the display unit 151 (step < RTI ID = 0.0 > Can be displayed. At this time, the thumbnail image displayed on the display unit 151 may include at least one of a thumbnail image corresponding to the still image and a thumbnail image corresponding to one scene of the moving image.

Referring to FIG. 4D, when one of the thumbnail images 255 'is selected, the controller 180 displays the current situation using the image 255 corresponding to the selected thumbnail image 255' Can be detected.

At this time, as shown in the figure, an image 255 corresponding to the selected thumbnail image 255 'may be displayed on the display unit 151. At the same time, a pop-up window 256 informing that the current situation is being detected can be displayed on the display unit 151.

In addition, the first icon 253 may be highlighted and displayed above the second icon 254 to indicate that the image has been acquired using the current memory unit 160. For example, as shown, the border of the first icon 253 may be displayed in bolder than the border of the second icon 254. Although not shown, the control unit 180 may change the color, size, transparency, and three-dimensional depth value of at least one of the first icon 253 and the second icon 254 so that the first icon 253 The second icon 254 can be emphasized and displayed.

5 (c), the control unit 180 displays a pop-up window 257 on the display unit 151 so that the user can select the type of the image to be photographed can do. The user can select whether to shoot a still image or a moving image through the pop-up window 257. [ Although not shown, the control unit 180 may determine whether to take a still image or a moving image based on at least one of the frequency of use information and the recently used history information.

For example, when the user selects an icon corresponding to the function of photographing a moving image through the pop-up window 257, referring to FIG. 5 (d), the camera unit 121 can photograph a moving image.

At this time, although not shown, when the camera unit 121 includes a plurality of cameras, it is possible to select which one of the plurality of cameras is used to photograph a moving image.

Referring back to the drawing, the moving picture 255 taken by the camera unit 121 can be displayed on the display unit 151. [ At the same time, a pop-up window 256 informing that the current situation is being detected can be displayed on the display unit 151.

In addition, the second icon 254 may be displayed more emphasized than the first icon 253 to indicate that the image is acquired using the camera unit 121 at present. For example, as shown, the border of the second icon 254 may be displayed in bolder than the border of the first icon 253.

In this way, the camera unit 121 of the mobile terminal 100 can take an image. 6 (a) and 6 (c), when the main body of the mobile terminal 100 is inside the conference room, the camera unit 121 can capture images of the conference room.

All the embodiments of the present invention can be applied not only to the mobile terminal 100 but also to the smart glasses 300 shown in FIG. 6 (b). The smart glasses 300 may include a camera unit (not shown). The smart glasses 300 are equipped with an operating system (OS) and can have a GPS function and a 3D image implementation function as well as a data connection function.

6 (b) and 6 (c), when the user wearing the smart glasses 300 is inside the conference room, the camera unit provided in the smart glasses 300 can capture images of the conference room.

When the camera unit captures an image of the conference room, the setting of the smart glasses 300 may be changed based on the situation information based on the captured image. In addition, the smart glasses 300 may transmit status information to an external mobile terminal 100. [ In this case, the setting of the mobile terminal 100 may be changed.

FIG. 7 is a flowchart illustrating a method of determining status information of a main body using the obtained image. 8 is a conceptual diagram showing an example of an operation of determining the status information of the main body using the acquired image. The mobile terminal 100 includes a main body, a memory unit 160 (see FIG. 1), a camera unit 121 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 7, first, an image is obtained (S210).

As described above, the image can be acquired through at least one of the memory unit 160 and the camera unit 121. [

Next, a step S220 of separating the background from the acquired image and a step S230 of detecting the separated object from the background are performed.

The control unit 180 can separate the background from the acquired image. At this time, the AMF (Approximated Median Filtering) algorithm can be used. The AMF algorithm is one of the background separation techniques for object detection in images. It is a recursive background separation technique that requires processing for positively curved regions.

The controller 180 can separate the background from the acquired image using the AMF algorithm. At this time, a reference image may be used. As the background separates from the acquired image, objects can be detected in the acquired image.

At this time, a step of correcting the image of the detected object may be performed. That is, at least one of the sharpness and hue of the detected object may be corrected. However, this step may be omitted.

Thereafter, in step S240, a region of interest (ROI) of interest is selected from the detected objects.

The objects included in the acquired image may include objects that are indispensable in determining the context information of the main body, but may also include objects that are not needed. Accordingly, the user can directly select an object necessary for determining the context information of the main body among a plurality of objects. On the other hand, regardless of the selection of the user, the control unit 180 can select an object having a share ratio equal to or higher than a predetermined ratio in the acquired image.

Next, a step S250 of overlapping the object frame image of the memory unit 160 with the selected object and a step S260 of determining whether the overlapped region is equal to or greater than a predetermined area are performed.

Referring to FIG. 8, the memory unit 160 may include a first context aware database 161 and a second context awareness database 162. The first context aware database 162 may include a first context aware database 162 and a second context aware database 162. [ The first context awareness database 161 may store unique numbers according to a plurality of context information. Here, -1 means "null" value.

The second context awareness database 162 may store object frame images and configuration information corresponding to a plurality of context information. The setting information may include event information to be generated and response information when an event occurs.

For example, as shown in the figure, a projector, a blackboard, a person, or the like is required as an object to be included in the acquired image in order to detect "being in a meeting" (unique number 0) as the situation information. That is, if the acquired image includes a projector, a blackboard, a person, and the like, the control unit 180 can recognize that the present situation is " in conference ".

If a call signal is received in the first event, the controller 180 transmits an automatic response message in response to the first event or switches to the silent mode or the vibration mode can do. Similarly, when a message is received in the second event, the controller 180 may transmit an automatic response message in response to the second event, or may switch to a silent mode or a vibration mode.

Here, the -1 designated to the first event and the second event means " no event ". For example, in a situation that is in an " airplane ", the controller 180 may immediately switch to airplane mode even if there is no event.

Referring back to FIG. 7, the controller 180 may overlap the object frame image stored in the second context awareness database 162 with the selected object. If the overlapped area is equal to or larger than the predetermined area, the controller 180 can determine the status information of the main body (S270).

If the overlapped area is less than the preset area, the controller 180 can again select the object of interest among the detected objects and determine the state information of the main body again.

FIGS. 9 and 10 are conceptual diagrams illustrating an example of an operation of determining the status information of the main body using the acquired image. The mobile terminal 100 includes a main body, a memory unit 160 (see FIG. 1), a camera unit 121 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIGS. 9A and 10A, an image 255 captured by the camera unit 121 can be displayed on the display unit 151. FIG. At the same time, a pop-up window 258 indicating that an object is being detected in the photographed image may be displayed on the display unit 151.

Next, referring to FIGS. 9B and 10B, the controller 180 can detect objects in the acquired image by separating the background from the acquired image using the AMF algorithm. As shown, the objects may include blackboards, desks, chairs, clocks, and the like.

The controller 180 may select an object of interest among the detected objects. Specifically, the control unit 180 can select an object having a rate of occupancy equal to or greater than a predetermined rate in the acquired image. For example, the selected object may include a chalkboard 259a, a desk 259b, and chairs 259c through 259e. Also, as shown, the selected objects 259a through 259e may be displayed to be distinguished from other objects. For example, the edges of the selected objects 259a to 259e can be highlighted and displayed.

9C, the control unit 180 detects the occupancy rate of the selected objects 259a to 259e and stores the occupancy rate of the selected objects 259a to 259e in the memory unit 160 (see FIG. 1) based on the detected occupancy rate information. Any one of the plurality of pieces of context information can be determined as the context information of the main body.

As shown in the figure, the control unit 180 may display a pop-up window 260 on the display unit 151 to inform the occupancy information of the selected objects 259a to 259e. As the status information of the main body is determined, the control unit 180 can display the main body status information (e.g., " conference status ") in the pop-up window 260 as well. Meanwhile, the pop-up window 260 may include only one of the occupancy rate information of the selected objects 259a to 259e and the status information of the main body.

On the other hand, referring to FIG. 10 (c), the controller 180 may not be able to detect the status information of the main body according to the occupancy rate information of the selected objects 259a to 259e. At this time, the controller 180 may display a pop-up window 261 on the display unit 151 indicating that the status information matching the status information of the main body is not stored in the memory unit 160. [

10 (d), the control unit 180 displays an input window 262 for receiving new situation information and a virtual keypad for displaying the virtual keypad, Can be displayed on the display section (151). Upon receiving the new situation information, the controller 180 may store the received new situation information in the memory unit 160 together with the object frame images of the selected objects 259a to 259e.

In addition, although not shown, the control unit 180 can receive setting information corresponding to new situation information. The setting information may include event information to be generated and response information when an event occurs. In addition, the control unit 180 can select whether to execute the response information corresponding to the corresponding situation information immediately after receiving the setting information (for example, the immediate execution mode and the scheduled execution mode).

FIGS. 11 to 15 are conceptual diagrams illustrating an example of an operation for determining an acquisition time point of an image. The mobile terminal 100 includes a main body, a memory unit 160 (see FIG. 1), a camera unit 121 (see FIG. 1), and a control unit 180 (see FIG. 1).

11 shows an example of an operation of acquiring an image when the mobile terminal 100 receives a control command for releasing a sleep mode.

11 (a) and 11 (b), when the mobile terminal 100 is in the sleep mode, the user input unit 130 may receive a control command for releasing the sleep mode. Here, the sleep mode means a mode in which the screen information is not displayed on the display unit 151 and the touch input applied to the display unit 151 is not sensed.

When receiving a control command for releasing the sleep mode through the user input unit 130, the control unit 180 executes an application (hereinafter referred to as a " smart eye application " .

Referring to FIG. 11 (c), the controller 180 can select a user to acquire an image using the memory unit 160 and the camera unit 121, while the smart eye application is being executed.

Accordingly, the first icon 253 corresponding to the function of acquiring an image using the memory unit 160 and the second icon 253 corresponding to the function of acquiring the image using the camera unit 121, The first icon 254 is displayed on the display unit 151 and any one of the first and second icons 253 and 254 can be selected from the user.

Although not shown, the control unit 180 determines whether to acquire an image using either the memory unit 160 or the camera unit 121 based on at least one of the frequency of use information and the recently used history information It is possible.

Meanwhile, although not shown, when a user inputs a hot key for the operation of the camera unit 121, an image may be obtained using the camera unit 121 immediately.

12 shows an example of an operation in which the mobile terminal 100 acquires an image based on at least one of position information and time information.

Specifically, referring to FIGS. 12A and 12B, the wireless communication unit 110 (see FIG. 1) can receive at least one of position information and time information of the main body. The control unit 180 can determine whether to execute the smart eye application based on at least one of the received location information and the time information.

The controller 180 determines the position information of the main body using at least one of the position information received from the Global Positioning System (GPS) and the position information collected through wireless communication with an access point (AP) .

For example, when the coordinates indicating the position information of the main body are changed by a predetermined value or more, the control unit 180 can execute the smart eye application. In addition, the control unit 180 may display a pop-up window 263 on the display unit 151 indicating that the position of the main body is detected and the smart eye application is executed.

Although not shown, the control unit 180 may execute the smart eye application based on the current time information. For example, when the current time is 9:00 am, the control unit 180 may execute the smart eye application.

12 (c), when the Smart Eye application is executed, the control unit 180 can select a user to acquire an image using the memory unit 160 and the camera unit 121 .

FIG. 13 shows an example of an operation of acquiring an image based on the type of an event that the mobile terminal 100 generates.

13 (a) and 13 (b), the controller 180 may monitor the generated event. For example, while the home screen is being displayed in the foreground, the controller 180 may monitor events occurring in the background. The controller 180 may display on the display 151 a pop-up window 264 indicating that an event has occurred in the background.

The control unit 180 can detect the type of the generated event. Depending on the type of the detected event, the control unit 180 can determine whether to execute the smart eye application. The control unit 180 may determine whether to execute the smart eye application according to the type of the detected event as well as the information of the sender who generated the event.

For example, if the detected event is an event related to receiving a text message, the control unit 180 may execute a smart eye application. At the same time, the control unit 180 may display a pop-up window 263 on the display unit 151 informing that the smart eye application is executed.

13C, when the Smart Eye application is executed, the control unit 180 can select a user to acquire an image using the memory unit 160 and the camera unit 121 .

FIG. 14 shows an example of an operation in which the mobile terminal 100 acquires an image based on an analysis result of a voice signal input through a microphone (not shown).

14 (a) and 14 (b), the control unit 180 can execute a voice recognition program (for example, a quick voice application). The microphone can receive a voice signal. The control unit 180 can convert the voice signal input through the microphone into text data. The control unit 180 may perform a Natural Language Processing (NLP) algorithm to extract the control command converted into the text data.

The natural language processing algorithm means an artificial intelligence technology for the mobile terminal 100 or the computer to understand, generate and analyze a human language. Natural language understanding work refers to a task of converting a daily life language of a person so that the mobile terminal 100 or the computer can process it through morphological analysis, semantic analysis, and dialog analysis.

As shown, the user can execute the smart eye application by voice through the microphone. In addition, the user can execute the image photographing mode by voice through the microphone. When the control command is extracted through the natural language processing algorithm, the control unit 180 can execute the smart eye application using the extracted control command and execute the image shooting mode.

Referring to FIG. 14C, the control unit 180 may display the photographed image 255 on the display unit 151. FIG.

15 shows an example of an operation in which the mobile terminal 100 determines the status information of the main body and acquires the image after a predetermined time has elapsed.

15 (a) and 15 (b), after the predetermined time has elapsed since the status information of the main body is determined, the controller 180 controls the smart i-application to determine new status information of the main body Can be executed.

Accordingly, the newly acquired image 255 'can be displayed on the display unit 151. [ In addition, a pop-up window 256 indicating that the current situation is being detected may be displayed on the display unit 151. [ In addition, the second icon 254 may be highlighted and displayed to indicate that a new image 255 'is being acquired through the camera unit 121. [

15 (c), the controller 180 detects the occupancy rate of the new objects, and based on the detected occupancy rate information, acquires any one of a plurality of pieces of context information stored in the memory unit 160, You can decide with new situation information.

As shown in the figure, the controller 180 may display a popup window 260 'on the display unit 151 to inform the occupancy rate information of new objects. As new status information of the main body is determined, the control unit 180 can also display new status information of the main body (for example, " break situation ") in the pop-up window 260 '.

16 to 18 are conceptual diagrams showing an example of an operation of controlling the main body using setting information. The mobile terminal 100 includes a main body, a memory unit 160 (see FIG. 1), a camera unit 121 (see FIG. 1), and a control unit 180 (see FIG. 1).

Referring to FIG. 16A, the controller 180 determines which one of a plurality of pieces of context information stored in the memory unit 160 is to be stored in the main body, based on the occupancy rate information of the selected objects among the objects included in the acquired image. It can be decided by the situation information.

As shown in the figure, the control unit 180 may display a pop-up window 260 on the display unit 151 to inform the occupancy rate information of the selected objects. As the status information of the main body is determined, the control unit 180 can display the main body status information (e.g., " conference status ") in the pop-up window 260 as well.

The control unit 180 can control the main body using the setting information corresponding to the status information of the main body. Specifically, the control unit 180 can recommend at least one application using the setting information corresponding to the status information of the main body, and can control the main body using the recommended application.

In more detail, the control unit 180 can change the setting of the main body using the setting information. Further, the control unit 180 may execute a recommended application or display an icon corresponding to the recommended application on the home screen.

For example, referring to FIG. 16 (b), a call signal can be received after the status information of the main body is recognized as a conference situation. At this time, as shown in (c) of FIG. 16, the controller 180 can transmit an automatic response message to the received call signal. After transmitting the automatic response message to the other party, the control unit 180 may display a popup window 265 on the display unit 151 indicating that the automatic response message has been transmitted.

16 (d), the control unit 180 may switch the mode of the mobile terminal 100 to a silent mode (for example, a silent mode or a vibration mode). The control unit 180 may display a pop-up window 266 on the display unit 151 indicating that the mobile phone 100 is switched to the silent mode after switching the mode of the mobile terminal 100 to the silent mode.

Referring to FIG. 17, the control unit 180 may display an icon corresponding to the recommended application on the display unit 151. FIG. 17 (a) and 17 (b), when the status information of the main body is recognized as a meeting situation, the control unit 180 displays an icon 267a corresponding to the e-mail application, The icon 267b corresponding to the contact application, the icon 267c corresponding to the contact application, and the icon 267d corresponding to the electronic memo application on the lock screen.

To this end, the memory unit 160 may store information of an application optimized for each of a plurality of pieces of context information. Specifically, based on at least one of the user's selection and use history information, the control unit 180 can determine the information of the application optimized for each of the plurality of situation information, and store the determined information in the memory unit 160. [ When the status information of the main body is determined, the control unit 180 can recommend an application matching the status information of the main body from the memory unit 160. [

Referring to (a) of FIG. 18, a setting screen capable of setting an application optimized for the situation information can be displayed. For example, if the situation information is " conference situation ", the user can select a frequently used application during a meeting. On the other hand, the control unit 180 can select the application based on the past usage history information of the user, in addition to the selection by the user. The selected information may be stored in the memory unit 160.

Although the setting screen for setting the application related to the situation information is displayed in the drawing, the control unit 180 may display a setting screen for changing the setting of the main body with respect to the situation information. The user can change the sound mode of the sound output module 152 (see FIG. 1) and change the communication mode of the wireless communication unit 110 (see FIG. 1) on the setting screen.

Thereafter, as shown in FIG. 18B, a preview screen (preview screen) showing the selection result of the application matched with the "meeting situation" among the plurality of situation information can be displayed on the display unit 151 .

Thereafter, when the status information of the main body is recognized as " conference situation ", icons corresponding to the applications pre-selected by the user can be displayed on the lock screen.

As described above, all embodiments of the present invention can analyze the acquired image and control the body based on the analysis result. The control unit 180 can detect the current location information, the current location information, the current time information, and the like using the acquired image.

The control unit 180 detects the situation in the public transportation, the situation in the airplane, the situation in the theater, etc. based on the current place information and displays the application optimized for each situation on the display unit 151 , The optimized mode can be executed. For example, when the user is at the bus stop, the control unit 180 may display the route information or the arrival time information of the bus frequently used by the user on the display unit 151. For example, when the user is in the theater, the control unit 180 may display the movie information currently being displayed in the theater or recently viewed movie information on the display unit 151. In addition, the control unit 180 may display the movie information corresponding to the user's favorite genre on the display unit 151 among the movie information being displayed.

In addition, the control unit 180 can detect a situation in which the user is parked, a situation in which the user is shopping, etc., based on the current location information, provide a navigation screen to the user, or provide shopping information. For example, when the user is parked, the camera unit 121 scans the parking lot image, and then the control unit 180 may provide a navigation screen to guide the user to the parked area. For example, if the user is shopping, the control unit 180 may display the floor guide map of the shopping center on the display unit 151. [ In addition, the control unit 180 may display the event guide information of the shopping center on the display unit 151.

In addition, the control unit 180 can automatically connect the emergency rescue phone when the user is at a traffic accident occurrence point based on the current situation information. At this time, the control unit 180 can recognize that the user is at a traffic accident occurrence point by detecting an object related to a traffic accident.

In addition, the controller 180 may detect whether the user is inside the vehicle or on the bed based on the objects included in the acquired image. For example, when the user is inside the vehicle, the main body of the mobile terminal 100 can be automatically switched to the speakerphone mode and the Bluetooth mode. For example, when the user is on the bed, the weather information, news information, and schedule information of the user can be displayed on the display unit 151.

For example, the control unit 180 may recognize that the user is eating on the basis of the object (e.g., food) included in the acquired image. The camera unit 121 recognizes the food on the table and can recommend the recommended food to the user by associating the user's health information with the perceived food information. In another example, the controller 180 may recognize that the user is in motion based on the object (e.g., ball) included in the acquired image. The control unit 180 may display on the display unit 151 positional information that can use the object (e.g., ball). For example, the control unit 180 may execute a home network based on an object (for example, a home appliance) included in the acquired image, remotely control the home appliance in the user's home through the home network can do.

Further, according to the embodiment disclosed herein, the above-described method can be implemented as a code that can be read by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The mobile terminal described above can be applied to not only the configuration and method of the embodiments described above but also all or some of the embodiments may be selectively combined so that various modifications may be made to the embodiments It is possible.

Claims (18)

A terminal body;
A memory unit configured to store images;
A camera unit configured to capture an image;
A display unit; And
Wherein the control unit acquires an image from at least one of the memory unit and the camera unit, outputs the obtained image to the display unit, analyzes the obtained image, And a control unit for controlling the main body using setting information corresponding to the status information of the main body,
Wherein,
Selecting the objects having the occupancy rates higher than a predetermined ratio in the acquired image, detecting the occupancy rate of the selected objects, determining the status information of the main body based on the detected occupancy rate information,
Displaying the selected objects so as to be distinguished from non-selected objects in the acquired image,
A pop-up window including the occupancy rate information of the selected objects and the determined status information of the main body to the display unit,
And outputs information informing the operation performed by the main body to the display unit when the setting of the main body is changed so as to correspond to the determined status information of the main body. The method according to claim 1,
Wherein,
Wherein the control unit acquires at least one of an image selected from the images stored in the memory unit and an image captured through the camera unit based on a control command received from the outside. 3. The method of claim 2,
Wherein,
Detecting at least one object included in the acquired image, analyzing the detected object, and determining any one of the plurality of status information as status information of the main body. The method of claim 3,
Wherein,
Receiving status information and setting information matched to the main body when there is no status information matching the main body among the plurality of status information as a result of analysis of the detected object,
And stores the received status information and setting information in the memory unit. The method of claim 3,
Further comprising a user input unit for receiving a control command for releasing the sleep mode,
Wherein,
Wherein the control unit activates the camera unit and controls the camera unit to photograph the camera unit when the control unit receives the control command for releasing the sleep mode through the user input unit. 6. The method of claim 5,
And a wireless communication unit for receiving at least one of position information and time information of the main body,
Wherein,
And determines whether to activate the camera unit based on at least one of the received location information and the time information. The method according to claim 6,
Wherein,
The position information of the main body is determined using at least one of position information received from a Global Positioning System (GPS) and position information collected through wireless communication with an access point (AP) . 6. The method of claim 5,
Wherein,
Monitors the generated event, and determines whether to activate the camera unit according to the type of the generated event. 6. The method of claim 5,
Further comprising a microphone for receiving a voice signal,
Wherein,
Analyzes the voice signal inputted through the microphone, and determines whether to activate the camera unit according to the analysis result. The method of claim 3,
Wherein,
Wherein the control unit activates the camera unit and controls the camera unit to photograph the camera unit image after a predetermined time has elapsed after determining the status information of the main body. The method of claim 3,
Wherein,
Recommends at least one application using setting information corresponding to the status information of the main body, and controls the main body using the recommended application. 12. The method of claim 11,
Wherein,
And displays the icon corresponding to the recommended application on the display unit. The mobile terminal according to claim 1, wherein the recommendable application is a mobile phone. 13. The method of claim 12,
The memory unit,
Storing information of an application optimized for each of the plurality of context information,
Wherein,
And recommends an application matching the status information of the main body from the memory unit. 14. The method of claim 13,
Wherein,
And information of the application optimized for each of the plurality of context information based on at least one of the user's selection and use history information and stores the determined information in the memory unit. A method for controlling a mobile terminal having a terminal body, comprising:
Acquiring an image;
Outputting the obtained image to a display unit;
Analyzing the acquired image and recognizing the status information of the main body using the analysis result; And
And controlling the main body using setting information corresponding to the status information of the main body,
Wherein the recognizing comprises:
Wherein the control unit selects the objects having the occupancy rate equal to or higher than a predetermined rate in the acquired image, detects the occupancy rate of the selected objects, and determines the status information of the main body based on the detected occupancy rate information.
Displaying the selected objects so as to be distinguished from non-selected objects in the acquired image;
Outputting a pop-up window including the occupancy rate information of the selected objects and the determined status information of the main body to the display unit; And
Further comprising the step of outputting to the display unit information informing the operation performed by the main body according to the changed setting when the setting of the main body is changed so as to correspond to the determined status information of the main body Way. 16. The method of claim 15,
Wherein the acquiring of the image comprises:
And acquiring at least one of the images selected through the camera unit and images selected from the images stored in the memory unit based on the control command received from the outside. 17. The method of claim 16,
Analyzing the acquired image and recognizing the status information of the main body using the analysis result,
Detecting at least one object included in the acquired image; And
Analyzing the detected object and determining one of a plurality of context information as status information of the main body. 18. The method of claim 17,
Wherein the step of controlling the main body using setting information corresponding to the status information of the main body comprises:
Recommending at least one application using configuration information corresponding to context information of the main body; And
And controlling the main body using the recommended application.

Images