KR102220367B1 - Mobile terminal and method for controlling the same - Google Patents

Abstract

The technical problem disclosed in this specification is to share an event occurring in any one terminal device of a mobile terminal or a vehicle control device with other terminal devices, and operate in each terminal device, regardless of whether the vehicle is running or getting on the vehicle. It is to provide an invention related to a mobile terminal and a control method thereof that increase convenience to a user by maintaining continuity between programs.
An embodiment disclosed in the present specification is a mobile terminal that performs communication with a vehicle control device installed in a vehicle, the wireless communication unit forming a network including each of the vehicle control device and the mobile terminal as a node, and at least one Disclosed is a mobile terminal including a control unit for causing the vehicle control device or the mobile terminal to perform an operation corresponding to the event according to whether the vehicle is running or whether the user boards the vehicle based on an event occurring in a node.

Description

Mobile terminal and its control method {MOBILE TERMINAL AND METHOD FOR CONTROLLING THE SAME}

The technology disclosed in the present specification relates to a mobile terminal, and more specifically, a mobile terminal that shares an event that occurs depending on whether a vehicle is running or whether a user is riding a vehicle, and a control thereof. It's about how.

Terminals can be divided into mobile/portable terminals and stationary terminals depending on whether or not they can move. Again, the mobile terminal can be divided into a handheld terminal and a vehicle mount terminal according to whether the user can directly carry it.

Such a terminal is implemented in the form of a multimedia player with complex functions such as taking photos or videos, playing music or video files, receiving games, and broadcasting as functions are diversified. have. Furthermore, in order to support and increase the function of the terminal, it may be considered to improve the structural and software parts of the terminal.

In addition, various types of mobile terminals have recently been developed in consideration of user convenience. Among them, a wearable device includes all types of electronic devices that a user can wear on their body or clothing. Such a wearable device may be, for example, a smart watch (a watch-type mobile terminal), a wearable computer, a Google glass, a Bluetooth headset, and a smart wear.

Such wearable devices are implemented in the form of multimedia devices with complex functions according to their various functions. For example, in the case of a smart watch, in addition to the basic function provided as a watch, a still image may be captured through an equipped camera, a video may be recorded, or multimedia content may be played back through a display unit formed on the main body. Alternatively, various email plug-ins can be used to check messages through the wireless Internet or to access a social network.

Research is being actively conducted to provide more convenience to users by utilizing various functions of such a mobile terminal or wearable device.

In particular, the necessity of utilizing such a mobile terminal or a wearable device is increasingly emerging in relation to the driving or operation of a vehicle.

The technical problem disclosed in this specification is to share an event occurring in any one terminal device of a mobile terminal or a vehicle control device with other terminal devices, and operate in each terminal device, regardless of whether the vehicle is running or getting on the vehicle. It is to provide an invention related to a mobile terminal and a control method thereof that increase convenience to a user by maintaining continuity between programs.

An embodiment disclosed in the present specification is a mobile terminal that performs communication with a vehicle control device installed in a vehicle, the wireless communication unit forming a network including each of the vehicle control device and the mobile terminal as a node, and at least one A mobile terminal including a control unit for causing the vehicle control device or the mobile terminal to perform an operation corresponding to the event according to whether the vehicle is running or whether the user gets on or off the vehicle, based on an event occurring in a node. Start.

According to an embodiment, the wireless communication unit discloses a mobile terminal, characterized in that the vehicle control device transmits data corresponding to the event to the vehicle control device so that the vehicle control device performs an operation corresponding to the event.

According to an embodiment, a mobile terminal further comprises an output unit for displaying a pop-up window for receiving the user input on a screen.

According to an embodiment, the output unit displays at least one graphic object in the pop-up window on a screen, and the control unit performs an operation corresponding to the event according to a selection input for the graphic object. Initiate a mobile terminal.

According to an embodiment, the graphic object discloses a mobile terminal, characterized in that the number of occurrences of the event is displayed on or around the graphic object.

According to an embodiment, the control unit initiates a mobile terminal, characterized in that, when an operation corresponding to the event is performed, whether the event occurs or the number of occurrences of the event is displayed on a part of the screen while the operation is being performed. do.

According to an embodiment, the control unit displays whether the event has occurred or the number of occurrences of the event in or around a portion displayed on the screen to receive a command for executing a program that performs an operation corresponding to the event. Disclosed is a mobile terminal, characterized in that.

According to an embodiment, when the event occurs, discloses a mobile terminal, characterized in that it further comprises an output unit for outputting in the form of light, vibration, or sound.

According to an embodiment, the control unit is configured to include any one of an on/off state of the vehicle, a speed of the vehicle, a change in the vehicle position, and a distance between the vehicle control device and a mobile terminal. Or a combination thereof discloses a mobile terminal, characterized in that it is determined whether the vehicle is running or whether the user rides the vehicle.

According to an embodiment, when the power is turned on within a predetermined distance from the location of the vehicle, the mobile terminal executes a program that outputs the location of the vehicle according to a user input. Start up the terminal.

According to an embodiment, a mobile terminal is disclosed, wherein the location of the vehicle is a current location recognized by the mobile terminal or the vehicle control device when a vehicle disembarkation event of a user occurs.

According to an embodiment, the program for outputting the location of the vehicle discloses a mobile terminal, characterized in that the location of the vehicle is output on a map or a picture set by a user input is output.

According to an embodiment, a program for outputting the location of the vehicle discloses a mobile terminal, characterized in that the output is output by varying the amplitude or frequency of the vibration according to a distance difference between the mobile terminal and the vehicle.

According to an embodiment, the program for outputting the location of the vehicle includes a mobile terminal that outputs a different voice according to a distance difference between the mobile terminal and the vehicle, or by varying the amplitude or frequency of a notification sound. Start.

According to an embodiment, the mobile terminal executes a program for setting a destination of the vehicle control device according to a user input when the power is turned on within a predetermined distance from the vehicle control device. A mobile terminal is disclosed.

According to an embodiment, the mobile terminal discloses a mobile terminal, characterized in that when the power is turned on within a certain distance from the vehicle control device, executes a schedule management program according to a user input.

According to an embodiment, the mobile terminal, when the power is turned on within a predetermined distance from the vehicle control device, outputs the vehicle information according to a user input.

According to an embodiment, when the power is turned on within a certain distance from the vehicle control device, the mobile terminal starts a mobile terminal, characterized in that it outputs a message including a schedule-related text according to a user input. do.

According to an embodiment, when the power is turned on within a certain distance from the vehicle control device, the mobile terminal executes a program for transmitting a control command for the vehicle according to a user input. To start the mobile terminal.

According to an embodiment, the control command for the vehicle includes air conditioning control inside the vehicle, starting on/off control of the vehicle, door opening/closing control of the vehicle, window opening/closing control of the vehicle, and Disclosed is a mobile terminal comprising at least one of controlling the opening and closing of the sunroof of the vehicle.

According to an embodiment, the mobile terminal discloses a mobile terminal, characterized in that when a user's vehicle riding event occurs, outputs the vehicle information according to a user input.

According to an embodiment, the vehicle information includes: an air conditioning state inside the vehicle, whether the vehicle door is opened or closed, whether the vehicle window is opened or closed, an alarm state of the vehicle, whether a door is opened, whether a window is opened, a sunroof Disclosed is a mobile terminal comprising at least one of information on whether to open or close the vehicle, a state of charging a battery of the vehicle, a state of fueling the vehicle, and information on an air pressure of a tire.

According to an embodiment, the mobile terminal discloses a mobile terminal, characterized in that when a user's vehicle ride event occurs, executes a program for transmitting a control command for the vehicle according to a user input.

According to an embodiment, the mobile terminal discloses a mobile terminal, characterized in that when a user's vehicle riding event occurs, the mobile terminal executes a program for setting a destination in the vehicle control device according to a user input.

According to an embodiment, the program for setting the destination is a place name that has been searched more than a certain number of times based on a search log stored in the mobile terminal, a place registered more than a certain number of times in a schedule management program, or a message including a specific place name When is more than a certain number of times, a place included in the message is set as a destination in the vehicle control device.

According to an embodiment, the mobile terminal, when the vehicle receives a call while driving, rejects the call and transmits a response message to the call originating target, when a vehicle non-driving event or a user alighting event occurs, the user input Accordingly, a mobile terminal is disclosed, characterized in that the program for sending a call to the call originating target is executed.

According to an embodiment, when the vehicle receives a message including a schedule-related text while driving, the mobile terminal executes a schedule management program according to a user input when a vehicle non-driving event or a user alighting event occurs. Disclosed is a mobile terminal characterized by a feature.

According to an embodiment, when the vehicle is recorded while driving, the mobile terminal executes a program capable of managing the recorded file according to a user input when a vehicle non-driving event or a user alighting event occurs. Disclosed is a mobile terminal characterized by a feature.

According to an embodiment, when determining that the vehicle has not arrived at a preset destination, the mobile terminal, when a vehicle non-driving event or a user's disembarkation event occurs, the destination from the current location according to a user input. Disclosed is a mobile terminal, characterized in that to output a route to the screen.

According to an embodiment, the vehicle control device, after determining the arrival of the vehicle to a preset first destination, is set to a second destination, and determines the arrival of the vehicle to the second destination again, the mobile terminal Discloses a mobile terminal, comprising outputting a route from the second destination to the first destination according to a user input when a vehicle non-driving event or a user alighting event occurs.

According to an embodiment, when the vehicle control device determines the arrival of the vehicle to a preset destination, the mobile terminal outputs information related to the destination when a vehicle non-driving event or a user alighting event occurs. Disclosed is a mobile terminal characterized by a feature.

According to an embodiment, the mobile terminal transmits a query including the set destination name to a search server, and outputs response data received from the search server on a screen according to a user input. do.

According to an embodiment, when the vehicle control device determines the arrival of the vehicle to a preset destination, the mobile terminal, when the distance between the address stored in the address book and the destination set in the vehicle control device falls within a predetermined distance, Disclosed is a mobile terminal, comprising executing a call originating program to send a call to a contact corresponding to an address stored in the address book according to a user input.

* According to an embodiment, when the vehicle control device determines the arrival of the vehicle to a preset destination, the mobile terminal includes a distance between a place included in a pre-stored message and a destination set in the vehicle control device. In the case of belonging to within, a mobile terminal is disclosed, characterized in that the mobile terminal executes a call originating program to send to a contact within a message stored with the place or to the message originator according to a user input.

According to an embodiment, when the vehicle control device determines the arrival of the vehicle to a preset destination, the mobile terminal includes a distance between a place stored in a schedule management program and a destination set in the vehicle control device within a predetermined distance. In this case, disclosed is a mobile terminal, characterized in that the schedule management program executes a call originating program to send a call to a contact stored together with the place in the schedule management program according to a user input.

* According to an embodiment, when the vehicle control device determines the arrival of the vehicle to a preset destination, the mobile terminal, when a vehicle non-driving event or a user's alighting event occurs, a photo taking program according to a user input, Disclosed is a mobile terminal characterized by executing a memo program or a recorded program.

In addition, an embodiment disclosed in the present specification, in a vehicle control device installed in a vehicle that performs communication with a mobile terminal, a communication unit forming a network including each of the vehicle control device and the mobile terminal as a node, and at least one Based on the event occurring at the node of, the vehicle control device or the mobile terminal initiates a vehicle control device including a control unit to perform an operation corresponding to the event according to whether the vehicle is running or whether the user rides the vehicle. do.

In addition, an embodiment disclosed in the present specification discloses a vehicle characterized in that the vehicle control device is mounted.

In addition, an embodiment disclosed in the present specification is a method for controlling a mobile terminal performing communication with a vehicle control device installed in a vehicle, the step of forming a network including each of the vehicle control device and the mobile terminal as a node. And performing, by the vehicle control device or the mobile terminal, an operation corresponding to the event according to whether the vehicle is running or whether a user boards a vehicle based on an event occurring in at least one node. Disclosed is a control method of.

According to the mobile terminal or the control method thereof according to an embodiment disclosed in the present specification, the vehicle information is obtained by obtaining vehicle information for the vehicle from a vehicle control device installed in the vehicle and outputting the obtained vehicle information to the outside. There is an advantage in that it is possible to easily, quickly and efficiently check the data, and remotely control the vehicle before boarding the vehicle by using the vehicle control device installed in the vehicle.

In addition, the mobile terminal or the control method thereof according to the exemplary embodiment disclosed in the present specification may share an event occurring in any one of the mobile terminal or the vehicle control device with another terminal device by interlocking with the vehicle control device. .

Accordingly, regardless of whether the vehicle is running or whether to board the vehicle, continuity between programs operating in each terminal device can be maintained, thereby increasing user convenience.

1 is a block diagram illustrating a mobile terminal according to an embodiment disclosed in the present specification.
2A and 2B are conceptual diagrams of a communication system capable of operating a mobile terminal according to the present invention.
3A and 3B are views showing the front and rear surfaces of a smart watch according to an embodiment of the present invention.
4A and 4B are conceptual diagrams illustrating an embodiment of a wearable glasses-type terminal according to an embodiment disclosed in the present specification.
5A is a front perspective view of an example of a mobile terminal according to the present invention.
6A is a block diagram illustrating a vehicle control apparatus related to the present invention.
6B is an exemplary view showing an example of external devices connected to the vehicle control device related to the present invention.
7 is an exemplary view illustrating a display unit of a vehicle control apparatus according to an exemplary embodiment disclosed in the present specification.
8A is a block diagram showing the configuration of a vehicle control apparatus according to another exemplary embodiment disclosed in the present specification.
8B is a block diagram showing the configuration of a vehicle control apparatus according to another embodiment disclosed in the present specification.
8C is an exemplary view showing a screen related to a navigation function according to an embodiment disclosed in the present specification.
9A is an exemplary diagram illustrating a screen of a vehicle control apparatus when a call reception event occurs in a mobile terminal while driving a vehicle according to an embodiment disclosed in the present specification.
9B is an exemplary view showing a partial screen of the vehicle control device in FIG. 9A.
9C is an exemplary diagram illustrating a screen in which a mobile terminal transmits a response message to a counterpart when a call reception event occurs in a mobile terminal while driving a vehicle according to an embodiment disclosed in the present specification.
10A is an exemplary diagram of a mobile terminal displaying a pop-up window on a screen according to an embodiment disclosed in the present specification.
10B is an exemplary diagram of a pop-up window displayed on a screen of a mobile terminal according to an embodiment disclosed in the present specification.
10C is an exemplary view showing the number of occurrences of an event around an icon displayed on a screen of a mobile terminal according to an exemplary embodiment disclosed in the present specification.
10D is an exemplary diagram showing whether an event occurs on a part of a program execution screen of a mobile terminal according to an embodiment disclosed in the present specification.
11A is a first exemplary diagram illustrating a screen for outputting a location of a vehicle according to an exemplary embodiment disclosed in the present specification.
11A is a second exemplary view showing a screen for outputting a location of a vehicle according to an exemplary embodiment disclosed in the present specification.
12 is an exemplary diagram illustrating various output methods of a distance alarm according to an embodiment disclosed in the present specification.
13A is an exemplary diagram illustrating a destination setting screen according to an embodiment disclosed in the present specification.
13B is an exemplary view showing a screen on which a schedule management program according to an embodiment disclosed in the present specification is executed.
13C is an exemplary diagram illustrating a screen on which a message including text related to a schedule is output according to an embodiment disclosed in the present specification.
13D is an exemplary diagram illustrating a screen for outputting vehicle information according to an exemplary embodiment disclosed in the present specification.
13E is an exemplary view showing an execution screen of a program for transmitting a control command for a vehicle according to an exemplary embodiment disclosed in the present specification.
13F is an exemplary view showing an execution screen of a recording program according to an embodiment disclosed in the present specification.
13G is an exemplary view showing a screen outputting a route to a destination according to an embodiment disclosed in the present specification.
13H is an exemplary diagram illustrating a screen on which information related to a destination is output according to an embodiment disclosed in the present specification.
13I is an exemplary view showing an execution screen of a call originating program for sending a call to a destination-related contact according to an embodiment disclosed in the present specification.
14 is a schematic configuration diagram of an electric vehicle including a battery charging device according to an embodiment disclosed in the present specification.

The techniques disclosed herein can be applied to a mobile terminal and a control method thereof. In particular, the technology disclosed in the present specification can be applied to a wearable device linked or interlocked with a vehicle and a control method thereof.

Specifically, the technology disclosed in the present specification relates to a mobile terminal and a control method thereof that perform communication with a vehicle control device installed in a vehicle and operate in connection with or interlock with the vehicle control device.

In particular, the technology disclosed in the present specification can provide a moving direction to a destination, a mobile terminal capable of interlocking with vehicle navigation, and a control method thereof.

Mobile terminals described in this specification include mobile phones, smart phones, laptop computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), navigation systems, and slate PCs. , A tablet PC, an ultrabook, a wearable device, etc. may be included. However, it will be readily apparent to those skilled in the art that the configuration according to the embodiment described in the present specification may also be applied to a fixed terminal such as a digital TV or a desktop computer, except when applicable only to a mobile terminal.

The vehicle control apparatus described in this specification includes a telematics terminal, a navigation terminal, an audio video navigation (AVN) terminal, a television, a 3D television, an audio/video (A/V) system, and information provision. It can be applied to various devices or devices such as a center and a call center.

In addition, the vehicle control device described in the present specification may be formed in the form of a mobile terminal connected to the vehicle by wire or wirelessly. In this case, the vehicle control device includes a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistants (PDA), a portable multimedia player (PMP), and a navigation system, as in the mobile terminal described above. , A slate PC, a tablet PC, an ultrabook, a wearable device, and the like.

Hereinafter, embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the technical terms used in this specification are used only to describe specific embodiments, and are intended to limit the spirit of the technology disclosed in the present specification. It should be noted that it is not. In addition, the technical terms used in the present specification should be interpreted in the meaning generally understood by those of ordinary skill in the field to which the technology disclosed in the present specification belongs, unless otherwise defined in the specification. It should not be construed in a comprehensive or excessively reduced sense. In addition, when a technical term used in the present specification is an incorrect technical term that does not accurately express the spirit of the technology disclosed in the present specification, it should be replaced with a technical term that can be correctly understood by those skilled in the art. In addition, general terms used in the present specification should be interpreted as defined in the dictionary or according to the context before and after, and should not be interpreted as an excessively reduced meaning.

In addition, the singular expression used in the present specification includes a plurality of expressions unless the context clearly indicates otherwise. In the present specification, terms such as “consisting of” or “comprising” should not be construed as necessarily including all of the various elements or various steps described in the specification, and some of the elements or some steps It may not be included, or it should be interpreted that it may further include additional elements or steps. The suffixes "module" and "unit" for components used in the following description are given or used interchangeably in consideration of only the ease of preparation of the specification, and do not have meanings or roles that are distinguished from each other by themselves.

In addition, terms including ordinal numbers such as first and second used herein may be used to describe various elements, but the elements should not be limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may be referred to as a first component.

Hereinafter, exemplary embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but identical or similar components are denoted by the same reference numerals regardless of reference numerals, and redundant descriptions thereof will be omitted.

In addition, in describing the technology disclosed in the present specification, when it is determined that a detailed description of a related known technology may obscure the gist of the technology disclosed in the present specification, a detailed description thereof will be omitted. In addition, it should be noted that the accompanying drawings are for easy understanding of the spirit of the technology disclosed in the present specification, and should not be construed as limiting the spirit of the technology by the accompanying drawings.

Mobile terminal

Hereinafter, a configuration or form of a mobile terminal according to an embodiment disclosed in the present specification will be described in detail with reference to FIGS. 1 to 5B.

1 is a block diagram illustrating a mobile terminal 100 according to an embodiment disclosed in the present specification.

The mobile terminal 100 includes a wireless communication unit 110, an audio/video (A/V) input unit 120, a user input unit 130, a sensing unit 140, an output unit 150, a memory 160, and an interface. The unit 170, the control unit 180, and the power supply unit 190 may be included. Since the components shown in FIG. 1 are not essential, a mobile terminal having more components or fewer components may be implemented.

Hereinafter, the components will be described in order.

The wireless communication unit 110 may include one or more modules that enable wireless communication between the mobile terminal 100 and a wireless communication system or between the mobile terminal 100 and a network in which the mobile terminal 100 is located. For example, the wireless communication unit 110 may include at least one of a broadcast receiving module 111, a mobile communication module 112, a wireless Internet module 113, a short-range communication module 114, and a location information module 115. I can.

The broadcast reception module 111 receives a broadcast signal and/or broadcast-related information from an external broadcast management server through a broadcast channel.

The broadcast channel may include a satellite channel and a terrestrial channel. The broadcast management server may mean a server that generates and transmits a broadcast signal and/or broadcast-related information, or a server that receives and transmits a previously-generated broadcast signal and/or broadcast-related information to a terminal. The broadcast signal may include not only a TV broadcast signal, a radio broadcast signal, and a data broadcast signal, but also a broadcast signal in a form in which a data broadcast signal is combined with a TV broadcast signal or a radio broadcast signal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast-related information may also be provided through a mobile communication network. In this case, it may be received by the mobile communication module 112.

The broadcast-related information may exist in various forms. For example, it may exist in the form of an Electronic Program Guide (EPG) of Digital Multimedia Broadcasting (DMB) or an Electronic Service Guide (ESG) of Digital Video Broadcast-Handheld (DVB-H).

The broadcast receiving module 111 includes, for example, Digital Multimedia Broadcasting-Terrestrial (DMB-T), Digital Multimedia Broadcasting-Satellite (DMB-S), Media Forward Link Only (MediaFLO), and Digital Video Broadcasting (DVB-H). -Handheld), ISDB-T (Integrated Services Digital Broadcast-Terrestrial), and other digital broadcasting systems can be used to receive digital broadcasting signals. Of course, the broadcast reception module 111 may be configured to be suitable for not only the digital broadcasting system described above, but also other broadcasting systems.

The broadcast signal and/or broadcast related information received through the broadcast reception module 111 may be stored in the memory 160.

The mobile communication module 112 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. The wireless signal may include a voice call signal, a video call signal, or various types of data according to transmission/reception of text/multimedia messages.

The mobile communication module 112 is configured to implement a video call mode and a voice call mode. The video call mode refers to a state in which a call is made while viewing the video of the other party, and the voice call mode refers to a state in which a call is made without viewing the image of the other party. In order to implement the video call mode and the voice call mode, the mobile communication module 112 is formed to transmit and receive at least one of audio and video.

The wireless Internet module 113 refers to a module for wireless Internet access, and may be built-in or external to the mobile terminal 100. Wireless Internet technologies include WLAN (Wireless LAN), WiFi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), etc. Can be used.

The short-range communication module 114 refers to a module for short-range communication. Short-range communication technologies include Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and Near Field Communication (NFC). I can.

The location information module 115 is a module for obtaining a location of a mobile terminal, and representative examples thereof include a GPS (Global Position System) module or a WiFi (Wireless Fidelity) module.

Referring to FIG. 1, an A/V (Audio/Video) input unit 120 is for inputting an audio signal or a video signal, and may include a camera 121 and a microphone 122. The camera 121 processes an image frame such as a still image or a video obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The image frame processed by the camera 121 may be stored in the memory 160 or transmitted to an external device through the wireless communication unit 110. In addition, location information of the user may be calculated from the image frame acquired by the camera 121. Two or more cameras 121 may be provided depending on the use environment.

The microphone 122 receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, or the like and processes it as electrical voice data. In the case of a call mode, the processed voice data may be converted into a format that can be transmitted to a mobile communication base station through the mobile communication module 112 and then output. Various noise removal algorithms may be implemented in the microphone 122 to remove noise generated in the process of receiving an external sound signal.

The user input unit 130 generates input data according to a control command for controlling the operation of the mobile terminal 100 applied by the user. The user input unit 130 may include a key pad, a dome switch, a touch pad (positive pressure/static power), a jog wheel, a jog switch, and the like.

The sensing unit (or sensing unit, 140) is the open/closed state of the mobile terminal 100, the position of the mobile terminal 100, the presence or absence of user contact, the orientation of the mobile terminal, and acceleration/deceleration of the mobile terminal 100. A sensing signal (or sensing signal) for controlling the operation of the mobile terminal 100 is generated by sensing the current state. For example, the sensing unit 140 may detect whether the slide phone is opened or closed when the mobile terminal 100 is in the form of a slide phone. In addition, the detection unit 140 may detect whether the power supply unit 190 supplies power or whether the interface unit 170 is coupled to an external device.

The output unit 150 is for generating output related to visual, auditory, or tactile sense, and may include a display unit 151, an audio output module 153, an alarm unit 154, and a haptic module 155. have.

The display unit 151 displays (outputs) information processed by the mobile terminal 100. For example, when the mobile terminal is in a call mode, a user interface (UI) or a graphical user interface (GUI) related to a call is displayed. When the mobile terminal 100 is in a video call mode or a photographing mode, the display unit 151 displays a photographed or/and received image, a UI, or a GUI.

The display unit 151 includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display. display), a 3D display, and an e-ink display.

Some of these displays may be configured as a transparent type or a light-transmitting type so that the outside can be seen through them. This may be referred to as a transparent display, and a representative example of the transparent display is TOLED (Transparant OLED). The rear structure of the display unit 151 may also be configured as a light transmission type structure. With this structure, the user can see an object located behind the terminal body through an area occupied by the display unit 151 of the terminal body.

Two or more display units 151 may exist depending on the implementation form of the mobile terminal 100. For example, in the mobile terminal 100, a plurality of display units may be spaced apart or integrally disposed on one surface, or may be disposed on different surfaces.

In addition, the display unit 151 may be configured as a three-dimensional display unit 152 that displays a three-dimensional image.

Here, a three-dimensional image represents a three-dimensional stereoscopic image, and a three-dimensional stereoscopic image represents the gradual depth and reality where objects are located on a monitor or screen. This video is designed to feel the same as the space. The 3D stereoscopic image is implemented using binocular disparity. Binocular parallax refers to the parallax caused by the position of two eyes apart. When the two eyes see different two-dimensional images and the images are transferred to the brain through the retina and fused, the depth and reality of the stereoscopic image can be felt. .

A three-dimensional display method such as a stereoscopic method (glasses method), an auto stereoscopic method (no glasses method), and a projection method (holographic method) may be applied to the stereoscopic display unit 152. A stereoscopic method commonly used in home television receivers includes a Wheatstone stereoscope method.

Examples of the auto stereoscopic method include a paralex barrier method, a lenticular method, an integrated imaging method, and a switchable lens. Projection methods include reflective holographic methods and transmissive holographic methods.

In general, a 3D stereoscopic image is composed of a left image (an image for the left eye) and a right image (an image for the right eye). Depending on how the left and right images are combined into a 3D stereoscopic image, a top-down method in which left and right images are arranged up and down in one frame, and left and right images are left and right within one frame. L-to-R (left-to-right, side by side) method, a checker board method in which pieces of left and right images are arranged in a tile form, and left and right images are arranged in columns Alternatively, it is divided into an interlaced method in which the image is alternately arranged in row units, and a time sequential (frame by frame) method in which the left image and the right image are alternately displayed by time.

In addition, the 3D thumbnail image may generate a left image thumbnail and a right image thumbnail from the left image and the right image of the original image frame, respectively, and combine them to generate one 3D thumbnail image. In general, a thumbnail refers to a reduced image or a reduced still image. The left image thumbnail and the right image thumbnail generated in this way are displayed with a left and right distance difference on the screen as much as a depth corresponding to the parallax between the left image and the right image, thereby representing a three-dimensional sense of space.

The left image and the right image required for realizing a 3D stereoscopic image may be displayed on the stereoscopic display unit 152 by a stereoscopic processing unit (not shown). The 3D processing unit receives a 3D image and extracts a left image and a right image therefrom, or receives a 2D image and converts it into a left image and a right image.

On the other hand, when the display unit 151 and a sensor for detecting a touch motion (hereinafter, referred to as'touch sensor') form a mutual layer structure (hereinafter, referred to as a'touch screen'), the display unit 151 outputs In addition to the device, it can also be used as an input device. The touch sensor may have, for example, a touch film, a touch sheet, a touch pad, or the like.

The touch sensor may be configured to convert a change in pressure applied to a specific portion of the display unit 151 or a capacitance generated at a specific portion of the display unit 151 into an electrical input signal. The touch sensor may be configured to detect not only a location and an area at which a touch object is touched on the touch sensor, but also a pressure at the time of a touch. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

When there is a touch input to the touch sensor, a signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 180. As a result, the controller 180 can know whether an area of the display unit 151 is touched.

Referring to FIG. 1, a proximity sensor 141 may be disposed in an inner area of a mobile terminal surrounded by the touch screen or near the touch screen. The proximity sensor 141 may be provided as an example of the sensing unit 140. The proximity sensor 141 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity using the force of an electromagnetic field or infrared rays without mechanical contact. The proximity sensor 141 has a longer lifespan and higher utilization than a contact sensor.

Examples of the proximity sensor 141 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, and an infrared proximity sensor. When the touch screen is a capacitive type, it is configured to detect the proximity of the pointer by a change in an electric field according to the proximity of a conductive object (hereinafter referred to as a pointer). In this case, the touch screen (touch sensor) may be classified as a proximity sensor.

Hereinafter, for convenience of explanation, the action of allowing the pointer to be recognized as being positioned on the touch screen by approaching the touch screen without contacting the pointer is referred to as "proximity touch", and the touch The act of actually touching the pointer on the screen is referred to as "contact touch". The position on the touch screen at which a pointer is used for proximity touch refers to a position at which the pointer vertically corresponds to the touch screen when the pointer is touched.

The proximity sensor 141 detects a proximity touch and a proximity touch pattern (eg, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). Information corresponding to the sensed proximity touch operation and proximity touch pattern may be output on the touch screen.

When the three-dimensional display unit 152 and the touch sensor form a mutual layer structure (hereinafter, referred to as'three-dimensional touch screen'), or when the three-dimensional display unit 152 and a three-dimensional sensor for detecting a touch motion are combined with each other, The three-dimensional display unit 152 may also be used as a three-dimensional input device.

As an example of the 3D sensor, the sensing unit 140 may include a proximity sensor 141, a three-dimensional touch sensing unit 142, an ultrasonic sensing unit 143, and a camera sensing unit 144.

The proximity sensor 141 measures a distance between a sensing target (eg, a user's finger or a stylus pen) to which a touch is applied without a mechanical contact by using an electromagnetic field or infrared rays and a detection surface. The terminal recognizes which part of the 3D image has been touched using this distance. In particular, when the touch screen is a capacitive type, it is configured to detect a proximity degree of the sensing object by a change in an electric field according to the proximity of the sensing object, and recognize a three-dimensional touch using the proximity degree.

The three-dimensional touch sensing unit 142 is configured to detect the intensity or duration of a touch applied to the touch screen. For example, the three-dimensional touch sensing unit 142 detects a pressure applying a touch, and when the pressing force is strong, it recognizes the touch as a touch on an object located farther from the touch screen toward the inside of the terminal.

The ultrasonic sensing unit 143 is configured to recognize the location information of the sensing target by using ultrasonic waves.

The ultrasonic sensing unit 143 may include, for example, an optical sensor and a plurality of ultrasonic sensors. The optical sensor is formed to detect light, and the ultrasonic sensor is formed to detect ultrasonic waves. Since the light is much faster than the ultrasonic wave, the time for the light to reach the optical sensor is much faster than the time for the ultrasonic wave to reach the ultrasonic sensor. Therefore, it is possible to calculate the position of the wave generator by using the time difference between the time when the ultrasonic wave arrives using light as a reference signal.

The camera sensing unit 144 includes at least one of a camera 121, a photo sensor, and a laser sensor.

For example, the camera 121 and the laser sensor are combined with each other to detect a touch of a sensing target for a 3D stereoscopic image. When distance information sensed by a laser sensor is added to a 2D image captured by a camera, 3D information may be obtained.

As another example, a photosensor may be stacked on the display device. The photosensor is configured to scan a motion of a sensing object close to the touch screen. More specifically, the photo sensor scans the contents placed on the photo sensor by mounting a photo diode and a transistor (TR) in a row/column and using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photosensor calculates the coordinates of the object to be detected according to the amount of light change, and obtains position information of the object to be detected through this.

The sound output module 153 may output audio data received from the wireless communication unit 110 or stored in the memory 160 in a call signal reception, a call mode or a recording mode, a voice recognition mode, or a broadcast reception mode. The sound output module 153 also outputs sound signals related to functions (eg, call signal reception sound, message reception sound, etc.) performed in the mobile terminal 100. The sound output module 153 may include a receiver, a speaker, a buzzer, and the like.

The alarm unit 154 outputs a signal for notifying the occurrence of an event in the mobile terminal 100. Examples of events occurring in the mobile terminal 100 include call signal reception, message reception, key signal input, and touch input. The alarm unit 154 may output a signal for notifying the occurrence of an event by using other forms, such as vibration, in addition to a video signal or an audio signal. The video signal or audio signal may also be output through the display unit 151 or the sound output module 153, so the display unit 151 and the sound output module 153 may be classified as part of the alarm unit 154. .

The haptic module 155 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 155 may be vibration. The intensity and pattern of the vibration generated by the haptic module 155 may be controlled by a user's selection or setting of a controller. For example, the haptic module 155 may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 155 is designed to respond to stimuli such as a pin arrangement that moves vertically with respect to the contact skin surface, blowing force or suction force of air through the injection or inlet, grazing on the skin surface, contact of an electrode, and electrostatic force. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling and warming using an endothermic or heat generating element.

The haptic module 155 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 155 may be provided depending on the configuration aspect of the mobile terminal 100.

* The memory 160 may store a program for the operation of the controller 180 and may temporarily store input/output data (eg, a phone book, a message, a still image, a video, etc.). The memory 160 may store data related to vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 160 is a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), and RAM. (random access memory; RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, magnetic It may include at least one type of storage medium among a disk and an optical disk. The mobile terminal 100 may be operated in connection with a web storage that performs a storage function of the memory 160 over the Internet.

The interface unit 170 serves as a passage for all external devices connected to the mobile terminal 100. The interface unit 170 receives data from an external device or receives power and transmits it to each component inside the mobile terminal 100, or transmits data inside the mobile terminal 100 to an external device. For example, a wired/wireless headset port, an external charger port, a wired/wireless data port, a memory card port, a port for connecting a device equipped with an identification module. , An audio input/output (I/O) port, a video input/output (I/O) port, an earphone port, and the like may be included in the interface unit 170.

Meanwhile, the identification module is a chip that stores various types of information for authenticating the right to use the mobile terminal 100, and includes a user identification module (UIM), a subscriber identity module (SIM), and universal user authentication. It may include a module (universal subscriber identity module; USIM). A device equipped with an identification module (hereinafter,'identification device') may be manufactured in the form of a smart card. Accordingly, the identification device may be connected to the terminal 100 through the interface unit 170.

In addition, the interface unit 170 serves as a path through which power from the cradle is supplied to the mobile terminal 100 when the mobile terminal 100 is connected to an external cradle, or is input from the cradle by a user. It may be a path through which various command signals are transmitted to the mobile terminal 100. Various command signals or the power input from the cradle may be operated as signals for recognizing that the mobile terminal 100 is correctly mounted on the cradle.

The controller 180 generally controls the overall operation of the mobile terminal 100. For example, it performs control and processing related to voice calls, data communication, and video calls. The controller 180 may also include a multimedia module 181 for playing multimedia. The multimedia module 181 may be implemented in the controller 180 or may be implemented separately from the controller 180.

In addition, the controller 180 may perform a pattern recognition process capable of recognizing a handwriting input or a drawing input performed on the touch screen as characters and images, respectively.

In addition, when the state of the mobile terminal satisfies a set condition, the controller 180 may execute a locked state limiting input of a user's control command for applications. In addition, the controller 180 may control a lock screen displayed in the locked state based on a touch input sensed through the display unit 151 in the locked state.

The power supply unit 190 receives external power and internal power under the control of the controller 180 to supply power necessary for the operation of each component.

Various embodiments described herein may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

According to hardware implementation, the embodiments described herein include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs). , Processors, controllers, micro-controllers, microprocessors, and electric units for performing other functions may be used. In some cases, the embodiments described herein may be implemented by the controller 180 itself.

According to software implementation, embodiments such as procedures and functions described in the present specification may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

The software code is a software application written in an appropriate programming language, and the software code can be implemented. The software code may be stored in the memory 160 and executed by the controller 180.

Next, a communication system that can be implemented through the mobile terminal 100 according to the present invention will be described.

2A and 2B are conceptual diagrams of a communication system capable of operating the mobile terminal 100 according to the present invention.

First, referring to FIG. 2A, the communication system may use different air interfaces and/or physical layers. For example, the radio interfaces usable by the communication system include Frequency Division Multiple Access (FDMA), Time Division Multiple Access (TDMA), and Code Division Multiple Access (CDMA). ), Universal Mobile Telecommunications Systems (UMTS) (especially, Long Term Evolution (LTE)), Global System for Mobile Communications (GSM), and the like.

Hereinafter, for convenience of description, the description will be limited to CDMA. However, it is apparent that the present invention can be applied to any communication system including a CDMA wireless communication system.

As shown in FIG. 2A, the CDMA wireless communication system includes at least one terminal 100, at least one base station (BS) 270, and at least one base station controllers (BSCs) 275 ), may include a Mobile Switching Center (MSC) 280. The MSC 280 is configured to be connected to a public switched telephone network (PSTN) 290 and BSCs 275. The BSCs 275 may be paired with the BS 270 to be connected through a backhaul line. The backhaul line may be provided according to at least one of E1/T1, ATM, IP, PPP, Frame Relay, HDSL, ADSL, or xDSL. Thus, multiple BSCs 275 may be included in the system shown in FIG. 2A.

Each of the plurality of BSs 270 may include at least one sector, and each sector may include an omni-directional antenna or an antenna pointing in a specific direction radially from the BS 270. In addition, each sector may include two or more antennas of various types. Each BS 270 may be configured to support a plurality of frequency assignments, and each of the plurality of frequency assignments may have a specific spectrum (eg, 1.25 MHz, 5 MHz, etc.).

The intersection of sector and frequency allocation can be referred to as a CDMA channel. BS 270 may be referred to as a base station transmission/reception subsystem (BTS). In this case, one BSC 275 and at least one BS 270 may be collectively referred to as a “base station”. The base station may also represent a "cell site". Alternatively, each of the plurality of sectors for a specific BS 270 may be referred to as a plurality of cell sites.

As shown in Fig. 2A, a broadcasting transmitter (BT) 295 transmits a broadcast signal to terminals 100 operating in the system. The broadcast receiving module 111 shown in FIG. 1 is provided in the terminal 100 to receive a broadcast signal transmitted by the BT 295.

In addition, Fig. 2A shows a satellite 300 of a Global Positioning System (GPS). The satellite 300 helps to determine the location of the mobile terminal 100. Although two satellites are shown in Figure 2A, useful location information may be obtained by two or more satellites. The location information module 115 shown in FIG. 1 cooperates with the satellite 300 shown in FIG. 2A to obtain desired location information. Here, the location of the mobile terminal 100 may be tracked using not only GPS tracking technology but also all technologies capable of tracking the location. In addition, at least one of the GPS satellites 300 may selectively or additionally perform satellite DMB transmission.

During typical operation of the wireless communication system, BS 270 receives a reverse link signal from mobile terminal 100. At this time, the mobile terminal 100 is connecting a call, transmitting/receiving a message, or performing another communication operation. Each of the reverse link signals received by the specific base station 270 is processed within the specific base station 270. The data generated as a result of the processing is transmitted to the connected BSC 275. BSC 275 provides call resource allocation and mobility management functions, including organizing soft handoffs between base stations 270. Further, the BSCs 275 transmit the received data to the MSC 280, and the MSC 280 provides an additional transmission service for connection with the PSTN 290. In addition, similarly, the PSTN 290 is connected to the MSC 280, the MSC 280 is connected to the BSCs 275, and the BSCs 275 is the BS ( 270) can be controlled.

Next, in FIG. 2B, a method of acquiring location information of a mobile terminal using a Wi-Fi positioning system (WPS: Wireless Fidelity) will be described.

The Wi-Fi positioning system (WPS: WiFi Positioning System, 300) moves by using a WiFi module provided in the mobile terminal 100 and a wireless access point (AP) 320 that transmits or receives a wireless signal with the WiFi module. As a technology for tracking the location of the terminal 100, it means a wireless local area network (WLAN)-based location positioning technology using WiFi.

The Wi-Fi location tracking system 300 includes a Wi-Fi location positioning server 310, a mobile terminal 100, a wireless AP 330 connected to the mobile terminal 100, and a database 330 storing random wireless AP information. Can include.

The Wi-Fi location server 310 extracts information on the wireless AP 320 connected to the mobile terminal 100 based on the location information request message (or signal) of the mobile terminal 100. The information on the wireless AP 320 connected to the mobile terminal 100 is transmitted to the Wi-Fi location server 310 through the mobile terminal 100, or from the wireless AP 320 to the Wi-Fi location server 310. Can be transmitted.

Based on the location information request message of the mobile terminal 100, the extracted wireless AP information is MAC Address, SSID, RSSI, channel information, Privacy, Network Type, Signal Strength, and Noise Strength. It may be at least one of.

As described above, the Wi-Fi location server 310 receives information on the wireless AP 320 connected to the mobile terminal 100, and includes information contained in a pre-built database 330 and the received wireless AP 320. By comparing the information, the location information of the mobile terminal 100 is extracted (or analyzed).

Meanwhile, in FIG. 2B, as an example, wireless APs connected to the mobile terminal 100 are illustrated as first, second, and third wireless APs 320. However, the number of wireless APs connected to the mobile terminal 100 may vary according to the wireless communication environment in which the mobile terminal 100 is located. The Wi-Fi location tracking system 300 can track the location of the mobile terminal 100 when the mobile terminal 100 is connected to at least one wireless AP.

Next, looking at the database 330 in which random wireless AP information is stored in more detail, the database 330 may store various information of random wireless APs arranged at different locations.

Information of arbitrary wireless APs stored in the database 300 includes MAC Address, SSID, RSSI, channel information, Privacy, Network Type, latitude and longitude coordinates of the wireless AP, building name where the wireless AP is located, the number of floors, and detailed indoor location information. (GPS coordinates are available), it may be information such as the AP owner's address and phone number.

In this way, since the database 330 stores information about a random wireless AP and location information corresponding to the random wireless AP, the Wi-Fi location server 310 is used in the database 330 to the mobile terminal 100 The location information of the mobile terminal 100 may be extracted by searching for wireless AP information corresponding to the information of the wireless AP 320 connected to and extracting the location information matched with the searched wireless AP information.

In addition, the extracted location information of the mobile terminal 100 is transmitted to the mobile terminal 100 through the Wi-Fi location server 310, so that the mobile terminal 100 can obtain the location information.

Hereinafter, implementation forms of various mobile terminals according to an exemplary embodiment disclosed in the present specification will be described with reference to FIGS. 3 to 5B.

3A and 3B are views showing the front and rear surfaces of a smart watch according to an embodiment of the present invention.

That is, FIGS. 3A and 3B illustrate a case in which the mobile terminal 100 has a smart watch, which is a watch-type mobile terminal among the types of wearable devices.

The disclosed smart watch (Smart Watch: 200) has a rectangular structure. However, the present invention is not limited thereto, and can be applied to a smart watch having a variety of structures, that is, a polygonal structure of various shapes such as a circle or a triangle.

According to an embodiment, the smart watch 200 includes a band 230 and a body 220. Cases forming the exterior of the main body 220 may be divided into a front case 210 and a rear case 250. Various electronic components are embedded in the space formed between the front case 210 and the rear case 250. At least one intermediate case may be additionally disposed between the front case 210 and the rear case 250. The cases may be formed by injection of synthetic resin or may be formed to have a metal material such as stainless steel (STS) or titanium (Ti).

Referring to FIG. 3A, a display unit 151, a camera 121, a microphone 122, and the like may be disposed on the front case 210.

The display unit 151 occupies most of the main surface of the front case 210. Camera 121 and microphone 122 may be disposed at both ends of the display unit 151.

Meanwhile, various types of visual information may be displayed on the display unit 151. These information may be displayed in the form of letters, numbers, symbols, graphics, or icons.

In order to input such information, at least one of the letters, numbers, symbols, graphics, and icons may be displayed in a certain arrangement, thereby being implemented in the form of a keypad. Such a keypad can be called a'soft key'.

The display unit 151 may operate as an entire area, or may be divided into a plurality of areas and operated. In the latter case, the plurality of regions may be configured to operate in association with each other.

In addition, a wired/wireless headset port (not shown) and a wired/wireless data port (not shown) may be disposed on one side of the main body 220 of the smart watch 200. The ports are configured as an example of an interface 170 (see FIG. 1).

Referring to FIG. 3B, a first sensor 140a may be disposed on the rear surface of the main body 220, that is, on the rear case 250. The first sensor 140a may be a sensor for detecting a user's skin condition or a user's biometric signal. In addition, a second sensor 140b capable of detecting the user's muscle movement may be disposed in at least one area of the band 230 that is in contact with the skin of the back of the user's wrist.

An antenna for receiving broadcast signals may be additionally disposed on the side of the main body 220. An antenna forming a part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be retractable from the main body 220.

In addition, the main body 220 of the smart watch 200 may be provided with an audio output module (not shown) and an interface. In addition, a user input unit 340 and a connection port may be disposed on side surfaces of the front case 210 and the rear case 250.

The user input unit 240 is manipulated to receive a command for controlling the operation of the smart location 200 and may include at least one manipulation unit 240a, 240b, 240c, and 240d. The operating units may also be collectively referred to as a manipulating portion, and any method may be employed as long as it is a tactile manner in which a user applies a tactile feeling.

Content input by the plurality of operation units may be set in various ways. For example, it may be formed to receive a command such as input of a command such as start, end, scroll, etc., control of the volume of sound output from the sound output unit 152, or change of the touch recognition mode of the display unit 151. have.

The connection port receives data from an external device, receives power and transmits it to each component inside the smart watch 200, or transmits data inside the smart watch 200 to an external device. The connection port may be configured as an example of the interface 170 (see FIG. 1).

A power supply unit (not shown) for supplying power to the smart watch 200 is provided in the main body 220 of the smart watch 200. The power supply unit may be configured to be embedded in the main body 220.

4A and 4B are conceptual diagrams illustrating an embodiment of a wearable glasses-type terminal according to an embodiment disclosed in the present specification.

That is, FIGS. 4A and 4B illustrate a case in which the mobile terminal 100 has a smart glasses type, which is a glasses type mobile terminal, among the types of wearable devices.

Referring to FIG. 4A, a wearable glasses-type terminal 200 ′ according to an exemplary embodiment disclosed herein includes a main body 100 ′, a display unit 151, and a controller 180.

In addition, the wearable glasses-type terminal 200 ′ according to an exemplary embodiment disclosed in the present specification may further include a user input unit, a voice recognition unit, and a motion detection unit.

The wearable glasses-type terminal 200 ′ according to the exemplary embodiment disclosed in the present specification may be implemented as a head mounted display (HMD). As a specific example, it may be implemented with smart glasses.

The body 100' is formed to be mountable on the head. For example, it can be implemented as a frame and a leg in smart glasses.

The display unit 151 may be disposed in a position corresponding to both eyes by being combined with the main body 100 ′. Also, the display unit 151 has light transmittance and may output visual information.

The visual information refers to a virtual object generated by the wearable glasses-type terminal 200 ′ or input from an external device. For example, the virtual object may mean an application, an icon corresponding thereto, content, a UI of a call mode, and the like. This may be generated by the controller 180 or may be input from a mobile terminal such as a smart phone. In this case, since the display unit 151 has light transmittance, the user can see the external environment through the display unit 151.

In addition, as an example, the display unit 151 may view the external environment and output information on an arbitrary external object constituting the external environment. For example, the external object may be a business card, a person, or an external device capable of mutual communication.

As described above, the controller 180 may control the wearable glasses-type terminal 200 ′. Specifically, the controller 180 may output information on an external device detected by the wireless communication unit 110 on the display unit 151.

For example, the controller 180 may identify the detected location of the external device. In this case, the controller 180 may determine whether the sensed external device is located within the user's field of view, and determine whether to output the sensed external device information according to the determination result.

In addition, the controller 180 may be mounted on the body 100 ′ of the wearable glasses-type terminal 200 ′ or may be integrally formed with the body 100 ′. In another embodiment, it may be disposed apart from the main body 100 ′.

The camera 121 may be disposed in front of at least one of the left and right eye display units 151. Alternatively, it is disposed on one or both sides of the frame 100 ′ so that a space other than the wearer's field of view may be photographed.

The user input unit 130 may be implemented as a separate touch panel on one or both sides of the frame 110 ′. Alternatively, it can be implemented with a physical key. For example, a power ON/OFF switch may be implemented on one side of the frame 110'.

In another embodiment, it may be implemented as a separate external device device connected to the main body 100 ′. Accordingly, the user can input a specific command to a separate external device. Alternatively, the display unit 151 may be implemented as a touch screen to directly receive a control command from a user.

In another embodiment, it may be implemented as a module that recognizes a user's voice command. Through this, the user can input a specific command to the main body 100' through voice.

Meanwhile, as an embodiment of a wearable glasses-type terminal, smart glasses are being released. Smart glasses implemented as a wearable device can easily execute functions that have been executed in existing mobile terminals.

The display unit 151 of the smart glasses may simultaneously display an external environment and output visual information viewed through the display unit 151 (Augmented Reality). Through this, the user can more easily grasp information on arbitrary objects constituting the external environment.

In addition, the smart glasses may perform wireless communication between smart glasses or an external device capable of communicating with the smart glasses. In this case, information related to the external device may be output on the display unit 151.

4B illustrates a wearable device to which an eye proximity display according to an embodiment disclosed herein may be mounted.

Referring to FIG. 4B, the illustrated wearable device is a glass-type terminal 200 ″, and the glass-type terminal 200 ″ is configured to be worn on the head of the human body, and a frame part (case, housing, etc.) for this It can be provided. The frame portion may be formed of a flexible material to facilitate wearing. In this drawing, it is illustrated that the frame portion includes a first frame 201 ″ and a second frame 202 ″ made of different materials.

The frame portion is supported on the head and provides a space in which various parts are mounted. As shown, electronic components such as a control module 280 ″ and an audio output module 252 ″ may be mounted on the frame part. In addition, a display unit 251 ″ covering at least one of the left eye and the right eye may be detachably mounted on the frame unit.

The control module 280 ″ is configured to control various electronic components provided in the glass-type terminal 200 ″. The control module 280 ″ may be understood as a configuration corresponding to the control unit 180 (see FIG. 1) described above. In this drawing, it is illustrated that the control module 280 ″ is installed on the frame on one side of the head. However, the location of the control module 280 ″ is not limited thereto.

The display unit 251 ″ may be implemented in the form of a head mounted display (HMD). The HMD type refers to a display method that is mounted on the head and displays an image directly in front of the user's eyes. When the user wears the glass terminal 200, the display unit 251 may be disposed to correspond to at least one of the left eye and the right eye so that an image can be directly provided in front of the user's eyes.

The display unit 251 ″ may project an image to the user's eyes. In addition, the display unit 251 may be formed to be light-transmitting so that the user can see the projected image and the general field of view (a range that the user sees through the eyes) together.

In this way, the image output through the display unit 251 ″ may be viewed by overlapping with the general field of view. The mobile terminal 100 may provide an Augmented Reality (AR) that displays a single image by superimposing a virtual image on a real image or a background by using the characteristics of the display.

The camera 221 ″ is disposed adjacent to at least one of the left eye and the right eye, and is formed to capture a front image. Since the camera 221 ″ is located adjacent to the eye, the camera 221 ″ may acquire a scene viewed by the user as an image.

In this drawing, it is illustrated that the camera 221 ″ is provided in the control module 280 ″, but is not limited thereto. The camera 221 ″ may be installed on the frame, or may be provided in plural to obtain a three-dimensional image.

The glass-type terminal 200 ″ may include user input units 223a ″ and 223b ″ which are operated to receive a control command. The user input units 223a'' and 223b'' may be employed in any manner as long as they are in a tactile manner, such as touch or push. In this drawing, it is illustrated that the frame unit and the control module 280 ″ are provided with user input units 223a ″ and 223b ″ of push and touch input methods, respectively.

In addition, the glass-type mobile terminal 200 ″ may be provided with a microphone (not shown) for receiving sound and processing it as electrical voice data, and an sound output module 252 ″ for outputting sound. The sound output module 252 may be configured to transmit sound through a general sound output method or a bone conduction method. When the sound output module 252'' is implemented in a bone conduction method, when the user wears the glass-type terminal 200'', the sound output module 252'' is in close contact with the head and vibrates the skull for sound Will be delivered.

Hereinafter, with reference to FIGS. 5A and 5B, a structure of a mobile terminal or a mobile terminal in which components of the mobile terminal according to an embodiment disclosed in the present specification are arranged will be described.

5A is a front perspective view of an example of a mobile terminal 100 related to the present invention.

The disclosed mobile terminal 100 has a bar-shaped terminal body. However, the present invention is not limited thereto, and can be applied to various structures such as a watch type, a clip type, a glasses type, or a folder type in which two or more bodies are relatively movably coupled, a flip type, a slide type, a swing type, and a swivel type. have.

The body includes a case (frame, housing, cover, etc.) forming the exterior. In this embodiment, the case may be divided into a front case 101 and a rear case 102. Various electronic components are embedded in the space formed between the front case 101 and the rear case 102. At least one intermediate case may be additionally disposed between the front case 101 and the rear case 102, and the battery cover 103 covering the battery 191 may be configured to be detachably attached to the rear case 102. have.

The cases may be formed by injection of synthetic resin or may be formed of a metal such as stainless steel (STS), aluminum (Al), titanium (Ti), or the like.

A display unit 151, a first sound output module 153a, a first camera 121a, and a first operation unit 131 are disposed on the front of the terminal body, and a microphone 122 and an interface unit 170 are disposed on the side surfaces. ), a second operation unit 132, and the like may be provided.

The display unit 151 is configured to display (output) information processed by the mobile terminal 100. The display unit 151 is a liquid crystal display (LCD) that visually expresses information, a thin film transistor-liquid crystal display (TFT LCD), and an organic light-emitting diode (OLED). ), a flexible display, a 3D display, and an e-ink display.

The display unit 151 may include a touch sensing means to receive a control command by a touch method. When a touch is made to any one place on the display unit 151, the touch sensing means may be configured to sense this and input a content corresponding to the touched position. Content input by the touch method may be letters or numbers, or menu items that can be indicated or designated in various modes.

The touch sensing means is formed to be light-transmitting so that visual information output from the display unit 151 can be seen, and may include a structure for enhancing visibility of the touch screen in a bright place. Referring to FIG. 5A, the display unit 151 occupies most of the front surface of the front case 101.

A first sound output module 153a and a first camera 121a are disposed in an area adjacent to one end of both ends of the display unit 151, and a first operation unit 131 and a microphone 122 are disposed in an area adjacent to the other end. ) Is placed. The second manipulation unit 132 (refer to FIG. 5B) and the interface unit 170 may be disposed on the side of the terminal body.

The first sound output module 153a may be implemented in the form of a receiver that transmits a call sound to a user's ear or a loud speaker that outputs various alarm sounds or multimedia reproduction sounds.

The sound generated from the first acoustic output module 153a may be configured to be emitted along an assembly gap between structures. In this case, the externally formed hole for sound output is not visible or hidden, so that the appearance of the mobile terminal 100 may be more simple. However, the present invention is not limited thereto, and a hole for emitting the sound may be formed in the window.

The first camera 121a processes an image frame such as a still image or a moving picture obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display unit 151.

The user input unit 130 is manipulated to receive a command for controlling the operation of the mobile terminal 100 and may include first and second manipulation units 131 and 132. The first and second operation units 131 and 132 may be collectively referred to as a manipulating portion, and any method may be employed as long as the user operates while having a tactile feeling such as touch, push, and scroll. Can be.

In the present drawing, the first operation unit 131 is illustrated based on a touch key, but the present invention is not limited thereto. For example, the first operation unit 131 may be a push key (mechanical key), or may be configured as a combination of a touch key and a push key.

Contents input by the first and/or second manipulation units 131 and 132 may be set in various ways. For example, the first manipulation unit 131 receives commands such as menu, home key, cancel, search, etc., and the second manipulation unit 132 adjusts the size of the sound output from the first sound output module 153a or A command such as switching to the touch recognition mode of the display unit 151 may be input.

The microphone 122 is formed to receive a user's voice and other sounds. The microphone 122 may be provided at a plurality of locations and configured to receive stereo sound.

The interface unit 170 serves as a passage through which the mobile terminal 100 can exchange data with an external device. For example, the interface unit 170 includes a connection terminal for connecting to an earphone wired or wirelessly, a port for short-range communication (e.g., an infrared port, a Bluetooth port), a wireless LAN port. LAN Port), etc.), or at least one of power supply terminals for supplying power to the mobile terminal 100. The interface unit 170 may be implemented in the form of a socket for accommodating an external card such as a Subscriber Identification Module (SIM) or a User Identity Module (UIM), or a memory card for storing information.

5B is a rear perspective view of the mobile terminal 100 shown in FIG. 5A.

Referring to FIG. 5B, a second camera 121b may be additionally mounted on the rear surface of the terminal body, that is, the rear case 102. The second camera 121b may be a camera having a photographing direction substantially opposite to that of the first camera 121a (refer to FIG. 5A) and having different pixels from the first camera 121a.

For example, the first camera 121a has a low pixel so that it is not unreasonable to photograph the user's face and transmit it to the other party in the case of a video call, and the second camera 121b photographs a general subject and does not immediately transmit it. In many cases, it is desirable to have high pixels. The first and second cameras 121a and 121b may be installed on the terminal body to enable rotation or pop-up.

A flash 123 and a mirror 124 are additionally disposed adjacent to the second camera 121b. The flash 123 illuminates light toward the subject when photographing the subject with the second camera 121b. The mirror 124 enables the user's own face to be reflected when the user wants to take a picture (self-photographed) using the second camera 121b.

A second sound output module 153b may be additionally disposed on the rear surface of the terminal body. The second sound output module 153b may implement a stereo function together with the first sound output module 153a (refer to FIG. 5A), and may be used to implement a speakerphone mode during a call.

An antenna for receiving broadcast signals (not shown) may be additionally disposed on the side of the terminal body in addition to an antenna for a call. An antenna forming a part of the broadcast receiving module 111 (refer to FIG. 1) may be installed to be retractable from the terminal body.

The terminal body is provided with a power supply unit 190 (see FIG. 1) for supplying power to the mobile terminal 100. The power supply unit 190 may include a battery 191 that is built into the terminal body or configured to be detachable from the outside of the terminal body. In this drawing, it is illustrated that the battery cover 103 is coupled to the rear case 102 to cover the battery 191 to limit the separation of the battery 191 and protect the battery 191 from external shocks and foreign substances. .

It is obvious to those skilled in the art that the technology for a mobile terminal or a wearable device disclosed in the present specification may be embodied in other specific forms without departing from the technical spirit disclosed in the present specification.

Vehicle control device

Hereinafter, a vehicle control device disclosed in the present specification and a navigation function that can be performed by the vehicle control device will be described in detail with reference to FIGS. 6A to 8C.

6A is a block diagram illustrating a vehicle control apparatus related to the present invention.

6B is an exemplary view showing an example of external devices connected to the vehicle control device related to the present invention.

6A and 6B, FIG. 6A is a block diagram for describing a vehicle control device according to an embodiment disclosed in the present specification, and FIG. 6B is a connectable vehicle control apparatus according to an embodiment disclosed herein. This is an example diagram showing examples of external devices.

First, as shown in FIG. 6A, the vehicle control device 400 according to an embodiment disclosed in the present specification includes a control unit 410, a sensing unit 430 connected to the control unit 410, and a vehicle driving unit 420. , The memory 440 may be included, and an output unit 450 may be further included. In addition, the vehicle control device 400 may be formed in a body portion of a vehicle including an outer frame and a window forming the exterior of the vehicle, and an inner frame formed to allow a user to ride. Here, the components shown in FIG. 6A are not essential in implementing the vehicle control device 400 related to the present invention, so that the vehicle control device 400 described in the present specification is more or less than the components listed above. , Or may have fewer components.

The sensing unit 430 may include one or more sensors for sensing at least one of information in the vehicle control device 400, information on an environment surrounding the vehicle control device 400, and user information. For example, the detection unit 430 may include a proximity sensor 432, an illumination sensor, a touch sensor, an acceleration sensor, a magnetic sensor, and a gravity sensor. G-sensor), gyroscope sensor, motion sensor, RGB sensor, infrared sensor (IR sensor), finger scan sensor, ultrasonic sensor, light Sensors (optical sensors), environmental sensors (e.g., barometers, hygrometers, thermometers, radiation sensors, heat sensors, gas sensors, etc.), chemical sensors (e.g., electronic nose, healthcare sensors, biometric sensors) And the like) may be included. Meanwhile, the vehicle control apparatus 400 disclosed in this specification may combine and utilize information sensed by at least two or more of these sensors.

Meanwhile, the sensing unit 430 may further include a short-range communication module 431. The short range communication module 431 is for short range communication, and includes Bluetooth™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, and NFC. Near field communication may be supported by using at least one of (Near Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technologies. The short-range communication module 431 may support wireless communication between the vehicle control device 400 and an external device 170 (refer to FIG. 6B) through wireless area networks.

The external device may be the mobile terminal 100 described above. In particular, the external device may be a wearable device 200 or 200 ′, which is a type of the mobile terminal described above.

The vehicle driving unit 420 may unlock the vehicle or switch the vehicle to the locked state. Here, the locked state of the vehicle may be a state in which all or part of the function of the vehicle is limited, the engine is not started, or the door is not opened. Conversely, the state in which the locked state is released means that the door of the driver's seat or the passenger seat of the vehicle, at least one of the doors of the rear seat or the trunk (trunk) is opened, or all functions of the vehicle, i.e., starting This may mean making it possible to take it or making various functions such as a navigation function or a ventilation function available.

In addition, the vehicle driving unit 420 may change various settings of the vehicle or allow functions to be automatically performed. For example, the vehicle driving unit 420 may determine the degree to which each component of the vehicle, for example, a window of a driver's seat or an assistant seat in the front seat, or an angle of a side mirror, and the like. It can be controlled according to the control of the driver's seat or the seat height of at least one of the auxiliary seats and rear seats, or the horizontal position of the seat (for example, the gap between the seats) can be adjusted. In addition, the vehicle driving unit 120 may set the steering wheel of the driver's seat, that is, the height of the steering wheel or the sensitivity of the steering wheel according to the control of the controller 410. In addition, the vehicle driving unit 420 may allow the vehicle's gear to operate in an automatic transmission mode or a manual transmission mode according to the control of the controller 410, and in the case of a hybrid vehicle, an internal combustion engine engine is used. It is also possible to preferentially select one of the mode to use or the mode to use the electric motor.

In addition, the vehicle driving unit 420 may change the physical setting state of the vehicle as well as the software setting according to the control of the controller 410. For example, the vehicle driving unit 420 may display a preset music list according to the control of the control unit 410, or may automatically play any one of the music on the preset list. Alternatively, the vehicle driving unit 420 may automatically set a preset specific destination, and automatically display a route to the specific destination through provided navigation. Alternatively, the vehicle driving unit 420 may automatically set the vehicle distance or vehicle speed according to the control of the control unit 410 during cruise control of the vehicle.

To this end, the vehicle driving unit 420 may have at least one different lower driving units, and each of these lower driving units may change a physical setting state of the vehicle or a software setting state. Hereinafter, the lower driving unit that changes the physical setting state of the vehicle will be referred to as a first driving unit 421, and the lower driving unit that changes the software setting state of the vehicle will be referred to as a second driving unit 422.

Here, the first driving unit 421 may include other components capable of changing an outer frame or an inner frame of the vehicle in order to change the physical setting of the vehicle. For example, the first driving unit 421 may further include a physical driving unit for adjusting the height of the seat or the angle of the backrest, and an elastic member such as a coil or spring or a pressure member for raising or lowering the height of the handle It may further include a handle height adjustment unit including a.

Meanwhile, the second driver 422 may be implemented as at least one or more application programs or applications. For example, the second driving unit 122 may be implemented in a form including any one of application programs for driving navigation or an application program for playing pre-stored media data (eg, MP3, etc.), These applications or applications may be any of those for driving control of the vehicle.

The output unit 450 is for generating output related to visual, auditory or tactile sense, and includes at least one of the display unit 451, the sound output unit 452, the hap tip module 453, and the light output unit 454 can do. The display unit 451 displaying various types of image information may form a layered structure with a touch sensor or be formed integrally with the touch sensor, thereby implementing a touch screen. Such a touch screen may function as a user input unit 423 that provides an input interface between the vehicle control device 100 and a user, and may provide an output interface between the vehicle control device 400 and a user.

Such a touch screen may be implemented in various parts of a vehicle. For example, the touch screen may be implemented on all or part of a vehicle's windshield glass, and an external surface (a surface exposed to the outside of the vehicle) or an internal surface (a surface facing the interior of the vehicle) It can be implemented in either. In addition, the touch screen may be implemented on a window on a side of a driver's seat, a window on a side of an assistant seat, or on an outer or inner surface of a window on a rear seat of a vehicle. Alternatively, the touch screen may be implemented in a vehicle's side mirror or a vehicle's sunroof.

In addition, such a touch screen may be implemented in a glass portion such as a window or a sunroof of a vehicle, as well as an external frame or an internal frame of the vehicle. For example, the touch screen may be implemented on the surface of an outer frame of a vehicle, such as between a windshield glass and a window, or between a window or a window, such as an A-pillar, B-pillar, and C-pillar. Alternatively, it may be implemented on at least a portion of the exterior surface of the vehicle door (eg, near the handle portion of the vehicle door). In addition, the touch screen may be formed on a cover surface of a gear box inside a vehicle or a cover portion of a console box. In addition, it goes without saying that at least one or more touch screens may be formed in a plurality of different parts of the vehicle.

The memory 440 stores data supporting various functions of the vehicle control device 400. The memory 440 may store a plurality of application programs or applications driven by the vehicle control device 400, data for operation of the vehicle control device 400, and commands. At least some of these application programs may be downloaded from an external server through wireless communication. In addition, at least some of these application programs exist on the vehicle control device 400 from the time of shipment for basic functions of the vehicle control device 400 (eg, a starting function, a navigation function, and a vehicle locking and unlocking function). I can. Meanwhile, the application program may be stored in the memory 440, installed on the vehicle control device 400, and driven by the controller 410 to perform an operation (or function) of the vehicle control device.

According to an embodiment, the application program may be a navigation program that performs a navigation function.

In addition, the memory 440 may store information related to at least one or more users. Here, the user-related information may be information on the authentication information of the corresponding user and the setting states of various vehicles that are directly set by the user or appropriately set based on the user's biometric information. For example, it may be an internal temperature or humidity of a vehicle directly set by a specific user, or setting information according to a user's driving habit. Alternatively, such information may be a record of the user's driving route. In addition, the authentication information may be information about a password or pattern previously set by the user, or may be information based on the user's biometric information such as fingerprint or iris recognition information. Alternatively, the authentication information may be information related to a user's gesture.

According to an embodiment, the user's biometric information may be obtained by the mobile terminal 100 or the wearable device 200 or 200 ′.

In this case, the wearable device further includes a communication unit that performs communication with a vehicle control device installed in the vehicle, and a biometric information acquisition unit that acquires biometric information for the user from the specific body part (eg, wrist part). I can.

Here, the communication unit may transmit the acquired biometric information of the user to the vehicle control device 400, and the storage unit 440 may store the user's biometric information.

The biometric information may be at least one of information about the user's heart rate, body fat, blood pressure, blood sugar, face shape, fingerprint, brain waves, and iris.

Further, the memory 440 may store a program for the operation of the controller 410 and may temporarily store input/output data (eg, user authentication information, driving environment setting information). The memory 440 may store data on vibrations and sounds of various patterns output when a touch input on the touch screen is performed.

The memory 440 is a flash memory type, a hard disk type, a solid state disk type, an SDD type, a multimedia card micro type. type), card-type memory (e.g., SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable (EEPROM) read-only memory), programmable read-only memory (PROM), magnetic memory, magnetic disk, and optical disk. The vehicle control device 400 may be operated in connection with a web storage that performs a storage function of the memory 440 over the Internet.

Meanwhile, the controller 410 controls the general operation of the vehicle control device 400 in addition to the operation related to the application program. The controller 410 may control the driving of the vehicle by processing signals, data, information, etc. input or output through the above-described components or by driving an application program stored in the memory 440. In addition, the controller 410 may control at least some of the constituent elements discussed with FIG. 1A in order to drive the application program stored in the memory 440. Further, the control unit 410 may operate by combining at least two or more of the components included in the vehicle control apparatus 400 to drive the application program.

Meanwhile, the controller 410 may receive authentication information from a user, and may determine whether the user is an authenticated user based on the input authentication information. Here, the authentication information may be a user's fingerprint or recognition information of a preset pattern. Alternatively, the authentication information may be information related to a user's iris recognition or a user's specific gesture. For example, the controller 410 may be configured to recognize a pattern of a plurality of tapping (for example, a tab or a knock) applied to a part of the surface of the vehicle outside or inside the vehicle, or the outside of the vehicle. Alternatively, fingerprint identification information that can be inputted through a touch screen area formed on a surface of a portion of the interior, a window of a driver's seat or an auxiliary seat, and a windshield glass may be input as the authentication information. Alternatively, the controller 410 may recognize a user's gesture made inside or outside the vehicle using a photo sensor or a camera provided in the sensing unit 430, or may recognize the user's iris information.

In addition, the controller 410 may allow only the authenticated user to release the locked state of the vehicle. Therefore, the vehicle control device 400. It is possible to allow the user to open the door of the vehicle or open the trunk without using the key. Alternatively, the vehicle may be started using the preset user's authentication information. Alternatively, on the contrary, the state of the vehicle may be changed to a locked state. That is, the controller 410 may maintain the locked state of the vehicle until authentication information of the authenticated user is input again based on the selection of the authenticated user. Meanwhile, when the user's authentication information is input through the outside of the vehicle while the vehicle is unlocked, the controller 410 may switch the vehicle state to the locked state based on this. In addition, when the same authentication information is input once again while the vehicle is switched to the locked state, the vehicle may be switched to the unlocked state again.

The controller 410 may allow a touch screen to be formed on a part of the vehicle to receive such user authentication information. The controller 410 may receive user's fingerprint information or pattern information through the formed touch screen, or may receive a preset password. To this end, the controller 410 may perform a pattern recognition process capable of recognizing handwriting input or drawing input performed on the touch screen as characters and images, respectively. Further, the controller 410 may control any one or a combination of a plurality of components described above in order to implement various embodiments described below on the vehicle control apparatus 400 according to the present invention.

Also, the controller 410 may display various image information on a touch screen formed on a part of the vehicle. For example, the control unit 410 may display a fingerprint input area for user authentication or graphic objects for pattern input on the touch screen, and display the user's authentication result or information related to the currently authenticated user. You can do it.

In addition, in the case of an authenticated user, the controller 410 may change the setting state of the vehicle using user-related information corresponding to the user. For example, the control unit 410 may control the first driving unit 421 to adjust the height of the seat of the driver's seat or the angle of the backrest based on the authenticated user's information, and may adjust the temperature or humidity inside the vehicle. have. Alternatively, the controller 410 may adjust the degree of opening of the driver's seat and the passenger's seat window, the angle of the side mirror, etc., based on the information corresponding to the authenticated user, or the height of the handle.

In addition, the control unit 410 may change various operation modes of the vehicle according to the authenticated user. For example, the control unit 410 changes the operation mode of the power steering device of the steering wheel to change the operation mode of the authenticated user to one operation mode (for example, a normal mode or a sports mode). May be selected. Alternatively, the control unit 110 may set the gear shifting method to one of a manual shifting method or an automatic shifting method that the user prefers.

In addition, the controller 410 may perform not only such physical setting change but also software setting change. For example, when an authenticated user boards a vehicle, the controller 410 may automatically select music preferred by the user or a music list currently listened to by the authenticated user. Alternatively, the control unit 410 may automatically select a channel of a radio station that the currently authenticated user mainly listens to.

In addition, the controller 410 may change various vehicle settings based on the time when the authenticated user boards the vehicle. For example, the control unit 410 may analyze a destination that the user mainly heads to at the time based on the authenticated time and the authenticated user's driving record when the authenticated user boards the vehicle. That is, if the user mainly has a driving habit of going home from work between 8 pm and 9 pm, the control unit 410 is based on the driving record of the user, between 8 pm and 9 pm. When the user boards the vehicle, the destination may be automatically set to "home" and the corresponding route may be displayed on the display unit of the already equipped navigation system.

As described above, the control unit 410 of the vehicle control apparatus 400 according to the exemplary embodiment of the present invention enables the user to control the vehicle using authentication information, so that the user can board the vehicle and use the vehicle more easily and conveniently. In addition, the control unit 410 of the vehicle control device 400 according to an embodiment of the present invention, when a user is authenticated, adjusts various environment settings of the vehicle based on the authenticated user, so that the user's preferred driving environment is automatically adjusted. So that it can be provided.

In addition, not only when the user is not in the vehicle, but also when the user is in the vehicle, the control unit 410 makes it easy to change the physical setting of the vehicle or change the software setting based on the user's selection. May be. For example, the control unit 410 changes at least one physical setting based on a plurality of taps (Tabs) applied to the interior of the vehicle, for example, a console box, a gear box, or a window of a driver's seat or an assistant seat. Alternatively, you can change the settings in software. As an example, when a user applies a plurality of tabs to a steering wheel portion of a vehicle, the controller 410 may recognize this and adjust the height of the steering wheel or change an operation mode of the power steering device to another mode.

Meanwhile, the controller 410 may change the physical or software setting state based on a user's gesture as well as the plurality of taps. For example, the controller 410 may detect a movement of a driver or assistant in the vehicle using a camera, a photo sensor, a laser sensor, or an infrared sensor provided in the vehicle. In addition, a specific function may be performed or a currently set state may be adjusted based on the movement of the driver or assistant. For example, if an occupant seated in the passenger seat makes a gesture of lowering his hand from the top to the bottom near the passenger seat window, the degree of opening of the passenger seat window may be adjusted based on the gesture of the occupant. Alternatively, when a specific gesture (for example, a gesture of flicking a finger or clapping) is detected based on a gesture of a driver's seat or a passenger, the control unit 410 may play preset specific music data.

Meanwhile, at least some of the respective components may operate in cooperation with each other to implement the operation, control, or control method of the vehicle control apparatus 400 according to various embodiments described below. In addition, the operation, control, or control method of the vehicle control device 400 may be implemented on the vehicle control device 400 by driving at least one application program stored in the memory 440.

Hereinafter, before looking at various embodiments implemented through the vehicle control apparatus 400 described above, the above-listed components will be described in more detail with reference to FIG. 6A.

The sensing unit 430 senses at least one of information in the vehicle control device, surrounding environment information surrounding the vehicle control device, and user information, and generates a sensing signal corresponding thereto. The controller 410 may control the driving or operation of the vehicle control device 400 or perform data processing, functions, or operations related to an application program installed in the vehicle control device 400 based on such a sensing signal. Representative sensors among various sensors that may be included in the sensing unit 430 will be described in more detail.

First, the proximity sensor 432 refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object existing in the vicinity by using the force of an electromagnetic field or infrared rays without mechanical contact. The proximity sensor 432 may be disposed in each area inside or outside the vehicle or near the touch screen.

Examples of the proximity sensor 432 include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive type proximity sensor, a magnetic type proximity sensor, an infrared proximity sensor, and the like. When the touch screen is a capacitive type, the proximity sensor 432 may be configured to detect the proximity of the object by a change in the electric field according to the proximity of the conductive object. In this case, the touch screen (or touch sensor) itself may be classified as a proximity sensor.

On the other hand, for convenience of explanation, the action of allowing an object to be recognized as being positioned on the touch screen without contacting an object on the touch screen is referred to as "proximity touch", and the touch The act of actually touching an object on the screen is referred to as "contact touch". A position at which an object is touched in proximity on the touch screen means a position at which the object is vertically corresponding to the touch screen when the object is touched in proximity. The proximity sensor 432 may detect a proximity touch and a proximity touch pattern (for example, a proximity touch distance, a proximity touch direction, a proximity touch speed, a proximity touch time, a proximity touch position, a proximity touch movement state, etc.). have. Meanwhile, as above, the control unit 410 processes data (or information) corresponding to the proximity touch operation and the proximity touch pattern sensed through the proximity sensor 432, and further, provides visual information corresponding to the processed data. It can be output on the touch screen. Further, the controller 410 may control the vehicle control device 400 to process different operations or data (or information) according to whether the touch to the same point on the touch screen is a proximity touch or a touch touch. have.

The touch sensor detects a touch (or touch input) applied to the touch screen (or the display unit 451) by using at least one of various touch methods such as a resistive film method, a capacitive method, an infrared method, an ultrasonic method, and a magnetic field method. do.

As an example, the touch sensor may be configured to convert a change in pressure applied to a specific portion of the touch screen or a capacitance generated in a specific portion into an electrical input signal. The touch sensor may be configured to detect a location, area, pressure when touched, capacitance when touched, etc. of a touch object applied to the touch screen on the touch sensor. Here, the touch object is an object that applies a touch to the touch sensor, and may be, for example, a finger, a touch pen, a stylus pen, or a pointer.

In this way, when there is a touch input to the touch sensor, the signal(s) corresponding thereto is transmitted to the touch controller. The touch controller processes the signal(s) and then transmits the corresponding data to the controller 410. As a result, the control unit 110 can know which area of the display unit 451 has been touched. Here, the touch controller may be a separate component from the controller 410 or may be the controller 410 itself.

Meanwhile, the controller 410 may perform different controls or perform the same control according to the type of the touch object by touching the touch screen (or a touch key provided in addition to the touch screen). Whether to perform different controls or the same control according to the type of the touch object may be determined according to the current operating state of the vehicle control device 400 or an application program being executed.

Meanwhile, the touch sensor and the proximity sensor described above are independently or in combination, and a short (or tap) touch, a long touch, a multi touch, and a drag touch on the touch screen. ), flick touch, pinch-in touch, pinch-out touch, swipe touch, hovering touch, etc. You can sense the touch.

The ultrasonic sensor may recognize location information of a sensing target by using ultrasonic waves. Meanwhile, the control unit 410 may calculate the location of the wave generating source through information sensed from the optical sensor and the plurality of ultrasonic sensors. The location of the wave generator may be calculated by using a property that the light is much faster than the ultrasonic wave, that is, the time that the light reaches the optical sensor is much faster than the time that the ultrasonic wave reaches the ultrasonic sensor. More specifically, the position of the wave generator may be calculated using a time difference between a time when the ultrasonic wave arrives using light as a reference signal.

Meanwhile, the sensing unit 430 may include at least one of a camera sensor (eg, CCD, CMOS, etc.), a photo sensor (or image sensor), and a laser sensor to recognize a user's gesture.

The camera 421 and the laser sensor are combined with each other to detect a touch of a sensing target. The photosensor may be stacked on the display device, and the photosensor is configured to scan a motion of a sensing object close to the touch screen. More specifically, the photo sensor scans the contents placed on the photo sensor by mounting a photo diode and a transistor (TR) in a row/column and using an electrical signal that changes according to the amount of light applied to the photo diode. That is, the photosensor calculates the coordinates of the sensing object according to the amount of light change, and through this, position information of the sensing object may be obtained.

As described above, the display unit 451 may display various image information related to the user's input of authentication information. For example, the display unit 451 may display a graphic object displaying an area for receiving a user's fingerprint or a graphic object for receiving pattern information in a partial area of a vehicle on which a touch screen is formed. Alternatively, when user authentication is completed, the display unit 451 may display a user authentication result and information related to a currently authenticated user. Such image information may be displayed on at least a part of the windshield glass of the vehicle or the window of the driver's seat or the passenger seat, and thus, the window of the vehicle or the windshield glass provided with the vehicle control device 400 according to an embodiment of the present invention. At least some of the electrodes may be designed to detect a user's touch input.

In addition, the display unit 451 may be formed not only on the outer surface of the windshield glass and the window, but also on the inner surface. In addition, the display unit 451 formed on the inner surface may display (output) information processed by the vehicle control apparatus 400. For example, the screen information displayed on the display unit 451 formed on the inner surface is information on the execution screen of an application program driven by the vehicle control device 400, or a UI (User Interface) according to the execution screen information. , May be GUI (Graphic User Interface) information.

In addition, the display unit 451 may be implemented by being included in the sensing unit 130. In this case, the display unit 451 may display a detection result of the detection unit 430, a matching result of user authentication information, or a part of the user's unique authentication information (for example, a user's name, etc.). .

The sound output unit 452 may output audio data stored in the memory 440. The sound output unit 152 also outputs an sound signal related to a function (eg, a user authentication confirmation sound, a user authentication guide sound, etc.) performed by the vehicle control device 400. The sound output unit 452 may include a speaker, a buzzer, and the like.

Meanwhile, the output unit 450 of the vehicle control device 400 according to the exemplary embodiment disclosed in the present specification may include a haptic module 453. The haptic module 453 generates various tactile effects that a user can feel. A typical example of the tactile effect generated by the haptic module 453 may be vibration. When a user's touch input is sensed on a touch screen implemented in an external frame, an internal frame, or a glass-shaped window of the vehicle, the controller 410 may output tactile information using the haptic module 453. Accordingly, the user may check whether the authentication information inputted by the user is correctly input using the tactile information.

The intensity and pattern of the vibration generated by the haptic module 453 may be controlled by a user's selection or setting of a controller. For example, the haptic module 453 may synthesize and output different vibrations or sequentially output them.

In addition to vibration, the haptic module 453 is used for stimuli such as an arrangement of pins vertically moving with respect to the contact skin surface, blowing force or suction force of air through the injection or inlet, grazing against the skin surface, contact of electrodes, and electrostatic force. It can generate various tactile effects, such as the effect by the effect and the effect by reproducing the feeling of cooling and warming using an endothermic or heat generating element.

The haptic module 453 may not only deliver a tactile effect through direct contact, but may also be implemented so that a user can feel the tactile effect through muscle sensations such as a finger or an arm. Two or more haptic modules 453 may be provided depending on the configuration aspect of the vehicle control device 400.

Meanwhile, hereinafter, various embodiments may be implemented in a recording medium that can be read by a computer or a similar device using, for example, software, hardware, or a combination thereof.

Meanwhile, the sensing unit 430 of the vehicle control apparatus 400 according to the exemplary embodiment disclosed in the present specification includes a main body mounted on the body to contact a part of the user's body, and a tab through which the user taps the main body. Alternatively, a tap detection unit 433 for detecting a tap gesture may be further provided. Here, the tap detected by the tap detection unit 433 of the vehicle control device 400 is a means for inputting user's authentication information, or controls various functions of the vehicle control device 400 when the user boards the vehicle. It can be used as a means to do. In addition, such a tap may be understood as an operation of lightly tapping the main body of the vehicle control apparatus 400 or an object with a tap object such as a finger, or an operation of lightly touching the main body or an object of the vehicle control apparatus 400 with the tab object. Here, the body of the sensing unit 430 may be formed on a body of a vehicle including an outer frame and an inner frame of the vehicle, and a window or windshield glass.

Meanwhile, the tap object to which such a tap is applied may be a body of the vehicle control device 400 or an object capable of applying an external force to an object, for example, a finger, a stylus pen, a pen, or a pointer. , Fists, etc. On the other hand, the tap object is not necessarily limited to an object that can apply a touch input to the vehicle control device 400 according to the present invention, and as long as it is an object that can apply an external force to the body of the vehicle control device 400 or an object, The kind is irrelevant.

Meanwhile, the object to which the tap gesture is applied may include at least one of a main body of the vehicle control device 400 and an object placed on the vehicle control device 400.

Meanwhile, the tap or tap gesture may be detected by at least one of an acceleration sensor and a touch sensor included in the tap detection unit 433. Here, the acceleration sensor is a sensor capable of measuring dynamic forces such as acceleration, vibration, and impact of the vehicle control device 400 body.

That is, the acceleration sensor may detect vibration (or movement) of the main body of the vehicle control apparatus 400 generated by a tap gesture, and detect whether a tap is applied to an object. Therefore, the acceleration sensor is positioned close to the main body of the vehicle control apparatus 400 so as to detect a tap on the main body of the vehicle control apparatus 400 or detect whether movement or vibration has occurred in the main body of the vehicle control apparatus 400. It can detect that an object is tapped.

In this way, the acceleration sensor is applied to a point outside the main body as long as it is possible to detect motion or vibration in the main body of the vehicle control device 400, as long as the tab is applied to the main body of the vehicle control device 400. Even if it is, the tap can be detected.

In the vehicle control apparatus 100 according to the present invention, in order to detect a tap on the vehicle control apparatus 400 body, only one of an acceleration sensor and a touch sensor is used, an acceleration sensor and a touch sensor are sequentially used, or Alternatively, an acceleration sensor and a touch sensor can be used at the same time. On the other hand, in order to detect a tap, a mode using only the acceleration sensor may be called a first mode, and a mode using a touch sensor may be called a second mode, and both the acceleration sensor and the touch sensor are used (simultaneously or sequentially). Possible) mode may be referred to as a third mode or a hybrid mode.

Meanwhile, when a tap is sensed through a touch sensor, it may be possible to more accurately identify a position at which the tap is sensed.

Meanwhile, in the vehicle control device 400 according to an embodiment, in order to detect the tap through an acceleration sensor or a touch sensor, the display unit 451 of the vehicle control device 400 is You can operate in a specific mode where it is consumed. This specific mode may be referred to as "doze mode".

For example, in the doze mode, in a touch screen structure in which a touch sensor and a display unit 451 form a mutual layer structure, a light emitting device for outputting a screen from the display unit 451 is turned off, and the touch The sensor may be in a state that maintains an on state. Alternatively, the dose mode may be a mode in which the display unit 451 is turned off and the acceleration sensor is kept on. Alternatively, the dose mode may be a mode in which the display unit 451 is turned off and both the touch sensor and the acceleration sensor are kept on.

Accordingly, in the doze mode state, that is, in a state in which the display unit 451 is turned off (the display unit 451 is inactive), the user at least one point on the touch screen formed on a part of the vehicle or the vehicle control device ( 400) When the tap is applied to a specific point of the body, it may be sensed that the tap has been applied by the user through at least one of an on touch sensor or an acceleration sensor.

In addition, the control unit 410, in order to distinguish between a tap as a means for inputting user's authentication information or a tap as a means for controlling the function of the vehicle control device 400 and a simple collision of an external object, It is determined that a "tap" for the purpose of inputting user's authentication information or controlling the vehicle control device 400 is detected only when at least two taps are applied to the touch screen formed on a part of the vehicle within the reference time. can do. For example, when it is determined that a single tap has been applied to a touch screen formed on a part of the vehicle as a result of detection by the tap detection unit 433, the control unit 410 inputs the authentication information of the user through the single tap. It is not intended to be received, but may be recognized as a collision of an external object or human body.

Therefore, the control unit 410 is a means for inputting user's authentication information only when at least two or more (or multiple) taps continuously applied within the reference time are detected by the tap detection unit 433 or It may be determined that a'tap' as a means for controlling the function of the vehicle control device 400 is detected.

That is, tap gestures may mean that at least two tap gestures are continuously detected within a reference time. Therefore, in the following, when the "tap" is sensed, it may mean that an object such as a user's finger or a touch pen is actually tapped on the main body of the vehicle control apparatus 400 a plurality of times.

Furthermore, the controller 410 may determine whether the tap is detected not only within the reference time, but also whether the tap is detected by different fingers of the user or by one finger. For example, the control unit 410 may include a predetermined area of the vehicle, that is, a partial area of a window or windshield glass of a vehicle, a pillar A, B, C, or a sunroof of a vehicle, or a portion of a vehicle door, or a console inside the vehicle. When the tabs are detected in a box or a gear box, it is possible to detect whether the tabs are formed through one finger or through different fingers, using a fingerprint detected at a portion to which the tabs are applied. Alternatively, the control unit 410 recognizes the position at which the taps are sensed on the display unit 451 through at least one of a touch sensor or an acceleration sensor provided in the tap detection unit 433 or an acceleration generated by the taps, It is possible to detect whether the taps are made through one finger or each other.

Furthermore, the control unit 410 further considers the angle and distance to which the tap was applied, or the direction in which the fingerprint was recognized, and whether the user inputs the taps through one hand or one finger, or through both hands or at least two fingers. It is possible to determine whether it has been entered or not.

Meanwhile, the taps may mean tapping a plurality of times continuously detected within a reference time. Here, the reference time may be a very short time, for example, it may be within 300 ms to 2 s.

To this end, when the tap detection unit 433 detects that the main body of the vehicle control device 400 is first tapped, the tap detection unit 433 is the next time after the first tapping within a reference time from the time when the first tapping is detected. You can detect whether there is a tapping. And when the next tapping is detected within the reference time, the tap detection unit 433 or the control unit 410 performs input of user authentication information or a specific function of the vehicle control device 400 according to an embodiment of the present invention. It may be determined that a tap for controlling is detected. As described above, the control unit 410 recognizes as a "valid tap" only when the second tap is detected within a predetermined time after the first tap is detected, so that the user can input authentication information or the vehicle control device 400 It is possible to discriminate whether a tap is applied to control or if a user's mistake or an unintended object collides outside or inside the vehicle.

There may be several ways to make the "valid tab" recognized. For example, the control unit 410 detects a first tap tapping a first reference number or more than a first reference number, and then tapping the body by a second reference number or more than a second reference number within a predetermined time. This detection may be recognized as the'valid tap'. Here, the number of the first reference number and the second reference number may be the same or different from each other. For example, the first reference number of times may be one, and the second reference number of times may be two. As another example, both the first reference number and the second reference number may be once.

Also, the controller 410 may determine that the "taps" have been detected only when the tap is applied within the "prescribed area". That is, when it is detected that the main body of the vehicle control device 400 is first tapped, the controller 410 may calculate a predetermined area from the point where the first tapping is detected. And the control unit 410 taps the first or second reference number of times, or more than the first or second reference number of times following the first tapping on the "prescribed area" within the reference time from the time when the first tapping is detected. When this is detected, it may be determined that the first tap or the second tap has been applied.

Meanwhile, it goes without saying that the above-described reference time and predetermined area may be variously modified according to exemplary embodiments.

On the other hand, it goes without saying that the first tap and the second tap may be detected as separate taps according to a position at which each tap is sensed, as well as a reference time and a predetermined region. That is, when the second tap is detected at a position spaced apart from the position where the first tap is sensed by a predetermined distance or more, the controller 410 may determine that the first tap and the second tap are applied. In addition, when the first and second tabs are recognized based on the sensed positions, the first and second tabs may be simultaneously sensed.

In addition, when the first tab and the second tab are composed of a plurality of touches, that is, a plurality of taps, a plurality of touches constituting each of the first and second tabs may also be sensed simultaneously. For example, at the same time that the first touch constituting the first tab is sensed, the first touch constituting the second tab is at a position spaced apart by a predetermined distance or more from the position where the first touch of the first tab is sensed. When detected, the controller 110 may detect the first touch constituting the first and second tabs, respectively. Further, the controller 410 detects an additional touch input sensed at each location, and when a touch greater than or equal to the first reference number or the second reference number is sensed at each location, it is determined that the first tap and the second tap have been applied. can do.

On the other hand, when a tap on the main body of the vehicle control device 400 is detected multiple times by the tap detection unit 133, the controller 410 not only authenticates the user but also authenticates the vehicle control device ( At least one of the functions executable in 400) may be controlled. Here, the functions executable on the vehicle control apparatus 400 may mean all types of functions that can be executed or driven by the vehicle control apparatus 400. Here, one of the executable functions may be an application installed in the vehicle control device 400. And "an arbitrary function is executed" may mean that "an arbitrary application program is executed or driven in the vehicle control device 400". For example, the controller 410 may play a music file based on a plurality of taps of a user detected in a console box or control a navigation so that a route to a preset destination is automatically set.

As another example, a function executable in the vehicle control device 400 may be a function required for basic driving of the vehicle control device 400. For example, a function necessary for basic driving may be a function of turning on/off an air conditioner or a hot air fan provided in the vehicle, starting the vehicle, switching the vehicle from the locked state to the unlocked state, or vice versa. There may be a function of switching from a state to a locked state. Alternatively, the cruise control function of the vehicle may be turned on or off.

Meanwhile, the control unit 410 may form a location at which the user's authentication information is input based on a location on the body or a touch screen where the user's tap is sensed. For example, the control unit 410 forms an area for receiving pattern information, or an area for receiving user's biometric information, i.e., a fingerprint, etc., based on the point where the user's tap is first applied. You can do it. In this case, even if the user applies a tap to a different point on the main body or the touch screen every time, the point at which the user's pattern information or biometric authentication information is input may be changed each time. Accordingly, the user can minimize the exposure of authentication information, and thus can be more secure from threats such as theft of a vehicle.

In addition, it goes without saying that such user authentication information may be input to the vehicle control apparatus 400 through a preset external device based on a user's selection. That is, for example, the sensing unit 430 may be connected to a preset external device outside the vehicle using the short-range communication module 431, and the authentication information of the user input through such an external device is the short-range communication module ( It is applied to the sensing unit 430 through 431 and may be authenticated by the control unit 410.

The vehicle control device 400 may obtain vehicle information from a vehicle.

According to an embodiment, the vehicle information may be obtained through the above-described sensing unit 430.

According to another embodiment, the vehicle control device 400 may separately include a vehicle information acquisition unit 460 that acquires the vehicle information.

Here, the vehicle information includes: an air conditioning function for the vehicle, whether a door (including a bonnet, a trunk and a gasoline) is opened or closed, a window is opened, a sunroof is opened, a battery charging state of the vehicle, and the vehicle is It may be information related to at least one of a parking position, a navigation function provided in the vehicle, a stolen state of the vehicle, and a fueling state of the vehicle.

In addition, the vehicle information may further include information related to at least one of a driving speed of the vehicle, a driving acceleration, a driving distance to the present, a number of sudden accelerations, and a number of sudden braking.

To this end, the vehicle information acquisition unit 460 may perform communication with various sensors provided in the vehicle.

For example, the vehicle information acquisition unit 460 may collect acceleration information on the vehicle by performing communication with an acceleration sensor installed in the vehicle and measuring acceleration of the vehicle.

In addition, for example, the vehicle information acquisition unit 460 may perform communication with a black box provided in the vehicle to obtain an accident image when a vehicle accident occurs. In this case, the memory 440 may store the accident image.

6B illustrates an example in which a preset external device is connected to the vehicle control device according to an embodiment of the present invention.

Referring to FIG. 6B, the preset external device 170 may be a mobile terminal such as a user's smart phone 171 or a smart key 172. In this case, the controller 110 may recognize the unique information of the external device 170 and automatically recognize a specific user when the external device 170 approaches within a certain distance. In addition, the control unit 410 may receive authentication information input by the user through the external device 170, and the authentication information input from the external device 170 includes a communication module provided in the external device 170, It may be transmitted to the vehicle control device 400 through the short-range communication module 431 of the sensing unit 430.

Meanwhile, such authentication information may be biometric information of the user.

According to an embodiment, the biometric information may be obtained by the mobile terminal 100 or the wearable device 200 or 200 ′.

Here, the biometric information may be at least one of information about the user's heart rate, body fat, blood pressure, blood sugar, face shape, fingerprint, brain waves, and iris.

For example, the authentication information may be a user's heart rate, fingerprint or iris recognition information, or preset password or pattern information. Also, such authentication information may be information related to a gesture of a specific user.

Authentication of the user may be performed based on a plurality of biometric information or a plurality of authentication information.

For example, authentication for the user may be performed by confirming both the user's heart rate and the user's gesture.

To this end, the external device 170 is configured to receive authentication information from a user, that is, at least some of the sensors provided in the sensing unit 430 of the vehicle control device 400 according to an embodiment or other additional It may further include the same, similar or corresponding configuration to the typical sensors.

For example, in the external device 170 such as the smart key 172 or the smart phone 171, a touch screen through which a user can input pattern information or the sensing unit 430 of the vehicle control device 400 The same, similar, or corresponding to the tap detection unit 433 may be provided. Further, the external device 170 may further include a fingerprint recognition unit for recognizing a user's fingerprint. In addition, it goes without saying that the external device 170 may further include an inertial sensor, a gyro sensor, or an acceleration sensor for recognizing a user's gesture.

In addition, for example, in the case of the smart watch 173 as a watch-type mobile terminal, a sensor capable of acquiring the user's heart rate may be included. In the case of the smart glasses 174 as a glasses-type mobile terminal, the user It may include an iris recognition camera to recognize the iris of.

In this case, the user may input his/her authentication information through the external device 170 by using at least one of a fingerprint, preset pattern information, and iris recognition information. Alternatively, the user may make his/her authentication information input to the external device 170 by making a specific gesture while wearing the external device 170. In this case, the control unit 110 of the external device 170 uses information on the position change of the external device 170 according to the user's gesture, that is, a measurement value of acceleration, a change in gravity, or a change in inertia. Thus, the user's gesture can be recognized and used as authentication information. Alternatively, the external device 170 may recognize that the location has changed using the user's image input through a camera or the like, and measure the changed value.

Meanwhile, when authentication information is input through the external device 170 as described above, the control unit 410 of the vehicle control device 400 may control the driving of the vehicle using the input authentication information. For example, the control unit 410 may recognize a current user according to the authentication information, unlock a vehicle, and set a vehicle interior environment corresponding to the recognized user. Alternatively, the controller 410 may convert the unlocked state of the vehicle into a locked state when the current vehicle state is an unlocked state, and the authentication information is once again input when the ignition is terminated.

Meanwhile, as described above, the driving of the vehicle may be directly controlled using the user's authentication information input through the external device 170, but the controller 410 may further request the user to perform one more authentication process. In this case, when the external device 170 approaches within a certain distance or when authentication information is input through the external device 170, the control unit 410 switches the vehicle state to a wake-up state, and , Preparation to drive the vehicle may be performed according to authentication information input from the authenticated user. And when the user enters the authentication information once again in a preset area outside or inside the vehicle (for example, the window of the driver's seat or the assistant seat, or the A, B, C pillar, etc.) in the wake-up state, this The user can be authenticated by receiving input, and the vehicle can be driven accordingly.

In addition, in the above description, it has been described as an example that only one more authentication procedure is performed, but it goes without saying that any number of more authentication procedures may be performed. In addition, in the above description, it has been described that a plurality of authentication procedures are performed when user authentication information is input through the external device 170, but such a plurality of authentication procedures are performed by the user directly in a touch screen area formed on a part of the vehicle. Of course, the same can be applied to the case of entering your own authentication information.

7 is an exemplary view illustrating a display unit of a vehicle control apparatus according to an exemplary embodiment disclosed in the present specification.

7 shows a case in which the vehicle control device 400 is implemented in the form of a head unit of a vehicle.

The vehicle control device 400 may include a plurality of display units D100 to D102.

For example, as shown in FIG. 7, the vehicle control device 400 may include a first display unit D100 in front of the driver's seat and two second display units D101 and D102 in front of each rear seat. I can.

In this case, generally, only the first display unit D100 is restricted by the driving regulation.

Accordingly, only the first display unit D100 is limited by the vehicle content display method, and the second display units D101 and D102 may display the entire content without the limitation.

8A is a block diagram showing the configuration of a vehicle control apparatus according to another embodiment disclosed in the present specification.

FIG. 8A shows a case where the vehicle control device 400 is implemented in the form of an image display device, a vehicle head unit, or a telematics terminal.

As shown in Fig. 8A, the vehicle control device 400 ′ includes a control unit (eg, a central processing unit, CPU) 412 ′ that controls the overall operation of the vehicle control device 400 ′, and a control unit 412 A memory 413' for storing programs for processing and controlling') and input/output data, a key control unit 411' for controlling various key signals, and an LCD control unit for controlling a liquid crystal display (LCD) It includes a main board 410' with a built-in 414'.

The memory 413' may store map information (map data) for displaying road guidance information on a digital map. In addition, the memory 413 ′ may store a traffic information collection control algorithm that enables the vehicle to input traffic information according to a current road condition and information for controlling the algorithm.

The main board 410 ′ is assigned a unique device number and a code division multiple access (CDMA) module 406 ′ built into the vehicle, a GPS signal for guiding the location of the vehicle, and tracking the driving route from the departure point to the destination. GPS module 207 for receiving signals or transmitting traffic information collected by a user as a Global Positioning System (GPS) signal, and a CD Deck 408' for reproducing signals recorded on a compact disk (CD) , May include a gyro sensor 409'. The CDMA module 406 ′ and the GPS module 407 ′ may transmit and receive signals through antennas 404 ′ and 405 ′.

In addition, the broadcast reception module 422 ′ may be connected to the main board 410 ′ and may receive a broadcast signal through an antenna 423 ′. The main board 410 ′ includes a display unit (LCD) 401 ′ controlled by the LCD control unit 414 ′ through an interface board 430 ′ and a front board controlled by a key control unit 411 ′. 402') and a camera 427' that photographs the inside and/or outside of the vehicle may be connected. The display unit 401 ′ displays various video signals and character signals, and the front board 402 ′ includes buttons for inputting various key signals, and provides a key signal corresponding to a button selected by a user on a main board. Provided to (410'). In addition, the display unit 401' includes a proximity sensor and a touch sensor (touch screen).

The front board 402 ′ includes a menu key for directly inputting traffic information, and the menu key may be configured to be controlled by a key controller 411 ′.

The audio board 417' is connected to the main board 410' and processes various audio signals. The audio board 417' includes a microcomputer 419' for controlling the audio board 417', a tuner 418' for receiving radio signals, and a power supply for supplying power to the microcomputer 419'. 416') and a signal processing unit 415' that processes various audio signals.

In addition, the audio board 417' includes a radio antenna 420' for receiving a radio signal and a tape deck 421' for reproducing an audio tape. The audio board 417 ′ may further include an audio output unit (eg, an amplifier) 426 ′ for outputting an audio signal processed by the audio board 417 ′.

The audio output unit (amplifier) 426' is connected to a vehicle interface 424'. That is, the audio board 417' and the main board 410' are connected to the vehicle interface 424'. The vehicle interface 424' may be connected to a hands-free 425a' for inputting a voice signal, an airbag 425b' for occupant safety, a speed sensor 425c' for detecting a vehicle speed, and the like. The speed sensor 425c' calculates a vehicle speed, and provides the calculated vehicle speed information to the central processing unit 412'.

* The navigation session 400_1' applied to the vehicle control device 400' generates road guide information based on map data and current vehicle location information, and notifies the user of the generated road guide information.

The display unit 401' detects a proximity touch in a display window through a proximity sensor. For example, the display unit 401' detects the position of the proximity touch when a pointer (for example, a finger or a stylus pen) is touched, and stores position information corresponding to the detected position. Output to the control unit 412'.

The voice recognition device (or voice recognition module) 401_1' recognizes a voice uttered by a user and performs a corresponding function according to the recognized voice signal.

A navigation session 400_1 ′ applied to the vehicle control device 400 ′ displays a driving route on map data, and the location of the mobile terminal 100 is preset from a blind spot included in the driving route. When within a set distance, a wireless network is automatically established with a terminal mounted on a nearby vehicle (for example, a vehicle navigation device) and/or a mobile terminal carried by a nearby pedestrian through wireless communication (for example, a short-range wireless communication network). By forming, location information of the surrounding vehicle is received from a terminal mounted on the surrounding vehicle, and location information of the surrounding pedestrian is received from a mobile terminal carried by the surrounding pedestrian.

Meanwhile, the main board 410' may be connected to the interface unit 430', and the interface unit 430' includes an external device interface unit 431' and a network interface unit 432'.

The external device interface unit 431 ′ may connect the external device and the vehicle control device 400 ′. To this end, the external device interface unit 431 ′ may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 431 ′ may be connected to an external device such as a digital versatile disk (DVD), a Blu ray, a game device, a camera, a camcorder, a computer (laptop), and the like by wire/wireless. The external device interface unit 231 transmits a video, audio, or data signal input from the outside through a connected external device to the control unit 412 ′ of the vehicle control device 400 ′. Also, an image, audio, or data signal processed by the controller 412' may be output to a connected external device. To this end, the external device interface unit 431 ′ may include an A/V input/output unit (not shown) or a wireless communication unit (not shown).

The A/V input/output unit includes a USB terminal, a CVBS (Composite Video Banking Sync) terminal, a component terminal, an S-video terminal (analog), so that video and audio signals from an external device can be input to the vehicle control device 400'. A Digital Visual Interface (DVI) terminal, a High Definition Multimedia Interface (HDMI) terminal, an RGB terminal, a D-SUB terminal, and the like may be included.

The wireless communication unit may perform short-range wireless communication with another electronic device. The vehicle control device 400 ′ includes, for example, Bluetooth, Radio Frequency Identification (RFID), infrared data association (IrDA), Ultra Wideband (UWB), ZigBee, Digital Living Network (DLNA). Alliance) and other electronic devices may be connected to the network according to communication standards.

In addition, the external device interface unit 431 ′ may be connected through at least one of various set-top boxes and various terminals to perform input/output operations with the set-top box.

Meanwhile, the external device interface unit 431 ′ may receive an application or an application list in an adjacent external device and transmit it to the controller 412 ′ or the memory 413 ′.

The network interface unit 432' provides an interface for connecting the vehicle control device 400' with a wired/wireless network including an Internet network. The network interface unit 432 ′ may be provided with, for example, an Ethernet terminal for connection with a wired network, and for connection with a wireless network, for example, a WLAN (Wireless LAN) (Wi -Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access) communication standards, etc. may be used.

The network interface unit 432 ′ may transmit or receive data with other users or other electronic devices through a connected network or another network linked to the connected network. Particularly, some content data stored in the vehicle control device 400 ′ may be transmitted to another user registered in advance in the vehicle control device 400 ′ or a selected user or a selected electronic device among other electronic devices.

Meanwhile, the network interface unit 432' may access a predetermined web page through a connected network or another network linked to the connected network. That is, by accessing a predetermined web page through a network, the server and data can be transmitted or received. In addition, content or data provided by a content provider or a network operator may be received. That is, content such as movies, advertisements, games, VODs, broadcast signals, and related information provided from a content provider or a network provider may be received through a network. In addition, it is possible to receive update information and an update file of the firmware provided by the network operator. It can also transmit data to the Internet or content provider or network operator.

In addition, the network interface unit 432 ′ may select and receive a desired application from among applications open to the public through a network.

8B is a block diagram showing the configuration of a vehicle control apparatus according to another embodiment disclosed in the present specification.

8B is a block diagram showing the vehicle control device 400 with an emphasis on functions of the vehicle navigation device.

When the vehicle control device 400 ″ is implemented as a vehicle navigation device, the vehicle control device 400 ″ is an In Dash Type and an OnDash Type according to an installation type in the vehicle. ). The in-dash type navigation (vehicle navigation) device is a type that is fixedly mounted by being inserted into a certain space allocated in a dash board of a vehicle. The on-desi type navigation (vehicle navigation) device is mounted on the dashboard of the vehicle or is installed near the dashboard using a certain support, and can be detached from the vehicle and carried.

The vehicle control device 400 ″ according to the present embodiments includes such an in-dash type and an on-dash type navigation (vehicle navigation) device, and in addition, a navigation message transmitted from a GPS (Global Positioning System) satellite in the vehicle. It includes all information processing devices capable of receiving and/or processing traffic information, such as various portable terminals capable of performing a navigation function in conjunction with a GPS receiver that receives a signal.

As shown in Fig. 8B, the vehicle control device 400 ″ receives a global positioning system (GPS) signal received from a satellite, and a navigation device (mobile communication terminal 100) based on the received GPS signal. ), the GPS module 401'' that generates the first vehicle location data of (regarded as the same location as), and the DR (Dead) that generates second vehicle location data based on the driving direction of the vehicle and the speed of the vehicle. -Reckoning) vehicle estimation based on the sensor 402'', a storage unit (or memory) 404'' for storing map data and various information, and the first vehicle location data and the second vehicle location data A location is generated, the generated vehicle estimated location is matched with a link (map matching link or map matching road) in the map data stored in the storage unit 404 ″, and the matched map information (map matching A map matching unit 403'' that outputs a result) and real-time traffic information from the information providing center and/or surrounding vehicles through the wireless communication network 500'', traffic light information, and telephone communication. A communication unit 408 ″ to perform, a control unit 407 ″ for generating road guidance information based on the matched map information (map matching result), and a road guidance map included in the Information) and a display unit 405 ″ for displaying the traffic light information, and a voice for outputting road guidance audio information (road guidance voice message) included in the road guidance information and an audio signal corresponding to the traffic light information It may include an output unit 406 ″.

Here, the communication unit 408 ″ may further include a hands-free having a Bluetooth module, and may receive a broadcast signal including traffic information in TPEG format from a broadcasting station through an antenna. The broadcast signal includes video and audio data according to various standards such as terrestrial or satellite digital multimedia broadcasting (DMB), digital audio broadcasting (DAB), and digital video broadcasting (DVB-T, DVB-H), as well as traffic information (TPEG). It includes additional information such as traffic information and various additional data according to service, BIFS (Binary Format for Scene) data service. In addition, the communication unit 408 ″ synchronizes a signal band provided with traffic information, demodulates the tuned signal, and outputs it to a TPEG decoder (included in the control unit 407).

The TPEG decoder decodes traffic information in the TPEG format and provides various information including traffic light information included in the traffic information to the controller 407 ″.

The road guidance information may include not only map data, but also various information related to driving such as lane information, driving speed limit information, turn-by-turn information, traffic safety information, traffic guidance information, vehicle information, and directions information. .

The signal received through the GPS module 401'' is 802.11, which is a standard standard of a wireless network for a wireless LAN including a wireless LAN and some infrared communication proposed by the Institute of Electrical and Electronics Engineers (IEEE), and Bluetooth. 802.15, which is a standard standard for wireless personal area networks (PANs) including UWB, ZigBee, etc., and wireless metropolitan area network (MAN) (Broadband Wireless Access: BWA) ), and 802.20, which is a standard standard for mobile Internet, for wireless MAN (MBWA: Mobile Broadband Wireless Access) including Wibro and WiMAX, etc. It may be configured to provide location information of the terminal to the vehicle control device 400 ″.

An input unit may be further included in the vehicle control device 400 ″, and the input unit may select a desired function or input information, and various devices such as a keypad, a touch screen, a jog shuttle, and a microphone may be used. .

The map matching unit 403 ″ generates an estimated vehicle location based on the first location data and the second location data, and reads map data corresponding to a driving route from the storage unit 404 ″. do.

The map matching unit 403 ″ matches the estimated vehicle location with a link (road) included in the map data, and sends the matched map information (map matching result) to the control unit 407 ″. ). For example, the map matching unit 403 ″ generates a vehicle estimated position based on the first position data and the second position data, and the generated vehicle estimated position and the storage unit 404 ″ The links in the map data stored in the map data are matched according to the link order, and the matched map information (map matching result) is output to the controller 407 ″. The map matching unit 403 ″ may output road attribute information such as a single-story road or a multi-story road included in the matched map information (map matching result) to the control unit 407 ″. In addition, the function of the map matching unit 403 ″ may be implemented in the control unit 407 ″.

The storage unit 404'' stores map data. At this time, the stored map data includes geographic coordinates (Geographic Coordinates or long-latitude coordinates) indicating latitude and longitude in units of degrees, minutes, and seconds (DMS unit: Degree/Minute/Second). Here, the stored map data may use Universal Transverse Mercator (UTM) coordinates, Universal Polar System (UPS) coordinates, Transverse Mercator (TM) coordinates, etc. in addition to the geographic coordinates.

The storage unit 404'' stores various types of information such as various menu screens, points of interest (POI: Point Of Interest, hereinafter referred to as'POI'), and functional characteristic information according to a specific location of map data.

The storage unit 404 ″ stores various user interfaces (UIs) and/or graphical user interfaces (GUIs).

The storage unit 404'' stores data and programs necessary for the navigation device 400 to operate.

The storage unit 404 ″ stores destination information input from a user through the input unit. In this case, the destination information may be a destination, or any one of a departure point and a destination.

The display unit 405 ″ displays image information (or a road guide map) included in the road guide information generated by the control unit 407. Here, the display unit 405 includes a touch sensor (touch screen) and a proximity sensor. In addition, the road guidance information includes not only map data, but also various information related to driving such as lane information, driving speed limit information, turn-by-turn (TBT) information, traffic safety information, traffic guidance information, vehicle information, and directions information. May be included.

When displaying the image information, the display unit 405'' displays various contents such as various menu screens and directions information by using a user interface and/or a graphic user interface included in the storage unit 404 can do. Here, the content displayed on the display unit 405 ″ includes various text or image data (including map data or various information data) and a menu screen including data such as icons, list menus, and combo boxes.

The audio output unit 406 ″ outputs audio information (or a voice message for the road guidance information) included in the road guidance information generated by the control unit 407. Here, the audio output unit 406 ″ may be an amplifier or speaker.

The control unit 407'' generates road guidance information based on the matched map information, and outputs the generated road guidance information to the display unit 405 ″ and the audio output unit 406 ″. . At this time, the display unit 405 ″ displays the road guide information.

Real-time traffic information is received from the control unit 407 ″, the information providing center and/or a terminal (vehicle navigation device) mounted on a nearby vehicle to generate road guidance information.

The control unit 407 ″ may be connected to a call center through a communication unit 408 ″ to perform a phone call or transmit/receive information between the vehicle control device 400 ″ and the call center. . Here, the communication unit 408 ″ further includes a hands-free module having a Bluetooth function using a short-range wireless communication method.

When the POI search menu is selected by the user, the control unit 407 ″ searches for a POI located on a path from a current location to a destination, and displays the searched POI on the display unit 405 ″. At this time, the control unit 407'' is a POI located on the route (a point where it is not necessary to change (research) a route, for example, a POI located on the left or right of the driving road) and/or the periphery of the route. A POI located at (a point at which a route should be changed, for example, a point at which a preset route should be changed in order to pass through a surrounding POI) is searched, and the retrieved POI is displayed on the display unit 405 ″.

8C is an exemplary view showing a screen related to a navigation function according to an embodiment disclosed in the present specification.

The screen shown in FIG. 8C may be a screen displayed by the mobile terminal 100, the wearable devices 200 and 200 ′, or the vehicle control apparatus 400, 400 ′ and 400 ″.

The mobile terminal 100 is a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a wearable device, etc. When implemented in the form of, only some of the components shown in FIG. 8C may be displayed, or all of the components shown in FIG. 8C may not be displayed.

As shown in FIG. 8C, the display unit that provides a screen related to the navigation function may display an icon I1 indicating the orientation of the map displayed in one area of the screen. The display unit providing a screen related to the navigation function may display a map such that a specific direction (for example, a true north direction of the earth), a moving object's moving direction, a direction in which a destination is located, and the like are fixed and displayed in the upper direction of the screen.

The display unit providing a screen related to the navigation function may display an icon I2 indicating whether or not the sound output module 162 is activated and a volume setting in one area of the screen. The user can activate or deactivate the sound output module 162 or adjust its volume by applying a touch input to the icon I2.

The display unit may display an icon I3 indicating whether or not a route search function using a Transport Portal Experts Group (TPG) is activated on one area of the screen. TPEG (Transport Portal Experts Group) refers to a group originally established by the European Broadcasting Union in 1997 to establish a traffic information protocol, but in a navigation system, it is widely known for its route guidance function using real-time traffic information. have.

The display unit may display an icon I4 indicating a scale of the map data on one area of the screen.

The display unit may display an icon I5 indicating the current time on one area of the screen. In addition, the display unit 161 may display an icon I6 indicating an expected time of reaching a predetermined destination on a region of the screen. In addition, an icon indicating the estimated time required to reach a preset destination may be displayed.

The display unit may display an icon I7 indicating a remaining distance to a preset destination on one area of the screen.

The display unit may display an icon I8 for enlarging the map displayed on an area of the screen or an icon I8 ′ for reducing the map.

The display unit may display an icon I9 indicating the location and the moving direction of the moving object on one area of the screen. The icon I9 may be displayed on the map at a point corresponding to the current location of the moving object. In addition, the moving direction of the moving object may be indicated by the direction of the vertex of the arrow in the icon I9.

The display unit may display an icon I10 indicating a place name of an area in which the moving object is located in one area of the screen.

The display unit may display an icon I11 indicating a lane structure of the roadway when the moving object is a roadway along one area of the screen.

The display unit may display a route required to reach the preset destination (I12, see FIG. 8). The route may not be displayed when the destination of the moving object is not set.

All functions (e.g., navigation functions) performed by the vehicle control devices 400, 400', 400'' described above are mobile terminal 100 connected to the vehicle control device 400 by wire or wirelessly, or Both can be performed by the wearable devices 200 and 200 ′.

Alternatively, the vehicle control device 400, 400 ′, 400 ″ and the mobile terminal 100 may perform all the above functions by interlocking or linking with each other.

To this end, the mobile terminal 100 or the wearable device 200 may include components that are the same as, similar to, or correspond to components included in the vehicle control apparatus 400.

For example, an acceleration sensor included in the mobile terminal 100 or the wearable devices 200 and 200 ′ may serve as an acceleration sensor included in the vehicle control apparatus 400.

According to an embodiment, a VNC (Virtual Network Computing) method may be applied to link or link the vehicle control device 400, 400', 400' and the mobile terminal 100.

VNC (Virtual Network Computing) may refer to a graphic desktop sharing system that remotely controls another computer (or other terminal) using an RFB protocol in a computer environment.

The VNC may provide a method of updating a graphic screen through a network by transmitting a keyboard, mouse, or touch event from one terminal to another terminal.

In addition, all functions performed by the vehicle control device 400, 400', 400'' described above are the vehicle control device 400, 400', 400'' and the mobile terminal 100 or the wearable device. It can be performed by dividing (200, 200').

That is, when a specific function among all functions performed by the above-described vehicle control devices 400, 400', 400' is performed, some of the specific functions are the vehicle control devices 400, 400', 400' '), and the remaining functions may be performed by the mobile terminal 100 or the wearable devices 200 and 200'.

For example, in the case of the air conditioning function for the vehicle, the input of the set temperature for the air conditioner provided in the vehicle is performed by the mobile terminal 100 or the wearable device 200, 200', and the input The role of controlling the air conditioner to a set temperature may be performed by the vehicle control device 400.

It is obvious to those skilled in the art that the technology for the vehicle control apparatus disclosed in the present specification may be embodied in other specific forms without departing from the technical spirit disclosed in the present specification.

Hereinafter, a mobile terminal interworking with a vehicle control apparatus according to an embodiment disclosed in the present specification will be described in detail with reference to FIGS. 9 to 21.

Mobile terminal interlocking with vehicle control device

Hereinafter, a mobile terminal interworking with a vehicle control device will be described in detail according to an exemplary embodiment disclosed in the present specification, but the content overlapping with the above will be replaced therewith, and a detailed description will be omitted.

A mobile terminal according to an embodiment disclosed in the present specification includes a wireless communication unit 110 and a control unit 180.

As shown in FIG. 1, the wireless communication unit 110 included in the mobile terminal 100 is a means for communicating with the vehicle control devices 400, 400', 400', and generally, the mobile terminal 100 It may include at least one module for performing wireless communication with another node included in the network including as one node.

Accordingly, the mobile terminal 100 forms a network with the vehicle control devices 400, 400', 400' using the wireless communication unit 110.

A network formed between the mobile terminal 100 and the vehicle control devices 400, 400', 400'' is irrespective of a connection type of nodes, a connection distance between nodes, a communication protocol used, and the like.

The controller 180 is a means for controlling the overall of the mobile terminal 100, and based on an event occurring in at least one node, the mobile terminal 100 or a vehicle control device according to whether the vehicle is running or whether the user rides the vehicle. (400, 400', 400'') automatically or receives a user input to perform an action corresponding to the event.

A terminal in which an event has occurred, as well as a terminal in which the event has not occurred, interwork with the terminal in which the event has occurred and perform an operation according to the event, thereby facilitating user convenience.

Specifically, the mobile terminal 100 and the vehicle control device 400, 400', 400'' are events that occur in any one of the mobile terminal 100 and the vehicle control device 400, 400', 400'' By sharing with the other, it is possible to execute a new program for the user's convenience or re-execute a program that was not executed in consideration of the user's safety based on whether the vehicle is running or whether the user rides the vehicle.

For example, when a call reception event occurs in the mobile terminal 100 while the vehicle is driving, the mobile terminal 100 rejects the call reception and transmits a response message stating "You cannot respond now" to the call originator. After that, when the vehicle is not running or the user gets out of the vehicle, the mobile terminal 100 notifies the user to send a call to the other party who has rejected the call, thereby inducing the execution of the call originating program from the user. have.

Here, whether the vehicle is running can be determined by the mobile terminal 100 or the vehicle control device 400, 400', 400', and the vehicle's starting on/off state, the vehicle's speed , Whether or not the vehicle location is changed, and the distance between the vehicle control device and the mobile terminal can be determined by any one or a combination thereof, and it is preferable to comprehensively consider a plurality of conditions to determine whether the vehicle is running. Do.

As an example, the vehicle control device 400, 400', 400'' directly senses whether the vehicle is started, the vehicle's moving speed, acceleration, or position is changed to determine whether the vehicle is running, or When the distance difference between 100 and the vehicle control device is 0 or less than a predetermined distance, the mobile terminal 100 determines whether the moving speed, acceleration, or position of the mobile terminal 100 is changed, and determines whether the vehicle is traveling. You can also judge indirectly.

In addition, whether the user boards the vehicle can be determined by the mobile terminal 100 or the vehicle control device 400, 400', 400', and external input of the vehicle control device 400, 400', 400' Receiving or not, whether the door is opened or closed, whether it is detected by a pressure sensor installed in the seat, the vehicle start on/off state, the vehicle speed, whether the vehicle position is changed, and the vehicle control device and It may be determined by any one of the distances between the mobile terminals or a combination thereof, and it is preferable to comprehensively consider a plurality of conditions to determine whether or not the user rides the vehicle.

For example, when a user manipulation is input, the vehicle control device 400, 400', 400'' can determine that the user is currently riding the vehicle, and a pressure sensor installed in the seat detects a pressure above the reference value. Even in one case, it may be determined that the user is currently winning the vehicle, and even when the speed of the vehicle or the location of the vehicle changes, it may be determined that the user is currently riding the vehicle.

An example of the basis for determining whether the vehicle is running or whether the user rides the vehicle may be mentioned as described above, but is not limited thereto and may be determined by other known methods.

In addition, according to an embodiment disclosed herein, an event occurring in the mobile terminal 100 and/or the vehicle control device 400, 400', 400'' is the mobile terminal 100 and/or the vehicle control device ( 400, 400', 400''), so that it is not routine in the standby state, when the external signal received through the external input or communication unit, or the value detected by the sensor is above a certain threshold, etc. It can mean.

Specifically, events occurring in the mobile terminal 100 and/or the vehicle control device 400, 400 ′, 400 ″ according to the exemplary embodiment disclosed in the present specification include a call reception event, a message reception event, a user and a vehicle A vehicle proximity event in which the distance between the vehicle is close within a certain distance, a vehicle ride event when the user boards the vehicle, a vehicle non-driving event when the vehicle is parked or stopped, a vehicle alighting event when the user gets off the vehicle, etc.

Meanwhile, according to an embodiment disclosed in the present specification, the mobile terminal 100 includes an output unit 150 that displays a pop-up window for inducing a user input for executing the call originating program, directions program, or memo program on the screen. It may contain more.

In this case, in order to receive a user input for performing an action according to the occurrence of an event as described above, it may be displayed on the screen in the form of an icon or in the form of a widget on the operating system screen executed in the mobile terminal 100, but the movement In order to fix the location regardless of the operating system screen change of the terminal 100, to prevent interference with other icons, and to allow the user to arbitrarily change the location, it is preferable to display it on the screen in the form of a pop-up window.

10A is an exemplary diagram of a mobile terminal displaying a pop-up window on a screen according to an embodiment disclosed in the present specification.

As shown in FIG. 10A, the mobile terminal 100 receiving data corresponding to an event occurring in any one of the mobile terminal 100 and the vehicle control device 400, 400', 400' Before performing an operation corresponding to, in order to receive a user input on whether to perform the operation, the mobile terminal 100 may display a pop-up window W for receiving a user input on a part of the screen.

The pop-up window W may have a polygon, a circle, an ellipse, etc., but preferably, the user at a glance recognizes that the pop-up window W is related to the vehicle control device 400, 400 ′, 400 ″, which is another node. In order to be able to do so, it is preferable that the shape corresponding to the vehicle control devices 400, 400', 400", for example, a vehicle shape (see FIG. 10B).

As described above, the location of the pop-up window W may be changed by a user's input or a user's setting.

On the other hand, the pop-up window (W) includes at least one graphic object (WB) in the form of a button that receives a user input to perform an action corresponding to the occurrence of an event, as shown in FIGS. 10A and 10B, and is displayed on the screen. can do.

In this case, when a selection input for at least one graphic object WB is received from a user, an operation corresponding thereto, for example, a specific program may be executed.

As an example, as shown in FIG. 10A, the three graphic objects in the pop-up window W are sequentially from top to bottom, receiving inputs for executing a map-related program, and executing a call incoming/outgoing program. It may be a second graphic object for receiving an input for and a third graphic object for receiving an input for executing a memo program.

The number of graphic objects WB or a program associated therewith may be set by the user.

In addition, the program linked to the graphic object (WB) can be set by the control unit as a program frequently used by the user, but preferably the control unit is a program frequently used by the user within a specific time range based on whether the vehicle is running or getting on or off. Can be set.

At this time, the program linked to the graphic object WB set by the control unit may be a program that has been executed more than the preset number of executions, and the number is not particularly limited.

Meanwhile, on the graphic object WB or around the graphic object WB, an indicator WI indicating whether an event corresponding to the graphic object WB has occurred and/or the number of occurrences may be displayed.

For example, as shown in FIG. 10A, a "1" may be displayed on the upper right of the first graphic object receiving an input for executing a map-related program. Specifically, since the location where the user alighted was different from the destination location, an event occurred once in the vehicle control device (400, 400', 400'), and the mobile terminal 100 received the first graphic object from the user. Upon receiving the selected input, the mobile terminal 100 may execute a program that provides directions from the location where the user alighted to the destination.

According to another embodiment, an indicator indicating whether an event has occurred and/or the number of occurrences may be displayed on or around the program icon. Here, the program icon may be a graphic object displayed on a screen to receive an execution command for a program that performs an operation corresponding to the event.

10C is an exemplary diagram showing the number of occurrences of an event around an icon displayed on a screen of a mobile terminal according to an embodiment disclosed in the present specification.

As illustrated in FIG. 10C, an indicator AI indicating whether an event has occurred and/or the number of occurrences may be displayed near the program icon IC.

That is, when an event occurs, the selection input for performing an operation corresponding thereto is the same as the graphic object WB, as well as the graphic object WB, on or on the icon IC receiving a command for executing a similar program. Around, the indicator AI may be displayed.

For example, when a call reception event occurs once in the mobile terminal 100 while the vehicle is driving, and the vehicle is not driving or the user gets out of the vehicle, the mobile terminal 100 will send a call to the other party who rejected the call. For this, in addition to the graphic object WB receiving an execution command of the call destination program, “1” may be displayed in the upper right corner of the icon IC of the call destination program.

According to another embodiment, when an operation corresponding to an event occurring in at least one node is performed, whether the event occurs or the number of occurrences of the event may be displayed on a part of a screen during operation.

10D is an exemplary diagram showing whether an event occurs on a part of a program execution screen of a mobile terminal according to an embodiment disclosed in the present specification.

When a program is executed based on a user input, whether an event has occurred or the number of occurrences of the event can be displayed on the executed program screen. At this time, it goes without saying that the executed program is a program related to event occurrence.

For example, as shown in FIG. 10D, when a call incoming/outgoing program is executed, when a call incoming event occurs once in the mobile terminal 100 while the vehicle is driving, whether an event occurs in a part of the execution screen of the call incoming/outgoing program Can be displayed. In this case, the number of occurrences of the event may be displayed on the screen by repeating a number or a “vehicle”-shaped icon CI indicating that there is an event that has occurred.

Here, the icon CI indicating whether an event has occurred is determined according to information extracted from data corresponding to the event occurring in the mobile terminal 100 or the vehicle control device 400, 400', 400'. I can.

As an example, a call incoming event occurred in the mobile terminal 100 while the vehicle was driving, and the call originating destination was extracted from the data corresponding to this, and according to the extracted information, the call incoming and outgoing of the screen showing the call incoming and outgoing program It is preferable to display the "vehicle"-shaped icon in the area corresponding to "my daughter" in the list.

Meanwhile, when the event occurs, the output unit 150 may output light, vibration, or sound.

For example, by outputting a specific screen through the display unit 151, visually notifying the user that an event has occurred, or flashing a specific color or a specific color at predetermined intervals through a light emitting means (not shown). Notifying the user that an event has occurred visually, or by outputting a specific color vibration or sound through the alarm unit 154 or the sound output unit 153 to indicate that the event has occurred tactilely or aurally to the user. I can tell.

Between mobile terminal and vehicle control device Interlocked Concrete Example

Hereinafter, a specific embodiment of interworking between a mobile terminal and a vehicle control device according to an embodiment disclosed in the present specification will be described.

Before boarding the vehicle-1st Example

The mobile terminal 100 may output the location of the vehicle according to a user input when the power is turned on within a certain distance from the location of the vehicle, that is, when a vehicle proximity event occurs.

The controller 180 of the mobile terminal 100 may calculate the distance to the vehicle control devices 400, 400', 400' in order to calculate the distance to the vehicle location.

In this case, one method of calculating the distance from the vehicle control device 400, 400', 400'' by the controller 180 is the location recognized by the mobile terminal 100 when the user gets off the vehicle and the current mobile terminal 100 The distance difference between the mobile terminal 100 and the vehicle can be calculated using the location of. This is assuming that the vehicle is not driven when the user gets off the vehicle, and it may be inaccurate when the vehicle is towed or when the vehicle is driven by a person who does not carry the mobile terminal 100, but the mobile terminal 100 and the vehicle There is an advantage that it is easy to calculate the distance between the two and the amount of calculation is not large.

In contrast, in order to calculate the distance between the mobile terminal 100 and the vehicle, the distance between the two positions is determined by using the current positions of the mobile terminal 100 and the vehicle control devices 400, 400', 400' Alternatively, the distance may be calculated based on the strength of the wireless signal transmitted and received between the mobile terminal 100 and the vehicle control device 400, 400', 400', but is not limited thereto, and the distance between the two terminals is All known methods of calculation can be applied.

Meanwhile, when a user carrying the mobile terminal 100 moves toward a vehicle and the mobile terminal 100 is located within a certain distance around the vehicle control devices 400, 400', 400', the mobile terminal 100 If) is the power on (on) state, the position of the vehicle can be output by executing the program.

*Specifically, when the distance between the mobile terminal 100 and the vehicle control devices 400, 400', 400'' is within a certain distance, and the mobile terminal 100 is in the on state, as shown in FIG. 10A In the pop-up window W, an indicator WI indicating “1” may be displayed around the graphic object WB corresponding to the program that outputs the position of the vehicle, and the graphic object WB is selected according to a user input. When an input to be received is received, the mobile terminal 100 may output the location of the vehicle on the screen.

For example, as shown in FIG. 11A, by executing a program that outputs the location of the vehicle, the location of the vehicle may be output on a map.

More preferably, the current location of the user is displayed together with the location of the vehicle, but the shortest and/or optimal route from the current location to the vehicle location is calculated, and the user can move from the current location to the vehicle location according to the route. So that you can follow directions.

In addition, the driving direction for reaching the vehicle position is calculated in real time according to the direction the mobile terminal body is facing, and the calculated driving direction is displayed on the screen in a turn-by-turn (TBT) method. It is desirable.

In this case, when displaying the driving direction to the vehicle position in a turn-by-turn manner with an arrow, it is preferable to output it on the screen of the wearable device.

In addition, it is preferable that the user calculates the travel distance from the current position to the vehicle position or the predicted travel time according to the walking speed and displays it on the screen.

Meanwhile, according to another embodiment, a picture or memo set by a user input for the location of the vehicle may be output.

As shown in FIG. 11B, when a user takes a picture of the vehicle or its surroundings after getting off the vehicle, a program for outputting the location of the vehicle may output the photographed picture.

When the vehicle is parked and stopped in an underground parking lot where the location of the vehicle cannot be accurately recognized, a picture set by the user is displayed on the screen, thereby providing a clue that the user can move to the current vehicle location.

On the other hand, when a program for outputting the location of the vehicle is executed, the mobile terminal 100 may output by varying the magnitude or period of the vibration according to the difference in distance from the vehicle.

12 is an exemplary diagram illustrating various output methods of a distance alarm according to an embodiment disclosed in the present specification.

As an example, as shown in FIG. 12, the mobile terminal 100 has a distance difference between the mobile terminal 100 and the vehicle calculated based on the vibration type distance alarm AS10 having a basic amplitude and a fundamental frequency. As it becomes smaller, a distance alarm AS20 in which the frequency of vibration is increased may be output, or a distance alarm AS30 in which the amplitude of vibration is increased may be output to the outside.

In addition, the mobile terminal 200 is a distance in which the frequency or amplitude of the vibration varies with time as the calculated distance difference decreases, based on the vibration-type distance alarm AS10 having a basic amplitude and a fundamental frequency. Alarm (AS40) can be output to the outside.

As described above, the frequency or amplitude of the vibration may be differently output according to the distance difference between the mobile terminal 100 and the vehicle, but according to another embodiment, the amplitude or frequency of the notification sound may be differently output. .

In addition, according to another embodiment, according to the distance difference between the mobile terminal 100 and the vehicle, one of the previously stored voices may be selected (for example, "10m remaining") and output.

Before boarding the vehicle-2nd Example

When the mobile terminal 100 is powered on within a certain distance from the location of the vehicle, that is, when a vehicle proximity event occurs, the vehicle control device 400, 400', 400'' according to a user input You can run a program to set the destination of the device.

13A is an exemplary diagram illustrating a destination setting screen according to an embodiment disclosed in the present specification.

When an event occurs, the mobile terminal 100 can execute a program for setting a destination on the vehicle control devices 400, 400', 400'', and the destination setting program searches for an address or name to set a destination. You can display the input window for the screen. In addition, the mobile terminal 100 may search for a destination by recognizing a voice.

Meanwhile, frequently searched destinations, destinations stored by the user, and recent destinations can be displayed in the form of a list as shown in Fig. 13A(a), and the user selects any one of the lists and selects the selected destination by wireless. By transmitting to the vehicle control device 400, 400 ′, 400 ″ through the communication unit 110, the vehicle control device 400, 400 ′, 400 ″ can be set as a destination.

In this case, the data transmitted by the mobile terminal 100 to the vehicle control devices 400, 400 ′, 400 ″ may include route information including a stopover point or route point in addition to the destination.

When a destination is selected by the user, the mobile terminal 100 may display the selected destination, transit point, or route point on a map, as shown in FIG. 13A(b).

In this case, the shortest or optimal distance and/or the required time from the current vehicle location to the destination may be output on a part of the screen, and the user selects “set destination” to input the selected destination to the vehicle control device 400 , 400', 400'').

* According to another embodiment, the mobile terminal 100 executes a program for setting a destination on the vehicle control devices 400, 400', 400', and displays a destination list on the screen as shown in FIG. 13A. Can be printed.

At this time, the destination list displayed on the screen is the name of a place searched more than a certain number of times based on the search log stored in the memory 160 of the mobile terminal 100, a place registered more than a certain number of times in the schedule management program, or The message including the place name may include the place of a certain number of times.

Specifically, at least one search program included in the mobile terminal 100 may store at least one query in which a search request is received from a user in the memory 160.

Based on at least one query stored in the memory 160, the controller 180 may select a place name whose search request by the user is equal to or greater than a certain number of times and output it to the destination list.

Here, whether the place name is included in the query is compared with the place name stored in the memory 160 of the mobile terminal 100 or the vehicle control device 400, 400', 400'', or through the wireless communication unit 110 It can be determined by comparing it with the place name provided by the connected navigation company server.

According to another embodiment, the mobile terminal 100 may select a place that is more than a certain number of places stored in the schedule management program and output it to the destination list.

In addition, according to another embodiment, when the message including the specific place name is more than a certain number of times, the specific place name may be output to the destination list.

The controller 180 of the mobile terminal 100 extracts the time and/or place name from text included in the message, and based on the number of messages including a specific place name among the messages stored in the memory 160, a schedule Place names that are more than the number of times may be exposed to the destination list.

Before boarding the vehicle-3rd Example

The mobile terminal 100 may execute a schedule management program according to a user input when the power is turned on within a predetermined distance from the location of the vehicle, that is, when a vehicle proximity event occurs.

13B is an exemplary view showing a screen on which a schedule management program according to an embodiment disclosed in the present specification is executed.

As shown in Fig. 13B, by executing a schedule management program when an event occurs, the mobile terminal 100 outputs a schedule or memo in which the user's to-dos are stored on the screen to recognize the destination to which the user is to be moved. , It is possible for a user to set a destination on the vehicle control device 400, 400', 400' through the destination program.

According to an embodiment, the mobile terminal 100 executes a schedule management program to output the place name according to the time stored in the memory 160 on the screen, and receives a selection input for the place name from the user, The place name can be transmitted to the destination setting program.

Accordingly, the destination setting program may output a destination on the screen in FIG. 13A(a) or (b), and set the destination in the vehicle control devices 400, 400', 400'' according to a user input.

Before boarding the vehicle-4th Example

The mobile terminal 100 may output a message including a schedule-related text according to a user input when the power is turned on within a certain distance from the location of the vehicle, that is, when a vehicle proximity event occurs.

13C is an exemplary view showing a screen on which a message including text related to a schedule is output according to an embodiment disclosed in the present specification.

As shown in FIG. 13C, the mobile terminal 100 can output a message stored in the memory 160 by executing a message program when an event occurs.

The message displayed on the screen is a message including schedule-related text in addition to a simple message, and the controller 180 recognizes the time and/or place name from the text of the message, and as shown in FIG. 13C, the recognized time and place name Can be output in the form of a hyperlink to receive user selection input.

The mobile terminal 100 receiving a selection input for any one of the time and place name from the user transmits at least one of the time, place name, and message sender included in the message to the schedule management program, and schedules the time, place name, and message sender. You can make it possible to enroll in a management program.

According to another embodiment, the mobile terminal 100 receiving a selection input for a place name from a user transmits the place name to a destination setting program, and transmits the place name to the vehicle control device 400, 400 ′, 400 ″. Can be set to

According to another embodiment, the message sender can be transmitted to a call originating program according to a user input, so that the mobile terminal 100 can make a call to the message originating destination.

Before boarding the vehicle-5th Example

The mobile terminal 100 may output a screen for outputting vehicle information according to a user input when the power is turned on within a certain distance from the location of the vehicle, that is, when a vehicle proximity event occurs.

13D is an exemplary view showing a screen for outputting vehicle information according to an exemplary embodiment disclosed in the present specification.

13D, the mobile terminal 100 receives vehicle information collected by the vehicle control devices 400, 400', 400' through the wireless communication unit 110, and displays the received vehicle information on a screen. Can be printed on.

At this time, the vehicle control devices 400, 400', 400'' collect vehicle information through the vehicle information acquisition unit 460, such as the air conditioning conditions inside the vehicle (temperature, humidity, air volume, etc.), vehicle doors (bonnet, It may be information related to at least one of open/closed/open/closed windows, open/closed windows, open/closed sunroof, vehicle battery charge status, vehicle fueling status, vehicle alarm status, and tire pressure information. have.

As an example, as shown in FIG. 13D, the mobile terminal 100 displays the status of the battery included in the vehicle ("60% remaining") and the vehicle door status ("door open!!") of the vehicle information on the screen. Can be displayed.

According to another embodiment, when the power is turned on within a certain distance from the location of the vehicle, that is, when a vehicle proximity event occurs, the mobile terminal 100 issues a control command for the vehicle according to a user input. You can run the program to send.

13E is an exemplary view showing an execution screen of a program for transmitting a control command for a vehicle according to an embodiment disclosed in the present specification.

13E, the mobile terminal 100 transmits a control command for the vehicle through the vehicle control device 400, 400', 400'' through the wireless communication unit 110, and transmits the vehicle control command according to the control command. The control devices 400, 400' and 400' may control the vehicle.

At this time, the control commands transmitted from the mobile terminal 100 to the vehicle control devices 400, 400', 400'' are air conditioning control inside the vehicle, start-up on/off control of the vehicle, and the vehicle It may include at least one of door opening/closing control, window opening/closing control of the vehicle, and sunroof opening/closing control of the vehicle.

As an example, as shown in FIG. 13E, the mobile terminal 100 generates an air conditioning control command to increase or decrease the temperature in the vehicle through user selection inputs for "UP" and "DOWN", and the vehicle control device 400 , 400', 400'').

Accordingly, the vehicle control apparatus 400, 400', 400'' may control the internal temperature of the vehicle to maintain the internal temperature of 18 degrees according to the air conditioning control command.

After boarding the vehicle-1st Example

The mobile terminal 100 may output vehicle information according to a user input when a user boards a vehicle, that is, when a vehicle ride event occurs.

As described above, the mobile terminal 100 or the vehicle control device 400, 400 ′, 400 ″ can determine whether the user is boarding a vehicle, and when a vehicle boarding event of the user occurs, the mobile terminal 100 Can output vehicle information.

As described above in the [Before boarding the vehicle-Fifth embodiment], the mobile terminal 100 transmits vehicle information collected by the vehicle control device 400, 400', 400' through the wireless communication unit 110. Upon receiving, the received vehicle information may be displayed on a screen.

At this time, the vehicle control devices 400, 400', 400'' collect vehicle information through the vehicle information acquisition unit 46, including the air conditioning conditions inside the vehicle (temperature, humidity, air volume, etc.), vehicle doors (bonnet, It may be information related to at least one of open/closed/open/closed windows, open/closed windows, open/closed sunroof, vehicle battery charge status, vehicle fueling status, vehicle alarm status, and tire pressure information. have.

The user can check the state of the vehicle even after boarding the vehicle, and accordingly, determine whether the vehicle is abnormal.

When the mobile terminal 100 determines whether there is an abnormality based on the state of the vehicle as described above and determines that there is an abnormality in the vehicle, the mobile terminal 100 outputs light, sound, or vibration to the outside, There is an effect that users can cope with accidents that may occur during driving.

According to another embodiment, when a user boards a vehicle, that is, when a vehicle boarding event occurs, the mobile terminal 100 may execute a program for transmitting a control command for the vehicle according to a user input.

As described above in [Before boarding the vehicle-Fifth embodiment], the mobile terminal 100 controls the vehicle by the vehicle control device 400, 400', 400' through the wireless communication unit 110 And, according to the control command, the vehicle control devices 400, 400 ′, 400 ″ may control the vehicle.

At this time, the control commands transmitted from the mobile terminal 100 to the vehicle control devices 400, 400', 400'' are air conditioning control inside the vehicle, start-up on/off control of the vehicle, and the vehicle It may include at least one of door opening/closing control, window opening/closing control of the vehicle, and sunroof opening/closing control of the vehicle.

After boarding the vehicle-2nd Example

The mobile terminal 100 can execute a program for setting a destination of the vehicle control device 400, 400', 400'' according to a user input when a user boards a vehicle, that is, when a vehicle ride event occurs. have.

Briefly, the mobile terminal 100 receives an input for searching for a destination in text or voice form from the user, transmits the destination selected by the user to the vehicle control device 400, 400', 400', and The destination may be set based on the data received by the control devices 400, 400', and 400'. Of course, the destination may include route information including a waypoint or route point.

However, when the user boards the vehicle, the user can directly manipulate the vehicle control devices 400, 400 ′, 400 ″ to set the destination or route point, and thus the vehicle control device through the mobile terminal 100 Setting a destination at (400, 400', 400'') may not have a major advantage.

However, when a destination is set in the vehicle control device 400, 400', 400'' through the mobile terminal 100, the user controls the vehicle through the experience experienced through the mobile terminal 100 before boarding the vehicle. It can be recognized by the devices 400, 400', 400''.

As described above in [before boarding the vehicle-second embodiment] to [before boarding the vehicle-fourth embodiment], before boarding the vehicle, the user searches through at least one search program included in the mobile terminal 100 The mobile terminal 100 extracts the place name, etc. from the query requesting the request, the item stored in the schedule management program, or the text included in the message, and uses the extracted content into the vehicle control device 400, 400', 400'' ). Accordingly, the vehicle control apparatus 400, 400', 400'' may set a destination based on data received from the mobile terminal 100.

As an example, as shown in FIG. 13A, the mobile terminal 100 outputs a destination on the screen based on a log using the mobile terminal 100, and simply selects one of the destination list from the user. By receiving an input, a destination can be conveniently set in the vehicle control devices 400, 400', 400'.

Vehicle Driving-First Example

When the mobile terminal 100 receives a call while the vehicle is driving, that is, when a call reception event occurs, the mobile terminal 100 may reject the call and transmit an automatic response message to the call originating target.

Thereafter, when the vehicle is not driving or when the user gets off the vehicle, a program that is transmitted to the call originating target according to a user input may be executed.

As described above, the mobile terminal 100 or the vehicle control device 400, 400', 400' may determine whether the vehicle is running, and the mobile terminal 100 or the vehicle control device 400, 400', 400'') can share the driving status of the vehicle.

In this case, when a call reception event occurs in the mobile terminal 100 while the vehicle is driving, the mobile terminal 100 rejects the call when the call is received and may automatically transmit a response message to the other party.

9C is an exemplary view illustrating a screen in which a mobile terminal transmits a response message to a counterpart when a call reception event occurs in a mobile terminal while driving a vehicle according to an embodiment disclosed in the present specification.

For example, when a call reception event occurs from "my daughter" in the mobile terminal 100 while driving the vehicle, the mobile terminal 100 rejects the call reception, and as shown in FIG. "Daughter" (010-xxxx-xxxx) sends a message "You are driving. Please contact me later."

On the other hand, since the mobile terminal 100 and the vehicle control device 400, 400', 400'' share an event occurring in each node, when a call reception event occurs in the mobile terminal 100, the mobile terminal 100 A. At the same time as rejecting the incoming call, the vehicle control device (400, 400', 400 ``), as shown in Fig. 9B, the call originating party "my daughter" (010-xxxx) through the mobile terminal 100. -xxxx) can be entered.

Since the vehicle is currently driving, preferably, the vehicle control device 400, 400', 400'' recognizes the voice input from the user, writes text based on the recognized content, and thus, the mobile terminal 100 ), and the mobile terminal 100 may create a message based on the received text and transmit the created message to the calling party.

Thereafter, when a vehicle non-driving event or a user's vehicle disembarkation event occurs in the mobile terminal 100 or the vehicle control device 400, 400', 400'', the mobile terminal 100 sends the call according to the user input. You can run a program that sends a call to the target.

For example, when a call reception event occurs in the mobile terminal 100 while driving a vehicle, the mobile terminal 100 performs call rejection and response message transmission as described above, and as shown in FIG. A pop-up window W including a graphic object corresponding to the program may be displayed on the screen.

In addition, around the graphic object and/or around the icon receiving an execution command for the call originating program, the number of times the call reception event occurs in the mobile terminal 100 while the vehicle is driving may be displayed as a number.

At this time, when receiving a user input for selecting the graphic object or a call originating program, the mobile terminal 100 executes the call originating program as shown in FIG. 10D to perform a call originating operation on the target receiving the selection input from the user. do.

At this time, in the call originating program screen, whether the event has occurred or the number of occurrences of the event may be displayed on the screen of the executed program.

For example, as shown in FIG. 10D, when a call incoming/outgoing program is executed, when a call incoming event occurs once in the mobile terminal 100 while the vehicle is driving, whether an event occurs in a part of the execution screen of the call incoming/outgoing program Can be displayed. In this case, the number of occurrences of the event may be displayed on the screen by repeating a number or a "vehicle"-shaped icon indicating that there is an event that has occurred.

Here, the location of the icon indicating whether an event has occurred may be determined according to information extracted from data corresponding to an event occurring in the mobile terminal 100 or the vehicle control device 400, 400', 400'.

As an example, a call incoming event occurred in the mobile terminal 100 while the vehicle was driving, and the call originating destination was extracted from the data corresponding to this, and according to the extracted information, the call incoming and outgoing of the screen showing the call incoming and outgoing program It is preferable to display the "vehicle"-shaped icon in the area corresponding to "my daughter" in the list.

Vehicle Driving-Second Example

When the mobile terminal 100 receives a message including a schedule-related text while the vehicle is driving, the mobile terminal 100 may execute a schedule management program according to a user input when the vehicle is not driving or when the user gets off the vehicle.

While the mobile terminal 100 is driving a vehicle, as shown in FIG. 13C, a message having a schedule-related text including a time (“12:00”) and/or a place name (“Gasan Digital Complex Area”) is received, and the vehicle When a non-driving event or a vehicle getting off event occurs, the mobile terminal 100 may execute a schedule management program.

The controller 180 of the mobile terminal 100 may extract a schedule-related text from the message and register it in a schedule management program installed in the mobile terminal 100.

However, if the schedule-related text extracted from the message contains at least one of the date, time, and place name, or contains unrecognizable text, correction by the user is required, so a vehicle non-driving event or a vehicle alighting event may have occurred. At this time, it is preferable that the mobile terminal 100 executes a schedule management program according to a user input.

Vehicle Driving-3rd Example

The mobile terminal 100 may execute a program capable of managing a recording file according to a user input when the vehicle is recorded while the vehicle is driving, when the vehicle is not driving or when the user gets off the vehicle.

While the vehicle is driving, the mobile terminal 100 or the vehicle control device 400, 400 ′, 400 ″ may receive a voice or text input from the user (since the vehicle is driving, preferably voice) and store it.

Thereafter, when a vehicle non-driving event or vehicle alighting event occurs in the mobile terminal 100 or the vehicle control device 400, 400', 400'', the mobile terminal 100 executes a program capable of managing the recorded file. I can.

For example, when a vehicle non-driving event or a vehicle disembarkation event occurs, the mobile terminal 100 displays a pop-up window W including a graphic object corresponding to a recording program (or memo program) on the screen, as shown in FIG. 10A. Can be printed.

In addition, the number of recordings (or memos) stored while driving the vehicle may be displayed as a number around the graphic object and/or around the icon receiving an execution command for the recording program (or memo program).

At this time, when receiving a user input for selecting the graphic object or recording program (or memo program), the mobile terminal 100 executes the recording file management program as shown in FIG. 13F to record (or memo) while driving the vehicle. You can play files, record additional (or memo), edit or delete files.

In this case, although not shown, in the recording management program screen, whether the event has occurred or the number of occurrences of the event may be displayed on the screen of the executed program.

For example, when a recording management program is executed, when a recorded recording (or memo) occurs while the vehicle is driving, whether or not an event has occurred may be displayed on a part of the recording management program execution screen. In this case, the number of occurrences of the event may be displayed on the screen by repeating a number or a "vehicle"-shaped icon indicating that there is an event that has occurred.

Vehicle Driving-Part 4 Example

Although the vehicle control device 400, 400', 400'' has determined that the vehicle has not arrived at the set destination, a vehicle non-driving event or a vehicle is sent to the mobile terminal 100 or the vehicle control device 400, 400', 400''. When an alighting event occurs, the mobile terminal 100 may output a route from the current location to the destination according to a user input.

For example, the vehicle to be driven has not reached the destination, but the user may get off the vehicle.

Accordingly, the user can output the route from the current location to the destination on the screen so that the user can walk from the location where they got off the vehicle to the destination.

The wireless communication unit 110 of the mobile terminal 100 receives the destination set from the vehicle control device 400, 400', 400', and the controller 180 receives the shortest and/or the received destination from the current position of the vehicle. Alternatively, by calculating an optimal route, the route may be output on a screen through the output unit 150 so as to guide the user from the current location to the vehicle location according to the route.

As shown in Fig. 13G(a), the route from the current location T2 to the destination T1 can be output on the map, and the vehicle is used to reach the vehicle location according to the direction the mobile terminal body is facing. It is desirable to calculate the driving direction in real time and display the calculated driving direction on the screen in a turn-by-turn (TBT) method with arrows.

In this case, when displaying the driving direction to the vehicle position in a turn-by-turn manner with an arrow, it is preferable to output it on the screen of the wearable device.

In addition, it is preferable that the user calculates the travel distance from the current position to the vehicle position or the predicted travel time according to the walking speed and displays it on the screen.

According to another embodiment, after the vehicle control device 400, 400', 400'' determines that the current vehicle has arrived at the first destination T1, the second destination T2 is set, and the vehicle is When it is determined that the vehicle has arrived at the second destination T2, the mobile terminal 100 can output the route from the second destination to the first destination according to a user input when the vehicle is not driving or when the user gets off the vehicle. have.

For example, when a driving vehicle arrives at a first destination, but no parking space exists at the first destination, the user through the mobile terminal 100 or the vehicle control device 400, 400', 400' The surrounding parking lot may be set as the second destination T2 by input.

Accordingly, the user may output a route from the second destination T2 to the first destination T1 on the screen so that the user can move from the reset second destination T2 to the initially set first destination T1. .

The wireless communication unit 110 of the mobile terminal 100 receives the set first and second destinations from the vehicle control devices 400, 400 ′, 400 ″, and the controller 180 sends the second destination to the first destination. By calculating the shortest and/or optimal route of, the route may be output on the screen through the output unit 150 so that the user can navigate from the current location to the vehicle location according to the route.

As shown in Fig. 13G(a), the route from the current location to the destination can be output on the map, and as shown in Fig. 13G(b), turn-by-turn (TBT) Can be displayed on the screen in a way.

vehicle Non-driving Or user alight-1st Example

The vehicle control device (400, 400', 400``) determines the arrival of the vehicle to the set destination, and the vehicle non-driving event or vehicle to the mobile terminal 100 or the vehicle control device (400, 400', 400'') When the getting off event occurs, the mobile terminal 100 may output information related to a destination set in the vehicle control devices 400, 400', 400'.

The mobile terminal 100 receives the destination name from the vehicle control device 400, 400', 400'' through the wireless communication unit 110, or receives information related to the destination based on the destination previously selected (set) by the user. Can be printed.

According to an embodiment, the memory 160 of the mobile terminal 100 may store related information about a place name, address, or location.

Accordingly, when a vehicle non-driving event or a vehicle disembarkation event occurs, the controller 180 of the mobile terminal 100 uses the destination set in the vehicle control device 400, 400', 400'' as a keyword, and the memory 160 ), you can search for destinations and related information, and display the search results on the screen.

As an example, information related to a destination stored in the memory 160 may be a map including the destination, a toilet location at the destination, a parking lot location, an entrance location, a restaurant location, etc. If the destination is a restaurant, operation of the restaurant It could be the time, the menu of the restaurant, the contact information of the restaurant, etc.

According to another embodiment, the mobile terminal 100 transmits a query including a destination name set in the vehicle control device 400, 400', 400' to a search server (provided by a search service operator) (not shown). And, according to a user input, response data received from the search server may be displayed on a screen.

For example, when a vehicle non-driving event or a vehicle alighting event occurs, a pop-up window W including a graphic object related to a location may be output on the screen.

In addition, around the graphic object and/or around the icon for receiving an execution command for a program related to a location, the number of events requiring confirmation from the user may be displayed as a number.

In this case, when receiving a user input for selecting the graphic object, the mobile terminal 100 may execute a program related to a location and output a screen showing information related to a destination as shown in FIG. 13H.

In contrast, when receiving a user input for selecting the graphic object, the mobile terminal 100 transmits the destination name to a search program as a parameter, and uses a search program to retrieve response data received from the search server. It can be received and displayed on the screen. As shown in Fig. 13H, it can be output in the form of a web page.

In this way, when a vehicle non-driving event or a vehicle disembarkation event occurs, the mobile terminal 100 may provide information on the destination to the user by outputting information related to the destination on the screen. Accordingly, the user can provide a map of the destination, You can know the location of various facilities installed at the destination, visit the homepage corresponding to the destination, and make a call through the call outgoing program using the destination's contact information.

vehicle Non-driving Or user alight-2nd Example

The vehicle control device (400, 400', 400``) determines the arrival of the vehicle to the set destination, and the vehicle non-driving event or vehicle to the mobile terminal 100 or the vehicle control device (400, 400', 400'') When the disembarkation event occurs, the mobile terminal 100, when the address stored in the address book falls within a certain range and the destination set in the vehicle control device 400, 400', 400', the address stored in the address book according to a user input You can run a call originating program to call out to a contact corresponding to.

According to another embodiment, the vehicle control device 400, 400', 400'' determines the arrival of the vehicle to the set destination, and the mobile terminal 100 or the vehicle control device 400, 400', 400'' When a vehicle non-driving event or a vehicle disembarkation event occurs, the mobile terminal 100 includes a destination and a predetermined range set in the vehicle control device 400, 400', 400' when the place included in the previously stored message falls within a certain range, A call sending program may be executed to send to a contact in a message stored with the place or to a sender of the message according to a user input.

According to another embodiment, the vehicle control device 400, 400', 400'' determines the arrival of the vehicle to the set destination, and the mobile terminal 100 or the vehicle control device 400, 400', 400'' When a vehicle non-driving event or a vehicle disembarkation event occurs, the mobile terminal 100, when the place stored in the schedule management program falls within a predetermined range and a destination set in the vehicle control device 400, 400', 400', the user Depending on the input, a call outgoing program may be executed in the schedule management program to send to a contact stored along with the place.

That is, when the vehicle arrives at the destination set in the vehicle control device (400, 400', 400'), the mobile terminal 100 provides a call originating program so that a call can be sent to a specific person, house, or store related to the destination. It is desirable to do it.

At this time, the mobile terminal 100 may execute the call originating program and output the call originating target in the form of a list, as shown in FIG. 13I.

As described above, the call destination may be a contact stored in an address book, a contact stored in a message, or a contact sent from a message, or a contact stored in a schedule management program.

Specifically, the mobile terminal 100 selects a destination selected (or set) by a user or received from the vehicle control device 400, 400', 400' according to the occurrence of a vehicle non-driving event or a vehicle getting off event. As a basis, it is preferable to search the address book, message, and contents stored in the schedule management program stored in the memory 160, extract the contact related to the destination, and make a call to the extracted contact according to the user input through a call outgoing program. Do.

That is, the controller 180 of the mobile terminal 100 calculates the distance between the address stored in the address book and the destination based on the destination, and when the calculated distance falls within a predetermined distance, the You can run a call originating program to call out to a contact corresponding to the address.

Further, the controller 180 of the mobile terminal 100 extracts a place or address from a message including a schedule-related text based on the destination, and calculates a distance between the extracted place or address and the destination. When the calculated distance falls within a certain distance, a call originating program may be executed to send the contact included in the message from which the place or address is extracted or the message from which the place or address is extracted to the sender.

Further, the controller 180 of the mobile terminal 100 extracts a place or address stored in the schedule management program based on the destination, and calculates a distance between the extracted place or address and the destination. When the calculated distance falls within a predetermined distance, a call originating program may be executed to send the location or address to a contact stored together with the extracted information.

As shown in Fig. 13I, the call originating program interlocks with the address book, message, and schedule management program, and the mobile terminal 100 outputs the contact information related to the destination in a list format on the screen, and the contact selected by the user , Call can be made.

vehicle Non-driving Or user alight-3rd Example

The vehicle control device (400, 400', 400``) determines the arrival of the vehicle to the set destination, and the vehicle non-driving event or vehicle to the mobile terminal 100 or the vehicle control device (400, 400', 400'') When the getting off event occurs, the mobile terminal 100 may execute a photo taking program, a memo program, or a recording program according to a user input.

When getting out of the vehicle, the user can take a picture, write a memo, or record by executing a program according to the user input when a vehicle non-driving event or vehicle alighting event occurs in order to record the parking position of the vehicle. It is desirable to do so.

For example, when a vehicle non-driving event or a vehicle disembarkation event occurs, as shown in FIG. 10A, the mobile terminal 100 includes a pop-up window (W) including a graphic object corresponding to a picture, a memo, or a recording program that can be recorded. Can be displayed on the screen.

In addition, around the graphic object and/or around an icon receiving an execution command for the recording program, the number of occurrences of an event requiring confirmation by the user may be displayed as a number.

At this time, when receiving a user input for selecting the graphic object or a recording program, for example, the mobile terminal 100 executes a recording file management program as shown in FIG. 13F to record or take a picture as shown in FIG. 11B. You can run a program that can shoot.

Vehicles to which the technology disclosed in this specification is applicable

Hereinafter, a vehicle to which the technology disclosed in the present specification is applicable will be described with reference to FIG. 14.

In FIG. 14, an electric vehicle is described, but the technology disclosed in this specification is also applied to other types of vehicles (eg, a gasoline engine, a diesel engine, or a vehicle equipped with an LPG engine) without departing from the technical spirit disclosed in the present specification. Applicability is apparent to those skilled in the art.

14 is a schematic configuration diagram of an electric vehicle including a battery charging device according to an embodiment disclosed in the present specification.

As shown in FIG. 14, an electric vehicle 600 equipped with a battery charging device according to an embodiment of the present invention includes a vehicle body 610, a battery 625 provided in the vehicle body 610, and , A battery charging device 640 provided in the vehicle body 610 and connected to an external power source to charge the battery 625.

Although not shown in the drawing, a boarding space for a driver or a passenger may be provided in the upper area of the vehicle body 610. For example, the vehicle body 610 may include a cabin (not shown) in which a boarding space is formed.

The vehicle body 610 may be configured with a plurality of wheels 615 to enable driving. A suspension device 620 may be provided between the vehicle body 610 and each wheel 615. As a result, vibrations and shocks generated when the vehicle body 610 is traveling on a road surface may be alleviated.

The wheel 615 may be disposed on both sides of the vehicle body 610 before and after, respectively.

A battery 625 for supplying power may be provided in the vehicle body 610.

The battery 625 may be configured as a secondary battery to enable charging.

An electric motor 630 that provides driving force to the wheel 615 may be provided on one side of the vehicle body 610.

The vehicle body 610 may be provided with an inverter device 635 that provides driving power to the electric motor 630. The inverter device 635 may be connected to the battery 625 and the electric motor 630, respectively.

The inverter device 635 is connected to the battery 125 to receive DC power, and converts DC power to power suitable for driving the electric motor 630 and provides it to the electric motor 130.

A battery charging device 640 may be provided in the vehicle body 610 to charge the battery 625. The battery charging device 640 is configured with a charging circuit 660 connected to an external commercial power source (AC) to convert commercial power into power suitable for charging the battery 625 and provide it to the battery 625 Can be. Here, the charging circuit 660, although not shown in detail, is a commercial power input unit that is connected to a commercial power to input commercial power, a rectifier and smoothing unit that converts the commercial power input through the commercial power input into DC , A power converter converting the converted DC power into power suitable for charging the battery 625 and outputting it.

The scope of the present invention is not limited to the embodiments disclosed herein, and the present invention can be modified, changed, or improved in various forms within the scope of the spirit and claims of the present invention.

100: mobile terminal 110: wireless communication unit
160: memory 180: control unit
400, 400', 400'': vehicle control unit

Claims (21)

A display unit;
Wireless communication unit; And
Using the information received through the wireless communication unit to determine whether the user boards the vehicle,
When an event occurs through the wireless communication unit, it includes a control unit for executing different functions corresponding to the event according to whether the vehicle is boarded, and
The control unit,
When the user is located inside the vehicle, a first function corresponding to the event is executed, and when the user is located outside the vehicle, a second function corresponding to the event is executed,
When executing the first function, in response to the user getting off the vehicle, controlling the display unit to display a graphic object guiding the execution of the first function to maintain execution of the first function Mobile terminal characterized by. The method of claim 1,
The wireless communication unit,
And transmitting data corresponding to the event to the vehicle control device so that the vehicle control device performs communication with a vehicle control device installed in the vehicle, and the vehicle control device performs an operation corresponding to the event. The method of claim 1,
An output unit that displays a pop-up window for receiving a user input on the screen;
A mobile terminal further comprising a. The method of claim 3,
The output unit,
At least one graphic object in the pop-up window is displayed on the screen,
The control unit,
And performing an operation corresponding to the event according to a selection input for the graphic object. The method of claim 4,
The graphic object,
A mobile terminal, characterized in that the number of occurrences of an event is displayed on the graphic object or around the graphic object. The method of claim 1,
The mobile terminal,
When a user's vehicle riding event occurs, the mobile terminal outputs information on the vehicle according to a user input. The method of claim 1,
The mobile terminal,
A mobile terminal, comprising executing a program for transmitting a control command for the vehicle according to a user input when a user's vehicle riding event occurs. The method of claim 2,
The mobile terminal,
A mobile terminal, characterized in that when a user's vehicle riding event occurs, a program for setting a destination in the vehicle control device is executed according to a user input. The method of claim 1,
The mobile terminal,
When the vehicle receives a call while driving, when the call is rejected and a response message is transmitted to the call originating target,
A mobile terminal, comprising executing a program for sending a call to the call originating target according to a user input when a vehicle non-driving event or a user alighting event occurs. The method of claim 1,
The mobile terminal,
When the vehicle receives a message including a schedule-related text while driving,
A mobile terminal, characterized in that when a vehicle non-driving event or a user's getting off event occurs, a schedule management program is executed according to a user input. The method of claim 1,
The mobile terminal,
If the vehicle was recorded while driving,
A mobile terminal, characterized in that when a vehicle non-driving event or a user's getting off event occurs, a program capable of managing a recorded file according to a user input is executed. The method of claim 2,
The vehicle control device,
When it is determined that the vehicle has not arrived at a preset destination, the mobile terminal outputs a route from the current location to the destination on a screen according to a user input when a vehicle non-driving event or a user's disembarkation event occurs. terminal. The method of claim 2,
The vehicle control device,
After determining the arrival of the vehicle to a preset first destination, when a second destination is set and it is determined that the vehicle arrives at the second destination again,
The mobile terminal,
A mobile terminal, comprising outputting a route from the second destination to the first destination according to a user input when a vehicle non-driving event or a user alighting event occurs. The method of claim 2,
The vehicle control device,
When determining the arrival of the vehicle to a preset destination,
The mobile terminal,
A mobile terminal comprising outputting information related to the destination when a vehicle non-driving event or a user's getting off event occurs. The method of claim 2,
The vehicle control device,
When determining the arrival of the vehicle to a preset destination,
The mobile terminal,
When the distance between the place stored in the schedule management program and the destination set in the vehicle control device falls within a certain distance, a call originating program is executed to call the contact information stored together with the place in the schedule management program according to a user input. Mobile terminal. delete delete delete delete delete delete

Images