KR20220114727A - Vehicle Rear Occupant Monitoring Systmet and Method for the same - Google Patents

Abstract

A vehicle rear seat monitoring system and method are disclosed. According to the present specification, when a person is detected in the rear seat of the vehicle through a sensor inside the vehicle after the vehicle is started, a Bluetooth signal is transmitted to a pre-registered mobile device. The mobile device may output an alarm when out of a Bluetooth communication distance with the vehicle, thereby effectively notifying that there is a person remaining in the rear seat of the vehicle.

Description

Vehicle Rear Occupant Monitoring System and Method for the same}

The present specification relates to a vehicle rear seat monitoring system and method.

As infants and young children die from heat stroke every year, the European (Euro NCAP) and American (NHRSA) organizations are considering applying the ROA system.

Vehicles are equipped with various mechanisms for detecting the appearance of objects inside the vehicle. These mechanisms may be implemented in such a way that an alarm is provided to the driver when an object, person, pet, etc. is left in the vehicle. However, many of these alarms cannot efficiently and directly provide the status of objects left in the vehicle.

An object of the present specification is to solve the above-mentioned problems, and to provide a method for detecting a rear seat object and efficiently providing an alarm because it has little influence on environmental changes and strong permeability.

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned are clear to those of ordinary skill in the art to which the present invention belongs from the detailed description of the invention below. will be able to be understood

Vehicle rear seat monitoring system according to an embodiment of the present specification, a wireless communication module; a sensor inside the vehicle that detects an object in the vehicle rear seat; and a processor for controlling the wireless communication module to transmit a wireless signal indicating that the object exists in the rear seat of the vehicle to a pre-registered mobile device when the object is detected. In the mobile device, when the distance to the wireless communication module exceeds a threshold wireless distance as the wireless signal is received, an alarm is output.

The wireless communication module includes a Bluetooth module, and the wireless signal is a Bluetooth signal. The Bluetooth signal may include a Bluetooth Low Energy (BLE) signal.

The vehicle rear seat monitoring system further includes an alarm unit, and the processor, when the vehicle is started, broadcasts a first Bluetooth signal, and at least one rear Occupant Alert (ROA) application is installed. When the mobile device is not detected, an alarm may be output through the alarm unit.

The alarm unit may be implemented as an LED lamp.

The processor may control the sensor to operate when the vehicle is turned off.

The processor may transmit a Bluetooth signal including a sensing result to the pre-registered mobile device when the lock of the vehicle door is detected after the sensor is operated.

When there are a plurality of pre-registered mobile devices, the processor may transmit the Bluetooth signal to each of the plurality of mobile devices, and the plurality of devices may be linked through a Rear Occupant Alert (ROA) application.

When any one mobile device deviates from the threshold wireless distance while all of the plurality of mobile devices have received the Bluetooth signal, the alarm may be output from a mobile device that is close to the vehicle.

When all the mobile devices deviate from the threshold wireless distance while all of the plurality of mobile devices have received the Bluetooth signal, the alarm may be output to all of the plurality of mobile devices.

As a result of the sensing, a person is detected in the rear seat of the vehicle, and the mobile device receiving the Bluetooth signal outputs an alarm when the distance between the rear seat monitoring system and the mobile device is within the threshold wireless distance. The alarm may be output when it is maintained in a non-disabled state and deviates from the threshold radio distance.

In the case of a vehicle in which a door lock signal is not separately provided, the processor may transmit a Bluetooth signal including a sensing result to the pre-registered mobile device after the sensor is operated.

The processor transmits a first Bluetooth signal when a person is detected in the rear seat of the vehicle as a result of the sensing of the sensor, and transmits a second Bluetooth signal when the person is not detected, wherein the mobile device transmits the second Bluetooth signal In the case of receiving , the alarm may not be output from the mobile device regardless of the threshold wireless distance.

The processor is configured to, when a result of the sensing of the sensor is changed while transmitting any one of the first Bluetooth signal and the second Bluetooth signal to the mobile device, switch to another Bluetooth signal to be transmitted. can

When a predetermined operation is input from the mobile device after the alarm is output, the door of the vehicle may be controlled to be opened.

The sensor is installed on the ceiling inside the vehicle, and may include a millimeter wave radar sensor (mmWave 　Rader Sensor).

The object may include a living organism, and the processor may analyze a signal of the millimeter wave radar sensor to determine whether the object exists.

In the rear seat monitoring method according to another embodiment of the present specification, when the vehicle is started, the first Bluetooth signal is broadcast through the wireless communication module, and at least one ROA (Rear Occupant Alert) application is installed. detecting a mobile device of controlling a sensor inside the vehicle that detects an object in the rear seat of the vehicle to be operated when the ignition of the vehicle is turned off; transmitting a Bluetooth signal including a sensing result to a pre-registered mobile device when the lock of the vehicle door is detected after the sensor is operated; and controlling the mobile device to output an alarm when it is detected that the mobile device deviates from the threshold wireless distance with the vehicle.

The sensor is installed on the ceiling inside the vehicle, includes a millimeter wave radar sensor (mmWave 　Rader Sensor), analyzing the signal of the millimeter wave radar sensor to determine whether the object exists; further comprising can do.

transmitting the Bluetooth signal to each of the plurality of mobile devices when there are a plurality of pre-registered mobile devices; monitoring a distance between the plurality of mobile devices and the vehicle, respectively; and controlling the alarm to be output from the first mobile device when the first mobile device, which is close to the vehicle, deviates from the wireless threshold distance.

when the number of the pre-registered mobile devices is plural, controlling the alarm to be output from a specific mobile device based on the distances of the plurality of mobile devices to the vehicle through the ROA application; may further include.

outputting information related to the installation of the ROA application to a display provided in the vehicle when the at least one mobile device on which the Rear Occupant Alert (ROA) application is installed is not detected; and registering the at least one mobile device in the rear seat monitoring system of the vehicle by allowing the ROA application to be installed in the at least one mobile device as a predetermined input is received.

A vehicle rear seat monitoring system and method according to an embodiment of the present specification may provide a method for detecting a rear seat object and efficiently providing an alarm because it has little influence on environmental change and strong permeability.

The effects obtainable in the present invention are not limited to the above-mentioned effects, and other effects not mentioned will be clearly understood by those of ordinary skill in the art to which the present invention belongs from the following description. .

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as part of the detailed description to help the understanding of the present specification, provide embodiments of the present specification, and together with the detailed description, explain the technical features of the present specification.
1 is a diagram illustrating an example of a wireless communication system using the Bluetooth technology proposed in the present specification.
2 is an example of a side appearance of a vehicle in which a vehicle rear seat monitoring system according to an embodiment of the present specification is installed.
3 is a block diagram of a vehicle rear seat monitoring system and/or apparatus according to an embodiment of the present specification.
4 is a block diagram of a mobile device applied to an embodiment of the present specification.
5 is a diagram for explaining an example of a mobile device registration process for monitoring the rear seat of a vehicle according to an embodiment of the present specification.
6 is a flowchart of a vehicle rear seat monitoring method through a vehicle rear seat monitoring system according to an embodiment of the present specification.
7 is a flowchart illustrating an alarm method through a vehicle rear seat monitoring system when there are a plurality of registered mobile devices according to an embodiment of the present specification.
8 to 9 are diagrams for explaining the embodiment shown in FIG. 7 .
BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included as a part of the detailed description to facilitate the understanding of the present specification, provide embodiments of the present invention, and together with the detailed description, explain the technical features of the present invention.

Hereinafter, the embodiments disclosed in the present specification will be described in detail with reference to the accompanying drawings, but the same or similar components are assigned the same reference numbers regardless of reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed in consideration of only the ease of writing the specification, and do not have distinct meanings or roles by themselves. In addition, in describing the embodiments disclosed in the present specification, if it is determined that detailed descriptions of related known technologies may obscure the gist of the embodiments disclosed in the present specification, the detailed description thereof will be omitted. In addition, the accompanying drawings are only for easy understanding of the embodiments disclosed in the present specification, and the technical spirit disclosed herein is not limited by the accompanying drawings, and all changes included in the spirit and scope of the present invention , should be understood to include equivalents or substitutes.

Terms including ordinal numbers such as first, second, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

When a component is referred to as being “connected” or “connected” to another component, it may be directly connected or connected to the other component, but it is understood that other components may exist in between. it should be On the other hand, when it is said that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The singular expression includes the plural expression unless the context clearly dictates otherwise.

In the present application, terms such as “comprises” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It is to be understood that this does not preclude the possibility of the presence or addition of numbers, steps, operations, components, parts, or combinations thereof.

The above-described specification, it is possible to be implemented as computer-readable code on a medium in which the program is recorded. The computer-readable medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that includes implementation in the form of. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present specification should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of this specification.

1 is a diagram illustrating an example of a wireless communication system using the Bluetooth technology proposed in the present specification. 2 is an example of a side appearance of a vehicle in which a vehicle rear seat monitoring system according to an embodiment of the present specification is installed.

Bluetooth is one of the basic technologies of IoT and is a short-range wireless technology standard for exchanging information by connecting mobile devices such as mobile phones, laptops, earphones, and headsets. Bluetooth communicates using ISM (Industrial, Scientific, Medical) band 2400~2483.5MHz frequency. In this band, Bluetooth has a guard band of 3.5 MHz above 2 MHz below, and uses a total of 79 channels with a bandwidth of 1 MHz for each channel, and uses frequency hopping to prevent radio interference. Frequency hopping, also called frequency hopping, is a method of transmitting data while moving a channel quickly according to a specific pattern. The connection between Bluetooth devices consists of a master and a slave, and up to 7 slave devices can be connected to one master device. The master and the slave are not fixed, and the master and the slave may change depending on the situation.

There are two types of Bluetooth communication methods: BR/EDR (Basic Rate/Enhanced Data Rate) and LE (Low Energy), which is a low-power method. The BR/EDR method may be referred to as Bluetooth Classic. The Bluetooth classic method includes a Bluetooth technology that has been inherited from Bluetooth 1.0 using a basic rate and a Bluetooth technology that uses an enhanced data rate supported from Bluetooth 2.0.

Bluetooth Low energy (hereinafter referred to as Bluetooth LE) Applied from Bluetooth 4.0, it consumes little power and can stably provide hundreds of kilobytes (KB) of information. This Bluetooth low energy technology exchanges information between devices by using an attribute protocol. This Bluetooth LE method can reduce the overhead of a header and simplify the operation, thereby reducing energy consumption. Bluetooth Mesh, based on Bluetooth LE, supports many-to-many device communication and optimizes the creation of large-scale device networks. It has industrial-level stability, scalability and security, and supports global interoperability. In particular, it is suitable for IoT solutions such as building automation, sensor networks, and asset tracking, where thousands of devices need to communicate reliably and securely with each other. Mesh networks extend the reach of low-energy Bluetooth connections, and because they use a technology called 'Managed Flood', they can handle endless requests from tens of thousands of devices. Bluetooth mesh networking contributes to expanding the use of Bluetooth beyond consumers to factory automation systems, smart offices, and smart cities.

Bluetooth version 5 is an upgraded version of Bluetooth version 4. In theory, Bluetooth version 5 can connect up to 400m in an obstacle-free environment. Bluetooth version 5 can connect up to 120m in a realistic configuration, which is four times that of Bluetooth version 4. The data transfer rate is also doubled to 2Mbps. Therefore, Bluetooth version 5 makes it easier to transmit firmware to devices with faster speed, wider connection distance, and error correction function, and is useful for automobiles, intelligent meters, and medical devices implanted in the human body. In addition, Bluetooth basically performs pairing (connection) between two devices, and if a function called broadcast is used, multiple communication with nearby beacons is possible without separate pairing. Bluetooth 5 increases this broadcast capacity by 8 times, allowing more diverse beacon services to be used.

Hereinafter, in the embodiments of the present specification, the mobile terminal performing wireless communication with the ROA system proceeds with Bluetooth communication, and for convenience of description, the Bluetooth technology will be described by taking the Bluetooth low energy technology as an example.

Referring to FIG. 1 , the wireless communication system 1 includes at least one server device (Server Device) 100 and at least one client device (Client Device) 20 .

The server device and the client device perform Bluetooth communication using Bluetooth Low Energy (BLE, hereinafter referred to as 'BLE' for convenience) technology.

According to the embodiment of the present specification, the server device 100 corresponds to the ROA sensor system 100 provided in the vehicle 10 , and the client device 20 is located in the rear seat of the vehicle through the ROA sensor system 100 . When a person is detected, it may correspond to the mobile device 20 receiving an alarm.

In BLE technology, (1) the number of RF channels is 40, (2) data transmission rate supports 1Mbps, (3) topology is scatternet structure, (4) latency is 3ms, (5) maximum current is less than 15mA, (6) output power is less than 10mW (10dBm), and (7) it is mainly used in applications such as mobile phones, watches, sports, healthcare, sensors, and device control.

The server device 100 may operate as a client device in a relationship with another device, and the client device may operate as a server device in a relationship with another device. That is, in the Bluetooth communication system, any one device may operate as a server device or a client device, and, if necessary, may simultaneously operate as a server device and a client device.

The server device 100 is a data service device (Data Service Device), a slave device (slave device) device, a slave (slave), a server, a conductor (Conductor), a host device (Host Device), a gateway (Gateway), a sensing device (Sensing Device), may be expressed as a monitoring device (monitoring device).

The client device 20 includes a master device, a master, a client, a member, a sensor device, a sink device, a collector, a third device, a fourth device, etc. can be expressed

A server device (or server device) and a client device (or client device) correspond to main components of the wireless communication system, and the wireless communication system may include other components in addition to the server device and the client device.

The server device is a device that receives data from the client device and directly communicates with the client device, thereby providing data to the client device through a response when receiving a data request from the client device.

In addition, the server device sends a notification message and an indication message to the client device to provide data information to the client device. Also, when the server device transmits an indication message to the client device, the server device receives a confirmation message corresponding to the indication message from the client.

In addition, the server device provides data information to the user through a display unit or receives a request input from the user through an input unit (User Input Interface) in the process of transmitting and receiving notification, instruction, and confirmation messages to and from the client device can do.

In addition, the server device may read data from a memory unit or write new data to the corresponding memory in the process of transmitting and receiving messages with the client device.

In addition, one server device may be connected to a plurality of client devices, and it is possible to easily reconnect (or connect) to the client devices by using bonding information.

The client device 20 refers to a device that requests data information and data transmission from a server device.

The client apparatus receives data from the server apparatus through a notification message, an instruction message, and the like, and when receiving the instruction message from the server device, sends a confirmation message in response to the instruction message.

Similarly, the client device may provide information to a user through an output unit or receive an input from a user through an input unit in the process of transmitting and receiving messages with the server device.

In addition, the client device may read data from the memory or write new data to the corresponding memory in the process of transmitting and receiving messages with the server device.

Hardware components such as an output unit, an input unit, and a memory of the server device and the client device will be described in detail with reference to FIGS. 3 and 4 .

In addition, the wireless communication system may configure Personal Area Networking (PAN) through Bluetooth technology. For example, in the wireless communication system, files, documents, and the like can be exchanged quickly and safely by establishing a private piconet between devices.

Meanwhile, referring to FIGS. 1 and 2 , the ROA sensor system 100 may be located on a ceiling inside a vehicle. For example, the ROA sensor system 100 may be installed near the ceiling lamp to use a power connector applied to the ceiling lamp. The ROA sensor system 100 is

The sensor is installed on the ceiling inside the vehicle, and may include a millimeter wave radar sensor (mmWave 　Rader Sensor). Even if the millimeter wave radar sensor is installed in the center of the vehicle ceiling, a sensing range may be secured to detect objects positioned in the front driver's seat, front passenger's seat, and rear seat.

3 is a block diagram of a vehicle rear seat monitoring system and/or apparatus according to an embodiment of the present specification.

Referring to FIG. 3 , the ROA sensor system 300 includes a wireless communication unit 310 , an alarm output unit 320 , an ROA sensor 330 , a power supply unit 340 , a memory 350 , an interface unit 360 and a processor. (370). In addition, if necessary, the internal block diagram of the ROA sensor system 300 may further include other components (modules, blocks, and parts), and some of the components of FIG. 3 may be omitted. In addition, the wireless communication unit 310 , the alarm output unit 320 , the ROA sensor 330 , the power supply unit 340 , the memory 350 , the interface unit 360 , and the processor 370 are the methods proposed in this specification. are functionally linked to perform

The wireless communication unit 310 is composed of a Bluetooth module and uses Bluetooth technology to transmit a request/response, command, notification, instruction/confirmation message, etc. or data between devices inside and/or outside the vehicle using a unit (or module) capable of transmitting data. say

The alarm output unit 320 is for generating an output related to sight or sound, and according to an embodiment of the present specification, an LED LAMP may be provided to be exposed to the sensor housing.

The ROA sensor 330 may include a radar sensor. More specifically, the ROA sensor is a sensor that transmits electromagnetic waves in a specific direction, and a milli-millimeter wave radar sensor (mmWave 　Rader Sensor) may be applied. The millimeter wave radar sensor is a sensor using a frequency between 61 GHz and 70 GHz. The frequency between 61 GHz and 70 GHz has directivity that can focus electromagnetic waves in a specific direction, and electromagnetic waves composed of frequencies with such directivity are not affected by other external operations, so multiple human body 　 biometric detection is possible. can For example, if the electromagnetic wave output from the millimillimeter wave radar sensor is compared with data (eg, root sum square (RSS) value) of the reflected electromagnetic wave reflected by the person and the object, according to the dielectric constant of the object and the person, respectively It is possible to observe that an object and a person reflect different amounts of reflected electromagnetic waves, and through regression analysis of the reflected electromagnetic wave versus the output electromagnetic wave, it is possible to distinguish whether the object that reflects the electromagnetic wave is an object or a person.

The ROA sensor 330 may monitor whether an object is boarded through a front door or a rear door of the vehicle.

The ROA sensor 330 extracts a frequency from the data of the reflected electromagnetic wave and pre-processes the extracted frequency, so that the data of the reflected electromagnetic wave may check whether a person is breathing. A dominant frequency peak is generated in the frequency extracted from the reflected electromagnetic wave data, and the frequency of the frequency peak may be related to a person's respiration rate.

According to an embodiment of the present specification, when the driver leaves the vehicle and the door is locked while a person is left in the rear seat, when it is detected that the breathing rate of the rear seat object shows an abnormal breathing rate, a Bluetooth signal for confirming the existence of a simple rear seat object It is also possible to transmit a Bluetooth signal notifying an emergency situation to the mobile device.

The power supply unit 340 receives external power and internal power under the control of the processor 370 and supplies power to each component included in the ROA sensor system 300 . The power supply 340 includes a battery, and the battery may be a built-in battery or a replaceable battery. Also, the power supply unit 340 may be powered by the vehicle itself operating in the standby mode. Accordingly, it is possible to continuously monitor the object of the rear seat even when the vehicle is turned off. Alternatively, the power supply 340 may be adaptively selected and applied between the built-in battery and the vehicle's standby mode power. According to an embodiment, the BLE technology has a small duty cycle and can greatly reduce power consumption through a low data rate, so that the power supply unit 340 is configured with a small output power (10 mW (10 dBm) or less). It can supply the power necessary for the operation of the elements.

The memory 350 may store data supporting various functions of the ROA sensor system 300 . The memory 350 may store a plurality of application programs (or applications) driven in the ROA sensor system 300 , data for operation of the ROA sensor system 300 , and commands. At least some of these application programs may be downloaded from an external server through wireless communication or acquired through vehicle communication through an ECU or TCU inside the vehicle.

The interface unit 360 serves as a passage with all external devices connected to the ROA sensor system 300 . The interface unit 360 receives data from an external device, receives power and transmits it to each component inside the ROA sensor system 350 , or transmits data inside the ROA sensor system 300 to an external device. For example, according to an embodiment of the present specification, transmission of a Bluetooth signal corresponding to a sensing result of the ROA sensor, a broadcasting signal for device search, etc. may be implemented through a Bluetooth interface.

The processor 370 controls the overall operation of the RAO sensor system 300 . The processor 370 may provide or process the ROA sensing result to the user as appropriate information or function by processing an input or output signal, data, information, or the like, or driving an application program stored in the memory.

On the other hand, the vehicle communication interface is in charge of communication between the vehicle communication interface 11, ECU, TCUs, and internal and external electronic devices. ECU (Electronic Control Unit) is a device that controls various electronic devices. There are several ECUs such as EGN ECU, ABS ECU, multimedia ECU, transmission ECU, and safety related ECU. It plays a key role in controlling the system and braking system. The vehicle communication is MOST (Multimedia Oriented Systems Transport), FlexRay (10Mbps), TTP (Time Triggered Protocol) providing a data transfer rate of 25MbPS, TTCAN (Time Triggered CAN) implemented in TDMA method, IEEE1394 extension of CAN protocol IDB1394, which is characterized by 400Mbps speed as optical communication, can be applied.

4 is a block diagram of a mobile device applied to an embodiment of the present specification.

Referring to FIG. 4 , the mobile device may include a wireless communication unit 410 , an output unit 420 , a memory 430 , and a control unit 440 . The components shown in FIG. 4 are not essential for implementing a mobile device, so the mobile device described herein may have more or fewer components than those listed above.

More specifically, the wireless communication unit 410 among the components includes one or more modules that enable wireless communication between a mobile device and a wireless communication system, between a mobile device and another device, or between a mobile device and an external server. can do. In addition, the wireless communication unit 410 may include one or more modules for connecting the mobile device to one or more 5G networks. The wireless communication unit 410 may include at least one of a mobile communication module 411 , a wireless Internet module 412 , a short-range communication module 413 , and a location information module 414 .

The mobile communication module 411 is a technical standard or communication method for mobile communication (eg, Global System for Mobile communication (GSM), Code Division Multi Access (CDMA), Code Division Multi Access 2000 (CDMA2000), EV -DO (Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), WCDMA (Wideband CDMA), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), LTE-A (Long Term Evolution-Advanced, etc.) transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network constructed according to (Long Term Evolution-Advanced).

The wireless signal may include various types of data according to transmission/reception of a voice call signal, a video call signal, or a text/multimedia message.

The wireless Internet module 412 refers to a module for wireless Internet access, and may be built-in or external to the mobile device. The wireless Internet module 412 is configured to transmit and receive wireless signals in a communication network according to wireless Internet technologies.

As wireless Internet technology, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), WiMAX (World Interoperability for Microwave Access), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), 5G, etc., the wireless Internet The module 413 transmits and receives data according to at least one wireless Internet technology within a range including Internet technologies not listed above.

Short-range communication module 413 is for short-range communication, Bluetooth (Bluetooth??), RFID (Radio Frequency Identification), infrared communication (Infrared Data Association; IrDA), UWB (Ultra Wideband), ZigBee, At least one of Near Field Communication (NFC), Wireless-Fidelity (Wi-Fi), Wi-Fi Direct, and Wireless Universal Serial Bus (USB) technologies may be used to support short-range communication. The short-distance communication module 413 provides wireless communication between a mobile device and a wireless communication system through wireless area networks, between a mobile device and another mobile device, or between a mobile device and a network in which another external server is located. can support The local area network may be local area networks (Wireless Personal Area Networks).

The location information module 414 is a module for acquiring a location (or current location) of a mobile device, and a representative example thereof includes a Global Positioning System (GPS) module or a Wireless Fidelity (WiFi) module. For example, if the mobile device utilizes the GPS module, it may acquire the location of the mobile device by using a signal transmitted from a GPS satellite. As another example, if the mobile device utilizes the Wi-Fi module, it may acquire the location of the mobile device based on information of the Wi-Fi module and a wireless access point (AP) that transmits or receives a wireless signal. If necessary, the location information module 414 may perform any function of other modules of the wireless communication unit in order to obtain data on the location of the mobile device as a substitute or additionally. The location information module 414 is a module used to obtain the location (or current location) of the mobile device, and is not limited to a module that directly calculates or obtains the location of the mobile device.

The output unit 420 may include a display unit 421 , a sound output unit 422 , and a haptic module 423 . The display unit 421 outputs information processed by the mobile device. According to an embodiment of the present specification, the display unit 421 may display execution screen information of the ROA application executed on the mobile device, or user interface information according to the execution screen information. Alternatively, the display unit 421 may output the rear seat object alarm in the form of a message according to an embodiment of the present specification.

The sound output unit 422 may output audio data received from the wireless communication unit or stored in a memory in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. The sound output unit 422 also outputs a sound signal related to a function (eg, a call signal reception sound, a message reception sound, etc.) performed by the mobile device 100 . The sound output unit 422 may include a receiver, a speaker, a buzzer, and the like.

The haptic module 423 generates various tactile effects that the user can feel. For example, according to an embodiment of the present specification, the haptic module 423 may output a rear seat object detection alarm signal by synthesizing and outputting different vibrations or sequentially outputting them.

The light output unit outputs a signal for notifying the occurrence of an event by using the light of the light source of the mobile device. Examples of the event generated in the mobile device may include message reception, call signal reception, missed call, alarm, schedule notification, email reception, information reception through an application, and the like. The signal output by the light output unit is realized as the mobile device emits light of a single color or a plurality of colors toward the front or rear side. The signal output may be terminated when the mobile device detects the user's event confirmation.

The memory 430 may store a program for the operation of the controller 440 , and may temporarily store input/output data (eg, a phone book, a message, a still image, a moving image, etc.). The memory 430 may include a flash memory type, a hard disk type, a solid state disk type, a silicon disk drive type SDD, and a multimedia card micro type. ), card-type memory (such as SD or XD memory), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read (EEPROM) -only memory), a programmable read-only memory (PROM), a magnetic memory, a magnetic disk, and an optical disk may include at least one type of storage medium.

The configuration of the wireless communication system, the ROA sensor system, and the mobile device for implementing the method for monitoring the rear seat of a vehicle according to an embodiment of the present specification has been described above with reference to FIGS. 1 to 4 . Hereinafter, a specific method for implementing rear seat monitoring and alarm provision according to an embodiment of the present specification will be described with reference to the drawings. The operation of performing the steps described in the following drawings (flow chart, etc.) may be implemented through the system described with reference to FIGS. 1 to 4 , the processor of the ROA sensor system, and/or the mobile device in which the ROA application is installed.

5 is a diagram for explaining an example of a mobile device registration process for monitoring the rear seat of a vehicle according to an embodiment of the present specification.

Referring to FIG. 5 , the ROA sensor system detects that the vehicle is turned on ( 500 ). The Bluetooth module of the ROA sensor system broadcasts a Bluetooth signal (510). The Bluetooth signal may include a Bluetooth LE signal. The broadcast Bluetooth signal may be a signal for discovering a mobile device in which the ROA application is installed. The ROA sensor system may receive a response signal to the transmitted BLE signal, and determine whether there is at least one mobile device on which the ROA application is installed ( 520 ).

The ROA application may be an application that manages a sensing result of the ROA sensor, output and/or transmission of a Bluetooth signal including the sensing result, and whether an alarm is output according to reception of a Bluetooth signal. Through the ROA application, the mobile device may be provided with the vehicle rear seat monitoring service according to an embodiment of the present specification. The ROA application is exemplary and the present specification is not limited thereto, and the vehicle rear seat monitoring service may be provided through a specific wireless communication method with a vehicle and/or ROA sensor system that is not embedded in a mobile device.

The ROA sensor system may notify the driver or the like through an alarm output unit (eg, LED LAMP output) of the ROA sensor system when the mobile device in which the ROA application is installed is not found in the vehicle. The driver may receive the rear seat service provided by the ROA sensor system by installing the ROA application in the mobile device based on the alarm. According to an embodiment, the ROA sensor system may output the ROA application installation information to a display inside the vehicle. The ROA application may be installed in the driver's mobile device through a user operation on the displayed and output ROA application installation information.

When a mobile device in which the ROA application is installed is found in the vehicle, the ROA sensor system may wait for activation of the ROA sensor without outputting an alarm through an alarm output unit of the ROA sensor system.

Hereinafter, an alarm method for detecting an object in the rear seat of a vehicle by transmitting a condition for activating the operation of the ROA sensor and a sensing result to an external device will be described in more detail.

6 is a flowchart of a vehicle rear seat monitoring method through a vehicle rear seat monitoring system according to an embodiment of the present specification.

Referring to FIG. 6 , the ROA sensor system may be installed inside a vehicle, preferably on a ceiling inside the vehicle, as described above.

The ROA sensor system activates the ROA sensor ( 610 ) as it detects that the vehicle's ignition is off ( 600 ). The ROA sensor may be operated in a low-power mode in a deactivated state while the vehicle is driving.

The ROA sensor system collects and analyzes a sensing signal of a millimeter wave radar sensor (hereinafter referred to as a radar sensor) ( 620 ). A specific signal analysis method for detecting an organism, a person, etc. through radar signal analysis is a well-known method, and detailed description thereof will be omitted. When it is determined that a person is present in the rear seat of the vehicle as a result of analyzing the radar signal (630:Y), the ROA sensor system may determine whether there is a case in which the vehicle door is switched to the locked state after the ignition of the vehicle is turned off (640) ).

When the ROA sensor system detects the lock state of the vehicle door, the ROA sensor system may transmit a Bluetooth signal including the sensing result to the pre-registered mobile device through the Bluetooth module.

Meanwhile, after the ignition of the vehicle is turned off, the pre-registered mobile device may move away from the vehicle. More specifically, the ROA sensor system detects that 1) the vehicle's ignition is off, 2) the vehicle front door is opened, and 3) the vehicle door lock is detected sequentially, when a person in the rear seat of the vehicle is detected. It may be determined that the vehicle door is locked while remaining.

Meanwhile, the ROA sensor system may transmit a Bluetooth signal to a pre-registered mobile device after confirming the locked state of the vehicle door ( 645 ). The Bluetooth signal may be a signal indicating that a person is present in the rear seat of the vehicle, but the mobile device does not immediately output an alarm upon receiving the BLE signal. The mobile device may determine the distance to the ROA sensor system based on the signal reception strength of the received Bluetooth signal. The mobile device may output an alarm ( 660 ) when it is determined that the checked distance is out of a predetermined threshold wireless distance ( 650 ). The threshold wireless distance may mean a maximum distance through which Bluetooth communication is possible between the ROA sensor system and the mobile device.

Meanwhile, the ROA sensor system does not transmit the BLE signal to a pre-registered mobile device when a person is detected in the rear seat of the vehicle as a result of sensing by the ROA sensor, but the lock state of the vehicle door is not detected.

7 is a flowchart illustrating an alarm method through a vehicle rear seat monitoring system when there are a plurality of registered mobile devices according to an embodiment of the present specification.

Referring to FIG. 7 , the ROA sensor system transmits a Bluetooth signal in a state in which sequential operations of 1) vehicle start-off detection, 2) ROA sensing result, person detection, and 3) vehicle door lock state detection are detected. There may be a case where there are a plurality of mobile devices.

The ROA sensor system may determine whether there are a plurality of registered mobile devices ( 700 ). When there are a plurality of registered devices, the ROA sensor system transmits a BLE signal to each of the first mobile device MD1 and the second mobile device MD2 ( 710 and 715 ).

When the first mobile device MD1 determines that the distance to the ROA sensor system does not deviate from the threshold wireless distance (720:N), the second mobile device MD2 sets the threshold wireless distance through the first mobile device ROA application. You can share whether or not you are out.

The ROA sensor system may compare the distance D1 between the first mobile device MD1 and the ROA sensor system and the distance D2 between the second mobile device MD2 and the ROA sensor system ( 740 ). When D1 is greater than D2, the alarm may be output through the second mobile device MD2 when the second mobile device MD2 deviates from the threshold radio distance.

After confirming distance information between each mobile device and the vehicle through the ROA application, the second mobile device may prepare an alarm output when it is confirmed that the first mobile device first deviates from the threshold wireless distance. When it is determined that the distance to the vehicle is out of the threshold wireless distance (760:Y), the second mobile device may output an alarm.

Hereinafter, when a plurality of mobile devices registered in the ROA sensor system exist, a process of selecting a mobile device outputting an alarm will be described in more detail.

8 to 9 are views for explaining the embodiment shown in FIG. 7 .

Referring to FIG. 8 , the ROA sensor system (hereinafter, may be described as a vehicle) and a critical wireless distance (hereinafter referred to as a BT distance) are referred to. When there are a plurality of mobile devices registered in the ROA sensor system according to an embodiment of the present specification, a plurality of mobile devices A and B may exist within a BT distance. The BT distance may be divided into a plurality of sections (Zone 1, Zone 2, Zone 3) according to the distance from the vehicle point. 7 , the vehicle transmits a Bluetooth signal to a device A located in Zone 1 and a BLE signal to a device B located in Zone 3, respectively. The ROA application may suspend alarm output until a point in time when any one device is out of the BT distance and another device exists within the BT distance when the other device is out of the BT distance. Here, the other device means a device having a close distance to the vehicle.

Referring to FIG. 9 , when two devices A and B are present in the same zone (zone 2) within a BT distance, both devices A and B are in a state of receiving a Bluetooth signal, and the ROA application is When both the devices A and B are out of the BT distance, an alarm may be output to both the devices A and B.

According to an embodiment of the present specification, the ROA sensor may control to generate a BLE signal by distinguishing a first state in which a person is detected in the rear seat of a vehicle and a second state in which a person is not detected. For example, the ROA sensor system may transmit a first Bluetooth signal when a person is detected in the rear seat of the vehicle as a result of sensing by the sensor, and transmit a second Bluetooth signal when the person is not detected. When the mobile device receives the second Bluetooth signal, the mobile device may be controlled so that an alarm is not output from the mobile device regardless of a critical wireless distance.

In addition, there may be a case in which the sensing result of the sensor is changed while any one of the first Bluetooth signal and the second Bluetooth signal is transmitted to a specific mobile device. For example, when no person is detected in the rear seat of the vehicle while the ROA sensor is activated, a second Bluetooth signal may be generated and transmitted to the mobile device. When a person is detected in the rear seat of the vehicle as a result of the sensing of the ROA sensor before the mobile device leaves the BT distance, a first Bluetooth signal is generated instead of the second Bluetooth signal and transmitted to the mobile device, and the mobile device immediately leaves the BT distance, An alarm can be output.

In addition, according to an embodiment of the present specification, the mobile device may output an alarm screen through the display unit of the mobile device after the mobile device leaves the BT distance and an alarm is output. The alarm screen may include a user interface capable of remotely controlling the lock state of the vehicle door, and the mobile device may unlock the vehicle door lock state through manipulation of the user interface.

Meanwhile, according to an embodiment of the present specification, when the vehicle door is switched to the locked state after the vehicle is turned off, the case of transmitting the Bluetooth signal including the sensing result to the mobile device has been described, but the door lock signal In the case of a vehicle that does not provide the ROA sensor system, the sensing result may be transmitted to the mobile device regardless of whether the vehicle door is locked.

The above-described specification can be implemented as computer-readable code on a medium in which a program is recorded. The computer-readable medium includes all kinds of recording devices in which data readable by a computer system is stored. Examples of computer-readable media include Hard Disk Drive (HDD), Solid State Disk (SSD), Silicon Disk Drive (SDD), ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc. There is also a carrier wave (eg, transmission over the Internet) that includes implementation in the form of. Accordingly, the above detailed description should not be construed as restrictive in all respects but as exemplary. The scope of the present invention should be determined by a reasonable interpretation of the appended claims, and all modifications within the equivalent scope of the present invention are included in the scope of the present invention.

10: vehicle
20: mobile device
100: ROA sensor system

Claims (21)

wireless communication module;
a sensor inside the vehicle that detects an object in the vehicle rear seat; and
When detecting the object, a processor for controlling the wireless communication module to transmit a wireless signal notifying that the object exists in the rear seat of the vehicle to a pre-registered mobile device;
The mobile device, as the wireless signal is received, the rear seat monitoring system, characterized in that the alarm is output when the distance to the wireless communication module exceeds a threshold wireless distance.
The method of claim 1,
The wireless communication module includes a Bluetooth module,
The wireless signal is a vehicle rear seat monitoring system, characterized in that the Bluetooth signal.
3. The method of claim 2,
Alarm unit; further comprising,
The processor is
When the vehicle is turned on, a first Bluetooth signal is broadcast, and when at least one mobile device in which a Rear Occupant Alert (ROA) application is installed is not detected, an alarm is output through the alarm unit. A vehicle rear-seat monitoring system.
3. The method of claim 2,
The processor is
The rear seat monitoring system of the vehicle, characterized in that when the vehicle is turned off (off), the sensor is controlled to operate.
5. The method of claim 4,
The processor is
When the lock of the vehicle door is detected after the sensor is operated, a Bluetooth signal including a sensing result is transmitted to the pre-registered mobile device.
6. The method of claim 5,
When there are a plurality of pre-registered mobile devices,
The processor transmits the Bluetooth signal to each of the plurality of mobile devices,
The rear seat monitoring system of the vehicle, characterized in that the plurality of devices are linked through a rear occupant alert (ROA) application.
7. The method of claim 6,
When any one mobile device deviates from the threshold wireless distance while all of the plurality of mobile devices have received the Bluetooth signal, the alarm is output from a mobile device that is close to the vehicle. monitoring system.
7. The method of claim 6,
The rear seat monitoring system according to claim 1 , wherein the alarm is output to all of the plurality of mobile devices when all of the mobile devices deviate from the threshold wireless distance while all of the plurality of mobile devices have received the Bluetooth signal.
6. The method of claim 5,
As a result of the sensing, a person is detected in the rear seat of the vehicle,
The mobile device receiving the Bluetooth signal,
When the distance between the vehicle rear seat monitoring system and the mobile device is within the threshold wireless distance, the alarm is maintained in a state in which it is not output, and when it is out of the threshold wireless distance, the alarm is output. Rear seat monitoring system.
5. The method of claim 4,
For vehicles that do not provide a door lock signal,
The processor is
After the sensor is operated, a Bluetooth signal including a sensing result is transmitted to the pre-registered mobile device.
3. The method of claim 2,
The processor is
When a person is detected in the rear seat of the vehicle as a result of the sensing of the sensor, a first Bluetooth signal is transmitted, and when the person is not detected, a second Bluetooth signal is transmitted,
When the mobile device receives the second Bluetooth signal, an alarm is not output from the mobile device regardless of the critical wireless distance.
9. The method of claim 8,
The processor is
When the sensing result of the sensor changes while transmitting any one Bluetooth signal of the first Bluetooth signal or the second Bluetooth signal to the mobile device, switching to another Bluetooth signal and controlling the transmission Vehicle rear seat monitoring system.
The method of claim 1,
When a predetermined operation is inputted from the mobile device after the alarm is output, the vehicle rear seat monitoring system according to claim 1 , wherein the control system controls the door of the vehicle to be opened.
The method of claim 1,
The sensor is installed on the ceiling inside the vehicle, and the rear seat monitoring system, characterized in that it includes a milli-millimeter wave radar sensor (mmWave Rader Sensor).
15. The method of claim 14,
The object includes a living organism,
wherein the processor analyzes the signal of the millimeter wave radar sensor to confirm the existence of the object.
3. The method of claim 2,
The Bluetooth signal is a vehicle rear seat monitoring system, characterized in that it includes a BLE (Bluetooth Low Energy) signal.
detecting at least one mobile device in which a Rear Occupant Alert (ROA) application is installed by broadcasting a first Bluetooth signal through a wireless communication module when the vehicle is started;
controlling a sensor inside the vehicle that detects an object in the rear seat of the vehicle to be operated when the ignition of the vehicle is turned off;
transmitting a Bluetooth signal including a sensing result to a pre-registered mobile device when the lock of the vehicle door is detected after the sensor is operated; and
controlling the mobile device to output an alarm when it is detected that the mobile device deviates from the threshold wireless distance with the vehicle;
A vehicle rear seat monitoring method comprising a.
18. The method of claim 17,
The sensor is installed on the ceiling inside the vehicle, and includes a millimeter wave radar sensor (mmWave Rader Sensor),
The method of monitoring the rear seat of a vehicle further comprising: analyzing a signal of the millimeter wave radar sensor to determine whether the object exists.
18. The method of claim 17,
When there are a plurality of pre-registered mobile devices,
transmitting the Bluetooth signal to each of the plurality of mobile devices;
monitoring a distance between the plurality of mobile devices and the vehicle, respectively;
controlling the alarm to be output from the first mobile device when the first mobile device, which is close to the vehicle, deviates from the wireless threshold distance;
Vehicle rear seat monitoring method comprising a.
18. The method of claim 17,
When there are a plurality of pre-registered mobile devices,
controlling the alarm to be output from a specific mobile device based on the distances of the plurality of mobile devices to the vehicle through the ROA application;
Vehicle rear seat monitoring method, characterized in that it further comprises.
18. The method of claim 17,
When at least one mobile device on which the Rear Occupant Alert (ROA) application is installed is not detected,
outputting information related to the installation of the ROA application to a display provided in the vehicle; and
registering the at least one mobile device in a rear seat monitoring system of the vehicle by allowing the ROA application to be installed in the at least one mobile device as a predetermined input is received;
Vehicle rear seat monitoring method, characterized in that it further comprises.

Images