CN105292124A - Driving monitoring method and driving monitoring device - Google Patents
Driving monitoring method and driving monitoring device Download PDFInfo
- Publication number
- CN105292124A CN105292124A CN201410276252.7A CN201410276252A CN105292124A CN 105292124 A CN105292124 A CN 105292124A CN 201410276252 A CN201410276252 A CN 201410276252A CN 105292124 A CN105292124 A CN 105292124A
- Authority
- CN
- China
- Prior art keywords
- information
- acceleration
- driving
- threshold
- sound
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 63
- 238000000034 method Methods 0.000 title claims abstract description 47
- 238000012806 monitoring device Methods 0.000 title claims abstract description 15
- 230000010365 information processing Effects 0.000 claims abstract description 16
- 230000001133 acceleration Effects 0.000 claims description 171
- 230000014509 gene expression Effects 0.000 claims description 71
- 206010022998 Irritability Diseases 0.000 claims description 26
- 238000012545 processing Methods 0.000 claims description 21
- 238000011156 evaluation Methods 0.000 claims description 12
- 238000001514 detection method Methods 0.000 claims description 6
- 230000000622 irritating effect Effects 0.000 claims description 3
- 230000008451 emotion Effects 0.000 description 18
- 230000036651 mood Effects 0.000 description 6
- 206010039203 Road traffic accident Diseases 0.000 description 4
- 230000006399 behavior Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 210000004709 eyebrow Anatomy 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 206010027940 Mood altered Diseases 0.000 description 1
- 238000010252 digital analysis Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000000116 mitigating effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000001228 spectrum Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/16—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state
- A61B5/18—Devices for psychotechnics; Testing reaction times ; Devices for evaluating the psychological state for vehicle drivers or machine operators
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Automation & Control Theory (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Transportation (AREA)
- Mechanical Engineering (AREA)
- Child & Adolescent Psychology (AREA)
- Heart & Thoracic Surgery (AREA)
- Educational Technology (AREA)
- Hospice & Palliative Care (AREA)
- Psychiatry (AREA)
- Psychology (AREA)
- Social Psychology (AREA)
- Mathematical Physics (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Developmental Disabilities (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Human Computer Interaction (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention discloses a driving monitoring method and a driving monitoring device. The method comprises the steps that real-time information during driving of a user is monitored; and the monitored real-time information is compared with stored driving reference information, and whether a prompt is sent out or not is determined according to a comparison result. Accordingly, the invention further discloses a driving monitoring device which comprises a monitoring module and an information processing module.
Description
Technical Field
The invention relates to the field of terminals, in particular to a method and a device for monitoring safe driving.
Background
With the arrival of the automobile age, the contradiction between the growing automobiles and the increasingly congested roads is continuously intensified, and the accompanying traffic accidents are also endless. According to the statistics of the traffic department, most traffic accidents are actually caused by the factors of the driver, and nine times of ten accidents are fast. The fussy mood of the driver is the main reason for the overspeed of the automobile, and the dangerous driving causes unnecessary traffic accidents to a great extent.
Although methods for using a mobile terminal for mitigating the emotion of a user and some methods for monitoring safe driving of an automobile are available, these methods have great limitations in monitoring dangerous driving. The emotion is relieved by utilizing the mobile terminal, the user is required to wear the perception receiver, and the configuration and the portable wearing of the receiver are forbidden for many people; the safe driving monitoring starts only from expressions, important factors of sound are ignored, and the current driving condition cannot be monitored more comprehensively; in addition, the two methods lack a data acquisition process, and are not accurate enough for judging the emotion of the driver.
Disclosure of Invention
In order to solve the existing problems, the invention mainly provides a driving monitoring method and a driving monitoring device, which can monitor the emotion and the vehicle condition of a driver in real time, remind the driver when danger is pre-judged, relieve the mood of the driver, eliminate dangerous driving behaviors and avoid unnecessary traffic accidents to a great extent.
The technical scheme of the invention is realized as follows:
the invention provides a driving monitoring method, which comprises the following steps:
monitoring real-time information of a user during driving; and comparing the monitored real-time information with the stored driving reference information, and determining whether to send out a prompt according to a comparison result.
In the above solution, before monitoring the real-time information of the user while driving, the method further includes: collecting and storing driving reference information in a learning mode;
the driving reference information includes: an expressive image of irritability or anger and/or a disturbing or angry sound and/or velocity threshold information.
In the above scheme, the acquiring of the expression image of irritability or anger and/or the sound of irritability or anger and the storing includes: capturing an expression image of irritability or anger which appears in driving and is shown by a user by using a camera, digitizing the expression image, and storing the obtained first digital image information; and/or recording the sound of irritability or anger which appears in the driving process and is shown by the user by using a microphone, digitizing the sound, and storing the obtained first digital sound information.
In the above scheme, the monitoring of the real-time information of the user during driving includes: the camera captures the expression of the driver according to a preset frequency, and/or the microphone collects the voice of the driver according to the preset frequency, and/or the acceleration sensor detects the current acceleration information of the vehicle, and the collected expression image, and/or voice information, and/or acceleration information are recorded; wherein the acceleration information includes an instantaneous value a of a horizontal accelerationhiAnd instantaneous value a of vertical accelerationvi。
In the above scheme, the comparing the stored driving reference information with the monitored real-time information, and determining whether to send a reminder according to the comparison result includes: digitally processing the recorded monitored expression image to obtain second digital image information; and comparing the similarity of the second digital image information with the stored first digital image information, and sending out a safe driving prompt when the similarity is greater than the expression similarity threshold.
In the above scheme, the comparing the stored driving reference information with the monitored real-time information, and determining whether to send a reminder according to the comparison result includes: and carrying out digital processing on the recorded monitored sound information to obtain second digital sound information, carrying out similarity comparison on the second digital sound information and the stored first digital sound information, and sending out a safe driving prompt when the similarity is greater than a sound similarity threshold value.
In the above scheme, comparing the stored driving reference information with the monitored real-time information, and sending a prompt according to the comparison result includes: and comparing the speed threshold information with the detected acceleration information, and sending out a safe driving prompt when the detected acceleration information is greater than the speed threshold information.
In the foregoing solution, the speed threshold information includes: horizontal acceleration instantaneous value threshold ahmInstantaneous value threshold a of vertical accelerationvmHorizontal acceleration integrated value threshold ahaAnd a vertical acceleration integrated value threshold ava；
Comparing the speed threshold information with the detected acceleration information, and sending out a safe driving prompt when the detected acceleration information is greater than the speed threshold information, wherein the safe driving prompt comprises the following steps:
comparing the horizontal acceleration instantaneous value threshold value ahmWith instantaneous value a of the monitored horizontal accelerationhiWhen instantaneous value a of horizontal accelerationhiWhen the driving is high, a safe driving prompt is sent;
comparing the horizontal acceleration integrated value ahAnd a horizontal acceleration integrated value threshold ahaWhen the horizontal acceleration integrated value ahWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration instantaneous value threshold value avmWith instantaneous value a of said monitored vertical accelerationviWhen the instantaneous value a of the vertical accelerationviWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration integrated value avWith stored vertical acceleration integrated value threshold avaWhen the vertical acceleration integrated value avWhen the driving is high, a safe driving prompt is sent;
wherein the horizontal acceleration integrated value ahFor instantaneous value a of horizontal acceleration in a given time intervalhiThe sum of (1):the vertical acceleration integrated value avFor instantaneous value a of vertical acceleration in a given time intervalviThe sum of (1):
in the above scheme, the method further comprises: revisiting the user, providing a user evaluation interface, correcting threshold information according to the evaluation result of the user or reminding the user to select to enter the learning mode again, collecting and storing driving reference information; wherein,
the threshold information includes: expression similarity threshold, sound similarity threshold, and speed threshold information.
The present invention also provides a driving monitoring device, the device comprising: the monitoring module and the information processing module; wherein,
the monitoring module is used for monitoring real-time information of a user during driving;
and the information processing module is used for comparing the monitored real-time information with the stored driving reference information and determining whether to send out a prompt or not according to a comparison result.
The above-mentioned device still includes: the system comprises an information acquisition module and a storage module; wherein,
the information acquisition module is used for acquiring driving reference information in a learning mode before monitoring real-time information of a user during driving;
the storage module is used for storing the collected driving reference information;
the driving reference information includes: an expressive image of irritability or anger, and/or a sound of irritability or anger, and/or velocity threshold information.
In the above scheme, the information acquisition module includes: the system comprises an image acquisition module and a sound acquisition module; wherein,
the image acquisition module is used for capturing an expression image of irritability or anger which appears in driving and is shown by a user;
and the sound acquisition module is used for recording the irritative or angry sound which appears in the driving process and is shown by the user.
In the above scheme, the information processing module is specifically configured to digitize the expression image and/or the sound, and store the obtained first digital image information and/or first digital sound information in the storage module.
In the above scheme, the apparatus further comprises: an acceleration detection module for detecting the current acceleration information of the vehicle, wherein the acceleration information comprises the instantaneous value a of the horizontal accelerationhiAnd instantaneous value a of vertical accelerationvi；
The monitoring module is specifically used for controlling an image acquisition module in the information acquisition module to capture the expression of the driver according to a preset frequency, and/or controlling a sound acquisition module of the information acquisition module to acquire the sound of the driver according to the preset frequency, and/or controlling the acceleration detection module to detect the current acceleration information of the vehicle; and recording the collected expression images, and/or sound information, and/or acceleration information.
In the above scheme, the information processing module is specifically configured to perform digital processing on the recorded monitored expression images and/or sound information to obtain second digital image information and/or second digital sound information; comparing the similarity of the second digital image information with the stored first digital image information, and sending a safe driving prompt when the similarity is greater than an expression similarity threshold; and/or comparing the similarity of the second digital sound information with the stored first digital sound information, and sending a safe driving prompt when the similarity is greater than a sound similarity threshold; and/or comparing the speed threshold information with the acceleration information detected by the monitoring module, and sending out a safe driving prompt when the detected acceleration information is greater than the speed threshold information.
In the foregoing solution, the speed threshold information includes: horizontal acceleration instantaneous value threshold ahmInstantaneous value threshold a of vertical accelerationvmHorizontal acceleration integrated value threshold ahaAnd a vertical acceleration integrated value threshold ava；
Comparing the speed threshold information with the acceleration information detected by the monitoring module, and sending a safe driving prompt when the detected acceleration information is greater than the speed threshold information, wherein the safe driving prompt comprises the following steps:
comparing the horizontal acceleration instantaneous value threshold value ahmWith the instantaneous value a of the horizontal acceleration detected by the monitoring modulehiWhen the instantaneous value a of the horizontal accelerationhiWhen the driving is high, a safe driving prompt is sent;
comparing the horizontal acceleration integrated value ahWith stored horizontal acceleration integrated value threshold ahaWhen the horizontal acceleration integrated value ahWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration instantaneous value threshold value avmFrom the instantaneous value a of the vertical accelerationviWhen the instantaneous value a of the vertical accelerationviWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration integrated value avWith stored vertical acceleration integrated value threshold avaWhen the vertical acceleration integrated value avWhen the driving is high, a safe driving prompt is sent;
wherein the horizontal acceleration integrated value ahFor instantaneous value a of horizontal acceleration in a given time intervalhiThe sum of (1):the vertical acceleration integrated value avFor instantaneous value a of vertical acceleration in a given time intervalviThe sum of (1):
in the above scheme, the apparatus further comprises: the monitoring and correcting module and the control module; wherein,
the monitoring and correcting module is used for providing an evaluation interface for a user after monitoring is finished, correcting threshold information stored in the storage module according to an evaluation result of the user or reminding the user to select to enter a learning mode again, collecting and storing driving reference information;
the threshold information includes: expression similarity threshold, sound similarity threshold, speed threshold information;
and the control module is used for controlling and managing the execution flow of each module in the monitoring device.
The driving monitoring method and the driving monitoring device provided by the invention monitor the real-time information of a user during driving; comparing the monitored real-time information with stored driving reference information, and determining whether to send out a prompt according to a comparison result; therefore, the emotion of the driver can be more accurately evaluated and judged through the driving reference information, the speed information of the vehicle can be monitored, whether dangerous driving belongs to or not is judged according to the emotion of the driver and the speed of the vehicle, the driver is timely reminded to pay attention when danger is pre-judged, the mood of the driver is relieved, dangerous driving behaviors are eliminated, and therefore the safety of automobile driving is improved.
Drawings
Fig. 1 is a schematic flow chart of a safe driving monitoring method according to an embodiment of the present invention;
fig. 2 is a flowchart of a specific implementation of step 101 according to an embodiment of the present invention;
FIG. 3 is a flowchart illustrating a specific implementation of step 102 according to an embodiment of the present invention;
fig. 4 is a schematic view of a specific flow chart of acquiring and processing an expression image according to an embodiment of the present invention;
FIG. 5 is a schematic view of a specific process for collecting and processing sound according to an embodiment of the present invention;
fig. 6 is a schematic diagram of a specific process for acquiring and processing acceleration information according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a safe driving monitoring device according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of an information acquisition module according to an embodiment of the present invention.
Detailed Description
In the embodiment of the invention, the driving monitoring device monitors the real-time information of the user during driving; and comparing the monitored real-time information with the stored driving reference information, and determining whether to send out a prompt according to a comparison result.
The invention is further described in detail below with reference to the figures and the specific embodiments.
Fig. 1 is a flowchart illustrating a safe driving monitoring method according to an embodiment of the present invention, where the method includes the following steps:
step 100: entering a learning mode, collecting and storing driving reference information; wherein the driving reference information includes: an expressive image of irritability or anger, and/or a sound of irritability or anger, and/or velocity threshold information;
specifically, as shown in fig. 2, the present step includes several steps:
step 100 a: the device enters a learning mode;
step 100 b: starting a front camera to prompt a user to start a learning mode and ask the user to input worried or angry expression information which may appear in driving; the camera captures an expression which is shown by the face of the user and is irritative or angry in driving to generate an expression image;
the expression image can be displayed on a screen; waiting for the user to confirm whether to store or not;
step 100 c: the user makes a selection according to the storage options on the screen, and when the selection is yes, the current expression image is stored; when the selection is not, discarding the current expression; a plurality of expressions can be input according to the needs of a user; after the expression recording is finished, performing step 100 d;
step 100 d: starting a microphone, prompting a user to input a fussy or angry speech which can appear in driving, and recording the fussy or angry sound which can appear in driving by the user by using the microphone;
the sound can also be displayed in a mode of frequency spectrum and the like in a simulation mode, and a user is waited to confirm whether to store or not;
step 100 e: when the user selects to save the recording, storing the current sound; when the selection is not stored, discarding the current sound; a plurality of sounds can be recorded according to the needs of a user;
the steps of expression recording and sound recording are not in sequence, only one or both of the steps can be collected, and the steps are described for clarity;
step 100 f: carrying out digital analysis processing on the collected expression images and/or sounds to obtain first digital image information and/or first digital sound information; the first digital image information and/or the first digital sound information are/is coded and then stored in a database; wherein,
when the expression images are digitally processed, important information in each expression image can be extracted, such as: eyebrow, eye, mouth, etc.;
when the sound is processed digitally, important factors in the sound can also be analyzed and processed, such as: pitch, etc.
Step 101: monitoring real-time information of a user during driving;
specifically, as shown in fig. 3, the present step includes the following specific steps:
step 101 a: in the driving process, the equipment captures the expression and/or sound of a driver according to a preset frequency;
specifically, the camera captures the expression of the driver according to a preset frequency, such as 20 times/minute, and the microphone collects the sound of the driver according to the preset frequency, such as 20 times/minute; wherein,
the method further comprises the following steps: detecting current acceleration information of a vehicle through an acceleration sensor, wherein the acceleration information comprises: instantaneous value a of horizontal accelerationhiAnd instantaneous value a of vertical accelerationviCarrying out detection;
recording the collected expression images and/or sound information and/or acceleration information;
here, the recorded acceleration information is absolute value information without direction.
Step 101 b: and recording the expression image and/or the sound information and/or the acceleration information acquired in the step 101 a.
Step 102: comparing the monitored real-time information with stored driving reference information, and determining whether to send out a prompt according to a comparison result;
specifically, the comparing comprises: expression contrast and/or sound contrast and/or speed contrast;
firstly, digitally processing the recorded monitored real-time expression image and/or sound information to obtain second digital image information and/or second digital sound information; the specific process of the digital processing is preferably consistent with that in the step 100f, so that a more accurate emotion judgment result can be obtained;
secondly, comparing the similarity of the second digital image information and the stored first digital image information, and when the similarity is greater than an expression similarity threshold SfWhen the driver is in a state of irritability and anger, the current emotion of the driver is shown, and a safe driving prompt is sent;
comparing the similarity of the second digital sound information with the stored first digital sound information, and when the similarity is greater than a sound similarity threshold SvWhen the driver is in a state of irritability and anger, the current emotion of the driver is shown, and a safe driving prompt is sent;
wherein the expression similarity threshold SfAnd/or sound similarity threshold SvThe critical value of normal emotion, irritability and anger obtained by a designer according to emotion analysis is stored in the equipment in advance;
when the expression similarity is larger than the expression similarity threshold SfThe time and/or sound similarity is larger than the sound similarity thresholdS vThe current emotion of the driver can be considered to be rather irritated or angry, and the safety reminder sent by the equipment can be a sound and/or an image; for example, the driver may be reminded "monitor you now in a bad mood, which may affect your safe driving, please walk carefully, pay attention to safety"; a pattern which can relieve the mood of the driver, such as a smiling face, can be drawn on the screen of the device at the moment; meanwhile, the device can relieve the emotion of the driver by playing some light music;
the speed comparison is: comparing the speed threshold information with the detected acceleration information, and when the detected acceleration information is greater than the speed threshold information, indicating that the current driving condition is not good, sending a safe driving prompt;
wherein the speed threshold information comprises: horizontal acceleration instantaneous value threshold ahmHang downThreshold value a of instantaneous value of direct accelerationvmHorizontal acceleration integrated value threshold ahaAnd a vertical acceleration integrated value threshold; these thresholds are set according to the safe driving vehicle speed, and are stored in the device in advance;
specifically, the comparing the speed threshold information with the detected acceleration information, and when the detected acceleration information is greater than the speed threshold information, sending a safe driving prompt, includes:
comparing the horizontal acceleration instantaneous value threshold value ahmWith the instantaneous value a of the horizontal acceleration detected by the monitoring modulehiWhen the instantaneous value a of the horizontal accelerationhiWhen the vehicle speed is high, the current vehicle speed is too high, and a safe driving prompt is sent;
comparing the horizontal acceleration integrated value ahWith stored horizontal acceleration integrated value threshold ahaWhen the horizontal acceleration integrated value ahWhen the vehicle speed is high, the current vehicle speed is too high, and a safe driving prompt is sent;
comparing the vertical acceleration instantaneous value threshold value avmWith instantaneous value a of said monitored vertical accelerationviWhen the instantaneous value a of the vertical accelerationviWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration integrated value avWith stored vertical acceleration integrated value threshold avaComparing the obtained values when the vertical acceleration is the integrated value avWhen the driving is high, a safe driving prompt is sent;
wherein the horizontal acceleration integrated value ahFor instantaneous value a of horizontal acceleration in a given time intervalhiThe sum of (1):the vertical acceleration integrated value avFor instantaneous value a of vertical acceleration in a given time intervalviThe sum of (1):
the designated time interval is set by a designer or a user in advance and can be any time;
when the horizontal acceleration integrated value ahGreater than the accumulated threshold a of horizontal accelerationhaAnd/or vertical acceleration integrated value avIs greater than the vertical acceleration accumulated threshold avaWhen the vehicle is in use, the vehicle can be considered to have an overstimulated driving behavior within a period of time, and the device can remind the driver of the overstimulated driving behavior through sound and image information; for example, the driver may be reminded to "monitor that the current driving condition of the vehicle is too violent" if you are annoyed. Please take care to walk slowly, pay attention to safety "; a pattern, such as a smiling face, may also be drawn on the device screen at this time that may ease the mood of the driver. While the device may ease the mood of the driver by playing some light music.
The monitoring method for safe driving further comprises the following steps:
step 103: revisiting the user, providing a user evaluation interface, correcting the stored threshold information according to the evaluation result of the user or reminding the user to select to enter the learning mode again, collecting and storing the driving reference information;
the threshold information includes: expression similarity threshold, sound similarity threshold, and speed threshold information.
Specifically, the accuracy and timeliness of the safety driving reminding of the user are scored in a screen display and sound reminding mode; for example, the score can be divided into 1-10 scores, and the equipment corrects each preset threshold value through the score of the user; when the score is too low, e.g., below 5 points, the user is alerted whether to restart the learning process.
The flow of the above step 102 and step 103 can be specifically represented by the flow charts shown in fig. 4 to fig. 6;
FIG. 4 shows a specific flow of collecting and processing expression images;
acquiring the expression of the driver according to a preset frequency, carrying out digital processing to obtain second digital image information, carrying out similarity comparison with the first digital image information stored in the learning mode, and judging whether the similarity is greater than a preset expression similarity threshold SfWhen the current value is larger than the preset value, reminding the driver of paying attention to safety; and when the expression is not larger than the preset value, the expression is collected and processed again.
FIG. 5 shows a specific process for collecting and processing sound;
collecting the voice of the driver according to the preset frequency, carrying out digital processing to obtain second digital voice information, carrying out similarity comparison with the first digital voice information stored in the learning mode, and judging whether the similarity is greater than a preset voice similarity threshold value SvWhen the current value is larger than the preset value, reminding the driver of paying attention to safety; and when the sound is not larger than the preset value, the sound is collected and processed again.
FIG. 6 shows a specific process for collecting and processing acceleration information;
detecting the instantaneous value a of the horizontal acceleration of the vehicle at a preset frequencyhi(ii) a The processing of horizontal acceleration includes two things: 1) determining the instantaneous value a of the horizontal accelerationhiWith the horizontal acceleration instantaneous value threshold ahmWhen a is large or smallhiGreater than ahmWhen it is, the driver is reminded to pay attention to the safety when ahiIs not more than ahmWhile continuing to detect the instantaneous value a of the horizontal accelerationhi(ii) a 2) Determining a horizontal acceleration integrated value ahAnd judging the horizontal acceleration integrated value ahAnd a horizontal acceleration integrated value threshold ahaWhen a is large or smallhGreater than ahaWhen it is, the driver is reminded to pay attention to the safety when ahIs not more than ahaThen, the horizontal acceleration integrated value a is continuously determinedh；
Detecting the instantaneous value a of the vertical acceleration of the vehicle at a preset frequencyvi(ii) a The vertical acceleration processing comprises twoThe content is as follows: 1) determining the instantaneous value a of the vertical accelerationviWith vertical acceleration instantaneous value threshold avmWhen a is large or smallviGreater than avmWhen the driver is in the state of a, the driver is reminded to pay attention to the safetyviIs not more than avmWhile continuing to detect the instantaneous value a of the vertical accelerationvi(ii) a 2) Determining a vertical acceleration integrated value avAnd judging the vertical acceleration integrated value avAnd a vertical acceleration integrated value threshold avaWhen a is large or smallvGreater than avaWhen it is, the driver is reminded to pay attention to the safety when avIs not more than avaThen, the vertical acceleration integrated value threshold a is continuously determinedva。
In the above-mentioned collecting and processing flows shown in fig. 4 to 6, one or more of them may be selected to be performed in the actual driving monitoring; and after the driving is finished, revising the user, scoring by the user, and correcting or restarting the learning mode according to the scoring result.
The structure of the driving monitoring device provided by the embodiment of the invention is shown in fig. 7, and the device comprises: a monitoring module 72 and an information processing module 73; wherein,
the monitoring module 72 is used for monitoring real-time information of a user during driving;
the information processing module 73 is used for comparing the monitored real-time information with the stored driving reference information and determining whether to send out a prompt according to the comparison result;
the device also includes: an information acquisition module 70 and a storage module 71; wherein,
an information collecting module 70 for collecting driving reference information in a learning mode before monitoring real-time information of a user while driving;
the storage module 71 is configured to store the collected driving reference information;
wherein the driving reference information includes: an expressive image of irritability or anger, and/or a sound of irritability or anger, and/or velocity threshold information;
as shown in fig. 8, the information collection module 70 includes: an image acquisition module 80 and a sound acquisition module 81; wherein,
an image capturing module 80 for capturing an expression image of irritability or anger that may appear in driving that the user exhibits;
in practical application, the camera can be used for realizing image acquisition;
a sound collection module 81 for recording the sound of irritability or anger that the user shows in driving;
in practical application, a microphone can be used for realizing image acquisition;
the information processing module 73 is specifically configured to digitize the expression images and/or sounds, and store the obtained first digital image information and/or first digital sound information in the storage module 71; a database can be established in the storage module 71 to store the information for searching conveniently;
when the expression images are digitally processed, important information in each expression image can be extracted, such as: eyebrow, eye, mouth, etc.;
when the sound is processed digitally, important factors in the sound can also be analyzed and processed, such as: tone, pitch, etc.;
the monitoring device of fig. 7 further comprises: an acceleration detecting module 74, configured to detect current acceleration information of the vehicle, where the acceleration information is absolute value information without direction, and includes: instantaneous value a of horizontal accelerationviAnd instantaneous value a of vertical accelerationvi(ii) a The module consists of an acceleration sensor and a peripheral device;
the monitoring module 72 is specifically configured to control an image acquisition module 80 in the information acquisition module 70 to capture an expression of the driver according to a preset frequency, and/or control a sound acquisition module 81 in the information acquisition module 70 to acquire a sound of the driver according to a preset frequency, and/or control the acceleration detection module 74 to detect current acceleration information of the vehicle; recording the collected expression images, and/or sound information, and/or acceleration information; here, the recorded acceleration information is absolute value information without direction.
The frequencies of the captured expressions and the collected sounds can be consistent or inconsistent, and a driver can set the frequencies according to driving habits; for example, 20 times/min;
the recording may be storing the above information in the storage module 71;
the monitoring module 72 can be realized by a chip with control capability in the device, and more hardware chips capable of realizing the function in practical application are selected by designers according to the design requirements of the product;
the information processing module 73 is further specifically configured to perform digital processing on the recorded monitored real-time expression images and/or sound information to obtain second digital image information and/or second digital sound information; comparing the similarity of the second digital image information with the stored first digital image information, and when the similarity is greater than an expression similarity threshold SfWhen the driver is in a normal driving state, sending out a safe driving prompt; and/or comparing the similarity of the second digital sound information with the stored first digital sound information, and when the similarity is greater than a sound similarity threshold SvWhen the driver is in a normal driving state, sending out a safe driving prompt; and/or comparing the speed threshold information with the acceleration information detected by the monitoring module, and sending a safe driving prompt when the detected acceleration information is greater than the speed threshold information;
wherein the expression similarity threshold SfSound similarity threshold SvThe critical value of normal emotion, irritability or anger obtained by a designer according to emotion analysis is stored in the equipment in advance;
the speed threshold information is stored in the storage module 71;
the speed threshold information includes: horizontal acceleration instantaneous value threshold ahmInstantaneous value threshold a of vertical accelerationvmHorizontal acceleration integrated value threshold ahaAnd a vertical acceleration integrated value threshold ava；
Comparing the speed threshold information with the acceleration information detected by the monitoring module, and sending a safe driving prompt when the detected acceleration information is greater than the speed threshold information, wherein the safe driving prompt comprises the following steps:
comparing the horizontal acceleration instantaneous value threshold value ahmWith the instantaneous value a of the horizontal acceleration detected by the monitoring module 72hiWhen the instantaneous value a of the horizontal accelerationhiWhen the driving is high, a safe driving prompt is sent;
comparing the horizontal acceleration integrated value ahAnd a horizontal acceleration integrated value threshold ahaWhen the horizontal acceleration integrated value ahWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration instantaneous value threshold value avmWith instantaneous value a of said monitored vertical accelerationviWhen the instantaneous value a of the vertical accelerationviWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration integrated value a detected by the monitoring module 72vAnd a vertical acceleration integrated value threshold avaComparing the obtained values when the vertical acceleration is the integrated value avWhen the driving is high, a safe driving prompt is sent;
wherein the horizontal acceleration integrated value ahFor instantaneous value a of horizontal acceleration in a given time intervalhiThe sum of (1):the vertical acceleration integrated value avFor instantaneous value a of vertical acceleration in a given time intervalviThe sum of (1):
the information processing module 73 may be implemented by a chip with a strong information processing capability in the device, or may be implemented by a main chip; selecting a proper chip according to the specific internal hardware design of the product;
the monitoring device of fig. 7 further comprises: a monitor modification module 75 and a control module 76; wherein,
the monitoring and correcting module 75 is used for providing an evaluation interface for the user after the monitoring is finished, correcting the threshold information stored in the storage module according to the evaluation result of the user or reminding the user to select to enter the learning mode again, collecting and storing the driving reference information;
the threshold information includes: expression similarity threshold, sound similarity threshold, speed threshold information;
specifically, the monitoring and correcting module 75 allows the user to score the accuracy and timeliness of the safety driving reminding through screen display and sound reminding. For example, the score can be divided into 1-10 scores, and the device corrects the preset threshold value through the score of the user. When the score is too low, for example below 5 points, the user is reminded whether to restart the learning process;
the monitoring and correcting module 75 may be implemented by a main chip or an information processing chip;
a control module 76 for controlling and managing the execution flow of each module in the monitoring device;
the control module 76 is typically implemented by the most capable chip of controlling the devices to ensure control, management stability and timing accuracy.
The driving monitoring method of the embodiment of the invention can be stored in a computer readable storage medium if the driving monitoring method is realized in the form of a software functional module and sold or used as an independent product. Based on such an understanding, it will be apparent to one skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therewith, including but not limited to, a U disk, a removable hard disk, a Read-only memory (ROM), a magnetic disk storage device, a CD-ROM, an optical storage device, and the like.
In the embodiment of the invention, the equipment enters a learning mode, collects and stores driving reference information; the emotion of the driver is judged later and used as reference, so that the judgment accuracy is improved; monitoring real-time information of a user during driving; comparing the stored driving reference information with the monitored real-time information, and determining whether to send out a prompt according to a comparison result; the emotion data of the driver monitored in real time is compared with the reference in the database, so that the emotion can be judged more accurately, and meanwhile, the driving condition of the vehicle is added into the factor for judging whether the driving is safe, so that whether the driving process is safe or not is monitored more comprehensively.
The above description is only exemplary of the present invention and should not be taken as limiting the scope of the present invention, and any modifications, equivalents, improvements, etc. that are within the spirit and principle of the present invention should be included in the present invention.
Claims (17)
1. A driving monitoring method, characterized in that the method comprises:
monitoring real-time information of a user during driving; and comparing the monitored real-time information with the stored driving reference information, and determining whether to send out a prompt according to a comparison result.
2. The method of claim 1, wherein prior to monitoring real-time information while the user is driving, the method further comprises: collecting and storing driving reference information in a learning mode;
the driving reference information includes: an expressive image of irritability or anger and/or a disturbing or angry sound and/or velocity threshold information.
3. The method of claim 2, wherein the capturing of the expression image of irritability or anger and/or the sound of irritability or anger and the storing comprises: capturing an expression image of irritability or anger which appears in driving and is shown by a user by using a camera, digitizing the expression image, and storing the obtained first digital image information; and/or recording the sound of irritability or anger which appears in the driving process and is shown by the user by using a microphone, digitizing the sound, and storing the obtained first digital sound information.
4. The method of claim 1, wherein the monitoring real-time information of the user while driving comprises: the camera captures the expression of the driver according to a preset frequency, and/or the microphone collects the voice of the driver according to the preset frequency, and/or the acceleration sensor detects the current acceleration information of the vehicle, and the collected expression image, and/or voice information, and/or acceleration information are recorded; wherein the acceleration information includes an instantaneous value a of a horizontal accelerationhiAnd instantaneous value a of vertical accelerationvi。
5. The method of claim 4, wherein comparing the stored driving reference information with the monitored real-time information and determining whether to issue a reminder according to the comparison comprises: digitally processing the recorded monitored expression image to obtain second digital image information; and comparing the similarity of the second digital image information with the stored first digital image information, and sending out a safe driving prompt when the similarity is greater than the expression similarity threshold.
6. The method of claim 4, wherein comparing the stored driving reference information with the monitored real-time information and determining whether to issue a reminder according to the comparison comprises: and carrying out digital processing on the recorded monitored sound information to obtain second digital sound information, carrying out similarity comparison on the second digital sound information and the stored first digital sound information, and sending out a safe driving prompt when the similarity is greater than a sound similarity threshold value.
7. The method of claim 4, wherein comparing the stored driving reference information with the monitored real-time information and issuing a reminder according to the comparison comprises: and comparing the speed threshold information with the detected acceleration information, and sending out a safe driving prompt when the detected acceleration information is greater than the speed threshold information.
8. The method of claim 7, wherein the speed threshold information comprises: horizontal acceleration instantaneous value threshold ahmInstantaneous value threshold a of vertical accelerationvmHorizontal acceleration integrated value threshold ahaAnd a vertical acceleration integrated value threshold ava；
Comparing the speed threshold information with the detected acceleration information, and sending out a safe driving prompt when the detected acceleration information is greater than the speed threshold information, wherein the safe driving prompt comprises the following steps:
comparing the horizontal acceleration instantaneous value threshold value ahmWith instantaneous value a of the monitored horizontal accelerationhiWhen instantaneous value a of horizontal accelerationhiWhen the driving is high, a safe driving prompt is sent;
comparing the horizontal acceleration integrated value ahAnd a horizontal acceleration integrated value threshold ahaWhen the horizontal acceleration integrated value ahWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration instantaneous value threshold value avmWith instantaneous value a of said monitored vertical accelerationviWhen the instantaneous value a of the vertical accelerationviSend out safe driving in large hoursDriving reminding;
comparing the vertical acceleration integrated value avWith stored vertical acceleration integrated value threshold avaWhen the vertical acceleration integrated value avWhen the driving is high, a safe driving prompt is sent;
wherein the horizontal acceleration integrated value ahFor instantaneous value a of horizontal acceleration in a given time intervalhiThe sum of (1):the vertical acceleration integrated value avFor instantaneous value a of vertical acceleration in a given time intervalviThe sum of (1):。
9. the method of claim 1, further comprising: revisiting the user, providing a user evaluation interface, correcting threshold information according to the evaluation result of the user or reminding the user to select to enter the learning mode again, collecting and storing driving reference information; wherein,
the threshold information includes: expression similarity threshold, sound similarity threshold, and speed threshold information.
10. A driving monitoring device, the device comprising: the monitoring module and the information processing module; wherein,
the monitoring module is used for monitoring real-time information of a user during driving;
and the information processing module is used for comparing the monitored real-time information with the stored driving reference information and determining whether to send out a prompt or not according to a comparison result.
11. The apparatus of claim 10, further comprising: the system comprises an information acquisition module and a storage module; wherein,
the information acquisition module is used for acquiring driving reference information in a learning mode before monitoring real-time information of a user during driving;
the storage module is used for storing the collected driving reference information;
the driving reference information includes: an expressive image of irritability or anger, and/or a sound of irritability or anger, and/or velocity threshold information.
12. The apparatus of claim 11, wherein the information collection module comprises: the system comprises an image acquisition module and a sound acquisition module; wherein,
the image acquisition module is used for capturing an expression image of irritability or anger which appears in driving and is shown by a user;
and the sound acquisition module is used for recording the irritative or angry sound which appears in the driving process and is shown by the user.
13. The apparatus according to claim 12, wherein the information processing module is specifically configured to digitize the expression image and/or sound, and store the obtained first digital image information and/or first digital sound information in a storage module.
14. The apparatus of claim 13, further comprising: an acceleration detection module for detecting the current acceleration information of the vehicle, wherein the acceleration information comprises the instantaneous value a of the horizontal accelerationhiAnd instantaneous value a of vertical accelerationvi；
The monitoring module is specifically used for controlling an image acquisition module in the information acquisition module to capture the expression of the driver according to a preset frequency, and/or controlling a sound acquisition module of the information acquisition module to acquire the sound of the driver according to the preset frequency, and/or controlling the acceleration detection module to detect the current acceleration information of the vehicle; and recording the collected expression images, and/or sound information, and/or acceleration information.
15. The device according to claim 14, wherein the information processing module is specifically configured to perform digital processing on the recorded monitored expression images and/or sound information to obtain second digital image information and/or second digital sound information; comparing the similarity of the second digital image information with the stored first digital image information, and sending a safe driving prompt when the similarity is greater than an expression similarity threshold; and/or comparing the similarity of the second digital sound information with the stored first digital sound information, and sending a safe driving prompt when the similarity is greater than a sound similarity threshold; and/or comparing the speed threshold information with the acceleration information detected by the monitoring module, and sending out a safe driving prompt when the detected acceleration information is greater than the speed threshold information.
16. The apparatus of claim 15, wherein the speed threshold information comprises: horizontal acceleration instantaneous value threshold ahmInstantaneous value threshold a of vertical accelerationvmHorizontal acceleration integrated value threshold ahaAnd a vertical acceleration integrated value threshold ava；
Comparing the speed threshold information with the acceleration information detected by the monitoring module, and sending a safe driving prompt when the detected acceleration information is greater than the speed threshold information, wherein the safe driving prompt comprises the following steps:
comparing the horizontal acceleration instantaneous value threshold value ahmWith the instantaneous value a of the horizontal acceleration detected by the monitoring modulehiWhen the instantaneous value a of the horizontal accelerationhiWhen the driving is high, a safe driving prompt is sent;
comparing the horizontal acceleration integrated value ahWith stored horizontal acceleration integrated value threshold ahaWhen the horizontal acceleration integrated value ahWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration instantaneous value threshold value avmFrom the instantaneous value a of the vertical accelerationviWhen the instantaneous value a of the vertical accelerationviWhen the driving is high, a safe driving prompt is sent;
comparing the vertical acceleration integrated value avWith stored vertical acceleration integrated value threshold avaWhen the vertical acceleration integrated value avWhen the driving is high, a safe driving prompt is sent;
wherein the horizontal acceleration integrated value ahFor instantaneous value a of horizontal acceleration in a given time intervalhiThe sum of (1):the vertical acceleration integrated value avFor instantaneous value a of vertical acceleration in a given time intervalviThe sum of (1):。
17. the apparatus of claim 10, further comprising: the monitoring and correcting module and the control module; wherein,
the monitoring and correcting module is used for providing an evaluation interface for a user after monitoring is finished, correcting threshold information stored in the storage module according to an evaluation result of the user or reminding the user to select to enter a learning mode again, collecting and storing driving reference information;
the threshold information includes: expression similarity threshold, sound similarity threshold, speed threshold information;
and the control module is used for controlling and managing the execution flow of each module in the monitoring device.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410276252.7A CN105292124A (en) | 2014-06-19 | 2014-06-19 | Driving monitoring method and driving monitoring device |
| PCT/CN2014/093839 WO2015192618A1 (en) | 2014-06-19 | 2014-12-15 | Driving monitoring method and device and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410276252.7A CN105292124A (en) | 2014-06-19 | 2014-06-19 | Driving monitoring method and driving monitoring device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105292124A true CN105292124A (en) | 2016-02-03 |
Family
ID=54934823
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410276252.7A Pending CN105292124A (en) | 2014-06-19 | 2014-06-19 | Driving monitoring method and driving monitoring device |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN105292124A (en) |
| WO (1) | WO2015192618A1 (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106428015A (en) * | 2016-09-12 | 2017-02-22 | 惠州Tcl移动通信有限公司 | Intelligent driving assistant method and device |
| CN107235045A (en) * | 2017-06-29 | 2017-10-10 | 吉林大学 | Consider physiology and the vehicle-mounted identification interactive system of driver road anger state of manipulation information |
| CN107316436A (en) * | 2017-07-31 | 2017-11-03 | 努比亚技术有限公司 | Dangerous driving state processing method, electronic equipment and storage medium |
| CN107773247A (en) * | 2016-08-26 | 2018-03-09 | 马自达汽车株式会社 | Driver's health detection means and driver's health detection method |
| CN108860150A (en) * | 2018-07-03 | 2018-11-23 | 百度在线网络技术（北京）有限公司 | Automobile brake method, apparatus, equipment and computer readable storage medium |
| CN109461344A (en) * | 2018-12-07 | 2019-03-12 | 黑匣子(杭州)车联网科技有限公司 | A kind of method of car steering behavior assessment |
| CN110458604A (en) * | 2019-07-17 | 2019-11-15 | 中国第一汽车股份有限公司 | A kind of net about driver's evaluation method, device, equipment and storage medium |
| CN110871810A (en) * | 2018-08-21 | 2020-03-10 | 上海博泰悦臻网络技术服务有限公司 | Vehicle, vehicle equipment and driving information prompting method based on driving mode |
| CN111071258A (en) * | 2019-12-30 | 2020-04-28 | 合肥移顺信息技术有限公司 | Driving behavior detection method and device, electronic equipment and readable storage medium |
| CN111452798A (en) * | 2020-03-30 | 2020-07-28 | 芯海科技（深圳）股份有限公司 | Driver state detection method and device, electronic equipment and storage medium |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB2543759B (en) * | 2015-10-23 | 2019-03-20 | Jaguar Land Rover Ltd | Vehicle user advice system |
| CN113619588A (en) * | 2020-05-09 | 2021-11-09 | 北京地平线机器人技术研发有限公司 | Driving behavior reminding method and device, storage medium and electronic equipment |
| CN111661040B (en) * | 2020-06-18 | 2022-08-12 | 吉林大学 | Slow-moving safety system and method at medium and low speed |
| CN112704480A (en) * | 2020-12-28 | 2021-04-27 | 中亿达供应链管理(无锡)有限公司 | System and method for monitoring and early warning of automobile driver psychology |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101030316A (en) * | 2007-04-17 | 2007-09-05 | 北京中星微电子有限公司 | Safety driving monitoring system and method for vehicle |
| JP2008062852A (en) * | 2006-09-08 | 2008-03-21 | Fujitsu Ten Ltd | Vehicle controller |
| CN102874259A (en) * | 2012-06-15 | 2013-01-16 | 浙江吉利汽车研究院有限公司杭州分公司 | Automobile driver emotion monitoring and automobile control system |
| CN103085818A (en) * | 2011-11-07 | 2013-05-08 | 现代自动车株式会社 | Driving assistant system and method having warning function for risk level |
| CN203283229U (en) * | 2013-06-24 | 2013-11-13 | 成都衔石科技有限公司 | Driving aiding intelligent pre-warning system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2008038374A1 (en) * | 2006-09-28 | 2008-04-03 | Pioneer Corporation | Pseudo emotion output device, pseudo emotion output method, pseudo emotion output program, and computer-readable recording medium |
| CN202541525U (en) * | 2012-03-30 | 2012-11-21 | 深圳市杰成电子有限公司 | Automobile safety driving reminding system |
-
2014
- 2014-06-19 CN CN201410276252.7A patent/CN105292124A/en active Pending
- 2014-12-15 WO PCT/CN2014/093839 patent/WO2015192618A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008062852A (en) * | 2006-09-08 | 2008-03-21 | Fujitsu Ten Ltd | Vehicle controller |
| CN101030316A (en) * | 2007-04-17 | 2007-09-05 | 北京中星微电子有限公司 | Safety driving monitoring system and method for vehicle |
| CN103085818A (en) * | 2011-11-07 | 2013-05-08 | 现代自动车株式会社 | Driving assistant system and method having warning function for risk level |
| CN102874259A (en) * | 2012-06-15 | 2013-01-16 | 浙江吉利汽车研究院有限公司杭州分公司 | Automobile driver emotion monitoring and automobile control system |
| CN203283229U (en) * | 2013-06-24 | 2013-11-13 | 成都衔石科技有限公司 | Driving aiding intelligent pre-warning system |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107773247A (en) * | 2016-08-26 | 2018-03-09 | 马自达汽车株式会社 | Driver's health detection means and driver's health detection method |
| CN107773247B (en) * | 2016-08-26 | 2021-01-01 | 马自达汽车株式会社 | Driver physical condition detection device and driver physical condition detection method |
| CN106428015B (en) * | 2016-09-12 | 2019-07-19 | 惠州Tcl移动通信有限公司 | A kind of intelligent travelling crane householder method and device |
| CN106428015A (en) * | 2016-09-12 | 2017-02-22 | 惠州Tcl移动通信有限公司 | Intelligent driving assistant method and device |
| CN107235045A (en) * | 2017-06-29 | 2017-10-10 | 吉林大学 | Consider physiology and the vehicle-mounted identification interactive system of driver road anger state of manipulation information |
| CN107316436A (en) * | 2017-07-31 | 2017-11-03 | 努比亚技术有限公司 | Dangerous driving state processing method, electronic equipment and storage medium |
| CN108860150A (en) * | 2018-07-03 | 2018-11-23 | 百度在线网络技术（北京）有限公司 | Automobile brake method, apparatus, equipment and computer readable storage medium |
| CN108860150B (en) * | 2018-07-03 | 2021-05-04 | 百度在线网络技术（北京）有限公司 | Automobile braking method, device, equipment and computer readable storage medium |
| CN110871810A (en) * | 2018-08-21 | 2020-03-10 | 上海博泰悦臻网络技术服务有限公司 | Vehicle, vehicle equipment and driving information prompting method based on driving mode |
| CN109461344A (en) * | 2018-12-07 | 2019-03-12 | 黑匣子(杭州)车联网科技有限公司 | A kind of method of car steering behavior assessment |
| CN110458604A (en) * | 2019-07-17 | 2019-11-15 | 中国第一汽车股份有限公司 | A kind of net about driver's evaluation method, device, equipment and storage medium |
| CN111071258A (en) * | 2019-12-30 | 2020-04-28 | 合肥移顺信息技术有限公司 | Driving behavior detection method and device, electronic equipment and readable storage medium |
| CN111452798A (en) * | 2020-03-30 | 2020-07-28 | 芯海科技（深圳）股份有限公司 | Driver state detection method and device, electronic equipment and storage medium |
| CN111452798B (en) * | 2020-03-30 | 2021-06-25 | 芯海科技（深圳）股份有限公司 | Driver state detection method and device, electronic equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2015192618A1 (en) | 2015-12-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN105292124A (en) | Driving monitoring method and driving monitoring device | |
| US20210268902A1 (en) | Driving assistance apparatus and driving assistance method | |
| CN110740901B (en) | Multimedia information pushing method and device, storage medium and electronic equipment | |
| US9763055B2 (en) | Travel and activity capturing | |
| EP3890342B1 (en) | Waking up a wearable device | |
| JP6387892B2 (en) | Sleepiness detection device | |
| CN103530912A (en) | Attendance recording system having emotion identification function, and method thereof | |
| CN105292125B (en) | Driver state monitoring method | |
| WO2015196582A1 (en) | Behavior pattern statistical apparatus and method | |
| CN110766912A (en) | Driving early warning method, device and computer readable storage medium | |
| JP2008269588A (en) | Recognition device, recognition method, and recognition program | |
| CN106510720B (en) | User state prompting method and device | |
| CN110855934A (en) | Fatigue driving identification method, device and system, vehicle-mounted terminal and server | |
| CN116386277A (en) | Fatigue driving detection method and device, electronic equipment and medium | |
| CN110992989A (en) | Voice acquisition method and device and computer readable storage medium | |
| CN106897725A (en) | A kind of method and device for judging user's asthenopia | |
| WO2017143951A1 (en) | Expression feedback method and smart robot | |
| CN105551504B (en) | A kind of method and device based on crying triggering intelligent mobile terminal functional application | |
| KR101783183B1 (en) | Method and apparatus for emotion classification of smart device user | |
| CN106921806A (en) | A kind of eyeshield based reminding method and mobile terminal for being applied to mobile terminal | |
| JP7575397B2 (en) | Driver abnormality response system, driver abnormality response method, and program | |
| CN110942591B (en) | Driving safety reminding system and method | |
| CN113066263A (en) | Method and device for preventing fatigue driving | |
| JP2020103702A (en) | Information processing device and program | |
| JP5285939B2 (en) | Driving state warning system, driving state warning method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160203 |