[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

SG11202009420RA - Driving state analysis method and apparatus, driver monitoring system and vehicle - Google Patents

Driving state analysis method and apparatus, driver monitoring system and vehicle

Info

Publication number
SG11202009420RA
SG11202009420RA SG11202009420RA SG11202009420RA SG11202009420RA SG 11202009420R A SG11202009420R A SG 11202009420RA SG 11202009420R A SG11202009420R A SG 11202009420RA SG 11202009420R A SG11202009420R A SG 11202009420RA SG 11202009420R A SG11202009420R A SG 11202009420RA
Authority
SG
Singapore
Prior art keywords
vehicle
monitoring system
analysis method
driving state
state analysis
Prior art date
Application number
SG11202009420RA
Inventor
Renbo Qin
Daqian Yang
Original Assignee
Shanghai Sensetime Intelligent Tech Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Sensetime Intelligent Tech Co Ltd filed Critical Shanghai Sensetime Intelligent Tech Co Ltd
Publication of SG11202009420RA publication Critical patent/SG11202009420RA/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/59Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
    • G06V20/597Recognising the driver's state or behaviour, e.g. attention or drowsiness
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/107Static hand or arm
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/19Sensors therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/28Recognition of hand or arm movements, e.g. recognition of deaf sign language
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30196Human being; Person
    • G06T2207/30201Face
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30268Vehicle interior

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Computing Systems (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Medical Informatics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • Ophthalmology & Optometry (AREA)
  • Mechanical Engineering (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Psychiatry (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Social Psychology (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Traffic Control Systems (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mathematical Physics (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Business, Economics & Management (AREA)
  • Emergency Management (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Eye Examination Apparatus (AREA)
  • Image Analysis (AREA)
SG11202009420RA 2018-10-19 2019-10-18 Driving state analysis method and apparatus, driver monitoring system and vehicle SG11202009420RA (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201811224316.3A CN111079476B (en) 2018-10-19 2018-10-19 Driving state analysis method and device, driver monitoring system and vehicle
PCT/CN2019/111932 WO2020078465A1 (en) 2018-10-19 2019-10-18 Method and device for driving state analysis, driver monitoring system and vehicle

Publications (1)

Publication Number Publication Date
SG11202009420RA true SG11202009420RA (en) 2020-10-29

Family

ID=70282873

Family Applications (1)

Application Number Title Priority Date Filing Date
SG11202009420RA SG11202009420RA (en) 2018-10-19 2019-10-18 Driving state analysis method and apparatus, driver monitoring system and vehicle

Country Status (6)

Country Link
US (1) US11386679B2 (en)
JP (1) JP2021516829A (en)
KR (1) KR102469234B1 (en)
CN (1) CN111079476B (en)
SG (1) SG11202009420RA (en)
WO (1) WO2020078465A1 (en)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018033137A1 (en) * 2016-08-19 2018-02-22 北京市商汤科技开发有限公司 Method, apparatus, and electronic device for displaying service object in video image
CN111626082A (en) * 2019-02-28 2020-09-04 佳能株式会社 Detection device and method, image processing device and system
KR20210009596A (en) * 2019-07-17 2021-01-27 엘지전자 주식회사 Intelligent voice recognizing method, apparatus, and intelligent computing device
JP7047821B2 (en) * 2019-07-18 2022-04-05 トヨタ自動車株式会社 Driving support device
JP7410681B2 (en) * 2019-09-25 2024-01-10 株式会社Subaru vehicle control system
TWI805925B (en) * 2020-06-05 2023-06-21 財團法人車輛研究測試中心 Test method and test system for driver status monitor
CN111695510A (en) * 2020-06-12 2020-09-22 浙江工业大学 Image-based fatigue detection method for computer operator
CN111950371B (en) * 2020-07-10 2023-05-19 上海淇毓信息科技有限公司 Fatigue driving early warning method and device, electronic equipment and storage medium
CN112070927A (en) * 2020-08-28 2020-12-11 浙江省机电设计研究院有限公司 Highway vehicle microscopic driving behavior analysis system and analysis method
CN114495069A (en) * 2020-10-27 2022-05-13 中车株洲电力机车研究所有限公司 Method and system for monitoring driving state of driver
CN112356839A (en) * 2020-11-06 2021-02-12 广州小鹏自动驾驶科技有限公司 Driving state monitoring method and system and automobile
CN112754498B (en) * 2021-01-11 2023-05-26 一汽解放汽车有限公司 Driver fatigue detection method, device, equipment and storage medium
FR3119145B1 (en) * 2021-01-22 2023-10-27 Renault Sas Method for determining a level of distraction of a vehicle driver
CN115082978A (en) * 2021-03-10 2022-09-20 佳能株式会社 Face posture detection device, method, image processing system and storage medium
CN113436413A (en) * 2021-05-25 2021-09-24 东风电驱动系统有限公司 Fatigue driving early warning system and method
CN113313019A (en) * 2021-05-27 2021-08-27 展讯通信(天津)有限公司 Distracted driving detection method, system and related equipment
CN113298041B (en) * 2021-06-21 2024-07-02 黑芝麻智能科技(上海)有限公司 Method and system for calibrating distraction reference direction of driver
CN113536967B (en) * 2021-06-25 2023-05-30 武汉极目智能技术有限公司 Driver state identification method and device based on head movement posture and eye opening and closing degree of driver, and electronic equipment
CN113558621B (en) * 2021-07-23 2023-08-01 福州数据技术研究院有限公司 Method and system for detecting and reminding fatigue of driver
CN113537115A (en) * 2021-07-26 2021-10-22 东软睿驰汽车技术(沈阳)有限公司 Method and device for acquiring driving state of driver and electronic equipment
US12122392B2 (en) 2021-08-24 2024-10-22 Nvidia Corporation Context-based state estimation
US11830259B2 (en) * 2021-08-24 2023-11-28 Nvidia Corporation Robust state estimation
CN113642522B (en) * 2021-09-01 2022-02-08 中国科学院自动化研究所 Audio and video based fatigue state detection method and device
CN115100634A (en) * 2021-10-19 2022-09-23 长城汽车股份有限公司 Driver distraction detection method and device, electronic equipment, storage medium and vehicle
CN113795069B (en) * 2021-11-18 2022-02-11 深圳市奥新科技有限公司 Tunnel illumination control method and tunnel illumination system
CN116615765A (en) * 2021-12-13 2023-08-18 华为技术有限公司 Driver state detection method, driver state detection device and storage medium
CN114179831B (en) * 2021-12-29 2023-02-17 吉林大学 Man-machine steering switching control method based on driver distraction judgment
CN114373280A (en) * 2022-01-20 2022-04-19 一汽解放汽车有限公司 Driving behavior monitoring system and monitoring method
CN114680889A (en) * 2022-03-08 2022-07-01 中国石油大学(北京) Method and device for identifying unsafe behaviors of drilling operation personnel
CN115311819B (en) * 2022-10-10 2023-01-20 南京智慧交通信息股份有限公司 Intelligent bus intelligent vehicle-mounted real-time warning system and method thereof
WO2024180731A1 (en) * 2023-03-01 2024-09-06 日産自動車株式会社 Interior part control device and interior part control method
CN116311181B (en) * 2023-03-21 2023-09-12 重庆利龙中宝智能技术有限公司 Method and system for rapidly detecting abnormal driving
CN116469085B (en) * 2023-03-30 2024-04-02 万联易达物流科技有限公司 Monitoring method and system for risk driving behavior
CN116749988A (en) * 2023-06-20 2023-09-15 中国第一汽车股份有限公司 Driver fatigue early warning method and device, electronic equipment and storage medium

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1750236B1 (en) * 2005-08-02 2008-01-23 Delphi Technologies, Inc. Method and device for controlling a driver assist system
JP4704174B2 (en) * 2005-09-30 2011-06-15 富士フイルム株式会社 Status identification device, program, and method
JP2007265377A (en) * 2006-03-01 2007-10-11 Toyota Central Res & Dev Lab Inc Driver state determining device and driving support device
JP2009012608A (en) * 2007-07-04 2009-01-22 Denso Corp Vehicular lighting device
EP2564765B1 (en) 2011-09-02 2017-12-13 Volvo Car Corporation System and method for improving a performance estimation of an operator of a vehicle
CN102930693B (en) * 2012-11-06 2015-01-21 深圳市艾大机器人有限公司 Early warning system and method for safe driving
JP6210287B2 (en) * 2012-11-16 2017-10-11 豊田合成株式会社 Warning device for driver
KR101386823B1 (en) * 2013-10-29 2014-04-17 김재철 2 level drowsy driving prevention apparatus through motion, face, eye,and mouth recognition
CN104085396A (en) * 2014-07-03 2014-10-08 上海纵目科技有限公司 Panoramic lane departure warning method and system
JP6235425B2 (en) * 2014-07-07 2017-11-22 株式会社デンソーアイティーラボラトリ Safety confirmation determination device and driving support device
CN104599443B (en) * 2015-01-12 2017-05-31 中设设计集团股份有限公司 A kind of driving behavior early warning car-mounted terminal and its method for early warning based on information fusion
CN105574487A (en) 2015-11-26 2016-05-11 中国第一汽车股份有限公司 Facial feature based driver attention state detection method
FR3048544B1 (en) 2016-03-01 2021-04-02 Valeo Comfort & Driving Assistance DEVICE AND METHOD FOR MONITORING A DRIVER OF A MOTOR VEHICLE
WO2017208529A1 (en) * 2016-06-02 2017-12-07 オムロン株式会社 Driver state estimation device, driver state estimation system, driver state estimation method, driver state estimation program, subject state estimation device, subject state estimation method, subject state estimation program, and recording medium
JP2018133007A (en) * 2017-02-16 2018-08-23 いすゞ自動車株式会社 Alarm apparatus
US10948911B2 (en) * 2017-10-31 2021-03-16 Denso International America, Inc. Co-pilot
CN108021875A (en) * 2017-11-27 2018-05-11 上海灵至科技有限公司 A kind of vehicle driver's personalization fatigue monitoring and method for early warning
CN108022451A (en) * 2017-12-06 2018-05-11 驾玉科技(上海)有限公司 A kind of driver status early warning based on high in the clouds reports and dissemination system
CN108437999B (en) 2018-03-20 2020-07-28 中国计量大学 Attention auxiliary system

Also Published As

Publication number Publication date
US20210004619A1 (en) 2021-01-07
JP2021516829A (en) 2021-07-08
US11386679B2 (en) 2022-07-12
KR102469234B1 (en) 2022-11-18
WO2020078465A1 (en) 2020-04-23
CN111079476B (en) 2024-03-26
CN111079476A (en) 2020-04-28
KR20200131883A (en) 2020-11-24

Similar Documents

Publication Publication Date Title
SG11202009420RA (en) Driving state analysis method and apparatus, driver monitoring system and vehicle
SG11202009437SA (en) Driving state detection method and apparatus, driver monitoring system and vehicle
EP3666577A4 (en) Driving state monitoring method and device, driver monitoring system, and vehicle
SG11202007195TA (en) Vehicle-mounted camera self-calibration method and apparatus, and vehicle driving method and apparatus
EP3825981A4 (en) Warning apparatus, driving tendency analysis device, driving tendency analysis method, and program
EP3604064A4 (en) Method and apparatus for carrying out driving control on vehicle
EP3839686A4 (en) Vehicle-mounted control unit, and fpga-based vehicle automatic driving method and device
EP3944047A4 (en) Automated driving system upgrading method, automated driving system and vehicle-mounted device
EP3727978C0 (en) Method and system for ensemble vehicle control prediction in autonomous driving vehicles
EP3965082A4 (en) Vehicle monitoring system and vehicle monitoring method
SG11202100356TA (en) Action recognition method and apparatus, and driver state analysis method and apparatus
EP4043978A4 (en) Automobile diagnosis device, system and method
EP3739821A4 (en) Vehicle diagnostic method, device, apparatus, and system, and connection diagnostic apparatus
EP3816967A4 (en) Automatic parking method, apparatus and system, and vehicle
EP3761605A4 (en) Vehicle diagnosis method, related device and system
EP3770108A4 (en) Remote operation system for industrial vehicles, industrial vehicle, remote operation device, remote operation program for industrial vehicles, and remote operation method for industrial vehicles
EP3730371A4 (en) Method and system for monitoring distracted driving, and electronic device
EP3825676A4 (en) Travel control device, travel control system, travel control method, tire testing device, and tire testing method
EP4024250A4 (en) Vehicle monitoring device and vehicle monitoring method
EP3647894A4 (en) Method and system for using vehicle diagnostic device and vehicle diagnostic device
EP3882871A4 (en) Vehicle movement identification method and device, and vehicle alert system
EP3997528C0 (en) System, device and method for testing autonomous vehicles
EP3253632B8 (en) Method for monitoring a brake for motor vehicles, brake system for implementing the method, and motor vehicle comprising same
EP3865360A4 (en) Parking control method and apparatus, and vehicle
ZA201901446B (en) Vehicle monitoring system and method