CN118247777B - Driver working state monitoring system based on software development - Google Patents
Driver working state monitoring system based on software development Download PDFInfo
- Publication number
- CN118247777B CN118247777B CN202410679923.8A CN202410679923A CN118247777B CN 118247777 B CN118247777 B CN 118247777B CN 202410679923 A CN202410679923 A CN 202410679923A CN 118247777 B CN118247777 B CN 118247777B
- Authority
- CN
- China
- Prior art keywords
- driver
- monitoring
- module
- unit
- state
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012544 monitoring process Methods 0.000 title claims abstract description 146
- 230000002159 abnormal effect Effects 0.000 claims abstract description 14
- 230000008921 facial expression Effects 0.000 claims abstract description 7
- 238000012360 testing method Methods 0.000 claims description 56
- 238000012423 maintenance Methods 0.000 claims description 13
- 238000004088 simulation Methods 0.000 claims description 12
- 238000000034 method Methods 0.000 claims description 11
- 238000005259 measurement Methods 0.000 claims description 9
- 230000001815 facial effect Effects 0.000 claims description 5
- 230000005856 abnormality Effects 0.000 claims description 3
- 238000013500 data storage Methods 0.000 claims description 3
- 230000008451 emotion Effects 0.000 abstract description 11
- 230000001105 regulatory effect Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 238000013522 software testing Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/59—Context or environment of the image inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
- G06V20/597—Recognising the driver's state or behaviour, e.g. attention or drowsiness
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3438—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment monitoring of user actions
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C5/00—Registering or indicating the working of vehicles
- G07C5/08—Registering or indicating performance data other than driving, working, idle, or waiting time, with or without registering driving, working, idle or waiting time
- G07C5/0841—Registering performance data
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0818—Inactivity or incapacity of driver
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/08—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to drivers or passengers
- B60W2040/0872—Driver physiology
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Mathematical Physics (AREA)
- Mechanical Engineering (AREA)
- Computer Hardware Design (AREA)
- Transportation (AREA)
- Quality & Reliability (AREA)
- Automation & Control Theory (AREA)
- Multimedia (AREA)
- Emergency Alarm Devices (AREA)
Abstract
本发明公开了一种基于软件开发的驾驶员工作状态监控系统，包括：客户信息采集模块、主控平台、监控自动调节模块、工作状态分析模块、乘客状态分析模块、监控联动模块和状态调整提示模块，通过客户信息采集模块采集驾驶员信息，监控自动调节模块依据驾驶员的身高信息判断不同驾驶员的坐高，依据驾驶员的坐高数据自动调节监控范围以减少无效监控画面，工作状态分析模块依据驾驶员的面部表情和手部动作分析驾驶员是否存在“路噪”情绪，通过乘客状态分析模块分析公交车上站立乘客的乘车状态，预测驾驶员的开车状态，在监控到工作状态异常时通过状态调整提示模块提醒驾驶员及时地调整情绪和开车状态，减少了安全隐患，缓解了乘客乘车时的不适现象。
The present invention discloses a driver working state monitoring system based on software development, comprising: a customer information collection module, a main control platform, a monitoring automatic adjustment module, a working state analysis module, a passenger state analysis module, a monitoring linkage module and a state adjustment prompt module, wherein the customer information collection module collects driver information, the monitoring automatic adjustment module determines the sitting heights of different drivers according to the driver's height information, and automatically adjusts the monitoring range according to the driver's sitting height data to reduce invalid monitoring images, the working state analysis module analyzes whether the driver has "road noise" emotions according to the driver's facial expressions and hand movements, analyzes the riding state of standing passengers on the bus through the passenger state analysis module, predicts the driver's driving state, and reminds the driver to adjust his emotions and driving state in time through the state adjustment prompt module when the working state is abnormal, thereby reducing safety hazards and alleviating the discomfort of passengers when riding.
Description
Technical Field
The invention relates to the technical field of monitoring data processing, in particular to a driver working state monitoring system based on software development.
Background
The method comprises the steps of capturing and analyzing requirements, designing, realizing and testing, and the like, wherein in order to meet various requirements of clients, the software development technology is developed, the application direction is wider and wider, the working state of staff is required to be monitored by depending on the software development process, in the testing stage of a monitoring system, as much as possible, errors need to be found and solved at a small cost, the method has important significance as professional staff providing service for citizens in traveling, the working state of bus drivers is monitored and early warned in time, the monitoring range is automatically adjusted in the testing process, monitoring pictures required by the clients can be effectively captured, invalid monitoring pictures are reduced, the monitoring efficiency is improved, the requirements of the clients are met more intuitively, the abnormal situation of the working state of the drivers is not judged in time, the prompt processing is carried out, and the traffic safety hidden trouble cannot be reduced to a certain extent.
Therefore, a driver operating condition monitoring system based on software development is needed to solve the above problems.
Disclosure of Invention
The invention aims to provide a driver working state monitoring system based on software development, so as to solve the problems in the background technology.
In order to solve the technical problems, the invention provides the following technical scheme: a driver work state monitoring system based on software development is characterized in that: the system comprises: the system comprises a client information acquisition module, a main control platform, a monitoring automatic regulation module, a working state analysis module, a passenger state analysis module, a monitoring linkage module and a state adjustment prompt module;
The customer information acquisition module acquires information of different customers to the main control platform, and the method comprises the following steps: the method comprises the steps that height information of different drivers and height information of bus drivers after driver adjustment are sent to a monitoring automatic adjusting module by a main control platform, the monitoring automatic adjusting module predicts the sitting height of the drivers according to the heights of the drivers and the heights of corresponding drivers, tests whether the upper body is in an effective monitoring range or not under the dynamic state of the drivers according to the sitting heights of the different drivers and the positions of monitoring cameras, automatically adjusts the monitoring range if the upper body is not in the effective monitoring range, and simulates the working state of the drivers through a working state analyzing module after the monitoring range is adjusted: the method comprises the steps of analyzing facial expressions and hand actions of a driver, judging a passenger riding state according to a passenger body inclination proportion through the passenger state analysis module when the bus turns, comprehensively analyzing the driver riding state by combining the passenger riding state through the monitoring linkage module, and transmitting analysis results to the state adjustment prompt module, wherein the state adjustment prompt module prompts the driver to adjust the state when the driver works abnormally.
Further, the customer information acquisition module comprises a driver height acquisition unit and a driver position height acquisition unit, the height data of different drivers are acquired by the driver height acquisition unit, the driver position height data which are adjusted by the corresponding drivers are acquired by the driver position height acquisition unit, and all acquired information is transmitted to the main control platform for data storage.
Further, the automatic monitoring and adjusting module comprises a sitting height analyzing unit, a motion capturing testing unit and a monitoring range adjusting unit, wherein the sitting height analyzing unit judges sitting heights of different drivers according to received heights of the drivers and heights of driving positions, sitting height data are transmitted to the motion capturing testing unit, and the motion capturing testing unit tests whether hands and facial pictures of the drivers can be effectively captured when the drivers hold steering wheels according to an initial monitoring range: if the picture can be captured, monitoring the working state by using the initial monitoring range; and if the picture cannot be captured, adjusting the monitoring angle by using the monitoring range adjusting unit.
Further, the working state analysis module includes a working environment simulation unit and a working state test unit, the working environment simulation unit is used for simulating the working environment of a driver, in the simulation environment, the working state test unit is used for testing the facial expression and the maintenance time of the driver and the relative position of the hands of the driver and the steering wheel, the test result is transmitted to the monitoring linkage module, the passenger state analysis module includes a standing person counting unit and a body inclination measurement unit, the standing person counting unit is used for counting the number of standing persons on the bus in real time during turning, the number of persons data is transmitted to the body inclination measurement unit, the normal relative inclination angle between the body and the ground of the bus during turning is set, and the body inclination angle of the passenger is measured by the body inclination measurement unit and compared with the normal relative inclination angle: if the body inclination angle of the passengers exceeding the proportion is larger than the normal relative inclination angle during turning, judging that the driver makes an abnormality; otherwise, judging that the working state of the driver is normal, transmitting the comparison result to the monitoring linkage module, judging the comprehensive working state of the driver by the monitoring linkage module according to the test and comparison result, and reminding the driver to adjust the working state through the state adjustment prompt module if the comprehensive working state of the driver is abnormal.
Further, the height collection of different drivers is collected by the driver height collection unit to be h= { H 1,h2,...,hn }, the leg length index collection of the mahalanobis trunk of the corresponding driver is X= { X 1,X2,...,Xn }, the adjusted driver height collection of the corresponding driver is collected by the driver height collection unit to be H= { H 1,H2,...,Hn }, wherein n represents the number of drivers of the collected data, and the collected height, index and driver height data are transmitted to the main control platform.
Further, the main control platform transmits the acquired height, index and driving position height data to the sitting height analysis unit, the sitting heights of different drivers are analyzed through the sitting height analysis unit, and the vertical distance d i between the head top point and the ground when one driver sits on the driving position adjusted by the main control platform is calculated according to the following formula:
；
Wherein H i、Xi and H i respectively represent the height of the driver, the leg length index of the mahalanobis trunk and the adjusted height of the driver, the set of the vertical distances between the head top point and the ground when all drivers sit on the driver's adjusted positions is obtained to be d= { d 1,d2,...,dn }, the sitting height of the driver can be accurately judged through the relation between the height data and the leg length index of different drivers, and the vertical distances between the head top point and the ground can be calculated according to the adjusted height of the driver due to different comfortable seat heights of the drivers, so that the relative positions of the monitoring cameras and the drivers can be judged, the accurate adjustment of the monitoring range is facilitated, the invalid monitoring picture is reduced, the set of the distances is transmitted to the motion capture test unit, and the initial monitoring angle taking the head top point of the driver as the boundary is set as the initial monitoring angle The motion capture test unit tests that the horizontal distance between the monitoring camera and the vertex of the driver head is D, the vertical distance set is D '={D1 ',D2 ',...,Dn ', and the effective monitoring angle threshold value which takes the vertex of the driver head as the boundary is calculated according to the following formula：
；
Wherein D i ' represents the vertical distance between the monitoring camera and the top point of the ith driver head, and the obtained effective monitoring angle threshold value set is={，，...，ComparativeAnd: If it isThe hand and face images of the driver can be effectively captured, and the monitoring range is not required to be adjusted; if it isIndicating that the upper body of the driver is not in the effective monitoring range, the hand and face images of the driver can not be effectively captured, and the monitoring range adjusting unit is used for adjustingUp toThe aim of calculating the effective monitoring angle threshold value taking the top point of the head of the driver as the boundary according to the relative positions of the driver and the monitoring camera and the sitting heights of different drivers is to compare with the initial monitoring angle, judge whether the monitoring picture is complete or not, and be favorable for adjusting the monitoring range to obtain a complete and clear monitoring picture.
Further, the working environment simulation unit is used for simulating a working environment of a driver, in the simulated environment, the working state test unit is used for testing that a large maintenance time set of all the driver's mouths in a period from T1 to T2 is T= { T 1,T2,...,Tn }, and if the maintenance time in the set T is greater than or equal to (T2-T1)/2, the large maintenance time of the corresponding driver's mouths is excessively long; the standing person counting unit is used for counting the standing person number set of a random driver on the bus when the driver turns, wherein p= { p 1,p2,...,pm }, and the normal relative inclination angle of the body and the ground of the bus when the driver turns is set to beMeasuring the body inclination angle of the passenger by the body inclination measuring unit, andComparing, the body inclination angle is larger than that when turningThe number of people is p '={p1 ',p2 ',...,pm ', and the body inclination angle is larger than that when turningThe proportion of the number of people standing is set asWhere m represents the number of turns, ifIndicating that the turning radian of the driver is too large in the time period, counting the number of times of the excessive turning radian of the driver as a, ifIndicating that the number of times of overlarge turning radian is greater than or equal to half of the total turning number; otherwise, the number of times of overlarge turning radian is smaller than half of the total turning number, test and comparison results of a and m/2 and the maintaining time and (T2-T1)/2 in the set T are transmitted to the monitoring linkage module, when a driver generates a road noise emotion, the road noise emotion is always in an open cursory state for a long time, the phenomenon that the hands of the driver are separated from the steering wheel possibly occurs, once the driver is not careful, unexpected results are caused, the situation needs to be monitored and early-warned in time, meanwhile, the riding state of the passenger reflects the working state of the driver to a certain extent, and the accuracy of judging the working state of the driver can be improved by combining the riding state of the passenger and the emotion analysis of the driver.
Further, the monitoring linkage module judges the comprehensive working state of the driver according to the test and comparison results: in the presence of a sustain period greater than or equal to (t 2-t 1)/2 orOr when the driver leaves any one of the steering wheels, judging that the driver is abnormal; otherwise, judging that the working state of the driver is normal, if the working state is abnormal, reminding the corresponding driver to adjust the state through the state adjustment prompt module, and timely early warning and reminding the driver to adjust the emotion of the driver when the working of the driver is abnormal, so that the potential safety hazard of traffic is effectively reduced, and the uncomfortable phenomenon of passengers when riding is relieved.
Compared with the prior art, the invention has the following beneficial effects:
1. According to the invention, through simulating the working environment of a driver (bus driver), in a software testing stage, the relative positions of the monitoring cameras in the bus and the driver are judged according to the height data of the driver and the seat height data which are adjusted by the driver, and the effective monitoring angle threshold value which takes the top point of the driver head as the boundary is analyzed according to the relative positions of the driver and the monitoring cameras and the seat heights of different drivers, the effective monitoring angle threshold value is compared with the initial monitoring angle, so that whether a monitoring picture is complete or not is judged, the complete and clear monitoring picture is obtained by adjusting the monitoring range, the invalid picture in monitoring is reduced, and the monitoring efficiency is improved; after the monitoring range is adjusted, a simulated working environment of the driver is established, whether the mouth of the driver is opened or closed, the maintenance time of the mouth of the driver and whether the hands of the driver are separated from the steering wheel or not is monitored, meanwhile, the working state of the driver is analyzed by combining the judgment result of the riding state of the standing passenger in the turning process, and the driver is warned and reminded of adjusting the emotion of the driver in time when the driver works abnormally, so that the potential safety hazard of traffic is effectively reduced, and the uncomfortable phenomenon of the passenger in the riding process is relieved.
Drawings
The accompanying drawings are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate the invention and together with the embodiments of the invention, serve to explain the invention. In the drawings:
Fig. 1 is a block diagram of a driver operating condition monitoring system based on software development according to the present invention.
Detailed Description
The preferred embodiments of the present invention will be described below with reference to the accompanying drawings, it being understood that the preferred embodiments described herein are for illustration and explanation of the present invention only, and are not intended to limit the present invention.
Referring to fig. 1, the present invention provides the following technical solutions: a driver work state monitoring system based on software development is characterized in that: the system comprises: the system comprises a client information acquisition module S1, a main control platform S2, a monitoring automatic adjusting module S3, a working state analysis module S4, a passenger state analysis module S5, a monitoring linkage module S6 and a state adjustment prompting module S7;
The client information acquisition module S1 acquires information of different clients to the main control platform S2, including: the method comprises the steps that height information of different drivers and height information of bus drivers after driver adjustment are sent to a monitoring automatic adjusting module S3 by a main control platform S2, the monitoring automatic adjusting module S3 predicts the sitting height of the drivers according to the heights of the drivers and the heights of corresponding drivers, tests whether the upper body is in an effective monitoring range or not under the dynamic state of the drivers according to the sitting heights of the different drivers and the positions of monitoring cameras, automatically adjusts the monitoring range if the upper body is not in the effective monitoring range, and simulates the working state of the drivers through a working state analyzing module S4 after the monitoring range is adjusted: the facial expression and the hand actions of the driver are analyzed, meanwhile, the passenger riding state is judged according to the body inclination proportion of the passenger through the passenger state analysis module S5 when the bus turns, the monitoring linkage module S6 is combined with the passenger riding state to comprehensively analyze the working state of the driver, the analysis result is transmitted to the state adjustment prompt module S7, and the state adjustment prompt module S7 prompts the driver to adjust the state when the work of the driver is abnormal.
The customer information acquisition module S1 comprises a driver height acquisition unit and a driver position height acquisition unit, the driver height acquisition unit is used for acquiring height data of different drivers, the driver position height acquisition unit is used for acquiring the height data of the driver adjusted by the corresponding drivers, and all acquired information is transmitted to the main control platform S2 for data storage.
The monitoring automatic regulating module S3 comprises a sitting height analyzing unit, a motion capturing testing unit and a monitoring range regulating unit, wherein the sitting height analyzing unit judges the sitting heights of different drivers according to the received heights of the drivers and the heights of the drivers, the sitting height data are transmitted to the motion capturing testing unit, and the motion capturing testing unit tests whether the hands and facial pictures of the drivers can be effectively captured when the drivers hold the steering wheel according to the initial monitoring range: if the picture can be captured, monitoring the working state by using the initial monitoring range; if the picture can not be captured, the monitoring angle is adjusted by the monitoring range adjusting unit.
The working state analysis module S4 includes a working environment simulation unit and a working state test unit, the working environment simulation unit is used for simulating the working environment of a driver, in the simulation environment, the working state test unit is used for testing the facial expression and the maintenance time of the driver and the relative position of the hands of the driver and the steering wheel, the test result is transmitted to the monitoring linkage module S6, the passenger state analysis module S5 includes a standing person counting unit and a body inclination measurement unit, the standing person counting unit is used for counting the number of standing persons on the bus in real time during turning, the number of persons data is transmitted to the body inclination measurement unit, the normal relative inclination angle of the body and the ground of the bus during turning is set, and the body inclination angle of the passenger is measured by the body inclination measurement unit and compared with the normal relative inclination angle: if the body inclination angle of the passengers exceeding the proportion is larger than the normal relative inclination angle during turning, judging that the driver makes an abnormality; otherwise, judging that the working state of the driver is normal, transmitting the comparison result to the monitoring linkage module S6, judging the comprehensive working state of the driver by the monitoring linkage module S6 according to the test and comparison result, and reminding the driver to adjust the working state through the state adjustment prompt module S7 if the comprehensive working state is abnormal.
The height collection of different drivers is collected by the driver height collection unit to be h= { H 1,h2,...,hn }, the leg length index collection of the mahalanobis trunk of the corresponding driver is X= { X 1,X2,...,Xn }, the height collection of the driving position which is well adjusted by the corresponding driver is collected by the driving position height collection unit to be H= { H 1,H2,...,Hn }, wherein n represents the number of drivers of the collected data, and the collected height, index and driving position height data are transmitted to the main control platform S2.
The main control platform S2 transmits the collected height, index and driver position height data to the sitting height analysis unit, the sitting heights of different drivers are analyzed through the sitting height analysis unit, and the vertical distance d i between the head top point and the ground when a random driver sits on the driver position adjusted by the driver is calculated according to the following formula:
；
Wherein H i、Xi and H i respectively represent the height of the driver, the leg length index of the mahalanobis trunk and the adjusted height of the driver, the set of the vertical distances between the head top point and the ground when all drivers sit on the driver's adjusted positions is obtained to be d= { d 1,d2,...,dn }, the sitting height of the driver can be accurately judged through the relation between the height data and the leg length index of different drivers, and the vertical distances between the head top point and the ground can be calculated according to the adjusted height of the driver due to different comfortable seat heights of the drivers, so that the relative positions of the monitoring cameras and the drivers can be judged, the monitoring range can be conveniently and accurately adjusted, the invalid monitoring picture can be reduced, the set of the distances is transmitted to the motion capture test unit, and the initial monitoring angle taking the head top point of the driver as the boundary is set The motion capture test unit tests that the horizontal distance between the monitoring camera and the vertex of the driver head is D, the vertical distance set is D '={D1 ',D2 ',...,Dn ', and the effective monitoring angle threshold value which takes one random vertex of the driver head as a boundary is calculated according to the following formula：
；
Wherein D i ' represents the vertical distance between the monitoring camera and the top point of the ith driver head, and the obtained effective monitoring angle threshold value set is={，，...，ComparativeAnd: If it isThe hand and face images of the driver can be effectively captured, and the monitoring range is not required to be adjusted; if it isThe upper body of the driver is not in the effective monitoring range, the hands and the facial pictures of the driver can not be effectively captured, and the monitoring range adjusting unit is used for adjustingUp toThe aim of calculating the effective monitoring angle threshold value taking the head top point of the driver as the boundary according to the relative positions of the driver and the monitoring camera and the sitting heights of different drivers is to compare with the initial monitoring angle, judge whether the monitoring picture is complete or not, and facilitate the adjustment of the monitoring range to obtain a complete and clear monitoring picture.
Simulating a driver working environment by using a working environment simulation unit, in the simulated environment, using a working state test unit to test that a large maintenance time set of all driver mouths in a time period from T1 to T2 is T= { T 1,T2,...,Tn }, and if the maintenance time in the set T is greater than or equal to (T2-T1)/2, indicating that the corresponding large maintenance time of the driver mouths is overlong; the standing people counting unit is used for counting the standing people number set of a random driver on the bus when the driver turns, the standing people number set is p= { p 1,p2,...,pm }, and the normal relative inclination angle between the body and the ground of the bus when the driver turns is set to beMeasuring the body inclination angle of the passenger by using the body inclination measuring unit, andComparing, the body inclination angle is larger than that when turningThe number of people is p '={p1 ',p2 ',...,pm ', and the body inclination angle is larger than that when turningThe proportion of the number of people standing is set asWhere m represents the number of turns, ifIndicating that the turning radian of the driver is too large in the time period, counting the number of times of the excessive turning radian of the driver as a, ifIndicating that the number of times of overlarge turning radian is greater than or equal to half of the total turning number; otherwise, the number of times of overlarge turning radian is smaller than half of the total turning number, test and comparison results of a and m/2 and the maintaining time and (T2-T1)/2 in the set T are transmitted to the monitoring linkage module S6, when a driver generates a road noise emotion, the road noise emotion is always in a long-time open cursory state, the phenomenon that the hands of the driver are separated from the steering wheel possibly occurs, once the driver is not careful, unexpected results are caused, the situation needs to be monitored and early-warned in time, meanwhile, the riding state of the passenger reflects the working state of the driver to a certain extent, and the accuracy of judging the working state of the driver can be improved by combining the riding state of the passenger and emotion analysis of the driver.
The monitoring linkage module S6 judges the comprehensive working state of the driver according to the test and comparison results: in the presence of a sustain period greater than or equal to (t 2-t 1)/2 orOr when the driver leaves any one of the steering wheels, judging that the driver is abnormal; otherwise, judging that the working state of the driver is normal, if the working state is abnormal, reminding the corresponding driver to adjust the state through the state adjustment prompt module S7, and timely early warning and reminding the driver to adjust the emotion of the driver when the work of the driver is abnormal, so that the potential safety hazard of traffic can be effectively reduced, and the uncomfortable phenomenon of passengers when riding can be effectively relieved.
Embodiment one: the height collection unit of the driver collects heights of different drivers to be h= { H 1,h2,h3 } = {180, 170, 175}, the leg length index collection of the mahalanobis trunk of the corresponding driver to be X= { X 1,X2,X3 = {92, 82, 86}, the height collection unit of the driver collects the height collection of the driver adjusted to be H= { H 1,H2,H3 = {40, 34, 36}, the sitting heights of different drivers are analyzed by the sitting height analysis unit, and the sitting heights of the different drivers are calculated according to the formulaObtaining that when all drivers sit on the self-adjusted driving positions, the vertical distance set of the head top points from the ground is d= { d 1,d2,d3 = {133.8, 127.4, 130.1}, transmitting the distance set into the motion capture test unit, and setting the initial monitoring angle taking the head top points of the drivers as the boundary asThe motion capture test unit tests that the horizontal distance set of the monitoring camera and the vertex of the driver head is D=50, the vertical distance set is D '={D1 ',D2 ',D3 ' = {50, 70, 60}, and the formula is based on the following formulaObtaining the effective monitoring angle threshold value set as={，，}={，，}，，，The upper body of the driver 1 is not in the effective monitoring range, and the hands and the facial images of the driver cannot be effectively captured and respectively regulated by the monitoring range regulating unitUp to。
Finally, it should be noted that: the foregoing is merely a preferred example of the present invention, and the present invention is not limited thereto, but it is to be understood that modifications and equivalents of some of the technical features described in the foregoing embodiments may be made by those skilled in the art, although the present invention has been described in detail with reference to the foregoing embodiments. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (1)
1. A driver work state monitoring system based on software development is characterized in that: the system comprises: the system comprises a client information acquisition module (S1), a main control platform (S2), a monitoring automatic adjusting module (S3), a working state analysis module (S4), a passenger state analysis module (S5), a monitoring linkage module (S6) and a state adjustment prompting module (S7);
the customer information acquisition module (S1) comprises a driver height acquisition unit and a driver position height acquisition unit, the height data of different drivers are acquired by the driver height acquisition unit, the driver position height data which are adjusted by the corresponding drivers are acquired by the driver position height acquisition unit, and all acquired information is transmitted to the main control platform (S2) for data storage;
The client information acquisition module (S1) acquires information of different clients to the main control platform (S2), and comprises: the method comprises the steps that height information of different drivers and height information of bus drivers after driver adjustment are sent to a monitoring automatic adjusting module (S3) by a main control platform (S2), the monitoring automatic adjusting module (S3) predicts the sitting height of the drivers according to the heights of the drivers and the heights of corresponding drivers, whether the upper body is in an effective monitoring range or not under the dynamic state of the drivers is tested according to the sitting heights of the different drivers and the positions of monitoring cameras, if the upper body is not in the effective monitoring range, the monitoring range is automatically adjusted, and after the monitoring range is adjusted, the working state of the drivers is simulated by a working state analyzing module (S4): analyzing facial expressions and hand actions of a driver, judging a passenger riding state according to a passenger body inclination proportion through the passenger state analysis module (S5) when the bus turns, comprehensively analyzing the driver working state by combining the passenger riding state through the monitoring linkage module (S6), transmitting analysis results to the state adjustment prompt module (S7), and prompting the driver to adjust the state when the driver works abnormally through the state adjustment prompt module (S7);
The working state analysis module (S4) comprises a working environment simulation unit and a working state test unit, the working environment simulation unit is used for simulating the working environment of a driver, the working state test unit is used for testing the facial expression and the maintenance time of the driver and the relative position of the hands of the driver and the steering wheel in the simulation environment, the test result is transmitted to the monitoring linkage module (S6), the passenger state analysis module (S5) comprises a standing person counting unit and a body inclination measurement unit, the standing person counting unit is used for counting the number of the standing persons on the bus in real time during turning, the number of person data is transmitted to the body inclination measurement unit, the normal relative inclination angle of the body and the ground of the bus during turning is set, and the body inclination angle of the passenger is measured by the body inclination measurement unit and compared with the normal relative inclination angle during turning: if the body inclination angle of the passengers exceeding the proportion is larger than the normal relative inclination angle during turning, judging that the driver makes an abnormality; otherwise, judging that the working state of the driver is normal, transmitting a comparison result to the monitoring linkage module (S6), judging the comprehensive working state of the driver by the monitoring linkage module (S6) according to the test and comparison result, and reminding the driver to adjust the working state through the state adjustment prompt module (S7) if the comprehensive working state is abnormal;
The automatic monitoring and adjusting module (S3) comprises a sitting height analyzing unit, a motion capturing and testing unit and a monitoring range adjusting unit, wherein the sitting height analyzing unit judges sitting heights of different drivers according to received heights of the drivers and heights of driving positions, sitting height data are transmitted to the motion capturing and testing unit, and the motion capturing and testing unit tests whether hands and facial pictures of the drivers can be effectively captured when the drivers hold steering wheels according to an initial monitoring range: if the picture can be captured, monitoring the working state by using the initial monitoring range; if the picture can not be captured, the monitoring angle is adjusted by the monitoring range adjusting unit;
The height collection unit of the driver collects heights of different drivers to be h= { H 1,h2,...,hn }, the leg length index collection of the mahalanobis trunk of the corresponding driver to be X= { X 1,X2,...,Xn }, the height collection unit of the driver collects the height collection of the corresponding driver to be H= { H 1,H2,...,Hn }, wherein n represents the number of the drivers of which the data are collected, and the collected heights, indexes and the height data of the driver are transmitted to the main control platform (S2);
The main control platform (S2) transmits the collected height, index and driving position height data to the sitting height analysis unit, the sitting heights of different drivers are analyzed through the sitting height analysis unit, and the vertical distance d i between the head top point and the ground when one driver sits on the driving position adjusted by the main control platform according to the following formula is calculated:
；
Wherein H i、Xi and H i respectively represent the height of the driver, the leg length index of the mahalanobis trunk and the adjusted height of the driver, so as to obtain a set of vertical distances d= { d 1,d2,...,dn } between the head top points and the ground when all drivers sit on the driver's adjusted positions, transmitting the set of distances to the motion capture test unit, and setting an initial monitoring angle with the head top points of the drivers as a boundary as The motion capture test unit tests that the horizontal distance between the monitoring camera and the vertex of the driver head is D, the vertical distance set is D '={D1 ',D2 ',...,Dn ', and the effective monitoring angle threshold value which takes the vertex of the driver head as the boundary is calculated according to the following formula：
；
Wherein D i ' represents the vertical distance between the monitoring camera and the top point of the ith driver head, and the obtained effective monitoring angle threshold value set is={，，...，ComparativeAnd: If it isThe hand and face images of the driver can be effectively captured, and the monitoring range is not required to be adjusted; if it isIndicating that the upper body of the driver is not in the effective monitoring range, the hand and face images of the driver can not be effectively captured, and the monitoring range adjusting unit is used for adjustingUp to；
Simulating a driver working environment by using the working environment simulation unit, in the simulated environment, using the working state test unit to test that a large maintenance time set of all the driver mouths in a time period from T1 to T2 is T= { T 1,T2,...,Tn }, and if the maintenance time in the set T is greater than or equal to (T2-T1)/2, indicating that the corresponding large maintenance time of the driver mouths is overlong; the standing person counting unit is used for counting the standing person number set of a random driver on the bus when the driver turns, wherein p= { p 1,p2,...,pm }, and the normal relative inclination angle of the body and the ground of the bus when the driver turns is set to beMeasuring the body inclination angle of the passenger by the body inclination measuring unit, andComparing, the body inclination angle is larger than that when turningThe number of people is p '={p1 ',p2 ',...,pm ', and the body inclination angle is larger than that when turningThe proportion of the number of people standing is set asWhere m represents the number of turns, ifIndicating that the turning radian of the driver is too large in the time period, counting the number of times of the excessive turning radian of the driver as a, ifIndicating that the number of times of overlarge turning radian is greater than or equal to half of the total turning number; otherwise, the times of overlarge turning radian is less than half of the total turning times, and test and comparison results of a, m/2, the maintaining time in the set T and (T2-T1)/2 are transmitted to the monitoring linkage module (S6);
the monitoring linkage module (S6) judges the comprehensive working state of the driver according to the test and comparison results: in the presence of a sustain period greater than or equal to (t 2-t 1)/2 or Or when the driver leaves any one of the steering wheels, judging that the driver is abnormal; otherwise, judging that the working state of the driver is normal, and reminding the corresponding driver of adjusting the state through the state adjustment prompting module (S7) if the working state is abnormal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410679923.8A CN118247777B (en) | 2024-05-29 | 2024-05-29 | Driver working state monitoring system based on software development |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410679923.8A CN118247777B (en) | 2024-05-29 | 2024-05-29 | Driver working state monitoring system based on software development |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN118247777A CN118247777A (en) | 2024-06-25 |
| CN118247777B true CN118247777B (en) | 2024-11-08 |
Family
ID=91564151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410679923.8A Active CN118247777B (en) | 2024-05-29 | 2024-05-29 | Driver working state monitoring system based on software development |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN118247777B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103978932A (en) * | 2014-05-16 | 2014-08-13 | 长安大学 | Detection device and detection method for bus driver dangerous driving |
| CN115083114A (en) * | 2022-07-03 | 2022-09-20 | 苏州云之舟智能科技有限公司 | Real-time early warning equipment |
| CN117610932A (en) * | 2023-12-04 | 2024-02-27 | 中国雄安集团交通有限公司 | Public transport operation risk management and control system based on artificial intelligence |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5949660B2 (en) * | 2013-05-21 | 2016-07-13 | 株式会社デンソー | Driver confirmation device |
| CN113379832B (en) * | 2021-06-23 | 2022-06-07 | 南京领行科技股份有限公司 | Camera pose adjusting method and device, electronic equipment and storage medium |
| US20230130201A1 (en) * | 2021-10-26 | 2023-04-27 | GM Global Technology Operations LLC | Driver seat and side mirror-based localization of 3d driver head position for optimizing driver assist functions |
| CN218661579U (en) * | 2022-10-18 | 2023-03-21 | 安徽海德瑞丰光电科技有限公司 | Adjustable intelligent early warning device for fatigue driving |
-
2024
- 2024-05-29 CN CN202410679923.8A patent/CN118247777B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103978932A (en) * | 2014-05-16 | 2014-08-13 | 长安大学 | Detection device and detection method for bus driver dangerous driving |
| CN115083114A (en) * | 2022-07-03 | 2022-09-20 | 苏州云之舟智能科技有限公司 | Real-time early warning equipment |
| CN117610932A (en) * | 2023-12-04 | 2024-02-27 | 中国雄安集团交通有限公司 | Public transport operation risk management and control system based on artificial intelligence |
Also Published As
| Publication number | Publication date |
|---|---|
| CN118247777A (en) | 2024-06-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11386676B2 (en) | Passenger state analysis method and apparatus, vehicle, electronic device and storage medium | |
| Li et al. | Modeling of driver behavior in real world scenarios using multiple noninvasive sensors | |
| CN111048171B (en) | Method and device for solving motion sickness | |
| US8400313B2 (en) | Vehicle driver sleep state classification generating device based on Hidden Markov Model, sleep state classification device and warning device | |
| CN104616438B (en) | A kind of motion detection method of yawning for fatigue driving detection | |
| CN111027478A (en) | A driver and passenger behavior analysis and early warning system based on deep learning | |
| CN108446600A (en) | A kind of vehicle driver's fatigue monitoring early warning system and method | |
| CN110291478A (en) | Driver Monitoring and Response System | |
| US9105172B2 (en) | Drowsiness-estimating device and drowsiness-estimating method | |
| CN112097916B (en) | Medical epidemic prevention temperature measurement system and method | |
| CN110103816A (en) | A kind of driving condition detection method | |
| CN118247777B (en) | Driver working state monitoring system based on software development | |
| JP2022152500A (en) | Awakening level estimation method, awakening level estimation device and awakening level estimation program | |
| CN116168374B (en) | Active safety auxiliary driving method and system | |
| CN117885743A (en) | A method and system for identifying and restoring driver abnormal state | |
| CN118082854A (en) | A driver status monitoring and adjustment method and system based on multi-source data fusion | |
| CN115414008B (en) | VR display method and system for combating motion sickness | |
| CN113298346A (en) | Intelligent public transportation monitoring management system and method based on Internet of things | |
| CN118615646B (en) | Automatic intelligent spinning and operation safety protection system thereof | |
| CN119113333B (en) | Sleep quality monitoring and early warning system and method based on blockchain | |
| Priya et al. | Machine Learning-Based System for Detecting and Tracking Driver Drowsiness | |
| CN114869240B (en) | Method for screening motion sickness of flight students, bracelet and system | |
| CN113602280B (en) | Method, device and system for monitoring state of driver | |
| CN117341715B (en) | Vehicle driving safety early warning method based on joint self-checking | |
| JP7295790B2 (en) | In-vehicle device, processing device and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: Room 805, No. 974 East Huangpu Avenue, Huangpu District, Guangzhou City, Guangdong Province, 510000, self numbered 21st Patentee after: Guangzhou Hongyi Information Technology Co.,Ltd. Country or region after: China Address before: Room 805, No. 974 Huangpu Avenue East, Huangpu District, Guangzhou City, Guangdong Province, China. Self number 21 Patentee before: Guangzhou Hongyi Information Technology Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |