KR20150061943A - Device for detecting the status of the driver and method thereof - Google Patents

Abstract

The present invention relates to a device for detecting status of a driver and a method thereof, comprising: an acquisition unit acquiring driving operation information and careless status information of a driver; a control unit calculating a driving operation load by using the acquired driving operation information and a driving disturbance load by using the acquired careless status information, comparing the driving operation load and the driving disturbance load to determine safe driving status of the driver, and controlling an output unit for warning information to be outputted when determining that the driver is not in safe driving status in accordance with a determination result; and the output unit outputting the warning information by performing at least one output operation of a screen output and a warning sound output.

Description

Technical Field [0001] The present invention relates to a driver status detecting apparatus,

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a safe driving support system, and more particularly, to a technique for detecting a driver's condition to induce safe driving.

2. Description of the Related Art [0002] In recent years, intelligent and advanced automobiles have gradually been developed through technology convergence of automobiles and ICT (Information & Communication Technology). Accordingly, a safe driving support system implemented in an automobile recognizes a dangerous situation , And performs an operation of informing the driver thereof. The way in which a vehicle's safe driving support system recognizes a dangerous situation is mainly a method of collecting information through external sensors (radar, camera, lidar, etc.) and judging the risk (lane departure, collision prediction, etc.). In addition, there is a method of informing the driver of the dangerous situation by displaying the dangerous situation on a display device (for example, flashing display device such as a warning lamp) or by voice.

However, there are many cases in which a warning system for warning a driver by flashing a warning light or a warning device such as a warning light is buried in a noise caused by high-speed driving, or is focused on driving by looking forward,

In addition, it is important to understand the mental / physical health condition of the driver as well as the danger through sensors outside the vehicle for safe driving. However, it is cumbersome, restrictive, and costly to acquire the physical information of the person driving the vehicle .

An object of the present invention is to provide a technical solution which can induce safe driving by grasping the state of a driver.

According to an aspect of the present invention, there is provided an apparatus for detecting a driver's condition, the apparatus comprising: an obtaining unit that obtains driving operation information and driver's carelessness information of the vehicle; And determines whether or not the driver is in a safe driving state by comparing the traveling operation load amount and the traveling obstruction load amount with each other to determine a safe driving state of the driver. And an output unit for outputting the warning information by performing at least one output operation of a screen output and a warning sound output to control the output unit so that the warning information is output.

Here, the obtaining unit may include at least one of an acceleration pedal operation, a brake pedal operation, a clutch pedal operation, a multi-function switch operation, and a steering wheel operation of the vehicle to obtain the running operation information, At least one of the operation time information and the operation frequency information of the item included in the information and the weight set in each item are calculated to calculate the running load.

The acquiring unit acquires the careless state information using at least one of a peripheral device operation, a driver's voice, a face image, and an eye region image of the driver. The control unit may obtain information on an item included in the careless state information The disturbance load of the driver is calculated using at least one of the drowsiness load of the driver, the attention negligence load, the voice load, and the operation load of the peripheral device.

Further, the control unit may determine that the driver is not in the safe driving state when the value obtained by subtracting the traveling obstruction load from the driving load amount is equal to or less than a predetermined threshold value of the allowable load amount, The control unit controls the output unit to output the warning sound when it is confirmed that the driver has closed his / her eyes for a predetermined time or longer.

According to another aspect of the present invention, there is provided a method for detecting a driver's state by a driver's state sensing apparatus, comprising: obtaining driving operation information and driver's carelessness information of the vehicle; Calculating a traveling obstruction load amount using the traveling operation load amount and the carelessness information, comparing the traveling operation load amount with the travel obstruction load amount and a predetermined allowable load amount, Said method comprising the steps of:

Here, the acquiring step may include acquiring the traveling operation information including at least one of an acceleration pedal operation, a brake pedal operation, a clutch pedal operation, a multi-function switch operation, and a steering wheel operation of the vehicle, And acquiring the carelessness information including at least one of an operator's voice, a face image, and an eye region image of the driver, wherein the calculating includes calculating an operation time of the item included in the driving operation information Calculating at least one of information and operation frequency information and a predetermined weight for each item to calculate the traveling load amount; and calculating the driving load of the driver based on the information of the items included in the carelessness information, Load information, at least one of voice load and peripheral operation load, And a step of calculating the running disturbance load.

The comparing step may include comparing the current load amount, which is a value obtained by subtracting the traveling load amount from the running load amount, to be equal to or less than the allowable load amount, and the different providing step may be a step of calculating a difference between the running load amount Current load. And displaying the information in red if the amount is less than the allowable load amount, and providing the information to the driver when the excess load amount is exceeded.

Further, the driver state detection method may further include the step of outputting the warning sound to warn the driver using the eye region image among the items included in the careless state information when it is confirmed that the driver has closed his or her eyes for a predetermined time or longer .

According to the present invention, the safe driving state of the driver is checked by comparing the driving load amount generated due to the driving of the vehicle, the driving load impeded by the driver such as peripheral devices and the driver's sleeping state, (For example, a peripheral device) is forcibly stopped by stopping the operation of an element (for example, a peripheral device) that is not essential for driving the vehicle, thereby reducing the amount of disturbing load that interferes with driving the vehicle, Create an effect.

1 is a block diagram of a driver status sensing apparatus according to an embodiment of the present invention;
Figure 2 shows an arrangement of acquisition information according to the invention;
3 is a view for explaining a method of confirming the driver's eyes closed according to the present invention.
4 is a view for explaining a drowsiness load of a driver out of a disturbance load of travel according to the present invention.
FIG. 5 is a flow chart for explaining a drowsiness load of a driver among w-travel obstruction loads according to the present invention;
6 is a view for explaining an attention negligence load of a driver in a traveling obstruction load according to the present invention;
7 is a diagram illustrating screen output according to the present invention.
8 is a flowchart of a driver state sensing method according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS The foregoing and further aspects of the present invention will become more apparent from the following detailed description of preferred embodiments with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a driver status sensing apparatus according to an embodiment of the present invention. As shown, the driver condition sensing apparatus 10 includes an acquisition unit 100, a control unit 200, and an output unit 300.

The acquiring unit 100 is a configuration for acquiring the traveling operation information of the vehicle and the carelessness information of the driver. At this time, the acquiring unit 100 may include the traveling operation sensing unit 110 and the inattention state sensing unit 120, and may acquire the traveling operation information and the driver's carelessness information through each.

Among them, the traveling operation sensing unit 110 is configured to sense the operation of the control unit, which is essentially required for the vehicle to travel. The traveling operation sensing unit 110 may be an electronic control unit (ECU) Lt; / RTI >

The driving operation sensing unit 110 includes a plurality of operation sensing units such as an acceleration pedal operation sensing unit d1, a brake pedal operation sensing unit d2, a multifunction operation sensing unit d3, and a steering wheel operation sensing unit d4 . As shown in FIG. 2 (a), a plurality of operation sensing units of the travel operation sensing unit 110 sense an operation for driving the vehicle, and operate an ACC pad operation, a brake pedal operation, A multifunction switch (Multi function S / W) operation, and a steering wheel operation. Furthermore, the traveling operation sensing unit 110 may further include a clutch pedal operation or a transmission operation item of the passive-gear vehicle to acquire the traveling operation information. At this time, the traveling operation sensing unit 110 can confirm the speed of the vehicle and acquire the traveling operation information when the speed of the vehicle is equal to or higher than a predetermined speed (for example, 10 km / h).

)를 감지한다. 예를 들어, 주행 조작 감지부(110)는 200ms 동안 50ms 마다 가속도 패달이 작동(ON)하는지 지속적으로 확인한다. 이와 마찬가지로, 주행 조작 감지부(110)는 브레이크 패달 및 클러치 패달 또한 일정 시간마다 조작되는 작동 횟수(각각,

)를 감지할 수 있다. For example, the traveling operation detecting unit 110 may detect the number of times of operation of the acceleration pedal operated by the driver (for example,

). For example, the traveling operation sensing unit 110 continuously checks whether the acceleration pedal is ON (ON) every 50 ms for 200 ms. Likewise, the traveling operation detecting unit 110 detects the number of times the brake pedal and the clutch pedal are operated,

). ≪ / RTI >

)를 감지한다. 여기서 멀티펑션 스위치란, 차량의 와이퍼, 방향 지시등 등과 같은 차량 램프를 동작시키기 위한 스위치일 수 있다. 예를 들어, 주행 조작 감지부(110)는 200ms 동안 멀티펑션의 스위치가 조작하는 동작 횟수를 카운트한다.As another example, the traveling operation detecting unit 110 may detect the number of times of operation of each switch of the multi-function operated by the driver for a predetermined time

). Here, the multi-function switch may be a switch for operating a vehicle lamp such as a wiper of a vehicle, a turn signal lamp, or the like. For example, the traveling operation sensing unit 110 counts the number of times that the multi-function switch is operated for 200 ms.

)를 감지한다. 이때, 주행 조작 감지부(110)는 별도로 각속도를 측정하지 않고, 소정 시간 동안 일정 시간마다 스티어링 휠의 각 변화량을 측정하여 각 속도를 산출할 수 있다. 예를 들어, 주행 조작 감지부(110)는 200ms 동안 50ms 마다 스티어링 휠의 각 변화량을 측정하여 각속도를 산출할 수 있다. As another example, the traveling operation detecting unit 110 may detect the angular velocity of the steering wheel

). At this time, the traveling operation sensing unit 110 can measure the angular velocity of the steering wheel by measuring the angular velocity of the steering wheel at predetermined time intervals without measuring the angular velocity separately. For example, the traveling operation sensing unit 110 may calculate the angular velocity by measuring the angular variation of the steering wheel every 50 ms for 200 ms.

The inattentive state sensing unit 120 is a structure for sensing an operation of a control unit that is additionally operated when the vehicle is running and an operation of the driver. The inattentive state sensing unit 120 includes a plurality of audio signal input sensing units T1, air conditioning signal input sensing units T2, navigation signal input sensing units T3, and the like, for sensing the operation of the control unit (Manual Factor) As shown in FIG. The carelessness detecting unit 120 may include a drowsiness index measuring unit P, a gaze direction measuring unit E and a voice sensing unit V to detect a driver's operation (visual factor, verbal factor) . As illustrated in FIG. 2, the plurality of sensing units and the measurement units included in the carelessness sensing unit 120 are implemented in a predetermined position of the vehicle and include at least one item of a peripheral device operation, a face image of a driver, The carelessness information can be obtained using the information of the careless state.

)를 감지할 수 있다. 여기서, 주변 기기는 차량용 AVN(Audio, Video, Navigation), 차량 공조 장치 등과 같이 차량 주행에 필수적인 장치는 아니나, 운전자의 편의나 차량 실내 환경을 위해 조작될 수 있는 차량 제어 유닛들일 수 있다. 예를 들어, 부주의 상태 감지부(120)는 차량이 소정 속도(예를 들어, 10km/h) 이상으로 주행 중, 일정 시간(예를 들어, 200ms) 동안 운전자에 의해 조작되는 주변 기기들의 동작 스위치 입력 횟수를 감지하여 부주의 상태 정보로 획득할 수 있다.For example, the carelessness detecting unit 120 may detect the number of times the peripheral device is operated by the driver

). ≪ / RTI > Here, the peripheral device may not be an indispensable device for driving the vehicle such as an AVN (Audio, Video, Navigation), a car air conditioner, etc., but may be vehicle control units that can be operated for the convenience of the driver or the vehicle interior environment. For example, the carelessness detecting unit 120 may detect an inattentive state of the vehicle by operating the operation switches of peripheral devices operated by the driver for a predetermined time (for example, 200 ms) while the vehicle is traveling at a predetermined speed (for example, 10 km / The number of times of input can be detected and it can be acquired as inattention state information.

As another example, the carelessness sensing unit 120 may sense the driver's voice through a microphone mounted at a predetermined position in the vehicle. For example, the carelessness detecting unit 120 can check the pulse size (voice size) and the voice generation time of voice data received from the microphone for a predetermined time. Preferably, the carelessness sensing unit 120 detects the time at which the voice data having the pulse size equal to or larger than the pulse threshold value is received for a predetermined time (for example, 200 ms) using the pulse threshold value pre- .

As another example, the carelessness detecting unit 120 may receive the face image of the driver through the camera installed in the predetermined position of the vehicle, and may obtain the eye sight information and the attention neglect information of the driver. At this time, the camera may include a Near Infrared LED (Near Infrared LED) as shown in FIG. 2 (b) so that the camera can record images during daytime and at night. Preferably, the carelessness sensing unit 120 may extract the eye region image of the driver separately from the face image of the driver. At this time, the face image of the driver may be image-processed to extract the eye region image. That is, the carelessness detecting unit 120 can obtain the carelessness information such as the eyesight information and the attention neglect information by using the face image and the eye area image of the driver received from the camera.

The inattentive state sensing unit 120 can acquire the driver's eyesight information using the eye region image extracted from the face image of the driver. Referring to FIG. 3, the carelessness detecting unit 120 detects the eyelid region in the eye region image, and when the sum of angles ∠A and ∠B, which are eyelid angles, is less than a predetermined threshold angle value ∠C (∠A + ∠B ≤ ∠C), confirm that the driver has closed his eyes.

The inattentive state sensing unit 120 senses the number of times the driver closes his or her eyes by checking the angle of the eyelid for a predetermined period of time, calculates the number of times the eyes are closed for a predetermined period of time and a predetermined time value, Can be obtained. For example, the inattentive state sensing unit 120 measures (counts) the number of times the eyes are closed by dividing the time into 250 ms in one second. When the count is 3, the driver's eyes closed time (sleeping time) .

In addition, the carelessness sensing unit 120 may acquire the attention neglect information of the driver using the face image of the driver and the eye region image. Referring to FIG. 6, the range of attention negligible is based on the angle of the vehicle wheel, that is, the angle of change of the wheel in the center of the vehicle (an example such as? A or? B in FIG. 6A) , And determines whether or not there is a visibility range of the driver in the visibility distance (?) In which there is no load at the time of driving the vehicle. The visual field range is obtained by calculating the angle of the face (alpha in FIG. 6 (b)) from the face image of the driver obtained from the camera and then calculating the pupil position (pupil direction) (?).

Specifically, when the steering wheel angle is within a predetermined angle and the lever of the transmission is in the D-range or N-range, the carelessness detecting unit 120 detects that the driver's line of sight is in the running- , It is possible to acquire the information of negligence by judging it by neglecting attention and confirming the time. For example, if the vehicle speed is 10 Km or more and the transmission lever D or N is within ± 15 ° of the steering wheel angle, the inattentive state sensing unit 120 determines that the driver's line of sight is in the running no- ) Can be judged to be a negligence on the front of the vehicle when the vehicle is not detected.

The controller 200 may be an electronic control unit configured to perform an overall operation of the driver's condition sensing device 10. [ For example, the control unit 200 may be referred to as a driving workload computing unit (DWC).

Specifically, the control unit 200 calculates the traveling operation load amount and the travel disturbance load amount using the traveling operation information and the inattention state information acquired from the acquisition unit 100. [ In addition, the safe operation state of the driver is determined by comparing the load of the operation load and the load of the obstruction of travel, and the output unit 300 is controlled so that warning information is output when it is determined that the operation state is not the safe operation state.

First, the control unit 200 calculates the traveling operation load amount and the travel disturbance load amount using the traveling operation information and the carelessness information obtained from the acquisition unit 100.

)을 계산한다. 구체적으로, 제어부(200)는 주행 조작 감지부(110)로부터 획득되는 주행 조작 정보와, 주행 조작 정보의 항목별 가중치를 메모리로부터 불러와 주행 조작 부하량을 계산한다. For example, the control unit 200 may use the traveling operation information obtained from the traveling operation sensing unit 110 of the acquisition unit 100 to calculate the traveling operation load amount (

). Specifically, the control unit 200 calculates the traveling operation load obtained by loading the traveling operation information obtained from the traveling operation sensing unit 110 and the weight for each item of the traveling operation information from the memory.

Here, the weights may be predetermined values extracted for each item of the traveling operation information through various experiments in advance. Alternatively, the weight value may be a predetermined value arbitrarily preset for each item by the operator in advance. Further, the memory may be nonvolatile memory as a storage means for storing data.

,) 브페이크 패달 조작에 대한 가중치(

), 멀티펑션 스위치 조작에 대한 가중치(

) 및 조향 핸들 조작에 대한 가중치(θ)를 메모리로부터 불러올 수 있다.Preferably, the control unit 200 can calculate the load for each item by using the items included in the traveling operation information and the weights corresponding to the items. For example, when the driving operation information of the acceleration pedal operation, the brake pedal operation, the multi-function switch operation, and the steering wheel operation is obtained from the acquiring unit 100, the control unit 200 acquires the weight

, The weight for the Fake pedal operation (

), Weight for multi-function switch operation (

) And the weight ([theta]) for the steering wheel manipulation from the memory.

)은 수학식 1과 같이 나타낼 수 있다.If the time and frequency information of each item is acquired in units of 50 ms for 200 ms in the acquiring unit 100, the driving operation load for 200 ms calculated by the control unit 200

) Can be expressed by Equation (1).

Each item included in the running operation information can be added or subtracted in some cases. If the traveling operation information includes the clutch pedal operation and the transmission operation according to the type of vehicle, the control unit 200 may calculate the traveling operation load by further considering the weight for the clutch pedal operation and the weight for the transmission operation .

)을 계산한다. 구체적으로, 제어부(200)는 부주의 상태 감지부(120)로부터 획득되는 부주의 상태 정보에 포함된 각 항목들에 대한 부하량을 구할 수 있으며, 구해진 각 항목들의 부하량의 합하여 주행 방해 부하량을 계산할 수 있다.As another example, the control unit 200 may use the carelessness information obtained from the carelessness sensing unit 120 of the acquisition unit 100 to calculate the travel disturbance load

). Specifically, the control unit 200 can calculate the load for each item included in the carelessness information obtained from the carelessness sensing unit 120, and calculate the travel disturbance load by summing the loads of the respective items.

The control unit 200 may calculate the peripheral device operation load T (n) by using the number of peripheral device operations obtained from the carelessness detection unit 120 of the acquisition unit 100. [ For example, the control unit 200 may calculate the operating load of the peripheral device considering the weight of the operation of the peripheral device previously stored in the memory. If the acquiring unit 100 acquires the number of inputs of the peripheral operation by the driver for 200 ms, the control unit 200 calculates the number of peripheral operation inputs and the weight to calculate the peripheral operation load T (n) .

Further, the control unit 200 may calculate the voice load V (n) using the voice data of the driver obtained from the carelessness detecting unit 120 of the obtaining unit 100. Specifically, the control unit 200 can calculate the voice load considering the pulse threshold value of the voice data stored in the memory. For example, the control unit 200 determines the time at which voice data over a pulse threshold value is received from the voice data of the driver obtained for a predetermined time (for example, 200 ms) from the carelessness detecting unit 120 of the obtaining unit 100 To calculate the voice load amount V (t).

In addition, the control unit 200 calculates the sleeping load P (t) and the traveling neglecting load (load) P (t) by using the eye-sight-sensitive information and the attention-neglecting information among the carelessness information obtained by the carelessness detecting unit 120 of the acquiring unit 100 (E (t)) can be calculated.

Referring to the graph of FIG. 4, when the driver is in a perceived state, the variation range of the graph is relatively stable, while the PERCLOS value in the drowsy state is considerably changed and the overall value is higher than the perceived state. Here, the PERCLOS value can be expressed by Equation (2).

If the control unit 200 determines that the PERCLOS value is equal to or greater than a predetermined percentage (30%) based on the graph of FIG. 4, that is, The control unit 200 controls the output unit 300 to output a vehicle alarm sound when it is determined that the driver has closed his / her eyes for a predetermined period of time (for example, about 75 seconds). This is because the drowsy driving is the highest risk factor in driving the vehicle, so if it is confirmed that the driver has closed his or her eyes for a certain period of time, it is determined that the driver is in a drowsy driving state and an alarm sound is immediately output to warn the driver.

At this time, the controller 200 can perform the eye blindness check operation of the driver with reference to the flowchart of FIG. Specifically, the control unit 200 determines whether the vehicle speed V exceeds a predetermined speed (for example, V? 10 Km / h) for a predetermined time (N) through the carelessness sensing unit 120 (sleeping time) can be calculated by checking the number of times of eyelashes (y) through the angle of the eyelids for each x (for example, 250 ms or 0.25 s). At this time, if the angle of the eyelid is ∠A + ∠B ∠∠C, the carelessness detecting unit 120 determines that the eye is closed and counts the number of eyes closed (y ++). The control unit 200 counts the number of times the eyes are wiped (x + = 0.25, y ++) every predetermined time (x), and if the number of eyes wiped for one second is three times (x = 200) counts (P ++) the conversion factor (P) value. The controller 200 repeats the above steps while increasing the measurement time (N ++). If the conversion factor P becomes 100 or more within the measurement time of 250 seconds (N250, P100) And controls the output unit 300 so as to generate a warning. In addition, the controller 200 changes the conversion factor P to 99, decreases the measurement time N by 1 second (P = 99, N- = 1), repeats the above process, It is possible to calculate the winding time (sleeping time). Further, the controller 200 may calculate the sleeping load P (t) by checking the PERCLOS value of 30% or more for a predetermined period of time.

Also, the control unit 200 calculates the attention neglected load amount E (t) using the attention neglect information obtained by the carelessness detecting unit 120. [ If the field of view deviates from the running no-load visibility distance? As shown in FIG. 6, the factor of the load factor V may vary depending on the range of deviation. 6 (a), the range deviated from a 'or b' is set separately, and the factor of the load factor (E (t)) is read out from the memory by the range of the current driver's visual range, ) Can be calculated.

)으로 계산할 수 있다. 또한, 차량의 상태 및 경우에 따라서는 부주의 상태 정보를 이용하여 획득된 부하량들 중 주행 방해 부하량의 계산에 고려되지 않는 부하량이 있을 수도 있다.The control unit 200 calculates the calculated peripheral equipment operation load T (n), voice load V (t), sleeping load P (t) and attention neglect load E (t) Disturbance load (

). In addition, there may be a load that is not considered in the calculation of the disturbance load among the loads obtained using the state of the vehicle and the careless state information in some cases.

)과 주행 방해 부하량(

)을 서로 비교하여 운전자의 안전운전 상태를 판단한다. 구체적으로, 제어부(200)는 주행 부하량(

)에서 주행 방해 부하량(

)을 뺀 값이 기설정된 여유 부하량(

) 이하인 경우 운전자가 안전운전 상태가 아닌 것으로 판단한다. 여기서, 여유 부하량(

)은 주행부하량, 주행정보(변속기어상태, 차량가속도, 조향진행 등)으로부터 피실험자의 조건에 따른 실험을 통해 추출되어 메모리에 기저장된 값이며, 주행 조건에 따라 가변(

)될 수 있다. The control unit 200 calculates the driving load amount

) And the disturbance load (

) To determine the safe driving state of the driver. Specifically, the control unit 200 calculates the driving load amount

) To the load

) Is subtracted from the predetermined allowable load amount (

), It is determined that the driver is not in the safe driving state. Here, the allowable load amount (

) Is a value preliminarily stored in the memory extracted from the experiment according to the subject's condition from the driving load, the traveling information (the transmission state, the vehicle acceleration, the steering progress, etc.)

).

That is, in order for the driver to be determined to be in the safe driving state, the condition of Equation (3) must be satisfied.

Here, t is the time value and n is the number value.

The output unit 300 includes a liquid crystal display (LCD) and a speaker for outputting a screen and outputting an alarm sound. Preferably, the output unit 300 may output the image through a cluster as shown in FIG. 8 (b). Alternatively, the output unit 300 may display an image on an audio display. Furthermore, the output unit 300 may display the result of the safe operation state determination of the controller 200 and the resultant values on a bar graph format and a different color as shown in FIG. 8 (a).

)과 주행 방해 부하량(

)의 차를 여유 부하량(

)으로 나눈 결과 값(C)을 막대 그래프의 퍼센트 단위로 나타낼 수 있다. 만약, 차량 주행이 어려워지는 순간을 75%로 기설정된 경우, 제어부(200)는 결과값(C)이 75% 이상인 경우 막대 그래프의 색상을 적색으로 화면 표시되도록 나아가 막대 그래프가 점멸되도록 출력부(300)를 제어하여 운전자에게 차량 주행의 위험을 상기시킬 수 있다. 또한, 이러한 경우 제어부(200)는 경보음이 출력되도록 출력부(300)를 제어하여 운전자에게 경고할 수 있다. 결과값(C)이 75% 미만인 경우에는 막대 그래프가 녹색으로 표시되어 운전자에게 안전한 상태임을 알릴 수 있다.Specifically, the control unit 200 can control the output unit 300 to display information on the current load amount according to the difference between the running load amount and the running disturbance load on a bar graph. For example, the running load amount calculated by the control unit 200 (

) And the disturbance load (

) To the allowable load (

) Can be expressed as a percentage of the bar graph. If the instant at which the running of the vehicle becomes difficult is preset to 75%, the controller 200 proceeds to display the color of the bar graph in red when the result value C is 75% or more, 300) to remind the driver of the risk of driving the vehicle. In this case, the controller 200 may control the output unit 300 to warn the driver that an alarm sound is output. If the result (C) is less than 75%, the bar graph is displayed in green to inform the driver that it is safe.

)과 주행 방해 부하량(

)의 차를 여유 부하량(

)으로 나눈 결과 값(C)이 일정 수준(예를 들어, 85%)이상인 경우, 차량 주행의 안전에는 지장이 없는 AVN의 전원을 강제적으로 오프(OFF)시킬 수 있다. 덧붙여, 제어부(200)는 출력부(300)를 통해 출력되는 경보음의 음량을 결과값(C)에 거듭 제곱 비례하도록 높여 운전자에게 주행 위험을 강하게 경고할 수 있다.Further, the control unit 200 calculates the driving load amount

) And the disturbance load (

) To the allowable load (

), The power of the AVN which does not interfere with the safety of the driving of the vehicle can be forcibly turned off when the value C obtained by dividing the result value by the predetermined value (C) is equal to or higher than a certain level (for example, 85%). In addition, the control unit 200 may raise the volume of the alarm sound output through the output unit 300 so as to be proportionally increased to the result value C, thereby strongly warning the driver of the risk of running.

As described above, according to the present invention, it is possible to check the safe driving state of the driver by comparing the amount of running load generated in accordance with the running of the vehicle and the amount of running disturbance obstructed by the driver, such as peripheral equipment and driver's sleepiness, (For example, a peripheral device) by forcibly stopping the operation of an element (for example, a peripheral device) that is not essential for driving the vehicle, thereby reducing the load on the driving obstacle that interferes with driving the vehicle, .

8 is a flowchart illustrating a driver status sensing method according to an embodiment of the present invention.

First, the driver's condition sensing device 10 acquires the traveling operation information and the driver's carelessness information (S100).

Specifically, the driver's condition sensing device 10 senses the driving operation of the driving control units necessary for driving the vehicle and acquires the driving operation information. For example, the driver's condition sensing device 10 may include at least one of an ACC pad operation, a brake pad operation, a multi function S / W operation, and a steering wheel operation And acquires the traveling operation information. At this time, the driver's condition sensing apparatus 10 can confirm the speed of the vehicle and acquire the driving operation information when the speed of the vehicle is equal to or higher than a predetermined speed (for example, 10 km / h).

)를 감지한다. 이와 마찬가지로, 운전자 상태 감지 장치(10)는 브레이크 패달 및 클러치 패달 또한 일정 시간마다 조작되는 작동 횟수(각각,

)를 감지할 수 있다. For example, the driver's condition sensing device 10 may be configured to determine the number of times the acceleration pedal is operated

). Likewise, the driver's condition sensing device 10 may be configured such that the brake pedal and the clutch pedal also operate at a certain number of times,

). ≪ / RTI >

)를 감지한다. 여기서 멀티펑션 스위치란, 차량의 와이퍼, 방향 지시등 등과 같은 차량 램프를 동작시키기 위한 스위치일 수 있다. As another example, the driver's condition detecting device 10 may be configured to detect the number of times of operation of each switch of the multi-function operated by the driver for a predetermined period of time

). Here, the multi-function switch may be a switch for operating a vehicle lamp such as a wiper of a vehicle, a turn signal lamp, or the like.

)를 감지한다. 이때, 운전자 상태 감지 장치(10)는 별도로 각속도를 측정하지 않고, 소정 시간 동안 일정 시간마다 스티어링 휠의 각 변화량을 측정하여 각 속도를 산출할 수 있다. As another example, the driver's condition sensing device 10 may be configured to measure the angular velocity of the steering wheel

). At this time, the driver's condition sensing apparatus 10 can measure the angular velocity of the steering wheel by measuring the angular variation of the steering wheel at predetermined time intervals without measuring the angular velocity separately.

Further, the driver's condition sensing device 10 acquires the carelessness information through the peripheral device, driver's voice, and face information selectively controlled by the driver while driving the vehicle.

)를 감지할 수 있다. 여기서, 주변 기기는 차량용 AVN(Audio, Video, Navigation), 차량 공조 장치 등과 같이 차량 주행에 필수적인 장치는 아니나, 운전자의 편의나 차량 실내 환경을 위해 조작될 수 있는 차량 제어 유닛들일 수 있다.For example, the driver's condition sensing device 10 may determine the number of times the peripheral device is operated by the driver

). ≪ / RTI > Here, the peripheral device may not be an indispensable device for driving the vehicle such as an AVN (Audio, Video, Navigation), a car air conditioner, etc., but may be vehicle control units that can be operated for the convenience of the driver or the vehicle interior environment.

As another example, the driver's condition sensing device 10 can sense the driver's voice through a microphone mounted at a predetermined position in the vehicle. For example, the driver's condition sensing device 10 can confirm the pulse size (voice size) and voice generation time of voice data received from the microphone for a predetermined time.

As another example, the driver's condition sensing device 10 can receive the driver's facial image through the camera mounted at a predetermined position of the vehicle, and obtain the driver's eyesight information and the attention neglect information. At this time, the camera may include a Near Infrared LED (Near Infrared LED) as shown in FIG. 2 (b) so that the camera can record images during daytime and at night.

Preferably, the driver's condition sensing device 10 can separately extract the driver's eye region image from the driver's face image. At this time, the face image of the driver may be image-processed to extract the eye region image. That is, the driver's condition sensing apparatus 10 can acquire the inattentive state information such as the eye blindness information and the attention negligence information by using the face image of the driver and the eye region image received from the camera.

The driver's condition sensing apparatus 10 can acquire the driver's eyesight information using the eye region image extracted from the face image of the driver. Referring to FIG. 3, the driver's condition sensing apparatus 10 detects an eyelid region in an eye region image, and when the sum of angles ∠A and ∠B, which are eyelid angles, is less than a predetermined threshold angle value ∠C (∠A + ∠B ≤ ∠C), confirm that the driver has closed his eyes. The driver's condition detecting device 10 detects the number of times the driver closes his or her eyes by checking the angle of the eyelid for a predetermined time period, calculates the number of times the eyes are closed for a predetermined time and a predetermined time value, Can be obtained.

Also, the driver's condition sensing device 10 can acquire the driver's attention neglect information using the face image and the eye area image of the driver. Referring to FIG. 6, the range of attention negligible is based on the angle of the vehicle wheel, that is, the angle of change of the wheel in the center of the vehicle (an example such as? A or? B in FIG. 6A) , It is confirmed whether or not there is a visibility range of the driver in the visibility distance? Without load at the time of driving the vehicle, and the attention negligence information is obtained. 6 (b)) is calculated from the face image of the driver obtained from the camera, and then the position of the pupil (direction of the pupil) ((c (Β) of the sample.

Specifically, when the steering wheel angle is within a predetermined angle, and the lever of the transmission is in the D-stage or N-stage, the driver's state sensing device 10, Can be judged to be neglected and the time can be confirmed and the negligence information can be obtained.

The driver's condition sensing apparatus 10 calculates a traveling operation load amount and a travel disturbance load amount using the traveling operation information and the carelessness information obtained in step S100 (S200).

)을 계산한다. 구체적으로, 운전자 상태 감지 장치(10)는 주행 조작 정보와, 주행 조작 정보의 항목별 가중치를 메모리로부터 불러와 주행 조작 부하량을 계산한다. For example, the driver's condition sensing apparatus 10 may use the traveling operation information to calculate the traveling operation load (

). Specifically, the driver's condition sensing device 10 calculates the running manipulation load by loading the driving manipulation information and the weight for each item of the driving manipulation information from the memory.

Here, the weights may be predetermined values extracted for each item of the traveling operation information through various experiments in advance. Alternatively, the weight value may be a predetermined value arbitrarily preset for each item by the operator in advance.

,) 브페이크 패달 조작에 대한 가중치(

), 멀티펑션 스위치 조작에 대한 가중치(

) 및 조향 핸들 조작에 대한 가중치(θ)를 불러올 수 있다. 만약, 200ms 동안 50ms 단위로 주행 조작 정보에 포함된 각 항목들의 시간 및 횟수 정보가 획득되는 경우, 200ms 동안의 주행 조작 부하량(

)은 수학식 1과 같이 나타낼 수 있다.Preferably, the driver's condition sensing device 10 can calculate the load for each item using the item included in the traveling operation information and the weight corresponding to the item. For example, when the driving state information of the acceleration pedal operation, the brake pedal operation, the multi-function switch operation, and the steering wheel operation is obtained, the driver's condition detecting apparatus 10 can detect the acceleration Weight for pedal operation (

, The weight for the Fake pedal operation (

), Weight for multi-function switch operation (

) And the weight ([theta]) for the steering wheel manipulation. If the time and frequency information of each item included in the running operation information is obtained in units of 50 ms for 200 ms, the running operation load for 200 ms

) Can be expressed by Equation (1).

)을 계산한다. 구체적으로, 운전자 상태 감지 장치(10)는 부주의 상태 정보에 포함된 각 항목들에 대한 부하량을 구할 수 있으며, 구해진 각 항목들의 부하량의 합하여 주행 방해 부하량을 계산할 수 있다.As another example, the driver's condition sensing apparatus 10 may calculate the disturbance load amount

). Specifically, the driver's condition sensing apparatus 10 can calculate the load for each item included in the carelessness information, and calculate the travel disturbance load by summing the loads of the respective items.

The driver's condition sensing apparatus 10 can calculate the peripheral operation load T (n) using the number of peripheral operations. For example, the driver condition sensing apparatus 10 may calculate the operating load of the peripheral apparatus considering the weight of the previously stored peripheral apparatus operation. If the number of input operations of the peripheral device by the driver is obtained for a predetermined period of time, the driver's condition sensing device 10 may calculate the peripheral device operation load T (n) by calculating the number of peripheral device operation inputs and the weight .

Furthermore, the driver's condition sensing device 10 can calculate the voice load V (n) using the voice data of the driver. Specifically, the driver's condition sensing device 10 can calculate the voice load considering the pulse threshold value of the previously stored voice data. For example, the driver's condition sensing device 10 can calculate the voice load V (t) by calculating the time at which voice data over a pulse threshold value is received from the voice data of the driver acquired for a predetermined time.

In addition, the driver's condition sensing device 10 can calculate the sleeping load P (t) and the traveling watching neglected load E (t) by using the eye sight information and the attention neglect information in the inattentive state information.

5, when the vehicle speed V is less than a predetermined speed N for a predetermined time N, the driver's state sensing apparatus 10 may perform a driver's eyesight check operation, referring to the flowchart of FIG. The number of times the eyes are closed (y) through the angle of the eyelids can be checked to calculate the sleeping time (sleeping time) of the driver. Furthermore, the drowsiness load P (t) can be calculated by converting the value obtained by counting the number of times that the PERCLOS value is 30% or more over a predetermined period of time as a load factor.

In addition, the driver's condition sensing device 10 calculates the attention negligence load E (t) using the attention neglect information in the care-of-status information. As shown in FIG. 6, if the field of view deviates from the running no-load visibility distance?, The factor of the load factor V may vary depending on the range of deviation. 6 (a), the range deviated from a 'or b' is set separately, and the factor of the load factor (E (t)) is read out from the memory by the range of the current driver's visual range, ) Can be calculated.

)으로 계산할 수 있다.The driver's condition sensing device 10 calculates the peripheral operating load T (n), voice load V (t), sleeping load P (t) and attention neglect load E (t) And calculates the disturbance load (

).

)과 주행 방해 부하량(

)의 차와 여유 부하량(

)을 비교한다(S300).The driver's condition sensing apparatus 10 calculates the driving operation load amount (

) And the disturbance load (

) And the margin load (

(S300).

)에서 주행 방해 부하량(

)을 뺀 값이 기설정된 여유 부하량(

) 이하인지 확인한다. 여기서, 여유 부하량(

)은 주행부하량, 주행정보(변속기어상태, 차량가속도, 조향진행 등)으로부터 피실험자의 조건에 따른 실험을 통해 추출되어 메모리에 기저장된 값이며, 주행 조건에 따라 가변(

)될 수 있다. 이때, 운전자 상태 감지 장치(10)는 주행 부하량(

)과 주행 방해 부하량(

)의 차를 여유 부하량(

)으로 나눈 결과 값(C)을 산출할 수 있다.Specifically, the driver's condition sensing device 10 calculates the driving load amount

) To the load

) Is subtracted from the predetermined allowable load amount (

) Or less. Here, the allowable load amount (

) Is a value preliminarily stored in the memory extracted from the experiment according to the subject's condition from the driving load, the traveling information (the transmission state, the vehicle acceleration, the steering progress, etc.)

). At this time, the driver's condition sensing apparatus 10 calculates the driving load amount

) And the disturbance load (

) To the allowable load (

) To calculate the resultant value (C).

If the instant when the vehicle is difficult to drive is preset as a threshold percentage value and the comparison result C of S300 is equal to or greater than a threshold percentage value, the driver's condition sensing apparatus 10 warns the driver (S400).

The driver's state sensing device 10 warns the driver when the comparison result C in step S300 is 75% or more, for example. 10) displays the color of the bar graph indicating the current load in red, further blinking the bar graph to remind the driver of the risk of driving the vehicle. Also, in this case, the driver's condition sensing device 10 can output a warning sound to warn the driver.

If the comparison result C in step S300 is less than 75%, the driver's condition sensing apparatus 10 may display a bar graph indicating the current load amount in green to inform the driver that the current state is safe (S500).

As described above, according to the present invention, it is possible to check the safe driving state of the driver by comparing the amount of running load generated in accordance with the running of the vehicle and the amount of running disturbance obstructed by the driver, such as peripheral equipment and driver's sleepiness, (For example, a peripheral device) by forcibly stopping the operation of an element (for example, a peripheral device) that is not essential for driving the vehicle, thereby reducing the load on the driving obstacle that interferes with driving the vehicle, .

The present invention has been described with reference to the preferred embodiments. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed embodiments should be considered in an illustrative rather than a restrictive sense. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

10: Driver status detecting apparatus 100:
110: traveling operation sensing unit 120: inattention state sensing unit
200: control unit 300: output unit

Claims (13)

An acquiring unit for acquiring traveling operation information of the vehicle and information of the driver's carelessness;
Calculating a driving disturbance load amount using the traveling manipulation load amount and the obtained inattention state information using the obtained traveling manipulation information, comparing the traveling manipulation load amount and the traveling disturbance load amount to judge the safe driving state of the driver And controlling the output unit such that warning information is output when it is determined that the driver is not in the safe driving state. And
The output unit performing at least one output operation of a screen output and a warning sound output to output the warning information;
And a driver state detector. The method according to claim 1,
Wherein the obtaining unit includes at least one of an acceleration pedal operation, a brake pedal operation, a clutch pedal operation, a multi-function switch operation, and a steering-wheel operation of the vehicle to obtain the running operation information. 3. The method of claim 2,
Wherein the controller calculates at least one piece of information on operation time information and operation frequency information of the item included in the running operation information and the weight set in each item to calculate the running load amount. The method according to claim 1,
Wherein the obtaining unit obtains the careless state information using at least one of an operation of a peripheral device, a driver's voice of the driver, a face image, and an eye region image. 5. The method of claim 4,
Wherein the controller calculates the travel disturbance load using at least one load information of the driver's drowsiness load, a watchfulness load, a voice load, and a peripheral device load considering the information of the item included in the carelessness information Driver status detection device. The method according to claim 1,
Wherein the controller determines that the driver is not in the safe driving state when the value obtained by subtracting the traveling obstruction load from the driving load amount is equal to or less than a threshold value of the predetermined spare load amount. 6. The method of claim 5,
Wherein the control unit controls the output unit to output the warning sound when it is determined that the driver has closed his / her eyes for a predetermined time or longer by using the eye region image among the items included in the carelessness information. A method for detecting a driver state by a driver state sensing apparatus,
Obtaining driving operation information of the vehicle and information of the driver's carelessness;
Calculating travel obstruction load using the travel manipulation load and the carelessness information using the obtained travel manipulation information;
Comparing the traveling operation load amount with the travel disturbance load amount and a predetermined allowable load amount; And
Providing information to the driver differently according to the comparison result;
Wherein the driver state detection method comprises: 9. The method of claim 8, wherein the obtaining comprises:
Obtaining the driving operation information including at least one of an acceleration pedal operation, a brake pedal operation, a clutch pedal operation, a multi-function switch operation, and a steering-wheel operation of the vehicle; And
Acquiring the carelessness information including at least one of an operation of a peripheral device, a driver's voice of the driver, a facial image, and an eye region image;
Wherein the driver is a driver. 10. The method of claim 9, wherein the calculating comprises:
Calculating at least one of information on the operation time of the item and information on the number of operations included in the running operation information and a weight set in each item to calculate the running load; And
Calculating the travel disturbance load using at least one load information of the driver's drowsiness load, attention negligence load, voice load, and peripheral device operation load considering information of the items included in the careless state information;
Wherein the driver is a driver. 9. The method of claim 8, wherein the comparing comprises:
And comparing the current load amount, which is a value obtained by subtracting the traveling obstruction load from the running load amount, with the allowable load amount. 12. The method of claim 11, wherein said otherwise providing comprises:
A current load amount that is a value obtained by subtracting the traveling obstruction load from the traveling load amount.
And displaying the information in red if the amount is less than the allowable load amount, and providing the information to the driver in the case of exceeding the allowable load amount, by displaying the information in green. 10. The method of claim 9,
Outputting the warning sound and alerting the driver to the driver when it is confirmed that the driver has closed his / her eyes for a predetermined time or longer using the eye region image among the items included in the careless state information;
Wherein the driver state detection method further comprises:

Images