US20200114908A1 - Apparatus for responding to vehicle water splashing, system having the same and method thereof - Google Patents
Apparatus for responding to vehicle water splashing, system having the same and method thereof Download PDFInfo
- Publication number
- US20200114908A1 US20200114908A1 US16/232,906 US201816232906A US2020114908A1 US 20200114908 A1 US20200114908 A1 US 20200114908A1 US 201816232906 A US201816232906 A US 201816232906A US 2020114908 A1 US2020114908 A1 US 2020114908A1
- Authority
- US
- United States
- Prior art keywords
- vehicle
- water splashing
- dangerousness
- vehicle water
- occurs
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 title claims abstract description 233
- 238000000034 method Methods 0.000 title claims description 26
- 238000004891 communication Methods 0.000 claims description 18
- 230000007480 spreading Effects 0.000 claims description 11
- 238000004422 calculation algorithm Methods 0.000 description 9
- 238000013135 deep learning Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000001133 acceleration Effects 0.000 description 2
- 230000008901 benefit Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013527 convolutional neural network Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/09—Taking automatic action to avoid collision, e.g. braking and steering
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/10—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
- B60W40/105—Speed
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/025—Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60Q—ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
- B60Q9/00—Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/04—Conjoint control of vehicle sub-units of different type or different function including control of propulsion units
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/04—Conjoint control of vehicle sub-units of different type or different function including control of propulsion units
- B60W10/06—Conjoint control of vehicle sub-units of different type or different function including control of propulsion units including control of combustion engines
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/18—Conjoint control of vehicle sub-units of different type or different function including control of braking systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/20—Conjoint control of vehicle sub-units of different type or different function including control of steering systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W10/00—Conjoint control of vehicle sub-units of different type or different function
- B60W10/30—Conjoint control of vehicle sub-units of different type or different function including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W30/00—Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
- B60W30/08—Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
- B60W30/095—Predicting travel path or likelihood of collision
- B60W30/0956—Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W40/00—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
- B60W40/02—Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
- B60W40/06—Road conditions
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
-
- G06K9/00791—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
- G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/50—Context or environment of the image
- G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
- G06V20/588—Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/161—Decentralised systems, e.g. inter-vehicle communication
- G08G1/162—Decentralised systems, e.g. inter-vehicle communication event-triggered
-
- G—PHYSICS
- G08—SIGNALLING
- G08G—TRAFFIC CONTROL SYSTEMS
- G08G1/00—Traffic control systems for road vehicles
- G08G1/16—Anti-collision systems
- G08G1/166—Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W50/00—Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
- B60W50/08—Interaction between the driver and the control system
- B60W50/14—Means for informing the driver, warning the driver or prompting a driver intervention
- B60W2050/143—Alarm means
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2420/00—Indexing codes relating to the type of sensors based on the principle of their operation
- B60W2420/40—Photo, light or radio wave sensitive means, e.g. infrared sensors
- B60W2420/403—Image sensing, e.g. optical camera
-
- B60W2420/42—
-
- B60W2550/12—
-
- B60W2550/14—
-
- B60W2550/30—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2552/00—Input parameters relating to infrastructure
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2554/00—Input parameters relating to objects
- B60W2554/80—Spatial relation or speed relative to objects
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2555/00—Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
- B60W2555/20—Ambient conditions, e.g. wind or rain
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2710/00—Output or target parameters relating to a particular sub-units
- B60W2710/06—Combustion engines, Gas turbines
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2710/00—Output or target parameters relating to a particular sub-units
- B60W2710/18—Braking system
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2710/00—Output or target parameters relating to a particular sub-units
- B60W2710/20—Steering systems
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2710/00—Output or target parameters relating to a particular sub-units
- B60W2710/30—Auxiliary equipments
-
- B60W2750/40—
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B60—VEHICLES IN GENERAL
- B60W—CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60W2756/00—Output or target parameters relating to data
- B60W2756/10—Involving external transmission of data to or from the vehicle
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B62—LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
- B62D—MOTOR VEHICLES; TRAILERS
- B62D15/00—Steering not otherwise provided for
- B62D15/02—Steering position indicators ; Steering position determination; Steering aids
- B62D15/025—Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
- B62D15/0265—Automatic obstacle avoidance by steering
Definitions
- the present disclosure relates to an apparatus for responding to vehicle water splashing.
- the driver's vehicle may collide with a nearby obstacle by a sudden steering operation or may collide with the rear vehicle due to sudden braking, when the driver cannot see the front view of the vehicle. Furthermore, the vehicle may collide with the front vehicle when the safety distance to the front vehicle is not assured. In addition, the water splashing that occurs on a specific road surface will continuously occur at the following vehicles driving on the specific road.
- An aspect of the present disclosure provides an apparatus for responding to vehicle water splashing, a system having the same, and a method thereof that predict and determine the water splashing on the windshield of the vehicle based on the camera deep learning manner and actively respond to the water splashing.
- an apparatus for responding to vehicle water splashing may include a processor determining the vehicle water splashing based on image data of a nearby vehicle and determining dangerousness due to the vehicle water splashing to perform vehicle control and storage storing information determined by the processor and the image data of the nearby vehicle.
- the apparatus may further include a communication device transmitting and receiving information indicating that the vehicle water splashing occurs, to and from the nearby vehicle.
- the processor may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
- the processor may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
- the processor may be configured to operate a learning network that learns the vehicle water splashing, based on the image data of the front vehicle.
- the processor may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
- the processor may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
- the processor may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
- the processor may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control and to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing.
- the processor when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the processor may be configured to transmit danger information due to the vehicle water splashing to the nearby vehicle.
- a vehicle system may include a sensor module obtaining image data and driving information of a nearby vehicle and an apparatus for responding to vehicle water splashing determining the vehicle water splashing based on the image data of the nearby vehicle and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
- the apparatus for responding to the vehicle water splashing may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
- the apparatus for responding to the vehicle water splashing may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
- the apparatus for responding to the vehicle water splashing may include a learning network that learns the vehicle water splashing, based on the image data of the front vehicle, and the apparatus for responding to the vehicle water splashing may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
- the apparatus for responding to the vehicle water splashing may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
- the apparatus for responding to the vehicle water splashing may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
- the apparatus for responding to the vehicle water splashing may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control, to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and to transmit the danger information due to the vehicle water splashing to the nearby vehicle.
- a method for responding to vehicle water splashing may include obtaining image data and driving information of a nearby vehicle, determining the vehicle water splashing based on the image data of the nearby vehicle, and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
- the determining of the vehicle water splashing may include extracting a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
- the determining of the vehicle water splashing may include determining the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
- the performing of the vehicle control may include controlling vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
- the performing of the vehicle control may include outputting a warning sound or a warning text, providing a vehicle path for avoiding the point at which the vehicle water splashing occurs, or transmitting danger information due to the vehicle water splashing to the nearby vehicle.
- the performing of the vehicle control may include outputting a vehicle control message for providing a notification of performing automatic vehicle control, performing the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and transmitting the danger information due the vehicle water splashing to the nearby vehicle.
- FIG. 1 is a block diagram illustrating a configuration of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure
- FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure
- FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure
- FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure
- FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure
- FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure
- FIG. 7 is a flowchart for describing a method for responding to the vehicle water splashing, according to an embodiment of the present disclosure.
- FIG. 8 illustrates a computing system according to an embodiment of the present disclosure.
- the present disclosure disclose a technology that tracks image data of vehicle water splashing of a nearby vehicle, learns dangerousness for each water splashing waveform based on a learning algorithm by using the accumulated data, determines or estimates dangerousness or degree of danger caused by the current water splashing, depending on the dangerousness for each water splashing waveform when a vehicle is driving actually, and makes it possible to respond to the dangerousness.
- FIGS. 1 to 8 various embodiments of the present disclosure will be described in detail with reference to FIGS. 1 to 8 .
- FIG. 1 is a block diagram of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure.
- FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure.
- a vehicle system may include an apparatus 100 for responding to vehicle water splashing, a sensor module 210 , a communication module 220 , a warning device 230 , a steering control device 240 , a braking control device 250 , and an engine control device 260 .
- each of the components of the vehicle system including the apparatus 100 for responding to vehicle water splashing may be mounted in the vehicle.
- the apparatus 100 for responding to vehicle water splashing may learn the vehicle water splashing through a learning algorithm (Convolutional Neural Network (CNN)) based on image data of a nearby vehicle, may accurately determine the vehicle water splashing based on the learning result when the vehicle drives later, may determine the dangerousness caused by the vehicle water splashing, and may perform vehicle control and warning so as to avoid the dangerous situation.
- CNN Convolutional Neural Network
- the apparatus 100 for responding to vehicle water splashing may include a communication device 110 , storage 120 , and a processor 130 .
- the communication device 110 may be a hardware device implemented with various electronic circuits for transmitting and receiving signals via a wireless or wired connection; in embodiments, the communication device 110 may perform communication in a vehicle over CAN communication, or the like.
- the storage 120 may store information (e.g., image data) obtained from the sensor module 210 , data on which deep learning is performed by the processor 130 , or the like.
- the storage 120 may include at least one type of a storage medium among a flash memory type of a memory, a hard disk type of a memory, a micro type of a memory, and a card type (e.g., a Secure Digital (SD) card or an eXtream Digital (XD) Card) of a memory, a Random Access Memory (RAM) type of a memory, a Static RAM (SRAM) type of a memory, a Read-Only Memory (ROM) type of a memory, a Programmable ROM (PROM) type of a memory, an Electrically Erasable PROM (EEPROM) type of a memory, an Magnetic RAM (MRAM) type of a memory, a magnetic disk type of a memory, and an optical disc type of a memory.
- SD Secure Digital
- XD eXtream Digital
- the processor 130 may be electrically connected to the communication device 110 and the storage 120 , may electrically control each of the components, may be an electrical circuit that executes the commands of the software, and may perform various data processing and calculation described below.
- the processor 130 may be an electronic control unit (ECU) or a sub-controller, which is mounted in the vehicle.
- ECU electronice control unit
- sub-controller which is mounted in the vehicle.
- the processor 130 may extract the waveform of the vehicle water splashing occurring when the front vehicle is driving, based on the image data of the front vehicle obtained through the sensor module 210 .
- the processor 130 may determine or calculate the dangerousness based on at least one or more of the speed of the vehicle, a distance between the present vehicle and a point at which the water splashing of the front vehicle occurs, the height of the waveform of the vehicle water splashing, or the spreading width of the waveform of the vehicle water splashing.
- the processor 130 may operate a learning algorithm (learning network) that learns the vehicle water splashing based on the image data of the front vehicle obtained through the sensor module 210 , may input the image data of the front vehicle, which is obtained when the vehicle is driving, to the learning network, may determine the vehicle water splashing, and may determine the dangerousness.
- the learning network may generate dangerousness information according to the waveform of the vehicle water splashing based on the learned algorithm.
- the processor 130 may allow the vehicle to continuously drive without a separate warning or action, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level; the processor 130 may perform a warning or vehicle control, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level.
- the processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, or may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs.
- the processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, and may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs.
- the processor 130 may output a vehicle control message for providing a notification that the vehicle is automatically controlled, may perform vehicle control for avoiding the dangerousness due to the vehicle water splashing, and may transmit danger information due to the vehicle water splashing to a nearby vehicle to share the danger information with the nearby vehicle, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is driving at a point at which the vehicle water splashing occurs.
- the nearby vehicle may rapidly respond to the vehicle water splashing, by sharing information and dangerousness associated with a point at which the vehicle water splashing occurs, with a nearby vehicle.
- the sensor module 210 may obtain image data at a periphery of a vehicle, may detect an object at a periphery of the vehicle to obtain detection information, and may transmit the obtained information to the apparatus 100 for responding to vehicle water splashing over CAN communication. That is, the sensor module 210 may be configured to sense information about nearby objects (e.g., a vehicle, a pedestrian, a bicycle, a motorcycle, or the like). The sensor module 210 may sense various pieces of information such as the location, speed and acceleration, direction, type, or the like of an external object. To this end, the sensor module 210 may include a camera, radar, a laser scanner, corner radar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, and/or a wheel speed sensor.
- a camera radar, a laser scanner, corner radar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, and/or a wheel speed sensor.
- the sensor module 210 may include at least one or more sensor modules, and the at least one or more sensor modules may be mounted in the vehicle; the sensor module 210 may be installed on the front, side, or rear of the vehicle.
- FIG. 2 illustrates an example in which radars 301 , 302 , and 303 are mounted on the front side and both rear sides of the vehicle.
- the camera may include an MFC camera, a SVM camera, or the like.
- the communication module 220 may communicate with nearby vehicles or peripheral communication devices and may perform wireless communication.
- the communication module 220 may perform V2X or V2V communication and may perform wireless communication.
- the communication module 220 may transmit and receive vehicle driving information, danger information, or the like to and from nearby vehicles to share the vehicle driving information, the danger information, or the like.
- the warning device 230 may perform a warning such as notification of a dangerous situation due to the vehicle water splashing, or the like.
- the warning device 230 may have a configuration for performing visual, auditory, and tactile warnings, and may be implemented as a head-up display (HUD), a cluster, Audio Video Navigation (AVN), or the like.
- HUD head-up display
- APN Audio Video Navigation
- the steering control device 240 may be configured to control the steering angle of the vehicle and may include a steering wheel, an actuator operating in conjunction with the steering wheel, and a controller for controlling the actuator.
- the braking control device 250 may be configured to control the brake of the vehicle and may include a controller for controlling a brake.
- the engine control device 260 may be configured to control the driving of the engine of a vehicle and may include a controller for controlling the speed of the vehicle.
- the water splashing image may be recognized or determined while the vehicle is driving, may determine the dangerousness in advance, and may respond to the dangerousness.
- Embodiments may implement a warning message, may induce vehicle path avoidance, and may share danger information with nearby vehicles, as a primary countermeasure.
- a controller or other device of the vehicle may output a text message or voice message saying that the vehicle is autonomously controlled, may perform steering wheel steering, engine drive control, and brake control so as to identify nearby obstacles and to avoid the collision with nearby obstacles, and may transmit danger information to nearby vehicles to share the danger information with nearby vehicles, when the water splashing actually occurs.
- FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure.
- a water splashing image of a vehicle in 401 , 402 , 403 , and 404 of FIG. 3 water splashing waveforms 411 , 412 , 413 , and 414 occurring while a front vehicle is driving may be extracted.
- the apparatus 100 for responding to vehicle water splashing may determine dangerousness depending on the sizes of the water splashing waveforms 411 , 412 , 413 , and 414 .
- FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure.
- the apparatus 100 for responding to vehicle water splashing may input water splashing waveform information extracted in FIG. 3 to a learning network. After extracting a feature point, the apparatus 100 for responding to vehicle water splashing may perform classification based on the extracted feature point. For example, as illustrated in 413 of FIG. 3 , the dangerousness may be classified depending on a height H and a spreading width W of the water splashing waveform of a vehicle.
- the water splashing waveform 412 When the height and spreading width of the water splashing waveform 412 of a vehicle are very great or greater than a predetermined height and a predetermined width, the water splashing waveform 412 may be classified as the high dangerousness. When the spreading width of the water splashing waveform 411 of a vehicle are very small or smaller than a predetermined width, the water splashing waveform 411 may be classified as the low dangerousness.
- FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure.
- the apparatus 100 for responding to vehicle water splashing may output a warning message through a cluster 601 and an AVN 602 , when it is determined that dangerousness is higher than a predetermined level, based on the vehicle water splashing waveform of the current front vehicle.
- FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure.
- the apparatus 100 for responding to vehicle water splashing of FIG. 1 performs the process of FIG. 6 .
- the operation described as being executed by the apparatus 100 is controlled by the processor 130 of the apparatus 100 .
- the apparatus 100 for responding to vehicle water splashing accumulates data associated with the vehicle water splashing of image data received from the sensor module 210 .
- the sensor module 210 may transmit the image data to the apparatus 100 for responding to vehicle water splashing at a predetermined period or may provide the image data whenever an event (e.g., when it rains) occurs.
- the apparatus 100 for responding to vehicle water splashing classifies a water splashing waveform from the accumulated image data indicating that the vehicle water splashing occurs; in operation 5130 , the apparatus 100 for responding to vehicle water splashing performs learning through a deep learning algorithm for each waveform of water splashing.
- the apparatus 100 for responding to vehicle water splashing generates and stores dangerousness information for each water splashing waveform as the learning result.
- FIG. 7 is a flowchart for describing a method for responding to vehicle water splashing, according to an embodiment of the present disclosure.
- the apparatus 100 for responding to vehicle water splashing of FIG. 1 performs the process of FIG. 7 .
- the operation described as being executed by the apparatus 100 is controlled by the processor 130 of the apparatus 100 .
- the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, based on deep learning by applying the obtained image data to a learning algorithm. At this time, the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, by using the speed at which the vehicle is moving, a distance between the present vehicle and a point at which the water splashing occurs, the height of the water splashing occurring by the front vehicle, the degree of horizontal spreading of the water splashing, the waveform of the water splashing, or the like.
- the apparatus 100 for responding to vehicle water splashing determines the dangerousness or degree of danger that is to be caused by the vehicle water splashing, when the vehicle water splashing occurs. That is, the apparatus 100 for responding to vehicle water splashing may determine that the dangerousness due to the vehicle water splashing is higher than a predetermined level, when the blind phenomenon occurs in front of the vehicle due to the vehicle water splashing or when there are obstacles, which can cause collisions, at a periphery of the vehicle.
- the apparatus 100 for responding to vehicle water splashing maintains the driving of the vehicle, when it is determined that the dangerousness or a degree of danger is lower than a predetermined level; in operation 5250 , the apparatus 100 for responding to vehicle water splashing determines whether the vehicle water splashing is scheduled to occur, when it is determined that the dangerousness is higher than a predetermined level.
- the apparatus 100 for responding to vehicle water splashing outputs a warning message, induces the vehicle to drive a vehicle path such that the vehicle water splashing does not occur, transmits danger information to a nearby vehicle, and shares the danger information with the nearby vehicle, when the vehicle water splashing is scheduled to occur.
- the apparatus 100 for responding to vehicle water splashing outputs a warning message in advance, induces the vehicle to drive on a vehicle path such that the vehicle avoids a point at which it is expected that the vehicle water splashing occurs, transmits the point at which it is expected that the vehicle water splashing occurs, to nearby vehicles, and shares the point with the nearby vehicles, when a vehicle speed is not greater than 60 km/h and the point at which it is expected that the vehicle water splashing occurs is a 80 m ahead.
- the apparatus 100 for responding to vehicle water splashing may allow the following vehicles to drive while avoiding the point at which it is expected that the vehicle water splashing occurs.
- the apparatus 100 for responding to vehicle water splashing outputs a vehicle control message saying that the vehicle is controlled to avoid the dangerous situation, to notify a user, performs steering control, engine driving control, and brake control to avoid the collision, transmits danger information to a nearby vehicle, and shares the danger information to the nearby vehicle, when the vehicle water splashing occurs currently. That is, the apparatus 100 for responding to vehicle water splashing may perform vehicle control so as to prevent a secondary accident, may output a vehicle control message to notify a user before performing the vehicle control or at the same time, may avoid the collision or may prevent the sudden brake, or the like by performing the vehicle control, and may allow the vehicle to drive at a safe distance from the front vehicle, when the vehicle water splashing currently occurs in the present vehicle. In addition, the apparatus 100 for responding to vehicle water splashing may notify a nearby vehicle (the following vehicle) of a point at which the water splashing occurs in the present vehicle to allow the nearby vehicle to drive while the nearby vehicle avoids the point at which the water splashing occurs.
- a nearby vehicle the following vehicle
- a controller or other device of the vehicle may determine or estimate the vehicle water splashing, may provide a warning, and may perform vehicle control so as to provide an avoidance path or to prevent the collision, and thus it is possible to drive a vehicle safely.
- FIG. 8 illustrates a computing system according to an embodiment of the present disclosure.
- a computing system 1000 may include at least one processor 1100 , a memory 1300 , a user interface input device 1400 , a user interface output device 1500 , storage 1600 , and a network interface 1700 , which are connected with each other via a bus 1200 .
- the processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and/or the storage 1600 .
- Each of the memory 1300 and the storage 1600 may include various types of volatile or nonvolatile storage media.
- the memory 1300 may include a read only memory (ROM) and a random access memory (RAM).
- the operations of the methods or algorithms described in connection with the embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or a combination of the hardware module and the software module, which is executed by the processor 1100 .
- the software module may reside on a storage medium (i.e., the memory 1300 and/or the storage 1600 ) such as a RAM, a flash memory, a ROM, an erasable and programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disc, a removable disc, or a compact disc-ROM (CD-ROM).
- the storage medium may be coupled to the processor 1100 .
- the processor 1100 may read out information from the storage medium and may write information in the storage medium.
- the storage medium may be integrated with the processor 1100 .
- the processor and storage medium may reside in an application specific integrated circuit (ASIC).
- the ASIC may reside in a user terminal.
- the processor and storage medium may reside as a separate component in the user terminal.
- the vehicle may predict and respond to the vehicle water splashing to increase the reliability of the vehicle system and to allow a user to drive the vehicle safely, thereby enhancing the user's convenience.
- the ego vehicle may share information about the vehicle water splashing with other vehicles, thereby increasing a safe driving effect during autonomous driving.
- Logical blocks, modules or units described in connection with embodiments disclosed herein can be implemented or performed by a computing device having at least one processor, at least one memory and at least one communication interface.
- the elements of a method, process, or algorithm described in connection with embodiments disclosed herein can be embodied directly in hardware, in a software module executed by at least one processor, or in a combination of the two.
- Computer-executable instructions for implementing a method, process, or algorithm described in connection with embodiments disclosed herein can be stored in a non-transitory computer readable storage medium.
Landscapes
- Engineering & Computer Science (AREA)
- Mechanical Engineering (AREA)
- Transportation (AREA)
- Combustion & Propulsion (AREA)
- Chemical & Material Sciences (AREA)
- Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Mathematical Physics (AREA)
- Computing Systems (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biodiversity & Conservation Biology (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Software Systems (AREA)
- Traffic Control Systems (AREA)
Abstract
Description
- This application is claims the benefit of priority to Korean Patent Application No. 10-2018-0123047, filed in the Korean Intellectual Property Office on Oct. 16, 2018, the entire contents of which are incorporated herein by reference.
- The present disclosure relates to an apparatus for responding to vehicle water splashing.
- In recent years, vehicle automation/intelligence technologies such as a driver assistance system, a collision warning system, and an automatic temperature control system have been rapidly developing. In addition, the technologies to control the operating speed of a wiper or to control an engine or brake depending on weather and road conditions when a vehicle is driving have also been developed.
- However, water in a puddle on the road surface splashes as a vehicle passes, and then the water splashes on the front of the windshield of the vehicle, when the vehicle is driving in a state where the rain is heavy. Accordingly, a driver may not see the front view of the vehicle instantaneously.
- In this way, the driver's vehicle may collide with a nearby obstacle by a sudden steering operation or may collide with the rear vehicle due to sudden braking, when the driver cannot see the front view of the vehicle. Furthermore, the vehicle may collide with the front vehicle when the safety distance to the front vehicle is not assured. In addition, the water splashing that occurs on a specific road surface will continuously occur at the following vehicles driving on the specific road.
- The disclosure of this section is to provide background of the invention. Applicant notes that this section may contain information available before this application. However, by providing this section, Applicant does not admit that any information contained in this section constitutes prior art.
- An aspect of the present disclosure provides an apparatus for responding to vehicle water splashing, a system having the same, and a method thereof that predict and determine the water splashing on the windshield of the vehicle based on the camera deep learning manner and actively respond to the water splashing.
- According to an aspect of the present disclosure, an apparatus for responding to vehicle water splashing may include a processor determining the vehicle water splashing based on image data of a nearby vehicle and determining dangerousness due to the vehicle water splashing to perform vehicle control and storage storing information determined by the processor and the image data of the nearby vehicle.
- According to an embodiment, the apparatus may further include a communication device transmitting and receiving information indicating that the vehicle water splashing occurs, to and from the nearby vehicle.
- According to an embodiment, the processor may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
- According to an embodiment, the processor may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
- According to an embodiment, the processor may be configured to operate a learning network that learns the vehicle water splashing, based on the image data of the front vehicle.
- According to an embodiment, the processor may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
- According to an embodiment, the processor may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
- According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs, the processor may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
- According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at a point at which the vehicle water splashing occurs, the processor may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control and to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing.
- According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the processor may be configured to transmit danger information due to the vehicle water splashing to the nearby vehicle.
- According to an aspect of the present disclosure, a vehicle system may include a sensor module obtaining image data and driving information of a nearby vehicle and an apparatus for responding to vehicle water splashing determining the vehicle water splashing based on the image data of the nearby vehicle and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
- According to an embodiment, the apparatus for responding to the vehicle water splashing may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
- According to an embodiment, the apparatus for responding to the vehicle water splashing may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
- According to an embodiment, the apparatus for responding to the vehicle water splashing may include a learning network that learns the vehicle water splashing, based on the image data of the front vehicle, and the apparatus for responding to the vehicle water splashing may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
- According to an embodiment, the apparatus for responding to the vehicle water splashing may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level. When the dangerousness is high and a present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs, the apparatus for responding to the vehicle water splashing may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
- According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the apparatus for responding to the vehicle water splashing may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control, to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and to transmit the danger information due to the vehicle water splashing to the nearby vehicle.
- According to an aspect of the present disclosure, a method for responding to vehicle water splashing may include obtaining image data and driving information of a nearby vehicle, determining the vehicle water splashing based on the image data of the nearby vehicle, and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
- According to an embodiment, the determining of the vehicle water splashing may include extracting a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
- According to an embodiment, the determining of the vehicle water splashing may include determining the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
- According to an embodiment, the performing of the vehicle control may include controlling vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level. When the dangerousness is high and a present vehicle is scheduled to drive at the point at which the vehicle water splashing occurs, the performing of the vehicle control may include outputting a warning sound or a warning text, providing a vehicle path for avoiding the point at which the vehicle water splashing occurs, or transmitting danger information due to the vehicle water splashing to the nearby vehicle.
- According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the performing of the vehicle control may include outputting a vehicle control message for providing a notification of performing automatic vehicle control, performing the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and transmitting the danger information due the vehicle water splashing to the nearby vehicle.
- The above and other aspects, features and advantages of the present disclosure will be more apparent from the following detailed description taken in conjunction with the accompanying drawings:
-
FIG. 1 is a block diagram illustrating a configuration of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure; -
FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure; -
FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure; -
FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure; -
FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure; -
FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure; -
FIG. 7 is a flowchart for describing a method for responding to the vehicle water splashing, according to an embodiment of the present disclosure; and -
FIG. 8 illustrates a computing system according to an embodiment of the present disclosure. - Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals will be used throughout to designate the same or equivalent elements. In addition, a detailed description of well-known features or functions will be ruled out in order not to unnecessarily obscure the gist of the present disclosure.
- In describing elements of embodiments of the present disclosure, the terms first, second, A, B, (a), (b), and the like may be used herein. These terms are only used to distinguish one element from another element, but do not limit the corresponding elements irrespective of the order or priority of the corresponding elements. Furthermore, unless otherwise defined, all terms including technical and scientific terms used herein are to be interpreted as is customary in the art to which this invention belongs. It will be understood that terms used herein should be interpreted as having a meaning that is consistent with their meaning in the context of the present disclosure and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
- The present disclosure disclose a technology that tracks image data of vehicle water splashing of a nearby vehicle, learns dangerousness for each water splashing waveform based on a learning algorithm by using the accumulated data, determines or estimates dangerousness or degree of danger caused by the current water splashing, depending on the dangerousness for each water splashing waveform when a vehicle is driving actually, and makes it possible to respond to the dangerousness.
- Below, various embodiments of the present disclosure will be described in detail with reference to
FIGS. 1 to 8 . -
FIG. 1 is a block diagram of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure.FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure. - Referring to
FIG. 1 , a vehicle system may include an apparatus 100 for responding to vehicle water splashing, asensor module 210, acommunication module 220, awarning device 230, asteering control device 240, abraking control device 250, and anengine control device 260. At this time, each of the components of the vehicle system including the apparatus 100 for responding to vehicle water splashing may be mounted in the vehicle. - The apparatus 100 for responding to vehicle water splashing may learn the vehicle water splashing through a learning algorithm (Convolutional Neural Network (CNN)) based on image data of a nearby vehicle, may accurately determine the vehicle water splashing based on the learning result when the vehicle drives later, may determine the dangerousness caused by the vehicle water splashing, and may perform vehicle control and warning so as to avoid the dangerous situation.
- To this end, the apparatus 100 for responding to vehicle water splashing may include a
communication device 110,storage 120, and aprocessor 130. - The
communication device 110 may be a hardware device implemented with various electronic circuits for transmitting and receiving signals via a wireless or wired connection; in embodiments, thecommunication device 110 may perform communication in a vehicle over CAN communication, or the like. - The
storage 120 may store information (e.g., image data) obtained from thesensor module 210, data on which deep learning is performed by theprocessor 130, or the like. Thestorage 120 may include at least one type of a storage medium among a flash memory type of a memory, a hard disk type of a memory, a micro type of a memory, and a card type (e.g., a Secure Digital (SD) card or an eXtream Digital (XD) Card) of a memory, a Random Access Memory (RAM) type of a memory, a Static RAM (SRAM) type of a memory, a Read-Only Memory (ROM) type of a memory, a Programmable ROM (PROM) type of a memory, an Electrically Erasable PROM (EEPROM) type of a memory, an Magnetic RAM (MRAM) type of a memory, a magnetic disk type of a memory, and an optical disc type of a memory. - The
processor 130 may be electrically connected to thecommunication device 110 and thestorage 120, may electrically control each of the components, may be an electrical circuit that executes the commands of the software, and may perform various data processing and calculation described below. For example, theprocessor 130 may be an electronic control unit (ECU) or a sub-controller, which is mounted in the vehicle. - The
processor 130 may extract the waveform of the vehicle water splashing occurring when the front vehicle is driving, based on the image data of the front vehicle obtained through thesensor module 210. - The
processor 130 may determine or calculate the dangerousness based on at least one or more of the speed of the vehicle, a distance between the present vehicle and a point at which the water splashing of the front vehicle occurs, the height of the waveform of the vehicle water splashing, or the spreading width of the waveform of the vehicle water splashing. - The
processor 130 may operate a learning algorithm (learning network) that learns the vehicle water splashing based on the image data of the front vehicle obtained through thesensor module 210, may input the image data of the front vehicle, which is obtained when the vehicle is driving, to the learning network, may determine the vehicle water splashing, and may determine the dangerousness. The learning network may generate dangerousness information according to the waveform of the vehicle water splashing based on the learned algorithm. - The
processor 130 may allow the vehicle to continuously drive without a separate warning or action, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level; theprocessor 130 may perform a warning or vehicle control, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level. - The
processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, or may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs. Alternatively, theprocessor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, and may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs. - The
processor 130 may output a vehicle control message for providing a notification that the vehicle is automatically controlled, may perform vehicle control for avoiding the dangerousness due to the vehicle water splashing, and may transmit danger information due to the vehicle water splashing to a nearby vehicle to share the danger information with the nearby vehicle, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is driving at a point at which the vehicle water splashing occurs. - The nearby vehicle may rapidly respond to the vehicle water splashing, by sharing information and dangerousness associated with a point at which the vehicle water splashing occurs, with a nearby vehicle.
- The
sensor module 210 may obtain image data at a periphery of a vehicle, may detect an object at a periphery of the vehicle to obtain detection information, and may transmit the obtained information to the apparatus 100 for responding to vehicle water splashing over CAN communication. That is, thesensor module 210 may be configured to sense information about nearby objects (e.g., a vehicle, a pedestrian, a bicycle, a motorcycle, or the like). Thesensor module 210 may sense various pieces of information such as the location, speed and acceleration, direction, type, or the like of an external object. To this end, thesensor module 210 may include a camera, radar, a laser scanner, corner radar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, and/or a wheel speed sensor. - The
sensor module 210 may include at least one or more sensor modules, and the at least one or more sensor modules may be mounted in the vehicle; thesensor module 210 may be installed on the front, side, or rear of the vehicle.FIG. 2 illustrates an example in whichradars - The
communication module 220 may communicate with nearby vehicles or peripheral communication devices and may perform wireless communication. Thecommunication module 220 may perform V2X or V2V communication and may perform wireless communication. Thecommunication module 220 may transmit and receive vehicle driving information, danger information, or the like to and from nearby vehicles to share the vehicle driving information, the danger information, or the like. - The
warning device 230 may perform a warning such as notification of a dangerous situation due to the vehicle water splashing, or the like. Thewarning device 230 may have a configuration for performing visual, auditory, and tactile warnings, and may be implemented as a head-up display (HUD), a cluster, Audio Video Navigation (AVN), or the like. - The
steering control device 240 may be configured to control the steering angle of the vehicle and may include a steering wheel, an actuator operating in conjunction with the steering wheel, and a controller for controlling the actuator. - The
braking control device 250 may be configured to control the brake of the vehicle and may include a controller for controlling a brake. - The
engine control device 260 may be configured to control the driving of the engine of a vehicle and may include a controller for controlling the speed of the vehicle. - As such, after learning the vehicle water splashing through a camera deep learning method (CNN), the water splashing image may be recognized or determined while the vehicle is driving, may determine the dangerousness in advance, and may respond to the dangerousness. Embodiments may implement a warning message, may induce vehicle path avoidance, and may share danger information with nearby vehicles, as a primary countermeasure. Furthermore, in embodiments, as a secondary countermeasure, a controller or other device of the vehicle may output a text message or voice message saying that the vehicle is autonomously controlled, may perform steering wheel steering, engine drive control, and brake control so as to identify nearby obstacles and to avoid the collision with nearby obstacles, and may transmit danger information to nearby vehicles to share the danger information with nearby vehicles, when the water splashing actually occurs.
-
FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure. Referring to a water splashing image of a vehicle in 401, 402, 403, and 404 ofFIG. 3 ,water splashing waveforms water splashing waveforms -
FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure. Referring toFIG. 4 , the apparatus 100 for responding to vehicle water splashing may input water splashing waveform information extracted inFIG. 3 to a learning network. After extracting a feature point, the apparatus 100 for responding to vehicle water splashing may perform classification based on the extracted feature point. For example, as illustrated in 413 ofFIG. 3 , the dangerousness may be classified depending on a height H and a spreading width W of the water splashing waveform of a vehicle. When the height and spreading width of thewater splashing waveform 412 of a vehicle are very great or greater than a predetermined height and a predetermined width, thewater splashing waveform 412 may be classified as the high dangerousness. When the spreading width of thewater splashing waveform 411 of a vehicle are very small or smaller than a predetermined width, thewater splashing waveform 411 may be classified as the low dangerousness. -
FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure. Referring toFIG. 5 , the apparatus 100 for responding to vehicle water splashing may output a warning message through acluster 601 and anAVN 602, when it is determined that dangerousness is higher than a predetermined level, based on the vehicle water splashing waveform of the current front vehicle. - Hereinafter, according to an embodiment of the present disclosure, a learning method according to a water splashing waveform of a vehicle will be described with reference to
FIG. 6 .FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure. - Hereinafter, it is assumed that the apparatus 100 for responding to vehicle water splashing of
FIG. 1 performs the process ofFIG. 6 . In addition, as described inFIG. 6 , it is understood that the operation described as being executed by the apparatus 100 is controlled by theprocessor 130 of the apparatus 100. - Referring to
FIG. 6 , in operation 5110, the apparatus 100 for responding to vehicle water splashing accumulates data associated with the vehicle water splashing of image data received from thesensor module 210. At this time, thesensor module 210 may transmit the image data to the apparatus 100 for responding to vehicle water splashing at a predetermined period or may provide the image data whenever an event (e.g., when it rains) occurs. - Afterward, in operation 5120, the apparatus 100 for responding to vehicle water splashing classifies a water splashing waveform from the accumulated image data indicating that the vehicle water splashing occurs; in operation 5130, the apparatus 100 for responding to vehicle water splashing performs learning through a deep learning algorithm for each waveform of water splashing.
- As such, in operation 5140, the apparatus 100 for responding to vehicle water splashing generates and stores dangerousness information for each water splashing waveform as the learning result.
- Hereinafter, according to an embodiment of the present disclosure, a method for responding to vehicle water splashing will be described with reference to
FIG. 7 .FIG. 7 is a flowchart for describing a method for responding to vehicle water splashing, according to an embodiment of the present disclosure. Hereinafter, it is assumed that the apparatus 100 for responding to vehicle water splashing ofFIG. 1 performs the process ofFIG. 7 . In addition, as described inFIG. 7 , it is understood that the operation described as being executed by the apparatus 100 is controlled by theprocessor 130 of the apparatus 100. - Referring to
FIG. 7 , after starting the driving of a vehicle in operation 5210, in operation 5220, the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, based on deep learning by applying the obtained image data to a learning algorithm. At this time, the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, by using the speed at which the vehicle is moving, a distance between the present vehicle and a point at which the water splashing occurs, the height of the water splashing occurring by the front vehicle, the degree of horizontal spreading of the water splashing, the waveform of the water splashing, or the like. - In operation 5230, the apparatus 100 for responding to vehicle water splashing determines the dangerousness or degree of danger that is to be caused by the vehicle water splashing, when the vehicle water splashing occurs. That is, the apparatus 100 for responding to vehicle water splashing may determine that the dangerousness due to the vehicle water splashing is higher than a predetermined level, when the blind phenomenon occurs in front of the vehicle due to the vehicle water splashing or when there are obstacles, which can cause collisions, at a periphery of the vehicle.
- In operation 5240, the apparatus 100 for responding to vehicle water splashing maintains the driving of the vehicle, when it is determined that the dangerousness or a degree of danger is lower than a predetermined level; in operation 5250, the apparatus 100 for responding to vehicle water splashing determines whether the vehicle water splashing is scheduled to occur, when it is determined that the dangerousness is higher than a predetermined level.
- In operation 5260, the apparatus 100 for responding to vehicle water splashing outputs a warning message, induces the vehicle to drive a vehicle path such that the vehicle water splashing does not occur, transmits danger information to a nearby vehicle, and shares the danger information with the nearby vehicle, when the vehicle water splashing is scheduled to occur. For example, the apparatus 100 for responding to vehicle water splashing outputs a warning message in advance, induces the vehicle to drive on a vehicle path such that the vehicle avoids a point at which it is expected that the vehicle water splashing occurs, transmits the point at which it is expected that the vehicle water splashing occurs, to nearby vehicles, and shares the point with the nearby vehicles, when a vehicle speed is not greater than 60 km/h and the point at which it is expected that the vehicle water splashing occurs is a 80 m ahead. Accordingly, the apparatus 100 for responding to vehicle water splashing may allow the following vehicles to drive while avoiding the point at which it is expected that the vehicle water splashing occurs.
- In the meantime, in operation 5270, the apparatus 100 for responding to vehicle water splashing outputs a vehicle control message saying that the vehicle is controlled to avoid the dangerous situation, to notify a user, performs steering control, engine driving control, and brake control to avoid the collision, transmits danger information to a nearby vehicle, and shares the danger information to the nearby vehicle, when the vehicle water splashing occurs currently. That is, the apparatus 100 for responding to vehicle water splashing may perform vehicle control so as to prevent a secondary accident, may output a vehicle control message to notify a user before performing the vehicle control or at the same time, may avoid the collision or may prevent the sudden brake, or the like by performing the vehicle control, and may allow the vehicle to drive at a safe distance from the front vehicle, when the vehicle water splashing currently occurs in the present vehicle. In addition, the apparatus 100 for responding to vehicle water splashing may notify a nearby vehicle (the following vehicle) of a point at which the water splashing occurs in the present vehicle to allow the nearby vehicle to drive while the nearby vehicle avoids the point at which the water splashing occurs.
- As such, in case of rain, a controller or other device of the vehicle may determine or estimate the vehicle water splashing, may provide a warning, and may perform vehicle control so as to provide an avoidance path or to prevent the collision, and thus it is possible to drive a vehicle safely.
-
FIG. 8 illustrates a computing system according to an embodiment of the present disclosure. - Referring to
FIG. 8 , acomputing system 1000 may include at least oneprocessor 1100, amemory 1300, a userinterface input device 1400, a userinterface output device 1500,storage 1600, and anetwork interface 1700, which are connected with each other via abus 1200. - The
processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in thememory 1300 and/or thestorage 1600. Each of thememory 1300 and thestorage 1600 may include various types of volatile or nonvolatile storage media. For example, thememory 1300 may include a read only memory (ROM) and a random access memory (RAM). - Thus, the operations of the methods or algorithms described in connection with the embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or a combination of the hardware module and the software module, which is executed by the
processor 1100. The software module may reside on a storage medium (i.e., thememory 1300 and/or the storage 1600) such as a RAM, a flash memory, a ROM, an erasable and programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disc, a removable disc, or a compact disc-ROM (CD-ROM). - The storage medium may be coupled to the
processor 1100. Theprocessor 1100 may read out information from the storage medium and may write information in the storage medium. Alternatively, the storage medium may be integrated with theprocessor 1100. The processor and storage medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in a user terminal. Alternatively, the processor and storage medium may reside as a separate component in the user terminal. - Hereinabove, although the present disclosure has been described with reference to embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and altered by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure claimed in the following claims.
- Therefore, embodiments of the present disclosure are not intended to limit the technical spirit of the present disclosure, but provided only for the illustrative purpose. The scope of protection of the present disclosure should be construed by the attached claims, and all equivalents thereof should be construed as being included within the scope of the present disclosure.
- According to embodiments, the vehicle may predict and respond to the vehicle water splashing to increase the reliability of the vehicle system and to allow a user to drive the vehicle safely, thereby enhancing the user's convenience.
- In addition, the ego vehicle may share information about the vehicle water splashing with other vehicles, thereby increasing a safe driving effect during autonomous driving.
- Besides, a variety of effects directly or indirectly understood through this disclosure may be provided.
- Logical blocks, modules or units described in connection with embodiments disclosed herein can be implemented or performed by a computing device having at least one processor, at least one memory and at least one communication interface. The elements of a method, process, or algorithm described in connection with embodiments disclosed herein can be embodied directly in hardware, in a software module executed by at least one processor, or in a combination of the two. Computer-executable instructions for implementing a method, process, or algorithm described in connection with embodiments disclosed herein can be stored in a non-transitory computer readable storage medium.
- Hereinabove, although the present disclosure has been described with reference to embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and altered by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure claimed in the following claims.
Claims (20)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2018-0123047 | 2018-10-16 | ||
KR1020180123047A KR102529918B1 (en) | 2018-10-16 | 2018-10-16 | Apparatus for splashing water of vehicle, system having the same and method thereof |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200114908A1 true US20200114908A1 (en) | 2020-04-16 |
US11027727B2 US11027727B2 (en) | 2021-06-08 |
Family
ID=70162428
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/232,906 Active 2039-03-29 US11027727B2 (en) | 2018-10-16 | 2018-12-26 | Apparatus for responding to vehicle water splashing, system having the same and method thereof |
Country Status (3)
Country | Link |
---|---|
US (1) | US11027727B2 (en) |
KR (1) | KR102529918B1 (en) |
CN (1) | CN111055848B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220157067A1 (en) * | 2019-03-15 | 2022-05-19 | Car.Software Estonia As | Determining a source of danger on a roadway |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113771855B (en) * | 2021-09-02 | 2023-06-20 | 东风汽车集团股份有限公司 | Vehicle wading control method, device and system, terminal equipment and medium |
CN114320075A (en) * | 2022-01-27 | 2022-04-12 | 重庆长安汽车股份有限公司 | Automatic window closing system and method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170161573A1 (en) * | 2015-12-03 | 2017-06-08 | GM Global Technology Operations LLC | Vision-based wet road surface condition detection using tire side splash |
US20180022278A1 (en) * | 2016-07-19 | 2018-01-25 | GM Global Technology Operations LLC | System and method for enhancing vehicle environment perception |
US20180060676A1 (en) * | 2015-05-06 | 2018-03-01 | Continental Teves Ag & Co. Ohg | Method and device for detecting and evaluating environmental influences and road condition information in the vehicle surroundings |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008179251A (en) * | 2007-01-24 | 2008-08-07 | Toyota Motor Corp | Traveling support device for vehicle and traveling support method for vehicle |
JP5408240B2 (en) * | 2011-12-12 | 2014-02-05 | 株式会社デンソー | Warning system, vehicle device, and server |
DE102012112724A1 (en) * | 2012-12-20 | 2014-06-26 | Continental Teves Ag & Co. Ohg | Method for determining a road condition from environmental sensor data |
US9428194B2 (en) * | 2014-12-11 | 2016-08-30 | Toyota Motor Engineering & Manufacturing North America, Inc. | Splash condition detection for vehicles |
KR102366402B1 (en) * | 2015-05-21 | 2022-02-22 | 엘지전자 주식회사 | Driver assistance apparatus and control method for the same |
US9972206B2 (en) * | 2015-12-03 | 2018-05-15 | GM Global Technology Operations LLC | Wet road surface condition detection |
US20180286246A1 (en) * | 2017-03-31 | 2018-10-04 | Intel Corporation | Sensor-derived road hazard detection and reporting |
DE102017010746A1 (en) * | 2017-11-21 | 2018-07-12 | Daimler Ag | Method for avoiding a vehicle |
-
2018
- 2018-10-16 KR KR1020180123047A patent/KR102529918B1/en active IP Right Grant
- 2018-12-12 CN CN201811521643.5A patent/CN111055848B/en active Active
- 2018-12-26 US US16/232,906 patent/US11027727B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20180060676A1 (en) * | 2015-05-06 | 2018-03-01 | Continental Teves Ag & Co. Ohg | Method and device for detecting and evaluating environmental influences and road condition information in the vehicle surroundings |
US20170161573A1 (en) * | 2015-12-03 | 2017-06-08 | GM Global Technology Operations LLC | Vision-based wet road surface condition detection using tire side splash |
US20180022278A1 (en) * | 2016-07-19 | 2018-01-25 | GM Global Technology Operations LLC | System and method for enhancing vehicle environment perception |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220157067A1 (en) * | 2019-03-15 | 2022-05-19 | Car.Software Estonia As | Determining a source of danger on a roadway |
Also Published As
Publication number | Publication date |
---|---|
KR20200042661A (en) | 2020-04-24 |
KR102529918B1 (en) | 2023-05-08 |
US11027727B2 (en) | 2021-06-08 |
CN111055848A (en) | 2020-04-24 |
CN111055848B (en) | 2024-07-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110406533B (en) | Lane keeping assist system and method for improving safety of longitudinal control of front vehicle follower | |
KR102417905B1 (en) | Apparatus and method for controlling platooning of leading vehicle | |
CN107433946B (en) | Apparatus and method for controlling lane change considering priority | |
US9099006B2 (en) | Context-aware threat response arbitration | |
CN108216220B (en) | Apparatus and method for boundary-based vehicle collision control | |
JP6441959B2 (en) | Reduce false alarms using location data | |
US9196163B2 (en) | Driving support apparatus and driving support method | |
KR102406522B1 (en) | Apparatus for controlling platooning based-on weather environment, system having the same and method thereof | |
JP6575492B2 (en) | Automated driving system | |
US11427166B2 (en) | Adaptive AEB system considering steerable path and control method thereof | |
JP2010083312A (en) | Vehicle drive assist system | |
KR20190074025A (en) | Apparatus and method for deciding maneuver of peripheral vehicle | |
KR20210014433A (en) | Apparatus for controlling platooning driving of vehicle, system having the same and method thereof | |
US11027727B2 (en) | Apparatus for responding to vehicle water splashing, system having the same and method thereof | |
KR102598953B1 (en) | Apparatus for controlling a vehicle, system having the same and method thereof | |
JP2024091753A (en) | Method for restricting accident risk and control equipment | |
US20190317492A1 (en) | Apparatus and method for providing safety strategy in vehicle | |
US11891056B2 (en) | Device and method for improving assistance systems for lateral vehicle movements | |
KR20220023528A (en) | Apparatus and method for controlling platooning information of vehicle | |
CN115465283A (en) | Adaptive trust calibration | |
US20220363291A1 (en) | Autonomous driving system, autonomous driving control method, and nontransitory storage medium | |
JP6193177B2 (en) | Motion support system and object recognition device | |
JP2019025932A (en) | Traveling control device for vehicle | |
US20230135702A1 (en) | Apparatus for controlling autonomous driving and method thereof | |
KR20210069782A (en) | Apparatus for controlling platooning and method thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KIA MOTORS CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIM, JUNG HO;REEL/FRAME:047854/0976 Effective date: 20181130 Owner name: HYUNDAI MOTOR COMPANY, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIM, JUNG HO;REEL/FRAME:047854/0976 Effective date: 20181130 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |