[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

US20200114908A1 - Apparatus for responding to vehicle water splashing, system having the same and method thereof - Google Patents

Apparatus for responding to vehicle water splashing, system having the same and method thereof Download PDF

Info

Publication number
US20200114908A1
US20200114908A1 US16/232,906 US201816232906A US2020114908A1 US 20200114908 A1 US20200114908 A1 US 20200114908A1 US 201816232906 A US201816232906 A US 201816232906A US 2020114908 A1 US2020114908 A1 US 2020114908A1
Authority
US
United States
Prior art keywords
vehicle
water splashing
dangerousness
vehicle water
occurs
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US16/232,906
Other versions
US11027727B2 (en
Inventor
Jung Ho LIM
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Motor Co
Kia Corp
Original Assignee
Hyundai Motor Co
Kia Motors Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Motor Co, Kia Motors Corp filed Critical Hyundai Motor Co
Assigned to HYUNDAI MOTOR COMPANY, KIA MOTORS CORPORATION reassignment HYUNDAI MOTOR COMPANY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: LIM, JUNG HO
Publication of US20200114908A1 publication Critical patent/US20200114908A1/en
Application granted granted Critical
Publication of US11027727B2 publication Critical patent/US11027727B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/09Taking automatic action to avoid collision, e.g. braking and steering
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/10Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to vehicle motion
    • B60W40/105Speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D15/00Steering not otherwise provided for
    • B62D15/02Steering position indicators ; Steering position determination; Steering aids
    • B62D15/025Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60QARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL
    • B60Q9/00Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00, e.g. haptic signalling
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/04Conjoint control of vehicle sub-units of different type or different function including control of propulsion units
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/04Conjoint control of vehicle sub-units of different type or different function including control of propulsion units
    • B60W10/06Conjoint control of vehicle sub-units of different type or different function including control of propulsion units including control of combustion engines
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/18Conjoint control of vehicle sub-units of different type or different function including control of braking systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/20Conjoint control of vehicle sub-units of different type or different function including control of steering systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W10/00Conjoint control of vehicle sub-units of different type or different function
    • B60W10/30Conjoint control of vehicle sub-units of different type or different function including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/08Active safety systems predicting or avoiding probable or impending collision or attempting to minimise its consequences
    • B60W30/095Predicting travel path or likelihood of collision
    • B60W30/0956Predicting travel path or likelihood of collision the prediction being responsive to traffic or environmental parameters
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06Road conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • G06K9/00791
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/764Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/588Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/161Decentralised systems, e.g. inter-vehicle communication
    • G08G1/162Decentralised systems, e.g. inter-vehicle communication event-triggered
    • GPHYSICS
    • G08SIGNALLING
    • G08GTRAFFIC CONTROL SYSTEMS
    • G08G1/00Traffic control systems for road vehicles
    • G08G1/16Anti-collision systems
    • G08G1/166Anti-collision systems for active traffic, e.g. moving vehicles, pedestrians, bikes
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system
    • B60W50/14Means for informing the driver, warning the driver or prompting a driver intervention
    • B60W2050/143Alarm means
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/403Image sensing, e.g. optical camera
    • B60W2420/42
    • B60W2550/12
    • B60W2550/14
    • B60W2550/30
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00Input parameters relating to infrastructure
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2554/00Input parameters relating to objects
    • B60W2554/80Spatial relation or speed relative to objects
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2555/00Input parameters relating to exterior conditions, not covered by groups B60W2552/00, B60W2554/00
    • B60W2555/20Ambient conditions, e.g. wind or rain
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2710/00Output or target parameters relating to a particular sub-units
    • B60W2710/06Combustion engines, Gas turbines
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2710/00Output or target parameters relating to a particular sub-units
    • B60W2710/18Braking system
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2710/00Output or target parameters relating to a particular sub-units
    • B60W2710/20Steering systems
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2710/00Output or target parameters relating to a particular sub-units
    • B60W2710/30Auxiliary equipments
    • B60W2750/40
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2756/00Output or target parameters relating to data
    • B60W2756/10Involving external transmission of data to or from the vehicle
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B62LAND VEHICLES FOR TRAVELLING OTHERWISE THAN ON RAILS
    • B62DMOTOR VEHICLES; TRAILERS
    • B62D15/00Steering not otherwise provided for
    • B62D15/02Steering position indicators ; Steering position determination; Steering aids
    • B62D15/025Active steering aids, e.g. helping the driver by actively influencing the steering system after environment evaluation
    • B62D15/0265Automatic obstacle avoidance by steering

Definitions

  • the present disclosure relates to an apparatus for responding to vehicle water splashing.
  • the driver's vehicle may collide with a nearby obstacle by a sudden steering operation or may collide with the rear vehicle due to sudden braking, when the driver cannot see the front view of the vehicle. Furthermore, the vehicle may collide with the front vehicle when the safety distance to the front vehicle is not assured. In addition, the water splashing that occurs on a specific road surface will continuously occur at the following vehicles driving on the specific road.
  • An aspect of the present disclosure provides an apparatus for responding to vehicle water splashing, a system having the same, and a method thereof that predict and determine the water splashing on the windshield of the vehicle based on the camera deep learning manner and actively respond to the water splashing.
  • an apparatus for responding to vehicle water splashing may include a processor determining the vehicle water splashing based on image data of a nearby vehicle and determining dangerousness due to the vehicle water splashing to perform vehicle control and storage storing information determined by the processor and the image data of the nearby vehicle.
  • the apparatus may further include a communication device transmitting and receiving information indicating that the vehicle water splashing occurs, to and from the nearby vehicle.
  • the processor may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
  • the processor may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
  • the processor may be configured to operate a learning network that learns the vehicle water splashing, based on the image data of the front vehicle.
  • the processor may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
  • the processor may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
  • the processor may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
  • the processor may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control and to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing.
  • the processor when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the processor may be configured to transmit danger information due to the vehicle water splashing to the nearby vehicle.
  • a vehicle system may include a sensor module obtaining image data and driving information of a nearby vehicle and an apparatus for responding to vehicle water splashing determining the vehicle water splashing based on the image data of the nearby vehicle and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
  • the apparatus for responding to the vehicle water splashing may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
  • the apparatus for responding to the vehicle water splashing may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
  • the apparatus for responding to the vehicle water splashing may include a learning network that learns the vehicle water splashing, based on the image data of the front vehicle, and the apparatus for responding to the vehicle water splashing may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
  • the apparatus for responding to the vehicle water splashing may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
  • the apparatus for responding to the vehicle water splashing may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
  • the apparatus for responding to the vehicle water splashing may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control, to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and to transmit the danger information due to the vehicle water splashing to the nearby vehicle.
  • a method for responding to vehicle water splashing may include obtaining image data and driving information of a nearby vehicle, determining the vehicle water splashing based on the image data of the nearby vehicle, and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
  • the determining of the vehicle water splashing may include extracting a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
  • the determining of the vehicle water splashing may include determining the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
  • the performing of the vehicle control may include controlling vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
  • the performing of the vehicle control may include outputting a warning sound or a warning text, providing a vehicle path for avoiding the point at which the vehicle water splashing occurs, or transmitting danger information due to the vehicle water splashing to the nearby vehicle.
  • the performing of the vehicle control may include outputting a vehicle control message for providing a notification of performing automatic vehicle control, performing the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and transmitting the danger information due the vehicle water splashing to the nearby vehicle.
  • FIG. 1 is a block diagram illustrating a configuration of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure
  • FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure
  • FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure
  • FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure
  • FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure
  • FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure
  • FIG. 7 is a flowchart for describing a method for responding to the vehicle water splashing, according to an embodiment of the present disclosure.
  • FIG. 8 illustrates a computing system according to an embodiment of the present disclosure.
  • the present disclosure disclose a technology that tracks image data of vehicle water splashing of a nearby vehicle, learns dangerousness for each water splashing waveform based on a learning algorithm by using the accumulated data, determines or estimates dangerousness or degree of danger caused by the current water splashing, depending on the dangerousness for each water splashing waveform when a vehicle is driving actually, and makes it possible to respond to the dangerousness.
  • FIGS. 1 to 8 various embodiments of the present disclosure will be described in detail with reference to FIGS. 1 to 8 .
  • FIG. 1 is a block diagram of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure.
  • FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure.
  • a vehicle system may include an apparatus 100 for responding to vehicle water splashing, a sensor module 210 , a communication module 220 , a warning device 230 , a steering control device 240 , a braking control device 250 , and an engine control device 260 .
  • each of the components of the vehicle system including the apparatus 100 for responding to vehicle water splashing may be mounted in the vehicle.
  • the apparatus 100 for responding to vehicle water splashing may learn the vehicle water splashing through a learning algorithm (Convolutional Neural Network (CNN)) based on image data of a nearby vehicle, may accurately determine the vehicle water splashing based on the learning result when the vehicle drives later, may determine the dangerousness caused by the vehicle water splashing, and may perform vehicle control and warning so as to avoid the dangerous situation.
  • CNN Convolutional Neural Network
  • the apparatus 100 for responding to vehicle water splashing may include a communication device 110 , storage 120 , and a processor 130 .
  • the communication device 110 may be a hardware device implemented with various electronic circuits for transmitting and receiving signals via a wireless or wired connection; in embodiments, the communication device 110 may perform communication in a vehicle over CAN communication, or the like.
  • the storage 120 may store information (e.g., image data) obtained from the sensor module 210 , data on which deep learning is performed by the processor 130 , or the like.
  • the storage 120 may include at least one type of a storage medium among a flash memory type of a memory, a hard disk type of a memory, a micro type of a memory, and a card type (e.g., a Secure Digital (SD) card or an eXtream Digital (XD) Card) of a memory, a Random Access Memory (RAM) type of a memory, a Static RAM (SRAM) type of a memory, a Read-Only Memory (ROM) type of a memory, a Programmable ROM (PROM) type of a memory, an Electrically Erasable PROM (EEPROM) type of a memory, an Magnetic RAM (MRAM) type of a memory, a magnetic disk type of a memory, and an optical disc type of a memory.
  • SD Secure Digital
  • XD eXtream Digital
  • the processor 130 may be electrically connected to the communication device 110 and the storage 120 , may electrically control each of the components, may be an electrical circuit that executes the commands of the software, and may perform various data processing and calculation described below.
  • the processor 130 may be an electronic control unit (ECU) or a sub-controller, which is mounted in the vehicle.
  • ECU electronice control unit
  • sub-controller which is mounted in the vehicle.
  • the processor 130 may extract the waveform of the vehicle water splashing occurring when the front vehicle is driving, based on the image data of the front vehicle obtained through the sensor module 210 .
  • the processor 130 may determine or calculate the dangerousness based on at least one or more of the speed of the vehicle, a distance between the present vehicle and a point at which the water splashing of the front vehicle occurs, the height of the waveform of the vehicle water splashing, or the spreading width of the waveform of the vehicle water splashing.
  • the processor 130 may operate a learning algorithm (learning network) that learns the vehicle water splashing based on the image data of the front vehicle obtained through the sensor module 210 , may input the image data of the front vehicle, which is obtained when the vehicle is driving, to the learning network, may determine the vehicle water splashing, and may determine the dangerousness.
  • the learning network may generate dangerousness information according to the waveform of the vehicle water splashing based on the learned algorithm.
  • the processor 130 may allow the vehicle to continuously drive without a separate warning or action, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level; the processor 130 may perform a warning or vehicle control, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level.
  • the processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, or may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs.
  • the processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, and may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs.
  • the processor 130 may output a vehicle control message for providing a notification that the vehicle is automatically controlled, may perform vehicle control for avoiding the dangerousness due to the vehicle water splashing, and may transmit danger information due to the vehicle water splashing to a nearby vehicle to share the danger information with the nearby vehicle, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is driving at a point at which the vehicle water splashing occurs.
  • the nearby vehicle may rapidly respond to the vehicle water splashing, by sharing information and dangerousness associated with a point at which the vehicle water splashing occurs, with a nearby vehicle.
  • the sensor module 210 may obtain image data at a periphery of a vehicle, may detect an object at a periphery of the vehicle to obtain detection information, and may transmit the obtained information to the apparatus 100 for responding to vehicle water splashing over CAN communication. That is, the sensor module 210 may be configured to sense information about nearby objects (e.g., a vehicle, a pedestrian, a bicycle, a motorcycle, or the like). The sensor module 210 may sense various pieces of information such as the location, speed and acceleration, direction, type, or the like of an external object. To this end, the sensor module 210 may include a camera, radar, a laser scanner, corner radar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, and/or a wheel speed sensor.
  • a camera radar, a laser scanner, corner radar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, and/or a wheel speed sensor.
  • the sensor module 210 may include at least one or more sensor modules, and the at least one or more sensor modules may be mounted in the vehicle; the sensor module 210 may be installed on the front, side, or rear of the vehicle.
  • FIG. 2 illustrates an example in which radars 301 , 302 , and 303 are mounted on the front side and both rear sides of the vehicle.
  • the camera may include an MFC camera, a SVM camera, or the like.
  • the communication module 220 may communicate with nearby vehicles or peripheral communication devices and may perform wireless communication.
  • the communication module 220 may perform V2X or V2V communication and may perform wireless communication.
  • the communication module 220 may transmit and receive vehicle driving information, danger information, or the like to and from nearby vehicles to share the vehicle driving information, the danger information, or the like.
  • the warning device 230 may perform a warning such as notification of a dangerous situation due to the vehicle water splashing, or the like.
  • the warning device 230 may have a configuration for performing visual, auditory, and tactile warnings, and may be implemented as a head-up display (HUD), a cluster, Audio Video Navigation (AVN), or the like.
  • HUD head-up display
  • APN Audio Video Navigation
  • the steering control device 240 may be configured to control the steering angle of the vehicle and may include a steering wheel, an actuator operating in conjunction with the steering wheel, and a controller for controlling the actuator.
  • the braking control device 250 may be configured to control the brake of the vehicle and may include a controller for controlling a brake.
  • the engine control device 260 may be configured to control the driving of the engine of a vehicle and may include a controller for controlling the speed of the vehicle.
  • the water splashing image may be recognized or determined while the vehicle is driving, may determine the dangerousness in advance, and may respond to the dangerousness.
  • Embodiments may implement a warning message, may induce vehicle path avoidance, and may share danger information with nearby vehicles, as a primary countermeasure.
  • a controller or other device of the vehicle may output a text message or voice message saying that the vehicle is autonomously controlled, may perform steering wheel steering, engine drive control, and brake control so as to identify nearby obstacles and to avoid the collision with nearby obstacles, and may transmit danger information to nearby vehicles to share the danger information with nearby vehicles, when the water splashing actually occurs.
  • FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure.
  • a water splashing image of a vehicle in 401 , 402 , 403 , and 404 of FIG. 3 water splashing waveforms 411 , 412 , 413 , and 414 occurring while a front vehicle is driving may be extracted.
  • the apparatus 100 for responding to vehicle water splashing may determine dangerousness depending on the sizes of the water splashing waveforms 411 , 412 , 413 , and 414 .
  • FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure.
  • the apparatus 100 for responding to vehicle water splashing may input water splashing waveform information extracted in FIG. 3 to a learning network. After extracting a feature point, the apparatus 100 for responding to vehicle water splashing may perform classification based on the extracted feature point. For example, as illustrated in 413 of FIG. 3 , the dangerousness may be classified depending on a height H and a spreading width W of the water splashing waveform of a vehicle.
  • the water splashing waveform 412 When the height and spreading width of the water splashing waveform 412 of a vehicle are very great or greater than a predetermined height and a predetermined width, the water splashing waveform 412 may be classified as the high dangerousness. When the spreading width of the water splashing waveform 411 of a vehicle are very small or smaller than a predetermined width, the water splashing waveform 411 may be classified as the low dangerousness.
  • FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure.
  • the apparatus 100 for responding to vehicle water splashing may output a warning message through a cluster 601 and an AVN 602 , when it is determined that dangerousness is higher than a predetermined level, based on the vehicle water splashing waveform of the current front vehicle.
  • FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure.
  • the apparatus 100 for responding to vehicle water splashing of FIG. 1 performs the process of FIG. 6 .
  • the operation described as being executed by the apparatus 100 is controlled by the processor 130 of the apparatus 100 .
  • the apparatus 100 for responding to vehicle water splashing accumulates data associated with the vehicle water splashing of image data received from the sensor module 210 .
  • the sensor module 210 may transmit the image data to the apparatus 100 for responding to vehicle water splashing at a predetermined period or may provide the image data whenever an event (e.g., when it rains) occurs.
  • the apparatus 100 for responding to vehicle water splashing classifies a water splashing waveform from the accumulated image data indicating that the vehicle water splashing occurs; in operation 5130 , the apparatus 100 for responding to vehicle water splashing performs learning through a deep learning algorithm for each waveform of water splashing.
  • the apparatus 100 for responding to vehicle water splashing generates and stores dangerousness information for each water splashing waveform as the learning result.
  • FIG. 7 is a flowchart for describing a method for responding to vehicle water splashing, according to an embodiment of the present disclosure.
  • the apparatus 100 for responding to vehicle water splashing of FIG. 1 performs the process of FIG. 7 .
  • the operation described as being executed by the apparatus 100 is controlled by the processor 130 of the apparatus 100 .
  • the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, based on deep learning by applying the obtained image data to a learning algorithm. At this time, the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, by using the speed at which the vehicle is moving, a distance between the present vehicle and a point at which the water splashing occurs, the height of the water splashing occurring by the front vehicle, the degree of horizontal spreading of the water splashing, the waveform of the water splashing, or the like.
  • the apparatus 100 for responding to vehicle water splashing determines the dangerousness or degree of danger that is to be caused by the vehicle water splashing, when the vehicle water splashing occurs. That is, the apparatus 100 for responding to vehicle water splashing may determine that the dangerousness due to the vehicle water splashing is higher than a predetermined level, when the blind phenomenon occurs in front of the vehicle due to the vehicle water splashing or when there are obstacles, which can cause collisions, at a periphery of the vehicle.
  • the apparatus 100 for responding to vehicle water splashing maintains the driving of the vehicle, when it is determined that the dangerousness or a degree of danger is lower than a predetermined level; in operation 5250 , the apparatus 100 for responding to vehicle water splashing determines whether the vehicle water splashing is scheduled to occur, when it is determined that the dangerousness is higher than a predetermined level.
  • the apparatus 100 for responding to vehicle water splashing outputs a warning message, induces the vehicle to drive a vehicle path such that the vehicle water splashing does not occur, transmits danger information to a nearby vehicle, and shares the danger information with the nearby vehicle, when the vehicle water splashing is scheduled to occur.
  • the apparatus 100 for responding to vehicle water splashing outputs a warning message in advance, induces the vehicle to drive on a vehicle path such that the vehicle avoids a point at which it is expected that the vehicle water splashing occurs, transmits the point at which it is expected that the vehicle water splashing occurs, to nearby vehicles, and shares the point with the nearby vehicles, when a vehicle speed is not greater than 60 km/h and the point at which it is expected that the vehicle water splashing occurs is a 80 m ahead.
  • the apparatus 100 for responding to vehicle water splashing may allow the following vehicles to drive while avoiding the point at which it is expected that the vehicle water splashing occurs.
  • the apparatus 100 for responding to vehicle water splashing outputs a vehicle control message saying that the vehicle is controlled to avoid the dangerous situation, to notify a user, performs steering control, engine driving control, and brake control to avoid the collision, transmits danger information to a nearby vehicle, and shares the danger information to the nearby vehicle, when the vehicle water splashing occurs currently. That is, the apparatus 100 for responding to vehicle water splashing may perform vehicle control so as to prevent a secondary accident, may output a vehicle control message to notify a user before performing the vehicle control or at the same time, may avoid the collision or may prevent the sudden brake, or the like by performing the vehicle control, and may allow the vehicle to drive at a safe distance from the front vehicle, when the vehicle water splashing currently occurs in the present vehicle. In addition, the apparatus 100 for responding to vehicle water splashing may notify a nearby vehicle (the following vehicle) of a point at which the water splashing occurs in the present vehicle to allow the nearby vehicle to drive while the nearby vehicle avoids the point at which the water splashing occurs.
  • a nearby vehicle the following vehicle
  • a controller or other device of the vehicle may determine or estimate the vehicle water splashing, may provide a warning, and may perform vehicle control so as to provide an avoidance path or to prevent the collision, and thus it is possible to drive a vehicle safely.
  • FIG. 8 illustrates a computing system according to an embodiment of the present disclosure.
  • a computing system 1000 may include at least one processor 1100 , a memory 1300 , a user interface input device 1400 , a user interface output device 1500 , storage 1600 , and a network interface 1700 , which are connected with each other via a bus 1200 .
  • the processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and/or the storage 1600 .
  • Each of the memory 1300 and the storage 1600 may include various types of volatile or nonvolatile storage media.
  • the memory 1300 may include a read only memory (ROM) and a random access memory (RAM).
  • the operations of the methods or algorithms described in connection with the embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or a combination of the hardware module and the software module, which is executed by the processor 1100 .
  • the software module may reside on a storage medium (i.e., the memory 1300 and/or the storage 1600 ) such as a RAM, a flash memory, a ROM, an erasable and programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disc, a removable disc, or a compact disc-ROM (CD-ROM).
  • the storage medium may be coupled to the processor 1100 .
  • the processor 1100 may read out information from the storage medium and may write information in the storage medium.
  • the storage medium may be integrated with the processor 1100 .
  • the processor and storage medium may reside in an application specific integrated circuit (ASIC).
  • the ASIC may reside in a user terminal.
  • the processor and storage medium may reside as a separate component in the user terminal.
  • the vehicle may predict and respond to the vehicle water splashing to increase the reliability of the vehicle system and to allow a user to drive the vehicle safely, thereby enhancing the user's convenience.
  • the ego vehicle may share information about the vehicle water splashing with other vehicles, thereby increasing a safe driving effect during autonomous driving.
  • Logical blocks, modules or units described in connection with embodiments disclosed herein can be implemented or performed by a computing device having at least one processor, at least one memory and at least one communication interface.
  • the elements of a method, process, or algorithm described in connection with embodiments disclosed herein can be embodied directly in hardware, in a software module executed by at least one processor, or in a combination of the two.
  • Computer-executable instructions for implementing a method, process, or algorithm described in connection with embodiments disclosed herein can be stored in a non-transitory computer readable storage medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Transportation (AREA)
  • Combustion & Propulsion (AREA)
  • Chemical & Material Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Software Systems (AREA)
  • Traffic Control Systems (AREA)

Abstract

An apparatus for responding to vehicle water splashing includes a processor determining the vehicle water splashing based on image data of a nearby vehicle and determining dangerousness caused by the vehicle water splashing to perform vehicle control and storage storing information determined by the processor and the image data of the nearby vehicle.

Description

    CROSS-REFERENCE TO RELATED APPLICATION
  • This application is claims the benefit of priority to Korean Patent Application No. 10-2018-0123047, filed in the Korean Intellectual Property Office on Oct. 16, 2018, the entire contents of which are incorporated herein by reference.
  • TECHNICAL FIELD
  • The present disclosure relates to an apparatus for responding to vehicle water splashing.
  • BACKGROUND
  • In recent years, vehicle automation/intelligence technologies such as a driver assistance system, a collision warning system, and an automatic temperature control system have been rapidly developing. In addition, the technologies to control the operating speed of a wiper or to control an engine or brake depending on weather and road conditions when a vehicle is driving have also been developed.
  • However, water in a puddle on the road surface splashes as a vehicle passes, and then the water splashes on the front of the windshield of the vehicle, when the vehicle is driving in a state where the rain is heavy. Accordingly, a driver may not see the front view of the vehicle instantaneously.
  • In this way, the driver's vehicle may collide with a nearby obstacle by a sudden steering operation or may collide with the rear vehicle due to sudden braking, when the driver cannot see the front view of the vehicle. Furthermore, the vehicle may collide with the front vehicle when the safety distance to the front vehicle is not assured. In addition, the water splashing that occurs on a specific road surface will continuously occur at the following vehicles driving on the specific road.
  • The disclosure of this section is to provide background of the invention. Applicant notes that this section may contain information available before this application. However, by providing this section, Applicant does not admit that any information contained in this section constitutes prior art.
  • SUMMARY
  • An aspect of the present disclosure provides an apparatus for responding to vehicle water splashing, a system having the same, and a method thereof that predict and determine the water splashing on the windshield of the vehicle based on the camera deep learning manner and actively respond to the water splashing.
  • According to an aspect of the present disclosure, an apparatus for responding to vehicle water splashing may include a processor determining the vehicle water splashing based on image data of a nearby vehicle and determining dangerousness due to the vehicle water splashing to perform vehicle control and storage storing information determined by the processor and the image data of the nearby vehicle.
  • According to an embodiment, the apparatus may further include a communication device transmitting and receiving information indicating that the vehicle water splashing occurs, to and from the nearby vehicle.
  • According to an embodiment, the processor may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
  • According to an embodiment, the processor may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
  • According to an embodiment, the processor may be configured to operate a learning network that learns the vehicle water splashing, based on the image data of the front vehicle.
  • According to an embodiment, the processor may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
  • According to an embodiment, the processor may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
  • According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs, the processor may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
  • According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at a point at which the vehicle water splashing occurs, the processor may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control and to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing.
  • According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the processor may be configured to transmit danger information due to the vehicle water splashing to the nearby vehicle.
  • According to an aspect of the present disclosure, a vehicle system may include a sensor module obtaining image data and driving information of a nearby vehicle and an apparatus for responding to vehicle water splashing determining the vehicle water splashing based on the image data of the nearby vehicle and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
  • According to an embodiment, the apparatus for responding to the vehicle water splashing may be configured to extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
  • According to an embodiment, the apparatus for responding to the vehicle water splashing may be configured to determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
  • According to an embodiment, the apparatus for responding to the vehicle water splashing may include a learning network that learns the vehicle water splashing, based on the image data of the front vehicle, and the apparatus for responding to the vehicle water splashing may be configured to input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine the vehicle water splashing and to determine the dangerousness.
  • According to an embodiment, the apparatus for responding to the vehicle water splashing may be configured to control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level. When the dangerousness is high and a present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs, the apparatus for responding to the vehicle water splashing may be configured to output a warning sound or a warning text, to provide a vehicle path for avoiding the point at which the vehicle water splashing occurs, or to transmit danger information due to the vehicle water splashing to the nearby vehicle.
  • According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the apparatus for responding to the vehicle water splashing may be configured to output a vehicle control message for providing a notification of performing automatic vehicle control, to perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and to transmit the danger information due to the vehicle water splashing to the nearby vehicle.
  • According to an aspect of the present disclosure, a method for responding to vehicle water splashing may include obtaining image data and driving information of a nearby vehicle, determining the vehicle water splashing based on the image data of the nearby vehicle, and determining dangerousness caused by the vehicle water splashing to perform vehicle control.
  • According to an embodiment, the determining of the vehicle water splashing may include extracting a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
  • According to an embodiment, the determining of the vehicle water splashing may include determining the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
  • According to an embodiment, the performing of the vehicle control may include controlling vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level. When the dangerousness is high and a present vehicle is scheduled to drive at the point at which the vehicle water splashing occurs, the performing of the vehicle control may include outputting a warning sound or a warning text, providing a vehicle path for avoiding the point at which the vehicle water splashing occurs, or transmitting danger information due to the vehicle water splashing to the nearby vehicle.
  • According to an embodiment, when the result of determining the dangerousness indicates that the dangerousness is high and the present vehicle is driving at the point at which the vehicle water splashing occurs, the performing of the vehicle control may include outputting a vehicle control message for providing a notification of performing automatic vehicle control, performing the vehicle control for avoiding the dangerousness due to the vehicle water splashing, and transmitting the danger information due the vehicle water splashing to the nearby vehicle.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • The above and other aspects, features and advantages of the present disclosure will be more apparent from the following detailed description taken in conjunction with the accompanying drawings:
  • FIG. 1 is a block diagram illustrating a configuration of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure;
  • FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure;
  • FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure;
  • FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure;
  • FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure;
  • FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure;
  • FIG. 7 is a flowchart for describing a method for responding to the vehicle water splashing, according to an embodiment of the present disclosure; and
  • FIG. 8 illustrates a computing system according to an embodiment of the present disclosure.
  • DETAILED DESCRIPTION
  • Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals will be used throughout to designate the same or equivalent elements. In addition, a detailed description of well-known features or functions will be ruled out in order not to unnecessarily obscure the gist of the present disclosure.
  • In describing elements of embodiments of the present disclosure, the terms first, second, A, B, (a), (b), and the like may be used herein. These terms are only used to distinguish one element from another element, but do not limit the corresponding elements irrespective of the order or priority of the corresponding elements. Furthermore, unless otherwise defined, all terms including technical and scientific terms used herein are to be interpreted as is customary in the art to which this invention belongs. It will be understood that terms used herein should be interpreted as having a meaning that is consistent with their meaning in the context of the present disclosure and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
  • The present disclosure disclose a technology that tracks image data of vehicle water splashing of a nearby vehicle, learns dangerousness for each water splashing waveform based on a learning algorithm by using the accumulated data, determines or estimates dangerousness or degree of danger caused by the current water splashing, depending on the dangerousness for each water splashing waveform when a vehicle is driving actually, and makes it possible to respond to the dangerousness.
  • Below, various embodiments of the present disclosure will be described in detail with reference to FIGS. 1 to 8.
  • FIG. 1 is a block diagram of a vehicle system including an apparatus for responding to vehicle water splashing, according to an embodiment of the present disclosure. FIG. 2 is a view in which a sensor module is mounted in a vehicle, according to an embodiment of the present disclosure.
  • Referring to FIG. 1, a vehicle system may include an apparatus 100 for responding to vehicle water splashing, a sensor module 210, a communication module 220, a warning device 230, a steering control device 240, a braking control device 250, and an engine control device 260. At this time, each of the components of the vehicle system including the apparatus 100 for responding to vehicle water splashing may be mounted in the vehicle.
  • The apparatus 100 for responding to vehicle water splashing may learn the vehicle water splashing through a learning algorithm (Convolutional Neural Network (CNN)) based on image data of a nearby vehicle, may accurately determine the vehicle water splashing based on the learning result when the vehicle drives later, may determine the dangerousness caused by the vehicle water splashing, and may perform vehicle control and warning so as to avoid the dangerous situation.
  • To this end, the apparatus 100 for responding to vehicle water splashing may include a communication device 110, storage 120, and a processor 130.
  • The communication device 110 may be a hardware device implemented with various electronic circuits for transmitting and receiving signals via a wireless or wired connection; in embodiments, the communication device 110 may perform communication in a vehicle over CAN communication, or the like.
  • The storage 120 may store information (e.g., image data) obtained from the sensor module 210, data on which deep learning is performed by the processor 130, or the like. The storage 120 may include at least one type of a storage medium among a flash memory type of a memory, a hard disk type of a memory, a micro type of a memory, and a card type (e.g., a Secure Digital (SD) card or an eXtream Digital (XD) Card) of a memory, a Random Access Memory (RAM) type of a memory, a Static RAM (SRAM) type of a memory, a Read-Only Memory (ROM) type of a memory, a Programmable ROM (PROM) type of a memory, an Electrically Erasable PROM (EEPROM) type of a memory, an Magnetic RAM (MRAM) type of a memory, a magnetic disk type of a memory, and an optical disc type of a memory.
  • The processor 130 may be electrically connected to the communication device 110 and the storage 120, may electrically control each of the components, may be an electrical circuit that executes the commands of the software, and may perform various data processing and calculation described below. For example, the processor 130 may be an electronic control unit (ECU) or a sub-controller, which is mounted in the vehicle.
  • The processor 130 may extract the waveform of the vehicle water splashing occurring when the front vehicle is driving, based on the image data of the front vehicle obtained through the sensor module 210.
  • The processor 130 may determine or calculate the dangerousness based on at least one or more of the speed of the vehicle, a distance between the present vehicle and a point at which the water splashing of the front vehicle occurs, the height of the waveform of the vehicle water splashing, or the spreading width of the waveform of the vehicle water splashing.
  • The processor 130 may operate a learning algorithm (learning network) that learns the vehicle water splashing based on the image data of the front vehicle obtained through the sensor module 210, may input the image data of the front vehicle, which is obtained when the vehicle is driving, to the learning network, may determine the vehicle water splashing, and may determine the dangerousness. The learning network may generate dangerousness information according to the waveform of the vehicle water splashing based on the learned algorithm.
  • The processor 130 may allow the vehicle to continuously drive without a separate warning or action, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level; the processor 130 may perform a warning or vehicle control, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level.
  • The processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, or may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs. Alternatively, the processor 130 may output a warning sound or warning text, may provide a vehicle path for avoiding a point at which the vehicle water splashing occurs, and may transmit danger information due to the vehicle water splashing, to a nearby vehicle, when the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs.
  • The processor 130 may output a vehicle control message for providing a notification that the vehicle is automatically controlled, may perform vehicle control for avoiding the dangerousness due to the vehicle water splashing, and may transmit danger information due to the vehicle water splashing to a nearby vehicle to share the danger information with the nearby vehicle, when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is driving at a point at which the vehicle water splashing occurs.
  • The nearby vehicle may rapidly respond to the vehicle water splashing, by sharing information and dangerousness associated with a point at which the vehicle water splashing occurs, with a nearby vehicle.
  • The sensor module 210 may obtain image data at a periphery of a vehicle, may detect an object at a periphery of the vehicle to obtain detection information, and may transmit the obtained information to the apparatus 100 for responding to vehicle water splashing over CAN communication. That is, the sensor module 210 may be configured to sense information about nearby objects (e.g., a vehicle, a pedestrian, a bicycle, a motorcycle, or the like). The sensor module 210 may sense various pieces of information such as the location, speed and acceleration, direction, type, or the like of an external object. To this end, the sensor module 210 may include a camera, radar, a laser scanner, corner radar, an acceleration sensor, a yaw rate sensor, a torque measurement sensor, and/or a wheel speed sensor.
  • The sensor module 210 may include at least one or more sensor modules, and the at least one or more sensor modules may be mounted in the vehicle; the sensor module 210 may be installed on the front, side, or rear of the vehicle. FIG. 2 illustrates an example in which radars 301, 302, and 303 are mounted on the front side and both rear sides of the vehicle. At this time, the camera may include an MFC camera, a SVM camera, or the like.
  • The communication module 220 may communicate with nearby vehicles or peripheral communication devices and may perform wireless communication. The communication module 220 may perform V2X or V2V communication and may perform wireless communication. The communication module 220 may transmit and receive vehicle driving information, danger information, or the like to and from nearby vehicles to share the vehicle driving information, the danger information, or the like.
  • The warning device 230 may perform a warning such as notification of a dangerous situation due to the vehicle water splashing, or the like. The warning device 230 may have a configuration for performing visual, auditory, and tactile warnings, and may be implemented as a head-up display (HUD), a cluster, Audio Video Navigation (AVN), or the like.
  • The steering control device 240 may be configured to control the steering angle of the vehicle and may include a steering wheel, an actuator operating in conjunction with the steering wheel, and a controller for controlling the actuator.
  • The braking control device 250 may be configured to control the brake of the vehicle and may include a controller for controlling a brake.
  • The engine control device 260 may be configured to control the driving of the engine of a vehicle and may include a controller for controlling the speed of the vehicle.
  • As such, after learning the vehicle water splashing through a camera deep learning method (CNN), the water splashing image may be recognized or determined while the vehicle is driving, may determine the dangerousness in advance, and may respond to the dangerousness. Embodiments may implement a warning message, may induce vehicle path avoidance, and may share danger information with nearby vehicles, as a primary countermeasure. Furthermore, in embodiments, as a secondary countermeasure, a controller or other device of the vehicle may output a text message or voice message saying that the vehicle is autonomously controlled, may perform steering wheel steering, engine drive control, and brake control so as to identify nearby obstacles and to avoid the collision with nearby obstacles, and may transmit danger information to nearby vehicles to share the danger information with nearby vehicles, when the water splashing actually occurs.
  • FIG. 3 is a view of waveforms of various pieces of vehicle water splashing, according to an embodiment of the present disclosure. Referring to a water splashing image of a vehicle in 401, 402, 403, and 404 of FIG. 3, water splashing waveforms 411, 412, 413, and 414 occurring while a front vehicle is driving may be extracted. At this time, the apparatus 100 for responding to vehicle water splashing may determine dangerousness depending on the sizes of the water splashing waveforms 411, 412, 413, and 414.
  • FIG. 4 is a view for describing a deep learning method using a water splashing waveform of a vehicle, according to an embodiment of the present disclosure. Referring to FIG. 4, the apparatus 100 for responding to vehicle water splashing may input water splashing waveform information extracted in FIG. 3 to a learning network. After extracting a feature point, the apparatus 100 for responding to vehicle water splashing may perform classification based on the extracted feature point. For example, as illustrated in 413 of FIG. 3, the dangerousness may be classified depending on a height H and a spreading width W of the water splashing waveform of a vehicle. When the height and spreading width of the water splashing waveform 412 of a vehicle are very great or greater than a predetermined height and a predetermined width, the water splashing waveform 412 may be classified as the high dangerousness. When the spreading width of the water splashing waveform 411 of a vehicle are very small or smaller than a predetermined width, the water splashing waveform 411 may be classified as the low dangerousness.
  • FIG. 5 is a view of a warning output according to dangerousness of vehicle water splashing, according to an embodiment of the present disclosure. Referring to FIG. 5, the apparatus 100 for responding to vehicle water splashing may output a warning message through a cluster 601 and an AVN 602, when it is determined that dangerousness is higher than a predetermined level, based on the vehicle water splashing waveform of the current front vehicle.
  • Hereinafter, according to an embodiment of the present disclosure, a learning method according to a water splashing waveform of a vehicle will be described with reference to FIG. 6. FIG. 6 is a flowchart for describing a learning method according to a water splashing waveform of a vehicle, according to an embodiment of the present disclosure.
  • Hereinafter, it is assumed that the apparatus 100 for responding to vehicle water splashing of FIG. 1 performs the process of FIG. 6. In addition, as described in FIG. 6, it is understood that the operation described as being executed by the apparatus 100 is controlled by the processor 130 of the apparatus 100.
  • Referring to FIG. 6, in operation 5110, the apparatus 100 for responding to vehicle water splashing accumulates data associated with the vehicle water splashing of image data received from the sensor module 210. At this time, the sensor module 210 may transmit the image data to the apparatus 100 for responding to vehicle water splashing at a predetermined period or may provide the image data whenever an event (e.g., when it rains) occurs.
  • Afterward, in operation 5120, the apparatus 100 for responding to vehicle water splashing classifies a water splashing waveform from the accumulated image data indicating that the vehicle water splashing occurs; in operation 5130, the apparatus 100 for responding to vehicle water splashing performs learning through a deep learning algorithm for each waveform of water splashing.
  • As such, in operation 5140, the apparatus 100 for responding to vehicle water splashing generates and stores dangerousness information for each water splashing waveform as the learning result.
  • Hereinafter, according to an embodiment of the present disclosure, a method for responding to vehicle water splashing will be described with reference to FIG. 7. FIG. 7 is a flowchart for describing a method for responding to vehicle water splashing, according to an embodiment of the present disclosure. Hereinafter, it is assumed that the apparatus 100 for responding to vehicle water splashing of FIG. 1 performs the process of FIG. 7. In addition, as described in FIG. 7, it is understood that the operation described as being executed by the apparatus 100 is controlled by the processor 130 of the apparatus 100.
  • Referring to FIG. 7, after starting the driving of a vehicle in operation 5210, in operation 5220, the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, based on deep learning by applying the obtained image data to a learning algorithm. At this time, the apparatus 100 for responding to vehicle water splashing may determine whether the vehicle water splashing occurs, by using the speed at which the vehicle is moving, a distance between the present vehicle and a point at which the water splashing occurs, the height of the water splashing occurring by the front vehicle, the degree of horizontal spreading of the water splashing, the waveform of the water splashing, or the like.
  • In operation 5230, the apparatus 100 for responding to vehicle water splashing determines the dangerousness or degree of danger that is to be caused by the vehicle water splashing, when the vehicle water splashing occurs. That is, the apparatus 100 for responding to vehicle water splashing may determine that the dangerousness due to the vehicle water splashing is higher than a predetermined level, when the blind phenomenon occurs in front of the vehicle due to the vehicle water splashing or when there are obstacles, which can cause collisions, at a periphery of the vehicle.
  • In operation 5240, the apparatus 100 for responding to vehicle water splashing maintains the driving of the vehicle, when it is determined that the dangerousness or a degree of danger is lower than a predetermined level; in operation 5250, the apparatus 100 for responding to vehicle water splashing determines whether the vehicle water splashing is scheduled to occur, when it is determined that the dangerousness is higher than a predetermined level.
  • In operation 5260, the apparatus 100 for responding to vehicle water splashing outputs a warning message, induces the vehicle to drive a vehicle path such that the vehicle water splashing does not occur, transmits danger information to a nearby vehicle, and shares the danger information with the nearby vehicle, when the vehicle water splashing is scheduled to occur. For example, the apparatus 100 for responding to vehicle water splashing outputs a warning message in advance, induces the vehicle to drive on a vehicle path such that the vehicle avoids a point at which it is expected that the vehicle water splashing occurs, transmits the point at which it is expected that the vehicle water splashing occurs, to nearby vehicles, and shares the point with the nearby vehicles, when a vehicle speed is not greater than 60 km/h and the point at which it is expected that the vehicle water splashing occurs is a 80 m ahead. Accordingly, the apparatus 100 for responding to vehicle water splashing may allow the following vehicles to drive while avoiding the point at which it is expected that the vehicle water splashing occurs.
  • In the meantime, in operation 5270, the apparatus 100 for responding to vehicle water splashing outputs a vehicle control message saying that the vehicle is controlled to avoid the dangerous situation, to notify a user, performs steering control, engine driving control, and brake control to avoid the collision, transmits danger information to a nearby vehicle, and shares the danger information to the nearby vehicle, when the vehicle water splashing occurs currently. That is, the apparatus 100 for responding to vehicle water splashing may perform vehicle control so as to prevent a secondary accident, may output a vehicle control message to notify a user before performing the vehicle control or at the same time, may avoid the collision or may prevent the sudden brake, or the like by performing the vehicle control, and may allow the vehicle to drive at a safe distance from the front vehicle, when the vehicle water splashing currently occurs in the present vehicle. In addition, the apparatus 100 for responding to vehicle water splashing may notify a nearby vehicle (the following vehicle) of a point at which the water splashing occurs in the present vehicle to allow the nearby vehicle to drive while the nearby vehicle avoids the point at which the water splashing occurs.
  • As such, in case of rain, a controller or other device of the vehicle may determine or estimate the vehicle water splashing, may provide a warning, and may perform vehicle control so as to provide an avoidance path or to prevent the collision, and thus it is possible to drive a vehicle safely.
  • FIG. 8 illustrates a computing system according to an embodiment of the present disclosure.
  • Referring to FIG. 8, a computing system 1000 may include at least one processor 1100, a memory 1300, a user interface input device 1400, a user interface output device 1500, storage 1600, and a network interface 1700, which are connected with each other via a bus 1200.
  • The processor 1100 may be a central processing unit (CPU) or a semiconductor device that processes instructions stored in the memory 1300 and/or the storage 1600. Each of the memory 1300 and the storage 1600 may include various types of volatile or nonvolatile storage media. For example, the memory 1300 may include a read only memory (ROM) and a random access memory (RAM).
  • Thus, the operations of the methods or algorithms described in connection with the embodiments disclosed in the specification may be directly implemented with a hardware module, a software module, or a combination of the hardware module and the software module, which is executed by the processor 1100. The software module may reside on a storage medium (i.e., the memory 1300 and/or the storage 1600) such as a RAM, a flash memory, a ROM, an erasable and programmable ROM (EPROM), an electrically EPROM (EEPROM), a register, a hard disc, a removable disc, or a compact disc-ROM (CD-ROM).
  • The storage medium may be coupled to the processor 1100. The processor 1100 may read out information from the storage medium and may write information in the storage medium. Alternatively, the storage medium may be integrated with the processor 1100. The processor and storage medium may reside in an application specific integrated circuit (ASIC). The ASIC may reside in a user terminal. Alternatively, the processor and storage medium may reside as a separate component in the user terminal.
  • Hereinabove, although the present disclosure has been described with reference to embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and altered by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure claimed in the following claims.
  • Therefore, embodiments of the present disclosure are not intended to limit the technical spirit of the present disclosure, but provided only for the illustrative purpose. The scope of protection of the present disclosure should be construed by the attached claims, and all equivalents thereof should be construed as being included within the scope of the present disclosure.
  • According to embodiments, the vehicle may predict and respond to the vehicle water splashing to increase the reliability of the vehicle system and to allow a user to drive the vehicle safely, thereby enhancing the user's convenience.
  • In addition, the ego vehicle may share information about the vehicle water splashing with other vehicles, thereby increasing a safe driving effect during autonomous driving.
  • Besides, a variety of effects directly or indirectly understood through this disclosure may be provided.
  • Logical blocks, modules or units described in connection with embodiments disclosed herein can be implemented or performed by a computing device having at least one processor, at least one memory and at least one communication interface. The elements of a method, process, or algorithm described in connection with embodiments disclosed herein can be embodied directly in hardware, in a software module executed by at least one processor, or in a combination of the two. Computer-executable instructions for implementing a method, process, or algorithm described in connection with embodiments disclosed herein can be stored in a non-transitory computer readable storage medium.
  • Hereinabove, although the present disclosure has been described with reference to embodiments and the accompanying drawings, the present disclosure is not limited thereto, but may be variously modified and altered by those skilled in the art to which the present disclosure pertains without departing from the spirit and scope of the present disclosure claimed in the following claims.

Claims (20)

What is claimed is:
1. An apparatus for responding to vehicle water splashing, the apparatus comprising:
a processor, wherein the processor is configured to:
determine, based on image data of a nearby vehicle, whether vehicle water splashing occurs, and
determine dangerousness caused by the vehicle water splashing to perform vehicle control when determined the vehicle water splashing occurs; and
storage configured to store information determined by the processor and the image data of the nearby vehicle.
2. The apparatus of claim 1, further comprising:
a communication device configured to transmit and receive information indicating that the vehicle water splashing occurs, to and from the nearby vehicle.
3. The apparatus of claim 1, wherein the processor is configured to:
extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
4. The apparatus of claim 3, wherein the processor is configured to:
determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
5. The apparatus of claim 4, wherein the processor is configured to:
operate a learning network that learns the vehicle water splashing, based on the image data of the front vehicle;
input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine whether the vehicle water splashing occurs; and
determine the dangerousness.
6. The apparatus of claim 4, wherein the processor is configured to:
control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level.
7. The apparatus of claim 4, wherein when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs, the processor is configured to:
output a warning sound or a warning text;
provide a vehicle path for avoiding the point at which the vehicle water splashing occurs; or
transmit danger information due to the vehicle water splashing to the nearby vehicle.
8. The apparatus of claim 4, wherein when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is driving at a point at which the vehicle water splashing occurs, the processor is configured to:
output a vehicle control message for providing a notification of performing automatic vehicle control; and
perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing.
9. The apparatus of claim 8, wherein when the result of determining the dangerousness indicates that the dangerousness is higher than the predetermined level and the present vehicle is driving at the point at which the vehicle water splashing occurs, the processor is further configured to:
transmit danger information due to the vehicle water splashing to the nearby vehicle.
10. A vehicle system comprising:
at least a sensor module configured to obtain image data and driving information of a nearby vehicle; and
an apparatus for responding to vehicle water splashing, wherein the apparatus for responding to the vehicle water splashing is configured to:
determine, based on the image data of the nearby vehicle, whether vehicle water splashing occurs; and
determine dangerousness caused by the vehicle water splashing to perform vehicle control when determined that the vehicle water splashing occurs.
11. The vehicle system of claim 10, wherein the apparatus for responding to the vehicle water splashing is configured to:
extract a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
12. The vehicle system of claim 11, wherein the apparatus for responding to the vehicle water splashing is configured to:
determine the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
13. The vehicle system of claim 11, wherein the apparatus for responding to the vehicle water splashing includes a learning network that learns the vehicle water splashing, based on the image data of the front vehicle, and
wherein the apparatus for responding to vehicle water splashing is configured to:
input the image data of the front vehicle obtained in vehicle driving, to the learning network to determine whether the vehicle water splashing occurs; and
determine the dangerousness.
14. The vehicle system of claim 13, wherein the apparatus for responding to vehicle water splashing is configured to:
control vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level, and
wherein when the dangerousness is higher than a predetermined level and a present vehicle is scheduled to drive at a point at which the vehicle water splashing occurs, the apparatus for responding to the vehicle water splashing is configured to:
output a warning sound or a warning text;
provide a vehicle path for avoiding the point at which the vehicle water splashing occurs; or
transmit danger information due to the vehicle water splashing to the nearby vehicle.
15. The vehicle system of claim 14, wherein when the result of determining the dangerousness indicates that the dangerousness is higher than a predetermined level and the present vehicle is driving at the point at which the vehicle water splashing occurs, the apparatus for responding to the vehicle water splashing is configured to:
output a vehicle control message for providing a notification of performing automatic vehicle control;
perform the vehicle control for avoiding the dangerousness due to the vehicle water splashing; and
transmit the danger information due to the vehicle water splashing to the nearby vehicle.
16. A method for responding to vehicle water splashing, the method comprising:
obtaining image data and driving information of a nearby vehicle;
determining, based on the image data of the nearby vehicle, whether vehicle water splashing occurs; and
determining dangerousness caused by the vehicle water splashing to perform vehicle control when determined that the vehicle water splashing occurs.
17. The method of claim 16, wherein the determining of the vehicle water splashing includes:
extracting a waveform of the vehicle water splashing occurring when a front vehicle is driving, based on image data of the front vehicle among the nearby vehicle.
18. The method of claim 17, wherein the determining of the vehicle water splashing includes:
determining the dangerousness based on at least one or more of vehicle speed, a distance between a present vehicle and a point at which water splashing of the front vehicle occurs, a height of the waveform of the vehicle water splashing, or a spreading width of the waveform of the vehicle water splashing.
19. The method of claim 16, wherein the performing of the vehicle control includes:
controlling vehicle driving to be continued, when the result of determining the dangerousness indicates that the dangerousness is lower than a predetermined level, and
wherein the performing of the vehicle control includes:
when the dangerousness is higher than the predetermined level and a present vehicle is scheduled to drive at the point at which the vehicle water splashing occurs,
outputting a warning sound or a warning text;
providing a vehicle path for avoiding the point at which the vehicle water splashing occurs; or
transmitting danger information due to the vehicle water splashing to the nearby vehicle.
20. The method of claim 19, wherein when the result of determining the dangerousness indicates that the dangerousness is higher than the predetermined level and the present vehicle is driving at the point at which the vehicle water splashing occurs, the performing of the vehicle control includes:
outputting a vehicle control message for providing a notification of performing automatic vehicle control;
performing the vehicle control for avoiding the dangerousness due to the vehicle water splashing; and
transmitting the danger information due the vehicle water splashing to the nearby vehicle.
US16/232,906 2018-10-16 2018-12-26 Apparatus for responding to vehicle water splashing, system having the same and method thereof Active 2039-03-29 US11027727B2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2018-0123047 2018-10-16
KR1020180123047A KR102529918B1 (en) 2018-10-16 2018-10-16 Apparatus for splashing water of vehicle, system having the same and method thereof

Publications (2)

Publication Number Publication Date
US20200114908A1 true US20200114908A1 (en) 2020-04-16
US11027727B2 US11027727B2 (en) 2021-06-08

Family

ID=70162428

Family Applications (1)

Application Number Title Priority Date Filing Date
US16/232,906 Active 2039-03-29 US11027727B2 (en) 2018-10-16 2018-12-26 Apparatus for responding to vehicle water splashing, system having the same and method thereof

Country Status (3)

Country Link
US (1) US11027727B2 (en)
KR (1) KR102529918B1 (en)
CN (1) CN111055848B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220157067A1 (en) * 2019-03-15 2022-05-19 Car.Software Estonia As Determining a source of danger on a roadway

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113771855B (en) * 2021-09-02 2023-06-20 东风汽车集团股份有限公司 Vehicle wading control method, device and system, terminal equipment and medium
CN114320075A (en) * 2022-01-27 2022-04-12 重庆长安汽车股份有限公司 Automatic window closing system and method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170161573A1 (en) * 2015-12-03 2017-06-08 GM Global Technology Operations LLC Vision-based wet road surface condition detection using tire side splash
US20180022278A1 (en) * 2016-07-19 2018-01-25 GM Global Technology Operations LLC System and method for enhancing vehicle environment perception
US20180060676A1 (en) * 2015-05-06 2018-03-01 Continental Teves Ag & Co. Ohg Method and device for detecting and evaluating environmental influences and road condition information in the vehicle surroundings

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008179251A (en) * 2007-01-24 2008-08-07 Toyota Motor Corp Traveling support device for vehicle and traveling support method for vehicle
JP5408240B2 (en) * 2011-12-12 2014-02-05 株式会社デンソー Warning system, vehicle device, and server
DE102012112724A1 (en) * 2012-12-20 2014-06-26 Continental Teves Ag & Co. Ohg Method for determining a road condition from environmental sensor data
US9428194B2 (en) * 2014-12-11 2016-08-30 Toyota Motor Engineering & Manufacturing North America, Inc. Splash condition detection for vehicles
KR102366402B1 (en) * 2015-05-21 2022-02-22 엘지전자 주식회사 Driver assistance apparatus and control method for the same
US9972206B2 (en) * 2015-12-03 2018-05-15 GM Global Technology Operations LLC Wet road surface condition detection
US20180286246A1 (en) * 2017-03-31 2018-10-04 Intel Corporation Sensor-derived road hazard detection and reporting
DE102017010746A1 (en) * 2017-11-21 2018-07-12 Daimler Ag Method for avoiding a vehicle

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180060676A1 (en) * 2015-05-06 2018-03-01 Continental Teves Ag & Co. Ohg Method and device for detecting and evaluating environmental influences and road condition information in the vehicle surroundings
US20170161573A1 (en) * 2015-12-03 2017-06-08 GM Global Technology Operations LLC Vision-based wet road surface condition detection using tire side splash
US20180022278A1 (en) * 2016-07-19 2018-01-25 GM Global Technology Operations LLC System and method for enhancing vehicle environment perception

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20220157067A1 (en) * 2019-03-15 2022-05-19 Car.Software Estonia As Determining a source of danger on a roadway

Also Published As

Publication number Publication date
KR20200042661A (en) 2020-04-24
KR102529918B1 (en) 2023-05-08
US11027727B2 (en) 2021-06-08
CN111055848A (en) 2020-04-24
CN111055848B (en) 2024-07-26

Similar Documents

Publication Publication Date Title
CN110406533B (en) Lane keeping assist system and method for improving safety of longitudinal control of front vehicle follower
KR102417905B1 (en) Apparatus and method for controlling platooning of leading vehicle
CN107433946B (en) Apparatus and method for controlling lane change considering priority
US9099006B2 (en) Context-aware threat response arbitration
CN108216220B (en) Apparatus and method for boundary-based vehicle collision control
JP6441959B2 (en) Reduce false alarms using location data
US9196163B2 (en) Driving support apparatus and driving support method
KR102406522B1 (en) Apparatus for controlling platooning based-on weather environment, system having the same and method thereof
JP6575492B2 (en) Automated driving system
US11427166B2 (en) Adaptive AEB system considering steerable path and control method thereof
JP2010083312A (en) Vehicle drive assist system
KR20190074025A (en) Apparatus and method for deciding maneuver of peripheral vehicle
KR20210014433A (en) Apparatus for controlling platooning driving of vehicle, system having the same and method thereof
US11027727B2 (en) Apparatus for responding to vehicle water splashing, system having the same and method thereof
KR102598953B1 (en) Apparatus for controlling a vehicle, system having the same and method thereof
JP2024091753A (en) Method for restricting accident risk and control equipment
US20190317492A1 (en) Apparatus and method for providing safety strategy in vehicle
US11891056B2 (en) Device and method for improving assistance systems for lateral vehicle movements
KR20220023528A (en) Apparatus and method for controlling platooning information of vehicle
CN115465283A (en) Adaptive trust calibration
US20220363291A1 (en) Autonomous driving system, autonomous driving control method, and nontransitory storage medium
JP6193177B2 (en) Motion support system and object recognition device
JP2019025932A (en) Traveling control device for vehicle
US20230135702A1 (en) Apparatus for controlling autonomous driving and method thereof
KR20210069782A (en) Apparatus for controlling platooning and method thereof

Legal Events

Date Code Title Description
AS Assignment

Owner name: KIA MOTORS CORPORATION, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIM, JUNG HO;REEL/FRAME:047854/0976

Effective date: 20181130

Owner name: HYUNDAI MOTOR COMPANY, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:LIM, JUNG HO;REEL/FRAME:047854/0976

Effective date: 20181130

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT RECEIVED

STPP Information on status: patent application and granting procedure in general

Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED

STCF Information on status: patent grant

Free format text: PATENTED CASE