[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

GB2401270A - Fog detection system - Google Patents

Fog detection system Download PDF

Info

Publication number
GB2401270A
GB2401270A GB0309749A GB0309749A GB2401270A GB 2401270 A GB2401270 A GB 2401270A GB 0309749 A GB0309749 A GB 0309749A GB 0309749 A GB0309749 A GB 0309749A GB 2401270 A GB2401270 A GB 2401270A
Authority
GB
United Kingdom
Prior art keywords
video camera
detection
activation signal
fog
output signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
GB0309749A
Inventor
Yona Newman
Avi Azaria
Nissim Cohen-Matzliah
Carol Ronen
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Motorola Solutions Inc
Original Assignee
Motorola Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Motorola Inc filed Critical Motorola Inc
Priority to GB0309749A priority Critical patent/GB2401270A/en
Publication of GB2401270A publication Critical patent/GB2401270A/en
Withdrawn legal-status Critical Current

Links

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R1/00Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/20Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
    • B60R1/30Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles providing vision in the non-visible spectrum, e.g. night or infrared vision
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H04N23/21Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from near infrared [NIR] radiation
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/10Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used
    • B60R2300/106Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of camera system used using night vision cameras
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/30Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the type of image processing
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/40Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components
    • B60R2300/404Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the details of the power supply or the coupling to vehicle components triggering from stand-by mode to operation mode
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R2300/00Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle
    • B60R2300/80Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement
    • B60R2300/8053Details of viewing arrangements using cameras and displays, specially adapted for use in a vehicle characterised by the intended use of the viewing arrangement for bad weather conditions or night vision

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Mechanical Engineering (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Traffic Control Systems (AREA)

Abstract

A system to assist driving in fog, comprising a vehicle fitted with at least a first controller 120, the system being characterised by a video camera 110 responsive in at least the near infra-red spectrum in the absence of dedicated infra-red illumination, operably coupled to at least said first controller. Additionally, means to analyse the video camera output signal to detect the presence of fog, means to provide an activation signal within the controller upon detection of fog and means to display the video camera output signal within the visible spectrum dependent upon the activation signal.

Description

A System To Assist Driving In Fog
Technical Field
The invention relates to a system to assist driving in fog.
Background
Military vehicles have in the past been equipped with night-vision systems utilising active and passive infra-red detectors to assist in driving visibility.
However, such systems are both highly costly and in general inapplicable to civil vehicles, typically requiring specialist headgear or viewing methods incompatible with normal road use.
Civilian in-vehicle camera systems most often concern security (Automobile Camera System - US 2003/0041329 A1) or awareness of the vehicle's extremities for manocuvring purposes (Vehicle Imaging Apparatus And Rear View Mirror - US 2003/0040851 A1).
US 2002/0172400 A1 (Gloger) 'Process and device for improving the visibility in vehicles' discusses a vision processing system that receives images in infra-red, classifies them into particular objects, and then translates these into images in the visual spectrum corresponding to the user's normal perception of that object.
Other civil systems typically involve fixed cameras for traffic reporting purposes, coupled to traffic control centres that may warn drivers of adverse conditions ahead via radio bulletins, data transmission or roadside displays.
: À c: : : - À Whilst such warnings are clearly of value, they do not provide the driver with analysis concerning their immediate surroundings.
Summary of the Invention
For the case of foggy driving conditions, the inventors of the current invention have found that it is not necessary to utilise dedicated infrared vision systems or third party remote data. They have appreciated that the COD (Charge Coupled Device), CMOS (Complementary Metal Oxide Silicon) or equivalent sensors within commercial standard video cameras in fact have sufficient responsiveness in the near infra-red to provide reasonable images within fog, and have exploited this property by operably coupling such a video camera to an in-vehicle controller capable of analysing such images. This analysis enables the detection of fog to be used to activate functions within the vehicle that may assist in foggy conditions.
This system in accordance with the present invention provides a low-cost aid to driving visibility, and in addition to domestic and commercial vehicles is particularly suited to public service vehicles such as police cars, ambulances and fire engines, which are frequently required to attend emergencies precipitated by such foggy conditions.
In a first aspect, the invention provides a system to assist driving in fog, as claimed in claim 1.
In a second aspect, the invention provides a method of assisting driving in fog, as claimed in claim 12.
Aft.. : ces es: À: À À. :e...: À . À Further features of the present invention are as claimed in the dependent claims.
Embodiments of the present invention will now be described by way of example with reference to the accompanying drawings, in which:
Brief description of the drawings
FIG. 1 is a block diagram of a system in accordance with an embodiment of the present invention.
Detailed description
In accordance with an embodiment of the invention, a system to assist driving visibility in fog includes a video camera 110, which may be a standard commercial video camera, operably coupled to a controller 120, such as, for example, that provided within the Motorola MW800 in-car computer system that comprises a PC processor, user interface 150 and display 130.
A preferred embodiment of the present invention exploits the observation that the video camera imaging systems of many common commercial video cameras are sufficiently responsive within the near infra-red electromagnetic spectrum, in the absence of additional infra-red illumination, to provide reasonable images in foggy conditions.
Upon detection of fog the output signal from the aforesaid video camera 110 may be adapted to take either or both of the following forms in a suitable in-vehicle display; i) Picture-in-picture; ii) Full screen. À . . À À À À
The user (typically the driver, but plausibly a passenger with whom the navigation role is shared) may select between the picture-in-picture and full screen modes and select which of any available displays to use.
Whilst in many situations the user may wish to have manual control over the activation of display and other dependent features as defined in the present invention, for emergency and other public service vehicles where the user may already be occupied with radio, GPS and other on-board systems, it is desirable from a safety perspective that the system also be capable of automatic activation upon the detection of fog.
Consequently a preferred embodiment of the present invention employs one or more of the following detection system, based upon analysis of any of a plurality of images generated by the video camera output signal: In a first automatic activation system, automatic activation is requested upon detection by a software algorithm within the controller of a change in spectral characteristics of an image generated by the video camera output signal corresponding to water molecule spectral absorption, such as for example the 'Fog Product', based upon differences between light measurements at 10.7 microns, and 3.9 microns (See www.cira.colostate. edu/ramm/goes39/toc.htm or www.gisdevelopment. net/aars/acrs/1997/ts3/ts3004.shtml, both available online as at 16th April 2003).
Additional considerations should be applied to this first system; for example, natural light may demonstrate such characteristic changes if the vehicle drives under cloud : À À À I- ct. - . cover. Thus in an enhanced embodiment of the present invention, a general spectral analysis of an image is biased to favour characteristic spectral changes to artificial light sources within said image, such as those of oncoming vehicle headlights.
In a second automatic activation system, automatic activation is requested upon detection by a software algorithm within the controller of the characteristic halo seen around light sources in foggy conditions, within an image generated by the video camera output signal.
In a third automatic activation system, automatic activation is requested upon detection by a software algorithm within the controller of a reduction in contrast ratio within an image or region thereof generated by the video camera output signal. This may be achieved by a number of known methods, such as: i) Luminance histogram analysis (where a reduction in contrast narrows the distribution of the luminance histogram) ; ii) ROB balance analysis (A mean convergence of Red, Green and Blue colour values indicating a whitening of the image) if colour output is available; or iii) Edge gradient detection (where the rate of change of luminosity at the edges of objects within an image is reduced by fog).
In any of the above automatic activation systems a detection confidence measure may be indicated, that may be combined with those of any other automatic activation systems and/or with other metrics such as overall luminosity within the output of the video camera, or other vehicle system states such as whether the user has turned ::. cece eee. cee. A. ::. À
on the vehicle's lights, moisture sensitive windshields or changes of outside temperature.
The individual or combined measures may then be used or accumulated in assessing the request for automatic activation, which may be subject to additional constraints such as a short activation/deactivation time delay to discount transitory effects such as condensed water vapour from the exhaust gases of a vehicle in front of the video camera.
Upon a successful request for automatic activation, an activation signal is provided to the display by the controller.
In an embodiment of the present invention, the activation signal is also provided as input to the control of other in-vehicle systems, such as screen de-misters, air conditioning, and fog lights.
In an embodiment of the present invention, image enhancement may be provided to improve image clarity for analysis and any subsequent display to the user.

Claims (17)

  1. ::e ce À cee. ceee. ce e. ::e À Claims 1. A system to assist driving in
    fog, comprising a vehicle fitted with at least a first controller (120), the system being characterized by; a video camera (110) responsive in at least the near infra-red spectrum in the absence of dedicated infra-red illumination, operably coupled to at least said first controller; means to analyse the video camera output signal to detect the presence of fog; means to provide an activation signal within the controller upon detection of fog; and means to display the video camera output signal within the visible spectrum dependent upon the activation signal.
  2. 2. A system according to claim 1, wherein an output signal from the video camera (110) may be adapted to provide a displayed image on at least a first in-vehicle display unit (130) in either or both of the following forms; i) Picture-in-picture; ii) Full screen.
  3. 3. A system according to claim 2, which is operable such that a user may select via an interface (150) those of the available forms of output and those of the available displays to use.
  4. 4. A system according to any one of the preceding claims, which is operable whereby an activation signal is requested upon detection of a change in spectral characteristics corresponding to water molecule spectral absorption within ::e À. À. c.. ce. ::. À -
    a selected region or regions of an image generated by an output signal from the video camera.
  5. 5. A system according to any one of the preceding claims, which is operable whereby an activation signal is requested upon detection of a reduction in image contrast ratio within a selected region or regions of an image generated by an output signal from the video camera.
  6. 6. A system according to any one of the preceding claims, which is operable whereby an activation signal is requested upon detection of the characteristic halo seen around light sources in foggy conditions within a selected region or regions of an image generated by an output signal from the video camera.
  7. 7. A system according to any one of claims 4 to 6 where) a detection confidence indicator is a component of the request, and confidences derived from different detection methods may be combined in assessing requests for an activation signal.
  8. 8. A system according to any one of the preceding claims, wherein generating an activation signal requires the detection of fog to persist beyond a predetermined duration.
  9. 9. A system according to any one of the preceding claims, which is operable whereby an activation signal is available as input to the control of further systems.
  10. 10. A system according to claim 9, wherein an activation signal is available as input to the control of any or all of the following invehicle systems; ::. .' À I 'te. ce À. ::. À
    i) Screen de-misters; ii) Air conditioning; and iii) Fog lights.
  11. 11. A system according to any of the above claims, wherein the vehicle is any of: i) a private vehicle; ii) a commercial vehicle; and iii) a public service vehicle.
  12. 12. A method of assisting driving in fog, comprising the provision of at least a first controller (120) within a vehicle, further characterized by; operably coupling to the controller a video camera (110) responsive in the near infra-red spectrum in the absence of dedicated infra-red illumination; analysing the video camera output signal to detect the presence of fog; providing an activation signal upon the detection of fog; and displaying the video camera output signal within the visible spectrum upon dependent upon the activation signal;
  13. 13. A method according to claim 12, wherein is requested upon detection of a change in spectral characteristics corresponding to water molecule spectral absorption within a selected region or regions of an image generated by an output signal from the video camera.
  14. 14. A method according to claim 12 or claim 13, wherein an activation signal is requested upon detection of a reduction in image contrast ratio within a selected region or regions of an image generated by an output signal from the video camera.
    a À À - À
  15. 15. A method according to any one of claims 12 to 14, wherein an activation signal is requested upon detection of the characteristic halo seen around light sources in foggy conditions within a selected region or regions of an image generated by an output signal from the video camera.
  16. 16. A method according to any one of claims 12 to 15, wherein generating an activation signal requires the detection of fog to persist beyond a predetermined duration.
  17. 17. A system substantially according to claim 1 and substantially as hereinbefore described with reference to the accompanying drawing.
GB0309749A 2003-04-29 2003-04-29 Fog detection system Withdrawn GB2401270A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
GB0309749A GB2401270A (en) 2003-04-29 2003-04-29 Fog detection system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
GB0309749A GB2401270A (en) 2003-04-29 2003-04-29 Fog detection system

Publications (1)

Publication Number Publication Date
GB2401270A true GB2401270A (en) 2004-11-03

Family

ID=33155758

Family Applications (1)

Application Number Title Priority Date Filing Date
GB0309749A Withdrawn GB2401270A (en) 2003-04-29 2003-04-29 Fog detection system

Country Status (1)

Country Link
GB (1) GB2401270A (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2406732A (en) * 2003-10-02 2005-04-06 Daimler Chrysler Ag Controlling switching of display of vehicle surroundings
WO2007081407A1 (en) * 2005-09-08 2007-07-19 Gentex Corporation Automotive vehicle image sensor
WO2009052912A1 (en) * 2007-10-23 2009-04-30 Daimler Ag Method and device for controlling a night-vision system and a headlight of a vehicle
CN103297750A (en) * 2013-04-12 2013-09-11 济南金宇源光电子有限公司 High definition laser fog-passing night vision evidence obtaining system
CN105578121A (en) * 2014-10-16 2016-05-11 广东中星电子有限公司 Outdoor network video monitoring equipment, control platform and video image processing method thereof
US20220161762A1 (en) * 2019-03-20 2022-05-26 Koito Manufacturing Co., Ltd. Sensor system
US20230174091A1 (en) * 2020-05-12 2023-06-08 C.R.F. Societa' Consortile Per Azioni Motor-vehicle driving assistance in low meteorological visibility conditions, in particular with fog

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1142910A (en) * 1966-07-12 1969-02-12 Luc Payet Apparatus for improving the visibility in motor vehicles
JPS6215480A (en) * 1985-07-15 1987-01-23 Nippon Soken Inc Fog detecting device for vehicle
US5349267A (en) * 1992-03-31 1994-09-20 Valeo Vision Lighting and/or indicating apparatus for use in foggy conditions
JPH11278182A (en) * 1998-03-31 1999-10-12 Nissan Motor Co Ltd Fog status detection device for vehicle
JP2000215398A (en) * 1999-01-26 2000-08-04 Mazda Motor Corp Circumstance information notifying device for vehicle
JP2001283394A (en) * 2000-03-30 2001-10-12 Toshiba Corp Vehicle drive visibility aiding device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB1142910A (en) * 1966-07-12 1969-02-12 Luc Payet Apparatus for improving the visibility in motor vehicles
JPS6215480A (en) * 1985-07-15 1987-01-23 Nippon Soken Inc Fog detecting device for vehicle
US5349267A (en) * 1992-03-31 1994-09-20 Valeo Vision Lighting and/or indicating apparatus for use in foggy conditions
JPH11278182A (en) * 1998-03-31 1999-10-12 Nissan Motor Co Ltd Fog status detection device for vehicle
JP2000215398A (en) * 1999-01-26 2000-08-04 Mazda Motor Corp Circumstance information notifying device for vehicle
JP2001283394A (en) * 2000-03-30 2001-10-12 Toshiba Corp Vehicle drive visibility aiding device

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2406732A (en) * 2003-10-02 2005-04-06 Daimler Chrysler Ag Controlling switching of display of vehicle surroundings
GB2406732B (en) * 2003-10-02 2005-11-30 Daimler Chrysler Ag Device for improving the visibility conditions in a motor vehicle
WO2007081407A1 (en) * 2005-09-08 2007-07-19 Gentex Corporation Automotive vehicle image sensor
US7417221B2 (en) 2005-09-08 2008-08-26 Gentex Corporation Automotive vehicle image sensor
WO2009052912A1 (en) * 2007-10-23 2009-04-30 Daimler Ag Method and device for controlling a night-vision system and a headlight of a vehicle
CN103297750A (en) * 2013-04-12 2013-09-11 济南金宇源光电子有限公司 High definition laser fog-passing night vision evidence obtaining system
CN105578121A (en) * 2014-10-16 2016-05-11 广东中星电子有限公司 Outdoor network video monitoring equipment, control platform and video image processing method thereof
CN105578121B (en) * 2014-10-16 2019-10-18 广东中星电子有限公司 Outdoor Network video monitoring equipment, control platform and its method of video image processing
US20220161762A1 (en) * 2019-03-20 2022-05-26 Koito Manufacturing Co., Ltd. Sensor system
US20230174091A1 (en) * 2020-05-12 2023-06-08 C.R.F. Societa' Consortile Per Azioni Motor-vehicle driving assistance in low meteorological visibility conditions, in particular with fog

Similar Documents

Publication Publication Date Title
US10694262B1 (en) Overlaying ads on camera feed in automotive viewing applications
US6424272B1 (en) Vehicular blind spot vision system
US6496117B2 (en) System for monitoring a driver's attention to driving
CN108621943B (en) System and method for dynamically displaying images on a vehicle electronic display
US20060257024A1 (en) Method and device for visualizing the surroundings of a vehicle
JP2006350617A (en) Vehicle driving support apparatus
US20180015879A1 (en) Side-view mirror camera system for vehicle
JP2008230558A (en) Vehicle periphery monitoring device
JP6705335B2 (en) Vehicle display control device and vehicle driving assist system
US11238834B2 (en) Method, device and system for adjusting image, and computer readable storage medium
US20190126831A1 (en) Irms ar object detection and classification
CN108791062A (en) Dynamic information system and operating method
CN112119398A (en) Method and device for operating a camera-monitor system of a motor vehicle
US10882451B2 (en) Apparatus for providing vehicular environment information
GB2401270A (en) Fog detection system
CN113183758A (en) Auxiliary driving method and system based on augmented reality
US20060061461A1 (en) Vehicle speed limit reminding device
US11670005B2 (en) Low-light camera occlusion detection
CN112166433B (en) Method for detecting a marker light
Tsimhoni et al. Pedestrian detection with night vision systems enhanced by automatic warnings
JP2017040773A (en) Head-mounted display device
TWM586439U (en) Vehicle rear guidance imaging system
WO2024024537A1 (en) Information processing device, information processing method, and information processing system
US20190381936A1 (en) Device for assisting night-time road navigation
JP7570164B2 (en) DISPLAY CONTROL DEVICE, DISPLAY CONTROL SYSTEM, AND DISPLAY CONTROL METHOD

Legal Events

Date Code Title Description
WAP Application withdrawn, taken to be withdrawn or refused ** after publication under section 16(1)