[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

USRE47834E1 - Method, apparatus and system for detecting narrow road - Google Patents

Method, apparatus and system for detecting narrow road Download PDF

Info

Publication number
USRE47834E1
USRE47834E1 US15/655,411 US201715655411A USRE47834E US RE47834 E1 USRE47834 E1 US RE47834E1 US 201715655411 A US201715655411 A US 201715655411A US RE47834 E USRE47834 E US RE47834E
Authority
US
United States
Prior art keywords
road
vehicle
points
boundary point
driving
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
US15/655,411
Inventor
Ki Cheol Shin
Chang Jae Lee
Ee Suk Jung
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hyundai Motor Co
Kia Corp
Original Assignee
Hyundai Motor Co
Kia Motors Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hyundai Motor Co, Kia Motors Corp filed Critical Hyundai Motor Co
Priority to US15/655,411 priority Critical patent/USRE47834E1/en
Assigned to KIA MOTORS CORPORATION, HYUNDAI MOTOR COMPANY reassignment KIA MOTORS CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HYUNDAI MOTOR COMPANY
Application granted granted Critical
Publication of USRE47834E1 publication Critical patent/USRE47834E1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06Road conditions
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W30/00Purposes of road vehicle drive control systems not related to the control of a particular sub-unit, e.g. of systems using conjoint control of vehicle sub-units
    • B60W30/10Path keeping
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W40/00Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models
    • B60W40/02Estimation or calculation of non-directly measurable driving parameters for road vehicle drive control systems not related to the control of a particular sub unit, e.g. by using mathematical models related to ambient conditions
    • B60W40/06Road conditions
    • B60W40/072Curvature of the road
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/02Systems using the reflection of electromagnetic waves other than radio waves
    • G01S17/06Systems determining position data of a target
    • G01S17/42Simultaneous measurement of distance and other co-ordinates
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88Lidar systems specially adapted for specific applications
    • G01S17/93Lidar systems specially adapted for specific applications for anti-collision purposes
    • G01S17/931Lidar systems specially adapted for specific applications for anti-collision purposes of land vehicles
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2420/00Indexing codes relating to the type of sensors based on the principle of their operation
    • B60W2420/40Photo, light or radio wave sensitive means, e.g. infrared sensors
    • B60W2420/408Radar; Laser, e.g. lidar
    • B60W2420/52
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2520/00Input parameters relating to overall vehicle dynamics
    • B60W2520/10Longitudinal speed
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2540/00Input parameters relating to occupants
    • B60W2540/18Steering angle
    • B60W2550/146
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00Input parameters relating to infrastructure
    • B60W2552/20Road profile, i.e. the change in elevation or curvature of a plurality of continuous road segments
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W2552/00Input parameters relating to infrastructure
    • B60W2552/30Road curve radius
    • G01S17/936

Definitions

  • the present inventive concept relates to a method, an apparatus, and a system for detecting a narrow road.
  • the ADAS is a system which senses dangerous situations occurring while driving a vehicle by using sensors mounted in a vehicle and cope with the dangerous situations to assure driver's safety and provide convenience to the driver.
  • a driver When driving a vehicle on a protruding narrow road, a driver may not differentiate a road boundary well, such that it is difficult for the driver to drive a vehicle and the risk of accidents is increased.
  • One object to be achieved by the present inventive concept is to provide a method, an apparatus, and a system for detecting a narrow road. Another object to be achieved by the present inventive concept is to provide a computer readable recording medium in which a program for allowing a computer to execute the method is recorded.
  • the technical problem to be solved by an exemplary embodiment of the present inventive concept is not limited to the technical problems as described above, and therefore other technical problems may be present.
  • One aspect of the present inventive concept relates to a method for detecting a narrow road, including receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of vehicle meets a ground. A relative height of the points from the distance measuring sensor to the ground is calculated based on the distance information. A left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal, are acquired. A road boundary line of a driving road of the vehicle is acquired based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. A road width of the driving road is calculated based on the road boundary line of the driving road. It is detected that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width.
  • Another aspect of the present inventive concept encompasses a computer readable recording medium including computer executable instructions which control a processor to perform the method for detecting a narrow road.
  • Still another aspect of the present inventive concept relates to an apparatus for detecting a narrow road, including a relative height calculation unit, a protruding determination unit, a road boundary line acquisition unit, a road width calculation unit, and a narrow road detection unit.
  • the relative height calculation unit is configured to calculate relative heights of points from a distance measuring sensor to a ground based on distance information of the points on a ground line at which a vertical surface in a driving direction of a vehicle received from the distance measuring sensor meets the ground.
  • the protruding determination unit is configured to acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
  • the road boundary line acquisition unit is configured to acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when the difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
  • the road width calculation unit is configured to calculate a road width of the driving road based on the acquired road boundary line of the driving road.
  • the narrow road detection unit is configured to determine whether the road width of the driving road is less than or equal to a reference road width and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to the reference road width.
  • the distance information may include a distance from the distance measuring sensor to the points on the ground line and an angle between a line segment connecting the distance measuring sensor and the points on the ground line and a reference line of the distance measuring sensor.
  • Yet another aspect of the present inventive concept encompasses a system for detecting a narrow road, including a speed output apparatus, a steering information output apparatus, a distance measuring sensor, and a detection apparatus.
  • the speed output apparatus is configured to output a moving speed of a vehicle.
  • the steering information output apparatus is configured to output steering information of the vehicle.
  • the distance measuring sensor is configured to output distance information of points on a ground line at which a vertical surface in a driving direction of the vehicle meets a ground.
  • the apparatus for detecting a narrow road is configured to receive the distance information of the points from the distance measuring sensor, calculate relative heights of the points from the distance measuring sensor to the ground based on the distance information, acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal, acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when the difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value, calculate a road width of the driving road based on the road boundary line of the driving road, and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width.
  • FIG. 1 is a configuration diagram of an apparatus and a system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • FIG. 2 is a configuration diagram of an apparatus and a system for detecting a narrow road according to another exemplary embodiment of the present inventive concept.
  • FIG. 3 is a reference diagram for describing an operation of calculating relative heights in an apparatus or a system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • FIGS. 4A and 4B are reference diagrams for describing an operation of acquiring a left boundary point and a right boundary point in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • FIG. 5 is a reference diagram for describing an operation of calculating a road width of a driving road in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • FIG. 6 is a flow chart of a method for detecting a narrow road according to the exemplary embodiment of the present inventive concept.
  • FIG. 1 is a configuration diagram of an apparatus and a system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • a system 200 for detecting a narrow road may include a distance measuring sensor 210 and an apparatus 100 for detecting a narrow road.
  • the system 200 for detecting a narrow road may further include a movement trajectory output apparatus 220 .
  • the system 200 for detecting a narrow road may acquire distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground by using a distance measuring sensor 210 while driving the vehicle and detect whether a driving road of a vehicle is a narrow road based on the distance information of the points on the ground line.
  • the narrow road means a protruding narrow road, such as a road in which a boundary at sides of the road is a cliff, a bridge without a guardrail, and a road protruding from the ground.
  • the system 200 for detecting a narrow road may output an alarm signal or a warning signal which informs a driver that the driving road of the vehicle is the narrow road.
  • the system 200 for detecting a narrow road may be used to control a speed of a vehicle, emergency braking of a vehicle, and the like, by outputting the alarm signal or the warning signal to a vehicle control system, an advanced driver assistance system, an adaptive cruise control system, an automatic emergency braking system, and the like.
  • the distance measuring sensor 210 may acquire the distance information of the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground and output the acquired distance information to the apparatus 100 for detecting a narrow road.
  • the distance measuring sensor 210 may be mounted on the whole surface of the vehicle, such as a bumper and a grill to be able to acquire the distance information of the ground within a radius of a sensor recognition range of the distance measuring sensor 210 in a direction in which a vehicle body is headed.
  • the distance information may include a distance r from the distance measuring sensor 210 to the points on the ground line and an angle ⁇ between a line segment connecting the distance measuring sensor 210 and the points on the ground line and a reference line of the distance measuring sensor 210 .
  • the distance measuring sensor may be a light detection and ranging (LiDAR) sensor.
  • LiDAR light detection and ranging
  • the present inventive concept is not limited thereto, and therefore any sensors that can acquire the distance information of the points on the ground line in the driving direction of vehicle may be used.
  • the movement trajectory output apparatus 220 may output a movement trajectory of a vehicle.
  • the movement trajectory represents a moving route of a vehicle over time.
  • the movement trajectory output apparatus 220 may model the movement trajectory of the vehicle based on moving speed and steering information of the vehicle over time.
  • the movement trajectory output apparatus 220 may acquire location information of a vehicle over time by using a global positioning system (GPS) and acquire the movement trajectory of the vehicle based thereon.
  • GPS global positioning system
  • the location information acquired by using the GPS may include a latitude, a longitude, an altitude, a speed, an azimuth, and the like.
  • the apparatus 100 for detecting a narrow road may receive the distance information of the points on the ground line in the driving direction of the vehicle from the distance measuring sensor 210 and detect whether the driving road of the vehicle is a narrow road by various calculations using the distance information of the points on the ground line.
  • the apparatus 100 for detecting a narrow road may calculate relative heights of the points on the ground line based on the distance information, acquire a left boundary point and a right boundary point at which a difference in the relative heights becomes maximal, and calculate a road boundary line of the driving road and a road width of the driving road of the vehicle.
  • the apparatus 100 for detecting a narrow road may correspond to at least one processor, e.g., a microprocessor, or may include at least one processor.
  • the apparatus 100 for detecting a narrow road may include a relative height calculation unit 110 , a protruding determination unit 120 , a road boundary line acquisition unit 130 , a road width calculation unit 140 , and a narrow road detection unit 150 .
  • the relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the distance information received from the distance measuring sensor 210 .
  • the relative height represents the distance from the distance measuring sensor 210 to the ground.
  • the relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the mounting height, the mounting angle, and the distance information of the distance measuring sensor 210 . The detailed description thereof will be made with reference to FIG. 3 .
  • the protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative heights from adjacent points among the points on the ground line becomes maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
  • the protruding determination unit 120 may determine a road as a protruding road and detect whether a road is a narrow road when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. However, the protruding determination unit 120 may end the detection of the narrow road when the difference in the relative heights at the left boundary point and the right boundary point is less than the reference value.
  • the reference value may be a value which is a reference determining whether a driving road protrudes and the reference value may be calculated based on the heights of components of a vehicle or may be acquired based on an experiment. According to an exemplary embodiment of the present inventive concept, the reference value may be a maximum height which may allow a vehicle to go up and down without damaging the vehicle.
  • the left boundary point and the right boundary point at which the difference in the relative heights from adjacent points among the points on the ground line becomes maximal may be acquired.
  • the left boundary point and the right boundary point may become a boundary point which divides the driving road from a region out of the driving road. The acquisition of the left boundary point and the right boundary point will be described in detail with reference to FIGS. 4A and 4B .
  • the road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle.
  • the movement trajectory of the vehicle may be received from the movement trajectory output apparatus 220 .
  • the movement trajectory of the vehicle may be calculated by the apparatus 100 for detecting a narrow road based on the position of the vehicle.
  • the road boundary line acquisition unit 130 may transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system.
  • An exemplary embodiment of the present inventive concept will be described in detail with reference to FIG. 5 .
  • the road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road.
  • the road width may be a minimum distance between the left boundary line and the right boundary line of the road boundary line.
  • a road width of a straight section may be a distance from the left boundary point to the right boundary point, but a road width of a curved section may not coincide with a distance from the left boundary point to the right boundary point. Therefore, the road width calculation unit 140 may calculate the minimum distance between the left boundary line and the right boundary line of the road boundary line as the road width, based on the road boundary line of the driving road.
  • the narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width.
  • the reference road width may be a reference determining whether the driving road is the narrow road. Therefore, when the road width of the driving road exceeds the reference road width, the narrow road detection unit 150 may determine that the driving road of the vehicle is not the narrow road and when the road width of the driving road is less than or equal to the reference road width, may detect that the driving road of the vehicle is the narrow road.
  • the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section.
  • the narrow road detection unit 150 may output or display that the driving section is the narrow road section by using noise, vibration, a picture, or a moving picture.
  • the narrow road detection unit 150 may display a road shape of the detected narrow road while informing the narrow road section, when the narrow road is detected.
  • the narrow road detection unit 150 may display the road shape of the detected narrow road by referring to the road boundary line detected by the road boundary line acquisition unit 130 .
  • the apparatus 100 for detecting a narrow road may display the road shape of the narrow road to allow a driver to recognize a portion which is not seen by the driver, thereby greatly reducing the risk of accidents.
  • the apparatus 100 for detecting a narrow road or the system 200 for detecting a narrow road may inform the driver that the driving road of the vehicle is the narrow road, thereby assuring safety of the driver and improving convenience of the driver.
  • FIG. 2 is a configuration diagram of an apparatus and a system for detecting a narrow road according to another exemplary embodiment of the present inventive concept.
  • a system 400 for detecting a narrow road may include a distance measuring sensor 210 , a speed output apparatus 410 , a steering information output apparatus 420 , and an apparatus 300 for detecting a narrow road.
  • the apparatus 100 for detecting a narrow road may include the relative height calculation unit 110 , the protruding determination unit 120 , the road boundary line acquisition unit 130 , the road width calculation unit 140 , the narrow road detection unit 150 , and a movement trajectory modeling unit 310 .
  • the distance measuring sensor 210 , the relative height calculation unit 110 , the protruding determination unit 120 , the road boundary line acquisition unit 130 , the road width calculation unit 140 , and the narrow road detection unit 150 which are illustrated in FIG. 2 may correspond to the distance measuring sensor 210 , the relative height calculation unit 110 , the protruding determination unit 120 , the road boundary line acquisition unit 130 , the road width calculation unit 140 , and the narrow road detection unit 150 which are illustrated in FIG. 1 . Therefore, the overlapping description thereof will be omitted.
  • the system 400 for detecting a narrow road may acquire distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground by using a distance measuring sensor 210 while driving the vehicle and detect whether a driving road of a vehicle is a narrow road based on the distance information of the points on the ground line.
  • the system 400 for detecting a narrow road may output an alarm signal or a warning signal which informs a driver that the driving road of the vehicle is the narrow road, when it is detected that the driving road of the vehicle is a narrow road.
  • the system 400 for detecting a narrow road may be used to control a speed of a vehicle, emergency braking of a vehicle, and the like, by outputting the alarm signal or the warning signal to the vehicle control system, the advanced driver assistance system, the adaptive cruise control system, the automatic emergency braking system, and the like.
  • the distance measuring sensor 210 may acquire the distance information on the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground and outputs the acquired distance information to the apparatus 300 for detecting a narrow road.
  • the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle ⁇ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210 .
  • the distance measuring sensor may be the light detection and ranging (LiDAR) sensor.
  • LiDAR light detection and ranging
  • the present inventive concept is not limited thereto, and therefore any sensors that can acquire the distance information of the points on the ground line in the driving direction of vehicle may be used.
  • a speed output apparatus 410 may output the moving speed of the vehicle.
  • the speed output apparatus 410 may output the moving speed of the vehicle to the apparatus 300 for detecting a narrow road over time.
  • the steering information output apparatus 420 may output the steering information of the vehicle.
  • the steering information represents a direction in which the vehicle is headed.
  • the steering information output apparatus 420 may acquire the steering information based on operation information of a handle.
  • the present inventive concept is not limited thereto, and the steering information output apparatus 230 may be any apparatuses that can output the steering information of the vehicle.
  • the apparatus 300 for detecting a narrow road may receive the distance information of the points on the ground line in the driving direction of the vehicle and detect whether the driving road of the vehicle is the narrow road by various calculations using the distance information of the points on the ground line.
  • the apparatus 300 for detecting a narrow road calculates the relative heights of the points on the ground line based on the distance information and acquires the left boundary point and the right boundary point at which the difference in the relative heights becomes maximal, and calculate the road boundary line of the driving road and the road width of the driving road of the vehicle.
  • the apparatus 300 for detecting a narrow road may correspond to at least one processor or may include at least one processor.
  • the relative height calculation unit 110 calculates the relative heights of the points on the ground line based on the distance information received from the distance measuring sensor 210 .
  • the relative height represents the distance from the distance measuring sensor 210 to the ground. The calculation of the relative heights will be described in detail with reference to FIG. 3 .
  • the protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative heights from adjacent points among the points on the ground line becomes maximal and determines whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
  • the reference value may be a value which is a reference determining whether the driving road protrudes.
  • the protruding determination unit 120 may determine a road as the protruding road and detect whether the road is the narrow road when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. However, the protruding determination unit 120 may end the detection of the narrow road when the difference in the relative heights at the left boundary point and the right boundary point is less than the reference value.
  • the movement trajectory modeling unit 310 may model the movement trajectory of the vehicle based on the moving speed of the vehicle and the steering information of the vehicle when the protruding determination unit 120 determines that the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. According to an exemplary embodiment of the present inventive concept, the movement trajectory modeling unit 310 may model the movement trajectory of the vehicle by receiving the moving speed of the vehicle and the steering information of the vehicle from the speed detection apparatus 410 and the steering information detection apparatus 420 .
  • the movement trajectory modeling unit 310 may acquire a position and a heading angle of a vehicle over time based on the movement speed and the steering information of the vehicle and model the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
  • the heading angle represents an angle of the direction in which the vehicle is headed.
  • the road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle.
  • the road boundary line acquisition unit 130 may receive the movement trajectory of the vehicle over time from the movement trajectory modeling unit 310 .
  • the road boundary line acquisition unit 130 may generate the road boundary line depending on the movement trajectory of the vehicle and the coordinates of the left boundary point and the right boundary point over time.
  • the road boundary line acquisition unit 130 may transform coordinates of the left boundary point and the right boundary point in a local coordinate system into those in a global coordinate system, based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system.
  • An exemplary embodiment of the present inventive concept will be described in detail with reference to FIG. 5 .
  • the road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road.
  • the road width may be a minimum distance between the left boundary line and the right boundary line of the road boundary line.
  • the narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width and detect that the driving road of the vehicle is the narrow road when the road width of the driving road is less than or equal to the reference road width. When the road width of the driving road exceeds the reference road with, the narrow road detection unit 150 may determine that the driving road of the vehicle is not the narrow road and end the detection of the narrow road.
  • the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section and display the road shape of the detected narrow road.
  • FIG. 3 is a reference diagram for describing an operation of calculating the relative heights in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • the apparatuses 100 and 300 for detecting a narrow road and the systems 200 and 400 for detecting a narrow road may receive from the distance measuring sensor 210 the distance information of points 31 on the ground line at which the vertical surface in the driving direction of the vehicle 10 meets the ground.
  • the distance measuring sensor 210 may be mounted on the whole surface of the vehicle, such as a bumper and a grill to be able to acquire the distance information of the points 31 on the ground line within a radius of the sensor recognition range 30 of the distance measuring sensor 210 in a direction in which a vehicle body is headed.
  • a sensor recognition range 30 may be changed and the acquired points on the ground line may be changed, depending on a mounting height h 0 and a mounting angle ⁇ of the distance measuring sensor 210 .
  • the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle ⁇ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210 .
  • the distance measuring sensor 210 may detect the distance information (distance, angle) of the points on the ground line, that is, in a form of (ri, ⁇ i).
  • the relative height calculation unit 110 may calculate the relative height hi of the points on the ground line based on the distance information (ri, ⁇ i) received from the distance measuring sensor 210 .
  • hi represents the relative heights of the points on the ground detected by the distance measuring sensor 210
  • ri represents the distance from the distance measuring sensor 210 to the points on the ground line
  • ⁇ i represents an angle between the line segment connecting the distance measuring sensor 210 to the points on the ground line and the reference line of the distance measuring sensor 210
  • represents the mounting angle of the distance measuring sensor 210 which is mounted in the vehicle 10 .
  • the relative height calculation unit 110 may calculate the relative height hi of the points on the ground line based on the distance information (ri, ⁇ i) of the points on the ground line detected by the distance measuring sensor 210 .
  • FIGS. 4A and 4B are reference diagrams for describing an operation of acquiring the left boundary point and the right boundary point in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • FIG. 4A represents the distance information of the points 31 on the ground line detected by the distance measuring sensor 210 of the vehicle in the narrow road and the relative heights of the points 31 on the ground line calculated by the relative height calculation unit 110 .
  • the distance information of the points on the ground line detected by the distance measuring sensor 210 of the vehicle may be represented by (rk+1, ⁇ k+1), (rk, ⁇ k), . . . , (ri, ⁇ i), . . . , (rj, ⁇ j), (rj+1, ⁇ j+1) . . . . .
  • the relative height calculation unit 110 may calculate the relative heights of the points on the ground line as hk+1, hk, . . . , hi, . . . , hj, hj+1 . . . .
  • h 0 represents the mounting height h 0 of the distance measuring sensor 210 .
  • FIG. 4B is a graph illustrating the difference in the relative heights from the adjacent points of the points 31 on the ground line.
  • a horizontal axis 0 represents the angle between the line segment connecting the distance measuring sensor 210 to the points on the ground line and the reference line of the distance measuring sensor 210 and a vertical axis represents the relative heights.
  • the points may have a constant height in the driving road which is portion protruding as hk+1, hk, . . . , hi, . . . , hj, hj+1 . . . and the difference in relative heights of the adjacent points at the boundary point of hk+1 and hk and the boundary point of hj and hj+1 may become maximal. Therefore, the protruding determination unit 130 may acquire the left boundary point 41 and the right boundary point 42 at which the relative heights from the adjacent points among the points on the ground line become maximal.
  • the protruding determination unit 120 may determine whether the difference in the relative height at the left boundary point and the right boundary point is more than or equal to the reference value. That is, when the difference between the hk+1 and hk and the difference between hj and hj+1 are larger than the reference value hc, the apparatus 100 for detecting a narrow road continuously may detect the narrow road. On the other hand, when the difference between the hk+1 and hk and the difference between hj and hj+1 is less than the reference value hc, the apparatus 100 for detecting a narrow road may end the detection of the narrow road.
  • FIG. 5 is a reference diagram for describing an operation of calculating the road width of the driving road in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
  • the movement trajectory of the vehicle may be represented by the global coordinate system.
  • the coordinates of the left boundary point 41 and the right boundary point 42 acquired by the distance measuring sensor 210 may be coordinates of the local coordinate system and therefore there is a need to transform the coordinates of the left boundary point 41 and the right boundary point 42 in the local coordinate system into coordinates in the global coordinate system depending on the movement trajectory of the vehicle.
  • the road boundary line acquisition unit 130 may acquire the coordinates of the left boundary point 41 and the right boundary point 42 in the local coordinate system as (X l , Y l ) k , (X r , Y r ) k and (X l , Y l ) k+1 , (X r , Y r ) k+1 which are coordinates in the global coordinate system, based on the movement trajectory of the vehicle.
  • the road boundary line acquisition unit 130 may transform the coordinates of the left boundary point 41 and the right boundary point 42 into coordinates in the global coordinate system based on the movement trajectory of the vehicle over time and as illustrated in FIG. 5 , may generate the road boundary line connecting the coordinates of the left boundary point 41 and the right boundary point 42 in the global coordinate system as illustrated in FIG. 5 .
  • the road width calculation unit 140 may calculate the road width of the driving road which is a minimum distance between a left boundary line 51 and a right boundary line 52 of the road boundary line, based on the road boundary line of the driving road.
  • FIG. 6 is a flow chart of a method for controlling a driving of a vehicle according to an exemplary embodiment of the present inventive concept.
  • the flow chart illustrated in FIG. 6 may include steps which are processed in time series by the apparatuses 100 and 300 for detecting a narrow road or the systems 200 and 400 for detecting a narrow road illustrated in FIGS. 1 to 5 . Therefore, even though omitted hereinafter, the contents described above regarding the apparatuses 100 and 300 for detecting a narrow road or the systems 200 and 400 for detecting a narrow road illustrated in FIGS. 1 to 5 may be applied to the flow chart illustrated in FIG. 6 .
  • the apparatus 100 for detecting a narrow road may receive from the distance measuring sensor 210 the distance information of the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground.
  • the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle ⁇ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210 .
  • the relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the distance information.
  • the relative height represents the distance from the distance measuring sensor 210 to the ground.
  • the protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative height from the adjacent points among the points on the ground line becomes maximal.
  • the left boundary point and the right boundary point may be the boundary point which divides the driving road from the region out of the driving road.
  • the protruding determination unit 120 may determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value.
  • the reference value may be a value which is a reference determining whether a driving road protrudes and the reference value may be calculated based on the heights of components of a vehicle or may be acquired based on an experiment.
  • the reference value may be the maximum height which may allow a vehicle to go up and down without damaging the vehicle.
  • the protruding determination unit 120 may compare the difference in the relative heights at the left boundary point and the right boundary point with the reference value to proceed to step 650 when the difference in the relative heights is more than or equal to the reference value and end the detection of the narrow road when the difference in the relative heights is less than the reference value.
  • the road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle.
  • the movement trajectory of the vehicle may be received from external apparatuses.
  • the movement trajectory of the vehicle may be calculated by the apparatus 100 for detecting a narrow road based on the position of the vehicle.
  • the road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road.
  • the road width may be the minimum distance between the left boundary line and the right boundary line of the road boundary line.
  • the narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width.
  • the narrow road detection unit 150 may compare the road width of the driving road with the reference road width to proceed to step 680 when the road width of the driving road is less than or equal to the reference road width and end the detection of the narrow road when the road width of the driving road exceeds the reference road width.
  • the narrow road detection unit 150 may detect that the driving road of the vehicle is the narrow road. According to an exemplary embodiment of the present inventive concept, when the narrow road is detected, the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section. According to another exemplary embodiment of the present inventive concept, the narrow road detection unit 150 may further display a road shape of the detected narrow road while informing the narrow road section, when the narrow road is detected.
  • the method, apparatus, and system for detecting a narrow road it is possible to detect the protruding narrow road by using the distance measuring sensor detecting the distance to the ground in front of the vehicle and assure the driver's safety and improve the driver's convenience by informing the narrow road of the user. Therefore, it is possible to reduce the risk of accidents due to the narrow road.
  • ‘one embodiment’ of principles of the present inventive concept and various changes of the expression means that specific features, structures, characteristics, and the like, associated with the embodiment are included in at lease one embodiment of the principle of the present inventive concept. Therefore, the expression ‘one embodiment’ and any other modification examples disclosed throughout the present disclosure do not necessarily mean the same embodiment.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • Mathematical Physics (AREA)
  • Electromagnetism (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

A method for detecting a narrow road includes calculating relative heights of points from a distance measuring sensor to a ground based on distance information. A left boundary point and a right boundary point, at which a difference in relative heights from adjacent points becomes maximal, are acquired. A road boundary line of a driving road is acquired based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. A road width of the driving road is calculated based on the road boundary line. It is detected whether the driving road of the vehicle is a narrow road based on the road width.

Description

RELATED APPLICATIONS
This application is a reissue application of U.S. Pat. No. 9,278,695, issued on Mar. 8, 2016 issued from U.S. patent application Ser. No. 14/518,910, filed on Oct. 20, 2014.
CROSS-REFERENCE TO RELATED APPLICATION
This application is based on and claims benefit of priority to Korean Patent Application No. 10-2013-0143140, filed on Nov. 22, 2013 in the Korean Intellectual Property Office, the entire content of which is incorporated herein by reference.
TECHNICAL FIELD
The present inventive concept relates to a method, an apparatus, and a system for detecting a narrow road.
BACKGROUND
Recently, an advanced driver assistance system (ADAS) has been greatly drawn attention in vehicle industries. The ADAS is a system which senses dangerous situations occurring while driving a vehicle by using sensors mounted in a vehicle and cope with the dangerous situations to assure driver's safety and provide convenience to the driver.
When driving a vehicle on a protruding narrow road, a driver may not differentiate a road boundary well, such that it is difficult for the driver to drive a vehicle and the risk of accidents is increased.
SUMMARY
Accordingly, the present inventive concept has been made to solve the above-mentioned problems occurring in the prior art while advantages achieved by the prior art are maintained intact.
One object to be achieved by the present inventive concept is to provide a method, an apparatus, and a system for detecting a narrow road. Another object to be achieved by the present inventive concept is to provide a computer readable recording medium in which a program for allowing a computer to execute the method is recorded. The technical problem to be solved by an exemplary embodiment of the present inventive concept is not limited to the technical problems as described above, and therefore other technical problems may be present.
One aspect of the present inventive concept relates to a method for detecting a narrow road, including receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of vehicle meets a ground. A relative height of the points from the distance measuring sensor to the ground is calculated based on the distance information. A left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal, are acquired. A road boundary line of a driving road of the vehicle is acquired based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. A road width of the driving road is calculated based on the road boundary line of the driving road. It is detected that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width.
Another aspect of the present inventive concept encompasses a computer readable recording medium including computer executable instructions which control a processor to perform the method for detecting a narrow road.
Still another aspect of the present inventive concept relates to an apparatus for detecting a narrow road, including a relative height calculation unit, a protruding determination unit, a road boundary line acquisition unit, a road width calculation unit, and a narrow road detection unit. The relative height calculation unit is configured to calculate relative heights of points from a distance measuring sensor to a ground based on distance information of the points on a ground line at which a vertical surface in a driving direction of a vehicle received from the distance measuring sensor meets the ground. The protruding determination unit is configured to acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. The road boundary line acquisition unit is configured to acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when the difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. The road width calculation unit is configured to calculate a road width of the driving road based on the acquired road boundary line of the driving road. The narrow road detection unit is configured to determine whether the road width of the driving road is less than or equal to a reference road width and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to the reference road width.
The distance information may include a distance from the distance measuring sensor to the points on the ground line and an angle between a line segment connecting the distance measuring sensor and the points on the ground line and a reference line of the distance measuring sensor.
Yet another aspect of the present inventive concept encompasses a system for detecting a narrow road, including a speed output apparatus, a steering information output apparatus, a distance measuring sensor, and a detection apparatus. The speed output apparatus is configured to output a moving speed of a vehicle. The steering information output apparatus is configured to output steering information of the vehicle. The distance measuring sensor is configured to output distance information of points on a ground line at which a vertical surface in a driving direction of the vehicle meets a ground. The apparatus for detecting a narrow road is configured to receive the distance information of the points from the distance measuring sensor, calculate relative heights of the points from the distance measuring sensor to the ground based on the distance information, acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal, acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when the difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value, calculate a road width of the driving road based on the road boundary line of the driving road, and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width.
BRIEF DESCRIPTION OF THE DRAWINGS
The above and other objects, features and advantages of the present inventive concept will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which like reference characters may refer to the same or similar parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the embodiments of the inventive concept.
FIG. 1 is a configuration diagram of an apparatus and a system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
FIG. 2 is a configuration diagram of an apparatus and a system for detecting a narrow road according to another exemplary embodiment of the present inventive concept.
FIG. 3 is a reference diagram for describing an operation of calculating relative heights in an apparatus or a system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
FIGS. 4A and 4B are reference diagrams for describing an operation of acquiring a left boundary point and a right boundary point in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
FIG. 5 is a reference diagram for describing an operation of calculating a road width of a driving road in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
FIG. 6 is a flow chart of a method for detecting a narrow road according to the exemplary embodiment of the present inventive concept.
DETAILED DESCRIPTION
Hereinafter, the present disclosure will be described with reference to the accompanying drawings. In each drawing, like components are denoted by like reference numerals. Further, the detailed description of known functions and/or components will be omitted. The following disclosed contents mainly describe portions required to understand operations according to various embodiments and the description of elements which make the gist of the description obscure will be omitted.
Further, some of components of the drawings may be exaggerated, omitted, or schematically illustrated. A size of each component does not completely reflect a real size and therefore the contents disclosed herein are not limited by a relative size or interval of the components illustrated in the drawings.
FIG. 1 is a configuration diagram of an apparatus and a system for detecting a narrow road according to an exemplary embodiment of the present inventive concept. Referring to FIG. 1, a system 200 for detecting a narrow road may include a distance measuring sensor 210 and an apparatus 100 for detecting a narrow road. According to an exemplary embodiment of the present inventive concept, the system 200 for detecting a narrow road may further include a movement trajectory output apparatus 220.
In the present disclosure, only components involved in an exemplary embodiment of the present inventive concept will be described to prevent features of the exemplary embodiment of the present inventive concept from obscuring. Therefore, a person having ordinary skill in the art to which the present inventive concept pertains may understand that other general-purpose components in addition to components illustrated in FIG. 1 may be further provided.
The system 200 for detecting a narrow road may acquire distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground by using a distance measuring sensor 210 while driving the vehicle and detect whether a driving road of a vehicle is a narrow road based on the distance information of the points on the ground line. The narrow road means a protruding narrow road, such as a road in which a boundary at sides of the road is a cliff, a bridge without a guardrail, and a road protruding from the ground. The system 200 for detecting a narrow road may output an alarm signal or a warning signal which informs a driver that the driving road of the vehicle is the narrow road. The system 200 for detecting a narrow road may be used to control a speed of a vehicle, emergency braking of a vehicle, and the like, by outputting the alarm signal or the warning signal to a vehicle control system, an advanced driver assistance system, an adaptive cruise control system, an automatic emergency braking system, and the like.
The distance measuring sensor 210 may acquire the distance information of the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground and output the acquired distance information to the apparatus 100 for detecting a narrow road. The distance measuring sensor 210 may be mounted on the whole surface of the vehicle, such as a bumper and a grill to be able to acquire the distance information of the ground within a radius of a sensor recognition range of the distance measuring sensor 210 in a direction in which a vehicle body is headed.
For example, the distance information may include a distance r from the distance measuring sensor 210 to the points on the ground line and an angle θ between a line segment connecting the distance measuring sensor 210 and the points on the ground line and a reference line of the distance measuring sensor 210.
The points on the ground line acquired depending on a mounting height and a mounting angle of the distance measuring sensor 210 may be changed. According to an exemplary embodiment of the present inventive concept, the distance measuring sensor may be a light detection and ranging (LiDAR) sensor. However, the present inventive concept is not limited thereto, and therefore any sensors that can acquire the distance information of the points on the ground line in the driving direction of vehicle may be used.
The movement trajectory output apparatus 220 may output a movement trajectory of a vehicle. The movement trajectory represents a moving route of a vehicle over time. According to an exemplary embodiment of the present inventive concept, the movement trajectory output apparatus 220 may model the movement trajectory of the vehicle based on moving speed and steering information of the vehicle over time. According to another exemplary embodiment of the present inventive concept, the movement trajectory output apparatus 220 may acquire location information of a vehicle over time by using a global positioning system (GPS) and acquire the movement trajectory of the vehicle based thereon. The location information acquired by using the GPS may include a latitude, a longitude, an altitude, a speed, an azimuth, and the like.
The apparatus 100 for detecting a narrow road may receive the distance information of the points on the ground line in the driving direction of the vehicle from the distance measuring sensor 210 and detect whether the driving road of the vehicle is a narrow road by various calculations using the distance information of the points on the ground line. The apparatus 100 for detecting a narrow road may calculate relative heights of the points on the ground line based on the distance information, acquire a left boundary point and a right boundary point at which a difference in the relative heights becomes maximal, and calculate a road boundary line of the driving road and a road width of the driving road of the vehicle. The apparatus 100 for detecting a narrow road according to an exemplary embodiment of the present inventive concept may correspond to at least one processor, e.g., a microprocessor, or may include at least one processor.
The apparatus 100 for detecting a narrow road may include a relative height calculation unit 110, a protruding determination unit 120, a road boundary line acquisition unit 130, a road width calculation unit 140, and a narrow road detection unit 150.
The relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the distance information received from the distance measuring sensor 210. The relative height represents the distance from the distance measuring sensor 210 to the ground.
According to an exemplary embodiment of the present inventive concept, the relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the mounting height, the mounting angle, and the distance information of the distance measuring sensor 210. The detailed description thereof will be made with reference to FIG. 3.
The protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative heights from adjacent points among the points on the ground line becomes maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
The protruding determination unit 120 may determine a road as a protruding road and detect whether a road is a narrow road when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. However, the protruding determination unit 120 may end the detection of the narrow road when the difference in the relative heights at the left boundary point and the right boundary point is less than the reference value.
The reference value may be a value which is a reference determining whether a driving road protrudes and the reference value may be calculated based on the heights of components of a vehicle or may be acquired based on an experiment. According to an exemplary embodiment of the present inventive concept, the reference value may be a maximum height which may allow a vehicle to go up and down without damaging the vehicle.
When the driving road of the vehicle is the protruding road, the left boundary point and the right boundary point at which the difference in the relative heights from adjacent points among the points on the ground line becomes maximal may be acquired. In this case, the left boundary point and the right boundary point may become a boundary point which divides the driving road from a region out of the driving road. The acquisition of the left boundary point and the right boundary point will be described in detail with reference to FIGS. 4A and 4B.
The road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle. According to an exemplary embodiment of the present inventive concept, the movement trajectory of the vehicle may be received from the movement trajectory output apparatus 220. According to another exemplary embodiment of the present inventive concept, the movement trajectory of the vehicle may be calculated by the apparatus 100 for detecting a narrow road based on the position of the vehicle.
According to an exemplary embodiment of the present inventive concept, the road boundary line acquisition unit 130 may transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system. An exemplary embodiment of the present inventive concept will be described in detail with reference to FIG. 5.
The road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road. In this case, the road width may be a minimum distance between the left boundary line and the right boundary line of the road boundary line. For example, a road width of a straight section may be a distance from the left boundary point to the right boundary point, but a road width of a curved section may not coincide with a distance from the left boundary point to the right boundary point. Therefore, the road width calculation unit 140 may calculate the minimum distance between the left boundary line and the right boundary line of the road boundary line as the road width, based on the road boundary line of the driving road.
The narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width. The reference road width may be a reference determining whether the driving road is the narrow road. Therefore, when the road width of the driving road exceeds the reference road width, the narrow road detection unit 150 may determine that the driving road of the vehicle is not the narrow road and when the road width of the driving road is less than or equal to the reference road width, may detect that the driving road of the vehicle is the narrow road.
When the narrow road is detected, the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section. According to an exemplary embodiment of the present inventive concept, the narrow road detection unit 150 may output or display that the driving section is the narrow road section by using noise, vibration, a picture, or a moving picture.
According to another exemplary embodiment of the present inventive concept, the narrow road detection unit 150 may display a road shape of the detected narrow road while informing the narrow road section, when the narrow road is detected. The narrow road detection unit 150 may display the road shape of the detected narrow road by referring to the road boundary line detected by the road boundary line acquisition unit 130. The apparatus 100 for detecting a narrow road may display the road shape of the narrow road to allow a driver to recognize a portion which is not seen by the driver, thereby greatly reducing the risk of accidents.
As described above, the apparatus 100 for detecting a narrow road or the system 200 for detecting a narrow road may inform the driver that the driving road of the vehicle is the narrow road, thereby assuring safety of the driver and improving convenience of the driver.
FIG. 2 is a configuration diagram of an apparatus and a system for detecting a narrow road according to another exemplary embodiment of the present inventive concept. Referring to FIG. 1, a system 400 for detecting a narrow road may include a distance measuring sensor 210, a speed output apparatus 410, a steering information output apparatus 420, and an apparatus 300 for detecting a narrow road. The apparatus 100 for detecting a narrow road may include the relative height calculation unit 110, the protruding determination unit 120, the road boundary line acquisition unit 130, the road width calculation unit 140, the narrow road detection unit 150, and a movement trajectory modeling unit 310.
The distance measuring sensor 210, the relative height calculation unit 110, the protruding determination unit 120, the road boundary line acquisition unit 130, the road width calculation unit 140, and the narrow road detection unit 150 which are illustrated in FIG. 2 may correspond to the distance measuring sensor 210, the relative height calculation unit 110, the protruding determination unit 120, the road boundary line acquisition unit 130, the road width calculation unit 140, and the narrow road detection unit 150 which are illustrated in FIG. 1. Therefore, the overlapping description thereof will be omitted.
The system 400 for detecting a narrow road may acquire distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground by using a distance measuring sensor 210 while driving the vehicle and detect whether a driving road of a vehicle is a narrow road based on the distance information of the points on the ground line. The system 400 for detecting a narrow road may output an alarm signal or a warning signal which informs a driver that the driving road of the vehicle is the narrow road, when it is detected that the driving road of the vehicle is a narrow road. The system 400 for detecting a narrow road may be used to control a speed of a vehicle, emergency braking of a vehicle, and the like, by outputting the alarm signal or the warning signal to the vehicle control system, the advanced driver assistance system, the adaptive cruise control system, the automatic emergency braking system, and the like.
The distance measuring sensor 210 may acquire the distance information on the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground and outputs the acquired distance information to the apparatus 300 for detecting a narrow road. For example, the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle θ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210.
According to an exemplary embodiment of the present inventive concept, the distance measuring sensor may be the light detection and ranging (LiDAR) sensor. However, the present inventive concept is not limited thereto, and therefore any sensors that can acquire the distance information of the points on the ground line in the driving direction of vehicle may be used.
A speed output apparatus 410 may output the moving speed of the vehicle. The speed output apparatus 410 may output the moving speed of the vehicle to the apparatus 300 for detecting a narrow road over time.
The steering information output apparatus 420 may output the steering information of the vehicle. The steering information represents a direction in which the vehicle is headed. According to an exemplary embodiment of the present inventive concept, the steering information output apparatus 420 may acquire the steering information based on operation information of a handle. However, the present inventive concept is not limited thereto, and the steering information output apparatus 230 may be any apparatuses that can output the steering information of the vehicle.
The apparatus 300 for detecting a narrow road may receive the distance information of the points on the ground line in the driving direction of the vehicle and detect whether the driving road of the vehicle is the narrow road by various calculations using the distance information of the points on the ground line. The apparatus 300 for detecting a narrow road calculates the relative heights of the points on the ground line based on the distance information and acquires the left boundary point and the right boundary point at which the difference in the relative heights becomes maximal, and calculate the road boundary line of the driving road and the road width of the driving road of the vehicle. The apparatus 300 for detecting a narrow road according to an exemplary embodiment of the present inventive concept may correspond to at least one processor or may include at least one processor.
The relative height calculation unit 110 calculates the relative heights of the points on the ground line based on the distance information received from the distance measuring sensor 210. The relative height represents the distance from the distance measuring sensor 210 to the ground. The calculation of the relative heights will be described in detail with reference to FIG. 3.
The protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative heights from adjacent points among the points on the ground line becomes maximal and determines whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value. The reference value may be a value which is a reference determining whether the driving road protrudes. The acquisition of the left boundary point and the right boundary point will be described in detail with reference to FIGS. 4A and 4B.
The protruding determination unit 120 may determine a road as the protruding road and detect whether the road is the narrow road when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. However, the protruding determination unit 120 may end the detection of the narrow road when the difference in the relative heights at the left boundary point and the right boundary point is less than the reference value.
The movement trajectory modeling unit 310 may model the movement trajectory of the vehicle based on the moving speed of the vehicle and the steering information of the vehicle when the protruding determination unit 120 determines that the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. According to an exemplary embodiment of the present inventive concept, the movement trajectory modeling unit 310 may model the movement trajectory of the vehicle by receiving the moving speed of the vehicle and the steering information of the vehicle from the speed detection apparatus 410 and the steering information detection apparatus 420.
For example, the movement trajectory modeling unit 310 may acquire a position and a heading angle of a vehicle over time based on the movement speed and the steering information of the vehicle and model the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time. The heading angle represents an angle of the direction in which the vehicle is headed.
The road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle. The road boundary line acquisition unit 130 may receive the movement trajectory of the vehicle over time from the movement trajectory modeling unit 310. The road boundary line acquisition unit 130 may generate the road boundary line depending on the movement trajectory of the vehicle and the coordinates of the left boundary point and the right boundary point over time.
According to an exemplary embodiment of the present inventive concept, the road boundary line acquisition unit 130 may transform coordinates of the left boundary point and the right boundary point in a local coordinate system into those in a global coordinate system, based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system. An exemplary embodiment of the present inventive concept will be described in detail with reference to FIG. 5.
The road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road. In this case, the road width may be a minimum distance between the left boundary line and the right boundary line of the road boundary line.
The narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width and detect that the driving road of the vehicle is the narrow road when the road width of the driving road is less than or equal to the reference road width. When the road width of the driving road exceeds the reference road with, the narrow road detection unit 150 may determine that the driving road of the vehicle is not the narrow road and end the detection of the narrow road.
When the narrow road is detected, the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section and display the road shape of the detected narrow road.
FIG. 3 is a reference diagram for describing an operation of calculating the relative heights in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
The apparatuses 100 and 300 for detecting a narrow road and the systems 200 and 400 for detecting a narrow road may receive from the distance measuring sensor 210 the distance information of points 31 on the ground line at which the vertical surface in the driving direction of the vehicle 10 meets the ground.
The distance measuring sensor 210 may be mounted on the whole surface of the vehicle, such as a bumper and a grill to be able to acquire the distance information of the points 31 on the ground line within a radius of the sensor recognition range 30 of the distance measuring sensor 210 in a direction in which a vehicle body is headed. In this case, a sensor recognition range 30 may be changed and the acquired points on the ground line may be changed, depending on a mounting height h0 and a mounting angle α of the distance measuring sensor 210.
According to an exemplary embodiment of the present inventive concept, the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle θ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210.
Hereinafter, for convenience of explanation, it is assumed that the distance measuring sensor 210 may detect the distance information (distance, angle) of the points on the ground line, that is, in a form of (ri, θi).
The relative height calculation unit 110 may calculate the relative height hi of the points on the ground line based on the distance information (ri, θi) received from the distance measuring sensor 210. The relative height hi may be calculated by a distance from the distance measuring sensor 210 to the ground based on the following Equation 1.
hi=ri cos(θi)cos(α)  [Equation 1]
In the above Equation 1, hi represents the relative heights of the points on the ground detected by the distance measuring sensor 210, ri represents the distance from the distance measuring sensor 210 to the points on the ground line, θi represents an angle between the line segment connecting the distance measuring sensor 210 to the points on the ground line and the reference line of the distance measuring sensor 210, and α represents the mounting angle of the distance measuring sensor 210 which is mounted in the vehicle 10.
As described above, the relative height calculation unit 110 may calculate the relative height hi of the points on the ground line based on the distance information (ri, θi) of the points on the ground line detected by the distance measuring sensor 210.
FIGS. 4A and 4B are reference diagrams for describing an operation of acquiring the left boundary point and the right boundary point in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
FIG. 4A represents the distance information of the points 31 on the ground line detected by the distance measuring sensor 210 of the vehicle in the narrow road and the relative heights of the points 31 on the ground line calculated by the relative height calculation unit 110. Referring to FIG. 4A, the distance information of the points on the ground line detected by the distance measuring sensor 210 of the vehicle may be represented by (rk+1, θk+1), (rk, θk), . . . , (ri, θi), . . . , (rj, θj), (rj+1, θj+1) . . . . .
Based on the distance information, the relative height calculation unit 110 may calculate the relative heights of the points on the ground line as hk+1, hk, . . . , hi, . . . , hj, hj+1 . . . . In this case, h0 represents the mounting height h0 of the distance measuring sensor 210.
FIG. 4B is a graph illustrating the difference in the relative heights from the adjacent points of the points 31 on the ground line. A horizontal axis 0 represents the angle between the line segment connecting the distance measuring sensor 210 to the points on the ground line and the reference line of the distance measuring sensor 210 and a vertical axis represents the relative heights.
Compared with the relative heights of the points on the ground line, the points may have a constant height in the driving road which is portion protruding as hk+1, hk, . . . , hi, . . . , hj, hj+1 . . . and the difference in relative heights of the adjacent points at the boundary point of hk+1 and hk and the boundary point of hj and hj+1 may become maximal. Therefore, the protruding determination unit 130 may acquire the left boundary point 41 and the right boundary point 42 at which the relative heights from the adjacent points among the points on the ground line become maximal.
The protruding determination unit 120 may determine whether the difference in the relative height at the left boundary point and the right boundary point is more than or equal to the reference value. That is, when the difference between the hk+1 and hk and the difference between hj and hj+1 are larger than the reference value hc, the apparatus 100 for detecting a narrow road continuously may detect the narrow road. On the other hand, when the difference between the hk+1 and hk and the difference between hj and hj+1 is less than the reference value hc, the apparatus 100 for detecting a narrow road may end the detection of the narrow road.
FIG. 5 is a reference diagram for describing an operation of calculating the road width of the driving road in the apparatus or the system for detecting a narrow road according to an exemplary embodiment of the present inventive concept.
At t=k, the position of the vehicle may be represented by Xk=[Xk, Yk, θk] in the global coordinate system. At t=k+1, the position of the vehicle may be represented by Xk+1=[Xk+1, Yk+1, θk+1] in the global coordinate system. As such, the movement trajectory of the vehicle may be represented by the global coordinate system. However, the coordinates of the left boundary point 41 and the right boundary point 42 acquired by the distance measuring sensor 210 may be coordinates of the local coordinate system and therefore there is a need to transform the coordinates of the left boundary point 41 and the right boundary point 42 in the local coordinate system into coordinates in the global coordinate system depending on the movement trajectory of the vehicle.
Therefore, the road boundary line acquisition unit 130 may acquire the coordinates of the left boundary point 41 and the right boundary point 42 in the local coordinate system as (Xl, Yl)k, (Xr, Yr)k and (Xl, Yl)k+1, (Xr, Yr)k+1 which are coordinates in the global coordinate system, based on the movement trajectory of the vehicle.
The road boundary line acquisition unit 130 may transform the coordinates of the left boundary point 41 and the right boundary point 42 into coordinates in the global coordinate system based on the movement trajectory of the vehicle over time and as illustrated in FIG. 5, may generate the road boundary line connecting the coordinates of the left boundary point 41 and the right boundary point 42 in the global coordinate system as illustrated in FIG. 5.
The road width calculation unit 140 may calculate the road width of the driving road which is a minimum distance between a left boundary line 51 and a right boundary line 52 of the road boundary line, based on the road boundary line of the driving road.
FIG. 6 is a flow chart of a method for controlling a driving of a vehicle according to an exemplary embodiment of the present inventive concept. The flow chart illustrated in FIG. 6 may include steps which are processed in time series by the apparatuses 100 and 300 for detecting a narrow road or the systems 200 and 400 for detecting a narrow road illustrated in FIGS. 1 to 5. Therefore, even though omitted hereinafter, the contents described above regarding the apparatuses 100 and 300 for detecting a narrow road or the systems 200 and 400 for detecting a narrow road illustrated in FIGS. 1 to 5 may be applied to the flow chart illustrated in FIG. 6.
In step 610, the apparatus 100 for detecting a narrow road may receive from the distance measuring sensor 210 the distance information of the points on the ground line at which the vertical surface in the driving direction of the vehicle meets the ground. For example, the distance information may include the distance r from the distance measuring sensor 210 to the points on the ground line and the angle θ between the line segment connecting the distance measuring sensor 210 and the points on the ground line and the reference line of the distance measuring sensor 210.
In step 620, the relative height calculation unit 110 may calculate the relative heights of the points on the ground line based on the distance information. The relative height represents the distance from the distance measuring sensor 210 to the ground.
In step 630, the protruding determination unit 120 may acquire the left boundary point and the right boundary point at which the difference in the relative height from the adjacent points among the points on the ground line becomes maximal. In this case, the left boundary point and the right boundary point may be the boundary point which divides the driving road from the region out of the driving road.
In step 640, the protruding determination unit 120 may determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to the reference value. The reference value may be a value which is a reference determining whether a driving road protrudes and the reference value may be calculated based on the heights of components of a vehicle or may be acquired based on an experiment. For example, the reference value may be the maximum height which may allow a vehicle to go up and down without damaging the vehicle.
The protruding determination unit 120 may compare the difference in the relative heights at the left boundary point and the right boundary point with the reference value to proceed to step 650 when the difference in the relative heights is more than or equal to the reference value and end the detection of the narrow road when the difference in the relative heights is less than the reference value.
In step 650, the road boundary line acquisition unit 130 may acquire the road boundary line of the driving road of the vehicle based on the left boundary point and the right boundary point depending on the movement trajectory of the vehicle.
According to an exemplary embodiment of the present inventive concept, the movement trajectory of the vehicle may be received from external apparatuses. According to another exemplary embodiment of the present inventive concept, the movement trajectory of the vehicle may be calculated by the apparatus 100 for detecting a narrow road based on the position of the vehicle.
In step 660, the road width calculation unit 140 may calculate the road width of the driving road based on the road boundary line of the driving road. In this case, the road width may be the minimum distance between the left boundary line and the right boundary line of the road boundary line.
In step 670, the narrow road detection unit 150 may determine whether the road width of the driving road is less than or equal to the reference road width. The narrow road detection unit 150 may compare the road width of the driving road with the reference road width to proceed to step 680 when the road width of the driving road is less than or equal to the reference road width and end the detection of the narrow road when the road width of the driving road exceeds the reference road width.
In step 680, the narrow road detection unit 150 may detect that the driving road of the vehicle is the narrow road. According to an exemplary embodiment of the present inventive concept, when the narrow road is detected, the narrow road detection unit 150 may inform the driver of the vehicle that the driving section is the narrow road section. According to another exemplary embodiment of the present inventive concept, the narrow road detection unit 150 may further display a road shape of the detected narrow road while informing the narrow road section, when the narrow road is detected.
According to the method, apparatus, and system for detecting a narrow road according to exemplary embodiments of the present inventive concept, it is possible to detect the protruding narrow road by using the distance measuring sensor detecting the distance to the ground in front of the vehicle and assure the driver's safety and improve the driver's convenience by informing the narrow road of the user. Therefore, it is possible to reduce the risk of accidents due to the narrow road.
In the present disclosure, ‘one embodiment’ of principles of the present inventive concept and various changes of the expression means that specific features, structures, characteristics, and the like, associated with the embodiment are included in at lease one embodiment of the principle of the present inventive concept. Therefore, the expression ‘one embodiment’ and any other modification examples disclosed throughout the present disclosure do not necessarily mean the same embodiment.
All the embodiments and conditional examples disclosed in the present disclosure are described to help a person having ordinary skilled in the art to which the present inventive concept pertains to understand the principle and concept of the present inventive concept and those skilled in the art may be understood that the present inventive concept may be implemented in a modified form within a range which does not deviating from the essential characteristics of the present inventive concept. Therefore, the Examples described above should be considered in view of illustration rather than limitation. It should be interpreted that the scope of the present inventive concept is defined by the following claims rather than the above-mentioned detailed description and all of differences within a scope equivalent thereto are included in the appended claims of the present inventive concept.

Claims (33)

What is claimed is:
1. A method for detecting a narrow road, comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a plurality of left boundary point points and a plurality of right boundary point points at which a difference in relative heights from adjacent points among the points becomes maximal;
acquiring a road boundary line lines of a driving road of the vehicle based on the left boundary point points and the right boundary point points depending on a movement trajectory of the vehicle when a difference in relative heights at one of the left boundary point points and one of the right boundary point points is more than or equal to a reference value;
calculating a road width of the driving road based on the acquired road boundary line lines of the driving road; and
determining that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width,
wherein the acquiring of the road boundary lines includes:
transforming coordinates of the left boundary points and the right boundary points in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary lines by connecting the coordinates of the left boundary points and connecting the coordinates of the right boundary points in the global coordinate system.
2. The method of claim 1, further comprising:
receiving a moving speed of the vehicle and steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the moving speed of the vehicle and the steering information of the vehicle.
3. The method of claim 2, wherein the calculating of the movement trajectory of the vehicle includes:
acquiring a position and a heading angle of the vehicle over time, based on the moving speed of the vehicle and the steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
4. The method of claim 1, wherein the calculating of the relative height includes calculating the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
5. The method of claim 1, wherein the acquiring of the road boundary line includes:
transforming coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary line by connecting the coordinates of the left boundary point and connecting the coordinates of the right boundary point in the global coordinate system.
6. The method of claim 1, wherein the road width is a minimum distance between the a left boundary line and the a right boundary line of the road boundary line lines.
7. The method of claim 1, further comprising:
informing a driver of the vehicle that a driving section is a narrow road section, when the narrow road is detected.
8. The method of claim 1, further comprising:
displaying a road shape of the detected narrow driving road of the vehicle based on the road boundary line lines, when the driving road of the vehicle is determined as the narrow road is detected.
9. A non-transitory computer readable recording medium, comprising computer executable instructions which control, when exeucted by a processor, cause the processor to perform the a method of claim 1 comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a plurality of left boundary points and a plurality of right boundary points at which a difference in relative heights from adjacent points among the points becomes maximal;
acquiring road boundary lines of a driving road of the vehicle based on the left boundary points and the right boundary points depending on a movement trajectory of the vehicle when a difference in relative heights at one of the left boundary points and one of the right boundary points is more than or equal to a reference value;
calculating a road width of the driving road based on the acquired road boundary lines of the driving road; and
determining that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width,
wherein the acquiring of the road boundary lines includes:
transforming coordinates of the left boundary points and the right boundary points in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary lines by connecting the coordinates of the left boundary points and connecting the coordinates of the right boundary points in the global coordinate system.
10. An apparatus for detecting a narrow road, comprising:
a processor; and
a memory in which at least one instruction to be executed by the processor is stored,
wherein, when the at least one instruction is executed by the processor, the processor is configured to:
a relative height calculation unit configured to calculate relative heights of points from a distance measuring sensor to a ground based on distance information of the points on a ground line at which a vertical surface in a driving direction of a vehicle received from the distance measuring sensor meets the ground;
a protruding determination unit configured to acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points is maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value;
a road boundary line acquisition unit configured to acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle;
a road width calculation unit configured to calculate a road width of the driving road based on the acquired road boundary line of the driving road; and
a narrow road detection unit configured to determine whether the road width of the driving road is less than or equal to a reference road width and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to the reference road width,
wherein the processor is further configured to transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system.
11. The apparatus of claim 10, further comprising wherein the processor is further configured to:
a movement trajectory modeling unit configured to calculate the movement trajectory of the vehicle based on a moving speed of the vehicle and steering information of the vehicle, and
wherein the movement trajectory modeling unit calculatescalculate the movement trajectory of the vehicle when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
12. The apparatus of claim 11, wherein the movement trajectory modeling unit processor is further configured to receive the moving speed of the vehicle and the steering information of the vehicle from a speed detection apparatus and a steering information detection apparatus, acquire a position and a heading angle of the vehicle over time based on the moving speed and the steering information, and calculate the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
13. The apparatus of claim 10, wherein the relative height calculation unit processor is further configured to calculate the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
14. The apparatus of claim 10, wherein the road boundary line acquisition unit is configured to transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generates the road boundary line in the global coordinate system.
15. The apparatus of claim 10, wherein the road width is a minimum distance between the a left boundary line and the a right boundary line of the road boundary line.
16. The apparatus of claim 10, wherein the narrow road detection unit processor is further configured to inform a driver of the vehicle that a driving section is a narrow road section when the narrow road is detected.
17. The apparatus of claim 10, wherein the narrow detection unit processor is further configured to display a road shape of the detected narrow road based on the road boundary line when the narrow road is detected.
18. A system for detecting a narrow road, comprising:
a speed output apparatus configured to output a moving speed of a vehicle;
a steering information output apparatus configured to output steering information of the vehicle;
a distance measuring sensor configured to output distance information of points on a ground line at which a vertical surface in a driving direction of the vehicle meets a ground; and
an apparatus for detecting a narrow road configured to receive the distance information of the points from the distance measuring sensor, calculate relative heights of the points from the distance measuring sensor to the ground based on the distance information, acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal, acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when the difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value, calculate a road width of the driving road based on the acquired road boundary line of the driving road, and detect that the driving road of the vehicle is a narrow road when the road width of the driving road is less than or equal to a reference road width.
19. The method of claim 1, wherein the distance information includes a distance from the distance measuring sensor to the points on the ground line and an angle between a line segment connecting the distance measuring sensor and the points on the ground line and a reference line of the distance measuring sensor.
20. The apparatus of claim 10, wherein the distance information includes a distance from the distance measuring sensor to the points on the ground line and an angle between a line segment connecting the distance measuring sensor and the points on the ground line and a reference line of the distance measuring sensor.
21. A method for detecting road boundaries, comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal; and
acquiring a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the, vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value,
wherein the left boundary point and the right boundary point are points that divides the driving road from a region out of the driving road,
wherein the reference value is a reference determining whether the driving road protrudes, and
wherein the acquiring of the road boundary line includes:
transforming coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary line by connecting the coordinates of the left boundary point and connecting the coordinates of the right boundary point in the global coordinate system.
22. The method of claim 21, further comprising:
receiving a moving speed of the vehicle and steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the moving speed of the vehicle and the steering information of the vehicle.
23. The method of claim 22, wherein the calculating of the movement trajectory of the vehicle includes:
acquiring a position and a heading angle of the vehicle over time, based on the moving speed of the vehicle and the steering information of the vehicle; and
calculating the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
24. The method of claim 21, wherein the calculating of the relative height includes calculating the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
25. The method of claim 21, wherein the reference value is a maximum height which allows a vehicle to go up and down without damaging the vehicle.
26. The method of claim 21, wherein the reference value is calculated based on the heights of components of the vehicle.
27. A non-transitory computer readable recording medium, comprising computer executable instructions which, when executed by a processor, cause the processor to perform a method comprising:
receiving, from a distance measuring sensor, distance information of points on a ground line at which a vertical surface in a driving direction of a vehicle meets a ground;
calculating a relative height of the points from the distance measuring sensor to the ground based on the distance information;
acquiring a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points becomes maximal; and
acquiring a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle when a difference in relative heights at the left boundary point and the right boundary point is more than or equal to a reference value,
wherein the left boundary point and the right boundary point are points that divides the driving road from a region out of the driving road, and
wherein the reference value is a reference determining whether the driving road protrudes,
wherein the acquiring of the road boundary line includes:
transforming coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle; and
generating the road boundary line by connecting the coordinates of the left boundary point and connecting the coordinates of the right boundary point in the global coordinate system.
28. An apparatus for detecting a narrow road, comprising:
a processor; and
a memory in which at least one instruction to be executed by the processor is stored,
wherein, when the at least one instruction is executed by the processor, the processor is configured to:
calculate relative heights of points from a distance measuring sensor to a ground based on distance information of the points on a ground line at which a vertical surface in a driving direction of a vehicle received from the distance measuring sensor meets the ground;
acquire a left boundary point and a right boundary point at which a difference in relative heights from adjacent points among the points is maximal and determine whether the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value; and
acquire a road boundary line of a driving road of the vehicle based on the left boundary point and the right boundary point depending on a movement trajectory of the vehicle,
wherein the left boundary point and the right boundary point are points that divide the driving road from a region out of the driving road, and
wherein the reference value is a reference determining whether the driving road protrudes, and
wherein the processor is configured to transform coordinates of the left boundary point and the right boundary point in a local coordinate system into coordinates in a global coordinate system based on the position of the vehicle depending on the movement trajectory of the vehicle and generate the road boundary line in the global coordinate system.
29. The apparatus of claim 28, wherein the processor is further configured to:
calculate the movement trajectory of the vehicle based on a moving speed of the vehicle and steering information of the vehicle, and
calculate the movement trajectory of the vehicle when the difference in the relative heights at the left boundary point and the right boundary point is more than or equal to a reference value.
30. The apparatus of claim 29, wherein the processor is further configured to receive the moving speed of the vehicle and the steering information of the vehicle from a speed detection apparatus and a steering information detection apparatus, acquire a position and a heading angle of the vehicle over time based on the moving speed and the steering information, and calculate the movement trajectory of the vehicle based on the position and heading angle of the vehicle over time.
31. The apparatus of claim 28, wherein the processor is further configured to calculate the relative height of the points from the distance measuring sensor to the ground based on a mounting height and a mounting angle of the distance measuring sensor and the distance information.
32. The apparatus of claim 28, wherein the reference value is a maximum height which allows a vehicle to go up and down without damaging the vehicle.
33. The apparatus of claim 28, wherein the reference value is calculated based on the heights of components of the vehicle.
US15/655,411 2013-11-22 2017-07-20 Method, apparatus and system for detecting narrow road Active USRE47834E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/655,411 USRE47834E1 (en) 2013-11-22 2017-07-20 Method, apparatus and system for detecting narrow road

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR1020130143140A KR20150059489A (en) 2013-11-22 2013-11-22 Method, apparatus and system for detecting narrow road
KR10-2013-0143140 2013-11-22
US14/518,910 US9278695B2 (en) 2013-11-22 2014-10-20 Method, apparatus and system for detecting narrow road
US15/655,411 USRE47834E1 (en) 2013-11-22 2017-07-20 Method, apparatus and system for detecting narrow road

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/518,910 Reissue US9278695B2 (en) 2013-11-22 2014-10-20 Method, apparatus and system for detecting narrow road

Publications (1)

Publication Number Publication Date
USRE47834E1 true USRE47834E1 (en) 2020-02-04

Family

ID=53183305

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/518,910 Ceased US9278695B2 (en) 2013-11-22 2014-10-20 Method, apparatus and system for detecting narrow road
US15/655,411 Active USRE47834E1 (en) 2013-11-22 2017-07-20 Method, apparatus and system for detecting narrow road

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/518,910 Ceased US9278695B2 (en) 2013-11-22 2014-10-20 Method, apparatus and system for detecting narrow road

Country Status (3)

Country Link
US (2) US9278695B2 (en)
KR (1) KR20150059489A (en)
CN (1) CN104648403B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112172828A (en) * 2020-10-14 2021-01-05 斑马网络技术有限公司 Narrow road passing method and device, electronic equipment and computer readable storage medium

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9747278B2 (en) * 2012-02-23 2017-08-29 Palo Alto Research Center Incorporated System and method for mapping text phrases to geographical locations
KR101655553B1 (en) * 2014-10-29 2016-09-08 현대자동차주식회사 Driver assistance apparatus and method
CN106327575B (en) * 2015-06-19 2019-03-19 高德软件有限公司 A kind of the three-dimensional road data correcting method and device of road
JP6613795B2 (en) * 2015-10-16 2019-12-04 株式会社デンソー Display control device and vehicle control device
EP3217374A1 (en) * 2016-03-10 2017-09-13 Volvo Car Corporation Method and system for estimating a boundary of a road technical field
US10598922B2 (en) 2016-08-03 2020-03-24 Aptiv Technologies Limited Refractive beam steering device useful for automated vehicle LIDAR
CN106945663B (en) * 2017-04-13 2020-09-25 大陆投资(中国)有限公司 Anti-collision method for turning vehicle
US10705194B2 (en) * 2018-03-21 2020-07-07 Zoox, Inc. Automated detection of sensor miscalibration
CN111198379B (en) * 2018-11-19 2024-02-13 陕西汽车集团股份有限公司 Method for searching and positioning unloading position of unmanned transport vehicle
JP7333195B2 (en) * 2019-05-15 2023-08-24 株式会社Subaru Automated driving support system
CN110261866B (en) * 2019-06-12 2021-10-29 重庆交通大学 Road width geometric detection method and system based on road edge optical array
CN112027696A (en) * 2020-08-20 2020-12-04 江阴方艾机器人有限公司 Loading system and loading method thereof
CN114435469B (en) * 2020-11-03 2023-04-28 北京地平线机器人技术研发有限公司 Vehicle guiding prompting method and device
US12105222B2 (en) * 2020-11-23 2024-10-01 Harman International Industries, Incorporated Systems and methods for reducing cognitive workload and energy consumption by a sensor utilized on a vehicle
CN115951672B (en) * 2022-12-15 2024-04-12 锐趣科技(北京)有限公司 Method for robot to pass through narrow channel
CN116594409B (en) * 2023-07-17 2023-10-13 青岛能征智能装备有限公司 Unmanned control system and unmanned war chariot thereof

Citations (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5359666A (en) * 1988-09-28 1994-10-25 Honda Giken Kogyo Kabushiki Kaisha Driving way judging device and method
US6819407B2 (en) * 2002-02-08 2004-11-16 Omron Corporation Distance measuring apparatus
JP2005326963A (en) 2004-05-12 2005-11-24 Fujitsu Ten Ltd Operation supporting device
JP2007210458A (en) 2006-02-09 2007-08-23 Nissan Motor Co Ltd Display device for vehicle and image display control method for vehicle
KR20110080025A (en) 2010-01-04 2011-07-12 (주)엔스퀘어 Coordinates recognition method of automatic guided vehicle and apparatus thereof
US20110238252A1 (en) * 2010-03-26 2011-09-29 Nissan Motor Co., Ltd. Vehicle environment recognizing apparatus
JP2011232230A (en) 2010-04-28 2011-11-17 Denso Corp Overhead obstacle detector, collision preventing device, and overhead obstacle detection method
US20110320163A1 (en) * 2008-11-06 2011-12-29 Volvo Technology Corporation Method and system for determining road data
JP2012071833A (en) 2011-12-27 2012-04-12 Nissan Motor Co Ltd Display device for vehicle and image display control method for vehicle
JP2012071832A (en) 2011-12-27 2012-04-12 Nissan Motor Co Ltd Display device for vehicle and image display control method for vehicle
JP2012238230A (en) 2011-05-12 2012-12-06 Mitsubishi Heavy Ind Ltd Autonomous travel device and autonomous travel method, and program thereof
US20130032421A1 (en) * 2011-08-04 2013-02-07 GM Global Technology Operations LLC Driving assistance apparatus for assistance with driving along narrow roadways
CN103140409A (en) 2010-10-01 2013-06-05 丰田自动车株式会社 Driving support apparatus and driving support method
KR20130072542A (en) 2011-12-22 2013-07-02 현대자동차주식회사 Safety device and method for driving narrow road of vehicle
KR20130088987A (en) 2012-02-01 2013-08-09 현대엠엔소프트 주식회사 Apparatus for extracting surface information using point cloud of lidar data
US8750567B2 (en) * 2012-04-09 2014-06-10 GM Global Technology Operations LLC Road structure detection and tracking
US8825260B1 (en) * 2013-07-23 2014-09-02 Google Inc. Object and ground segmentation from a sparse one-dimensional range data
US20150019119A1 (en) 2013-07-11 2015-01-15 Hyundai Motor Company Apparatus and method for detecting narrow road in front of vehicle
US20150222813A1 (en) * 2012-08-03 2015-08-06 Clarion Co., Ltd. Camera Parameter Calculation Device, Navigation System and Camera Parameter Calculation Method
US20150332500A1 (en) * 2014-05-16 2015-11-19 Trimble Navigation Limited Handheld GIS data collection device target augmentation

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005052634B4 (en) * 2005-11-04 2021-02-18 Robert Bosch Gmbh Method and device for driver support before and / or when driving through a bottleneck
CN202686359U (en) * 2011-11-30 2013-01-23 富士重工业株式会社 Narrow road detection device

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5359666A (en) * 1988-09-28 1994-10-25 Honda Giken Kogyo Kabushiki Kaisha Driving way judging device and method
US6819407B2 (en) * 2002-02-08 2004-11-16 Omron Corporation Distance measuring apparatus
JP2005326963A (en) 2004-05-12 2005-11-24 Fujitsu Ten Ltd Operation supporting device
JP2007210458A (en) 2006-02-09 2007-08-23 Nissan Motor Co Ltd Display device for vehicle and image display control method for vehicle
US20110320163A1 (en) * 2008-11-06 2011-12-29 Volvo Technology Corporation Method and system for determining road data
KR20110080025A (en) 2010-01-04 2011-07-12 (주)엔스퀘어 Coordinates recognition method of automatic guided vehicle and apparatus thereof
US20110238252A1 (en) * 2010-03-26 2011-09-29 Nissan Motor Co., Ltd. Vehicle environment recognizing apparatus
JP2011232230A (en) 2010-04-28 2011-11-17 Denso Corp Overhead obstacle detector, collision preventing device, and overhead obstacle detection method
US20130184976A1 (en) 2010-10-01 2013-07-18 Toyota Jidosha Kabushiki Kaisha Driving support apparatus and driving support method
CN103140409A (en) 2010-10-01 2013-06-05 丰田自动车株式会社 Driving support apparatus and driving support method
JP2012238230A (en) 2011-05-12 2012-12-06 Mitsubishi Heavy Ind Ltd Autonomous travel device and autonomous travel method, and program thereof
US20130032421A1 (en) * 2011-08-04 2013-02-07 GM Global Technology Operations LLC Driving assistance apparatus for assistance with driving along narrow roadways
KR20130072542A (en) 2011-12-22 2013-07-02 현대자동차주식회사 Safety device and method for driving narrow road of vehicle
JP2012071832A (en) 2011-12-27 2012-04-12 Nissan Motor Co Ltd Display device for vehicle and image display control method for vehicle
JP2012071833A (en) 2011-12-27 2012-04-12 Nissan Motor Co Ltd Display device for vehicle and image display control method for vehicle
KR20130088987A (en) 2012-02-01 2013-08-09 현대엠엔소프트 주식회사 Apparatus for extracting surface information using point cloud of lidar data
US8750567B2 (en) * 2012-04-09 2014-06-10 GM Global Technology Operations LLC Road structure detection and tracking
US20150222813A1 (en) * 2012-08-03 2015-08-06 Clarion Co., Ltd. Camera Parameter Calculation Device, Navigation System and Camera Parameter Calculation Method
US9948853B2 (en) * 2012-08-03 2018-04-17 Clarion Co., Ltd. Camera parameter calculation device, navigation system and camera parameter calculation method
US20150019119A1 (en) 2013-07-11 2015-01-15 Hyundai Motor Company Apparatus and method for detecting narrow road in front of vehicle
US8825260B1 (en) * 2013-07-23 2014-09-02 Google Inc. Object and ground segmentation from a sparse one-dimensional range data
US20150332500A1 (en) * 2014-05-16 2015-11-19 Trimble Navigation Limited Handheld GIS data collection device target augmentation

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
English Translation of JP 201228230 to Shigetoshi. *
Notification of First Office Action dated Jan. 10, 2018 issued in Chinese Patent Application No. 201410609726.5 (with English translation).
U.S. Notice of Aliowance dated Nov. 4, 2015 issued in U.S. Appl. No. 14/528,910.

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112172828A (en) * 2020-10-14 2021-01-05 斑马网络技术有限公司 Narrow road passing method and device, electronic equipment and computer readable storage medium
CN112172828B (en) * 2020-10-14 2022-03-08 斑马网络技术有限公司 Narrow road passing method and device, electronic equipment and computer readable storage medium

Also Published As

Publication number Publication date
KR20150059489A (en) 2015-06-01
US20150148986A1 (en) 2015-05-28
CN104648403B (en) 2019-12-31
CN104648403A (en) 2015-05-27
US9278695B2 (en) 2016-03-08

Similar Documents

Publication Publication Date Title
USRE47834E1 (en) Method, apparatus and system for detecting narrow road
US9965956B2 (en) Collision risk calculation device, collision risk display device, and vehicle body control device
US9669829B2 (en) Travel lane marking recognition system
CA2987373C (en) Position estimation device and position estimation method
US8862389B2 (en) Display system, display method, and display program
US10414397B2 (en) Operational design domain decision apparatus
US9196163B2 (en) Driving support apparatus and driving support method
JP4876118B2 (en) Three-dimensional object appearance detection device
JP5966640B2 (en) Abnormal driving detection device and program
US20160019429A1 (en) Image processing apparatus, solid object detection method, solid object detection program, and moving object control system
CN104554272A (en) Path planning for evasive steering maneuver in presence of target vehicle and surrounding objects
US10814788B2 (en) Recognized-region estimation device, recognized-region estimation method, and recognized-region estimation program
US11390272B2 (en) Parking assistance device
KR101588787B1 (en) Method for determining lateral distance of forward vehicle and head up display system using the same
KR101470231B1 (en) Method and apparatus for controlling driving of vehicle, vehicle control system performing thereof
JP4756895B2 (en) Driving support device
JP7056379B2 (en) Vehicle driving control device
JP2015215299A (en) Object position estimation device
GB2623826A (en) Method and system for controlling a vehicle for travelling on a curved road
JP6604052B2 (en) Runway boundary estimation device and runway boundary estimation method
KR102180193B1 (en) Method and apparatus for parking space pose detection using parking stripe template matching
US10604149B2 (en) Alert reduction in vehicles using map data
KR102352214B1 (en) Method for detecting reflected light component in bird eye view image/ method and apparatus for detecting lane using the same
KR102303648B1 (en) Apparatus for controlling safety driving of vehicle and method thereof
KR102037593B1 (en) Apparatus and method for measuring distance between vehicles

Legal Events

Date Code Title Description
AS Assignment

Owner name: KIA MOTORS CORPORATION, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HYUNDAI MOTOR COMPANY;REEL/FRAME:045940/0180

Effective date: 20180529

Owner name: HYUNDAI MOTOR COMPANY, KOREA, REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HYUNDAI MOTOR COMPANY;REEL/FRAME:045940/0180

Effective date: 20180529

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8