KR101558395B1 - Vehicle curved display system and controlling method thereof - Google Patents

Abstract

An automotive curved display system and a control method thereof are disclosed. The automotive curved display system according to an embodiment of the present invention comprises a curved screen which is curved depending on the shape of a dashboard of a vehicle and displays an image including vehicle′s functions, which is projected from a projector; an infrared light which emits infrared light to the curved screen; an infrared camera which photographs an infrared image of the curved screen to recognize the touch gesture of a driver; a radar sensor unit which measures at least one of the location information and the lane information of a vehicle ahead by using a radar; and a control unit which displays, on the curved screen, a step-by-step warning set in accordance with the driving risk based on touch duration time of the driver, by the touch gesture recognition, and the distance from the vehicle ahead or distance between the lanes.

Description

[0001] VEHICLE CURVED DISPLAY SYSTEM AND CONTROLLING METHOD THEREOF [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention [0002] The present invention relates to a curved surface display system for a vehicle and a control method thereof, and more particularly, to a curved surface display system for a vehicle and a control method thereof for warning a running risk according to a touch operation time of a curved screen for a vehicle.

Generally, a vehicle is equipped with a display device such as a cluster and an AVN (Audio Video Navigation).

2. Description of the Related Art [0002] In recent years, research has been conducted to apply a curved display device to clusters and AVNs in order to improve driver's feel and interior design of a vehicle.

For example, a curved display device uses a projector that is disposed on the rear surface of a curved screen to project an image in a rear projection manner. In order to realize an in-vehicle curved display device, a projection type information output device is being developed, and a sharp image quality can be reproduced when a laser scanning projector is used for image projection.

However, since the curved surface display has no physical buttons in a touch manner, it is difficult to provide feedback to the driver on the button operation, and excessive focus of the driver is required when the user does not learn the operation of the touch UI.

Therefore, when the driver concentrates his gaze on the screen excessively while the vehicle is in operation, there is a problem that accidents due to dispersion of attention may occur

An embodiment of the present invention is to provide a vehicle curved display system and a control method thereof for calculating a driver's touch screen operation time and a front vehicle position of an SCC (Smart Cruise Control) to warn a driver of an excessive risk of sight.

According to an aspect of the present invention, a curved surface display system for a vehicle includes: a curved screen that is provided on a curved surface according to a dashboard shape of a vehicle and displays an image including a vehicle function to be projected from the projector; An infrared light illuminating the curved screen with infrared light; An infrared camera for photographing an infrared image of the curved screen to recognize a touch gesture of a driver; A radar sensor unit for measuring at least one of position information and lane information of the front vehicle using a radar; And a controller for displaying a stepwise warning according to the driving risk based on the touch duration of the driver according to the touch gesture recognition and the distance between the front vehicle and the lane or the lane.

The vehicle curved surface display system may further include: a first reflection mirror formed as an aspheric surface and reflecting an image projected from the projector; And a second reflective mirror for reflecting the image reflected by the first reflective mirror and projecting the reflected image onto the curved screen.

The controller may count a touch duration from the touch start point of the driver and display the first level warning on the curved screen when the touch duration exceeds the set time.

In addition, the controller may display a second-level warning having a higher risk than the first-level warning when the distance between the preceding vehicles is less than the set first-time distance in the touch continuation state of the driver.

Also, the controller may display a three-step warning that is more dangerous than the two-step warning when the distance between the front vehicles in the touch continuation state of the driver is less than the second headway distance that is closer to the first headway distance.

In addition, the image may include function-related operations and display information of the navigation device, the audio device, and the air conditioner provided in the cluster device and the center pace area.

In addition, the warning may be displayed in a part of the center fascia in which the driver's gaze is concentrated by overlapping the warning phrase and the warning mark with the color according to the risk.

In addition, the control unit may set the distance setting value between the preceding vehicles proportionally in accordance with the vehicle speed variation of the vehicle.

In addition, the control unit may variably set the distance setting value between the vehicle and the preceding vehicle, further considering the difference in speed between the vehicle and the preceding vehicle.

According to another aspect of the present invention, there is provided a method of controlling a curved display system for a vehicle, the method comprising the steps of: sensing a touch time of a curved screen displaying an image including a vehicle function projected from a projector, ) Illuminating the curved screen with infrared light and capturing an infrared image to recognize a driver's touch gesture; b) counting a touch duration from a touch start time according to the recognition of the touch gesture; c) collecting position information of the front vehicle from the radar sensor; And d) displaying the step-by-step warning on the curved screen according to the running risk based on the distance between the driver's touch duration and the preceding vehicle.

The step d) may include outputting a first warning message to a portion of the curved screen for driving safety when the touch duration of the driver exceeds a preset time.

The step d) may further include the step of outputting a two-step warning mark to a part of the curved screen when the distance between the front vehicles is less than the set first distance in the touching state of the driver. And displaying a third-level warning mark having a higher risk than the second-level warning if the distance between the preceding vehicle in the touch continuation state of the driver is less than the second distance between the first vehicle and the first vehicle.

In the step d), if the touch gesture is not recognized for a predetermined time, the warning display is terminated, and a menu or a pop-up window of a vehicle function for which input is requested due to the driver's start of touch is opened , It is determined that the driver is concentrating on the curved screen, and a step-by-step warning can be displayed.

In addition, the step (d) may divide the warning into colors according to the degree of risk, and may display the images in a part of the center fascia where the driver's gaze is concentrated, overlapping the images.

According to the embodiment of the present invention, it is possible to prevent the driver from concentrating his or her gaze on the curved screen excessively by calculating the time for operating the curved screen of the driver and the position of the preceding vehicle, .

In addition, it is possible to intuitively display an interval between the front vehicle and the driver when operating the curved screen of the driver, thereby providing a function of safely operating while assisting the front view of the driver.

1 shows a configuration of a curved surface display system for a vehicle according to an embodiment of the present invention.
FIG. 2 to FIG. 4 show a step-by-step warning screen displayed according to an embodiment of the present invention.
5 is a flowchart schematically illustrating a method of controlling a curved display system for a vehicle according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

Throughout the specification, when an element is referred to as "comprising ", it means that it can include other elements as well, without excluding other elements unless specifically stated otherwise. Also, the terms " part, "" module," and " module ", etc. in the specification mean a unit for processing at least one function or operation and may be implemented by hardware or software or a combination of hardware and software have.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A vehicle curved display system and warning method according to an embodiment of the present invention will now be described in detail with reference to the drawings.

1 shows a configuration of a curved surface display system for a vehicle according to an embodiment of the present invention.

2 schematically shows an image displayed on a curved screen according to an embodiment of the present invention.

1 and 2, a curved vehicle display system 100 according to an exemplary embodiment of the present invention includes a curved screen 110, a projector 120, a first reflective mirror 130, a second reflective mirror An infrared camera 150, an infrared camera 160, a radar sensor unit 170, and a control unit 180.

The curved screen 110 is formed of a transparent acrylic material so that the image can be displayed externally, and is provided as a curved surface according to the vehicle interior design such as a dashboard.

The curved screen 110 is divided into a cluster area and a center fascia area in the dashboard as shown in Fig. 2, and the center fascia area may include navigation, audio, and air conditioning functions.

The projector 120 projects an image on a projection area set in the vehicle interior, and displays the image on the curved screen 110 so that the driver can visually recognize the image.

The image may include vehicle speed information, engine speed information, cooling water temperature information, fuel remaining amount information, accumulation distance information, section distance information, operation information of a lamp (e.g., a direction indicator lamp, , A seat belt, a battery, etc.), and the like. That is, the image may include an object 111 corresponding to information provided by an existing cluster device.

In addition, the image may further include navigation device information, audio device information, and air conditioner information. That is, the image includes an operator interface (not shown) including a plurality of selectable objects 112, 113, and 114 corresponding to various buttons and displays for operation of a navigation device, an audio device, user interface < / RTI >

Here, the object refers to information that is selected by the driver input and can be controlled according to the intention of the driver. For example, an object may include an image, an icon, a folder icon, textual content, a list, and the like.

The navigation device information may include a navigation menu composed of a plurality of selectable objects, a current position of the vehicle, and a route guidance on the map. The audio device information may include an audio menu composed of a plurality of selectable objects, a volume, a sound source or a radio channel being reproduced, and the like. The air conditioner information may include an air conditioner menu including a plurality of selectable objects, a current temperature, a current airflow, and the like.

The first reflective mirror 130 and the second reflective mirror 140 are installed between the curved screen 110 and the projector 120 and display an image projected from the projector 120 on the curved screen 110.

At this time, the image projected from the projector 120 is reflected to the second reflecting mirror 140 through the first reflecting mirror 130. The image reflected by the second reflective mirror 140 is projected onto the curved screen 110 and displayed to the driver.

The first reflective mirror 130 may be an aspherical reflective mirror manufactured according to the curvature value of the curved screen 110. By using the first reflecting mirror 130, it is possible to reduce the size of the curved surface display system 100 installed in the vehicle by adjusting the optical path depth required to display an image on the curved screen 110. [

Infrared illumination 150 illuminates infrared illumination with curved screen 110.

Infrared illumination 150 may be configured to emit infrared light evenly over the entire area of curved screen 110.

The infrared camera 160 photographs the entire area of the curved screen 110 to determine whether or not the driver touches the curved screen 110. Here, whether or not the touch is the touch gesture refers to a touch gesture in which the driver touches the curved screen 110 to operate a specific function, and it can be confirmed that the touch recognition and the driver's hand are located in the curved screen 110 area.

The infrared camera 160 takes an infrared image corresponding to the entire area of the curved screen 110. The infrared camera 160 processes an image frame such as a still image or a moving image obtained by the image sensor in the photographing mode. The processed image frame is transmitted to the control unit 180, and it can be determined whether the curved screen 110 of the driver is touched.

For example, when the driver's hand H touches the curved screen 110, the infrared ray is reflected, and the infrared camera 160 photographs the reflected infrared ray image. The control unit 180 may determine the touch point based on the reflected infrared image.

The radar sensor unit 170 measures at least one of the vehicle position and the lane information present in front of the vehicle using a radar.

The radar sensor unit 170 may be a Smart Cruise Control (SCC), and may include a distance between the present vehicle and the preceding vehicle, a speed of the preceding vehicle, a speed difference between the present vehicle and the preceding vehicle, And so on.

Further, the radar sensor unit 170 can detect the lane information and the curved road section, and the sensing technology can refer to a known technique, and thus a detailed description thereof will be omitted.

The radar sensor unit 170 transmits the position measurement information of the front vehicle detected in real time to the controller 180 during the operation of the vehicle.

The control unit 180 is electrically connected to the projector 120, the infrared light 150, the infrared camera 160, and the radar sensor unit 170, and controls the overall operation of the curved surface display system 100 ≪ / RTI >

The curved surface display system 100 according to the embodiment of the present invention performs the steps of calculating the driver's touch screen operation time and the position of the forward vehicle of the radar sensor to warn the driver of the risk of excessive eye focus Lt; RTI ID = 0.0 > commands. ≪ / RTI >

The control unit 180 determines whether the driver touches the curved screen 110 based on the infrared image received through the infrared camera 160 and measures the touch time from the touch start point of the driver.

That is, when the touch starts, the controller 180 determines that the driver's line of sight focuses on the curved screen 110 for operating the vehicle function, and counts the touch time from the touch start point.

At this time, in a state in which a specific menu of the navigation, AVN, and air conditioning functions requiring input due to the touch of the driver and a pop-up window are opened (Pop-up), regardless of whether or not the driver touches the screen, 110). ≪ / RTI >

For example, if a keyboard input window for searching for a destination of navigation is opened after the driver starts touching, the driver can determine that the user is focused on the curved screen 110 until the keyword input for the destination search is completed or the input window display is terminated have.

The control unit 180 collects the position measurement information of the preceding vehicle from the radar sensor unit 170 when the driver's touch start is recognized.

The control unit 180 displays a predetermined warning on the curved screen 110 based on the distance between the driver's touch duration and the preceding vehicle.

For example, the control unit 180 issues a first-level warning in accordance with the driver's touch duration setting. In the state where the driver's touch is continued or the driver is concentrated on the curved screen after the step warning, a step-by-step warning according to the distance setting with respect to the preceding vehicle can be displayed.

2 to 3 show a step-by-step warning screen displayed according to an embodiment of the present invention.

Referring to FIG. 2, a first level warning is displayed according to a touch duration setting.

The control unit 180 displays a warning message such as "Looking Forward" on a part of the curved screen 110 when the touch duration of the driver exceeds the set time (e.g., 2 seconds).

Next, referring to FIG. 3, there is shown a screen displaying a 2-step warning according to the touch duration time and the first distance setting.

The control unit 180 displays a "first vehicle mark" on a part of the curved screen 110 when the distance between the front vehicles is measured to be less than the first inter-vehicle distance set in the touch continuation state of the driver.

Next, referring to FIG. 4, a screen displaying a three-level warning according to the touch duration time and the second distance setting is shown.

The control unit 180 displays a "second vehicle mark" in a part of the curved screen 110 when the distance between the front vehicles is measured to be less than the set second distance in the driver's touch continuation state.

The first vehicle mark and the second vehicle mark may be displayed in a center fascia area where a driver's line of sight is concentrated, and may be distinguished from each other by a unique color.

The control unit 180 intuitively warns the driver who has a gaze on the center pace by overlapping the warning text and the warning vehicle mark with the object image of the center pace area.

In addition, the control unit 180 may output a warning sound corresponding to each step warning via a speaker.

On the other hand, based on the configuration of the curved surface display system 100 for a vehicle according to the embodiment of the present invention, the curved surface 110 and the curved surface A display system control method will be described.

5 is a flowchart schematically illustrating a method of controlling a curved display system for a vehicle according to an embodiment of the present invention.

5, the curved display system 100 irradiates the curved screen 110 with infrared light, captures an infrared image, and recognizes the touch start according to recognition of the driver's touch gesture (S101).

When the curved surface display system 100 recognizes the start of the driver's touch, the curved surface display system 100 determines that the driver's line of sight focuses on the curved screen 110 for operating the vehicle function, and counts the touch time from the touch start point (S102).

The curved surface display system 100 continuously recognizes the driver's touch gesture in the area of the curved screen 110 in step S103 and if the driver's touch duration exceeds the set time in step S104 , And outputs a first stage warning to a part of the curved screen 110 for driving safety (S105). At this time, the curved surface display system 100 can display a warning phrase such as "forward looking"

Here, if the touch gesture is not recognized (S103: NO), the curved display system 100 may terminate the touch time measurement if the touch duration is less than the set time (S104: NO).

On the other hand, the curved surface display system 100 collects the position measurement information of the front vehicle from the radar sensor unit 170 after the first stage warning output, and displays the first distance (e.g., (S106; YES), a second stage warning is output to a partial area of the curved screen 110 (S107). At this time, the curved display system 100 may display the first vehicle mark of yellow with a two-level warning as shown in FIG.

If the distance between the front vehicles is measured to be less than the set second distance (e.g., 20 m) (S108; YES), the curved surface display system 100 displays a three-level warning (S109). At this time, the curved surface display system 100 can display a red second vehicle mark with a three-step warning as shown in FIG.

In the above description, the setting of the touch duration time and the headway distance is not limited to the above-described embodiment, and various settings can be made.

Meanwhile, although not shown in the drawing, the curved display system 100 stops the warning display and ends the touch time measurement if the driver's touch gesture is not recognized for a predetermined time at any stage at which the warning is output.

However, in the curved surface display system 100, in addition to the touch gesture recognition, when a specific menu or input window for navigation, AVN, and air conditioning functions requiring input due to the driver's touch is popped up, It is possible to output a warning in a stepwise manner.

As described above, according to the embodiment of the present invention, it is possible to prevent the driver from concentrating his or her gaze on the curved screen excessively by displaying the time for operating the curved screen of the driver and the position of the preceding vehicle, There is an effect that can be done.

In addition, when the curved screen of the driver operates the screen, the distance from the front vehicle is intuitively displayed, thereby providing a function of safely operating while helping the front of the driver.

Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and various modifications are possible.

For example, in the above-described embodiment of the present invention, the touch duration and the headway distance are set to a predetermined fixed value. However, the present invention is not limited to this, and the curved surface display system 100 may be configured such that, Accordingly, the distance setting value between the front vehicles can be set to be proportionally variable.

That is, it is difficult to guarantee the safety when the braking distance is taken into consideration when the vehicle warns that the front vehicle is at 30m when the highway is traveling at 100km. Accordingly, it is possible to increase the distance setting value between the front vehicles in accordance with the increase in the vehicle speed, thereby improving the driving safety.

In addition, the curved surface display system 100 can warn the step-by-step risk by taking into account not only the headway distance to the preceding vehicle but also the speed difference between the headway vehicle and the preceding vehicle.

That is, it is advantageous to increase the inter-vehicle distance setting for safety if the vehicle ahead is in a signal stop or is very slower than the vehicle, so that the distance setting value can be varied according to the difference in speed with respect to the preceding vehicle.

In the embodiment of the present invention described above, a warning is given in a stepwise manner according to distance measurement with respect to the preceding vehicle. However, the present invention is not limited to this, and the distance setting value between the vehicle and the lane according to the lane information of the radar sensor unit 170 , It is possible to warn a step-by-step risk.

That is, when the distance between the vehicle and the lane is narrowed while the driver continues touching, the user can be warned of the stepwise risk according to the distance setting value between the vehicle and the lane.

The embodiments of the present invention are not limited to the above-described apparatuses and / or methods, but may be implemented through a program for realizing functions corresponding to the configuration of the embodiment of the present invention, a recording medium on which the program is recorded And such an embodiment can be easily implemented by those skilled in the art from the description of the embodiments described above.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

100: Surface display system 110: Surface screen
120: projector 130: first reflecting mirror
140: Second reflective mirror 150: Infrared illumination
160: infrared camera 170: radar sensor unit
180:

Claims (14)

A curved screen which is provided on a curved surface according to a dashboard shape of the vehicle and displays an image including a vehicle function to be projected from the projector;
An infrared light illuminating the curved screen with infrared light;
An infrared camera for photographing an infrared image of the curved screen to recognize a touch gesture of a driver;
A radar sensor unit for measuring at least one of position information and lane information of the front vehicle using a radar; And
And a control unit for displaying a step-by-step warning according to a running risk based on a touch duration of the driver according to the touch gesture recognition and a distance between the front vehicle and a lane. The method according to claim 1,
A first reflection mirror formed as an aspheric surface and reflecting an image projected from the projector; And
And a second reflective mirror for reflecting the image reflected by the first reflective mirror and projecting the reflected image onto the curved screen. 3. The method according to claim 1 or 2,
Wherein,
Counting a touch duration time from a touch start point of the driver and displaying a first stage warning on the curved screen when the touch duration exceeds a set time. The method of claim 3,
Wherein,
When the distance between the front vehicles in the touch continuation state of the driver is less than the set first distance, displays a second stage warning with a higher risk than the first stage warning. 5. The method of claim 4,
Wherein,
Wherein the third level warning is higher than the second level warning when the distance between the front vehicles in the touch continuation state of the driver is less than the second distance between the first and second vehicles. The method according to claim 1,
Wherein the image includes:
A navigation device, an audio device, and an air conditioner provided in the cluster device and the center fascia area, and display information. 7. The method according to claim 1 or 6,
The warning may include,
The warning phrase and the warning mark are classified into the colors according to the risk, so as to overlap with the image in a part of the center fascia where the driver's gaze is concentrated. The method according to claim 1,
Wherein,
And sets the distance setting value between the preceding vehicles proportionally variable according to the vehicle speed variation of the vehicle. The method according to claim 1,
Wherein,
Wherein the distance setting value between the vehicle and the preceding vehicle is variably set considering the difference in speed between the vehicle and the preceding vehicle. A method of controlling a curved display system for a vehicle, the method comprising the steps of: sensing a touch screen of a curved screen displaying an image including a vehicle function projected from a projector;
a) irradiating the curved screen with infrared light and photographing an infrared image to recognize a driver's touch gesture;
b) counting a touch duration from a touch start time according to the recognition of the touch gesture;
c) collecting position information of the front vehicle from the radar sensor; And
and d) displaying a step-by-step warning on the curved screen according to the driving risk based on the touch duration of the driver and the distance between the front vehicle and the front vehicle. 11. The method of claim 10,
The step d)
And outputting a first warning phrase to a part of the curved screen for driving safety when the touch duration of the driver exceeds the set time. The method according to claim 10 or 11,
The step d)
Outputting a two-step warning mark to a part of the curved screen if the distance between the front vehicles in the touch continuation state of the driver is less than the set first headway distance; And
And displaying a third-level warning mark having a higher risk than the second-level warning if the distance between the front vehicles in the touch continuation state of the driver is less than a second distance between the first vehicle and the second vehicle, Control method. 11. The method of claim 10,
The step d)
When the touch gesture is not recognized for a predetermined time, the warning display is terminated. In a state in which a menu or an input window of a vehicle function for which input is requested due to the driver's start of a touch is popped up, And displaying a warning in a stepwise manner. 11. The method of claim 10,
The step d)
Wherein the warning is divided into a color according to the degree of danger and displayed in a partial area of the center fascia where the driver's gaze is concentrated so as to overlap with the image.

Images