JP2018148530A - Vehicle display controller, vehicle display system, vehicle display control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make a driver appropriately check the proximity of a vehicle.SOLUTION: A vehicle display controller comprises: a video data acquisition unit 31 for acquiring video data from a camera for imaging the proximity of a vehicle; a view point detection unit 32 for acquiring a detection result from a view point sensor 4 for detecting a view point of a driver; a measurement unit 33 for measuring a time in which a rear view monitor 5 is gazed, on the basis of the view point acquired by the view point detection unit 32; and a display control unit 39 that makes video acquired by the video data acquisition unit 31 displayed on the rear view monitor 5 and, when a measurement result of the measurement unit 33 shows that a time in which the rear view monitor 5 is gazed becomes equal to or longer than a predetermined gaze time, makes video obtained by processing video acquired by the video data acquisition unit 31 so that an imaged object is emphasized displayed.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a vehicle display control device, a vehicle display system, a vehicle display control method, and a program.

  In place of the conventional optical room mirror, a technique for photographing a rear peripheral area of a vehicle with a rear camera and displaying it on a display device is known. In such a display device, it is difficult to grasp a sense of distance as compared with a conventional optical room mirror, and there is a possibility that the time for the driver to watch the display device may be longer.

  A technique is known in which a warning is issued when the driver is gazing at the monitor for 2 seconds or more, and the screen is turned off when the driver continues to watch the monitor (see, for example, Patent Document 1). A technique is known in which, when it is detected that the driver's line of sight is looking at the display means, a captured image is clearly displayed on a monitor (for example, see Patent Document 2).

JP 2001-307298 A Japanese Patent Laid-Open No. 06-233306

  It is desired that a display device installed in place of a conventional optical room mirror suppresses the driver's gazing time from becoming long and the driver appropriately checks the periphery of the vehicle. Further, the display device is required to conform to the standards defined as the safety parts, like the conventional optical room mirror.

  The present invention has been made in view of the above, and an object of the present invention is to make a driver appropriately check the periphery of a vehicle.

  In order to solve the above-described problems and achieve the object, a vehicle display control apparatus according to the present invention includes a video data acquisition unit that acquires video data from a camera that captures the surroundings of a vehicle, and a driver's viewpoint. Acquired by a viewpoint detection unit that acquires a detection result from the viewpoint detection device to be detected, a measurement unit that measures the time during which the display unit is gazing based on the viewpoint acquired by the viewpoint detection unit, and the video data acquisition unit The video data is displayed on the display unit, and when the measurement result of the measurement unit gazes at the display unit exceeds a predetermined gaze time, the video data acquisition unit acquires the video data acquired by the video data acquisition unit. And a display control unit for displaying the video data processed so as to emphasize the object to be photographed.

  A vehicle display system according to the present invention includes the vehicle display control device and at least one of the display unit, the camera, and the viewpoint detection device.

  The vehicle display control method according to the present invention includes a video data acquisition step for acquiring video data from a camera that captures the surroundings of the vehicle, and a viewpoint detection for acquiring a detection result from a viewpoint detection device that detects a driver's viewpoint. A step of measuring a time during which the display unit is watched based on the viewpoint acquired in the viewpoint detection step, and displaying the video data acquired in the video data acquisition step on the display unit, and the measurement When the time when the measurement result of the step is gazing at the display unit is equal to or longer than a predetermined gazing time, the video data processed to emphasize the object to be captured with respect to the video data acquired in the video data acquisition step Display control step for displaying.

  The program according to the present invention includes a video data acquisition step of acquiring video data from a camera that captures the surroundings of a vehicle, a viewpoint detection step of acquiring a detection result from a viewpoint detection device that detects the viewpoint of the driver, A measurement step for measuring the time during which the display unit is gazed based on the viewpoint acquired in the viewpoint detection step, and the video data acquired in the video data acquisition step are displayed on the display unit, and the measurement result of the measurement step Display the video data processed to emphasize the object to be captured with respect to the video data acquired in the video data acquisition step when the time during which the display unit is gazing is equal to or longer than a predetermined gaze time The control step is executed by a computer operating as a vehicle display control device.

  According to the present invention, there is an effect that the driver can appropriately check the periphery of the vehicle.

FIG. 1 is a schematic diagram illustrating a configuration example of a vehicle display system according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration example of the vehicle display system according to the first embodiment. FIG. 3 is a schematic diagram illustrating a line-of-sight detection device and a rear view monitor of the vehicle display system according to the first embodiment. FIG. 4 is a schematic diagram illustrating another example of the configuration example of the vehicle display system according to the first embodiment. FIG. 5 is a flowchart illustrating an example of a process flow in the vehicle display system according to the first embodiment. FIG. 6 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 7 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 8 is a block diagram illustrating a configuration example of the vehicle display system according to the second embodiment. FIG. 9 is a flowchart illustrating an example of a process flow in the vehicle display system according to the second embodiment. FIG. 10 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the second embodiment. FIG. 11 is a block diagram illustrating a configuration example of the vehicle display system according to the third embodiment. FIG. 12 is a diagram illustrating a relationship between a traveling speed and a predetermined gaze time used in processing in the vehicle display system according to the third embodiment. FIG. 13 is a flowchart illustrating an example of a process flow in the vehicle display system according to the third embodiment.

  Exemplary embodiments of a vehicle display control device 10, a vehicle display system 1, a vehicle display control method, and a program according to the present invention will be described below in detail with reference to the accompanying drawings. In addition, this invention is not limited by the following embodiment.

[First embodiment]
The vehicle display system 1 is mounted on a vehicle and displays an image obtained by photographing the rear of the vehicle. In addition to what is mounted on the vehicle, the vehicle display system 1 may be a portable device that can be used in the vehicle. FIG. 1 is a schematic diagram illustrating a configuration example of a vehicle display system according to the first embodiment. FIG. 2 is a block diagram illustrating a configuration example of the vehicle display system according to the first embodiment. FIG. 3 is a schematic diagram illustrating a line-of-sight detection device and a rear view monitor of the vehicle display system according to the first embodiment.

  As shown in FIGS. 1 to 3, the vehicle display system 1 includes a rear camera (camera) 2, a viewpoint sensor (viewpoint detection device) 4, a rear view monitor (display unit) 5, and a vehicle display control device 10. And have.

  In the present embodiment, as an example, a description will be given on the assumption that an image captured by the rear camera 2 is displayed on the rear view monitor 5. The combination of the camera and the display unit is not limited to this. In the present embodiment, the vehicle display system 1 changes the image displayed on the rear view monitor 5 when the driver is gazing at the rear view monitor 5.

  The rear camera 2 is disposed behind the vehicle and photographs the rear of the vehicle. The rear camera 2 captures a range including the range displayed on the rear view monitor 5. In other words, the rear camera 2 is shooting including a range that is not displayed on the rear view monitor 5. Therefore, the image captured by the rear camera 2 has a range in which the driver of the vehicle can properly recognize the rear using the rear view monitor 5 by the display control unit 39 of the control unit 30 of the vehicle display control device 10. It is cut out and displayed on the rear view monitor 5. The rear camera 2 outputs the captured rear video data to the video data acquisition unit 31 of the control unit 30 of the vehicle display control device 10.

  The viewpoint sensor 4 will be described with reference to FIG. The viewpoint sensor 4 detects the driver's line of sight. The viewpoint sensor 4 is disposed in the vicinity of the rear view monitor 5 so as to face the driver's seat. In the present embodiment, the viewpoint sensor 4 is disposed on the upper side of the rear view monitor 5. The viewpoint sensor 4 includes, for example, a pair of infrared cameras 41 and an infrared light emitting unit 42 configured by an infrared LED group. In the present embodiment, the viewpoint sensor 4 irradiates infrared light toward the driver's face with the infrared light emitting unit 42 and images with the pair of infrared cameras 41. Whether or not the driver's line of sight is facing the rear view monitor 5 is determined based on the driver's pupil and the position of the corneal reflection from the captured image captured by the infrared camera 41 in this way. The viewpoint sensor 4 may have another configuration having the same function. The viewpoint sensor 4 outputs the detection result to the viewpoint detection unit 32 of the control unit 30 of the vehicle display control device 10.

  1 and 2, the rear view monitor 5 is an electronic room mirror as an example. When the rear view monitor 5 is used as an electronic room mirror, it does not matter whether there is a half mirror for confirming the rear by optical reflection. The rear view monitor 5 is a display including, for example, a liquid crystal display (LCD) or an organic EL-Organic Electro-Luminescence (EL) display.

  The rear view monitor 5 is disposed at a position that is easily visible to the driver. In the present embodiment, as shown in FIG. 1, the rear view monitor 5 is disposed at the center upper portion in the vehicle width direction of the windshield S in front of the driver of the vehicle. As shown in FIG. 4, the rear view monitor 5 may be disposed at the center upper portion of the dashboard D in the vehicle width direction. FIG. 4 is a schematic diagram illustrating another example of the configuration example of the vehicle display system according to the first embodiment.

  The rear view monitor 5 displays a rear image of the vehicle based on the video signal output from the display control unit 39 of the control unit 30 of the vehicle display control device 10. The rear view monitor 5 displays the display rear image data cut out in the range equivalent to the range visually recognized by the conventional optical room mirror, in other words, in the rear cutout range.

  Returning to FIG. 2, the vehicle display control apparatus 10 includes a storage unit 20 and a control unit 30.

  The storage unit 20 stores data and various processing results required for various processes in the vehicle display control apparatus 10. The storage unit 20 is, for example, a semiconductor memory device such as a RAM (Random Access Memory), a ROM (Read Only Memory), a flash memory (Flash Memory), or a storage device such as a hard disk, an optical disk, or an external storage device via a network. It is. Alternatively, an external storage device that is wirelessly connected via a communication device (not shown) may be used.

  The control unit 30 is an arithmetic processing unit configured with, for example, a CPU (Central Processing Unit). The control unit 30 includes a video data acquisition unit 31, a viewpoint detection unit 32, a measurement unit 33, and a display control unit 39. The control unit 30 executes instructions included in the program stored in the storage unit 20. The control unit 30 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the control unit 30.

  The video data acquisition unit 31 acquires rear video data obtained by photographing the rear of the vehicle. The rear video data acquired by the video data acquisition unit 31 is, for example, video data in which images of 60 frames per second are continuous. In the present embodiment, the video data acquisition unit 31 acquires the rear video data output from the rear camera 2. The video data acquisition unit 31 outputs the acquired rear video data to the display control unit 39.

  The viewpoint detection unit 32 detects whether the driver's viewpoint is facing the display surface 5 a of the rear view monitor 5 based on the detection result of the viewpoint sensor 4. More specifically, the viewpoint detection unit 32 detects the driver's pupil and the position of corneal reflection from the captured image captured by the infrared camera 41, and the driver's viewpoint faces the display surface 5 a of the rear view monitor 5. It is determined whether or not. The viewpoint detection unit 32 outputs the detection result to the measurement unit 33.

  The measurement unit 33 measures the gaze time during which the driver is gazing at the display surface 5 a of the rear view monitor 5 based on the detection result of the viewpoint detection unit 32. The gaze time is the time from when it is detected that the viewpoint is located on the display surface 5a to when it is detected that the viewpoint is separated from the display surface 5a. The measurement unit 33 outputs the measurement result to the display control unit 39.

  The display control unit 39 generates rear video data for display from the rear video data acquired by the video data acquisition unit 31 and displays it on the rear view monitor 5. The display control unit 39 includes a video processing unit 391 and a display processing unit 399.

  The video processing unit 391 includes a cutout unit 392 that cuts out a predetermined cutout range from the video acquired by the video data acquisition unit 31, and a video processing unit 393 that processes the cutout video. The video processing unit 391 outputs the cut-out processed video to the display processing unit 399.

  The video processing unit 391 generates rear video data for display by cutting out a rear cutout range to be displayed on the rear view monitor 5 from the rear video data.

  The cutout unit 392 cuts out a predetermined range such as the center of the rear video data as display rear video data of the rear cutout range. The rear cutout range is stored in the storage unit 20 in advance. The cutout unit 392 outputs the cut out display rear video data to the video processing unit 393.

  When the driver is gazing at the rear view monitor 5, the video processing unit 393 processes the rear video data acquired by the video data acquisition unit 31 to change the display state of the video displayed on the rear view monitor 5. To do. More specifically, the video processing unit 393 determines that the time during which the driver is gazing at the rear view monitor 5 (hereinafter referred to as “gaze time”) is equal to or longer than the predetermined gaze time t1 based on the measurement result of the measurement unit 33. If the determination is made, display rear video data is generated by processing the subject to be emphasized with respect to the rear video data acquired by the video data acquisition unit 31. In the present embodiment, the predetermined gaze time t1 is, for example, about 1.0 second or more and about 2 seconds or less, preferably about 1 second. The video processing unit 393 outputs the processed rear video data for display to the display processing unit 399. Here, the object to be photographed is all or part of the video data acquired by the video data acquisition unit, and indicates an object acquired by the target data acquisition unit described later in some embodiments.

  Processing that emphasizes the subject is, for example, processing that makes the video easier to see and understand. The process for emphasizing the object to be photographed is, for example, a process for performing an edge emphasis process for enhancing the contour of the object to be photographed. Processing that emphasizes the subject is, for example, processing that changes the contrast of the subject. The process for emphasizing the subject is, for example, a process for changing the luminance of the subject. The process of emphasizing the object to be photographed may include, for example, a process of enclosing the object to be photographed with a circular icon or the like. The process of emphasizing the subject may include, for example, turning off or turning on the backlight of the rear view monitor 5 at a position corresponding to the subject. By performing such processing that emphasizes the object to be photographed, the time required for the driver to confirm necessary information is shortened.

  Such processing for emphasizing the object to be photographed is performed on all the objects to be photographed or a part of the object to be photographed included in the video displayed on the rear view monitor 5. In the present embodiment, processing that emphasizes the object to be photographed is performed on all the objects to be photographed included in the video displayed on the rear view monitor 5.

  When the driver is not gazing at the rear view monitor 5, the video processing unit 393 outputs the video to the display processing unit 399 without processing the video.

  The display processing unit 399 outputs a video signal for causing the rear view monitor 5 to output the video generated by the video processing unit 391.

  Next, the flow of processing by the control unit 30 will be described with reference to FIG. FIG. 5 is a flowchart illustrating an example of a process flow in the vehicle display system according to the first embodiment.

  The control unit 30 acquires a camera shot image (step ST11). More specifically, the control unit 30 causes the video data acquisition unit 31 to acquire the rear video data output from the rear camera 2.

  The control unit 30 cuts out the video (step ST12). More specifically, the control unit 30 performs a cutting process of cutting out a predetermined cutting range from the rear video data by the cutting unit 392.

  The control unit 30 starts viewpoint detection (step ST13). More specifically, the control unit 30 acquires the detection result of the viewpoint sensor 4 by the viewpoint detection unit 32 and starts detecting the driver's viewpoint. Then, the control unit 30 causes the measurement unit 33 to measure the gaze time. The control unit 30 proceeds to step ST14.

  The control unit 30 determines whether or not the display surface 5a of the rear view monitor 5 is watched for a predetermined gaze time t1 or more (step ST14). More specifically, the control unit 30 determines whether or not the gaze time is equal to or longer than the predetermined gaze time t1 based on the measurement result of the measurement unit 33. When it is determined that the gaze time is equal to or longer than the predetermined gaze time t1 (Yes in step ST14), the control unit 30 proceeds to step ST15. When it is determined that the gaze time is not equal to or longer than the predetermined gaze time t1 (No in step ST14), the control unit 30 proceeds to step ST16.

  The control unit 30 performs video enhancement processing (step ST15). More specifically, the control unit 30 causes the video processing unit 393 to process the object to be emphasized to generate display rear video data. For example, the control unit 30 causes the video processing unit 393 to perform a contour enhancement process for enhancing the contour of the object to be captured on the rear video data to generate the rear video data for display. For example, the control unit 30 may cause the video processing unit 393 to generate the display rear video data by changing the contrast of the object to be captured with respect to the rear video data. For example, the control unit 30 may cause the video processing unit 393 to generate the rear video data for display by changing the luminance of the object to be captured with respect to the rear video data. For example, the control unit 30 may cause the video processing unit 393 to process the rear video data by enclosing the object to be captured with a circular icon or the like to generate display rear video data. . For example, the control unit 30 may cause the video processing unit 393 to turn off or turn on the backlight of the rear view monitor 5 at a position corresponding to the object to be photographed. The control unit 30 proceeds to step ST16.

  The control unit 30 displays the rear video data (step ST16). More specifically, the control unit 30 causes the display processing unit 399 to display the rear video data on the rear view monitor 5. The control unit 30 proceeds to step ST17.

  The control unit 30 determines whether or not to end the rear display (step ST17). More specifically, for example, when ending the vehicle display system 1, the control unit 30 determines to end the rear display (Yes in step ST17). The control unit 30 determines that the rear display is not terminated when the vehicle display system 1 is not terminated (No in step ST17). For example, when detecting an operation to end the rear display by the driver, the control unit 30 may determine to end the rear display (Yes in step ST17). For example, the control unit 30 may determine that the rear display is not terminated when the operation for ending the rear display by the driver is not detected (No in step ST17).

  The control unit 30 repeats such processing at predetermined intervals such as every frame or every predetermined frame.

  An image displayed on the rear view monitor 5 of the vehicle display system 1 will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment. FIG. 7 is a diagram illustrating another example of an image displayed on the rear view monitor of the vehicle display system according to the first embodiment.

  The video shown in FIG. 6 is a video that has not been processed to emphasize the subject.

  The video shown in FIG. 7 is a video obtained by processing the video shown in FIG. 6 so as to emphasize the subject. In the present embodiment, the contour emphasis process for emphasizing the contour is executed for all the objects included in the video. As a result, the image shown in FIG. 7 is an enhanced image in which each object is easier to see than the image shown in FIG. The video shown in FIG. 7 is a video that makes it easier for the driver to recognize the subject in a shorter time than the video shown in FIG.

  As described above, according to the present embodiment, when the driver is gazing at the rear view monitor 5, the rear image data for display is generated and displayed on the rear view monitor 5 by processing the subject to be emphasized. According to this embodiment, it is possible to display such that the time required for the driver to confirm necessary information is shortened. According to the present embodiment, the driver can obtain necessary information by aligning the viewpoint with the rear view monitor 5 for a short time, and can display such that the viewpoint can be immediately returned to the front of the vehicle. As described above, according to the present embodiment, the driver can be appropriately checked around the vehicle. In the present embodiment, since the driver is prevented from gazing at the rear view monitor 5, it is possible to make it possible to safely check the surroundings of the vehicle.

  According to the present embodiment, when the driver is gazing at the rear view monitor 5, the display on the rear view monitor 5 is changed. As described above, according to the present embodiment, it is possible to recognize that the driver is gazing at the rear view monitor 5 by changing the display of the rear view monitor 5. In the present embodiment, it is possible to provide a display that can prompt the driver to return the viewpoint to the front of the vehicle or the like by recognizing that the driver is gazing at the rear view monitor 5. Thereby, according to this embodiment, a driver | operator can be made to confirm the periphery of a vehicle appropriately.

  In the present embodiment, when the driver is gazing at the rear view monitor 5, the rear view monitor 5 continues to display the rear image as compared with the case where the rear view monitor 5 is not displayed. The state in which the safety around the vehicle can be confirmed can be maintained. As described above, according to the present embodiment, the rear view monitor 5 conforms to the standard defined as the safety part and can prevent the rearward confirmation of the vehicle from being hindered.

[Second Embodiment]
A vehicle display system 1A according to the present embodiment will be described with reference to FIGS. FIG. 8 is a block diagram illustrating a configuration example of the vehicle display system according to the second embodiment. FIG. 9 is a flowchart illustrating an example of a process flow in the vehicle display system according to the second embodiment. FIG. 10 is a diagram illustrating an example of an image displayed on the rear view monitor of the vehicle display system according to the second embodiment.

  As shown in FIG. 8, the vehicle display system 1A has the same basic configuration as the vehicle display system 1 of the first embodiment. In the following description, the detailed description of the same components as those of the vehicle display system 1 is omitted. The vehicle display system 1A is different from the vehicle display system 1 of the first embodiment in that the vehicle display system 1A has an approaching vehicle sensor 6A or acquires vehicle information approaching the host vehicle by image processing. The vehicle display system 1A is different from the vehicle display system 1 of the first embodiment in the processing in the control unit 30A of the vehicle display control device 10A.

  The approaching vehicle sensor 6A is a sensor that detects an object such as a vehicle approaching the host vehicle. The approaching vehicle sensor 6A can detect a symmetrical object in a range included in the rear video data for display. The approaching vehicle sensor 6A includes, for example, a plurality of sensors such as a front sensor, a rear sensor, a left side sensor, and a right side sensor. The approaching vehicle sensor 6A detects an object using, for example, an infrared sensor, an ultrasonic sensor, a millimeter wave sensor, a sensor based on image recognition, or the like. The approaching vehicle sensor 6A outputs the detected object information of the object to the approaching vehicle data acquisition unit (object data acquisition unit) 35A of the control unit 30A of the vehicle display control device 10A. In the present embodiment, the object is a vehicle.

  The control unit 30A includes a video data acquisition unit 31, a viewpoint detection unit 32, a measurement unit 33, an approaching vehicle data acquisition unit 35A, and a display control unit 39A.

  Based on the object information acquired from the approaching vehicle sensor 6A, the approaching vehicle data acquisition unit 35A determines the direction of the vehicle based on the attachment position of the sensor that outputs the object information and the detection range of the object by the sensor. Get subdivided. The approaching vehicle data acquisition unit 35A acquires the distance of the vehicle to the host vehicle from the object information. And approaching vehicle data acquisition part 35A detects the vehicle which approaches the own vehicle based on the change of the distance with respect to the own vehicle about the detected vehicle.

  The approaching vehicle data acquisition unit 35A may acquire a vehicle approaching the host vehicle by image processing without using the approaching vehicle sensor 6A. More specifically, the approaching vehicle data acquisition unit 35 </ b> A is an object that is recognized as the front side of the vehicle by using a recognition dictionary that can discriminate between the front side and the rear side of the vehicle with respect to the video data acquired by the video data acquisition unit 31. Get things. And approaching vehicle data acquisition part 35A detects the vehicle which approaches the own vehicle based on the change of the magnitude | size of the image | video of the vehicle in the image | video for every flame | frame about the detected vehicle.

  Further, the approaching vehicle data acquisition unit 35A may acquire a vehicle existing around the host vehicle, in other words, a vehicle close to the host vehicle, by the approaching vehicle sensor 6A or image processing. In this case, a vehicle existing in the vicinity of the host vehicle is detected based on the distance between the host vehicle and the other vehicle. At this time, the detection target is not limited to the other vehicle, and an obstacle existing around the host vehicle may be detected.

  When the driver is gazing at the rear view monitor 5, the display control unit 39A displays an image processed so as to emphasize the vehicle detected by the approaching vehicle data acquisition unit 35A.

  The video processing unit 391A includes a cutout unit 392A, a video processing unit 393A, and an approaching vehicle recognition unit 394A.

  The cutout portion 392A is configured in the same manner as the cutout portion 392 of the first embodiment. The cutout unit 392A outputs the cutout display rear image data to the approaching vehicle recognition unit 394A.

  When the video processing unit 393A determines that the gaze time is equal to or greater than the predetermined gaze time t1 based on the measurement result of the measurement unit 33, the rear image for display processed to emphasize the vehicle recognized by the approaching vehicle recognition unit 394A Generate data.

  Furthermore, the image processing unit 393A generates an image in which an object to be photographed other than the vehicle recognized by the approaching vehicle recognition unit 394A when the driver is gazing at the rear view monitor 5 is processed unclearly with respect to the detected vehicle. May be.

  The approaching vehicle recognition unit 394A extracts the approaching vehicle acquired by the approaching vehicle data acquisition unit 35A from the video data acquired by the video data acquisition unit 31. The approaching vehicle recognizing unit 394A outputs the rear video data for display including the information of the extracted other vehicle to the video processing unit 393A.

  Next, the flow of processing by the control unit 30A will be described with reference to FIG. Steps ST21 to ST24 and step ST30 perform the same processes as steps ST11 to ST14 and step ST17 of the first embodiment.

  Control unit 30A detects an approaching vehicle (step ST25). More specifically, the control unit 30A acquires the object information output by the approaching vehicle sensor 6A at the approaching vehicle data acquisition unit 35A.

  Control unit 30A determines whether or not there is a vehicle approaching the host vehicle (step ST26). When there is a vehicle approaching the host vehicle based on the object information acquired by the approaching vehicle data acquisition unit 35A (Yes in step ST26), the control unit 30A proceeds to step ST27. If there is no vehicle approaching the host vehicle based on the object information acquired by the approaching vehicle data acquisition unit 35A (No in step ST26), the control unit 30A proceeds to step ST29.

  Control unit 30A extracts an image of the approaching vehicle (step ST27). More specifically, the control unit 30A causes the approaching vehicle recognition unit 394A to acquire the image of the approaching vehicle from the rear image data acquired by the image data acquisition unit 31.

  The control unit 30A performs enhancement processing of the image of the approaching vehicle (step ST28). More specifically, the control unit 30A causes the video processing unit 393A to process the rear video data acquired by the video data acquisition unit 31 so as to emphasize an approaching vehicle and generate display rear video data. For example, in the video processing unit 393A, the control unit 30A performs a contour emphasis process for emphasizing the contour of the approaching vehicle on the rear video data to generate the rear video data for display. For example, the control unit 30A may cause the video processing unit 393A to generate the display rear video data by changing the contrast of the approaching vehicle with respect to the rear video data. For example, the control unit 30A may cause the video processing unit 393A to generate the rear video data for display by changing the brightness of the approaching vehicle with respect to the rear video data. For example, the control unit 30A may cause the video processing unit 393A to process the rear video data so that the approaching vehicle is surrounded by a round icon or the like to generate the rear video data for display. For example, the control unit 30A may turn on the backlight of the rear view monitor 5 at a position corresponding to the approaching vehicle using the image processing unit 393A. Control unit 30A proceeds to step ST29.

  The control unit 30A displays the rear video data (step ST29). More specifically, the control unit 30A causes the display processing unit 399 to display the rear video data for display on the rear view monitor 5. Control unit 30A proceeds to step ST30.

  An image displayed on the rear view monitor 5 of the vehicle display system 1A will be described with reference to FIG.

  The image shown in FIG. 10 is an image obtained by processing the image shown in FIG. 6 so as to emphasize the approaching vehicle V in the subject. As a result, the approaching vehicle V is easier to see and emphasized than the image shown in FIG. The video shown in FIG. 10 is a video that makes it easier for the driver to recognize the approaching vehicle V in a shorter time than the video shown in FIG.

  As described above, according to this embodiment, when the driver is gazing at the rear view monitor 5, the rear view monitor 5 generates display rear image data by processing to emphasize an approaching vehicle approaching the host vehicle. To display. According to this embodiment, it is possible to display such that the time required for the driver to check the approaching vehicle is shortened. According to the present embodiment, the driver can obtain necessary information regarding the approaching vehicle by bringing the viewpoint to the rear view monitor 5 for a short period of time, and can display the information so that the viewpoint can be immediately returned to the front of the vehicle. it can. As described above, according to the present embodiment, the driver can be appropriately checked around the vehicle. In the present embodiment, since the driver is prevented from gazing at the rear view monitor 5, it is possible to make it possible to safely check the surroundings of the vehicle.

  According to the present embodiment, the approaching vehicle that requires more confirmation by the driver is highlighted and displayed. According to the present embodiment, it is possible to display an approaching vehicle that allows the driver to more easily confirm an approaching vehicle that is a subject to be confirmed than other subjects.

[Third embodiment]
The vehicle display system 1B according to the present embodiment will be described with reference to FIGS. FIG. 11 is a block diagram illustrating a configuration example of the vehicle display system according to the third embodiment. FIG. 12 is a diagram illustrating a relationship between a traveling speed and a predetermined gaze time used in processing in the vehicle display system according to the third embodiment. FIG. 13 is a flowchart illustrating an example of a process flow in the vehicle display system according to the third embodiment.

  The vehicle display system 1B of the present embodiment is different from the vehicle display system 1 of the first embodiment in the processing in the control unit 30B.

  The control unit 30B includes a video data acquisition unit 31, a viewpoint detection unit 32, a measurement unit 33, a travel state acquisition unit 34B, and a display control unit 39B.

  The control unit 30B varies the predetermined gaze time (gaze determination threshold) t1 according to the traveling speed of the vehicle. For example, the predetermined gaze time t1 may be 3 seconds when the vehicle traveling speed is 40 km / h or less, and may be 2 seconds when the vehicle traveling speed is greater than 40 km / h.

  Alternatively, as shown in FIG. 12, the predetermined gaze time t1 may be set shorter as the traveling speed of the vehicle is higher. The relationship between the traveling speed of the vehicle and the predetermined gaze time t1 is stored in the storage unit 20 in advance.

  As indicated by the solid line, the predetermined gaze time t1 may be set in a straight line so as to become shorter as the traveling speed of the vehicle increases. In the present embodiment, the predetermined gaze time t1 is set to, for example, 2 seconds when the vehicle traveling speed is 20 km / h, and the predetermined gaze time t1 is set to, for example, 1 second when the vehicle traveling speed is 120 km / h.

  The predetermined gaze time t <b> 1 may be set in a staircase shape so that the predetermined gaze time t <b> 1 becomes shorter as the traveling speed of the vehicle increases. In this embodiment, when the vehicle traveling speed is 20 km / h or more and less than 40 km / h, the predetermined gaze time t1 is, for example, 2 seconds, and when the vehicle traveling speed is 40 km / h or more and less than 80 km / h, the predetermined gaze time t1. For example, when the vehicle travel speed is 80 km / h or more and less than 120 km / h, the predetermined gaze time t1 is set to 1 second, for example.

  In the present embodiment, the predetermined gaze time t1 is not set when the vehicle traveling speed is less than 20 km / h and not less than 120 km / h. The predetermined gaze time t1 is the same as the vehicle traveling speed of 20 km / h when the vehicle traveling speed is less than 20 km / h, and the vehicle traveling speed is 120 km / h when the vehicle traveling speed is 120 km / h or more. The same value may be used.

  Accordingly, in this embodiment, the display control unit 39B changes the display state of the video displayed on the rear view monitor 5 when it is determined that the gaze time is equal to or longer than the predetermined gaze time t1 that is shorter as the traveling speed of the vehicle is higher. Let

  The traveling state acquisition unit 34B is connected to a CAN (Controller Area Network) provided in the vehicle and acquires OBD (On Board Diagnostics) II data and the like, thereby acquiring traveling information indicating the traveling state of the vehicle including the vehicle speed. . The traveling state acquisition unit 34B outputs the acquired traveling information to the display control unit 39B.

  Next, the flow of processing by the control unit 30B will be described with reference to FIG. The control unit 30B performs processing according to the flowchart of the first embodiment, and steps ST42, ST43, and steps ST47 to S51 perform the same processing as in the first embodiment.

  The control unit 30B sets a gaze determination threshold value (step ST41). More specifically, the control unit 30B sets an initial value of a threshold value for the predetermined gaze time t1. In the present embodiment, for example, the initial value of the predetermined gaze time t1 is 2 seconds.

  Control unit 30B detects the host vehicle speed (step ST44). More specifically, the control unit 30B acquires vehicle information including the vehicle speed at the traveling state acquisition unit 34B.

  Control unit 30B determines whether or not the host vehicle speed is equal to or lower than a predetermined speed (step ST45). In the present embodiment, the control unit 30B proceeds to step ST46 when the host vehicle speed is 40 km / h or less based on the acquired vehicle information (Yes in step ST45). Control unit 30B proceeds to step 47 when the own vehicle speed is higher than 40 km / h based on the acquired vehicle information (No in step ST45).

  Control unit 30B changes the threshold value for gaze determination (step ST46). More specifically, when the host vehicle speed is 40 km / h or less (Yes in step ST45), control unit 30B delays the threshold of predetermined gaze time t1 to 3 seconds. Control unit 30B proceeds to step ST47.

  Control unit 30B determines whether or not the user is gazing for a predetermined gaze time t1 or more set corresponding to the traveling speed (step ST48). More specifically, the control unit 30B causes the storage unit 20 to acquire a predetermined gaze time t1 set in accordance with the traveling speed of the vehicle, based on the traveling information acquired by the traveling state acquisition unit 34B. Then, the control unit 30B determines based on the measurement result of the measurement unit 33 whether or not the acquired gaze time is equal to or longer than the predetermined gaze time t1.

  As described above, according to the present embodiment, when the driver is gazing at the rear view monitor 5 for the predetermined gazing time t1 or more set corresponding to the traveling speed, the display on the rear view monitor 5 is changed. In the present embodiment, the gaze time is set shorter as the traveling speed of the vehicle is faster. The faster the vehicle travels, the longer the travel distance per unit time. The moving distance of the vehicle becomes longer while gazing at the rear view monitor 5. For this reason, the front can be recognized more appropriately by comparing the gaze time with the predetermined gaze time t1 that is shorter as the traveling speed of the vehicle is higher. As described above, according to the present embodiment, the driver can be more appropriately confirmed around the vehicle.

  Each component of the illustrated vehicle display system 1 is functionally conceptual, and may not necessarily be physically configured as illustrated. That is, the specific form of each device is not limited to the one shown in the figure, and all or a part of them is functionally or physically distributed or integrated in arbitrary units according to the processing load or usage status of each device. May be.

  The configuration of the vehicle display system 1 is realized by, for example, a program loaded into a memory as software. The above embodiment has been described as a functional block realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  The components described above include those that can be easily assumed by those skilled in the art and those that are substantially the same. Furthermore, the structures described above can be appropriately combined. In addition, various omissions, substitutions, or changes in the configuration can be made without departing from the scope of the present invention.

  The vehicle display system 1 may alert the driver with sound or light when changing the display of the rear view monitor 5. More specifically, the vehicular display system 1 may output an alarm sound from a speaker arranged around the rear view monitor 5. The vehicle display system 1 may turn on a notification lamp disposed around the rear view monitor 5. The vehicle display system 1 may blink an object of the display rear video data, an icon surrounding the object, or the like.

  The vehicle display system 1 uses the viewpoint sensor 4 to acquire an object to be photographed corresponding to the position where the driver is gazing on the display surface 5a of the rear view monitor 5, and emphasizes the object to be photographed. The processed image may be displayed on the rear view monitor 5.

  The vehicle display system 1 may be executed by combining the first embodiment to the third embodiment when the driver is gazing at the rear view monitor 5 repeatedly. For example, when the vehicle display system 1 first executes the process shown in the flowchart of the first embodiment and then determines that the driver gazes at the rear view monitor 5 again, the process shown in the flowchart of the second embodiment is performed. May be executed. Thereby, when the driver is gazing at the rear view monitor 5 repeatedly, the way of changing the display of the rear view monitor 5 can be changed. By doing in this way, it can be made to recognize more reliably that the driver was gazing at the rear view monitor 5.

  The vehicle display system 1 displays the rear video data for display processed to emphasize the object to be photographed on the rear view monitor 5, and then ends the emphasized display when the driver removes the viewpoint from the rear view monitor 5. Display rear video data that does not emphasize the object to be photographed may be displayed on the rear view monitor 5. Alternatively, the vehicle display system 1 may continue the emphasized display as it is after displaying the rear video data for display processed so as to emphasize the subject on the rear view monitor 5. By continuing the highlighted display as it is, the state where the driver can check the rear view monitor 5 in a short time is continued.

1 Display system for vehicles 2 Rear camera (camera)
4. Viewpoint sensor (viewpoint detection device)
5 Rear view monitor (display unit)
DESCRIPTION OF SYMBOLS 10 Vehicle display control apparatus 30 Control part 31 Image | video data acquisition part 32 View point detection part 33 Measurement part 39 Display control part 391 Image | video process part 392 Cut-out part 393 Image | video process part 399 Display process part t1 predetermined gaze time

Claims (11)

A video data acquisition unit that acquires video data from a camera that captures the surroundings of the vehicle;
A viewpoint detection unit that acquires a detection result from a viewpoint detection device that detects the viewpoint of the driver;
A measuring unit that measures the time during which the display unit is gazing based on the viewpoint acquired by the viewpoint detection unit;
When the video data acquired by the video data acquisition unit is displayed on the display unit, and when the measurement result of the measurement unit gazes at the display unit exceeds a predetermined gaze time, the video data acquisition is performed. A display control unit that displays video data processed to emphasize the object to be captured with respect to the video data acquired by the unit;
A vehicle display control device comprising: The display control unit, when the measurement result of the measurement unit is gazing at the display unit is equal to or longer than a predetermined gaze time, all the objects included in the video data displayed on the display unit Display the processed video data to emphasize
The vehicle display control apparatus according to claim 1. The display control unit, when the measurement result of the measurement unit is gazing at the display unit is equal to or longer than a predetermined gaze time, a part of the object included in the video data displayed on the display unit Display the processed video data to emphasize
The vehicle display control apparatus according to claim 1. An object data acquisition unit that acquires object data of an object approaching the host vehicle,
In addition,
The display control unit is processed to emphasize the object detected by the object data acquisition unit when the measurement result of the measurement unit is equal to or longer than a predetermined gaze time. Display video data,
The vehicle display control apparatus according to claim 3. An object data acquisition unit for acquiring object data of objects existing around the vehicle,
In addition,
The display control unit is processed to emphasize the object detected by the object data acquisition unit when the measurement result of the measurement unit is equal to or longer than a predetermined gaze time. Display video data,
The vehicle display control apparatus according to claim 3. The display control unit is configured such that when the measurement result of the measurement unit is gazing at the display unit for a predetermined gaze time or longer, the driver pays attention to the detection result of the viewpoint detection unit. Display the processed video data to emphasize the detected object.
The vehicle display control apparatus according to claim 3. The display control unit, when the measurement result of the measurement unit is gazing at the display unit is equal to or longer than a predetermined gaze time, the object to be photographed other than the detected object is detected with respect to the detected object. Display unclearly processed video data,
The vehicle display control apparatus according to any one of claims 4 to 6. The vehicle further includes a traveling state acquisition unit that acquires a traveling state of the vehicle,
The display control unit varies the predetermined gaze time according to a traveling speed of the vehicle.
The display control apparatus for vehicles as described in any one of Claim 1 to 7. A vehicle display control device according to any one of claims 1 to 8,
A vehicle display system comprising at least one of the display unit, the camera, and the viewpoint detection device. A video data acquisition step of acquiring video data from a camera that captures the surroundings of the vehicle;
A viewpoint detection step for obtaining a detection result from a viewpoint detection device for detecting the viewpoint of the driver;
A measurement step of measuring a time during which the display unit is gazed based on the viewpoint acquired in the viewpoint detection step;
The video data acquired in the video data acquisition step is displayed on the display unit, and the video data acquisition is performed when the measurement result of the measurement step is equal to or longer than a predetermined gaze time. A display control step for displaying the processed video data so as to emphasize the object to be captured in the step;
The vehicle display control method characterized by including. A video data acquisition step of acquiring video data from a camera that captures the surroundings of the vehicle;
A viewpoint detection step for obtaining a detection result from a viewpoint detection device for detecting the viewpoint of the driver;
A measurement step of measuring a time during which the display unit is gazed based on the viewpoint acquired in the viewpoint detection step;
The video data acquired in the video data acquisition step is displayed on the display unit, and the video data acquisition is performed when the measurement result of the measurement step is equal to or longer than a predetermined gaze time. A display control step for displaying the processed video data so as to emphasize the object to be captured in the step;
For causing a computer that operates as a display control device for a vehicle to execute.