JP7200652B2 - Notification control device, electronic mirror device, notification control method, notification control program - Google Patents

Description

The present invention relates to a notification control device, an electronic mirror device, a notification control method, and a notification control program.

2. Description of the Related Art A technique related to an electronic mirror that displays an image of the rear of a vehicle is known instead of an optical rearview mirror.

For example, Patent Literature 1 discloses a vehicle display device that highlights an object in an image displayed on a display unit based on the driver's line of sight to the display unit that displays an image from an in-vehicle camera. there is

JP 2018-162030 A

For example, an occupant of a motorcycle traveling in parallel with a vehicle equipped with a conventional optical rearview mirror can confirm the presence of the driver based on the direction of the driver's line of sight and face reflected in the rearview mirror. It judges the situation such as whether In this case, if the rider of the motorcycle determines that the driver has not confirmed his presence, he or she will move away from the vehicle or move to a position where it can be easily seen from the vehicle to increase safety. rice field. However, the computerization of the rearview mirror makes it impossible for a motorcycle rider or the like to check the driver's situation through the rearview mirror.

An object of the present invention is to provide a notification control device, an electronic mirror device, a notification control method, and a notification control program capable of improving safety in a vehicle equipped with an electronic mirror.

The notification control device of the present invention includes: a visual information acquisition unit for detecting that a driver of the vehicle has visually viewed a display unit that displays image data captured by a camera that captures the rear of the vehicle; and the visual information acquisition unit. However, when it is detected that the driver of the vehicle has viewed the display unit, the information indicating that the driver has viewed the display unit is notified by a notification unit that visually notifies the exterior of the vehicle. and a notification control unit.

The electronic mirror device of the present invention includes the notification control device of the present invention, the camera, a line-of-sight detection unit that detects the line of sight of the driver of the vehicle and outputs detected line-of-sight information to the visual information acquisition unit, and the notification unit.

The notification control method of the present invention includes a visual information acquisition step of detecting that the driver of the vehicle has visually viewed a display unit that displays video data captured by a camera that captures the rear of the vehicle; and the visual information acquisition step. When it is detected that the driver of the vehicle has viewed the display unit, information indicating that the driver has viewed the display unit is notified by a notification unit that visually notifies the exterior of the vehicle. and a notification control step.

The notification control program of the present invention comprises: a visual information acquisition step of detecting that the driver of the vehicle has visually viewed a display section displaying video data captured by a camera that captures the rear of the vehicle; and the visual information acquisition step. When it is detected that the driver of the vehicle has viewed the display unit, information indicating that the driver has viewed the display unit is notified by a notification unit that visually notifies the exterior of the vehicle. and causing the computer to perform a notification control step.

ADVANTAGE OF THE INVENTION According to this invention, the safety in the vehicle provided with the electronic mirror can be improved.

FIG. 1 is a schematic diagram showing an example of the configuration of the electronic mirror device according to the first embodiment. FIG. 2 is a schematic diagram showing an example of the configuration of the electronic mirror device according to the first embodiment. FIG. 3 is a block diagram showing an example of the configuration of the electronic mirror device according to the first embodiment. FIG. 4 is a schematic diagram for explaining an example of a method of notifying information indicating that the driver has viewed the display unit. FIG. 5 is a schematic diagram for explaining an example of a method of notifying information indicating that the driver has viewed the display unit. FIG. 6 is a schematic diagram for explaining an example of a method of notifying information indicating that the driver has viewed the display unit. FIG. 7 is a flow chart showing an example of the flow of processing of the notification control device according to the first embodiment. FIG. 8 is a block diagram showing an example of the configuration of the electronic mirror device according to the second embodiment. FIG. 9 is a flow chart showing an example of the flow of processing of the notification control device according to the second embodiment.

DETAILED DESCRIPTION OF THE INVENTION Embodiments according to the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the present invention is not limited by this embodiment, and when there are a plurality of embodiments, a combination of each embodiment is also included.

[First embodiment]
The configuration of the electronic mirror device according to the first embodiment will be described with reference to FIGS. 1, 2, and 3. FIG. FIG. 1 is a schematic diagram showing an example of the configuration of the electronic mirror device according to the first embodiment. FIG. 2 is a schematic diagram showing an example of the configuration of the electronic mirror device according to the first embodiment. FIG. 3 is a block diagram showing an example of the configuration of the electronic mirror device according to the first embodiment.

As shown in FIGS. 1 to 3, the electronic mirror device 1 includes a camera 10, a display unit 20, a line-of-sight detection unit 30, a notification unit 40, a storage unit 50, and a notification control device (control unit) 100. Prepare.

The camera 10 is a camera for photographing the rear of the vehicle M, and photographs the rear, left rear, and right rear of the vehicle M. The camera 10 is composed of, for example, a rear camera 11, a left side camera 12, and a right side camera 13. As shown in FIG.

The rear camera 11 is provided behind the vehicle M. As shown in FIG. Specifically, the rear camera 11 is provided so as to face the rear of the vehicle M, and photographs the rear of the vehicle M. As shown in FIG. The direction and angle of the rearward camera 11 can be arbitrarily set. The rear camera 11 outputs the captured rear image data to the image data acquisition unit 110 of the notification control device 100 .

The left side camera 12 is provided on the left side of the vehicle M. Specifically, the left side camera 12 is provided so as to face the rear left side of the vehicle M, and photographs the rear left side of the vehicle M. As shown in FIG. The direction and angle at which the left side camera 12 faces can be set arbitrarily. The left side camera 12 outputs the photographed data of the rear left side to the image data acquisition unit 110 of the notification control device 100 .

The right side camera 13 is provided on the right side of the vehicle M. Specifically, the right side camera 13 is provided so as to face the rear right side of the vehicle M, and photographs the rear right side of the vehicle M. As shown in FIG. The direction and angle at which the right side camera 13 faces can be set arbitrarily. The right side camera 13 outputs the photographed data of the rear right side to the image data acquisition unit 110 of the notification control device 100 .

The display unit 20 displays image data of the rear of the vehicle M, image data of the left rear, and image data of the right rear. The display unit 20 is composed of, for example, a rear monitor 21 , a left side monitor 22 and a right side monitor 23 . The rear monitor 21, the left side monitor 22, and the right side monitor 23, which constitute the display unit 20, are realized by a display such as a liquid crystal display (LCD) or an organic EL (organic electro-luminescence) display. be able to.

The rear monitor 21 displays image data behind the vehicle M. FIG. Specifically, the rear monitor 21 displays video data captured by the rear camera 11 under the control of the display control unit 120, for example. The rear monitor 21 is provided at a position where the driver of the vehicle M can visually recognize it. For example, the rear monitor 21 is provided in the upper center of the windshield S so that the driver of the vehicle M can easily visually recognize it.

The left side monitor 22 displays video data of the rear left side of the vehicle M. FIG. Specifically, the left side monitor 22 displays image data captured by the left side camera 12 under the control of the display control unit 120, for example. is provided. For example, the left side monitor 22 is provided on the left side of the dashboard D so that the driver of the vehicle M can easily view it.

The right side monitor 23 displays video data of the right rear of the vehicle M. FIG. Specifically, the right side monitor 23 displays video data captured by the right side camera 13 under the control of the display control unit 120, for example. The right side monitor 23 is provided at a position where the driver of the vehicle M can visually recognize it. For example, the right side monitor 23 is provided on the right side of the dashboard D so that the driver of the vehicle M can easily visually recognize it.

The line-of-sight detection unit 30 detects the line-of-sight direction of the driver of the vehicle M. FIG. Specifically, the line-of-sight detection unit 30 detects the driver's line of sight to the rear monitor 21, the left side monitor 22, and the right side monitor 23, for example. The line-of-sight detection unit 30 acquires the line-of-sight direction of the driver including the direction to the rear monitor 21, the left side monitor 22, and the right side monitor 23 as line-of-sight information as well as the information on the time during which the line of sight is directed. output to 130. In FIG. 2, a single line-of-sight detection unit 30 is provided on the dashboard D, but a plurality of line-of-sight detection units 30 are provided in the vicinity of each of the rear monitor 21, left side monitor 22, and right side monitor 23. may be

The line-of-sight detection unit 30 is a so-called line-of-sight sensor, and any existing line-of-sight detection method can be applied. For example, the line-of-sight detection unit 30 includes an infrared light emitting device and an infrared camera. output to Further, as another example of the line-of-sight detection unit 30 , a visible light camera that captures an image of the driver's face is provided, and the captured image data is output to the visual information acquisition unit 130 .

The notification unit 40 notifies the outside of the vehicle M of various information. The notification unit 40 visually notifies the outside of the vehicle M of information indicating that the driver has viewed the display unit 20, for example. The notification unit 40 includes, for example, at least one of a display unit that displays characters, a light emission unit that emits light, and a projection unit that projects light. The notification unit 40 displays characters, emits light, or projects light under the control of the notification control unit 140 .

The notification unit 40 is provided near the camera 10 . A notification unit 40 for notifying information indicating that the driver has viewed the left side monitor 22 is provided near the left side camera 12 . A notification unit 40 for notifying information indicating that the driver has viewed the right side monitor 23 is provided near the right side camera 13 . A notification unit 40 for notifying information indicating that the driver has viewed the rear monitor 21 is provided near the rear camera 11 .

The storage unit 50 stores, for example, programs for realizing each unit of the notification control device 100 . In this case, the notification control device 100 expands and executes the programs stored in the storage unit 50 to implement the functions of the respective units. The storage unit 50 can be realized by, for example, a semiconductor memory device such as RAM (Random Access Memory), ROM (Read Only Memory), or flash memory, or a storage device such as a hard disk, solid state drive, or optical disk. can be done.

Notification control device 100 includes image data acquisition unit 110 , display control unit 120 , visual information acquisition unit 130 , and notification control unit 140 . The notification control device 100 expands and executes the programs stored in the storage unit 50, thereby realizing the functions of each unit. The notification control device 100 can be realized, for example, by an electronic circuit including a CPU (Central Processing Unit).

The video data acquisition unit 110 acquires various video data. The image data acquisition unit 110 acquires image data captured by the rear camera 11, the left side camera 12, and the right side camera 13, for example. The video data acquisition unit 110 outputs the acquired video data to the display control unit 120 .

If the line-of-sight detection unit 30 is equipped with an infrared camera or a visible light camera, the image data acquisition unit 110 acquires the image data from the line-of-sight detection unit 30 and outputs the image data to the visual information acquisition unit 130. may be

The display control section 120 displays various image data on the display section 20 . The display control unit 120 displays, for example, an image behind the vehicle M captured by the rear camera 11 on the rear monitor 21 . The display control unit 120 displays, on the left side monitor 22, an image of the rear left side of the vehicle M captured by the left side camera 12, for example. The display control unit 120 displays, on the right side monitor 23, an image of the rear right side of the vehicle M captured by the right side camera 13, for example.

The visual line information acquisition unit 130 acquires line-of-sight information of the driver from the line-of-sight detection unit 30 . The visual information acquisition unit 130 detects that the driver has visually observed the left side monitor 22, the right side monitor 23, and the rear monitor 21 from the line of sight information. Specifically, the visual information acquisition unit 130 acquires, for example, video data of the driver captured from the line-of-sight detection unit 30, and recognizes the eye part from the acquired video data. When the acquired image data is image data obtained by a visible light camera, the visual information acquiring unit 130, for example, determines the left side monitor 22, the right side monitor 23, and the right side monitor 23 based on the positional relationship between the inner corner of the eye and the iris in the recognized eye part. Whether or not the line of sight is directed to the rear monitor 21 is detected, and the time during which the line of sight is directed to the left side monitor 22, the right side monitor 23 and the rear monitor 21 is detected. When the acquired image data is image data obtained by an infrared camera, the visual information acquisition unit 130 selects the left side monitor 22, the right side monitor 23, and the rear monitor 21 from the positional relationship between the pupil and the corneal reflection, for example. Whether or not the line of sight is directed, and further, the time during which the line of sight is directed to the left side monitor 22, the right side monitor 23, and the rear monitor 21 is detected.

The visual information acquisition unit 130 detects, for example, that the driver has visually observed the left side monitor 22, the right side monitor 23, and the rear monitor 21 for a predetermined time or longer. For the predetermined time, for example, the driver looks at any one of the left side monitor 22, the right side monitor 23 and the rear monitor 21, and the image displayed on the left side monitor 22, the right side monitor 23 or the rear monitor 21 is displayed. It is time to recognize Specifically, the predetermined time is, for example, 0.5 seconds, but is not limited to this. The predetermined time may be different for each driver. In this case, the predetermined time for each driver may be stored in the storage section 50 . Also, the predetermined time may be changed according to road conditions, weather, and time of day. The visual information acquisition unit 130 outputs to the notification control unit 140 the result of detecting that the driver has visually observed the left side monitor 22 , the right side monitor 23 and the rear monitor 21 .

The notification control unit 140 uses the notification unit 40 to notify the outside of the vehicle M of information indicating that the driver driving the vehicle M has viewed the display unit 20 . Specifically, when the driver driving the vehicle M looks at the left side monitor 22, the right side monitor 23, or the rear monitor 21 for a predetermined time or longer, the notification control unit 140 allows the driver to The outside of the vehicle M is notified that the side monitor 23 or the rear monitor 21 has been viewed.

A method of notifying the outside of the vehicle M of information indicating that the driver has viewed the display unit 20 will be described with reference to FIGS. 4, 5, and 6. FIG. FIG. 4 is a schematic diagram for explaining an example of a method of notifying the outside of the vehicle M of information indicating that the driver has viewed the display unit 20. As shown in FIG. FIG. 5 is a schematic diagram for explaining an example of a method different from FIG. 4 for notifying the outside of the vehicle M of information indicating that the driver has viewed the display unit 20. As shown in FIG. FIG. 6 is a schematic diagram for explaining an example of a method different from FIGS. 4 and 5 for notifying the outside of the vehicle M of information indicating that the driver has viewed the display unit 20. As shown in FIG.

4 to 6 show the right side camera 13 according to this embodiment. 4 to 6, a method of notifying the outside of the vehicle M of information indicating that the driver has viewed the right side monitor 23 will be described. The method of notifying the outside of the vehicle M of the information indicating that the left side monitor 22 and the rear monitor 21 have been viewed is the same as that for the case of viewing the right side monitor 23, so description thereof will be omitted.

As shown in FIG. 4, the right side camera 13 includes, for example, a photographing lens 131 and a light emitting section 132. As shown in FIG.

The photographing lens 131, for example, causes the incident light to form an image on an imaging device (not shown). As a result, an image is displayed on the right side monitor 23 .

The light emitting unit 132 is an example of the notification unit 40 and is, for example, a light emitting element provided around the photographing lens 131 . The light emitting unit 132 is not particularly limited, but can be realized by, for example, an LED (Light Emitting Diode).

The notification control unit 140 notifies the outside of the vehicle M of information indicating that the driver has viewed the right side monitor 23 by turning on the light emitting unit 132 . For example, the notification control unit 140 turns on the light emitting unit 132 when the driver looks at the right side monitor 23 for a predetermined time or longer. For example, the notification control unit 140 turns on the light emitting unit 132 at the moment when the driver looks at the right side monitor 23 for a predetermined time or longer, and turns off the light emitting unit 132 after about 1 to 2 seconds have passed. This is because if the lighting time of the light emitting unit 132 is shorter than 1 second, there is a possibility that, for example, a rider of a motorcycle traveling around the vehicle M will not notice. Also, if the time for which the light emitting unit 132 is turned on exceeds two seconds, there is a possibility that the surrounding conditions including the relative positional relationship between the vehicle M and the motorcycle will change.

For example, the notification control unit 140 may change the lighting color of the light emitting unit 132 according to the elapsed time after the driver views the right side monitor 23 for a predetermined time or more. In this case, the notification control unit 140 may, for example, turn on the blue light the moment the driver looks at the right side monitor 23 for a predetermined time or more, and change the light to yellow or red according to the elapsed time.

The notification control unit 140 may change the luminance of the light emitting unit 132 according to, for example, the elapsed time after the driver views the right side monitor 23 for a predetermined time or longer. In this case, the notification control unit 140 may, for example, light the right side monitor 23 most brightly at the moment when the driver looks at the right side monitor 23 for a predetermined time or longer, and gradually dim it according to the elapsed time.

Further, the notification control unit 140 turns on the light emitting unit 132 when, for example, the driver neglects to look at the right side monitor 23 for a predetermined time, not when the driver looks at the right side monitor 23 for a predetermined time or longer. You may let For example, if the right-side camera 13 recognizes the presence of a motorcycle but the driver neglects to look at the right-side monitor 23, the light-emitting unit 132 is lit in yellow or red to instruct the occupant of the motorcycle to drive. may notify that the person is unaware of the presence of the motorcycle. In this case, when it is detected that the driver is looking at the right side monitor 23, the light emission color of the light emitting unit 132 may be changed to blue to notify that the driver has noticed.

Next, a method of notifying the outside of the vehicle M of information indicating that the driver has visually checked the right side monitor 23 will be described with reference to FIG. 5 .

As shown in FIG. 5, the right side camera 13 may include a visual information display section 133 instead of the light emitting section 132 shown in FIG.

The visual information display section 133 is an example of the notification section 40 and is a display provided in the right side camera 13 . Although the visual information display unit 133 is not particularly limited, it can be realized by a display such as a liquid crystal display or an organic EL display.

The notification control unit 140 notifies the outside of the vehicle M by causing the visual information display unit 133 to display information indicating that the driver has viewed the right side monitor 23 . For example, when the driver views the right side monitor 23 for a predetermined time or longer, the notification control unit 140 causes the visual information display unit 133 to display information indicating that the driver has viewed the right side monitor 23 . For example, the notification control unit 140 displays characters such as "Driver is watching" on the visual information display unit 133 at the moment when the driver looks at the right side monitor 23 for a predetermined time or longer. For example, the notification control unit 140 displays characters on the visual information display unit 133 at the moment when the driver looks at the right side monitor 23 for a predetermined time or more, and erases the characters after about 1 to 2 seconds. The characters displayed on the visual information display unit 133 by the notification control unit 140 are not particularly limited as long as it is known that the driver is visually recognizing the right side monitor 23 .

When the vehicle M is provided with a driver imaging unit (not shown) that captures an image of the driver's face, the notification control unit 140 displays, for example, an image of the driver looking at the right side monitor 23 as visual information display. It may be displayed in section 133 . In this case, the notification control unit 140 may cause the visual information display unit 133 to display an image of the driver, for example, when the driver views the right side monitor 23 for a predetermined time or longer. Specifically, the notification control unit 140 displays an image of the driver's face on the visual information display unit 133 at the moment the driver looks at the right side monitor 23 for a predetermined time or longer, and after about one to two seconds have passed, the notification control unit 140 Erase the image.

Next, a method of notifying the outside of the vehicle M of information regarding the driver's visual observation of the right side monitor 23 by a method different from that of FIGS. 4 and 5 will be described with reference to FIG.

As shown in FIG. 6, the right side camera 13 may include a projection section 134 instead of the light emitting section 132 shown in FIG. 4 and the visual information display section 133 shown in FIG.

The projection unit 134 is an example of the notification unit 40, is provided in the right side camera 13, and projects light onto the road surface. Although the projection unit 134 is not particularly limited, it can be realized by, for example, a highly directional laser light source.

The notification control unit 140 notifies the outside of the vehicle M of information indicating that the driver has viewed the right side monitor 23 by projecting light onto the road surface from the projection unit 134 . For example, when the driver views the right side monitor 23 for a predetermined time or longer, the notification control unit 140 causes the projection unit 134 to project information indicating that the driver has viewed the right side monitor 23 onto the road surface. For example, the notification control unit 140 causes the projection unit 134 to project light the moment the driver looks at the right side monitor 23 for a predetermined time or more, and stops the projection after about one to two seconds have passed.

The notification control unit 140 projects, for example, from the projection unit 134 onto the road surface a figure or characters indicating that the right side monitor 23 has been viewed. The notification control unit 140 , for example, projects light of characters such as “Driver is visually recognizing” from the projection unit 134 onto the road surface. There is no particular limitation on the graphics and characters that the notification control unit 140 causes the projection unit 134 to project on the road surface, and it is sufficient that the driver is viewing the right side monitor 23 .

4 to 6, the right side camera 13 is provided with the light emitting unit 132, the visual information display unit 133, and the projection unit 134 separately. It is not intended to limit the invention. The right side camera 13 may be provided with a combination of a light emitting section 132 , a visual information display section 133 and a projection section 134 .

Processing of the notification control device 100 will be described with reference to FIG. FIG. 7 is a flowchart showing an example of the flow of processing by the notification control device 100. As shown in FIG. The process of FIG. 7 is repeatedly performed while the vehicle M is in operation, that is, while video data is displayed on the left side monitor 22 or the right side monitor 23 .

First, the notification control device 100 acquires information on detection of visual observation of the left side monitor 22 or the right side monitor 23 from the visual observation information acquisition unit 130 (step S101). Then, the notification control device 100 proceeds to step S102.

In step S102, the notification control device 100 determines whether or not the driver has looked at the left side monitor 22 or the right side monitor 23 for a predetermined period of time or longer, based on the acquired visual detection information.

If the driver does not look at the left side monitor 22 or the right side monitor 23 for a predetermined time or more (No in step S102), the notification control device 100 ends the processing of FIG. On the other hand, when the driver looks at the left side monitor 22 or the right side monitor 23 for the predetermined time or more (Yes in step S102), the notification control device 100 proceeds to step S103.

Next, the notification control device 100 notifies the outside that the driver has viewed the left side monitor 22 or the right side monitor 23 (step S103). Then, the notification control device 100 proceeds to step S104.

Next, the notification control device 100 terminates the notification to the outside (step S104). Then, the notification control device 100 ends the processing of FIG.

As described above, in the first embodiment, when the driver checks the surrounding situation with the left side monitor or the right side monitor, it is possible to notify the outside of the vehicle that the driver has checked the surrounding situation. . As a result, the safety of motorcycle occupants traveling near the vehicle can be further enhanced.

[Second embodiment]
The configuration of the electronic mirror device according to the second embodiment will be described with reference to FIG. FIG. 8 is a block diagram showing an example of the configuration of the electronic mirror device according to the second embodiment.

As shown in FIG. 8, the electronic mirror device 1A includes a camera 10, a display section 20, a line-of-sight detection section 30, a notification section 40, a storage section 50, and a notification control device (control section) 100A. The notification control device 100</b>A includes a video data acquisition unit 110 , a display control unit 120 , a visual information acquisition unit 130 , a notification control unit 140 and a recognition processing unit 150 . That is, the electronic mirror device 1A differs from the electronic mirror device 1 in that the notification control device 100 includes the recognition processing unit 150 .

The recognition processing unit 150 recognizes various objects included in the video data acquired by the video data acquisition unit 110 . The recognition processing unit 150, for example, recognizes the notification object included in the video data acquired by the video data acquiring unit 110. FIG. The notification target is, for example, a motorcycle or a bicycle traveling near the vehicle M.

The recognition processing unit 150 recognizes the notification object based on dictionary data such as a notification object recognition dictionary stored in a storage unit (not shown). Note that the recognition processing unit 150 may recognize the notification object using a well-known method.

In the second embodiment, for example, when the recognition processing unit 150 recognizes the notification object, the notification control unit 140 transmits information about the line of sight of the driver driving the vehicle M to the vehicle M by the notification unit 40. notify outside of The method by which the notification control unit 140 notifies the outside of the vehicle M is the same as in the first embodiment, so the description is omitted.

Processing of the notification control device 100A will be described with reference to FIG. FIG. 9 is a flowchart showing an example of the flow of processing by the notification control device 100A. The process of FIG. 9 is repeatedly performed while the vehicle M is in operation, that is, while video data is displayed on the left side monitor 22 or the right side monitor 23 .

Steps 201 and 202 are the same as steps S101 and S102 shown in FIG. 7, so description thereof will be omitted.

After Yes in step S202, the notification control device 100A determines whether or not the notification object is recognized from the video data in step S203.

If the notification target object is not recognized from the video data (No in step S203), the notification control device 100A terminates the processing of FIG. On the other hand, if the notification object is recognized from the video data (Yes in step S203), the notification control device 100A proceeds to step S204.

Steps S204 and S205 are the same as steps S103 and S104 shown in FIG. 7, so description thereof will be omitted.

As described above, in the second embodiment, when the driver checks the surrounding conditions with the left side monitor or the right side monitor only when the notification target is recognized, the driver checks the surrounding conditions. Notifies the outside of the vehicle of this fact. As a result, information regarding the line of sight of the driver can be appropriately conveyed to a rider of a motorcycle traveling near the vehicle, so that safety can be further enhanced.

Although the embodiments of the present invention have been described above, the embodiments are not limited by the contents of these embodiments. In addition, the components described above include those that can be easily assumed by those skilled in the art, those that are substantially the same, and those within the so-called equivalent range. Furthermore, the components described above can be combined as appropriate. Furthermore, various omissions, replacements, or modifications of components can be made without departing from the gist of the above-described embodiments.

1, 1A electronic mirror device 10 camera 11 rear camera 12 left side camera 13 right side camera 20 display unit 21 rear monitor 22 left side monitor 23 right side monitor 30 line of sight detection unit 40 notification unit 50 storage unit 100, 100A notification control device ( control part)
110 video data acquisition unit 120 display control unit 130 visual information acquisition unit 131 photographing lens 132 light emitting unit 133 visual information display unit 134 projection unit 140 notification control unit 150 recognition processing unit

Claims (10)

a visual information acquisition unit that detects that a driver of the vehicle has visually viewed a display unit that displays video data captured by a camera that captures the rear of the vehicle;
When the visual information acquisition unit detects that the driver of the vehicle has visually viewed the display unit, the information indicating that the driver has visually viewed the display unit is visually notified to the outside of the vehicle. a notification control unit that is notified by the notification unit;
A notification controller. The notification control unit visually notifies the outside of the vehicle of information indicating that the driver has viewed the display unit by causing a light emitting unit provided around the lens of the camera to emit light.
The notification control device according to claim 1. The notification control unit visually notifies the outside of the vehicle of information indicating that the driver has viewed the display unit by displaying characters on a display unit provided around the camera.
The notification control device according to claim 1 or 2. The notification control unit causes a projection unit that projects light onto the road surface from the vicinity of the camera to project light onto the road surface, thereby visually displaying information indicating that the driver has viewed the display unit to the outside of the vehicle. to notify
The notification control device according to any one of claims 1 to 3. The notification control unit causes the projection unit to project graphics or characters indicating that the driver has viewed the display unit onto the road surface.
The notification control device according to claim 4. The visual information acquisition unit detects that the driver of the vehicle has viewed the display unit for a predetermined time or more,
When the visual information acquisition unit detects that the driver of the vehicle has viewed the display unit for a predetermined time or longer, the notification control unit transmits information indicating that the driver has viewed the display unit to the vehicle. visually notify the outside of the
The notification control device according to any one of claims 1 to 5. further comprising a recognition processing unit that recognizes a notification target from video data captured by the camera,
The notification control unit visually notifies the outside of the vehicle of information indicating that the driver has viewed the display unit when the recognition processing unit recognizes the notification target object.
A notification control device according to any one of claims 1 to 6. A notification control device according to any one of claims 1 to 7;
the camera;
a line-of-sight detection unit that detects a line-of-sight of a driver of the vehicle and outputs detected line-of-sight information to the visual information acquisition unit;
the notification unit;
An electronic mirror device. a visual information acquisition step of detecting that a driver of the vehicle has visually viewed a display section displaying video data captured by a camera that captures the rear of the vehicle;
Notification for visually notifying the outside of the vehicle of information indicating that the driver has visually observed the display unit when it is detected that the driver of the vehicle has visually observed the display unit in the visual information obtaining step. a notification control step for notifying by the unit;
Notification control methods, including: a visual information acquisition step of detecting that a driver of the vehicle has visually viewed a display section displaying video data captured by a camera that captures the rear of the vehicle;
Notification for visually notifying the outside of the vehicle of information indicating that the driver has visually observed the display unit when it is detected that the driver of the vehicle has visually observed the display unit in the visual information obtaining step. a notification control step for notifying by the unit;
A notification control program that causes a computer to run

Images