JP2007156755A - Intervehicular communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an intervehicular communication system capable of transmitting preferentially and selectively only traffic information necessary for a driver, by extracting the traffic information concerned in the periphery of a vehicle from a picked-up image, and by transmitting the extracted traffic information to other vehicle when a behavior change of the vehicle gets to a prescribed variation or more. <P>SOLUTION: A kind and position coordinates of an object positioned in the periphery of one' own vehicle are detected based on the image of a front environment of the vehicle imaged by a front camera 5 (S2-S6), to be extracted as the traffic information (S7), the presence of the behavior change (meandering driving or lane change) of the vehicle for evading the object is determined when transmitting the extracted traffic information (S9, S10), and the extracted traffic information is transmitted only when the behavior change exists (S14). <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an inter-vehicle communication system that communicates information between a plurality of vehicles traveling on a road, and in particular, extracts traffic information related to the periphery of a vehicle from a captured image, and changes in behavior of the vehicle by a predetermined amount of change. The present invention relates to a vehicle-to-vehicle communication system that allows only traffic information necessary for a driver to be selected and transmitted by transmitting the extracted traffic information to other vehicles.

In general, the information that a driver who drives a vehicle can obtain from his / her five senses is quite limited. In particular, when the road is congested and other vehicles are running or stopped close to the front and back of the vehicle, or when driving on a road with poor visibility, the forward and backward visibility is blocked. And it has been a very difficult task for a driver to perform an appropriate driving in a situation where driving must be performed within such limited information.
Therefore, a vehicle-to-vehicle communication system that exchanges information between vehicles by wireless communication has been proposed. For example, in Japanese Patent Laid-Open No. 2001-283181, a driving support camera that captures an image of the surroundings of the host vehicle is provided, and an image captured by the driving support camera is wirelessly transmitted to another vehicle. An inter-vehicle communication system capable of transmitting in advance the occurrence of an abnormal event occurring above to another vehicle is described.
According to the above system, since information can be shared among a plurality of vehicles, it becomes possible for the driver to grasp information that cannot be recognized from the own vehicle based on information provided from other vehicles. It becomes possible to travel appropriately.
Japanese Patent Laid-Open No. 2001-283181 (pages 4 to 7, FIGS. 1 to 4)

Here, as in the inter-vehicle communication system described in Patent Document 1 described above, providing information between vehicles using a camera image captured by a camera is more specific information around the current vehicle. However, the amount of information of image data is much larger than that of character information. As a result, the time required for the communication processing between the vehicles is increased, and the processing load on the control device is also increased.
On the other hand, in the case where information is shared among a plurality of vehicles by simply transmitting only text information, the driver cannot obtain sufficient information about the surroundings of the vehicle, and it is still possible to perform appropriate traveling It was difficult.
Further, the traffic information acquired by each vehicle includes traffic information that hardly affects the travel of other vehicles. If such traffic information is also transmitted uniformly, the number of communications between the vehicles is extremely large, and the processing load on the control device is increased. In addition, it is difficult to grasp information originally necessary for the driver by uniformly outputting to the driver traffic information that hardly affects the driver.
However, it is difficult to determine whether the traffic information acquired by each vehicle is necessary traffic information for other vehicles, and it is possible to select or preferentially transmit only necessary traffic information. A communication system was desired.

  The present invention has been made to solve the above-described conventional problems, and only the traffic information necessary for other vehicles is selected from the traffic information extracted based on the captured images. This makes it possible for the driver to travel appropriately even in situations where it is necessary to drive within limited information, while reducing the communication time and processing load related to information communication. An object of the present invention is to provide a vehicle-to-vehicle communication system that enables the above.

In order to achieve the above object, a vehicle-to-vehicle communication system (1) according to claim 1 of the present application is a vehicle-to-vehicle communication system in which information is communicated between a plurality of vehicles (2) traveling on a road. An imaging means (5) for imaging the periphery of the vehicle, a traffic information extraction means (7) for extracting traffic information relating to the periphery of the vehicle from the image (41) captured by the imaging means, and a change in behavior of the vehicle are detected. Behavior change detecting means (16, 17), behavior change determining means (7) for determining whether or not the vehicle behavior change detected by the behavior change detecting means is a predetermined change amount or more, and the behavior change determination. Traffic information transmitting means (3) for transmitting the traffic information extracted by the traffic information extracting means to another vehicle when it is determined by the means that the behavior change of the vehicle is greater than or equal to a predetermined change amount. And wherein the door.
Here, the “traffic information” is information that affects driving when the vehicle travels on the road. Specifically, a traveling vehicle, a parked vehicle, a right turn vehicle, a pedestrian, a bicycle, This is information on the location and type of roadside obstacles, signs under construction, and the like.
Further, the “behavior change” includes a change in a driving state such as a driving speed, a driving direction, and a driving lane of the vehicle.

  Further, the inter-vehicle communication system (1) according to claim 2 is the inter-vehicle communication system according to claim 1, wherein the vehicle (2) receives the traffic information transmitted from another vehicle. Means (3) and traffic information output means (6) for outputting traffic information relating to the periphery of the vehicle based on the traffic information received by the traffic information receiving means.

  Further, the inter-vehicle communication system (1) according to claim 3 is the inter-vehicle communication system according to claim 1 or 2, wherein the traffic information extracting means (7) is imaged by the imaging means (5). Object detection means (7) for detecting objects (31-33) located in the vicinity of the vehicle based on the image (41), and an object for specifying the type of the object detected by the object detection means Object type specifying means (7), and object position detecting means (7) for detecting the position of the object detected by the object detecting means, wherein the traffic information is obtained by the object type specifying means. It is information regarding the type of the identified object and the position of the object detected by the object position detecting means.

  Furthermore, the inter-vehicle communication system (1) according to claim 4 is the inter-vehicle communication system according to claim 3, wherein the traffic information output means (6) displays a map around the vehicle (2). Specific information (65-73) for specifying the type of the object (31-33) and the position of the object is displayed on the displayed map.

In the inter-vehicle communication system according to claim 1 having the above-described configuration, the periphery of the vehicle is imaged by the imaging unit, the traffic information relating to the periphery of the vehicle is extracted from the captured image, and the behavior change of the vehicle is greater than or equal to a predetermined change amount. Since information is communicated between a plurality of vehicles by transmitting the traffic information extracted in some cases to other vehicles, traffic information based on images captured between a plurality of vehicles, particularly for other vehicles. It becomes possible to select and share only the traffic information that seems necessary. Therefore, it is possible to reduce the communication time and processing load related to information communication by reducing the number of communication without reducing the amount of traffic information necessary for the driver.
In addition, limited information such as when the road is congested due to traffic information sharing and other vehicles are traveling or stopping near the front and rear of the vehicle, or when traveling on a road with poor visibility Even in a situation where it is necessary to drive in the vehicle, the driver can travel appropriately.

  In the inter-vehicle communication system according to claim 2, the traffic information transmitted from the other vehicle is received and the traffic information related to the periphery of the vehicle is output based on the received traffic information. Traffic information around the vehicle based on the captured image can be obtained. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel by referring to the output traffic information.

  In the inter-vehicle communication system according to claim 3, the type and position of the object located around the vehicle are detected based on the image captured by the imaging unit, and the detected object type and position are related to the detected object type and position. Since the information is transmitted as traffic information to other vehicles, it is possible to share information related to objects such as parked vehicles and pedestrians detected based on images captured between a plurality of vehicles. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel in consideration of information on the object.

  Furthermore, in the inter-vehicle communication system according to claim 4, a map around the vehicle is displayed, and specific information identifying the type of the object and the position of the object is displayed on the displayed map. Therefore, the driver can obtain information related to objects around the own vehicle based on an image captured by another vehicle. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel by referring to the information related to the output object.

  DESCRIPTION OF EMBODIMENTS Hereinafter, a vehicle-to-vehicle communication system according to the present invention will be described in detail with reference to the drawings based on first to fourth embodiments embodied.

(First embodiment)
First, a schematic configuration of the inter-vehicle communication system 1 according to the first embodiment will be described with reference to FIGS. 1 and 2. FIG. 1 is a schematic configuration diagram of a vehicle-to-vehicle communication system 1 according to the first embodiment. FIG. 2 is a schematic configuration diagram showing the vehicle 2 in the inter-vehicle communication system 1 according to the first embodiment.
As shown in FIG. 1, the inter-vehicle communication system 1 according to the first embodiment is constituted by a plurality of vehicles 2 traveling on a road, and communication devices (traffic information transmitting means, traffic information) provided in each vehicle 2. The receiving means 3) enables mutual information communication between the vehicles 2.

Here, the communication device 3 is a communication device that communicates information in a wireless manner using, for example, millimeter wave radio waves. And with other vehicles (subsequent vehicle, forward vehicle, oncoming vehicle, etc.) located in a predetermined wireless communicable range (for example, a range up to a radius of 2 km centered on the own vehicle position) with respect to the own vehicle position It is possible to communicate information wirelessly.
The information transmitted and received between the vehicles by the communication device 3 includes traffic information extracted from an image of the front environment of the vehicle 2 captured by the front camera 5 provided in the vehicle 2 and a current position of the vehicle, as will be described later. There is information about.

  In the communication between the vehicles 2 in the inter-vehicle communication system 1, in addition to directly transmitting / receiving information between the vehicles 2, information is transmitted via a communication facility such as the communication center 4 as shown in FIG. 1. It is also possible to send and receive.

  Next, the configuration of one vehicle 2 constituting the inter-vehicle communication system 1 will be described with reference to FIG. As shown in FIG. 2, in addition to the communication device 3 described above, the vehicle 2 includes a front camera (imaging means) 5, a liquid crystal display (traffic information output means) 6, and a communication processing ECU (traffic information extraction means, behavior change). Determination means, object detection means, object type identification means, object position detection means) 7, current location detection unit 8, information DB 9, vehicle ECU 10, and the like.

  The front camera 5 uses a solid-state image sensor such as a CCD, for example, and is attached near the upper center of a license plate mounted in front of the vehicle 2 and is installed with the line-of-sight direction slightly below the horizontal. . Then, the front side of the vehicle that is the traveling direction of the vehicle 2 when the vehicle 2 is traveling is imaged (see FIG. 5). The captured image is subjected to predetermined processing by the communication processing ECU 7 so that traffic information around the vehicle 2 is extracted as described later, and the extracted traffic information is transmitted to other vehicles. . Here, the traffic information in the first embodiment is an object to be particularly careful when the vehicle 2 travels (for example, a traveling vehicle, a parked vehicle, a right turn vehicle, a pedestrian, a bicycle, an obstacle on the road, a signboard under construction). ), Specifically, information on the type of the object imaged by the front camera 5 and information on the position of the object.

  The liquid crystal display 6 is provided on the center console or panel surface of the vehicle 2 and displays a map image showing the type and position of an object specified on the map based on traffic information transmitted from another vehicle. Display (see FIG. 6). The liquid crystal display 6 may also be used for a navigation device.

  The communication processing ECU (Electronic Control Unit) 7 performs predetermined processing on the image captured by the front camera 5 to thereby obtain information on the object located around the vehicle 2 captured in the image (i.e., , Traffic information) is extracted, and whether the extracted traffic information is transmitted to other vehicles based on the behavior change of the vehicle 2 is determined, or the transmission range in which the traffic information is transmitted is set as the type of object. This is an electronic control unit that is set based on this. The detailed configuration of the communication processing ECU 7 will be described later.

  In addition, the current location detection unit 8 receives the radio wave generated by the artificial satellite, thereby detecting the current location and current time of the vehicle 2 on the earth, and the absolute direction of the vehicle 2 by measuring the geomagnetism. It comprises a geomagnetic sensor 12 to be detected and a map DB 13 in which map data is stored (see FIG. 3), and the current location and the traveling direction of the vehicle 2 can be specified on the map. Note that a navigation device may be used as the current location detection unit 8.

  Further, the information DB 9 displays a map image in which a mark for identifying the type and position of an object is superimposed on a map around the own vehicle based on image data captured by the front camera 5 and traffic information transmitted from another vehicle. Storage means for storing display data for display. In the first embodiment, a hard disk is used as a storage medium for the information DB 9, but a magnetic disk, memory card, magnetic tape, magnetic drum, CD, MD, DVD, optical disk, MO, IC card, optical card, etc. Can also be used as an external storage device.

The vehicle ECU 10 is an electronic control unit of the vehicle 2 that controls operations of an engine, a transmission, a brake, and the like, and includes a vehicle speed sensor 15, a steering angle sensor (behavior change detecting means) 16, a gyro sensor (behavior change detection). Means) 17 various sensors are connected.
Here, the vehicle speed sensor 15 is composed of an active wheel speed sensor attached to the wheel of the vehicle 2, detects the rotational speed of the wheel, and outputs a speed signal to the vehicle ECU 10.
The steering angle sensor 16 is mounted inside the steering device, and detects the amount of rotation of the steering column shaft by an optical sensor or the like. And a steering angle at the time of turning a steering wheel is detected, and a steering angle signal is outputted to vehicle ECU10.
Further, the gyro sensor 17 detects the turning angle of the vehicle 2 and outputs a turning angle signal to the vehicle ECU 10. As the gyro sensor 17, for example, a gas rate gyro, a vibration gyro, or the like is used.
As a result, the vehicle ECU 10 detects the current vehicle speed of the vehicle 2 based on the output signal of the vehicle speed sensor 15, and detects the steering angle of the vehicle 2 based on the output signal of the steering angle sensor 16. Further, by integrating the turning angle detected by the gyro sensor 17, the vehicle direction can be detected.

Next, the structure which concerns on the control system of the vehicle 2 which comprises the vehicle-to-vehicle communication system 1 which concerns on 1st Embodiment is demonstrated based on FIG. FIG. 3 is a block diagram schematically showing a control system of the vehicle 2 constituting the inter-vehicle communication system 1 according to the first embodiment.
In FIG. 3, the control system of the vehicle 2 is configured on the basis of the communication processing ECU 7 and each control means of the vehicle ECU 10, and each peripheral device described above is connected to each control means.

  Here, the communication processing ECU 7 is configured with the CPU 21 as a core, and a ROM 22 and a RAM 23 which are storage means are connected to the CPU 21. The ROM 22 has a vehicle-to-vehicle communication processing program (see FIG. 8) for transmitting traffic information extracted from an image captured by the front camera 5 to another vehicle, and the surroundings of the vehicle based on the traffic information transmitted from the other vehicle. A traffic information display processing program (see FIG. 10) for displaying the traffic information of the vehicle on the liquid crystal display 6, a communication range setting table 22A (FIG. 4) for setting a communication range for transmitting traffic information based on the type of the object, Various programs necessary for controlling the liquid crystal display 6 and the like are stored. The RAM 23 is a memory that temporarily stores various data calculated by the CPU 21. In particular, in the first embodiment, a traffic information table 23A that cumulatively stores traffic information extracted from images captured by the front camera 5 is stored. (FIG. 7) is stored.

Next, the communication range setting table 22A stored in the ROM 22 will be described with reference to FIG. FIG. 4 is a diagram showing the communication range setting table 22A according to the first embodiment.
As illustrated in FIG. 4, the communication range setting table 22 </ b> A includes a type of an object detected from an image captured by the front camera 5 and a communication range for transmitting traffic information related to the object.
For example, when the object detected from the captured image is a “traveling vehicle”, traffic information is transmitted to another vehicle located within a radius of 50 m from the host vehicle. If the object detected from the captured image is a “bicycle”, the traffic information is transmitted to another vehicle located within a radius of 100 m from the host vehicle. When the object detected from the captured image is a “pedestrian”, the traffic information is transmitted from the own vehicle to another vehicle located within a radius of 200 m. When the object detected from the captured image is a “right turn vehicle”, the traffic information is transmitted from the own vehicle to another vehicle located within a radius of 300 m. When the object detected from the captured image is a “parked vehicle” or other obstacle, the traffic information is transmitted from the own vehicle to another vehicle located within a radius of 1 km. As a result, it is possible to transmit only information on an object that is considered to be effective for other vehicles that receive traffic information.

  Next, a specific example of the traffic information table 23 </ b> A stored in the RAM 23 will be described with reference to FIGS. 5 to 7 together with a method for extracting traffic information from an image captured by the front camera 5. Here, FIG. 5 is a top view showing the vehicle 2 traveling on the road at a predetermined timing, and FIG. 6 shows a captured image 41 of the front environment of the vehicle 2 captured by the front camera 5 at the timing of FIG. FIG. 7 is a schematic diagram, and FIG. 7 is a diagram showing a traffic information table 23A that stores traffic information extracted based on the captured image 41 of FIG.

  5 and 6, the parked vehicle 31 parked on the road shoulder, the pedestrian 32 walking behind the parked vehicle 31, and the traveling vehicle traveling in the opposite lane at the predetermined timing shown in FIGS. 5 and 6. 33 exists. As a result, the parked vehicle 31, the pedestrian 32, and the traveling vehicle 33 are projected on the captured image 41 captured by the front camera 5.

  When the traffic information is extracted from the captured image 41, the CPU 21 first corrects the luminance of the road surface and the object (the parked vehicle 31, the pedestrian 32, and the traveling vehicle 33 in FIG. 6) based on the luminance difference. I do. After that, it is possible to detect a boundary line between the road surface and the object by performing binarization processing for separating the object from the image, geometric processing for correcting distortion, smoothing processing for removing image noise, and the like. Become.

  Further, the front camera 5 is attached so that the optical axis is directed downward from the horizontal by a predetermined angle (for example, 15 degrees) so that the front can be imaged from directly above the front bumper 42 of the vehicle 2, and the imaging range is fixed. ing. Accordingly, the distance from the vehicle 2 to the subject is calculated based on the position of the target object (specifically, the number of pixels from the lower edge) detected in the captured image 41 shown in FIG. 6 captured by the front camera 5. can do. Furthermore, it is possible to indirectly detect the position coordinates of the object from the relative positional relationship with the current position of the host vehicle detected by the GPS 11.

  Thereafter, the CPU 21 enlarges or reduces the image size of the object detected from the captured image 41 at an enlargement ratio or a reduction ratio determined according to the distance of the object. Then, the type of the object detected in the captured image 41 is calculated by pattern-matching the image of the object whose size has been adjusted with each template image stored in the ROM 22. Furthermore, it is also possible to determine the traveling state (parked vehicle, traveling vehicle, right turn vehicle) of the vehicle when the object is a vehicle from the moving direction and moving speed in the captured image 41 of the subsequent object.

As a result, as shown in FIG. 7, in the traffic information table 23A, the parked vehicle 31, the pedestrian 32, and the traveling vehicle 33, which are the objects detected from the captured image 41, are recorded together with the position coordinates.
Here, the position coordinates are specified from the image of the object in the captured image 41 captured by the front camera 5 and the current position of the host vehicle 2 as described above.
On the other hand, the type of the object is any one of the predetermined types (for example, a traveling vehicle, a parked vehicle, a right turn vehicle, a pedestrian, a bicycle, an obstacle on the road, and a signboard under construction) as previously described. Identified and memorized. In particular, regarding the vehicle, the vehicle type (light car, sedan, wagon, truck, etc.) is also specified. Note that the types of objects (including the type of vehicle) are stored in the traffic information table 23A by codes (numbers) that specify the types of objects. For example, “1” is a pedestrian, “ “2” is a sedan parked vehicle, “3” is a truck parked vehicle, “4” is... Moreover, when communicating traffic information between vehicles, especially regarding transmission / reception of the type of the object, it is performed by transmitting / receiving these codes. Therefore, it is necessary to store a correspondence table in which the code and the type of the object are associated with each other on the transmission side vehicle and the reception side vehicle.
In addition, in the traffic information table 23A, instead of a code (number) for specifying the type of the object or the vehicle type, a symbol or pattern for specifying the type of the object or the type of the vehicle (for example, ○, The sedan parked vehicle may store □) and send and receive traffic information by sending and receiving those symbols and patterns. Further, the color and size of the object may be recognized from the captured image 41 and stored.

  Next, an inter-vehicle communication processing program executed by the communication processing ECU 7 of the inter-vehicle communication system 1 according to the first embodiment having the above-described configuration will be described with reference to FIG. FIG. 8 is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system 1 according to the first embodiment. Here, the vehicle-to-vehicle communication processing program detects an object from a captured image captured by the front camera 5 when the vehicle 2 travels on a road, extracts information related to the object as traffic information, and extracts the extracted traffic. Control to transmit information to other vehicles is performed. 8 is stored in the ROM 22 or the RAM 23 provided in the communication processing ECU 7, and is executed by the CPU 21 at predetermined intervals (for example, every 4 ms).

  In the inter-vehicle communication processing program, first, in step (hereinafter abbreviated as S) 1, the CPU 21 images the front environment of the vehicle 2 with the front camera 5. Subsequently, in S2, the image captured by the front camera 5 in S1 is captured and analyzed, and image recognition for detecting objects such as pedestrians, bicycles, other vehicles, and other obstacles located around the vehicle 2 is performed. Process.

  Specifically, first, an image captured by the front camera 5 is input using analog communication means such as NTSC or digital communication means such as i-link, and is converted into a digital image format such as jpeg or mpeg. . Next, the CPU 21 corrects the brightness of the road surface and the object in the captured image based on the brightness difference. Thereafter, a binarization process for separating the object from the image, a geometric process for correcting distortion, a smoothing process for removing image noise, and the like are performed to detect a boundary line between the road surface and the object. Thereby, it is possible to detect an object located around the vehicle 2. Note that S2 corresponds to the processing of the object detection means.

  Next, in S3, it is determined whether or not any object has been detected from the captured image as a result of the image recognition process in S2. If it is determined that some object is detected (S3: YES), the process proceeds to S4. On the other hand, if it is determined that no object is detected (S3: NO), it is transmitted to another vehicle. Since there is no traffic information to be processed, the vehicle-to-vehicle communication processing program is terminated.

Next, in S4, the current position of the host vehicle 2 is detected using the GPS 11. Thereafter, in S5, the distance to the subject is calculated from the position of the object (specifically, the number of pixels from the lower edge) detected by the image recognition process in S2, and the own vehicle detected in S4 is further calculated. The position coordinates of the object are indirectly detected from the relative positional relationship with the current position. Note that S5 corresponds to the processing of the object position detection means.
Further, as a method of detecting the position coordinates of the target object, in addition to the method of detecting based on the above-described captured image, for example, a millimeter wave radar that transmits a millimeter wave is provided in the vehicle 2 and reflected by the target object. The distance from the vehicle 2 to the object may be detected by measuring the millimeter wave, and the position coordinates of the object may be detected from the current position of the vehicle 2.

  Subsequently, in S6, the type of the object detected in the image recognition process in S2 is specified. Specifically, the image size of the detected object is enlarged or reduced at an enlargement rate or reduction rate determined according to the distance from the host vehicle to the object calculated in S5. Then, the type of the object detected in the image is calculated by pattern-matching the image of the object whose size has been adjusted with each template image stored in the ROM 22. Furthermore, from the moving direction and moving speed in the captured image 41 of the target object thereafter, the relative position of the target object with respect to the vehicle traveling state (parked vehicle, traveling vehicle, right turn vehicle) and the transmitting vehicle when the target object is a vehicle. Also detect (left shoulder, right shoulder, etc.). If none of the template images stored in the ROM 22 matches, it is determined that the detected object does not need to be transmitted to other vehicles as traffic information, and the inter-vehicle communication processing program ends. . Further, S6 corresponds to the processing of the object type specifying means.

  In S7, the CPU 21 extracts the position coordinates of the object detected in S5 and the type of the object specified in S6 as traffic information, and stores it in the traffic information table 23A of the RAM 23 (S8). . In addition, said S2-S7 is corresponded to the process of a traffic information extraction means.

  Next, in S9, whether or not the object stored as traffic information in S8 has moved and disappeared from the image captured by the front camera 5, that is, the detected object is an obstacle to the traveling vehicle. It is determined whether or not the object is likely to become. Here, the object that moves and disappears from the image to be captured includes a traveling vehicle traveling in the corresponding lane, a parked vehicle by the road, a vehicle stopped for a right turn, a pedestrian, a bicycle, and an obstacle on the road. There are signs under construction.

  When it is determined in S9 that the object has moved and disappeared from the image captured by the front camera 5 (S9: YES), the process proceeds to S10. On the other hand, when it is determined that the object does not disappear from the image captured by the front camera 5 (S9: NO), the detected object is an object that is not likely to be an obstacle for the traveling vehicle. The vehicle-to-vehicle communication processing program is terminated without transmitting information related to the object to the other vehicle.

  Subsequently, in S10, the CPU 21 determines whether or not there has been a change in the behavior of the vehicle by a predetermined change amount or more based on detection results of various sensors connected to the vehicle ECU 10. Here, the behavior change of the vehicle determined in S10 in the first embodiment means that the vehicle 2 travels to avoid the object, and specifically, meandering or lane change to avoid the object is performed. If it is determined that there has been a change in the behavior of the vehicle over a predetermined change amount.

The specific determination means will be described below. For example, the object stored as the traffic information in S8 is located within a predetermined range (for example, within 10 m) of the host vehicle, and in the left half of the captured image. If the vehicle is positioned and the steering angle sensor 16 operates the steering wheel to the right by a predetermined range or more and then operates to the left, the vehicle 2 performs meandering to avoid the object. It is determined that
Further, in the case where the object stored as traffic information in S8 is located within a predetermined range (for example, within 10 m) of the host vehicle and located in the right half of the captured image, the steering angle sensor 16 When the steering is operated to the left in a predetermined range or more and then operated to the right, it is determined that the vehicle 2 has performed meandering to avoid the object.
Note that, instead of the steering angle sensor 16, the gyro sensor 17 may determine whether or not the meandering has been performed to avoid the object. In that case, when the vehicle direction changes more than a predetermined range in the left direction or the right direction by the gyro voltage of the gyro sensor 17 and then changes in the right direction or the left direction, the vehicle 2 avoids the object. It is determined that the meandering has been performed.

The determination as to whether or not the lane has been changed is a case where the object is located within a predetermined range (for example, within 10 m) of the host vehicle and located in the left half of the captured image. When the steering is operated to the right by the angle sensor 16 over a predetermined range, it is determined that the vehicle 2 has changed the lane to the right lane in order to avoid the object.
Further, when the object is located within a predetermined range (for example, within 10 m) of the host vehicle and is located in the right half of the captured image, the steering angle sensor 16 causes the steering to move leftward beyond the predetermined range. When operated, it is determined that the vehicle 2 has changed the lane to the left lane to avoid the object.
Note that the lane change may be determined by using the gyro sensor 17 instead of the steering angle sensor 16 to determine whether or not the meandering has been performed to avoid the object. Further, it may be determined whether or not the lane has been changed from the current position of the vehicle and the road data.

  Further, it is preferable that the predetermined range of the steering operation described above varies depending on the type of the detected object. This is because the traveling trajectory of the vehicle that avoids the object differs depending on whether the object is a vehicle or a pedestrian, and is larger when the object is a vehicle than when the object is a pedestrian. When there is a change in steering operation, it is determined that meandering has been performed. For example, when the object is a pedestrian, it is determined that the meandering or lane change has been performed when an operation of 5 degrees or more is performed, and when the object is a vehicle, an operation of 10 degrees or more is performed. It is determined that meandering or lane change has been performed. Thereby, it is possible to more accurately determine whether or not the vehicle has traveled to avoid the object. Note that the same applies to the determination by the gyro sensor 17, and in the case where the object is a vehicle rather than a pedestrian, the meandering or lane change is performed when there is a larger change in the gyro voltage. It is preferable to judge. Note that S10 corresponds to the processing of the behavior change determination means.

  If it is determined in S10 that the vehicle has a behavior change equal to or greater than the predetermined change amount (S10: YES), the process proceeds to S11. On the other hand, if it is determined that the vehicle has not changed its behavior more than the predetermined change amount (S10: NO), the detected object is expected to be an object that is not likely to be an obstacle for the traveling vehicle. The inter-vehicle communication processing program is terminated without transmitting information related to the object to the other vehicle.

  Next, in S11, based on the type of the object specified in S6 and the communication range setting table 22A (see FIG. 4) stored in the RAM 23, the traffic information extracted in S7 is transmitted to other vehicles. Set the transmission range. For example, when the traffic information shown in FIG. 7 is extracted, the information on “parked vehicle / sedan” is set to be transmitted to other vehicles located within 1 km from the host vehicle, and the information on “traveling vehicle / truck” is The information is set to be transmitted to another vehicle located within 50 m from the own vehicle, and the information related to “pedestrian” is set to be transmitted to another vehicle located within 200 m from the own vehicle.

Subsequently, in S12, by communicating with each other vehicle located around the host vehicle via the communication device 3, the position information of each other vehicle is acquired, and the acquired position information, the position information of the host vehicle, The distance from the own vehicle to each other vehicle is calculated.
Here, FIG. 9 is a schematic diagram showing the positional relationship between the host vehicle 51 and the other vehicles 52 to 58 traveling around the host vehicle 51 at a predetermined timing while traveling on the road. In the process of S12, the own vehicle 51 communicates with each of the other vehicles 52 to 58 to acquire position information of the other vehicles 52 to 58, and further determines the distance from the own vehicle 51 to the other vehicles 52 to 58. Calculate each.

  Next, in S13, it is determined whether or not another vehicle that is a target for transmitting the traffic information extracted in S7 is located around the own vehicle. For example, if the traffic information extracted in S7 is traffic information that targets only pedestrians and there is no other vehicle within 200 m of the subject vehicle in the calculation result of S12, send It is determined that there is no other target vehicle.

  If it is determined in S13 that there is another vehicle to be transmitted (S13: YES), the process proceeds to S14 to communicate with all other vehicles to be transmitted via the communication device 3. Is performed to transmit the traffic information stored in the traffic information table 23A. Thereafter, the transmitted traffic information is deleted from the traffic information table 23A. Even if it is not transmitted, when a predetermined time (for example, 30 seconds) has elapsed since the traffic information was stored in the traffic information table 23A, it is similarly deleted as unnecessary past information.

  On the other hand, when it is determined that there is no other vehicle to be transmitted (S13: NO), it is determined that there is no other vehicle that needs to transmit traffic information at the present time, and the target object is not related to the other vehicle. The vehicle-to-vehicle communication processing program is terminated without transmitting such information.

Here, the traffic information transmission process performed in S14 will be described in more detail with reference to FIG. 9. For example, when the traffic information shown in FIG. Information on “sedans” is transmitted to other vehicles 52 to 58 located within 1 km from the host vehicle 51.
In addition, information related to “traveling vehicle / track” is transmitted to other vehicles 52 and 53 located within 50 m from the host vehicle 51.
In addition, information regarding “pedestrians” is transmitted to other vehicles 52 to 56 located within 200 m from the host vehicle 51.

  Next, a traffic information display processing program executed by the communication processing ECU 7 of the inter-vehicle communication system 1 according to the first embodiment will be described with reference to FIG. FIG. 10 is a flowchart of the traffic information display processing program in the inter-vehicle communication system 1 according to the first embodiment. Here, the traffic information display processing program performs control for displaying traffic information around the host vehicle on the liquid crystal display 6 based on traffic information transmitted from another vehicle. 10 is stored in the ROM 22 or the RAM 23 provided in the communication processing ECU 7, and is executed by the CPU 21 at predetermined intervals (for example, every 4 ms).

  In the traffic information display processing program, first, in S21, the CPU 21 determines whether or not the traffic information transmitted from another vehicle has been received in S14 of the inter-vehicle communication processing program. And when it determines with having received traffic information (S21: YES), while moving to S22, when it determines with not having received traffic information (S21: NO), the said traffic information display process Exit the program.

  In S22, the traffic information transmitted from the other vehicle is analyzed. Specifically, the type and position coordinates of the object stored as traffic information are specified. Further, in the inter-vehicle communication system 1 according to the first embodiment, position information related to the same type of object (for example, a parked vehicle or a pedestrian) within a predetermined distance (for example, within 20 m) with respect to traffic information transmitted from another vehicle. When there are three or more, the position coordinates of the start point and the end point of the object located successively are specified. The position coordinates of the start point and end point may be specified on the transmitting vehicle side (for example, in the processing of S7 and S8 in FIG. 8).

Next, in S23, traffic information is displayed on the liquid crystal display 6 based on the analysis result of the traffic information analyzed in S22. The traffic information displayed on the liquid crystal display 6 in the process of S22 continues until a predetermined time (for example, 30 seconds) elapses or until traffic information is transmitted from another vehicle next time. Is displayed.
However, when traffic information is transmitted from a plurality of different other vehicles within a predetermined interval (for example, 30 seconds), it is desirable to simultaneously display the transmitted traffic information on the liquid crystal display 6.

  Here, FIG. 11 to FIG. 13 are diagrams showing a total of three patterns of traffic information display screens in which traffic information transmitted from other vehicles is displayed on the liquid crystal display 6. As shown in FIGS. 11 to 13, on the traffic information display screens 61 to 63, a map of the area around the current position of the host vehicle is displayed based on the map DB 13. On the displayed map, the vehicle mark 64 indicating the current position of the vehicle, the object marks 65 to 69 indicating the position and type of the object, the object section 70, the object moving areas 71 to 73, and the like. Are superimposed on each other.

  For example, the object mark 65 shown in FIG. 11 indicates that a truck-type traveling vehicle is traveling right in front of the host vehicle. The object mark 66 indicates that the wagon-type parked vehicle is parked on the road shoulder ahead of the host vehicle. The object mark 67 indicates that the sedan-type right turn vehicle is stopped to make a right turn at an intersection ahead of the host vehicle. The object marks 68 and 69 indicate that the pedestrian is walking at a predetermined point in front of the host vehicle.

FIG. 12 shows an example of traffic information using an object section 70 instead of an object mark. Here, in the inter-vehicle communication system 1 according to the first embodiment, with respect to traffic information transmitted from other vehicles, positions related to the same type of object (for example, a parked vehicle or a pedestrian) within a predetermined distance (for example, within 20 m). When there is more than a predetermined number of information, for example, 3 or more, the position coordinates of the start point and end point of the object are specified in the traffic information analysis process of S22, and the space between the position coordinates is displayed by the segment.
The object section 70 shown in FIG. 12 indicates that a plurality of parked vehicles are continuously parked in a predetermined section on the road shoulder located in front of the host vehicle. In this way, when the target object is continuously located, displaying the target object in segments makes it possible to display the target mark in an easy-to-understand manner rather than displaying the target mark continuously superimposed. It becomes.

On the other hand, FIG. 13 is an example in which traffic information is shown using the object movement areas 71 to 73 instead of the object marks. Here, the object movement areas 71 to 73 indicate the movement prediction range of the object together with the position of the object. This takes into account the range in which the target object may move before the host vehicle travels to the target point recognized by the other vehicle. A possible target object is set to be wider (for example, parked vehicle → pedestrian → bicycle → right turn vehicle → running vehicle in this order).
And the object moving area 71 shown in FIG. 13 has shown that the pedestrian is walking in the predetermined area ahead of the own vehicle. The object movement area 72 indicates that the bicycle is traveling in a predetermined area in front of the host vehicle. The object movement area 73 indicates that the traveling vehicle is traveling in a predetermined area in front of the host vehicle.

  And a driver | operator can grasp | ascertain easily the traffic information of the area which cannot be confirmed from the own vehicle by visually checking the traffic information display screens 61-63 displayed on the liquid crystal display 6. FIG. The traffic information may be output to the user by voice guidance using a speaker in addition to the display on the liquid crystal display 6.

As described above in detail, in the vehicle-to-vehicle communication system 1 according to the first embodiment, the types and position coordinates of the objects located around the own vehicle based on the image of the front environment of the vehicle imaged by the front camera 5 (S2 to S6) and extracted as traffic information (S7), and the extracted traffic information is transmitted to other vehicles (S14). Therefore, traffic information based on images captured between a plurality of vehicles 2 (specifically In particular, it is possible to share information regarding the type and position of the object.
Also, by transmitting and receiving traffic information extracted from images, the communication time for information communication is shortened compared to the case of directly transmitting image information without reducing the amount of traffic information required for the driver. And the processing load on the CPU 21 can be reduced.
In addition, when traffic information is transmitted from another vehicle, a map around the host vehicle is displayed on the liquid crystal display 6, and traffic information (specifically, the type of the target object) around the host vehicle is displayed on the displayed map. And information on the position) (S23), the driver can obtain traffic information around the vehicle based on the image captured by the other vehicle. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel by referring to the displayed traffic information.
Further, when the vehicle 2 transmits traffic information, it is determined whether or not there has been a change in the behavior of the vehicle (meandering operation or lane change) to avoid the object (S9, S10). Since the traffic information extracted only for the vehicle is transmitted (S14), the traffic information extracted from images captured between a plurality of vehicles (specifically, information on the type and position of the object), especially for other vehicles. It becomes possible to select and share only the traffic information that seems to be. Therefore, it is possible to reduce the communication time and processing load related to information communication without reducing the amount of traffic information necessary for the driver.
Moreover, since the traffic information regarding the said object is transmitted with respect to the other vehicle located in the transmission range based on the kind of target object which comprises traffic information (S11, S14), the suitable range according to the type of target object It becomes possible to transmit information only to other vehicles located inside and share traffic information. Therefore, it is possible to reduce the communication time and processing load related to information communication by reducing the number of communication without reducing the amount of traffic information necessary for the driver.
Furthermore, since the transmission range for transmitting traffic information is determined based on the types of objects constituting the traffic information, it is possible to select appropriate information according to the types of objects.
In addition, when transmitting information on the type of object to other vehicles, it is transmitted by a code (number) or pattern that identifies the type of object, so that the amount of information related to communication between vehicles can be reduced. Become.
Further, in the received traffic information, when there is a predetermined number or more (for example, 3 or more) of position information related to the same type of object within a predetermined distance, a segment for specifying a section of position coordinates related to the same type of object Is displayed (see FIG. 12), it becomes possible to easily display information on the objects continuously located within a predetermined distance to the driver.

(Second Embodiment)
Next, the vehicle-to-vehicle communication system according to the second embodiment will be described with reference to FIGS. In the following description, the same reference numerals as those of the inter-vehicle communication system 1 according to the first embodiment in FIGS. 1 to 13 are the same as those of the inter-vehicle communication system 1 according to the first embodiment. The corresponding part is shown.

The schematic configuration of the vehicle-to-vehicle communication system according to the second embodiment is substantially the same as the vehicle-to-vehicle communication system 1 according to the first embodiment. Various control processes are also substantially the same as the inter-vehicle communication system 1 according to the first embodiment.
However, when the inter-vehicle communication system 1 according to the first embodiment transmits the traffic information extracted from the image captured by the front camera 5 from the transmitting vehicle to the receiving vehicle, the transmitting vehicle is first positioned around Whereas the position information with the receiving vehicle is acquired (S12), and traffic information is transmitted by communicating only with the receiving vehicle located in the preset transmission range (see FIG. 4) (S14) In the inter-vehicle communication system according to the second embodiment, the transmitting vehicle transmits the traffic information to the communicable area where the communication device 3 can communicate, and receives the traffic information in the communicable area. The vehicle-to-vehicle communication system 1 according to the first embodiment in that the vehicle acquires position information with the transmission-side vehicle and outputs only traffic information transmitted from the transmission-side vehicle located in a preset reception range. Different You have me.

  Hereinafter, a vehicle-to-vehicle communication processing program executed by the communication processing ECU 7 of the vehicle-to-vehicle communication system according to the second embodiment will be described with reference to FIG. FIG. 14 is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system according to the second embodiment. 14 and 15 are stored in the ROM 22 and the RAM 23 provided in the communication processing ECU 7, and are executed by the CPU 21 at predetermined intervals (for example, every 4 ms).

  Here, since the process performed in S101-S110 is the same process as the process of S1-S10 of the vehicle-to-vehicle communication processing program (FIG. 8) which the vehicle-to-vehicle communication system 1 which concerns on the said 1st Embodiment performs. The description is omitted.

  Further, in S111, for all areas that can be communicated by the communication device 3 (for example, areas within a radius of 2 km from the vehicle 2), all traffic information is stored regardless of the contents of the traffic information stored in the traffic information table 23A in S108. Send. Thereafter, the transmitted traffic information is deleted from the traffic information table 23A.

  Next, a traffic information display processing program executed by the communication processing ECU 7 of the inter-vehicle communication system according to the second embodiment will be described with reference to FIG. FIG. 15 is a flowchart of the traffic information display processing program in the vehicle-to-vehicle communication system according to the second embodiment.

  In the traffic information display processing program, first, in S121, the CPU 21 determines whether or not the traffic information transmitted from another vehicle has been received in S111 of the inter-vehicle communication processing program. And when it determines with having received traffic information (S121: YES), it transfers to S122, and when it determines with not having received traffic information (S121: NO), the said traffic information display process Exit the program.

  In S122, the traffic information transmitted from the other vehicle is analyzed. Specifically, the type and position coordinates of the object stored as traffic information are specified. Further, in the inter-vehicle communication system according to the second embodiment, regarding traffic information transmitted from other vehicles, position information relating to the same type of object (for example, a parked vehicle or a pedestrian) is within a predetermined distance (for example, within 20 m). When there are three or more, the position coordinates of the start point and the end point of the successively located object are specified. The position coordinates of the start point and end point may be specified on the transmitting vehicle side (for example, in the processing of S107 and S108 in FIG. 14).

  Next, in S123, based on the analysis result of the traffic information analyzed in S122, based on the type of the identified object and the communication range setting table 22A (see FIG. 4) stored in the RAM 23, Set the reception range to output the received traffic information. For example, when the traffic information shown in FIG. 7 is transmitted from another vehicle, the information related to “parked vehicle / sedan” is set to output information transmitted from another vehicle located within 1 km from the own vehicle. Information relating to “traveling vehicle / track” is set to output information transmitted from another vehicle located within 50 m from the own vehicle, and information relating to “pedestrian” is transmitted from another vehicle located within 200 m from the own vehicle. Set when outputting things.

Subsequently, in S124, by communicating with the transmitting vehicle, which is another vehicle that transmits traffic information, via the communication device 3, the positional information of the transmitting vehicle is acquired, and the acquired positional information and the position of the own vehicle are acquired. The distance from the own vehicle to the transmitting vehicle is calculated from the information.
For example, in FIG. 9, when the other vehicle 56 that travels around the host vehicle 51 is a transmission-side vehicle that transmits traffic information, the distance between the host vehicle 51 and the other vehicle 56 is calculated.

Next, in S125, it is determined whether or not the transmission-side vehicle that transmitted the traffic information is located in any of the reception ranges set in S123, that is, whether or not there is traffic information transmitted from the reception range. The
Here, the reception range determination process performed in S125 will be described in more detail with reference to FIG. 9. For example, when the traffic information shown in FIG. When the other vehicles 52 to 58 located within 1 km from the host vehicle 51 are transmission side vehicles, it is determined that the transmission side vehicle is located in the reception range.
In addition, when the other vehicles 52 and 53 located within 50 m from the host vehicle 51 are transmission side vehicles, it is determined that the transmission side vehicle is located in the reception range.
Further, the information regarding “pedestrian” is determined that the transmitting vehicle is located in the reception range when the other vehicles 52 to 56 located within 200 m from the own vehicle 51 are transmitting vehicles.

If it is determined in S125 that there is traffic information transmitted from another vehicle located in the reception range (S125: YES), the liquid crystal is based on the analysis result of the traffic information analyzed in S122. Traffic information is displayed on the display 6. In addition, since the display method of the traffic information with respect to the liquid crystal display 6 is the same as that of the inter-vehicle communication system 1 which concerns on 1st Embodiment (refer FIGS. 11-13), the description is abbreviate | omitted here.
The traffic information displayed on the liquid crystal display 6 in the process of S126 continues until a predetermined time (for example, 30 seconds) elapses or until traffic information is next transmitted from another vehicle. Is displayed.
However, when traffic information is transmitted from a plurality of different other vehicles within a predetermined interval (for example, 30 seconds), it is desirable to simultaneously display the transmitted traffic information on the liquid crystal display 6.

  On the other hand, when it is determined in S125 that there is no traffic information transmitted from another vehicle located in the reception range (S125: NO), the transmitted traffic information is not traffic information that needs to be output at the present time. And the traffic information display processing program is terminated without displaying the traffic information on the liquid crystal display 6.

As described above in detail, in the vehicle-to-vehicle communication system according to the second embodiment, the type and position coordinates of the object located in the vicinity of the host vehicle are determined based on the image of the front environment of the vehicle imaged by the front camera 5. Since it detects (S102-S106) and extracts as traffic information (S107) and transmits the extracted traffic information to other vehicles, traffic information based on images captured between a plurality of vehicles 2 (specifically, target It is possible to share information on the types and positions of objects).
Also, by transmitting and receiving traffic information extracted from images, the communication time for information communication is shortened compared to the case of directly transmitting image information without reducing the amount of traffic information required for the driver. And the processing load on the CPU 21 can be reduced.
In addition, when traffic information is transmitted from another vehicle, a map around the host vehicle is displayed on the liquid crystal display 6, and traffic information (specifically, the type of the target object) around the host vehicle is displayed on the displayed map. And the information on the position) (S126), the driver can obtain traffic information around the own vehicle based on the image captured by the other vehicle. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel by referring to the displayed traffic information.
Further, when the vehicle 2 transmits traffic information, it is determined whether or not there has been a change in vehicle behavior (meandering operation or lane change) to avoid an object (S109, S110). Since the traffic information extracted only to the vehicle is transmitted (S111), it is necessary for other vehicles, particularly among the traffic information extracted from images captured between a plurality of vehicles (specifically, information on the type and position of the object). It becomes possible to select and share only the traffic information that seems to be. Therefore, it is possible to reduce the communication time and processing load related to information communication without reducing the amount of traffic information necessary for the driver.
In addition, the vehicle that has received the traffic information determines whether or not the other vehicle that has transmitted the traffic information is located in the reception range based on the type of the object (S125), and if it is determined that the vehicle is in the reception range, the liquid crystal Since the traffic information is displayed on the display 6 (S126), the driver can select and obtain only the traffic information that seems particularly necessary. Therefore, even when a lot of traffic information is transmitted from another vehicle, the driver can appropriately travel with reference to the output traffic information.

(Third embodiment)
Next, a vehicle-to-vehicle communication system according to a third embodiment will be described with reference to FIGS. In the following description, the same reference numerals as those of the inter-vehicle communication system 1 according to the first embodiment in FIGS. 1 to 13 are the same as those of the inter-vehicle communication system 1 according to the first embodiment. The corresponding part is shown.

The schematic configuration of the inter-vehicle communication system according to the third embodiment is substantially the same as the inter-vehicle communication system 1 according to the first embodiment. Various control processes are also substantially the same as the inter-vehicle communication system 1 according to the first embodiment.
However, when the inter-vehicle communication system 1 according to the first embodiment detects an object in the image captured by the front camera 5 (S3: YES), the traffic information extracted from the image is continuously transmitted from the transmission-side vehicle. In contrast to the transmission to the receiving vehicle (S14), in the inter-vehicle communication system according to the third embodiment, the traffic information extracted from the image when the object is detected in the image captured by the front camera 5 is displayed. Points that are accumulated and stored in the RAM, and when other vehicles are located in the transmission range set for each accumulated and stored traffic information, the traffic information accumulated and stored up to that point is transmitted to the other vehicle. This is different from the inter-vehicle communication system 1 according to the first embodiment.

  Next, a traffic information storage processing program executed by the communication processing ECU 7 of the vehicle-to-vehicle communication system according to the third embodiment having the above configuration will be described with reference to FIG. FIG. 16 is a flowchart of a traffic information storage processing program in the inter-vehicle communication system 1 according to the third embodiment. Here, the traffic information storage processing program performs control for accumulating and storing in the RAM 23 the traffic information extracted from the captured image captured by the front camera 5 when the vehicle 2 travels on the road. The programs shown in the flowcharts of FIGS. 16 to 18 below are stored in the ROM 22 and the RAM 23 provided in the communication processing ECU 7, and are executed by the CPU 21 at predetermined intervals (for example, every 4 ms).

  In the traffic information storage processing program, first, in S301, the CPU 21 images the front environment of the vehicle 2 with the front camera 5. Subsequently, in S302, the image captured by the front camera 5 in S301 is captured and analyzed, and image recognition for detecting objects such as pedestrians, bicycles, other vehicles, and other obstacles located around the vehicle 2 is performed. Process.

  Specifically, first, an image captured by the front camera 5 is input using analog communication means such as NTSC or digital communication means such as i-link, and is converted into a digital image format such as jpeg or mpeg. . Next, the CPU 21 corrects the brightness of the road surface and the object in the captured image based on the brightness difference. Thereafter, a binarization process for separating the object from the image, a geometric process for correcting distortion, a smoothing process for removing image noise, and the like are performed to detect a boundary line between the road surface and the object. Thereby, it is possible to detect an object located around the vehicle 2.

  Next, in S303, it is determined whether or not any object has been detected from the captured image as a result of the image recognition processing in S302. If it is determined that some object has been detected (S303: YES), the process proceeds to S304. On the other hand, if it is determined that no object has been detected (S303: NO), it is stored in the RAM 23. Since there is no traffic information that should be transmitted, the traffic information storage processing program is terminated.

Next, in S304, the GPS 11 is used to detect the current position of the host vehicle 2. Thereafter, in S305, the distance to the subject is calculated from the position of the object (specifically, the number of pixels from the lower edge) detected by the image recognition process in S302, and the own vehicle detected in S304. The position coordinates of the object are indirectly detected from the relative positional relationship with the current position.
As a method for detecting the position coordinates of the object, in addition to the method for detecting based on the above-described captured image, for example, a millimeter wave radar that transmits millimeter waves is provided in the vehicle 2 and reflected by the object. The distance from the vehicle 2 to the object may be detected by measuring the millimeter wave, and the position coordinates of the object may be detected from the current position of the vehicle 2.

  In step S306, the type of the object detected in the image recognition process in step S302 is specified. Specifically, the image size of the detected object is enlarged or reduced at an enlargement rate or reduction rate determined according to the distance from the host vehicle to the object calculated in S305. Then, the type of the object detected in the image is calculated by pattern-matching the image of the object whose size has been adjusted with each template image stored in the ROM 22. Furthermore, from the moving direction and moving speed in the captured image 41 of the target object thereafter, the relative position of the target object with respect to the vehicle traveling state (parked vehicle, traveling vehicle, right turn vehicle) and the transmitting vehicle when the target object is a vehicle. Also detect (left shoulder, right shoulder, etc.). If none of the template images stored in the ROM 22 matches, it is determined that the detected object is not traffic information to be stored in the RAM 23, and the traffic information storage processing program is terminated.

  In S307, the CPU 21 extracts the position coordinates of the object detected in S305 and the type of the object specified in S306 as traffic information, and cumulatively stores it in the traffic information table 23A of the RAM 23. (S308).

  Next, an inter-vehicle communication processing program executed by the communication processing ECU 7 of the inter-vehicle communication system 1 according to the third embodiment having the above-described configuration will be described with reference to FIG. FIG. 17 is a flowchart of a vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system 1 according to the third embodiment. Here, the vehicle-to-vehicle communication processing program performs control for transmitting the traffic information accumulated by the traffic information storage processing program to other vehicles located in the transmission range.

  In the inter-vehicle communication processing program, first, in S311, the CPU 21 determines whether or not communication with another vehicle has been performed via the communication device 3, that is, whether or not the other vehicle is located in an area where communication with the communication device 3 is possible. judge.

  As a result, when it is determined that communication with another vehicle has been performed (S311: YES), the process proceeds to S312. On the other hand, when it is determined that communication with another vehicle has not been performed (S311: NO), Since there is no other vehicle for which traffic information is to be transmitted, the vehicle-to-vehicle communication processing program ends.

  In S312, the position information of each other vehicle is obtained by communicating with each other vehicle located around the own vehicle via the communication device 3, and the own vehicle is further obtained from the obtained position information and the position information of the own vehicle. The distance from each other vehicle is calculated.

  Subsequently, in S313, the traffic information accumulated in the traffic information table 23A stored in the RAM 23 is read as traffic information to be transmitted to other vehicles.

  Next, in S314, it is determined whether or not another vehicle to which the traffic information read in S313 is to be transmitted is located around the own vehicle. For example, when the traffic information read out in S313 is traffic information that targets only pedestrians, and the other vehicle does not exist within 200 m of the subject vehicle in the calculation result of S312, It is determined that there is no other vehicle to be transmitted.

  If it is determined in S314 that there is another vehicle to be transmitted (S314: YES), the process proceeds to S315 to communicate with all other vehicles to be transmitted via the communication device 3. To transmit the traffic information accumulated and stored in the traffic information table 23A. Thereafter, the transmitted traffic information is deleted from the traffic information table 23A. Even if it is not transmitted, when a predetermined time (for example, 30 seconds) has elapsed since the traffic information was stored in the traffic information table 23A, it is similarly deleted as unnecessary past information.

  On the other hand, when it is determined that there is no other vehicle to be transmitted (S314: NO), it is determined that there is no other vehicle that needs to transmit the traffic information at the present time, and the target object is not compared to the other vehicle. The vehicle-to-vehicle communication processing program is terminated without transmitting such information.

  Next, a traffic information display processing program executed by the communication processing ECU 7 of the inter-vehicle communication system 1 according to the third embodiment will be described with reference to FIG. FIG. 18 is a flowchart of a traffic information display processing program in the inter-vehicle communication system 1 according to the third embodiment. Here, the traffic information display processing program performs control for displaying traffic information around the host vehicle on the liquid crystal display 6 based on traffic information transmitted from another vehicle.

  In the traffic information display processing program, first, in S321, the CPU 21 determines whether or not the traffic information transmitted from another vehicle has been received in S315 of the inter-vehicle communication processing program. If it is determined that traffic information has been received (S321: YES), the process proceeds to S322. If it is determined that traffic information has not been received (S321: NO), the traffic information display process is performed. Exit the program.

  In S322, the traffic information transmitted from the other vehicle is analyzed. Specifically, the type and position coordinates of the object stored as traffic information are specified. Further, in the inter-vehicle communication system 1 according to the third embodiment, position information relating to the same type of object (for example, a parked vehicle or a pedestrian) within a predetermined distance (for example, within 20 m) with respect to traffic information transmitted from another vehicle. When there are three or more, the position coordinates of the start point and the end point of the object located successively are specified. The position coordinates of the start point and the end point may be specified on the transmitting vehicle side (for example, in the processing of S307 and S308 in FIG. 16).

Next, in S323, traffic information is displayed on the liquid crystal display 6 based on the analysis result of the traffic information analyzed in S322. The traffic information displayed on the liquid crystal display 6 in the process of S322 continues until a predetermined time (for example, 30 seconds) elapses or until traffic information is transmitted from another vehicle next time. Is displayed.
However, when traffic information is transmitted from a plurality of different other vehicles within a predetermined interval (for example, 30 seconds), it is desirable to simultaneously display the transmitted traffic information on the liquid crystal display 6.

  In addition, about the display screen which displays traffic information on the liquid crystal display 6, it is the same as the display screen which displays traffic information on the liquid crystal display 6 of the inter-vehicle communication system 1 which concerns on 1st Embodiment. Since the traffic information display screens 61 to 63 displayed on the liquid crystal display 6 of the inter-vehicle communication system 1 according to the first embodiment have already been described with reference to FIGS. 11 to 13, description thereof is omitted here. To do. The traffic information may be output to the user by voice guidance using a speaker in addition to the display on the liquid crystal display 6.

As described above in detail, in the vehicle-to-vehicle communication system according to the third embodiment, the type and position coordinates of the object located in the vicinity of the host vehicle are determined based on the image of the front environment of the vehicle imaged by the front camera 5. It detects (S302-S306), extracts as traffic information (S307), accumulates and stores the extracted traffic information (S308), and stores the traffic information accumulated when communication with other vehicles is performed. Since it transmits to another vehicle (S315), it becomes possible to share the traffic information based on the image imaged among the some vehicles 2 (specifically information regarding the type and position of the object).
Also, by transmitting and receiving traffic information extracted from images, the communication time for information communication is shortened compared to the case of directly transmitting image information without reducing the amount of traffic information required for the driver. And the processing load on the CPU 21 can be reduced.
In addition, when traffic information is transmitted from another vehicle, a map around the host vehicle is displayed on the liquid crystal display 6, and traffic information (specifically, the type of the target object) around the host vehicle is displayed on the displayed map. (S323) is displayed (S323), so that the driver can obtain traffic information around the vehicle based on an image captured by another vehicle. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel by referring to the displayed traffic information.
In addition, since traffic information related to the object is transmitted to other vehicles located in the transmission range based on the type of the object constituting the traffic information (S312 and S315), an appropriate range according to the type of the object It becomes possible to transmit information only to other vehicles located inside and share traffic information. Therefore, it is possible to reduce the communication time and processing load related to information communication by reducing the number of communication without reducing the amount of traffic information necessary for the driver.
Furthermore, since the transmission range for transmitting traffic information is determined based on the types of objects constituting the traffic information, it is possible to select transmission information accurately according to the types of objects.

(Fourth embodiment)
Next, the vehicle-to-vehicle communication system 101 according to the fourth embodiment will be described with reference to FIGS. In the following description, the same reference numerals as those of the inter-vehicle communication system 1 according to the first embodiment in FIGS. 1 to 13 are the same as those of the inter-vehicle communication system 1 according to the first embodiment. The corresponding part is shown.

The schematic configuration of the vehicle-to-vehicle communication system 101 according to the fourth embodiment is substantially the same as the vehicle-to-vehicle communication system according to the first embodiment. Various control processes are also substantially the same as the inter-vehicle communication system 1 according to the first embodiment.
However, when the vehicle-to-vehicle communication system 1 according to the first embodiment detects an object in the image captured by the front camera 5 (S3: YES), the traffic information extracted from the image is transmitted from the transmitting vehicle to the receiving side. In contrast to the transmission to the vehicle (S14), in the inter-vehicle communication system 101 according to the fourth embodiment, the traffic information extracted from the image when the object is detected in the image captured by the front camera 5 is stored in the RAM. Vehicle-to-vehicle communication according to the first embodiment in that the traffic information accumulated up to that point is transmitted to another vehicle that has passed the vehicle when the vehicle passes another vehicle. Different from system 1.

First, a schematic configuration of the inter-vehicle communication system 101 according to the fourth embodiment will be described with reference to FIG. FIG. 19 is a schematic configuration diagram of a vehicle-to-vehicle communication system 101 according to the fourth embodiment.
As shown in FIG. 19, the inter-vehicle communication system 101 according to the fourth embodiment is configured by a plurality of vehicles 102 that travel on a road composed of two or more lanes, and the vehicle 102 that travels in one of the lanes. When the vehicles 102 traveling in other lanes pass each other, information communication between the vehicles is performed by the communication device 103 provided in each vehicle 102. In the communication between the vehicles 102 in the inter-vehicle communication system 101, information can be transmitted / received via a facility such as a communication center in addition to directly transmitting / receiving information between the vehicles 102.

Next, the structure which concerns on the control system of the vehicle 102 which comprises the vehicle-to-vehicle communication system 101 which concerns on 4th Embodiment is demonstrated based on FIG. FIG. 20 is a block diagram schematically showing a control system of the vehicle 102 constituting the inter-vehicle communication system 101 according to the fourth embodiment.
In FIG. 20, the control system of the vehicle 102 is configured based on the communication processing ECU 107 and the control means of the vehicle ECU 110, and the peripheral devices described above are connected to the control means. Here, in the configuration related to the control system of the vehicle 102 according to the fourth embodiment, the communication device 103 excluding the communication processing ECU 107, the front camera 105, the liquid crystal display 106, the current location detection unit 108, the information DB 109, the vehicle ECU 110, and the vehicle speed sensor 115. As for the configuration of the steering angle sensor 116 and the gyro sensor 117, the communication device 3, the front camera 5, the liquid crystal display 6, and the current position detection unit related to the control system of the vehicle 2 according to the first embodiment already described with reference to FIG. 8. Since the configuration of the information DB 9, the vehicle ECU 10, the vehicle speed sensor 15, the steering angle sensor 16, and the gyro sensor 17 is the same, details thereof are omitted.

  Here, the communication processing ECU 107 is configured with the CPU 121 as a core, and a ROM 122 and a RAM 123 which are storage means are connected to the CPU 121. In the ROM 122, a traffic information storage processing program (see FIG. 22) for accumulating and storing traffic information extracted from an image captured by the front camera 5, and inter-vehicle communication for transmitting the stored traffic information to another vehicle passing by. A processing program (see FIG. 23), a traffic information deletion processing program (see FIG. 24) that deletes cumulatively stored traffic information in the order from which the communication valid time has passed, and a vehicle based on traffic information transmitted from another vehicle Information display processing program (see FIG. 25) for displaying the traffic information around the vehicle on the liquid crystal display 106, and setting the communication valid time from the traffic information storage to the traffic information deletion based on the type of the object The communication valid time setting table 122A and other various programs necessary for controlling the liquid crystal display 106 and the like are stored. That. The RAM 123 is a memory that temporarily stores various data calculated by the CPU 121. In particular, in the fourth embodiment, a traffic information table 123A that cumulatively stores traffic information extracted from images captured by the front camera 105 in the fourth embodiment. Is stored.

Next, the communication valid time setting table 122A stored in the ROM 122 will be described with reference to FIG. FIG. 21 is a diagram showing a communication valid time setting table 122A according to the fourth embodiment.
As shown in FIG. 21, the communication valid time setting table 122A deletes the traffic information stored after the traffic information is stored in the traffic information table 123A and the type of the object recognized in the image captured by the front camera 105. It consists of the effective communication time until
For example, if the object recognized from the captured image is a “traveling vehicle”, the traffic information related to the object is deleted after 10 seconds from the time when the traffic information is stored in the traffic information table 123A, and the object passes between them. Traffic information is transmitted to and from other vehicles. If the object recognized from the captured image is “bicycle”, the traffic information related to the object is deleted in 20 seconds after the traffic information is stored in the traffic information table 123A. Traffic information is transmitted to and from other vehicles. If the object recognized from the captured image is a “pedestrian”, the traffic information related to the object is deleted 30 seconds after the traffic information is stored in the traffic information table 123A, and the object passes by Traffic information is transmitted to and from other vehicles. In addition, when the object recognized from the captured image is a “right turn vehicle”, the traffic information related to the object is deleted after one minute from the time when the traffic information related to the object is stored in the traffic information table 123A. Traffic information is transmitted to and from other vehicles. In addition, when the object recognized from the captured image is “parked vehicle” or other obstacle, the traffic information related to the object is stored in the traffic information table 123 </ b> A after 3 minutes have passed. Traffic information is transmitted to other vehicles that have been deleted and passed each other. As a result, it is possible to transmit only information on an object that is considered to be effective for other vehicles that receive traffic information.

  Further, since the traffic information table 123A stored in the RAM 123 is the same as the traffic information table 23A (FIG. 7) according to the first embodiment, the description thereof is omitted here.

  Next, a traffic information storage processing program executed by the communication processing ECU 107 of the inter-vehicle communication system 101 according to the fourth embodiment having the above-described configuration will be described with reference to FIG. FIG. 22 is a flowchart of the traffic information storage processing program in the inter-vehicle communication system 101 according to the fourth embodiment. Here, the traffic information storage processing program performs control for accumulating and storing in the RAM 123 traffic information extracted from a captured image captured by the front camera 5 when the vehicle 102 travels on a road. The programs shown in the flowcharts of FIGS. 22 to 25 below are stored in the ROM 122 and RAM 123 provided in the communication processing ECU 107, and are executed by the CPU 121 at predetermined intervals (for example, every 4 ms).

  In the traffic information storage processing program, first in step S <b> 401, the CPU 121 images the front environment of the vehicle 102 with the front camera 105. Subsequently, in S402, the image captured by the front camera 105 in S401 is captured and analyzed, and image recognition for detecting objects such as pedestrians, bicycles, other vehicles, and other obstacles located around the vehicle 102 is performed. Process.

  Specifically, first, an image captured by the front camera 105 is input using analog communication means such as NTSC or digital communication means such as i-link, and converted into a digital image format such as jpeg or mpeg. . Next, the CPU 121 corrects the brightness of the road surface and the object in the captured image based on the brightness difference. Thereafter, a binarization process for separating the object from the image, a geometric process for correcting distortion, a smoothing process for removing image noise, and the like are performed to detect a boundary line between the road surface and the object. Thereby, it is possible to detect an object located around the vehicle 102.

  Next, in S403, it is determined whether or not any object has been detected from the captured image as a result of the image recognition processing in S402. If it is determined that some object has been detected (S403: YES), the process proceeds to S404. On the other hand, if it is determined that no object has been detected (S403: NO), it is stored in the RAM 123. Since there is no traffic information that should be transmitted, the traffic information storage processing program is terminated.

Next, in S404, the current position of the host vehicle 102 is detected using the GPS 111. Thereafter, in S405, the distance to the subject is calculated from the position of the object (specifically, the number of pixels from the lower edge) detected by the image recognition process in S402, and the own vehicle detected in S404 is further calculated. The position coordinates of the object are indirectly detected from the relative positional relationship with the current position.
In addition to the method of detecting the position coordinates of the object based on the captured image described above, for example, a millimeter wave radar that transmits millimeter waves to the vehicle 102 is provided and reflected by the object. The distance from the vehicle 102 to the object may be detected by measuring the millimeter wave, and the position coordinates of the object may be detected from the current position of the vehicle 102.

  In step S406, the type of the object detected in the image recognition process in step S402 is specified. Specifically, the image size of the detected object is enlarged or reduced at an enlargement rate or reduction rate determined according to the distance from the vehicle to the object calculated in S405. Then, the type of the object detected in the image is calculated by pattern-matching the image of the object whose size has been adjusted with each template image stored in the ROM 122. Furthermore, from the moving direction and moving speed in the captured image 41 of the target object thereafter, the relative position of the target object with respect to the vehicle traveling state (parked vehicle, traveling vehicle, right turn vehicle) and the transmitting vehicle when the target object is a vehicle. Also detect (left shoulder, right shoulder, etc.). If none of the template images stored in the ROM 122 matches, it is determined that the detected object is not traffic information to be stored in the RAM 123, and the traffic information storage processing program is terminated.

  In S407, the CPU 121 extracts the position coordinates of the object detected in S405 and the type of the object specified in S406 as traffic information, and cumulatively stores it in the traffic information table 123A of the RAM 123. (S408).

  Next, an inter-vehicle communication processing program executed by the communication processing ECU 107 of the inter-vehicle communication system 101 according to the fourth embodiment having the above-described configuration will be described with reference to FIG. FIG. 23 is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system 101 according to the fourth embodiment. Here, the vehicle-to-vehicle communication processing program performs control for transmitting the traffic information accumulated by the traffic information storage processing program to another vehicle passing by.

  In the vehicle-to-vehicle communication processing program, first, in S411, the CPU 121 determines whether or not communication with another vehicle has been performed via the communication device 103, that is, whether or not the other vehicle is located within a communicable area by the communication device 103. judge.

  As a result, when it is determined that communication with another vehicle is performed (S411: YES), the process proceeds to S412. On the other hand, when it is determined that communication with another vehicle is not performed (S411: NO), Since there is no other vehicle for which traffic information is to be transmitted, the vehicle-to-vehicle communication processing program ends.

  In S412, the position information of each other vehicle is acquired by communicating with each other vehicle located around the own vehicle via the communication device 103, and the own vehicle is further obtained from the acquired position information and the position information of the own vehicle. The distance from each other vehicle is calculated.

  Subsequently, in S413, it is determined from the distance to the other vehicle detected in S412 (for example, whether the distance is within 5 m) as to whether the other vehicle with which the communication has been performed is the other vehicle that passes the own vehicle. To do. Here, in the inter-vehicle communication system 101 according to the fourth embodiment, the communication range between the vehicles by the communication device 103 is set narrow (for example, within a radius of 5 m), and the vehicle 102 traveling on the road as described above is another vehicle. When passing each other, communication is performed with the passing vehicle (see FIG. 19).

If it is determined that the other vehicle that has performed communication is another vehicle that passes the own vehicle (S413: YES), the traffic information table 123A stored in the RAM 123 is stored as traffic information to be transmitted to the other vehicle. The traffic information accumulated and stored in is read out (S414).
On the other hand, if it is determined that the other vehicle that communicated is not the other vehicle that passes the own vehicle (S413: NO), there is no other vehicle that is the target of transmission of traffic information. finish.

  Next, in S415, the CPU 121 transmits the traffic information read out in S414 to another vehicle passing by.

  Next, a traffic information deletion processing program executed by the communication processing ECU 107 of the inter-vehicle communication system 101 according to the fourth embodiment having the above-described configuration will be described with reference to FIG. FIG. 24 is a flowchart of the traffic information deletion processing program in the inter-vehicle communication system 101 according to the fourth embodiment. Here, the traffic information deletion processing program performs control to delete cumulatively stored traffic information in order from the communication effective time having elapsed.

  In the traffic information deletion processing program, first, in step S <b> 421, the CPU 121 determines whether at least one or more traffic information is stored in the traffic information table 123 </ b> A of the RAM 123.

  When it is determined that one or more pieces of traffic information are stored in the traffic information table 123A (S421: YES), the process proceeds to S422, while when it is determined that no traffic information is stored (S421: S421). NO) has no traffic information to be deleted, so the traffic information deletion processing program is terminated.

  In S422, the communication effective time of the stored traffic information is read based on the type of the object constituting the traffic information stored in the traffic information table 123A and the communication effective time setting table 122A.

  Thereafter, in S423, it is determined whether or not the communication effective time of the traffic information read out in S422 has elapsed. Specifically, the elapsed time after the traffic information is stored (S408) is measured using the current time acquired from the GPS 111, and the communication of any traffic information stored in the traffic information table 123A is measured. When the valid time has passed, it is determined that the communication valid time of the traffic information has passed.

  If it is determined that there is traffic information for which the communication valid time has elapsed (S423: YES), the traffic information determined to have elapsed is deleted from the traffic information table 123A (S424). As a result, past traffic information that does not require communication with other vehicles can be automatically deleted from the RAM 123.

  On the other hand, when it is determined that there is no traffic information for which the communication valid time has passed (S423: NO), there is no traffic information to be deleted at the present time, and thus the traffic information deletion processing program is terminated.

  Next, a traffic information display processing program executed by the communication processing ECU 107 of the inter-vehicle communication system 101 according to the fourth embodiment will be described with reference to FIG. FIG. 25 is a flowchart of a traffic information display processing program in the inter-vehicle communication system 101 according to the fourth embodiment. Here, the traffic information display processing program performs control for displaying traffic information around the host vehicle on the liquid crystal display 106 based on traffic information transmitted from another vehicle.

  In the traffic information display processing program, first, in S431, the CPU 121 determines whether or not the traffic information transmitted from another vehicle in S415 of the inter-vehicle communication processing program has been received. If it is determined that traffic information has been received (S431: YES), the process proceeds to S432, whereas if it is determined that traffic information has not been received (S431: NO), the traffic information display process is performed. Exit the program.

  In S432, the traffic information transmitted from the other vehicle is analyzed. Specifically, the type and position coordinates of the object stored as traffic information are specified. Further, in the inter-vehicle communication system 101 according to the fourth embodiment, position information relating to the same type of object (for example, a parked vehicle or a pedestrian) within a predetermined distance (for example, within 20 m) with respect to traffic information transmitted from another vehicle. When there are three or more, the position coordinates of the start point and the end point of the object located successively are specified. The position coordinates of the start point and end point may be specified on the transmitting vehicle side (for example, in step S407 or S408 in FIG. 22).

Next, in S433, traffic information is displayed on the liquid crystal display 106 based on the analysis result of the traffic information analyzed in S432. The traffic information displayed on the liquid crystal display 106 in the process of S432 continues until a predetermined time (for example, 30 seconds) elapses or until traffic information is next transmitted from another vehicle. Is displayed.
However, when traffic information is transmitted from a plurality of different other vehicles within a predetermined interval (for example, 30 seconds), it is desirable to simultaneously display the transmitted traffic information on the liquid crystal display 106.

  The display screen for displaying the traffic information on the liquid crystal display 106 is the same as the display screen for displaying the traffic information on the liquid crystal display 6 of the inter-vehicle communication system 1 according to the first embodiment. Since the traffic information display screens 61 to 63 displayed on the liquid crystal display 6 of the inter-vehicle communication system 1 according to the first embodiment have already been described with reference to FIGS. 11 to 13, description thereof is omitted here. To do. The traffic information may be output to the user by voice guidance using a speaker in addition to the display on the liquid crystal display 106.

As described above in detail, in the vehicle-to-vehicle communication system 101 according to the fourth embodiment, the types and position coordinates of the objects located around the vehicle based on the image of the front environment of the vehicle captured by the front camera 105 Is detected (S402 to S406), extracted as traffic information (S407), and the extracted traffic information is accumulated and stored (S408), and the accumulated traffic information is transmitted to another vehicle passing by (S408). S415), it becomes possible to share traffic information (specifically, information on the type and position of the object) based on images captured between the plurality of vehicles 102.
Also, by transmitting and receiving traffic information extracted from images, the communication time for information communication is shortened compared to the case of directly transmitting image information without reducing the amount of traffic information required for the driver. And the processing load on the CPU 121 can be reduced.
In addition, when traffic information is transmitted from another vehicle, a map around the host vehicle is displayed on the liquid crystal display 106, and traffic information (specifically, the type of the target object) around the host vehicle is displayed on the displayed map. And information on the position) (S433), the driver can obtain traffic information around the vehicle based on the image captured by the other vehicle. Therefore, it is necessary to drive in limited information such as when the road is congested and other vehicles are running or stopped in the vicinity of the vehicle, or when driving on a road with poor visibility. Even under certain circumstances, the driver can appropriately travel by referring to the displayed traffic information.
In addition, the traffic information stored in the RAM 123 is deleted when the transmittable time based on the type of the object has passed (S423, S424), so that the traffic information related to the object with respect to other vehicles that have passed within the transmittable time. Traffic information will be transmitted. Therefore, it becomes possible to transmit information only to other vehicles located in an appropriate area according to the type of the object, and to share traffic information. Then, it is possible to reduce the communication time and the processing load related to information communication by reducing the number of communication without reducing the amount of traffic information necessary for the driver.
Furthermore, since the transmission possible time in which the traffic information is stored in the RAM 123 and can be transmitted is determined based on the type of the object constituting the traffic information, the transmission information can be accurately selected according to the type of the object. It becomes possible.

Note that the present invention is not limited to the above-described embodiment, and various improvements and modifications can be made without departing from the scope of the present invention.
For example, in the first to fourth embodiments, when traffic information transmitted from another vehicle is received, the received traffic information is displayed on the liquid crystal displays 6 and 106. The traffic information may not be displayed, and may be displayed when approaching a predetermined distance (for example, 50 m) to the position of the object constituting the traffic information.

  In the first to third embodiments, the traffic information is transmitted or displayed when the receiving vehicle is located within the range of the communication range setting table 22A with respect to the transmitting vehicle. The traffic information may be transmitted or displayed regardless of whether or not it is located within the range of the range setting table 22A. In this case, traffic information located within the range of the communication range setting table 22A may be displayed with priority or emphasis over other traffic information.

  Further, in the first and second embodiments, whether or not the vehicle has a behavior change of a predetermined amount or more is detected by the steering angle sensor 16 or the gyro sensor 17, but the traveling locus of the vehicle is detected by the GPS 11. Further, it may be determined whether or not the vehicle has a behavior change of a predetermined amount or more based on the detected travel locus.

  Further, in the fourth embodiment, the traffic information that has passed when the effective communication time has elapsed is deleted from the RAM 123, and only the traffic information that is stored in the RAM 123 without being deleted is transmitted to other vehicles. However, by setting a flag as to whether or not to communicate with the traffic information stored in the RAM 123 and turning off the flag when the communication valid time has elapsed, the traffic with the flag turned on Only information may be transmitted to other vehicles.

1 is a schematic configuration diagram of a vehicle-to-vehicle communication system according to a first embodiment. It is a schematic block diagram which shows especially the vehicle of the inter-vehicle communication system which concerns on 1st Embodiment. It is a block diagram which shows typically the control system of the vehicles which constitute the inter-vehicle communication system concerning a 1st embodiment. It is the figure shown about the communication range setting table which concerns on 1st Embodiment. It is the top view which showed the vehicle which drive | works on a road at the predetermined timing. FIG. 6 is a schematic diagram illustrating a captured image of a front environment of a vehicle captured by a front camera at the timing of FIG. 5. It is the figure which showed the traffic information table which memorize | stored the traffic information extracted based on the captured image of FIG. It is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system according to the first embodiment. It is the schematic diagram which showed the positional relationship of the own vehicle in the predetermined timing which drive | works a road, and the other vehicle which drive | works the surroundings of the own vehicle. It is a flowchart of the traffic information display processing program in the vehicle-to-vehicle communication system which concerns on 1st Embodiment. It is the figure which showed the example of the traffic information display screen which displayed the traffic information transmitted from the other vehicle on the liquid crystal display. It is the figure which showed the example of the traffic information display screen which displayed the traffic information transmitted from the other vehicle on the liquid crystal display. It is the figure which showed the example of the traffic information display screen which displayed the traffic information transmitted from the other vehicle on the liquid crystal display. It is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system according to the second embodiment. It is a flowchart of the traffic information display processing program in the vehicle-to-vehicle communication system which concerns on 2nd Embodiment. It is a flowchart of the traffic information storage process program in the vehicle-to-vehicle communication system which concerns on 3rd Embodiment. It is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system according to the third embodiment. It is a flowchart of the traffic information display processing program in the vehicle-to-vehicle communication system which concerns on 3rd Embodiment. It is a schematic block diagram of the vehicle-to-vehicle communication system which concerns on 4th Embodiment. It is a block diagram which shows typically the control system of the vehicle which comprises the vehicle-to-vehicle communication system which concerns on 4th Embodiment. It is the figure shown about the communication effective time setting table which concerns on 4th Embodiment. It is a flowchart of the traffic information storage processing program in the vehicle-to-vehicle communication system which concerns on 4th Embodiment. It is a flowchart of the vehicle-to-vehicle communication processing program in the vehicle-to-vehicle communication system according to the fourth embodiment. It is a flowchart of the traffic information deletion process program in the inter-vehicle communication system which concerns on 4th Embodiment. It is a flowchart of the traffic information display processing program in the vehicle-to-vehicle communication system which concerns on 4th Embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1,101 Inter-vehicle communication system 2,102 Vehicle 3,103 Communication device 5,105 Front camera 6,106 Liquid crystal display 7,107 Communication processing ECU
8, 108 Current location detection unit 11, 111 GPS
16, 116 Steering angle sensor 17, 117 Gyro sensor 21, 121 CPU
22, 122 ROM
23, 123 RAM
41 Captured image 65-69 Object mark 70 Object section 71-73 Object movement area

Claims (4)

In a vehicle-to-vehicle communication system for communicating information between a plurality of vehicles traveling on a road,
The vehicle is
Imaging means for imaging the periphery of the vehicle;
Traffic information extracting means for extracting traffic information relating to the periphery of the vehicle from the image captured by the imaging means;
A behavior change detecting means for detecting a behavior change of the vehicle;
Behavior change determination means for determining whether or not the vehicle behavior change detected by the behavior change detection means is greater than or equal to a predetermined change amount;
Traffic information transmitting means for transmitting the traffic information extracted by the traffic information extracting means to another vehicle when the behavior change determining means determines that the vehicle behavior change is equal to or greater than a predetermined change amount;
A vehicle-to-vehicle communication system comprising: The vehicle is
Traffic information receiving means for receiving the traffic information transmitted from another vehicle;
Traffic information output means for outputting traffic information relating to the periphery of the vehicle based on the traffic information received by the traffic information receiving means;
The inter-vehicle communication system according to claim 1, comprising: The traffic information extracting means includes
An object detection means for detecting an object located in the vicinity of the vehicle based on an image picked up by the image pickup means;
Object type specifying means for specifying the type of object detected by the object detection means;
Object position detecting means for detecting the position of the object detected by the object detecting means;
With
The said traffic information is comprised from the information regarding the type of the target object specified by the said target object type specific | specification means, and the information regarding the position of the target object detected by the said target object position detection means. The inter-vehicle communication system according to claim 1 or 2.   The said traffic information output means displays the specific information which specifies the kind of said target object, and the position of a target object on the displayed map while displaying the map around a vehicle. The vehicle-to-vehicle communication system described.

Images