JP2021196626A - Image data provision device, image data provision system, image data provision method, and computer program - Google Patents

Abstract

To provide an image data provision device capable of inexpensively performing monitoring in an arbitrary direction from an arbitrary position on a road.SOLUTION: An image data provision device includes: a communication section for performing communication with vehicles; an image data acquisition section for acquiring image data to be obtained by photographing the peripheries of the vehicles with the use of cameras mounted on the vehicles and attached data indicating photographing positions and photographing directions of the cameras from the plurality of vehicles via the communication section; a storage section for storing the acquired image data and attached data; an instruction data acquisition section for acquiring instruction data to instruct a position and direction from a terminal device; and an image data provision section for identifying the attached data indicating the photographing position and photographing direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the identified attached data to the terminal device.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to an image data providing device, an image data providing system, an image data providing method, and a computer program.

In recent years, an increasing number of vehicles are equipped with a drive recorder (for example, see Non-Patent Document 1) for monitoring the inside and outside of the vehicle.

Further, in a web service such as Street View, an image based on a position and a direction specified by a user is provided to a terminal device (see, for example, Non-Patent Document 2). As a result, the user can view the image taken from an arbitrary position in an arbitrary direction by using the terminal device.

"Standalone type front and rear shooting compatible 2 camera drive recorder", [online], JVC KENWOOD Corporation, [Search on May 8, 2020], Internet <URL: https: // www. kenwood. com / jp / products / drive_recorder / drv_mr745 /> "What is Street View?", [Online], Google, [Search on May 8, 2020], Internet <URL: https: // www. Google. co. jp / intl / ja / streetview />

Even if a drive recorder, Street View, or the like is used, the user cannot monitor the situation of the area on the road from any position on the road to any direction. For example, the user cannot monitor the status of a particular road intersection.

This is because it is difficult for a vehicle equipped with a drive recorder or a vehicle equipped with a camera that captures an image for Street View to stay in a specific place. In order to monitor a specific place, it is necessary to install a surveillance camera on the road.

However, in order to monitor the entire road, a huge number of surveillance cameras must be installed, which is difficult due to cost constraints.

The present disclosure has been made in view of such circumstances, and is an image data providing device, an image data providing system, and an image data providing method capable of monitoring an arbitrary direction from an arbitrary position on a road at low cost. , And to provide computer programs.

The image data providing device according to one embodiment of the present disclosure includes a communication unit that communicates with a vehicle, image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and photographing by the camera. An image data acquisition unit that acquires ancillary data indicating a position and a shooting direction from a plurality of the vehicles via the communication unit, a storage unit that stores the acquired image data and the ancillary data, and a terminal. Specify and specify the instruction data acquisition unit that acquires instruction data for instructing the position and direction from the device, and the attached data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data. It is provided with an image data providing unit that provides the image data corresponding to the attached data to the terminal device.

The image data providing system according to another embodiment of the present disclosure includes a plurality of vehicle-mounted devices, each of which is mounted on a vehicle, an image data providing device connected to the plurality of vehicle-mounted devices via a network, and the image data. The in-vehicle device includes a providing device and a terminal device connected via a network, and the in-vehicle device includes image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, a shooting position of the camera, and a shooting position of the camera. The attached data indicating the shooting direction is transmitted to the image data providing device, the terminal device transmits instruction data for instructing the position and direction to the image data providing device, and the image data providing device is used. The storage unit for storing the image data and the accessory data received from the plurality of in-vehicle devices, and the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data received from the terminal device. It has an image data providing unit that specifies the attached data and provides the image data corresponding to the specified attached data to the terminal device.

The image data providing method according to another embodiment of the present disclosure includes image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and attached data indicating a shooting position and a shooting direction of the camera. A step of acquiring the acquired image data and the accessory data from the plurality of vehicles, a step of acquiring instruction data for instructing a position and a direction from the terminal device, and the above. It includes a step of specifying the accessory data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the specified accessory data to the terminal device.

The computer program according to another embodiment of the present disclosure includes image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and attached data indicating the shooting position and shooting direction of the camera. , A step of acquiring the acquired image data and the accessory data from the plurality of the vehicles, a step of acquiring instruction data for instructing the position and direction from the terminal device, and a step of acquiring the instruction data. The step of specifying the attached data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the specified attached data to the terminal device is executed. Let me.

According to the present disclosure, it is possible to monitor any direction from any position on the road at low cost.

FIG. 1 is a diagram showing an overall configuration of an image data providing system according to the first embodiment of the present disclosure. FIG. 2 is a block diagram showing an example of the configuration of the in-vehicle device according to the first embodiment of the present disclosure. FIG. 3 is a diagram for explaining an example of a shooting position and a shooting direction of image data by a camera mounted on a vehicle. FIG. 4 is a block diagram showing an example of the configuration of the image data providing device. FIG. 5 is a block diagram showing an example of the configuration of the terminal device. FIG. 6 is a diagram showing an example of screen display of a display device. FIG. 7 is a sequence diagram showing a processing flow of the image data providing system according to the first embodiment of the present disclosure. FIG. 8 is a diagram showing an example of a display screen of a display device. FIG. 9 is a block diagram showing an example of the configuration of the in-vehicle device according to the fourth embodiment of the present disclosure. FIG. 10 is a block diagram showing an example of the configuration of the image data providing device according to the fourth embodiment of the present disclosure. FIG. 11 is a sequence diagram showing a processing flow of the image data providing system according to the fourth embodiment of the present disclosure. FIG. 12 is a block diagram showing an example of the configuration of the in-vehicle device according to the fifth embodiment of the present disclosure. FIG. 13 is a block diagram showing an example of the configuration of the image data providing device according to the fifth embodiment of the present disclosure. FIG. 14 is a sequence diagram showing a processing flow of the image data providing system according to the fifth embodiment of the present disclosure. FIG. 15 is a block diagram showing an example of the configuration of the image data providing device according to the modified example of the present disclosure.

[Summary of Embodiments of the present disclosure]
First, an outline of the embodiments of the present disclosure will be listed and described.

(1) The image data providing device according to the embodiment of the present disclosure includes a communication unit that communicates with a vehicle, image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and the image data. An image data acquisition unit that acquires auxiliary data indicating the shooting position and shooting direction of the camera from the plurality of vehicles via the communication unit, and a storage unit that stores the acquired image data and the attached data. And, the instruction data acquisition unit which acquires the instruction data for instructing the position and the direction from the terminal apparatus, and the attached data which shows the image-taking position and the image-taking direction of the camera corresponding to the position and direction indicated by the instruction data are specified. It also includes an image data providing unit that provides the terminal device with the image data corresponding to the specified attached data.

According to this configuration, image data and attached data can be acquired and stored from a plurality of vehicles traveling on the road. Further, based on the instruction data, it is possible to provide the terminal device with image data of a place desired by a user who uses the terminal device. Here, the storage unit can sequentially store image data acquired from a plurality of vehicles. Therefore, the image data of every place on the road is stored in the storage unit. Therefore, the user can monitor the desired place by looking at the image data acquired by the terminal device. That is, it is possible to monitor any direction from any position on the road at low cost.

(2) Preferably, the attached data further indicates the shooting time of the camera, and the image data providing unit uses the image data having the latest shooting time among the image data corresponding to the specified attached data. Provided to the terminal device.

According to this configuration, the terminal device can acquire the latest image data of the place desired by the user. Therefore, the user can monitor the latest status of the desired location.

(3) Further, the attached data further indicates the shooting time of the camera, the instruction data further indicates the time, and the image data providing unit corresponds to the position, direction, and time indicated by the instruction data. The attached data indicating the shooting position, the shooting direction, and the shooting time of the camera may be specified, and the image data corresponding to the specified attached data may be provided to the terminal device.

According to this configuration, the terminal device can acquire image data at a place and time desired by the user. This allows the user to monitor the status of the desired past time at the desired location.

(4) Further, the image data includes moving image data, the instruction data further indicates the moving image data, and the image data providing unit further indicates the moving image data indicated by the instructed data. It may be provided to the terminal device.

According to this configuration, the user can see the moving image data taken by the camera mounted on a certain vehicle. As a result, the user can monitor the traveling route of the vehicle, and can utilize the moving image data for finding a falling object on the highway, for example.

(5) Further, the instruction data indicates the vehicle equipped with the camera that captured the moving image data as an instruction of the moving image data, and the image data providing unit indicates the vehicle indicated by the instruction data. The moving image data taken by the camera mounted on the terminal device may be provided to the terminal device.

According to this configuration, by designating a vehicle, the user can see the moving image data taken by the camera mounted on the designated vehicle.

(6) Further, the image data providing unit may provide the terminal device with the image data showing the predetermined installation object owned by the person who provides the monetary value in a display mode different from the others.

According to this configuration, for example, it is possible to provide the terminal device with image data shown in a display mode in which a signboard owned by a person who provides monetary value is conspicuous. Therefore, the signboard can be easily noticed by the user, and the operator of the image data providing service can obtain a monetary value from the owner of the installation as a consideration.

(7) Further, a value providing unit that provides monetary value to the user of the vehicle that has provided the image data and the attached data may be further provided.

According to this configuration, the user can be given an incentive to install the camera. This makes it possible to popularize in-vehicle cameras such as drive recorders.

(8) Further, the value providing unit may provide the monetary value to the user of the vehicle based on the evaluation of the image data from the terminal device.

According to this configuration, it is possible to provide monetary value to the user of the vehicle who has provided the image data evaluated by the user of the terminal device. Therefore, it is possible to give the user of the vehicle an incentive to provide better image data. This makes it possible to popularize, for example, a high-resolution in-vehicle camera capable of taking a better image.

(9) Further, an attention area indicating unit for instructing the vehicle of interest at the time of shooting by the camera may be further provided via the communication unit.

According to this configuration, when the image data is transmitted from the vehicle to the image data providing device, the image data having a lower resolution than the area of interest is transmitted to the area other than the area of interest, and the area other than the area of interest is noted. Image data compressed with a higher compression rate than the area can be sent. As a result, it is possible to transmit image data having the same identity as the original image data from the vehicle to the image data providing device for the region of interest while reducing the amount of communication between the vehicle and the image data providing device. ..

(10) Further, the image data providing device selects the image data and the attached data based on a predetermined criterion, and stores the selected image data and the attached data in the storage unit. You may also have more.

According to this configuration, for example, when a criterion of selecting one image data for every three images is set as a predetermined criterion, one image data for every three images acquired by the image data acquisition unit is selected. Then, the selected image data and the attached data of the image data can be stored in the storage unit. As a result, the number of image data stored in the storage unit can be reduced. If a criterion is set to select image data whose shooting time is within a predetermined time from the current time, the image data whose shooting time is old is deleted from the storage unit, and the image data whose shooting time is new is stored in the storage unit. can do. As a result, it is possible to store highly useful image data and attached data while reducing the number of image data stored in the storage unit.

(11) The image data providing system according to another embodiment of the present disclosure includes a plurality of vehicle-mounted devices, each of which is mounted on a vehicle, and an image data providing device connected to the plurality of vehicle-mounted devices via a network. The in-vehicle device includes the image data providing device and a terminal device connected via a network, and the in-vehicle device includes image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and image data of the camera. Ancillary data indicating a shooting position and a shooting direction are transmitted to the image data providing device, the terminal device transmits instruction data for instructing the position and direction to the image data providing device, and the image data is provided. The device is a storage unit that stores the image data and the accessory data received from the plurality of in-vehicle devices, and the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data received from the terminal device. It has an image data providing unit that specifies the attached data indicating the above and provides the image data corresponding to the specified attached data to the terminal device.

This configuration has the same configuration as the above-mentioned image data providing device. Therefore, according to this configuration, the same operation and effect as the above-mentioned image data providing device can be obtained.

(12) The image data providing method according to another embodiment of the present disclosure shows image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and a shooting position and a shooting direction of the camera. A step of acquiring attached data from a plurality of the vehicles, a step of writing the acquired image data and the attached data to a storage unit, and a step of acquiring instruction data for instructing a position and a direction from a terminal device. A step of specifying the accessory data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the specified accessory data to the terminal device. including.

This configuration includes steps corresponding to the configuration provided in the image data providing device described above. Therefore, according to this configuration, the same operation and effect as the above-mentioned image data providing device can be obtained.

(13) The computer program according to another embodiment of the present disclosure captures image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle, and the shooting position and shooting direction of the camera on the computer. The step of acquiring the attached data to be shown from the plurality of vehicles, the step of writing the acquired image data and the attached data to the storage unit, and the instruction data for instructing the position and direction from the terminal device are acquired. A step of specifying the accessory data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the specified accessory data to the terminal device. And execute.

According to this configuration, the computer can be made to execute the above-mentioned image data providing method. Therefore, the same operation and effect as the above-mentioned image data providing method can be obtained.

[Details of Embodiments of the present disclosure]
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. The embodiments described below are all specific examples of the present disclosure. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, the order of steps, and the like shown in the following embodiments are examples, and do not limit the present disclosure. Further, among the components in the following embodiments, the components not described in the independent claims are components that can be arbitrarily added. Further, each figure is a schematic view and is not necessarily exactly illustrated.

Further, the same components are designated by the same reference numerals. Since their functions and names are the same, their description will be omitted as appropriate.

<Embodiment 1>
[Overall configuration of image data provision system]
FIG. 1 is a diagram showing an overall configuration of an image data providing system according to the first embodiment of the present disclosure.

With reference to FIG. 1, the image data providing system 1 wirelessly communicates with a plurality of vehicles 2 traveling on a road capable of wireless communication, a terminal device 4 capable of wired communication or wireless communication, and the vehicle 2. Alternatively, it includes a plurality of base stations 7 and an image data providing device 5 that communicates with the base station 7 by wire or wirelessly via a network 6 such as the Internet.

The base station 7 includes a macrocell base station, a microcell base station, a picocell base station, and the like.

The vehicle 2 includes not only ordinary passenger cars but also public vehicles such as fixed-route buses and emergency vehicles. Further, the vehicle 2 may be a two-wheeled vehicle (motorcycle) as well as a four-wheeled vehicle.

Each vehicle 2 is provided with an in-vehicle device 3 including a camera, as will be described later. It is transmitted to the image data providing device 5 via.

The image data providing device 5 receives a set of image data and ancillary data from a plurality of vehicles 2 via the network 6 and stores the set in the storage unit of the image data providing device 5.

The terminal device 4 transmits instruction data indicating a position and direction desired to be monitored by the user of the terminal device 4 to the image data providing device 5 via the network 6.

The image data providing device 5 receives instruction data from the terminal device 4 via the network 6, identifies ancillary data corresponding to the position and direction indicated by the instruction data, and obtains image data corresponding to the specified ancillary data. It is transmitted to the terminal device 4 via the network 6.

The terminal device 4 receives the image data from the image data providing device 5 via the network 6 and displays it on the display device.

[Structure of vehicle 2]
FIG. 2 is a block diagram showing an example of the configuration of the in-vehicle device 3 according to the first embodiment of the present disclosure.

As shown in FIG. 2, the in-vehicle device 3 of the vehicle 2 includes a camera 21, a communication unit 22, a timer 23, a control unit (ECU) 24, and a GPS (Global Positioning System) receiver 28. , A gyro sensor 29 and a storage unit 31 are provided.

The camera 21 comprises an image sensor that captures an image in front of the vehicle 2. The camera 21 may be monocular or compound eye.
The communication unit 22 is composed of, for example, a wireless communication device capable of communication processing compatible with 5G (fifth generation mobile communication system). The communication unit 22 may be an existing wireless communication device in the vehicle 2 or a mobile terminal brought into the vehicle 2 by the passenger.

The passenger's mobile terminal temporarily becomes an in-vehicle wireless communication device by being connected to the in-vehicle LAN (Local Area Network) of the vehicle 2.

The timer 23 measures the current time.

The control unit 24 includes a computer device that controls each of the devices 21 to 23 and 28 to 31 of the vehicle 2. The control unit 24 obtains the vehicle position of its own vehicle by the GPS signal periodically acquired by the GPS receiver 28. The control unit 24 can complement the GPS signal or use the vehicle of its own vehicle by using the GPS complement signal or the GPS augmentation signal received by the receiver that receives the signal transmitted from the quasi-zenith satellite (not shown). The position may be corrected.

The control unit 24 complements the position and direction of the vehicle 2 based on the input signals of the vehicle speed sensor 30 and the gyro sensor 29, and grasps the accurate current position and direction of the vehicle 2. Here, the current position of the vehicle 2 is indicated by, for example, latitude and longitude. Further, the direction of the vehicle 2 is indicated by, for example, an angle in the range of 0 degrees to 360 degrees clockwise with the north as 0 degrees.

The GPS receiver 28, the gyro sensor 29, and the vehicle speed sensor 30 are sensors that measure the current position, direction, and speed of the vehicle 2.

The storage unit 31 is a volatile memory element such as SRAM (Static RAM) or DRAM (Dynamic RAM), a non-volatile memory element such as flash memory or EEPROM (Electrically Erasable Programmable Read Only Memory), or magnetic such as a hard disk. It is composed of a storage device and the like. The storage unit 31 stores a computer program executed by the control unit 24, data generated when the computer program is executed by the control unit 24, and the like.

The control unit 24 is composed of an arithmetic processing unit such as a microcomputer that executes a computer program stored in the storage unit 31. The control unit 24 includes an image data providing unit 25 as a functional processing unit realized by executing the computer program.

The image data providing unit 25 creates attached data of image data in which the current position and orientation of the vehicle 2 at the time of shooting the image in front of the vehicle 2 by the camera 21 is the imaging position and shooting direction of the camera 21. Here, it is assumed that the direction of the vehicle 2 and the shooting direction of the camera 21 are the same. However, if the orientation of the vehicle 2 and the shooting direction of the camera 21 are different, it is assumed that the angle difference between them is known in advance. In this case, the image data providing unit 25 obtains the shooting direction of the camera 21 by correcting the direction of the vehicle 2 using the above angle difference.

The image data providing unit 25 transmits the image data output by the camera 21 and the attached data of the image data to the image data providing device 5 via the communication unit 22.

It is preferable that the image data providing unit 25 includes the information on the shooting time of the camera 21 in the attached data and transmits the data.

Further, it is preferable that the image data providing unit 25 transmits the attached data including the identification information of the vehicle 2. Here, the identification information of the vehicle 2 may be, for example, the vehicle identification number of the vehicle 2 or the vehicle registration number. Further, the ID unique to the vehicle 2 or the ID unique to the user of the vehicle 2 may be used.

FIG. 3 is a diagram for explaining an example of a shooting position and a shooting direction of image data by the camera 21 mounted on the vehicle 2.

As shown in FIG. 3, it is assumed that the three vehicles 2 of the vehicle A, the vehicle B, and the vehicle C are traveling toward the intersection IS. The camera 21 mounted on the vehicle A captures an image in front of the vehicle A at the point α with the traveling direction 70A of the vehicle A as the shooting direction. The camera 21 mounted on the vehicle B captures an image in front of the vehicle B at the point β with the traveling direction 70B of the vehicle B as the shooting direction. The camera 21 mounted on the vehicle C captures an image in front of the vehicle C at the point γ with the traveling direction 70C of the vehicle C as the shooting direction.

Therefore, the attached data of the image data provided by the image data providing unit 25 of the vehicle A indicates the point α and the direction 70A. Further, the attached data of the image data provided by the image data providing unit 25 of the vehicle B indicates the point β and the direction 70B. Further, the attached data of the image data provided by the image data providing unit 25 of the vehicle C indicates the point γ and the direction 70C.

Each vehicle 2 periodically takes a picture with a camera 21 mounted on the vehicle while traveling. Therefore, image data of the same shooting position and shooting direction are sequentially transmitted from the plurality of vehicles 2 to the image data providing device 5. For example, every time the vehicle A, the vehicle B, and the vehicle C pass the point α, the image data with the point α as the shooting position and the direction 70A as the shooting direction is provided from the vehicle A, the vehicle B, and the vehicle C, respectively. It is transmitted to the device 5. Here, the traveling direction when the vehicle B and the vehicle C pass the point α is the direction 70A.

[Configuration of image data providing device 5]
FIG. 4 is a block diagram showing an example of the configuration of the image data providing device 5.

As shown in FIG. 4, the image data providing device 5 includes a control unit 50 including a CPU (Central Processing Unit), a storage unit 59, and a communication unit 60.

The control unit 50 controls the operation of each hardware by executing one or a plurality of computer programs stored in advance in the storage unit 59. That is, the control unit 50 includes an image data acquisition unit 52, an instruction data acquisition unit 53, and an image data provision unit 54 as functional processing units realized by executing a computer program.

The storage unit 59 is composed of a volatile memory element such as SRAM or DRAM, a non-volatile memory element such as flash memory or EEPROM, or a magnetic storage device such as a hard disk. The storage unit 59 stores a computer program executed by the control unit 50 and data necessary for its execution.

The communication unit 60 includes a communication device that executes communication processing with the network 6, and communicates with an external device via the network. That is, the communication unit 60 transmits the information given from the control unit 50 to the external device via the network 6, and gives the information received via the network 6 to the control unit 50.

The image data acquisition unit 52 receives the image data in front of the vehicle 2 taken by the camera 21 mounted on the vehicle 2 and the attached data attached to the image data from the vehicle 2 via the communication unit 60. .. The attached data indicates the shooting position and shooting direction of the camera 21. Further, the attached data may further indicate the shooting time of the camera 21 and the identification information of the vehicle 2. If the attached data does not include the shooting time of the camera 21, the image data acquisition unit 52 may consider the reception time of the image data and the attached data as the shooting time of the camera 21.

The image data acquisition unit 52 writes the received image data and attached data to the storage unit 59.

The instruction data acquisition unit 53 receives instruction data indicating a position and direction that the user of the terminal device 4 desires to monitor from the terminal device 4 via the communication unit 60. The instruction data acquisition unit 53 outputs the received instruction data to the image data providing unit 54. The position indicated by the indicated data is indicated by, for example, latitude and longitude, and the direction indicated by the indicated data is indicated by, for example, an angle in the range of 0 degrees to 360 degrees clockwise with 0 degrees as north.

The image data providing unit 54 receives instruction data from the instruction data acquisition unit 53, and reads out image data similar to the position and direction indicated by the instruction data from the storage unit 59. Specifically, for example, the image data providing unit 54 reads out the attached data within a predetermined distance from the position indicated by the instruction data from the storage unit 59. The image data providing unit 54 specifies the attached data in which the absolute value of the angle difference between the direction indicated by the attached data and the direction indicated by the instruction data is equal to or less than a predetermined angle among the read attached data. The image data providing unit 54 selects the attached data having the latest shooting time of the camera 21 from the specified attached data. The image data providing unit 54 reads out the image data associated with the selected attached data from the storage unit 59, and transmits the read image data to the terminal device 4 which is the source of the instruction data via the communication unit 60. do.

With reference to FIG. 3, for example, it is assumed that the instruction data indicates the shooting position 81 and the shooting direction 82. The image data providing unit 54 is the latest image data among the image data shot from a position within a predetermined distance from the shooting position 81 and in a direction in which the absolute value of the angle difference from the shooting direction 82 is equal to or less than the predetermined angle. As the image data, the image data taken by the vehicle A in the direction 70A at the point α is transmitted to the terminal device 4. Each time the vehicle B and the vehicle C pass near the point α, the image data transmitted by the image data providing unit 54 to the terminal device 4 is updated. That is, the image data providing unit 54 transmits the image data taken by the vehicle B toward the front (direction in which the angle difference from the shooting direction 82 is equal to or less than a predetermined angle) in the vicinity of the point α to the terminal device 4. Next, the image data providing unit 54 transmits the image data taken by the vehicle C toward the front (direction in which the angle difference from the shooting direction 82 is equal to or less than a predetermined angle) in the vicinity of the point α to the terminal device 4.

The image data providing unit 54 performs a process of converting the image data read from the storage unit 59 into image data viewed from the position and direction indicated by the instruction data, and then transmits the image data to the terminal device 4. You may.

Further, the image data providing unit 54 performs conversion processing so that the range (angle of view) of the image included in the image data becomes substantially uniform among the image data to be transmitted, and then converts the image data into the terminal device 4. May be sent to.

Further, the image data providing unit 54 may transmit the attached data together with the image data. As a result, the terminal device 4 can perform a process of converting the image data received from the image data providing device 5 into image data viewed from the position and direction indicated by the instruction data.

[Configuration of terminal device 4]
FIG. 5 is a block diagram showing an example of the configuration of the terminal device 4.

As shown in FIG. 5, the terminal device 4 includes a control unit 40 including a CPU and the like, an input / output interface 46, a storage unit 47, and a communication unit 48.

The control unit 40 controls the operation of each hardware by executing one or a plurality of computer programs stored in advance in the storage unit 47. That is, the control unit 40 includes an instruction data providing unit 41, a display control unit 42, and an image data acquisition unit 43 as functional processing units realized by executing a computer program.

The input / output interface 46 connects the terminal device 4 to an input / output device such as a display device or a keyboard. For example, the input / output interface 46 is configured to include a connection terminal.

The storage unit 47 is composed of a volatile memory element such as SRAM or DRAM, a non-volatile memory element such as flash memory or EEPROM, or a magnetic storage device such as a hard disk. The storage unit 47 stores a computer program executed by the control unit 40, data necessary for executing the computer program, map data, and the like.

The communication unit 48 includes a communication device that executes communication processing with the network 6, and communicates with an external device via the network. That is, the communication unit 48 transmits the information given from the control unit 40 to the external device via the network 6, and gives the information received via the network 6 to the control unit 40.

The display control unit 42 outputs the map indicated by the map data stored in the storage unit 47 to the display device via the input / output interface 46, so that the display device displays the map. For example, the display control unit 42 receives the position data indicating the position on the map input by the user using a keyboard or the like via the input / output interface 46. The display control unit 42 displays a map including the position indicated by the position data on the display device.

FIG. 6 is a diagram showing an example of screen display of a display device.

For example, the display control unit 42 displays a map centered on the intersection IS entered by the user as the display position on the right side of the display screen of the display device. When the user changes the display position, the display control unit 42 displays the updated map.

The input / output interface 46 receives the instruction data input by the user of the terminal device 4 using a keyboard or the like, and transmits the received instruction data to the instruction data providing unit 41.

With reference to FIG. 6, for example, the user operates a mouse or the like to specify a shooting position 81 and a shooting direction 82 on a map displayed on the screen of the display device. Instruction data including information on the shooting position 81 and the shooting direction 82 designated by the user is transmitted to the instruction data providing unit 41.

The instruction data providing unit 41 receives instruction data from the input / output interface 46. The instruction data providing unit 41 transmits the instruction data received from the input / output interface 46 to the image data providing device 5 via the communication unit 48.

The image data acquisition unit 43 receives the image data corresponding to the instruction data from the image data providing device 5 via the terminal device 4. The image data acquisition unit 43 outputs the received image data to the display control unit 42.

The display control unit 42 receives image data from the image data acquisition unit 43, outputs the image data to the display device via the input / output interface 46, and displays the image data on the screen of the display device.

With reference to FIG. 6, for example, the display control unit 42 displays image data on the left side of the display screen of the display device. This image data is, for example, the latest image data at the shooting time among the image data obtained by shooting in the direction of the shooting direction 82 from the shooting position 81. In the example of FIG. 3, the image data taken by the vehicle A at the point α is displayed, and when the vehicle B reaches the vicinity of the point α, the display is switched to the image data taken by the vehicle B in the vicinity of the point α. .. Further, when the vehicle C reaches the vicinity of the point α, the display is switched to the image data taken by the vehicle C in the vicinity of the point α.

[Process flow of image data providing system 1]
FIG. 7 is a sequence diagram showing a processing flow of the image data providing system 1 according to the first embodiment of the present disclosure.

FIG. 7 shows the processing executed by the two vehicles A and B as the vehicle 2 due to space limitations. However, the number of vehicles 2 is not limited to two, and many vehicles 2 actually perform the same processing.

The vehicle A captures an image in front of the vehicle A by the camera 21 and generates image data (S1).

The vehicle A detects the position and direction of the vehicle A as the shooting position and shooting direction of the image data by the camera 21 (S2).

The vehicle A detects the shooting time of the image data by the camera 21 (S3). The shooting time is detected by, for example, a timer 23 or a clock mounted on the vehicle A.

The vehicle A generates ancillary data of the image data generated in step S1, transmits the image data and the ancillary data to the image data providing device 5, and the image data providing device 5 receives the image data and the attached data from the vehicle A. Receive (S4). The attached data includes information on the shooting position and shooting direction detected in step S2, and information on the shooting time detected in step S3.

The image data providing device 5 writes the image data and the attached data received in step S4 to the storage unit 59 (S5).

The vehicle B captures an image in front of the vehicle B by the camera 21 and generates image data (S6).

The vehicle B detects the position and direction of the vehicle B as the shooting position and shooting direction of the image data by the camera 21 (S7).

The vehicle B detects the shooting time of the image data by the camera 21 (S8). The shooting time is detected by, for example, a clock 23 mounted on the vehicle B or a time measuring unit such as a timer.

The vehicle B generates ancillary data of the image data generated in step S6, transmits the image data and the ancillary data to the image data providing device 5, and the image data providing device 5 receives the image data and the attached data from the vehicle B. Receive (S9). The attached data includes information on the shooting position and shooting direction detected in step S7, and information on the shooting time detected in step S8.

The image data providing device 5 writes the image data and the attached data received in step S9 to the storage unit 59 (S10).

The terminal device 4 causes the display device to display the map indicated by the map data stored in the storage unit 47 (S12). As a result, for example, as shown in FIG. 6, a map is displayed on the right side of the display screen of the display device.

The terminal device 4 receives the instruction data input by the user (S13). As described above, for example, the terminal device 4 receives instruction data indicating the shooting position 81 and the shooting direction 82 shown in FIG.

The terminal device 4 transmits instruction data to the image data providing device 5, and the image data providing device 5 receives instruction data from the terminal device 4.

The image data providing device 5 searches for image data based on the instruction data (S15). For example, with reference to FIG. 6, the image data providing device 5 searches for image data having the latest shooting time among the image data similar to the shooting position 81 and the shooting direction 82 indicated by the instruction data.

The image data providing device 5 transmits the searched image data to the terminal device 4, and the terminal device 4 receives the image data from the image data providing device 5 (S16).

The image data providing device 5 causes the display device to display the received image data (S17). As a result, for example, as shown in FIG. 6, image data is displayed on the left side of the display screen of the display device.

[Effects of Embodiment 1]
As described above, according to the first embodiment of the present disclosure, the image data providing device 5 can acquire and store image data and attached data from a plurality of vehicles 2 traveling on the road. Further, the image data providing device 5 can provide the terminal device 4 with image data of a place desired by a user who uses the terminal device 4 based on the instruction data. Here, the storage unit 59 can sequentially store image data acquired from the plurality of vehicles 2. Therefore, the image data of every place on the road is stored in the storage unit 59. Therefore, the user can monitor the desired location by looking at the image data acquired by the terminal device 4. That is, it is possible to monitor any direction from any position on the road at low cost.

Further, the image data providing device 5 provides the terminal device 4 with the latest image data among the image data similar to the instruction data. As a result, the terminal device 4 can acquire the latest image data of the place desired by the user. Therefore, the user can monitor the latest status of the desired location. For example, the user can monitor the situation of an intersection where accidents occur frequently and the situation of a point where rockfalls and the like occur frequently. The user can also check the store status such as whether the stores along the road are open and whether the stores are lined up.

<Embodiment 2>
In the first embodiment, the image data providing device 5 provides the terminal device 4 with the latest image data among the image data similar to the instruction data.

In the second embodiment, an example in which the instruction data includes information for designating the shooting time will be described.

The user who uses the terminal device 4 operates a keyboard or the like to input the time desired by the user in addition to the position and direction as instruction data. The time is a time for designating the shooting time of the image data by the camera 21 of the vehicle 2, for example, the user "May 17, 2020 10:00 to May 17, 2020 10:05". Enter the time such as. The user may enter a time (for example, "May 18, 2020, 10:35 minutes") as a desired time.

The image data providing unit 54 of the image data providing device 5 that has received the instruction data sets the shooting time indicated by the attached data of the image data to the time indicated by the instruction data among the image data similar to the position and direction indicated by the instruction data. The included image data is read from the storage unit 59. The image data providing unit 54 transmits the read image data to the terminal device 4, and the terminal device 4 receives the image data transmitted from the image data providing unit 54 and displays it on the display device.

If the image data providing device 5 has a plurality of image data read from the storage unit 59, the image data providing device 5 may transmit all the image data to the terminal device 4, and any image data (for example, any of them) may be transmitted. Image data with the latest shooting time) may be transmitted to the terminal device 4. Further, it is preferable that the image data providing device 5 transmits information on the shooting time together with the image data.

When the terminal device 4 receives a plurality of image data, the terminal device 4 may display the plurality of image data in order (for example, in order from the oldest shooting time) on the display device, or may display arbitrary image data (for example, in order from the oldest one). The image data with the latest shooting time) may be displayed on the display device.

As described above, according to the second embodiment of the present disclosure, the terminal device 4 can acquire image data at a place and time desired by the user. This allows the user to monitor the status of the desired past time at the desired location.

<Embodiment 3>
In the second embodiment, the user instructs the position, the direction, and the time. In the third embodiment, an example in which the user instructs the moving image data will be described.

In the third embodiment, it is assumed that the identification information of the vehicle 2 is included in the attached data of the image data. Further, it is assumed that the image data is moving image data.

In the third embodiment, the terminal device 4 transmits the position data indicating the position (latitude and longitude) on the map input by the user to the image data providing device 5, and the image data providing device 5 receives the position data from the terminal device 4. To receive. Further, the terminal device 4 transmits the instruction data to the image data providing device 5, and the image data providing device 5 receives the instruction data. The image data providing device 5 transmits the vehicle position data indicating the position of the vehicle 2 traveling in the vicinity of the position indicated by the position data and the identification information of the vehicle 2 to the terminal device 4 at the time indicated by the instruction data. The terminal device 4 receives vehicle position data and identification information from the terminal device 4. The terminal device 4 superimposes the icon of the vehicle 2 on the position indicated by the vehicle position data on the map including the position indicated by the position data input by the user, and displays the icon on the display device.

FIG. 8 is a diagram showing an example of a display screen of a display device.

On the right side of the display device, a map on which the icon 83 of the vehicle 2 is superimposed is displayed.

The user selects the icon 83A from the plurality of icons 83 by using a mouse or the like. As a result, the user can select the vehicle corresponding to the icon 83A. The input / output interface 46 receives the identification information of the icon 83A selected by the user (for example, the position information of the icon 83A). The instruction data providing unit 41 identifies the vehicle 2 corresponding to the identification information of the icon 83A, and provides the data for instructing the specified vehicle 2 (that is, the identification information of the vehicle 2) as the instruction data in the image data providing device 5. Send to. By instructing the vehicle 2, the image data taken by the vehicle 2 can be instructed.

The image data providing unit 54 of the image data providing device 5 reads out the image data corresponding to the attached data including the identification information of the vehicle 2 indicated by the instruction data from the storage unit 59. Here, the image data to be read may be image data taken after the time indicated by the instruction data. The image data providing unit 54 transmits the read image data to the terminal device 4.

The terminal device 4 receives the image data from the image data providing unit 54 and causes the display device to display the received image data. For example, the map data acquisition unit 42 of the terminal device 4 displays the image data on the left side of the display screen of the display device as shown in FIG. The image data is moving image data. Therefore, a moving image taken by the vehicle 2 corresponding to the icon 83A is displayed. As a result, the user can confirm the image around the road on which the vehicle 2 corresponding to the icon 83A has traveled.

According to the third embodiment, by designating the vehicle 2, the user can see the moving image data taken by the camera 21 mounted on the designated vehicle 2. As a result, the user can monitor the traveling route of the vehicle 2, and can utilize the moving image data for finding a falling object on the highway, for example.

<Embodiment 4>
In the fourth embodiment of the present disclosure, an example in which the image data providing device 5 provides point information having a monetary value to the terminal device 4 that has provided the image will be described.

FIG. 9 is a block diagram showing an example of the configuration of the in-vehicle device 3 according to the fourth embodiment of the present disclosure.

The configuration of the vehicle-mounted device 3 according to the fourth embodiment is the same as the configuration of the vehicle-mounted device 3 according to the first embodiment shown in FIG. However, the configuration of the control unit 24 is partially different.

The control unit 24 further includes a value acquisition unit 27 as a functional processing unit realized by executing a computer program stored in the storage unit 31.

The value acquisition unit 27 receives point information indicating points having monetary value from the image data providing device 5 via the communication unit 22. The value acquisition unit 27 can store the received point information in the storage unit 31 or transmit it to another device. These points are paid by the image data providing device 5 as a consideration for the provision of the image data by the image data providing unit 25, and the amount of points indicates the amount of monetary value.

FIG. 10 is a block diagram showing an example of the configuration of the image data providing device 5 according to the fourth embodiment of the present disclosure.

The configuration of the image data providing device 5 according to the fourth embodiment is the same as the configuration of the image data providing device 5 according to the first embodiment shown in FIG. However, the configuration of the control unit 50 is partially different.

The control unit 50 further includes a value providing unit 55 as a functional processing unit realized by executing a computer program stored in the storage unit 59.

The value providing unit 55 provides points to the user of the vehicle 2 who has provided the image data and the attached data.

The points to be provided may be a uniform amount between the vehicles 2. Further, a light weight may be attached between the vehicles 2. For example, a user of vehicle 2 having a larger number or size of provided image data may provide more points.

Further, the value providing unit 55 receives evaluation data indicating the evaluation of the image data from the terminal device 4 via the communication unit 60, and the user of the vehicle 2 who provided the highly evaluated image data receives more points. May be provided.

The image data providing device 5 may manage the point information by its own device or another device instead of transmitting the point information to the vehicle 2.

FIG. 11 is a sequence diagram showing a processing flow of the image data providing system 1 according to the fourth embodiment of the present disclosure.

The processing of steps S1 to S15 is the same as that of the first embodiment. Therefore, the detailed explanation is not repeated here.

The image data providing unit 54 of the image data providing device 5 processes the searched image data (S21). The processing here is, for example, a processing shown in a display mode for distinguishing a predetermined installation object such as a signboard on a road from others, and for example, in order to make the predetermined installation object stand out, the processing is performed on the image data. It is a process of superimposing a frame of a predetermined color around the installation object. However, the processing method is not limited to this, and any display mode capable of highlighting a predetermined installation object may be used.

Here, the image data providing unit 54 identifies the predetermined installation object in the image data based on the position information of the predetermined installation object and the information on the shooting position and the shooting direction of the image data by the camera 21. Further, the image data providing unit 54 may specify the predetermined installation object by image recognition when the predetermined installation object includes characters, marks, and the like.

The business operator who owns the predetermined installation pays the monetary value such as money to the service operator using the image data providing device 5 in consideration of having the image data be processed to make the predetermined installation stand out. .. The monetary value can be used as a source of points provided to each vehicle 2.

The image data providing unit 54 of the image data providing device 5 transmits the processed image data to the terminal device 4, and the terminal device 4 receives the image data from the image data providing device 5 (S22).

The image data providing device 5 causes the display device to display the received image data (S23).

The user of the terminal device 4 who sees the image data can give an evaluation to the image data. For example, a user who has a favorable impression on the image data inputs an evaluation of the favorable impression using a keyboard or the like, and the input / output interface 46 receives evaluation data indicating the evaluation (S24).

The control unit 40 of the terminal device 4 transmits the received evaluation data to the image data providing device 5, and the value providing unit 55 of the image data providing device 5 receives the evaluation data via the communication unit 60 (S25).

The value providing unit 55 of the image data providing device 5 calculates the monetary value provided to each vehicle 2 based on the received evaluation data (S26). For example, the value providing unit 55 aggregates the number of high evaluations for the captured image data for each vehicle 2, and the monetary value of each vehicle 2 is higher so that the vehicle 2 having a larger number of high evaluations has a higher monetary value. Calculate the value.

The value providing unit 55 transmits point information indicating points corresponding to the calculated monetary value to the vehicle A, and the vehicle A receives the point information (S27). Further, the value providing unit 55 transmits point information indicating points corresponding to the calculated monetary value to the vehicle B, and the vehicle B receives the point information (S28).

As described above, according to the fourth embodiment of the present disclosure, for example, it is possible to provide the terminal device 4 with image data shown in a display mode in which a signboard owned by a business operator is conspicuous. Therefore, the signboard can be easily noticed by the user, and the operator of the image data providing service can obtain monetary value from the business operator as a consideration.

In addition, the vehicle 2 that provided the image data can receive points. Therefore, it is possible to give the user an incentive to install the camera 21. This makes it possible to popularize in-vehicle cameras such as drive recorders.

In addition, points can be provided to the user of the vehicle 2 who has provided the image data evaluated by the user of the terminal device 4. Therefore, it is possible to give the user of the vehicle 2 an incentive to provide better image data. This makes it possible to popularize, for example, a high-resolution in-vehicle camera capable of taking a better image.

<Embodiment 5>
In the fifth embodiment of the present disclosure, an example in which the image data providing device 5 indicates an area of interest at the time of shooting by the camera 21 will be described. For example, when an accident or the like occurs, it may be desired to confirm the accident site in detail. In such a case, the accident site is designated as the area of interest.

FIG. 12 is a block diagram showing an example of the configuration of the in-vehicle device 3 according to the fifth embodiment of the present disclosure.

The configuration of the vehicle-mounted device 3 according to the fifth embodiment is the same as the configuration of the vehicle-mounted device 3 according to the first embodiment shown in FIG. However, the configuration of the control unit 24 is partially different.

The control unit 24 further includes a region of interest acquisition unit 26 as a functional processing unit realized by executing a computer program stored in the storage unit 31.

The attention area acquisition unit 26 receives the attention area information indicating the position of the attention area from the image data providing device 5 via the communication unit 22.

The image data providing unit 25 identifies the region of interest in the image data captured by the camera 21 based on the position of the region of interest indicated by the region of interest information and the position and direction of the vehicle 2. The image data providing unit 25 compresses the image data so that the region other than the region of interest has a higher compression rate than the region of interest. The region of interest is compressed at a lower compression rate than the region other than the region of interest, or the compression process itself is not performed. The image data providing unit 25 transmits the compressed image data to the image data providing device 5.

FIG. 13 is a block diagram showing an example of the configuration of the image data providing device 5 according to the fifth embodiment of the present disclosure.

The configuration of the image data providing device 5 according to the fifth embodiment is the same as the configuration of the image data providing device 5 according to the first embodiment shown in FIG. However, the configuration of the control unit 50 is partially different.

The control unit 50 further includes an attention area indicating unit 56 as a functional processing unit realized by executing a computer program stored in the storage unit 59.

The attention area instruction unit 56 indicates the attention area to the vehicle 2 by transmitting the attention area information indicating the position of the attention area to the vehicle 2 via the communication unit 60. The area of interest may be designated by the user who uses the image data providing device 5. Further, the user who uses the terminal device 4 may specify the position of the attention area, and the attention area indicating unit 56 may receive the attention area information from the terminal device 4.

FIG. 14 is a sequence diagram showing a processing flow of the image data providing system 1 according to the fifth embodiment of the present disclosure.

The image data providing device 5 transmits the attention area information to the vehicle A, and the vehicle A receives the attention area information (S31). Further, the image data providing device 5 transmits the attention area information to the vehicle B, and the vehicle B receives the attention area information (S32).

The processing of steps S1 to S3 is the same as that of the first embodiment.

The image data providing unit 25 of the vehicle A performs a compression process on the image data captured in step S1 (S33). At this time, compression is not performed on the region of interest, but compression is performed on the region other than the region of interest.

The image data providing unit 25 of the vehicle A transmits the compressed image data and the attached data to the image data providing device 5, and the image data providing device 5 receives these data (S34).

After that, the same processing of steps S5 to S8 as in the first embodiment is executed.

The image data providing unit 25 of the vehicle B performs a compression process on the image data captured in step S6 (S35). At this time, compression is not performed on the region of interest, but compression is performed on the region other than the region of interest.

The image data providing unit 25 of the vehicle B transmits the compressed image data and the attached data to the image data providing device 5, and the image data providing device 5 receives these data (S36).

After that, the same processing of steps S10 to S17 as in the first embodiment is executed.

Since the image data is compressed, it is decoded at either the time of writing to the storage unit 59 of the image data providing device 5 (steps S5 and S10) or the time of displaying the image data (step S17). To.

As described above, according to the fifth embodiment of the present disclosure, when the image data is transmitted from the vehicle 2 to the image data providing device 5, the image data having a lower resolution than that of the region of interest is obtained in the region other than the region of interest. It is possible to send image data compressed at a higher compression rate than the area of interest for areas other than the area of interest. As a result, while reducing the amount of communication between the vehicle 2 and the image data providing device 5, the image data having the same identity as the original image data is transmitted from the vehicle 2 to the image data providing device 5 for the region of interest. can do.

<Modification example>
In the above-described embodiment, the image data and the attached data acquired by the image data acquisition unit 52 are stored in the storage unit 59, but the data to be stored in the storage unit 59 can be selected or stored in the storage unit 59. You may delete the data.

FIG. 15 is a block diagram showing an example of the configuration of the image data providing device 5 according to the modified example of the present disclosure.

The configuration of the image data providing device 5 according to this modification is the same as the configuration of the image data providing device 5 according to the first embodiment shown in FIG. However, the configuration of the control unit 50 is partially different.

The control unit 50 further includes an image data selection unit 61 as a functional processing unit realized by executing a computer program stored in the storage unit 59.

The image data selection unit 61 selects the image data and the attached data acquired by the image data acquisition unit 52 based on a predetermined standard, and stores the selected image data and the attached data in the storage unit 59.

For example, when the predetermined criterion is "selecting one image data in three images", the image data selection unit 61 has one image in three images taken at the same point. Select the image data of, and store the selected image data and the attached data of the image data. Further, the image data selection unit 61 discards the unselected image data and the attached data of the image data. Here, the same point may include not only a completely identical point but also a point within a predetermined range from the point.

Further, when the predetermined criterion is "selecting image data whose shooting time is within a predetermined time from the current time", the image data selection unit 61 has the image data stored in the storage unit 59 and attached. Of the data, the image data whose shooting time is within a predetermined time from the current time and the attached data of the image data are left, and the process of deleting the other image data and the attached data is periodically executed.

Further, when the predetermined criterion is "selecting the image data in which the predetermined object is reflected", the image data selection unit 61 shows the image data in which the predetermined object is reflected and the image data. The attached data of the above is stored in the storage unit 59. The image data selection unit 61 may add a predetermined flag to the attached data of the image data in which the predetermined object is shown to distinguish it from the others. Further, the image data selection unit 61 may delete the image data in which a predetermined object does not appear and the attached data of the image data from the storage unit 59.

Here, the predetermined object is, for example, a person. The image data selection unit 61 selects image data showing a person by recognizing a person's image pattern or a person's gait based on the image data. Such a person recognition process can be performed, for example, by using a neural network in which model parameters are learned by machine learning such as deep learning using image data in which a person is shown in advance as teacher data. That is, the image data selection unit 61 obtains a determination result of whether or not a person is reflected in the image data by inputting the image data into the neural network. The discriminator used for such recognition processing is not limited to the neural network, and other discriminators such as a support vector machine can also be used.

Further, when the predetermined criterion is to select the image data in which the predetermined event is reflected, the image data selection unit 61 stores the image data in which the predetermined event is reflected and the attached data of the image data. Store in part 59. The image data selection unit 61 may add a predetermined flag to the attached data of the image data in which a predetermined event is reflected to distinguish it from others. Further, the image data selection unit 61 may delete the image data in which a predetermined event is not shown and the attached data of the image data from the storage unit 59.

Here, the predetermined event is, for example, an accident, a rock fall, a sudden change in the weather, a special situation different from the normal state, or the like. The image data selection unit 61 selects the image data in which the predetermined event is reflected by recognizing the video pattern of the predetermined event based on the image data. Such a predetermined event recognition process can be performed, for example, by using a neural network in which model parameters are learned by machine learning such as deep learning using image data in which a predetermined event is reflected in advance as teacher data. That is, the image data selection unit 61 obtains a determination result of whether or not a predetermined event is reflected in the image data by inputting the image data into the neural network. The discriminator used for such recognition processing is not limited to the neural network, and other discriminators such as a support vector machine can also be used.

According to this modification, the image data stored in the storage unit 59 can be thinned out. As a result, it is possible to prevent similar image data from being stored in the storage unit 59 and reduce the number of stored image data.

Further, it is possible to store new image data and attached data at a shooting time with high utility value while reducing the number of image data stored in the storage unit 59.

Further, when the image data showing a person is stored in the storage unit 59, only the image data showing the person can be selected, so that it is possible to efficiently search for the missing person or the criminal. can.

Further, when the image data showing a predetermined event is stored in the storage unit 59, the predetermined event can be quickly specified. Therefore, it is possible to quickly convey information such as an accident or falling rock to the driver as traffic information.

[Additional Notes]
A part or all of the components constituting each of the above devices may be composed of one or a plurality of semiconductor devices such as system LSIs. A system LSI is a super-multifunctional LSI manufactured by integrating a plurality of components on one chip, and specifically, is a computer system including a microprocessor, ROM, RAM, and the like. .. A computer program is stored in the RAM. The system LSI achieves its function by operating the microprocessor according to the computer program.

Further, the above-mentioned computer program may be recorded and distributed on a computer-readable non-temporary recording medium such as an HDD, a CD-ROM, or a semiconductor memory. Further, the computer program may be transmitted and distributed via a telecommunication line, a wireless or wired communication line, a network typified by the Internet, data broadcasting, or the like.

Further, the image data providing device 5 may be realized by a plurality of processors or a plurality of computers.

Further, some or all the functions of the image data providing device 5 may be provided by cloud computing. That is, a part or all of the functions of the image data providing device 5 may be realized by the cloud server.

Further, at least a part of the above-described embodiment and the above-mentioned modification may be arbitrarily combined.

The embodiments disclosed this time should be considered to be exemplary and not restrictive in all respects. The scope of the present disclosure is expressed by the scope of claims, not the above-mentioned meaning, and is intended to include all modifications within the meaning and scope equivalent to the scope of claims.

1 Image data providing system 2 Vehicle 3 In-vehicle device 4 Terminal device 5 Image data providing device 6 Network 7 Base station 21 Camera 22 Communication unit 23 Timer 24 Control unit 25 Image data providing unit 26 Focus area acquisition unit 27 Value acquisition unit 28 GPS reception Machine 29 Gyro sensor 30 Vehicle speed sensor 31 Storage unit 40 Control unit 41 Instruction data provision unit 42 Display control unit 43 Image data acquisition unit 46 Input / output interface 47 Storage unit 48 Communication unit 50 Control unit 51 Map data provision unit 52 Image data acquisition unit 53 Instruction data acquisition unit 54 Image data provision unit 55 Value provision unit 56 Focus area indication unit 59 Storage unit 60 Communication unit 61 Image data selection unit 70A Direction 70B Direction 70C Direction 81 Shooting position 82 Shooting direction 83 Icon 83A Icon

Claims (13)

With the communication unit that communicates with the vehicle,
Image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle and attached data indicating the shooting position and shooting direction of the camera are obtained from a plurality of the vehicles via the communication unit. Image data acquisition unit to be acquired
A storage unit that stores the acquired image data and attached data, and
An instruction data acquisition unit that acquires instruction data for instructing the position and direction from the terminal device,
An image data providing unit that specifies the attached data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and provides the image data corresponding to the specified attached data to the terminal device. An image data providing device equipped with. The attached data further indicates the shooting time of the camera.
The image data providing device according to claim 1, wherein the image data providing unit provides the terminal device with the image data having the latest shooting time among the image data corresponding to the specified attached data. The attached data further indicates the shooting time of the camera.
The instruction data further indicates the time and
The image data providing unit identifies the accessory data indicating the shooting position, shooting direction, and shooting time of the camera corresponding to the position, direction, and time indicated by the instruction data, and the image corresponding to the specified accessory data. The image data providing device according to claim 1, which provides data to the terminal device. The image data includes moving image data, and includes moving image data.
The instruction data further indicates the moving image data, and the instruction data further indicates.
The image data providing device according to any one of claims 1 to 3, wherein the image data providing unit further provides the moving image data indicated by the instruction data to the terminal device. The instruction data indicates the vehicle equipped with the camera that captured the moving image data as an instruction of the moving image data.
The image data providing device according to claim 4, wherein the image data providing unit provides the terminal device with the moving image data taken by the camera mounted on the vehicle indicated by the instruction data. The image data providing unit according to claim 1 to 5, wherein the image data providing unit provides the terminal device with the image data showing a predetermined installation object owned by a person who provides monetary value in a display mode different from the others. The image data providing device according to any one of the following items. The image data according to any one of claims 1 to 6, further comprising a value providing unit that provides monetary value to the user of the vehicle that has provided the image data and the attached data. Providing equipment. The image data providing device according to claim 7, wherein the value providing unit provides the monetary value to the user of the vehicle based on the evaluation of the image data from the terminal device. The image according to any one of claims 1 to 8, further comprising an attention area instruction unit that indicates the attention area at the time of shooting with the camera to the vehicle via the communication unit. Data provider. Any of claims 1 to 9, further comprising an image data selection unit that selects the image data and the accessory data based on a predetermined criterion and stores the selected image data and the accessory data in the storage unit. The image data providing device according to item 1. Multiple in-vehicle devices, each mounted on a vehicle,
An image data providing device connected to the plurality of in-vehicle devices via a network, and
The image data providing device and a terminal device connected via a network are provided.
The in-vehicle device transmits image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle and attached data indicating a shooting position and a shooting direction of the camera to the image data providing device. death,
The terminal device transmits instruction data for instructing a position and a direction to the image data providing device.
The image data providing device is
A storage unit that stores the image data and the accessory data received from the plurality of in-vehicle devices, and a storage unit.
The attached data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data received from the terminal device is specified, and the image data corresponding to the specified attached data is transferred to the terminal device. An image data providing system having an image data providing unit to be provided. A step of acquiring image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle and attached data indicating the shooting position and shooting direction of the camera from a plurality of the vehicles.
A step of writing the acquired image data and the attached data to the storage unit, and
The step of acquiring instruction data for instructing the position and direction from the terminal device, and
The step includes specifying the accessory data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the specified accessory data to the terminal device. Image data provision method. On the computer
A step of acquiring image data obtained by photographing the surroundings of the vehicle with a camera mounted on the vehicle and attached data indicating the shooting position and shooting direction of the camera from a plurality of the vehicles.
A step of writing the acquired image data and the attached data to the storage unit, and
The step of acquiring instruction data for instructing the position and direction from the terminal device, and
The step of specifying the attached data indicating the shooting position and shooting direction of the camera corresponding to the position and direction indicated by the instruction data, and providing the image data corresponding to the specified attached data to the terminal device is executed. A computer program to let you.

Images