JP7190088B2 - Parking lot monitoring device, parking lot management system and parking lot management program - Google Patents

Description

The present invention relates to a parking lot monitoring device, a parking lot management system, and a parking lot management program.

Conventionally, there has been proposed a technique of monitoring a parking lot with a surveillance camera (for example, Patent Literature 1).

Japanese Patent No. 4540490

Especially in urban areas, there are many small parking lots, and many people are required to check the images acquired by the surveillance cameras. In addition, the burden of installing machines such as parking locks is also required.

The present invention attempts to solve such problems, and provides a parking lot monitoring device, a parking lot management system, and a parking lot management program that make it possible to manage many parking lots with a small number of people or unmanned. With the goal.

A first invention includes image acquisition means for acquiring an image in a parking lot, parking frame recognition means for recognizing a plurality of parking spaces included in the parking lot based on the image, and based on the image, vehicle recognition means for recognizing vehicles existing in the parking frame; and text data transmission means for transmitting information on the vehicle recognized by the vehicle recognition means as text data to a generalization device managing the plurality of parking lots. abnormal state determination means for determining the presence or absence of an abnormal state in the parking lot based on the image; and image data transmission for transmitting information regarding the abnormal state recognized by the abnormal state determination means to the supervising device as image data. and a parking lot monitoring device.

According to the configuration of the first aspect of the invention, the parking lot monitoring device transmits the information about the vehicle existing in the parking frame as text data to the supervising device, and transmits the abnormal state information as image data to the supervising device. Information about automobiles is text data, which is smaller in capacity than image data. The abnormal state information is image data, which has a larger capacity than text data, but is transmitted only when an abnormal state occurs. That is, since the parking lot monitoring device transmits only abnormal state information as image data to the commanding device, the capacity of the communication line may be smaller than in the case of transmitting data of all images to the commanding device. In addition, since it is sufficient for the manager who manages the supervising device to visually check only the abnormal state information on the image and take appropriate measures, one manager can manage a large number of parking lot monitoring devices. As a result, many parking lots can be managed by a small number of people.

In a second invention, in the configuration of the first invention, the parking frame recognition means and the car recognition means are configured to refer to feature data generated by deep learning, and the text The data is a parking monitor, including the type and registration number of the vehicle.

A third aspect of the present invention is the parking lot monitoring system according to the first aspect, wherein the abnormal condition determination means determines that the abnormal condition exists when the relationship between the vehicle and the human satisfies a predetermined abnormal condition. It is a device.

A fourth aspect of the invention, in the configuration of the first aspect, has reservation information receiving means for receiving reservation information requesting a reservation for parking from the supervising device, wherein the vehicle actually existing in the parking lot and the reservation The parking lot monitoring device has display control means for controlling a display device for displaying to the outside whether or not there is the available parking space based on the information.

A fifth invention, in the configuration of the first invention, is based on driver identification means for detecting a person in the image and identifying a driver of the vehicle, and driver image data for transmitting image data indicating the driver. A parking lot monitor having a transmitting means.

According to a sixth invention, in the configuration of the first invention, entering vehicle image acquisition means for acquiring an image of an entering vehicle that has entered the parking lot; outline calculation means for calculating an outline of the entering vehicle; parking frame determination means for determining a parking frame in which the entering vehicle can be parked based on the outer shape of the entering vehicle calculated by the means; and navigation for guiding the entering vehicle to the parking frame determined by the parking frame determining means. A parking lot monitoring device comprising means.

A seventh invention is a parking lot system having a parking lot monitoring device arranged in a parking lot, an integrated device capable of communicating with the plurality of parking lot monitoring devices, and a user device capable of communicating with the integrated device. The parking lot monitoring device includes image acquisition means for acquiring an image in the parking lot, parking frame recognition means for recognizing a plurality of parking spaces included in the parking lot based on the image, and Vehicle recognition means for recognizing vehicles existing in the parking frame based on the image, and information on the vehicles recognized by the vehicle recognition means are transmitted as text data to a centralizing device for managing the plurality of parking lots. and text data transmission means, wherein the supervising device has information providing means for transmitting information on the parking lot having the available parking spaces to the user device in response to an inquiry from the user device. , is a parking lot management system.

In an eighth invention based on the configuration of the seventh invention, the centralizing device receives location information from the user device, and the information providing means provides the information on the parking lot near the location of the user device to the user. a reservation information reception means for receiving reservation information requesting use of a specific parking lot from the user device; and a reservation for transmitting the reservation information to the parking monitoring device. and information transmission means.

A ninth aspect of the invention comprises a computer that controls a parking lot monitoring device that manages a parking lot, an image acquiring means that acquires an image in the parking lot, and a plurality of parking spaces included in the parking lot based on the image. parking space recognizing means for recognizing, vehicle recognizing means for recognizing a vehicle existing in the parking space based on the image, information about the vehicle recognized by the vehicle recognizing means as text data, a plurality of the parking lots. text data transmission means for transmitting text data to a supervising device to be managed; abnormal condition determination means for determining the presence or absence of an abnormal condition in the parking lot based on the image; A parking lot management program for functioning as image data transmission means for transmitting image data to the generalizing device.

As described above, according to the present invention, it is possible to provide a parking lot monitoring device, a parking lot management system, and a parking lot management program capable of managing a large number of parking lots with a small number of people.

It is a schematic plan view showing a parking lot. 1 is a schematic diagram showing a parking management system; FIG. FIG. 2 is a schematic diagram showing paths of data to be communicated, etc. FIG. It is a schematic diagram showing a functional block of a parking lot monitoring device. FIG. 3 is a schematic diagram showing data held by the parking monitoring device; FIG. 3 is a schematic diagram showing functional blocks of a centralizing device; FIG. 4 is a schematic diagram showing data held by a centralizing device; Figure 2 is a schematic diagram showing functional blocks of a user device; It is a schematic flowchart which shows operation|movement of a parking lot monitoring apparatus. It is a schematic flowchart which shows operation|movement of a parking lot monitoring apparatus. It is a schematic flowchart which shows operation|movement of a parking lot monitoring apparatus.

Embodiments of the present invention will be described with reference to the drawings. It should be noted that description of configurations that can be appropriately implemented by those skilled in the art will be omitted, and only the basic configuration of the present invention will be described.

FIG. 1 is a schematic plan view of a parking lot 1A viewed from above. A parking lot monitoring device 10 (hereinafter referred to as "monitoring device 10") is configured to monitor the parking lot 1A and is arranged in the parking lot 1A. The monitoring device 10 includes a housing 10a, and a visible light camera 10b and an infrared camera 10c arranged in the housing 10a. A visible light image is acquired by the visible light camera 10b, and a thermography (an image showing heat distribution: thermography) is acquired by the infrared camera 10c. The monitoring device 10 is rotatable in the horizontal direction (direction of arrow X1) about the rotation shaft 10d, and is rotatable in the vertical direction (direction of arrow Z1) about the rotation shaft 10e. The monitoring device 10 can acquire an image of the entire area of the parking lot 1A. The monitoring device 10 also includes a speaker 10f.

The parking lot 1A is configured so that cars can move in the direction indicated by the arrow G1. The parking lot 1A has parking frames S1 to S10. Currently, the vehicle 20A is present in the parking slot S2, the vehicle 20B is present in the parking slot S5, the vehicle 20C is present in the parking slot S6, the vehicle 20D is present in the parking slot S8, and the parking slot S9 is present. , there is a car 20E. A display device 12 is arranged at the entrance of the parking lot 1A, and indicates whether or not there is an available parking slot in the parking lot 1A. Since five of the parking spaces S1 to S10 are currently vacant, the display device 12 displays "vacant" indicating that there are available parking spaces. The display device 12 displays "FULL" when there is no available parking space.

As shown in FIG. 2, the parking lot management system 300 is composed of a large number of monitoring devices 10, a large number of user devices 200A, etc., and the generalizing device 100. FIG. The parking lot management system 300 is a system for managing a large number of parking lots 1A and the like, and a monitoring device 10 is arranged for each parking lot 1A. Although only parking lots 1A to 1D are shown in FIG. 2, in reality, a large number of monitoring devices 10, for example 100 to 1000, can be present. A large number of monitoring devices 10 can communicate with the centralizing device 100 via the Internet 120 . The commanding device 100 can communicate with user devices 200A to 200E (the user devices 200A and the like are collectively referred to as “user devices 200” hereinafter) via the Internet 120 . User devices 200 and the like may actually exist in a very large number, for example, 10,000 to 100,000. Although the monitoring device 10 and the controlling device 100 store various computer programs, so-called cloud computing may be used.

The monitoring device 10 performs image recognition on objects included in images acquired by the visible light camera 10b and the infrared camera 10c. The monitoring device 10 refers to feature data generated by deep learning, identifies the features of an object included in an acquired image, and recognizes the object as an image. . Deep learning is machine learning using a multi-layered neural network, and image recognition is one of the most promising application fields.

The monitoring device 10 can recognize the category of an object by identifying the feature of the object included in the image acquired by the visible light camera 10b or the like based on a large amount of feature information for each category. Here, the categories mean parking spaces, various types of automobiles, automobile registration numbers, people, and the like. The categories are subdivided to recognize specific characters that make up the vehicle registration number (for example, not only kanji, hiragana and numbers, but also specific characters such as "1123" if it is a number). can do. Human beings can recognize features such as facial features, clothing colors, and the like. As a result, for example, it is possible to determine the difference between a person recognized in the past and a person recognized at present.

Specifically, the monitoring device 10 extracts a large number of features, such as contours and directions of individual configurations, from the acquired image, and compares them with the feature data of each category acquired by deep learning to determine the correlation (correlation degrees). The higher the degree of correlation, the more likely the object in the acquired image belongs to a particular category. For example, when the degree of correlation is 0, the probability of belonging to a specific category (hereinafter referred to as “category common probability”) is 0%, and when the degree of correlation reaches the maximum value, the category common probability is 100. %. The monitoring device 10 determines that the category of the object in the acquired image belongs to the specific category when the category common probability is a predetermined reference value, for example, 95% or more. The monitoring device 10 has feature data obtained by deep learning using visible light images and feature data obtained by deep learning using thermography. The monitoring device 10 refers to the feature data based on the visible light image for image recognition of the object in the image obtained by the visible light camera 10b, and uses the feature data based on thermography for image recognition of the object in the image obtained by the infrared camera 10c. is configured to refer to

The monitoring device 10 collects feature data such as feature data indicating boundaries of parking lot areas, feature data indicating parking spaces, feature data indicating various types of automobiles, feature data indicating automobile license plates, and feature data indicating humans. By image recognition, it is possible to recognize the parking frame, the type and registration number of the car, the person, etc. Furthermore, the monitoring device 10 can determine an unnatural state (abnormal state) based on the result of image recognition.

As shown in FIG. 3, the monitoring device 10 transmits and receives text data (arrows R1 and R5) and image data (arrow R2) via the controlling device 100 and the Internet 120. FIG. The controlling device 100 can send and receive data (arrows R3 and R4) with the monitoring device 10 and the user devices 200 via the Internet 120 . The user device 200 can send and receive data (arrows R6 and R7) with the central device 100 via the Internet 120. FIG.

The monitoring device 10 performs image recognition of a parking lot area, a parking frame, a car model, a car registration number, a person, and the like. Basic information consisting of the identification number of the monitoring device 10 itself (the identification number of the parking lot in which it is arranged), the address (location), the number of parking spaces, the type of vehicle parked in the parking lot, and the registration number of the vehicle. is sent to the commanding device 100 as text data. Since the basic information is text data, the communication speed is faster and the capacity of the communication line may be relatively small compared to the case of transmitting image data. Also, the person in charge of managing the commanding device 100 does not need to visually check the basic information.

The monitoring device 10 determines the presence or absence of an abnormal state based on image recognition. An abnormal state is defined as, for example, a state other than a normal state. When a vehicle 20A enters the parking lot 1A (see FIG. 1) and the parking slot S2 is vacant, it is normal to park in the parking slot S2 without contacting another vehicle 20B or the like. . It is normal for the driver 30A to exit the car 20A and exit the parking lot 1A within a few minutes. On the other hand, the vehicle 20A coming into contact with another vehicle 20B or the like is an abnormal state because it is not a normal state. In addition, it is not normal for the driver 30A to approach another automobile 20B or the like and maintain a short distance (for example, within 1 meter (m)) for a predetermined period of time (for example, 5 minutes or longer). Abnormal state. In addition, even though the driver 30A has left the vehicle 20A, a person such as a child is present inside the vehicle 20A, and a state in which a predetermined time or longer (for example, 20 minutes or longer) elapses is not a normal state, so it is abnormal. state. Alternatively, it is normal for a person who has no record of being in the parking lot 1A to maintain a close distance (for example, within 1 meter (m)) to the car 20A for a predetermined time or longer (for example, 5 minutes or longer). It is abnormal because there is no When the monitoring device 10 determines that an “abnormal state” exists, the monitoring device 10 transmits image data related to the abnormal state to the supervising device 100 via the Internet 120 . For example, when a person other than the driver 30A of the automobile 20A exists at a short distance of the automobile 20A for a predetermined time or longer, the image data is image data for the past five minutes and the current image (moving image). Image data relating to an abnormal state is not transmitted to the commanding device 100 except when an abnormal state occurs, so the capacity of the communication line may be relatively small. In addition, since the person in charge of managing the supervising device 100 only needs to visually check the received image data when an abnormal state occurs, a small number of people can manage a large number of monitoring devices 10 (parking lot 1A, etc.). can be managed.

When the commanding device 100 receives an inquiry about available parking lots from the user device 200 , the commanding device 100 transmits data regarding available parking lots to the user device 200 . When the supervising device 100 receives data indicating a request for reservation from the user device 200 , the supervising device 100 transmits parking reservation information indicating the request for reservation to the target monitoring device 10 . When the monitoring device 10 receives the data indicating the reservation request from the commanding device 100,

As shown in FIG. 4 , the monitoring device 10 has a CPU (Central Processing Unit) 50 , a storage section 52 , a communication section 54 , an image processing section 56 , a display control section 58 and a power supply section 60 .

The communication unit 54 enables the monitoring device 10 to communicate with the controlling device 100 .

The image processing unit 56 allows the monitoring device 10 to operate the visible light camera 10b and the like to acquire visible light images and the like.

The power supply unit 60 is connected to, for example, an AC power supply, and supplies power to each unit of the monitoring device 10 .

The storage unit 52 stores basic programs such as a program for rotating the housing 10a and a program for operating the visible light camera 10b and the like, as well as the following programs.

The storage unit 52 stores a parking lot area recognition program, a parking frame recognition program, an automobile recognition program, a reservation information reception program, a display control program, a text data transmission program, an abnormal state determination program, an image data transmission program, a driver identification program, A driver image data transmission program, an intruding vehicle image acquisition program, an outline calculation program, a parking frame determination program, and a navigation program are stored.

The CPU 50 and the parking lot area recognition program are an example of parking lot area recognition means for recognizing the area of the parking lot 1A. The CPU 50 and the parking frame recognition program are examples of parking frame recognition means. The CPU 50 and the vehicle recognition program are examples of vehicle recognition means. The CPU 50 and the reservation information reception program are examples of reservation information reception means. The CPU 50 and the display control program are examples of display control means. The CPU 50 and the text data transmission program are examples of text data transmission means. The CPU 50 and the abnormal state determination program are examples of abnormal state determination means. The CPU 50 and the image data transmission program are examples of image data transmission means. The CPU 50 and the driver identification program are examples of driver identification means. The CPU 50 and the driver image data transmission program are examples of driver image data transmission means. The CPU 50 and the intrusion vehicle image program are an example of intrusion vehicle image acquisition means. The CPU 50 and the contour calculation program are examples of contour calculation means. The CPU 50 and the parking frame determination program are examples of parking frame determination means. The CPU 50 and the navigation program are examples of navigation means.

When the monitoring device 10 is placed in a specific parking lot, for example, the parking lot 1A, the parking lot area recognition program recognizes the image of the boundary of the parking lot 1A and distinguishes between the outside and the inside of the parking lot 1A. . Therefore, when the monitoring device 10 is placed in a specific parking lot, it is sufficient to register the identification number and address of the parking lot, and there is no need to input information on the boundaries of the parking lot and parking spaces.

Further, when the monitoring device 10 is placed in the parking lot 1A, the number of parking spaces, the arrangement of the parking spaces, and the positions of the parking spaces are image-recognized by the parking space recognition program. Therefore, it is not necessary to enter a specific parking structure when setting up the monitoring device 10 .

The monitoring device 10 recognizes whether or not there is a car in each parking frame S1 or the like by a car recognition program. The monitoring device 10 also recognizes the vehicle type. In addition, the monitoring device 10 recognizes the image of the license plate of the automobile, and also recognizes the registration number described there. The monitoring device 10 creates and holds parking lot data shown in FIG. 5, for example.

The monitoring device 10 uses a display control program to compare the number of parking spaces in the parking lot 1A with the number of cars existing in each parking space S1 or the like. The monitoring device 10 displays "Vacant" on the display device 12 when the number of cars is less than the number of parking spaces, and displays "Full" on the display device 12 when the number of cars is the same as the parking lot. ” is displayed.

The monitoring device 10 receives reservation information from the commanding device 100 by a reservation information reception program. When the monitoring device 10 receives the parking reservation information from the supervising device 100, the monitoring device 10 performs the above-described display control program based on the parking reservation information. For example, when there are actually 9 cars in the 10 parking spaces S1 to 10, when the parking reservation information for one car is received, the total number of cars is 10, so the number of cars to be parked is 10. It is assumed to be the same as the car park, and "Full" is displayed on the display device 12.例文帳に追加The reservation number may be part of the vehicle's registration number, eg, the last four digits of the registration number. In addition, when each parking frame S1 or the like in the parking lot 1A is provided with a raised locking plate (bar), for example, when "FULL" is not displayed (the parking frame is not actually parked) number and the total number of reservations), when the parking reservation information is received, one of the lock plates of the parking frame S1, etc. is raised to prevent parking, and the reservation number is entered. The lock plate may be lowered when the corresponding vehicle enters the parking lot 1A.

When the vehicle having the reservation number indicated in the parking reservation information actually enters the parking lot 1A and parks, the monitoring device 10 deletes the "reservation number" of the parking lot data in FIG. number”.

The monitoring device 10 transmits the basic information (see FIG. 3) as text data to the commanding device 100 by the text data transmission program.

When the monitoring device 10 determines that an abnormal state has occurred by the abnormal state determination program, the monitoring device 10 transmits image data regarding the abnormal state to the supervising device 100 by the image data transmission program.

The monitoring device 10 detects a person in the image and identifies the driver of the vehicle by means of the driver identification program in the image related to the abnormal condition described above. Since the monitoring device 10 can recognize the image of a person, it identifies the person as the driver when the person is behind the steering wheel of the car. The monitoring device 10 can identify, for example, the driver M (see FIG. 1) of the vehicle 20F entering the parking lot 1A.

The monitoring device 10 transmits image data representing the driver to the commanding device 100 according to the driver image data transmission program. As a result, the supervising device 100 can acquire the image data of the driver related to the abnormal state and use it, for example, by transmitting it to the nearest police station. Note that, unlike the present embodiment, the monitoring device 10 may always identify the driver of the vehicle parked in the parking lot 1A or the vehicle entering the parking lot 1A and transmit the image data thereof to the supervising device 100. good.

The monitoring device 10 acquires an image of a vehicle (entering vehicle) that has entered the parking lot 1A by an entering vehicle image acquisition program. For example, when an automobile 20F (see FIG. 1) approaches, an image of the automobile 20F is acquired.

The monitoring device 10 calculates the outer shape of the incoming vehicle 20F that has entered the parking lot 1A by using the outer shape calculation program. The monitoring device 10 calculates the horizontal length L1 and the vertical length L2 of the vehicle based on the number of pixels of the image of the vehicle 20F. Here, when the monitoring device 10 is installed, it recognizes a reference object (for example, a rod-shaped object with a length of 1 meter (m)) at a plurality of positions in the parking lot 1A, and a 1-meter object at that position The number of pixels occupied (hereinafter referred to as "reference pixel number") is stored. The plurality of positions are, for example, the position of the display device 12 arranged at the entrance and the position of each entrance such as the parking frame S1. As a result, the monitoring device 10 can calculate the outer shape of the vehicle 20F that has entered the parking lot 1A based on the number of pixels in the image.

The monitoring device 10 determines the parking frame for the vehicle 20F based on the external shape of the vehicle 20F by the parking frame determination program. The monitoring device 10 also calculates the outer shape of each parking frame S1, etc., based on the reference number of pixels, and determines that the parking frame in which the vehicle 20F can be parked is, for example, the parking frame S1.

The monitoring device 10 guides the automobile 20F to a parking slot in which the automobile 20F can be parked by the navigation program. Specifically, the monitoring device 10 emits a voice saying, for example, "Please park the car with the registration number XX that has just entered in the parking frame S1" from the speaker 10f.

As shown in FIG. 6 , the supervising device 100 has a CPU 110 , a storage section 112 , a communication section 114 and a power supply section 120 .

The communication unit 114 enables the generalization device 100 to communicate with the monitoring device 10 and the user device 200 .

The power supply unit 120 is connected to, for example, an AC power supply, and supplies power to each unit of the centralizing device 100 .

The storage unit 112 stores a basic program for operating the display device (not shown) and the speaker (not shown) of the commanding device 100, as well as an information providing program and a reservation information receiving program. The CPU 110 and the information providing program are examples of information providing means. The CPU 110 and the reservation information receiving program are examples of reservation information receiving means.

In response to an inquiry from the user device 200, the supervising device 100 transmits parking information regarding a parking lot having available parking spaces to the user device 200 using the information providing program. The parking information includes the address, name and number of vacant parking spaces of a specific parking lot. Coordinating device 100 also receives information indicating the current location of user device 200 , and transmits parking information regarding one or more parking lots to user device 200 in order of proximity to the current location of user device 200 .

Further, when receiving reservation request information requesting reservation of a specific parking lot from the user device 200 by the reservation information reception program, the supervising device 100 sends a request to the monitoring device 10 of the target parking lot 1A or the like. to send the parking reservation information.

The supervising device 100 stores data received from a plurality of monitoring devices 10 and user devices 200 as supervising device data shown in FIG. 7, for example.

As shown in FIG. 8 , the user device 200 has a CPU 210 , a storage section 212 , a wireless communication section 214 , a positioning section 216 and a power supply section 220 .

The wireless communication unit 214 allows the user device 200 to communicate with the central device 100 .

The power supply unit 220 is, for example, a rechargeable battery.

The operation of the monitoring device 10 will be summarized below with reference to FIGS. 9 to 11. FIG. The monitoring device 10 is placed in a specific parking lot, for example, the parking lot 1A, and when it starts operating, it acquires an image of the parking lot 1A (step ST1 in FIG. 9). Then, the monitoring device 10 performs image recognition of the area of the parking lot 1A and the parking frame (step ST2).

The monitoring device 10 recognizes the entry and exit of a car into and out of the parking lot 1A (step ST3), and when a car enters, the image recognition of the car model and registration number is performed (step ST4), and the basic information is integrated as text data. It is transmitted to the device 100 (step ST5). Subsequently, the monitoring device 10 executes parking frame management processing (step ST6).

Details of the parking frame management process will be described with reference to FIG. 10 . The monitoring device 10 judges whether or not there is a vacant parking lot in the most recent time (step ST61). If not, the message "Full" is displayed on the display device 12.例文帳に追加When the monitoring device 10 receives the reservation information (step ST62), it determines whether or not there is an empty parking slot in consideration of the number of vehicles indicated in the reservation information (step ST61). When the monitoring device 10 receives the reservation information (step ST62) and the reserved car does not arrive within a predetermined time (step ST63), the reservation of the parking lot data (see FIG. 5) is canceled and canceled. The information is transmitted to the supervising device 100 (step ST64), and based on the cancellation of the reservation, it is determined whether or not there is an empty parking slot (step ST61).

The monitoring device 10 performs determination of an abnormal state and transmission of image data shown in FIG. 11 in parallel with the processing of FIGS. 9 and 10 . When monitoring device 10 determines that an abnormal state exists (step ST101 in FIG. 11), it transmits image data to supervising device 100 (step ST102).

The present invention is not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present invention.

10 parking lot monitoring device 100 control device 200 user device

Claims (9)

image acquisition means for acquiring an image in the parking lot;
Parking frame recognition means for recognizing a plurality of parking spaces included in the parking lot based on the image;
car recognition means for recognizing a car existing in the parking frame based on the image;
text data transmission means for transmitting information about the vehicle recognized by the vehicle recognition means as text data to a supervising device that manages the plurality of parking lots;
Abnormal state determination means for determining the presence or absence of an abnormal state in the parking lot based on the image;
image data transmission means for transmitting information about the abnormal state determined by the abnormal state determination means as image data to the supervising device;
has
The text data is not limited to information indicating the presence or absence of the car in the parking frame, and includes the type and registration number of the car,
The image data is past image data and a current image (moving image) within a predetermined time range when a person other than the driver of the vehicle exists in the vicinity of the vehicle for a predetermined period of time or more.
Parking monitor. The parking frame recognition means and the vehicle recognition means are configured to refer to feature data generated by deep learning,
The parking lot monitoring device according to claim 1. The abnormal state determination means determines that the abnormal state exists when the relationship between the vehicle and the human satisfies a predetermined abnormal condition.
The parking lot monitoring device according to claim 1. Reservation information receiving means for receiving reservation information requesting a reservation for parking from the supervising device,
Display control means for controlling a display device that externally displays whether or not there is an available parking space based on the car actually existing in the parking lot and the reservation information,
The parking lot monitoring device according to claim 1. a driver identifying means for detecting a person in the image and identifying the driver of the vehicle;
2. The parking lot monitoring apparatus according to claim 1, further comprising driver image data transmission means for transmitting image data representing said driver. an entering vehicle image acquiring means for acquiring an image of an entering vehicle that has entered the parking lot;
an outline calculation means for calculating an outline of the approaching vehicle;
parking frame determination means for determining a parking frame in which the approaching vehicle can be parked based on the outer shape of the approaching vehicle calculated by the outer shape calculating means;
navigation means for guiding the entering vehicle to the parking space determined by the parking space determining means;
having
The parking lot monitoring device according to claim 1. a parking lot monitoring device arranged in the parking lot;
a supervising device capable of communicating with the plurality of parking lot monitoring devices;
a user device communicable with the centralized device;
A parking lot system having
The parking lot monitoring device
an image acquisition means for acquiring an image in the parking lot;
Parking frame recognition means for recognizing a plurality of parking spaces included in the parking lot based on the image;
car recognition means for recognizing a car existing in the parking frame based on the image;
text data transmission means for transmitting information about the vehicle recognized by the vehicle recognition means as text data to a commanding device that manages a plurality of the parking lots;
Abnormal state determination means for determining the presence or absence of an abnormal state in the parking lot based on the image;
image data transmission means for transmitting information about the abnormal state determined by the abnormal state determination means as image data to the supervising device;
has
The controlling device is
Having information providing means for transmitting information about the parking lot having the parking space that can be parked to the user device in response to an inquiry from the user device;
The text data is not limited to information indicating the presence or absence of the car in the parking frame, and includes the type and registration number of the car,
The image data is generated when a person other than the driver of the vehicle exists within a short distance of the vehicle for a predetermined time or more.leave, which is the past image data and the current image (moving image) within a predetermined time range,
Parking management system. the centralized device receives location information from the user device;
The information providing means is configured to transmit information about the parking lot near the location of the user device to the user device,
moreover,
Reservation information receiving means for receiving reservation information requesting use of a specific parking lot from the user device;
Reservation information transmission means for transmitting the reservation information to the parking monitoring device;
8. The parking lot management system of claim 7, comprising: The computer that controls the parking lot monitoring device that manages the parking lot,
image acquisition means for acquiring an image in the parking lot;
Parking frame recognition means for recognizing a plurality of parking spaces included in the parking lot based on the image;
vehicle recognition means for recognizing a vehicle existing in the parking frame based on the image;
text data transmission means for transmitting information about the vehicle recognized by the vehicle recognition means as text data to a supervising device that manages the plurality of parking lots;
Abnormal state determination means for determining the presence or absence of an abnormal state in the parking lot based on the image; and
image data transmission means for transmitting information about the abnormal state recognized by the abnormal state determination means as image data to the supervising device;
A parking lot management program for functioning as
The text data is not limited to information indicating the presence or absence of the car in the parking frame, and includes the type and registration number of the car,
The image data is past image data and a current image (moving image) within a predetermined time range when a person other than the driver of the vehicle exists in the vicinity of the vehicle for a predetermined period of time or more.
Parking management program.

Images