JP2013119461A - Apparatus for monitoring inside of elevator car - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an apparatus for monitoring the inside of an elevator car which can accurately monitor conditions in the elevator car by automatically setting a mask area.SOLUTION: An image processing part 32 for processing an image output by a video camera 31 taking an image of the inside of the elevator car 23 is configured to perform mask area setting control when a temporary elevator car call is registered under the condition of the absence of a person in the elevator car. In the mask area setting control, after a reference frame image is set during the movement of the elevator car 23, a composite fluctuation area different from an area of the reference frame image is extracted on the basis of frame images obtained so far in an image obtained by superposition of frame images obtained since the obtaining of the reference frame image, an amount of increase of this extracted composite fluctuation area with respect to a composite fluctuation area extracted last time is calculated and stored in a data storage part, and a finally extracted composite fluctuation area is set as the mask area when the calculated amount of increase is a predetermined threshold or below in succession a predetermined number of times.

Description

  The present invention relates to an elevator car monitoring device for monitoring the inside of an elevator car.

A conventional elevator car monitoring apparatus includes a camera for photographing the inside of the car and passenger detection means for detecting the presence or absence of a photographed passenger using this camera (see, for example, Patent Document 1).
The passenger detection means detects the presence or absence of a passenger by processing using the background subtraction method. That is, the passenger detection means detects the presence or absence of a passenger by adopting an image in an unattended car as a background image and comparing the background image with an image (input image) of a camera acquired at every sampling period. .

Japanese Patent No. 3698584

However, for example, when a window is provided in the car, the image reflected in the window varies depending on the height position of the car. In addition, when external light such as illumination is inserted into the car through the window, the area of the camera image that is affected by the external light varies depending on the height position of the car.
Therefore, when the car is moved, the image (input image) of the camera gradually changes even if there are no passengers in the car.

  In this state, the passenger detection means erroneously detects a change in the input image caused by the window or outside light accompanying the movement of the car as the presence of the passenger. In order to avoid this problem, the area that may change due to the window or outside light when the car is moved is taken as the mask area from the camera's output area and acquired from the camera's output video. When performing image processing, it is necessary to set an area corresponding to the mask area to be excluded from image processing.

Conventionally, in order to set a mask area, for example, an operator moves an unmanned cage and properly grasps the mask area by himself based on the image of the camera. Further, the mask area is set in the shooting area of the camera. The setting work was done manually.
Since the mask area was manually set, it was a laborious work for the maintenance personnel.

  The present invention has been made to solve the above-described problems, and an object thereof is to provide an elevator car monitoring device capable of accurately monitoring a state in a car by automatically setting a mask region. And

  The elevator car monitoring system according to the present invention acquires a frame image in an elevator car having an elevator control unit that controls the raising and lowering of the car according to a car, a car call and a hall call provided with a hoistway that can be raised and lowered. The frame image area is divided into a predetermined mask area to be excluded from the image processing target and the remaining image processing target area. Based on the change in the image processing target area, the information in the car is acquired. A monitoring device, an imaging unit that captures an image of the inside of the car, an image processing unit that processes an image in the car output by the imaging unit, a data storage unit that stores a result of image processing by the image processing unit, and a car call And an elevator control monitoring unit for determining a situation in which the registration of the hall call has been canceled and there are no passengers in the car and registering the temporary car call, and the image processing unit includes: When the temporary car call is registered, it is configured to perform mask area setting control, and as the mask area setting control, the image processing unit acquires a frame image from the output of the photographing means during movement of the car according to the temporary car call. Acquire sequentially, set a frame image acquired at a predetermined time as a reference frame image, and acquire a reference frame image every time a frame image is acquired at a predetermined interval after setting the reference frame image. In the image obtained by superimposing the frame images that have been superposed, the composition variation area that is different from the reference frame image is extracted based on the previously acquired frame image, and the composition extracted this time with respect to the previously extracted composition variation area The amount of increase in the variable region is calculated and stored in the data storage unit, and the calculated amount of increase in the combined variable region is less than the predetermined threshold value continuously for a predetermined number of times. When it performs control to set the last synthetic variation area extracted as a mask region.

  According to the elevator car monitoring apparatus according to the present invention, the elevator control monitoring unit registers the temporary car call and moves the car in a situation where there is no car call or landing call and there are no passengers in the car. Since the image processing unit is configured to automatically perform mask area setting control for setting the mask area, it is possible to remarkably reduce the trouble for the maintenance person to set the mask area.

1 is a schematic diagram of an elevator system having an elevator car monitoring device according to Embodiment 1 of the present invention. FIG. It is a perspective view which shows the mode in the car which the video camera of the elevator car monitoring apparatus which concerns on Embodiment 1 of this invention image | photographs. 1 is a system configuration diagram of an elevator system having an elevator car monitoring apparatus according to Embodiment 1 of the present invention. It is a figure explaining the image | video of a video camera, and a synthetic | combination fluctuation | variation area | region when the elevator car in which the elevator car monitoring apparatus which concerns on Embodiment 1 of this invention was installed moved on the conditions where a person is not riding. . It is a figure explaining the time change of the synthetic | combination fluctuation | variation area | region when the elevator car which has an elevator car monitoring apparatus which concerns on Embodiment 1 of this invention moves. It is a flowchart explaining operation | movement of the elevator car monitoring apparatus which concerns on Embodiment 1 of this invention. It is a figure explaining the time change of the synthetic | combination fluctuation | variation area | region when a camera shifts in the elevator car monitoring apparatus which concerns on Embodiment 2 of this invention. It is a flowchart explaining operation | movement of the elevator car monitoring apparatus which concerns on Embodiment 2 of this invention. It is a flowchart explaining operation | movement of the elevator car monitoring apparatus which concerns on Embodiment 3 of this invention. It is a flowchart explaining operation | movement of the elevator car monitoring apparatus which concerns on Embodiment 4 of this invention.

  The best mode for carrying out the present invention will be described below with reference to the drawings.

Embodiment 1 FIG.
1 is a schematic diagram of an elevator system having an elevator car monitoring device according to Embodiment 1 of the present invention, and FIG. 2 is taken by a video camera of the elevator car monitoring device according to Embodiment 1 of the present invention. FIG. 3 is a system configuration diagram of an elevator system having an elevator car monitoring device according to Embodiment 1 of the present invention.

  1 and 2, the elevator system 1 includes an elevator 10 and an elevator car monitoring device 30.

  The elevator 10 includes a hoistway 11 provided in the building 2, a drive sheave 13 and an electric motor 14 that generates torque for rotating the drive sheave 13, and a machine room 15 formed in the upper part of the hoistway 11. The hoisting machine 12 to be installed, the deflecting wheel 16 installed in the machine room 15, and the main rope 17 wound around the drive sheave 13 and the deflecting wheel 16 and suspended in the hoistway 11. Yes.

Further, the elevator 10 has a landing door 22 that opens and closes a landing doorway 21 that opens to the hoistway 11, and is connected to one end of the landing 20 provided on each floor and the main rope 17 so that the hoistway 11 can be raised and lowered. A car 23 having a car door 25 provided to open and close the car doorway 24 and a counterweight 18 connected to the other end of the main rope 17 are provided on the car 23 and are composed of a car door 25 and a landing door 22. And a door motor 27 that generates a driving force for opening and closing the door.
When the main rope 17 travels in conjunction with the rotation of the drive sheave 13 due to the frictional force between the drive sheave 13 and the main rope 17, the car 23 is also raised and lowered.

  The elevator 10 also includes an elevator control panel 28 as an elevator control unit that drives the electric motor 14 and the door motor 27 to control the raising and lowering of the car 23 and the opening and closing of the elevator door.

As shown in FIG. 1, each hall 20 is provided with a hall call button 20a as a hall call registration means. The hall call button 20a is used for designating a desired destination floor direction for passengers of the hall 20 with respect to the current floor.
Further, in the car 23, as shown in FIGS. 1 and 2, a destination floor button 23a as a car call registration means is provided. The destination floor button 23a is for a passenger in the car 23 to specify a desired destination floor, and here, a destination floor button 23a having a number corresponding to each floor is provided. Further, as shown in FIG. 2, the car 23 is provided with a display portion 23 b indicating the floor where the car 23 is currently located.

  Further, as shown in FIG. 2, the car door 25 is formed with a window portion 25a.

  The elevator control panel 28 stores a program (CPU) (not shown) as an arithmetic control means, a motor 14 and a door motor 27 to drive the elevator 23 and control the elevator door. A ROM (not shown), and a RAM (not shown) for temporarily storing data necessary for arithmetic control of the CPU.

  When the destination floor button 23a and the hall call button 20a are operated, the car call and the hall call are registered in the RAM of the elevator control panel 28 according to the operated destination floor button 23a and the hall call button 20a. The The CPU of the elevator control panel 28 controls the raising / lowering of the car 23 according to the registered car call and landing call, and appropriately controls the opening / closing of the elevator door according to the landing of the car 23.

Next, the configuration of the elevator car monitoring device 30 will be described.
In FIG. 1 and FIG. 3, an elevator car monitoring device 30 is capable of photographing a predetermined area in the car 23, and a video camera 31 as a photographing means provided in the car 23 and an image output from the video camera 31. An image processing unit 32 configured to be analyzable, a data storage unit 35 for storing the results of image processing by the image processing unit 32, and car calls and landing calls registered in the elevator control panel 28, and elevator door opening / closing control. And an elevator control monitoring unit 36 for monitoring.

  As shown in FIG. 2, the video camera 31 is provided so as to be able to photograph a main area in the car 23 including the car door 25.

  The image processing unit 32 is interposed between the image processing main unit 33 that can analyze the image output from the video camera 31, and between the image processing main unit 33 and the video camera 31, and in response to an external transfer command. An image transfer unit 34 that sends an image of the video camera 31 to the image processing main body unit 33 is provided.

  Each of the elevator control monitoring unit 36 and the image processing unit 32 temporarily stores a CPU (not shown) as calculation means, a ROM storing various programs, and data necessary for calculation control of the CPU. And a RAM (not shown).

  The ROM of the elevator control monitoring unit 36 stores a program for transmitting a transfer command for causing the image processing main body unit 33 to analyze the image of the video camera 31 according to the registration status of the car call and the hall call and the opening / closing status of the elevator door. Has been. Further, the ROM stores the predetermined floor on the elevator control panel 28 according to the analysis result of the image processing main body 33, regardless of the operation of the destination call button 20a or the destination floor button 23a in the car 23. A program for registering a temporary car call for the destination floor in the elevator control panel 28 is stored.

  In addition, in response to a transfer command from the elevator control monitoring unit 36, the image transfer unit 34 causes the image transfer unit 34 to transmit the video output from the video camera 31 to the image processing main body unit 33 and to the ROM of the image processing unit 32. A program for causing the image processing main body unit 33 to analyze the image is stored.

  Here, the image processing unit 32 and the elevator control monitoring unit 36 are provided separately from the elevator control panel 28, but the elevator control panel 28 has the functions of the image processing unit 32 and the elevator control monitoring unit 36. It may be used as well.

  The data storage unit 35 is a storage medium such as a RAM or a hard disk.

Next, the system configuration of the elevator system 1 will be described.
In FIG. 3, a destination floor button 23a and a hall call button 20a are electrically connected to the elevator control panel 28.
The elevator control panel 28 determines the destination floor of the car 23 according to the car call according to the operated destination floor button 23a and the hall call according to the operated hall call button 20a. .
The elevator control panel 28 is communicably connected to the display unit 23b, and controls the floor number displayed on the display unit 23b according to the current height position of the car 23.
The elevator control panel 28 is communicably connected to the door motor 27 and the electric motor 14, and can control driving of the door motor 27 and the electric motor 14.

The image transfer unit 34 and the video camera 31 are communicably connected.
The image processing main body 33 and the image transfer unit 34 are communicably connected.
The image processing main body 33 is electrically connected so that data can be written to the data storage unit 35.

Further, the elevator control monitoring unit 36 is electrically connected so as to be able to determine the control status by the elevator control panel 28, and can recognize the currently registered call status and the open / close status of the car door 25 and the landing door 22. It is possible.
The elevator control monitoring unit 36 is configured to be able to register a temporary car call for moving the car 23 to a predetermined destination floor on the elevator control panel 28.

Next, the operation of the elevator system 1 will be described.
When at least one of the hall call button 20a and the destination floor button 23a is operated and at least one of the hall call and the car call is registered, the elevator control panel 28 sets the call registration flag to ON, the hall call and the car. In response to the call, a passenger transport operation for landing the car 23 on the destination floor is performed.

  Then, when the elevator control panel 28 causes the car 23 to land on the destination floor, the car call or the hall call registered for landing on the destination floor is canceled, and all the car calls and the hall calls are canceled. In this case, the call registration flag is turned off.

Next, prior to the operation of the elevator car monitoring device 30, the image of the video camera 31 is sequentially acquired and sequentially acquired when the car 23 on which a person is not moving moves from the current landing floor toward the destination floor. The composite variation region obtained based on the frame image to be processed will be described.
FIG. 4 explains the video camera image and the composition variation region when the elevator car in which the elevator car monitoring apparatus according to Embodiment 1 of the present invention is installed moves under a condition that no person is on the vehicle. FIG.

In FIG. 4, each of (a) to (c) is a frame image acquired by the image processing unit 32 from the output of the video camera 31. (A) The figure is a frame image taken from the output of the video camera 31 when the car 23 is located immediately after moving from the first floor toward the second floor. FIG. 5B is a frame image captured from the output of the video camera 31 when the car 23 is at a position where the car 23 is raised to a predetermined height from the first floor to the second floor. FIG. 6C is a frame image taken from the output of the video camera 31 when the car 23 is at a position passing the landing position on the second floor, for example.
The frame image is acquired from the video of the video camera 31 output in real time.

  Transfer commands are sent from the elevator control monitoring unit 36 to the image transfer unit 34 at minute time intervals, and the image processing main body unit 33 acquires frame images at minute time intervals. That is, a large number of frame images are acquired during acquisition of (a) diagram and (b) diagram, and also during acquisition of (b) diagram and (c) diagram.

Each of (d) to (e) in FIG. 4 is a black result obtained by extracting the synthetic fluctuation region defined below at the time of obtaining the frame images in (a) to (c). It is shown by painting.
When the frame image shown in FIG. 5A is set as the reference frame image, the composite variation area is obtained by superimposing the frame images acquired so far after the reference frame image is acquired. It is defined as an area different from the frame image.

  In FIG. 4D, since the reference frame image is compared with the reference frame image, the composite variation region does not occur.

Further, as shown in FIG. 5A, when the car 23 is landed on the first floor, for example, a monochromatic floor is projected on the window 25a.
When the car 23 moves toward the second floor from this state, the wall of the landing 20 that divides the first floor and the second floor and the object placed on the landing 20 (hereinafter referred to as an installation) are seen from above the window 25a. The image is projected on the video camera 31 so as to move relatively downward.

(B) In the figure, the wall of the hall 20 is projected in a predetermined area from the upper end of the window.
For this reason, as a synthetic | combination fluctuation | variation area | region at the time of acquiring the frame image of (b), as shown in (e), the area | region of the predetermined range toward the lower end of the window part 25a is synthetic | combination fluctuation | variation. Extracted as a region.

(C) In the figure, for example, a part of the floor on the second floor is projected above the window portion 25a.
For example, when the floor color is the same on the first floor and the second floor, the video of the window part 25a of the reference frame image shown in FIG. 5A and the window part 25a of the frame image shown in FIG. It is the same if only the upper end part is seen. However, when the window portions 25a of all the frame images acquired so far are superimposed on the window portion 25a of the reference frame image, a change occurs in the entire region of the window portion 25a of the reference frame image.
For this reason, as a synthetic | combination fluctuation | variation area | region at the time of acquiring the frame image of (c) figure, as shown in (f) figure, the display of the whole area | region of the window part 25a and the display part 23b is 1-2. A region that has changed as a result of switching to is extracted.
In addition, a portion affected by external light inserted through the window 25a is also extracted as a composite variation region, but the description thereof is omitted here.

Next, a change in the composite variation area when the car 23 that has been landed on the first floor is moved toward the top floor will be described.
FIG. 5 is a diagram for explaining the change over time in the composite fluctuation region when the elevator car having the elevator car monitoring apparatus according to Embodiment 1 of the present invention moves.

In FIG. 5, time (A) is the time immediately after the car 23 that has been landed on the first floor has moved.
From time (A), as the time passes, the walls of the hall 20 and the installation objects of the hall 20 reflected above the window portion 25a are relatively moved toward the lower side of the window portion 25a. When the frame image is compared with a frame image acquired up to the previous time, the changed area is large, and the amount of increase in the combined fluctuation area per unit time is also large.

And, for example, after the car 23 has been moved so that the wall or installation of the hall 20 projected on the window 25a relatively crosses the entire area of the window 25a, the newly acquired frame image is When comparing with the synthesized frame images obtained up to the previous time, the newly changed area is greatly reduced.
For this reason, the increase amount of the synthetic | combination fluctuation | variation area | region per unit time decreases.
And, for example, after the time (B) when the car 23 passes around the landing position on the second floor, the increase amount of the fluctuation region per time simply becomes the time (C) after a predetermined time has passed. Also changes at a value close to 0, and after that, it changes at a value close to 0 until the car 23 reaches the destination floor.

  Here, although the change of the synthetic fluctuation area due to the influence of external light such as lighting is not described, the change of the synthetic fluctuation area due to the external light also moves to the next floor after the car 23 is moved. Once done, the change will be less.

Next, the operation of the elevator car monitoring device 30 will be described.
FIG. 6 is a flowchart for explaining the operation of the elevator car monitoring apparatus according to Embodiment 1 of the present invention.
In FIG. 6, for the convenience of explanation, steps 101 to 112 are described as S101 to S102.

In step 101, the elevator control monitoring unit 36 determines whether or not the call registration flag is ON.
In step 101, when the elevator control monitoring unit 36 determines that the call registration flag is ON, the elevator control monitoring unit 36 transmits a monitoring command to the image processing unit 32, assuming that the elevator 10 is performing passenger conveyance operation, and In-car monitoring control for monitoring the state is performed (step 102), and the process returns to step 101.

The in-car monitoring control here monitors the state in the car 23 using the background subtraction method as in the prior art, and the description thereof is omitted.
The image processing unit 32 acquires a shooting area of the video camera 31 in which a predetermined area in the car 23 is set as a shooting range in accordance with the following procedure for removing the shooting area from the image processing area, and the remaining image processing Divide into target areas. Then, the image processing unit 32 compares the frame image of the video captured by the acquired video camera 31 with the background frame image (reference frame image) acquired when there are no passengers, and compares only the data in the image target area. By doing so, it is determined whether or not there are passengers in the car 23 and whether or not the passengers are rampant.

If the elevator control monitoring unit 36 determines in step 101 that the call registration flag is not ON, the process proceeds to step 103.
In step 103, the elevator control monitoring unit 36 determines whether or not the elevator door is fully closed.
In step 103, if the elevator control monitoring unit 36 determines that the elevator door is not fully closed, the elevator control monitoring unit 36 repeats step 103 until the elevator door is fully closed. If it is determined that the elevator door is fully closed, there is no passenger in the car 23. And proceed to step 104.

In step 104, the elevator control monitoring unit 36 determines the destination floor as follows, transmits a temporary car call, registers the temporary car call in the elevator control panel 28, and moves the car 23 toward the destination floor. Let
Here, the destination floor determined by the elevator control monitoring unit 36 is assumed to be Fo.

The elevator control monitoring unit 36 obtains information on the current floor F of the car 23 from the elevator control panel 28.
Here, it is assumed that the uppermost floor of the car 23 is Fh and the lowermost floor is Fl.
And the elevator control monitoring part 36 sets the destination floor Fo to the highest floor Fh, when F is (Fh + Fl) / 2 or less.
When F is larger than (Fh + Fl) / 2, the destination floor Fo is set to the lowest floor Fl.

In addition, the elevator control monitoring unit 36 transmits a transfer command to the image transfer unit 34 together with the registration of the temporary car call, and inputs the video of the video camera 31 to the image processing main unit 33.
Thereafter, the elevator control monitoring unit 36 transmits the transfer command at predetermined minute intervals, and the image of the video camera 31 is input to the image processing main unit 33 in synchronization with the transfer command. .

In step 105 and subsequent steps, the image processing unit 32 performs mask area setting control.
The image processing unit 32 (image processing main body unit 33) acquires the frame image of the video camera 31 in synchronization with the transfer command.

  In step 106, the image processing unit 32 extracts a composite variation region using an inter-frame difference method.

Extraction of the composite fluctuation region is performed as follows.
Of the acquired frame images, a frame image acquired at a predetermined time is set as a reference frame image. Here, the reference frame image is set as the first frame image obtained after the temporary car call is registered and the car 23 starts moving from the current landing floor.

  When the reference frame image is set, the image processing unit 32 sets the reference frame image as a comparison source frame image.

In extracting the composite fluctuation region, the image processing unit 32 first obtains the fluctuation region.
The variable region is a frame that is obtained by setting a frame image to be a reference frame image and setting it as a comparison source frame image, and then comparing the acquired frame image with the comparison source frame image and changing the frame image with respect to the comparison source frame image. It is calculated as an image area.
After obtaining the frame image and obtaining the fluctuation region, the current comparison source frame image is overwritten (updated) with the composite frame image obtained by superimposing the current comparison source frame image with the frame image captured this time. Save).

  The image processing unit 32 obtains the fluctuation region of the next acquired frame image with respect to the overwritten comparison source frame image as described above, when obtaining the frame image and obtaining the fluctuation region next time.

  Further, the image processing unit 32 calculates an increase amount of the fluctuation region extracted this time with respect to the fluctuation region extracted last time. The image processing unit 32 saves the extracted variation region and the increase amount of the variation region extracted this time with respect to the variation region extracted last time in the data storage unit 35 every time the variation region is extracted.

Furthermore, the image processing unit 32 records the region obtained by superimposing the variation regions extracted so far as the combined variation region in the data storage unit 35, and proceeds to Step 107.
Note that the extracted fluctuation area, composite fluctuation area, and increase amount data of the fluctuation area are image fluctuation data.
The composite variation area obtained as described above is the same as the area different from the reference frame image in the image obtained by superimposing the frame images acquired so far after acquiring the reference frame image. Further, the increase amount of the fluctuation region obtained as described above is equal to the increase amount of the composite fluctuation region.

Next, in step 107, the image processing unit 32 refers to the data in the data storage unit 35 and determines whether or not the following mask area setting conditions are satisfied.
The mask area setting condition is that the amount of increase in the composite fluctuation area recorded in the data storage unit 35 is not more than a predetermined threshold continuously for a predetermined number of times.
The predetermined threshold roughly covers the entire area of the video camera 31 that changes due to the movement of the car 23 when the car 23 is moved over the lifting range in a situation where there is no person in the car 23. It is appropriately set as a guideline that can be determined to be.

If the image processing unit 32 determines in step 107 that the mask region setting condition is not satisfied, it checks whether or not the call registration flag is ON (step 108).
If the elevator control monitoring unit 36 determines in step 108 that the call registration flag is ON, the elevator control monitoring unit 36 transmits a command to cancel the temporary car call registration to the elevator control panel 28 in order to prioritize the passenger conveyance operation by the elevator 10. Then, the registration of the temporary car call is canceled and the image variation data is reset (step 109), and the process returns to step 101.

If the elevator control monitoring unit 36 determines in step 108 that the call registration flag is not ON, the elevator control monitoring unit 36 determines whether or not the destination floor registered by the temporary car call has arrived (step 110).
In step 110, if the elevator control monitoring unit 36 determines that it has not arrived at the destination floor, it returns to step 105, and if it determines that it has arrived at the destination floor, it proceeds to step 111.
In step 111, the elevator control monitoring unit 36 resets the image fluctuation data (step 111), and returns to step 101. The elevator control panel 28 automatically cancels the temporary car call.

  If the image processing unit 32 determines in step 107 that the mask region setting condition is satisfied, the current (last extracted) composite variation region is set as the mask region used in the next in-car monitoring control and the image is displayed. The fluctuation data is reset (step 112), and the process returns to step 101.

  The operation flow of the elevator car monitoring device 30 described above is summarized as follows. The elevator control monitoring unit 36 does not register the hall call and the car call, and the person in the car 23 when the elevator door is fully closed. Is unattended and there is no elevator user, the temporary car call is registered and the car 23 is moved. Then, the image processing section 32 performs mask area setting control when the car 23 is moved by a temporary car call.

  In the mask area setting control performed after step 105, the image processing unit 32 compares the comparison source frame image obtained by combining the frame images acquired so far with the frame image acquired this time after the acquisition of the reference frame image. The so-called inter-frame difference method is used to extract the comparison source frame image into the fluctuation region of the frame image acquired this time, and obtain the combined fluctuation amount by superimposing the fluctuation regions extracted so far. . Note that the method for obtaining the image fluctuation region is not limited to the inter-frame difference method, and other methods may be used.

  Further, every time the fluctuation region is calculated, the image processing unit 32 calculates the increase amount of the synthetic fluctuation region extracted this time with respect to the previously extracted synthetic fluctuation region, and the increase amount of the synthetic fluctuation region is continuously repeated a predetermined number of times. When the value is equal to or less than a predetermined threshold, the latest combined fluctuation region is set as a mask region when performing in-car monitoring control. As a result, when the image processing unit 32 performs monitoring control in the car 23, the frame area is acquired from the output of the video camera 31 by accurately excluding the video area of the changing video camera 31 regardless of the passenger. Therefore, the situation in the car 23 can be accurately determined.

  As described above, according to the elevator car monitoring apparatus of the first embodiment, the elevator control and monitoring unit 36 has a temporary car in a situation where there is no car call or landing call and no passengers are in the car 23. The call is registered and the car 23 is moved, and the image processing unit 32 is configured to automatically perform mask area setting control for setting a mask area.

  Therefore, compared with the conventional method in which the mask area is manually set, it is possible to remarkably reduce the trouble for the maintenance person to set the mask area. Moreover, since mask area | region setting control is performed using the condition where there is no passenger of the elevator 10, the passenger who uses the elevator 10 is not inconvenienced.

Embodiment 2. FIG.
The elevator car monitoring apparatus according to Embodiment 2 of the present invention is configured in the same manner as the elevator car monitoring apparatus of Embodiment 1 except for some control operations.

  Next, prior to the description of the control operation of the elevator car monitoring apparatus according to the second embodiment of the present invention, the temporal change of the composite fluctuation region when the video camera 31 is displaced will be described.

  FIG. 7 is a diagram for explaining the temporal change of the composite fluctuation region when the video camera is displaced in the elevator car monitoring apparatus according to Embodiment 2 of the present invention.

  FIG. 7 shows changes in the variable region when the car 23 is moved from the first floor to the top floor, for example, as in FIG. 5 of the first embodiment. In FIG. 7, the process up to time (C) is the same as the description of FIG.

For example, at time (C), it is assumed that the amount of increase in the composite variation area satisfies a condition of continuing a predetermined number of times to be equal to or less than a predetermined threshold.
Immediately after the position of the video camera 31 is shifted, if the position of the video camera 31 is shifted by time (C) for some reason after the time (B) has elapsed, the shooting area of the video camera 31 is largely shifted. When the acquired frame image is compared with the comparison source frame image based on the frame image acquired before the position of the video camera 31 is shifted, a large change occurs. As a result, the amount of increase per unit time of the composite fluctuation region that has settled below the predetermined threshold value suddenly increases again at time (C).

Next, the operation of the elevator car monitoring apparatus according to Embodiment 2 of the present invention will be described.
FIG. 8 is a flowchart for explaining the operation of the elevator car monitoring apparatus according to Embodiment 2 of the present invention.
In FIG. 8, for convenience of explanation, steps 201 to 214 are described as S201 to S214.

  The configuration of the elevator car monitoring device according to the second embodiment is substantially the same as that of the elevator car monitoring device 30 according to the first embodiment. However, the image processing unit 32 is an elevator 10 in which an administrator is stationed. The communication room is communicable with a personal computer (not shown). The personal computer displays the received information from the image processing unit 32. Then, as will be described later, when the image processing unit 32 determines that the positional deviation of the video camera 31 has occurred, the image processing unit 32 notifies the personal computer of an abnormality occurrence signal for notifying that the positional deviation of the video camera 31 has occurred. It is supposed to send.

In FIG. 8, Step 201 to Step 211 are the same as Step 101 to Step 111, and thus description thereof is omitted.
In step 212, the image processing unit 32 sets the current composition variation area as a mask area.
In step 213, the image processing unit 32 determines whether or not a camera shift condition described below is satisfied.

  The camera deviation condition is that after the mask area setting condition is satisfied, in other words, after the increase amount of the composite fluctuation area recorded in the data storage unit 35 continuously falls below a predetermined threshold value for a predetermined number of times, the car 23 Satisfied when the amount of increase in the recorded composite variable area continues a predetermined number of times before landing on the destination floor corresponding to the temporary car call, and becomes greater than a predetermined abnormality judgment threshold value greater than a predetermined threshold value And

  It should be noted that the camera deviation condition is satisfied when the amount of increase in the composite fluctuation region continues to be greater than the abnormality determination threshold value for a predetermined number of times, but this is unexpected although the monitoring device itself is normal. When there is noise or the video of the video camera 31 is disturbed, it is possible to prevent erroneous determination that the video camera 31 has been displaced even though the video camera 31 has not been displaced. Is for.

  When countermeasures are taken against such a cause of erroneous determination, the camera deviation condition may be satisfied even when it exceeds the abnormality determination threshold even once.

If the image processing unit 32 determines in step 213 that the camera deviation condition is not satisfied, the process proceeds to step 208.
In step 213, when the image processing unit 32 determines that the camera displacement condition is satisfied, an error occurrence signal for notifying that the displacement of the video camera 31 has occurred is transmitted to the personal computer in the management room via the communication line. Transmit (step 214).

  According to the elevator car monitoring device 30 according to the second embodiment, the image processing unit 32 sets a new mask area during registration of the temporary car call, and then the car 23 responds to the temporary car call. It can be determined that the video camera 31 has deviated when the increase amount of the composite variation area becomes larger than a predetermined abnormality determination threshold value larger than a predetermined threshold value before landing on the destination floor.

Thereby, it is possible to prevent the in-car monitoring device 30 of the elevator from operating while erroneously grasping the situation in the car 23.
When the video camera 31 is displaced, an abnormality occurrence signal is transmitted to the management room via the communication line, so that the administrator can quickly respond to the malfunction of the video camera 31 and perform maintenance. Can be visited on site.

Embodiment 3 FIG.
The elevator car monitoring apparatus according to Embodiment 3 of the present invention is configured in the same manner as the elevator car monitoring apparatus of Embodiment 1 except for some control operations.

FIG. 9 is a flowchart for explaining the operation of the elevator car monitoring apparatus according to Embodiment 3 of the present invention.
In FIG. 9, steps 301 to 314 are denoted as S301 to S314 for convenience of explanation.

  In FIG. 9, the control from step 301 to step 313 is the same as that from step 201 to step 213, and thus the description thereof is omitted.

In step 314, the image processing unit 32 resets the image variation data including the composite variation region, and proceeds to step 308.
In step 309 and step 311, if the image variation data has already been reset, the image variation data reset operation is omitted.

  The image processing unit 32 determines in step 308 that the call registration flag is not ON, and in step 310 determines that the car 23 has not arrived at the destination floor, returns to step 305 to acquire a frame image, In step 306, the composite fluctuation region is obtained.

The composite variation area in this case is performed by setting a frame image acquired at a predetermined time as a new reference frame image among frame images acquired after determining the positional deviation of the video camera 31.
That is, steps 305 to 308 and 310 are repeated until the mask area setting condition is satisfied. In this case, the image processing unit 32, after setting a new reference frame image, every time the frame image is acquired at a predetermined interval, the fluctuation region is acquired as a frame image acquired so far after acquiring the new reference frame image. The amount of increase in the fluctuation area extracted this time with respect to the fluctuation area extracted last time is calculated and stored in the data storage unit 35.

  As described above, according to the elevator car monitoring apparatus 30 according to the third embodiment, when the image processing unit 32 determines that the positional deviation of the video camera 31 has occurred, the image fluctuation data including the composite fluctuation region. To reset. Furthermore, if the call registration flag remains OFF and the arrival floor is not reached, the image processing unit 32 newly sets the reference frame image and sets the mask area without changing the temporary car call registration. Control is to be continued.

  That is, the image processing unit 32 obtains a new reference frame image, and when the increase amount of the variable region calculated every time the frame image is acquired is equal to or less than a predetermined threshold value for a predetermined number of times, A combined variation region obtained by superimposing the variation regions extracted so far after learning the reference frame image is set as a mask region.

  At this time, when the mileage of the car 23 to the destination floor registered by the temporary car call is short, the elevator control monitoring unit 36 once deletes the registration of the temporary car call, and performs the same procedure as step 104. A temporary car call may be registered to set a new destination floor.

Here, assuming that the positional deviation of the video camera 31 has occurred, by setting the mask area as described above based on the newly set reference frame image and the frame image acquired thereafter, the position A mask area to be removed by image processing is appropriately set in order to determine a passenger with respect to a video image taken by the video camera 31 in which the deviation has occurred.
Therefore, even after the video camera 31 is displaced, the elevator car monitoring device 30 controls the setting of the mask area, so that even when the video camera 31 is displaced, the elevator car monitoring device 30 The state in the car 23, such as the presence or absence of passengers, can be accurately grasped.

Embodiment 4 FIG.
FIG. 10 is a flowchart for explaining the operation of the elevator car monitoring apparatus according to Embodiment 4 of the present invention.
In FIG. 10, for convenience of explanation, steps 401 to 412 are described as S401 to S412.

The configuration of the elevator car monitoring device according to the fourth embodiment is the same as that of the first embodiment, and a description thereof will be omitted.
In FIG. 10, the operations from step 401 to step 411 are the same as those from step 101 to step 111, and thus the description thereof is omitted.

  In step 412, the image processing unit 32 cancels the registration of the temporary car call, sets the current range of the combined variation area as the mask region, resets the image variation data, and returns to step 401.

In the elevator car monitoring apparatus 30 according to the fourth embodiment, after the image processing unit 32 sets the mask area, there is no car call or landing call again, and there is no passenger in the car 23. The control monitoring unit 36 registers a temporary car call.
That is, the image processing unit 32 performs mask area setting control every time a temporary car call is registered, and periodically resets the mask area.

Here, for example, when sunlight is inserted into the car 23 through the window portion 25a, the incident direction of sunlight is changed according to time.
For this reason, since the area | region in the cage | basket | car which sunlight inserts changes with time, the position of the sunlight reflected in the video camera 31 changes.

  In the fourth embodiment, since the mask area is periodically reset, an appropriate mask area is changed over time by, for example, changing a portion irradiated with sunlight in the car 23 over time. Even in the case of fluctuation, the mask area suitable for the current situation in the car 23 is set in the car monitoring control by the image processing unit 32. Since the elevator car monitoring device 30 analyzes only the image processing target area excluding the mask area from the frame image acquired from the video camera 31, it accurately detects the passenger state without erroneously detecting the passenger. be able to.

  DESCRIPTION OF SYMBOLS 1 Elevator system, 10 Elevator, 11 Hoistway, 23 Car, 28 Elevator control panel (elevator control part), 30 Elevator car monitoring apparatus, 31 Image | photographing means, 32 Image processing part, 35 Data storage part, 36 Elevator control monitoring Department.

Claims (4)

Acquire a frame image in the elevator car having an elevator control unit that controls the raising and lowering of the car according to a car, a car call and a hall call provided with a hoistway so that the hoistway is freely movable. An elevator in-car monitoring device that obtains information in the car based on a change in the image processing target area, divided into a predetermined mask area to be removed from the processing target and a remaining image processing target area,
Photographing means for photographing the inside of the basket;
An image processing unit for processing an image in the car output by the photographing means;
A data storage unit for storing the result of image processing by the image processing unit;
An elevator control monitoring unit for determining a situation in which registration of the car call and the landing call has been canceled and no passengers are in the car, and registering a temporary car call;
The image processing unit is configured to perform mask area setting control when the temporary car call is registered,
The image processing unit, as the mask area setting control,
During the movement of the car in response to the temporary car call, the frame images are sequentially acquired from the output of the photographing means, the frame images acquired at a predetermined time are set as reference frame images, and the reference frame image After the setting, every time the frame image is acquired at a predetermined interval, the image obtained by superimposing the frame images acquired so far after acquiring the reference frame image is different from the reference frame image. Extract a certain fluctuation region based on the frame image acquired so far, calculate the increase amount of the synthesis fluctuation region extracted this time relative to the previously extracted synthesis fluctuation region, and store it in the data storage unit,
An elevator car monitoring device that performs control to set the last extracted combined fluctuation region as the mask region when the calculated increase amount is equal to or less than a predetermined threshold value continuously for a predetermined number of times. The image processing unit is calculated by the time the car reaches the destination floor corresponding to the temporary car call after the calculated increase amount is continuously equal to or less than the predetermined threshold value for a predetermined number of times. 2. The elevator according to claim 1, wherein when the increase amount is greater than a predetermined abnormality determination threshold value that is greater than the predetermined threshold value continuously for a predetermined number of times, it is determined that the position of the photographing unit has shifted. In-car monitoring device. When the image processing unit determines that the position of the photographing unit has shifted,
The composite variation area is reset, and the frame image acquired at a predetermined time is set as a new reference frame image among the frame images acquired after determining the positional deviation of the photographing unit, and the new After setting the reference frame image, each time the frame image is acquired at a predetermined interval, the new reference frame image is acquired and then the new frame image acquired so far is superimposed on the new frame image. The composition variation area that is different from the reference frame image is extracted based on the frame image acquired so far after acquiring the new reference frame image, and the composition composition extracted this time with respect to the previously extracted composition variation area Calculate the amount of increase in the variable region and store it in the data storage unit,
3. The combined fluctuation area extracted last is set as the mask area when the calculated increase amount is equal to or less than a predetermined threshold continuously for a predetermined number of times. Elevator car monitoring device. The elevator control monitoring unit determines whether the registration of the car call and the landing call has been canceled and there are no passengers in the car, and periodically registers the temporary car call.
The elevator car monitoring apparatus according to any one of claims 1 to 3, wherein the image processing unit performs the mask area setting control each time the temporary car call is registered. .

Images