JP3287382B2 - Camera control system and method - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a camera control system and method , and more particularly, to a camera control system and a camera control system for remotely controlling one or more cameras by one or more persons.
And method .

[0002]

2. Description of the Related Art By arranging a large number of cameras and computers in a building and connecting them to a network, it is possible to transmit video or interact with video and voice between any two points (or between three or more points). Video transmission systems have been proposed. For example, use as a video conference system or a remote monitoring system is considered. For this purpose, a camera whose camera direction and zoom can be externally controlled is also commercially available. In such an image transmission system, any other camera can be remotely operated from an arbitrary point and / or an image of any camera can be displayed on its own computer screen.

[0003] In a video transmission system that enables remote control of an arbitrary camera, it is particularly necessary to easily know where each camera is installed as the number of cameras to be operated increases. A method of superimposing and displaying a camera symbol indicating each camera on a map image indicating its installation location has already been proposed by the present applicant. The applicant has also proposed a configuration in which the orientation of each camera is displayed by the orientation of the camera symbol.

[0004]

Considering further improvements in such a camera control system, there are the following problems. That is, any user using the system is free to
You can remotely control a camera connected to another host and view its video. However, for a person who is in a photographable range of a remotely controlled camera, the situation is as if being monitored, which may give a strong discomfort.

[0005] It is an object of the present invention to solve such a problem and to provide a camera control system and method in consideration of privacy protection.

That is, the present invention provides a camera control system and a camera control system which can set a range where each camera cannot shoot, that is, a shooting non-permission range, and make it impossible to physically or substantially shoot the shooting non-permission range by remote control. The purpose is to present a method .

It is another object of the present invention to provide a camera control system and a method for enabling a remote operator to easily recognize a non-capturing area of each camera to be remotely controlled.

[0008]

According to the present invention, an area not desired to be photographed can be set on a map displayed by the map display means. That is, it is possible to freely set the photographing non-permission area with a very simple operation. The set photographing non-permission area is not photographed by the designated camera or any camera, so that privacy can be protected.

According to the present invention, remote control of a photographing direction and a zoom magnification for photographing even a part of a photographing non-permission area set by a user is prohibited, or a photographing non-permission area is photographed even partially. The display of camera images has been virtually prohibited. Thus, it is possible to prevent a part of the set photographing non-permission area from being photographed and displayed as an image. By notifying the user that the operation of the camera and the display of the image are restricted by the set non-capturing area, the user can clearly understand the reason for the restriction of the camera control and the display of the image and avoid unnecessary confusion. be able to.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings.

FIG. 1 is a schematic block diagram of a video communication terminal device, which is a basic element in one embodiment of the present invention, that is, a computer system to which a plurality of camera devices are connected. One or more computers having the configuration shown in FIG. 1 and / or one or more computers having a similar configuration are interconnected via a computer network.

In FIG. 1, 10 (10-1, 10-
2, 10-3,...) Are video cameras and 12 (12
-1, 12-2, 12-3,...) Are pan, tilt, zoom, focus adjustment, and aperture of the video camera 10 (10-1, 10-2, 10-3,...). A camera control circuit 14, which directly controls the video camera 10 according to an external control signal, controls which video camera 10 and outputs its video signal (usually a video signal, but in the case of a camera with a microphone, the video signal and the audio signal are used). The camera input selection device selects whether or not to take in a video signal. The control signal line includes, for example, RS-232C, but it is apparent that the present invention is not limited to this.

Reference numeral 20 denotes a video camera 10 attached to the camera control circuit 12 by sending a control command to a desired camera control circuit 12 via the camera input selection device 14.
And a video communication terminal device that transmits video from a selected camera to a network and receives video from the network. 22 is a CPU for controlling the whole, 24
Is a main memory, 26 is a secondary storage device (for example, a hard disk device), 28 is a mouse as a pointing device, and 30 is a keyboard.

32 connects the camera input selection device 14;
An I / O port 34 for supplying a camera control command or the like to the camera input selecting device 14, an input / output port 34 for taking in an output video signal of the video camera 10 selected by the camera input selecting device 14, and displaying various images on a bitmap display 35. , A network interface for connecting the video communication terminal device 20 to a computer network or a communication network,
Are the CPU 22 to the network interface 3
6 is a system bus for interconnecting the respective devices. With the network interface 36, a camera control signal can be sent to the video communication terminal device 20 from a remote place via a network to control the camera 10.

The camera input selecting device 14 controls one of the control signal lines connected to the plurality of camera control circuits 12 and the video output.
And select the video output from the video board 3
4, and logically connects the selected control signal line to the I / O port 32. As a format of the video signal, for example, there is an NTSC signal of a luminance / chrominance separation type. Video board 34 captures the video output selected by camera input selection device 14. The captured video signal is displayed as a moving image in a predetermined window of the bitmap display 35 and / or transmitted to another.

The secondary storage device 26 has a camera 10
And various information relating to other cameras connected via the network, such as camera position information data and camera graphic data. Details of such information will be described later.

When only one camera 10 is connected, the camera input selection device 14 is unnecessary, and the camera control circuit 12 is directly connected to the I / O port 32. Also,
When the video is not transmitted, the camera 10, the camera control circuit 12, and the camera input selection device 14 become unnecessary.

The device shown in FIG. 1 is connected to a network as a communication terminal, for example, as shown in FIG. It is not necessary that all communication terminals have the same configuration as shown in FIG. For example, there may be a communication terminal to which only one camera is connected, or a terminal to which one camera is not connected (that is, a remote control of a camera to be connected to another terminal to merely display the image thereof). Terminal having a function). Generally, communication terminals having such various configurations are mixed in one network. The network used in the present embodiment is an LA having a transmission bandwidth sufficient to transmit digital video data and a camera control signal.
N or WAN is assumed. Normally, moving image data is transmitted after being compressed. However, in this embodiment, since various existing methods can be used as the moving image compression method, detailed description is omitted.

The video board 34 has a video capture function as described above, and not only supplies the captured video data to the bitmap display 35 to display the video but also displays the video data via the bus 38. CPU2
2 is also supplied. The CPU 22 packetizes the video data and outputs the packetized data to the network via the network interface 36. From the network interface 36, a camera operation command, a camera switching command, and the like are also packetized and transmitted to the network.
Further, information on the entire system is also packetized and transmitted to the network. These pieces of information are transmitted to the specified terminal or all terminals depending on the content of data to be transmitted and the necessity.

The same applies to reception. That is,
Upon receiving the packetized video data and the camera operation command and the camera switching command, each video communication terminal device 20 treats the received video data in the same manner as internal capture data, and receives the received camera operation command and The camera switching command is handled in the same way as the internal similar command.
Information about the entire system is used for updating a system display of a user interface described later.

FIG. 3 is a block diagram showing the software configuration of the present embodiment. In FIG. 3, a plurality of video communication terminals 20 and a camera management server 50 are connected to a computer network 52. The video communication terminal device 20 includes a camera control signal for controlling the camera 10 in accordance with a camera control signal input by the own terminal or transmitted from another terminal (including a selection signal when a plurality of cameras are connected). A server 54, a camera control client 56 for remotely controlling the camera 10 of the own terminal or another terminal, and a camera 10 of the own terminal.
Is transmitted to the other terminal via the network 52 and the video transmission / reception software 58 which supplies the video transferred from the other terminal via the network 52 and the image of the camera 10 of the own terminal to the display 35 of the own terminal Installed.

The camera management server 50 is connected to the network 5
2 is software that manages all the cameras 10 released (or connected), and holds information such as the camera name, host name, installation position, and current state of each camera. The camera management server 50 not only manages registration of a camera that is newly available via the network 52 and erasure due to separation from the network 52, but also stores management information of each camera in all camera control clients. Notify 56 periodically and on request. Camera management server 50
May be stored in any one terminal connected to the network 52.

The camera control client 56 superimposes the positions and directions of all cameras available via the camera 10 of the terminal and the network 52 on a map by using a predetermined camera symbol on the screen of the display 35 of the terminal. Display above. The camera control client 56 also
The display state of each camera symbol is updated in real time based on the camera information periodically sent from the camera management server 50.

FIG. 4 shows an example of a camera display control panel displayed on the display 35 by the camera control client 56. Reference numeral 60 denotes a map window that superimposes and displays camera icons indicating the installation positions and directions of the cameras on a map indicating the installation locations of the operable cameras. 6
Reference numeral 2 denotes a camera image window that displays an image of one selected camera. Reference numeral 64 denotes a camera operation panel that includes various camera control buttons and operates pan, tilt, and zoom of the selected camera. In this embodiment, it is assumed that a window display system that can simultaneously display a plurality of windows is operating.

In the map window 60, a map showing the seat arrangement of the office is displayed, and on the map, a camera icon 66 showing an arrangement position of each camera arranged in the office is displayed. Each camera icon 66 is displayed in a position corresponding to the installation location of the camera indicated by the camera icon 66 in substantially the same direction as the current camera direction. The camera icons 66 are displayed in different colors so that cameras selected for video display or remote control, cameras used by other users, and cameras used by no one can be distinguished from each other. Is displayed with.

An operation panel 64 is displayed below the camera image window 62. The operation panel 64 includes a rotation operation button for pan and tilt and two buttons for zoom operation. By operating these buttons, it is possible to rotate and zoom an arbitrarily designated camera. When the selected camera is inoperable (for example, when the camera is already operated by another user), the display mode is such that both the rotation operation button and the zoom operation button are inoperable.

For example, when a user wants to access a certain camera (here, remote control), the user double-clicks a camera icon indicating a target camera. In response to this, the camera control client 56 requests the camera management server 50 for the operation right of the camera, and the camera management server 50 determines whether the operation right of the camera It is checked whether or not the user has been set, and if the operation right of the camera has not been granted to another user, remote operation of the camera (obviously including display of an image) is permitted. ,
Otherwise, the operation right is rejected. When the operation right is granted, the output image of the camera is displayed in the camera image window 62, and the operation (pan,
Tilt and zoom).

On the lower side of the operation panel 64, a setting button 68 for setting a non-capturing area and a clear button 70 for canceling the set non-capturing area are displayed. In this embodiment,
As described above, in a camera control system in which an arbitrary camera can be remotely operated in the entire physically operable range, a non-capturing area in which photographing is not allowed can be set.
For a camera in which a non-capturing area has been set, remote operation via a network cannot control the direction of the camera in such a direction as to capture the non-capturing area.

First, the setting processing of the photographing non-permission area in this embodiment will be described in detail.

The user sets a photographing non-permission area setting button 68
When is clicked, the camera control client 56 draws vertical and horizontal lines on the map window 60 as shown in FIG. The area divided by these vertical and horizontal lines is the unit of setting of the non-capturing area. The user can use the map window 60
In the above, one or a plurality of divided areas not to be photographed are designated. Specified divided area (for example, area 92 in FIG. 5)
Is displayed, for example, in red, so as to stand out as compared with the other divided areas. When a desired divided area is selected as a photographing non-permission area, a mouse button is double-clicked on any of the selected divided areas. As a result, a shooting non-permission area is set. When the user wants to eliminate the photographing non-permission area, the clear button 70 may be clicked with the mouse.

When the photographing non-permission area is set or changed,
This is notified to the camera management server 50, and the shooting direction of the camera that includes the set or changed shooting prohibited area in the shooting range is changed so as not to shoot the shooting disabled area. The direction of the corresponding camera icon 66 is similarly changed. That is, the camera control client 56 operating on the communication terminal device 20 in which the shooting non-permission area has been set, notifies the camera management server 50 of the fact that the shooting non-permission area has been set and the coordinate information of the set shooting non-permission area. Notice.

FIG. 6 is a basic flowchart of the camera management server 50 for setting and changing the photographing non-permission area. The camera management server 50 acquires the coordinate information (the coordinates of the diagonal point of the rectangle) of the set photographing non-permission area (S
1) Search for a camera that is included in the current shooting range even in a part of the set shooting non-permission area. A camera control command for changing the shooting direction to a direction in which the shooting non-permission area is out of the shooting range is issued to the corresponding camera, and the shooting direction of the camera is changed (S2). For the camera whose shooting direction has been changed in this way, the camera management server 5
0 notifies the new camera direction to the all camera control client 56, and updates the direction of the corresponding camera icon 66 on the map window 60 (S3).

FIG. 7 shows a detailed flowchart of S2 in FIG. First, a camera whose shooting direction is to be changed and a camera whose rotatable range of the camera is to be changed are selected (S1).
1). Here, it is assumed that only the camera of the own station that is locally connected to the host in which the shooting non-permission area is set is targeted, and the camera management server 50 selects the camera with reference to the host information of each camera ( S11).

Next, the photographing direction and the rotatable range are changed for each selected camera. That is, as shown in FIG. 8, for the camera i of interest (the zoom lens is set to the tele side) among the cameras selected in S11, the camera i The imaging non-permission direction θd (d <
θd <D) is calculated (S13). The camera control of the camera i is temporarily locked to prevent the user from operating the camera until the update of the camera i is completed (S
14), from the camera state table described later and the photographing non-permission direction obtained in S13, the photographing non-permission direction is set to the camera i.
The camera control command for changing the range in which the pan operation of the camera i can be performed so that the camera does not face the camera, and changing the shooting direction so as not to be the shooting non-permission direction when the camera i is currently facing the shooting non-permission direction. The data is transmitted to the camera control server 54 (S15). Details of this change processing will be described later. After completing the necessary change processing, the camera control lock of the camera i is released (S16).

For all the cameras selected in S11,
The processing of S13 to S15 is executed (S17, 18).

FIG. 9 shows an example of a camera status table for storing fixed information and current information of each camera. Camera number, camera name, host name, camera installation position coordinates on the map, initial direction at startup, panable direction θp (p <θ
p <P) and information such as the current direction. The panable direction is represented by an angle from the x direction (horizontal direction), similarly to d and D.

The camera management server 50 constantly checks the camera status table and monitors each camera so that it does not rotate beyond its panable range. Further, the camera management server 50 periodically sends the contents of the camera status table to the camera control client 56. The camera control client 56 updates the direction of the camera icon 66 on the map window 60 displayed on the display 35 based on information from the camera management server 50.

The following five cases can be classified according to the relationship between the panning possible direction θp (a <θp <A) and the photographing non-permitted direction θd (d <θd <D).

In case 1, as shown in FIG.
>D> d or a <A <d <D, and the panable direction and the photographing non-permission direction do not overlap at all.

In case 2, as shown in FIG. 11, d <a
<D <A, and a part of the shooting non-permission direction overlaps the panning possible direction.

In case 3, as shown in FIG. 12, a <d
<D <A, and this is a case where the shooting non-permission direction is included in all the panning directions.

In case 4, as shown in FIG. 13, a <d
<A <D, and a case where a part of the photographing non-permission direction overlaps the panning possible direction.

In case 5, as shown in FIG. 14, d <a
<A <D, and the panable direction is included in all the photographing non-permission directions.

FIG. 15 shows the details of S15 of FIG. The camera state table and the shooting direction are changed as follows according to these five cases. Here, the current direction of the camera of interest is N.

In case 1 (S21), nothing is changed since the shooting non-permission direction and the panning direction do not overlap (S22).

In case 5 (S21), since all panning directions are included in the shooting non-permission directions, the control and display of this camera are all turned off (S23).

In case 2 (S21), the current camera orientation N is checked (S24), and if a <N <D (S2
5) Since the camera is currently facing the direction in which photography is not permitted, it is necessary to change the direction of the camera. Therefore,
The angle D deviating from the non-capturing direction is substituted for the information of the current camera direction N in the camera state table, and the angle D is substituted for the end a of the panning direction (S26). Issue a panning command (S2
7).

The case 3 and the case 4 are basically the same as the case 2 except that the panning direction is changed so as not to include the photographing non-permission direction, and the camera facing the photographing non-permission direction is photographed. The photographing direction is changed so as not to face the non-permission direction (S28 to S34).

In the above embodiment, the non-shooting area is selected from the equally divided areas on the map. However, a rectangle drawn to an arbitrary size on the map by dragging the mouse is selected. Obviously, the area may be a non-capturing area. In this way, each user can set a photographing non-permission area of an arbitrary size.

In the above embodiment, only the camera connected to the local host is set as the camera that changes the panning direction or the shooting direction after setting the shooting non-permission area, and the direction of the camera of the own station is restricted. It is possible to add. As a result, it is impossible for another user to remotely control the camera of the own station in the direction of the area set as the photographing non-permission area. However, with a local camera alone, the number of camera operations that can be restricted is limited. In a situation where there are a large number of cameras, even if a non-capturing area is set, the non-capturing area is set to another host. It may be possible to take a picture from another camera. Further, there may be a case where it is desired to restrict the operation of a certain camera from another host instead of the local host.

Such a problem or demand is extended so that a camera connected to another host is also targeted for a camera that changes a panning direction or a shooting direction by setting (or changing) a shooting non-permission area. Can be solved. That is, the following is performed.

A camera access permission host is predetermined for each camera. For example, an authorized host information file as shown in FIG. 16 is provided. For example, when a shooting non-permission area is set on the map of the host 1, all cameras connected to all hosts permitted to perform remote operation by the host 1 from the permitted host information file are changed. . Of course, if all the host names are set for a certain camera, it is possible to prohibit any camera from being directed to the shooting non-permission setting area. In this case, the non-shooting area is
Never photographed.

It is not necessary to select the photographing non-permission area from the equally divided areas on the map. For example, FIG.
As shown in (1), several areas of an arbitrary size that may be set as non-capturing areas are set in advance, their positional information is stored, and setting (change) of non-capturing areas is performed.
At times, those areas may be displayed on a map so that they can be arbitrarily selected. This makes it possible to distinguish between an area that can be set as a shooting non-permission area and an area that cannot be set as an imaging non-permission area according to the user. For example, if a common place having a strong public meaning is not set as a candidate for a shooting non-permission area, it cannot be set as a shooting non-permission area when setting (changing) the shooting non-permission area.

A camera (or host) whose operation is restricted by the non-capturing area may be limited for each non-capturing area. In such a case, as shown in FIG. 18, a file for connecting the target camera is provided for each set photographing non-permission area. In FIG. 18, if the area 1 is selected as the photographing non-permission area, the cameras 1, 2, 3, and 5 become the cameras whose pan is restricted.

In the embodiment described above, the general user can freely set and cancel the photographing non-permission area. However, it is needless to say that these operations may be permitted only to a specific manager. Absent. For example, a system administrator or
A direct manager of the target camera (for example, a user of the video communication terminal device connected to the camera) can set a shooting non-permission area for each camera under management, and can change and cancel the setting. The user cannot set the shooting non-permission area for cameras that he does not manage,
The set photographing non-permission area may not be changed or canceled.

Further, in the above embodiment, the user was able to prohibit the camera from facing the non-capturing area, but it is not possible to prevent the set non-permission area from being partially photographed. For example, if the viewing angle of the camera is wide, even if the shooting direction is out of the shooting non-permission direction range, the camera image may include an image in the range set as the shooting non-permission area. Of course, the viewing angle greatly changes depending on the zoom magnification at that time, so it is possible to shoot a very wide range even if the camera is facing the same direction, or to zoom in on a narrow range and shoot The shooting non-permission area set in advance may or may not be partially included in the shooting range.

In consideration of the natural operation of the user, it is common to consider that the user does not want to take a partial image of the non-capturing area set by the user, and it is desired to control the camera to realize this.

Therefore, in a modified embodiment described below,
Prohibit remote control of the shooting direction and zoom magnification such that even a part of the shooting non-permission area set by the user is shot,
Alternatively, the display of a camera image obtained by partially photographing the non-capturing area is substantially prohibited. The details will be described below.

First, regarding the setting of the photographing non-permission area,
This is the same as described above with reference to FIG. When the setting of the photographing non-permission area is changed, the camera management server 50 is notified of the change, and for a camera including even a part of the set photographing non-permission area in the photographing range, the photographing non-permission area is set to the photographing non-permission area. The photographing direction and the photographing magnification are changed so as not to overlap, and photographing (or not displaying images) of even a part of the photographing non-permission area is restricted, and camera control and image display are restricted. As in the previous embodiment, when the shooting direction is changed, the direction of the corresponding camera icon 66 on the map window 60 is also changed. That is, the communication terminal device 2 in which the photographing non-permission area is set
The camera control client 56 operating at 0 notifies the camera management server 50 that the setting of the shooting non-permission area has been changed and the coordinate information of the changed shooting non-permission area.

FIG. 19 is a basic flowchart of the camera management server 50 for changing the setting of the photographing non-permission area. The camera management server 50 acquires the coordinate information (the coordinates of the diagonal point of the rectangle) of the set photographing non-permission area (S10).
1) Search for a camera that is included in the current shooting range even in a part of the set shooting non-permission area. A camera control command for changing the shooting direction and / or the zoom magnification is issued to the corresponding camera so that the shooting non-permission area is out of the shooting range, and the shooting direction and / or the zoom magnification of the camera is changed (S102). ). Thus, the shooting direction and / or
Alternatively, for a camera whose zoom magnification has been changed, the camera management server 50 also notifies a new photographing direction and / or zoom magnification value to the all camera control client 56, and displays a map window 60 for the camera whose photographing direction has been changed.
The direction of the corresponding camera icon 66 is updated (S103).

FIG. 20 is a detailed flowchart of S102 in FIG. First, a camera whose shooting direction or zoom magnification is to be changed is selected (S111). Here, it is assumed that only the camera of the own station that is locally connected to the host in which the shooting non-permission area is set is targeted, and the camera management server 50 selects the camera with reference to the host information of each camera ( S111). As another method of selecting a target camera, for example, a host that is permitted to access in advance is determined for each camera, and an access from a host in which a camera control client that has set (changed) a shooting non-permission area exists in advance. Only the permitted cameras may be set as target cameras.

Next, for each selected camera, the photographing direction, the zoom magnification value, and the remote controllable range thereof are changed. That is, as shown in FIG. 21, the shooting non-permission direction range θd (d <θd) of the camera i of interest, out of the cameras selected in S111, based on the installation position and the coordinates of the shooting non-permission area, as shown in FIG. <D) is calculated (S113). The camera control of the camera i is temporarily locked to prevent the user from operating the camera until the update of the camera i is completed (S114). At this time, if there is a host that has acquired the control right of the target camera, the camera management server 50 notifies the host of a message indicating that the lock is being performed.

Camera status table and S113 to be described later
The camera control command for changing the shooting direction and / or the zoom magnification of the camera i from the shooting non-permission direction obtained in the step so that the shooting range of the camera i is not partly included in the shooting non-permission direction range. The data is transmitted to the control server 54 (S115). Details of this change processing will be described later. After completing the necessary change processing, the camera control lock of the camera i is released (S116).

The processes of S113 to S115 are executed for all the cameras selected in S111 (S117, S117).
S118).

FIG. 22 shows an example of a camera status table for storing fixed information and variable information of each camera. FIG. 22A is a camera status table for fixed information, and FIG. 22B is a camera status table for storing the current value of variable information.

The camera information table shown in FIG. 22A includes a camera number, a camera name, a host name, coordinates of a camera installation position on a map, an initial direction at the time of starting, a maximum zoom magnification, and a maximum viewing angle (minimum zoom magnification). Angle of view)
And a panable direction θp indicating a range in which a pan operation is possible.
(P <θp <P). θp, p and P are d, D
Similarly to the above, it is represented by an angle from the x direction (horizontal direction).

The camera status table shown in FIG. 22B includes a camera number, a current zoom magnification, and a current visual field angle (this is a table of the correspondence between the zoom magnification and the visual field angle at any time. The current imaging direction and the imaging range θa (a <θa <A) where the image is currently being captured are obtained. The shooting range θa is
It can be calculated from the image viewing angle and the current shooting direction. FIG.
As shown in FIG. 3, if the visual field angle is α and the current shooting direction is Φ, a = Φ−α / 2 A = Φ + α / 2. a and A are in the x direction (horizontal direction), similarly to d and D.
It is represented by the angle from

The turtle operation request is issued to the camera control client 5
6, the camera management server 50 sends
The camera state table shown in FIG. 22 is checked, and monitoring is performed so that the current photographing range θa of the camera does not include any part of the photographing non-permission direction range θd. If there is no overlap between the photographing range θa and the photographing non-permission direction range θd, a camera operation request is transmitted to the camera control server 54 of the camera to execute camera control, and the content of the camera state table is also updated. If the overlap occurs, the command transmission of the camera to the camera control server 54 is stopped at that time, so that further camera operation is not performed. When prohibiting the camera operation, the host that has acquired the camera control right is notified of a message indicating that the camera operation is prohibited in order to capture a part of the non-capable area, and the host displays the message. Display that message above. As a result, the user can understand that the currently operated camera cannot be operated due to a conflict with the setting of the non-capturing area.

FIG. 24 is a detailed flowchart of S115 in FIG. First, the relationship between the current photographing range θa (a, A) obtained from the camera state table and the photographing non-permitted direction range θd (d, D) is checked (S121). Exit without making any changes. If there is an overlap (S122), it is checked whether the zoom magnification is the maximum (S123).

If the zoom magnification is not the maximum (S12
3) Maximize the zoom magnification and return to S121 (S1)
24). In S124, the camera management server 50 sends a camera control command instructing to maximize the zoom magnification to the corresponding camera control server 54, and actually changes the zoom magnification to the maximum. At the same time, the camera management server 50
Updates the content of the camera state table by maximizing the zoom magnification of the camera state table, calculating the photographing range θa from the image viewing angle and the current photographing direction.

If the zoom magnification is the maximum (S123),
It is checked whether or not the camera can be panned in a direction that does not project the non-capturing area (S125). More specifically, it is checked whether the camera can be panned until one side of the boundary between the two areas exactly overlaps as shown in FIG. If panning is possible (S125), the camera management server 50 transmits a pan command for instructing panning of the camera to the corresponding camera control server 54, and at the same time, updates the contents of the camera status table and updates each camera control client. The direction of the corresponding camera icon on the map window displayed by 56 is also updated (S126). If it is determined that panning is not possible (S125), both image display and control of the camera are prohibited.

As described above, when the set photographing non-permission area is partially included in the photographing range, the control of the photographing direction and the photographing magnification is controlled so that the photographing non-permission area is not photographed at all. Even if the permitted area is partially, it is possible to prevent the image from being photographed and displayed. If at least a part of the non-capturing area is photographed due to restrictions on the photographing direction and the zoom magnification, setting of the non-capturing area is substantially prohibited by prohibiting both camera control and image display. Becomes effective.

In the control as shown in FIG. 24, after the execution of S127, no control is possible for the camera unless the related non-capturing area is eliminated. Further, when the photographing non-permission direction range and the photographing range overlap, panning in a direction in which the overlapping of both ranges increases even temporarily is not allowed. For example, in the situation shown in FIG. 26, panning cannot be performed in an angle direction smaller than the photographing non-permission angle d. If the non-capturing area is not set, panning is possible in an angle direction smaller than the non-capturing angle d.

Such a problem can be solved by the following. That is, if the shooting-disallowed direction area partially overlaps with the shooting range, or if the shooting-disallowed direction area is completely included in the shooting range but overlaps, only display of the image of the camera is prohibited. Allow camera operation. Specifically, the camera management server 50 controls the video transmission / reception software 58 of the corresponding camera not to transmit the camera video, and the camera control server 54 transmits the camera operation command from the camera control client 56 as usual. Make it acceptable. At this time, "62" is displayed in the video display window instead of the camera video.
Do'nt Disturb ”
Displays the host name that specifies the non-capturing area. This allows the user to understand that the video being displayed is displayed because the camera currently being operated is oriented in the direction of capturing the non-capturable area. Of course, when the non-shooting direction range and the shooting range no longer overlap,
Resume display of camera image.

When the photographing non-permission direction range and the photographing range partially overlap with each other, or one of them includes the other, the image in the photographing non-permission direction range is hidden from the photographing range image by the image processing, so that the photographing non-permission is not possible. Only the image excluding the image in the permitted direction may be displayed. Such image processing is
Easy.

A camera icon superimposed on a map may be used as a means for notifying the user that the currently operated camera does not display the image because the shooting range includes the shooting non-permission direction in the shooting range. good. An example is shown in FIG. It is assumed that the camera icon displayed on the map is displayed so as to be superimposed on a figure (an isosceles triangle) indicating the shooting range of the camera with reference to the camera state table. The vertex angle of the isosceles triangle indicating the shooting range indicates the shooting range θa (a, A), and the length of the equal side on both sides indicates the zoom magnification. That is, the higher the zoom magnification, the higher the height of the isosceles triangle. When the photographing area overlaps the photographing non-permission direction range, the isosceles triangle is changed to a color (for example, black) meaning that no image is displayed. At the same time, the related non-capturing area is also displayed on the map.

In order for the user to intuitively grasp the relationship between the set photographing non-permission area and the photographing range, as shown in FIG. 28, the photographing icon is not displayed on the camera icon of the camera currently operated on the map. What is necessary is just to display the permitted direction range and the photographing range in a superimposed manner. In this way, the user can predict in which direction the camera should be panned or zoomed so that the non-capturing area overlaps the capturing range and the camera cannot be controlled.

[0078]

As can be easily understood from the above description, according to the present invention, it is possible to set an imaging non-permission area on a map indicating the arrangement of cameras, where the imaging is not permitted by the camera. In other words, privacy can be protected. In addition, the operation for that can be performed with an easy-to-understand interface.

Further, according to the present invention, the user can specify an area not to be imaged by the camera on the map indicating the arrangement of the camera, and control camera control so that the area is not imaged, thereby improving privacy protection. I do. More specifically, when the shooting non-permission direction of the camera and the shooting range overlap, the camera operation such as panning and zooming of the camera cannot be performed any more, or the image is not displayed even if the camera operation can be performed. .

Further, since means for notifying the user that the operation and display of the camera are restricted by the photographing non-permission area is provided, the user can clearly understand the reason why the display and operation of the target camera cannot be performed. And avoid unnecessary confusion.

Further, by displaying the photographing non-permission direction and the photographing direction of the camera under control superimposed on the camera icon on the map, it is possible to intuitively recognize the relationship between the two and to improve the operability. .

[Brief description of the drawings]

FIG. 1 is a schematic block diagram of a basic configuration of a computer system according to an embodiment of the present invention.

FIG. 2 is a schematic block diagram of a hardware configuration of the embodiment in a network.

FIG. 3 is a schematic block diagram of a software configuration of the embodiment in a network.

FIG. 4 is an example of a camera display control panel displayed on a display 35 by a camera control client 56;

FIG. 5 is an explanatory diagram of setting of a photographing non-permission area.

FIG. 6 is a flowchart of a basic operation of the camera management server 50 for setting a shooting non-permission area.

FIG. 7 is a detailed flowchart of S2 in FIG. 6;

FIG. 8 is a schematic diagram showing a correspondence between a photographing non-permission area and a photographing non-permission direction.

FIG. 9 is an example of a camera status table.

FIG. 10 is a schematic diagram showing a relationship between a panning possible direction and a photographing non-permission direction in case 1;

FIG. 11 is a schematic diagram showing a relationship between a panning possible direction and a photographing non-permission direction in case 2;

FIG. 12 is a schematic diagram showing a relationship between a panning possible direction and a photographing non-permission direction in case 3;

FIG. 13 is a schematic diagram showing a relationship between a panning possible direction and a photographing non-permission direction in case 4.

FIG. 14 is a schematic diagram showing a relationship between a panning possible direction and a photographing non-permission direction in case 5;

FIG. 15 is a detailed flowchart of S15 in FIG. 7;

FIG. 16 is an example of a permitted host information file.

FIG. 17 is an explanatory diagram of another setting method of a shooting non-permission area.

FIG. 18 is an example of a file for linking a set photographing non-permission area and a target camera.

FIG. 19 is a flowchart of a basic operation of the camera control server 50 for setting a shooting non-permission area.

FIG. 20 is a detailed flowchart of S102 in FIG. 19;

FIG. 21 is a diagram showing a relationship between a shooting non-permission area and shooting non-permission directions d and D.

FIG. 22 is an explanatory diagram of the structure and contents of a camera status table.

FIG. 23 is an explanatory diagram of a photographing direction and a photographing range θa (a, A). Camera orientation when setting the non-permitted area of 6-5,
11 is a flowchart illustrating the flow of a zoom magnification update process.

FIG. 24 is a detailed flowchart of S115 in FIG. 20;

FIG. 25 is an example of a shooting non-permission direction and a shooting direction.

FIG. 26 is an example of a shooting non-permission direction, a shooting direction, and a panable range.

FIG. 27 is an example of displaying, in addition to the camera icon on the map, that an image is being taken in a direction in which photography is not permitted.

FIG. 28 is an example of displaying a shooting non-permission direction and a shooting direction together on a map.

[Description of Signs] 10 (10-1, 10-2, 10-3, ...): Video camera 12 (12-1, 12-2, 12-3, ...): Camera control circuit 14 : Camera input selection device 20: Video communication terminal device 22: CPU 24: Main memory 26: Secondary storage device 28: Mouse 30: Keyboard 32: I / O port 34: Video board 35: Bitmap display 36: Network Interface 38: System bus 50, Camera management server 52: Network 54: Camera control server 56: Camera control client 58: Video transmission / reception software 60: Map window 62: Camera video window 64: Camera operation panel 66: Camera Icon 68: Button for setting non-capturing area 70: Clear button for non-capturing area Tan

──────────────────────────────────────────────────続 き Continuation of the front page (56) References JP-A-6-181539 (JP, A) JP-A-5-75995 (JP, A) JP-A-4-76698 (JP, A) 317288 (JP, A) (58) Fields surveyed (Int. Cl. ⁷ , DB name) H04N 7/18 H04N 7/15 H04N 5/222-5/257

Claims (22)

(57) [Claims] 1. A camera control system for selecting one of a plurality of controllable cameras connected on a network, displaying an image and controlling the camera, comprising: a map display unit; Symbol display means for superimposing and displaying one or more camera symbols each representing a camera on a map displayed by the means; and a non-capturing area in which photography is prohibited on the map displayed by the map display means. A camera control system comprising: a non-capturing area setting unit to be set; and a camera control restricting unit that restricts control of each camera so that the set non-capturing area is not photographed. Wherein said camera control regulating means, regulated by the camera, a camera control system according to claim 1 which do not include the imaging prohibition region to the imaging range by the rotation. Wherein the regulated cameras, the camera control system according to claim 2 is one or more cameras to be locally connected to the host set the photographing prohibition region. 4. The camera control system according to claim 2, wherein the regulated camera is one or more cameras connected to a predetermined host. 5. The regulated cameras, set those
The camera control system according to claim 2, wherein the predetermined one or more cameras for each said imaging disallowed regions. 6. The camera control regulation means, while the photographing prohibition region setting means has set the photographing prohibition region, a camera control system according to claim 1 for regulating the control of the camera. When 7. The photographing prohibition region setting means has set the photographing prohibition region, if the camera had captured disallowed region photographable state, the said camera control regulating means, The camera control system according to claim 1, wherein the camera controls the shooting of the shooting non-permission area immediately. 8. The camera controller regulating means for regulating the target camera, so as not to overlap with each other-direction range and the imaging range of the imaging prohibition region set according to claim 1 for regulating the control of the photographing direction and photographing magnification The camera control system according to item 1. 9. The camera control regulation means, for regulating the target camera, when the overlap direction range and the imaging range of the imaging prohibition region set to substantially block the display of at least the overlapping portion of the captured image The camera control system according to claim 1. 10. Further, the camera control system according to claim 1, 8 or 9 comprising a limiting notification means for notifying that the camera control is limited by the set the captured disallowed regions. 11. The camera control system according to claim 10, wherein said restriction notifying means notifies, when the set photographing non-permission area and the photographing range partially overlap, that they overlap. 12. A plurality of systems connected on a network.
Camera to select and control one of the controllable cameras
A control method, A map display step for displaying a map, On the map displayed by the map display step,
Superimpose one or more camera symbols, each representing a camera
A symbol display step for displaying Shoot on the map displayed by the map display step
Non-permitted shooting area setting to prohibit non-permitted shooting area setting
Steps and Set each image so that the set
Camera control regulation step for regulating camera control.
A camera control method. 13. The camera control restricting step includes the step of restricting
When the target camera rotates,
The turtle according to claim 12, which is not included in the photographing range.
LA control method. 14. The camera subject to the restriction may not be able to
One or more local connections to hosts that have allowed
14. The camera control method according to claim 13, which is a camera. 15. The camera subject to the restriction is a predetermined camera.
14. The method according to claim 13, wherein the at least one camera is connected to a host.
The camera control method described in the above. 16. The camera to be restricted is set
One or more cameras determined in advance for each of the shooting non-permission areas.
14. The camera control method according to claim 13. 17. The camera control restricting step,
The non-capturing area is set by the non-capturing area setting step.
Request that regulates the control of the camera while is set
Item 13. The camera control method according to Item 12. 18. The image forming apparatus according to claim 1, wherein the non-capturing area setting step is performed.
When the non-capturing area is set, the camera
If the permitted area can be photographed,
The camera control restriction step is forbidden by the camera
13. The turtle according to claim 12, wherein the photographing of the available area is immediately restricted.
LA control method. 19. The camera control restricting step includes the step of restricting
For the target camera, the area where the shooting is not permitted
The shooting direction and shooting direction should be set so that the
13. The camera control according to claim 12, wherein the control of the shadow magnification is regulated.
Method. 20. The camera control restricting step includes the step of restricting
For the target camera, the area where the shooting is not permitted
When the orientation range and the imaging range overlap,
13. The method according to claim 12, wherein the display of the overlapping portion is substantially prohibited.
The camera control method described in the above. 21. Further, the set photographing non-permission area is set.
To notify that camera control is restricted by
The method according to claim 12, 19 or 20, comprising a notifying step.
Camera control method described above. 22. The restriction notification step is set
Even when the shooting prohibited area and shooting range partially overlap,
22. The camera according to claim 21, wherein the camera is notified of the overlap.
Control method.