JPH09322053A - Image pickup method for object in automatic image pickup camera system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow the system to track automatically an object moving in a 3-dimensional space for image pickup and to visualize accurately a difference from sizes in the case that a plurality of objects with different sizes are individually picked up and visualized through synthesis or changeover. SOLUTION: The system is provided with 1st and 2nd sensor cameras 100 picking up a wide angle image corresponding to a visual field of a camera operator, a 3-dimensional position of an object 1 is measured based on the picked-up image by the 1st and 2nd sensor cameras 100, the system predicts a distance between a visual point of an image pickup camera 200 and the 3-dimensional position and picks up the object 1 with a reference field angle size corresponding to the predicted distance.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an automatic photographing camera system capable of measuring a three-dimensional position of an object from an image photographed by using a television camera and automatically tracking the object for unmanned photographing.

[0002]

2. Description of the Related Art Conventionally, in a camera system which allows a camera operator to automatically track and photograph a subject without directly operating a television camera, the camera system can be rotated in horizontal and vertical directions, and can be rotated from the outside. A shooting camera that can be controlled by a control signal is used, and the shooting camera is driven and controlled according to the movement of the subject. As a method of recognizing a subject, for example, a detection mark is previously attached to a subject (or an object that moves with the subject), and a captured image is processed to recognize the detection mark. Has been adopted.
Then, by driving and controlling the photographing camera so that the recognized subject is located at a predetermined position within the frame of the screen, the subject is tracked and photographed.

At this time, the angle of view size is determined based on the size (for example, the number of pixels of the color) obtained by extracting the target image portion from the captured image, and the size of the subject on the screen is determined. The camera is controlled by adjusting the zoom amount of the camera so that it is always constant.

[0004]

However, in the method of photographing a subject with the angle of view size determined by the above-described processing, when the subjects of different sizes are photographed, the size of the subject on the screen is constant. Therefore, the difference in size does not appear in the image. For example, as shown in FIG. 10, using a camera 200A and a camera 200B,
Adult 1a with a height of 180 cm and child 1 with a height of 120 cm
When the images of b coming in are respectively photographed and the images of both are compared and viewed, as shown in the image examples VD2a and VD2b in the figure, the images are of the same size, and there is a problem that there is a lack of realism. It was That is, in the conventional automatic photographing camera system, the angle of view θ is determined based on the sizes of the subjects 1a and 1b on the screen (for example, heights Z1 and Z2).
Since (Z1) and θ (Z2) are determined and photographed, the distances l1 (Y) and l2 to the subjects 1a and 1b are determined.
Even if (Y) changes, the sizes of the subjects 1a and 1b on the screen are always the same, and thus there is no change and the image is not realistic.

In order to enable realistic shooting, for example, when a child with a height of 120 cm is used as a reference, the height is 18
A 0 cm adult image needs to be sized according to the difference in height, such as shooting with a large subject. However, it is impossible to accurately capture the difference in height even in the normal camera operation.
That is, camera work (zooming work) matching the height is required to express the difference in height by the camera operation of the cameraman, but it is necessary to adjust the distance from the viewpoint of the shooting camera to the subject for different objects. It is practically impossible to shoot with a uniform angle of view,
The camerawork has to rely on the intuition of the cameraman.

The present invention has been made under the circumstances as described above, and an object of the present invention is to be able to automatically track and photograph an object moving in a three-dimensional space, and to have a plurality of objects of different sizes. It is an object of the present invention to provide an automatic photographing camera system capable of accurately visualizing a difference in size when the objects are individually imaged and combined or switched to be imaged.

[0007]

SUMMARY OF THE INVENTION According to the present invention, automatic photographing is performed in which a subject to be photographed is automatically tracked and photographed by driving control of a photographing camera capable of controlling camera operation including a photographing direction by a control signal from the outside. The present invention relates to a photographing method in a camera system, and the above-mentioned object of the present invention is based on the photographed images of the first and second sensor cameras that photograph wide-angle images corresponding to the visual field of the camera operator.
By measuring the three-dimensional position, predicting the distance from the viewpoint of the photographing camera to the three-dimensional position, and photographing the subject with a predetermined reference angle size corresponding to the predicted distance. To be achieved.

Further, the present invention is an automatic photographing in which different photographing subjects are automatically tracked and photographed by driving control of a plurality of photographing cameras capable of controlling camera operation including a photographing direction by a control signal from the outside. The present invention relates to a photographing method in a camera system, and the object of the present invention is to provide a three-dimensional image of the different subject based on the photographed images of the first and second sensor cameras that photograph wide-angle images corresponding to the visual field of the camera operator. While measuring each position,
The distances from the viewpoint of the photographing camera to the three-dimensional positions of the different subjects are respectively predicted, and the different subjects are photographed with a predetermined reference angle of view size corresponding to each predicted distance. This is achieved by combining them and displaying them on the same screen. Furthermore, the above-mentioned object of the present invention is more effectively achieved by determining the subject of the different photographing target based on the predicted distance.

[0009]

BEST MODE FOR CARRYING OUT THE INVENTION According to the present invention, the position of a subject in a three-dimensional space is measured, and the photographing camera is driven and controlled according to the movement of the subject to automatically photograph the subject. . Further, the distance from the viewpoint of the camera to the subject is measured, and the subject is imaged at a reference angle of view (a reference angle of view preset according to the distance) with respect to the distance. In addition, using multiple cameras, each of the multiple target objects can be captured and photographed,
Combining each captured image to create a desired composite image, and in real time on the same screen (or playing from the stored information)
I am able to display.

Hereinafter, a preferred embodiment of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a schematic configuration of an automatic photographing camera system according to the present invention. Two cameras 100 (hereinafter, referred to as “sensor cameras”) and one camera for capturing an object moving in a three-dimensional space are shown. The example of the system provided with the camera 200 for photography is shown. The sensor camera 100 is a camera corresponding to both eyes of a camera operator, and captures a wide-angle image including a subject 1 to be captured, as shown in FIG. Two sensor cameras 100 are used to obtain the three-dimensional position (three-dimensional coordinates) of the subject by the principle of triangulation. For example, when the subject 1 that moves beyond the field of view of the sensor camera 100 is tracked and photographed, a plurality of sensor cameras 100 are used, and in that case, the photographing range (measurement range) is divided and each of them is predetermined. Two units are arranged at the position. The photographing camera 200 includes a drive mechanism unit (head) 2 capable of adjusting the pan, tilt, zoom, focus, etc. of the camera by a control signal from the outside.
This is a camera in which 10 and the image pickup unit 220 are integrally configured, and by controlling the rotation of the pan axis and the tilt axis, it is possible to take an image of almost the entire space except directly below.

The three-dimensional position measuring apparatus 300 recognizes a subject 1 to be photographed from a stationary body or a moving body in the wide-angle image VD1a (VD1b) photographed by the sensor camera 100 (for example, it is recognized by color information of the subject 1). In addition, the present position of the subject 1 is sequentially measured, and the present position (three-dimensional coordinate information) of the subject 1 in the three-dimensional space with the viewpoint of the photographing camera 200 as the origin, and the size of the subject 1. Information (area information of the image extraction portion) indicating the measurement information PD
Output as This measurement information PD is input to the data analysis device 500 via the input / output interface. In the case of automatically tracking and shooting a plurality of subjects using the plurality of photographing cameras 200, the measurement information of each subject is collectively output as the measurement information PD.

The data analysis device 500 is a device that analyzes the movement of the subject 1 based on the measurement information PD from the three-dimensional position measurement device 300 and controls the camera work of the photographing camera 200 according to the movement of the subject 1. Yes, drive control unit 400
A drive signal MS is sent out via the to control the camera work of the photographing camera 200. That is, the data analysis device 5
In 00, the current position of the subject 1 is recognized based on the measurement information PD of the three-dimensional position measuring device 300, and
Of the shooting camera 200 (position, azimuth angle, acceleration, etc.) is predicted to predict the movement at the next moment, and the shooting camera 200 is based on this prediction information and information indicating the current direction of the shooting camera 200. Of the pan / tilt angle deviation and the amount of adjustment of the zoom and the like, and outputs drive control data (speed command) Vcom to move to the next operation position of the subject 1.
By controlling the driving of the subject 1, the subject 1 is automatically tracked and photographed.

In addition, the data analysis device 500 is used for the subject 1.
Camera 2 based on 3D position (3D coordinates) information
While predicting the distance from subject 00 to subject 1,
By obtaining the reference angle of view for that distance and controlling the zoom operation so that the image is captured at the reference angle of view for the predicted distance,
Regardless of the size of subject 1, subject 1 always has the same angle of view.
I am trying to shoot. That is, when shooting a plurality of subjects by using a plurality of shooting cameras 200, or when shooting while switching the subjects to be tracked by one shooting camera 200, the size of each subject 1 is changed. I try to make the difference appear exactly on the screen. Further, the change in the size of the subject caused by the change in the distance to the subject 1 is accurately displayed on the screen.

Next, an example of the configuration of each device will be described in more detail. First, the configurations of the photographing camera and the drive control unit will be described. FIG. 2 shows a configuration example of the photographing camera 200 and the drive control unit 400 of FIG.
00 is the pan shaft 21 driven by the motors 213 and 214.
The orientation of the image pickup unit 220 (horizontal and vertical directions) is adjusted by rotating 1 and the tilt shaft 212, and the zoom, focus, and iris of the image pickup unit 220 are adjusted by driving each motor 215. In this example, the motor 21
The step motor is used for 5, and the motors 213 and 214
Uses a direct drive motor that produces high torque.

The drive control unit 400 includes a motor 213 for the pan head.
Drive control data (speed command) Vcom from the host controller (the data analysis device 500 in the configuration example of FIG. 1), the drive control of the photographing camera 200 is performed. To do. That is, the drive controller 400 drives the drive signals MS1 to MS3 of the motors 213 to 215 based on the drive control data (speed command) Vcom from the host controller and the parameter PDD (drive control parameter of each motor) of the database 401. Is generated / output by the control CPU 410, and the photographing camera 200 is controlled by servo control via the motor driver 420.

Next, the configurations of the three-dimensional position measuring device and the data analyzing device will be described. FIG. 3 is a block diagram showing a configuration example of main parts of the three-dimensional position measuring device 300 and the data analysis device 500 of FIG. In FIG. 3, the three-dimensional position measuring apparatus 300 includes a subject recognition unit 310 that recognizes a subject 1 to be captured from a stationary body or a moving body in the wide-angle image VD1a (or VD1b) captured by the sensor camera 100, A three-dimensional coordinate measuring unit 320 that measures the current position (three-dimensional coordinate) of the subject 1 in the three-dimensional space. The measurement information PD of the three-dimensional position measurement device 300 is input to the motion analysis unit 510 in the data analysis device 500.

The data analysis device 500 analyzes the movement of the subject 1 based on the measurement information PD from the three-dimensional position measurement device 300, and obtains the latest motion vector of the subject 1 up to the present time. The motion predicting unit 520 that predicts the next motion of the subject 1 based on the motion vector calculated in 510, calculates the next motion vector, and sends prediction information such as the subject velocity V and the three-dimensional position measuring device 300. An angle-of-view determining unit 535 that obtains a distance from the viewpoint of the photographing camera 200 to the subject 1 based on the measurement information PD and obtains a reference angle of view for the obtained distance, and distance / reference-angle information from the angle-of-view determining unit 535 And the azimuth angle (pan, tilt angle) of the photographing camera 200 up to the optimum position of the subject in the photographing screen based on the detection information SD from the camera angle / angle of view detection sensor (not shown). Deviation) and the angle of view (zoom) adjustment amount are detected, the correction amount of the drive signal is obtained, and the speed correction information (correction speed ΔV) is sent out, and the speed correction amount detection unit 540, the prediction information from the motion prediction unit 520, And speed correction amount detection unit 5
The camera work is analyzed and determined based on the speed correction information and the like from 40, and drive control data (speed command) Vc
and a camera work control unit 530 for controlling camera work of the photographing camera 200 by outputting om.

The data analysis apparatus 500 additionally includes an analysis information recording unit (not shown) for recording analysis information of the subject motion analyzed by the motion analysis unit 510, and an analysis (not shown) for displaying the analysis information together with the photographed image on a monitor. And information display means.

An example of the operation of the device relating to the method for determining the angle of view and the control of the zoom operation according to the present invention having the above-mentioned structure will be described with reference to a specific example. FIG. 4 is a flow chart showing an example of the operation of the apparatus according to the present invention.
It is the figure shown corresponding to FIG. Hereinafter, description will be made with reference to FIG.

First, in the three-dimensional coordinate position measuring apparatus 300, the three-dimensional position of the subject 1 is measured by the following processing. In the three-dimensional coordinate position measuring apparatus 300, the subject 1 in the two-dimensional coordinate system in each of the images VD1a and VD1b is based on the images VD1a and VD1b of the two sensor cameras 100.
Of the sensor camera 100 and the photographing camera 200, and the three-dimensional coordinate position P (x, y, z) of the subject 1 is set as the origin from the viewpoint of the photographing camera 200. Is calculated by the principle of triangulation. The angle-of-view determination unit 535 in the data analysis device 500
Based on the three-dimensional position information (P (x, y, z)) from the three-dimensional coordinate position measuring device 300, as shown in FIG.
The position P (x,
Predict the distance l to y, z). Then, in the view angle determination unit 535, the reference view angle θ corresponding to the predicted distance l.
(L) is obtained, and the obtained reference angle of view θ (l) is determined as the angle of view θ at the time of prediction.

Here, the reference angle of view θ (l) is an angle of view preset corresponding to the distance 1, and for example, as shown in FIG. 6, the predicted distance 1 is in the range of L1 to L2. In this case, the angle of view θl and the angle of view θ2 when the predicted distance 1 is in the range of L2 to L3 are set in advance such that the value of the reference angle of view θn corresponds to the distance to the subject. This correspondence is set for each subject (human, automobile, etc.).

The speed correction amount detection unit 540 obtains the zoom movement amount of the photographing camera 200 from the angle of view θ determined by the angle of view determination unit 535 and the current angle of view θ ₀ . Here, the relationship between the angle of view and the zoom movement amount in the photographing camera 200 is as shown in, for example, FIG. 7, and the speed correction amount detection unit 540 obtains the zoom movement amount according to this relationship and the zoom motor 215. A speed command Vcom is generated and the speed command Vcom is transmitted via the camera work control unit 530. The drive control unit 400 sends a drive signal to the zoom motor 215 and controls the zoom operation of the photographing camera by feedforward control. As described above, by controlling the zooming work by the reference angle of view θ with respect to the predicted distance, when the subjects located at the same distance are photographed, the subject 1 can always be imaged at the same angle of view.

Now, with reference to FIG. 8, the difference between the method for determining the angle of view in the present invention and the method for determining the angle of view in the prior art (see FIG. 10) will be described. In FIG. 8, on the photographing camera 200A side, the distance l1 to the three-dimensional position Pa (x, y, z) of the adult 1a as the subject is shown.
A picture is taken at an angle of view θ (l1) corresponding to (Y). Similarly,
On the side of the camera 200B for shooting, the image is taken at an angle of view θ (l2) corresponding to the distance l2 (Y) to the three-dimensional position Pb (x, y, z) of the child 1b. That is, in the present invention, the angle of view θ is determined by the distance 1 regardless of the size of the subject, so the image examples VD2a and VD2b in FIG.
As shown in, the difference in size between the adult 1a and the child 1b is accurately imaged. On the other hand, the conventional method of determining the angle of view size is, as described above, the object 1a on the screen,
Since the angle of view size is determined based on the size of 1b, the adult 1a and the child 1b are imaged in the same size as shown in the image examples VD2a and VD2b in FIG. It will be. Further, in the present invention, the size of the subject on the screen changes according to the distance, but in the conventional technique, the size of the subject on the screen is constant.

Next, an application example of the present invention will be described with reference to FIG. Here, as shown in FIG. 9A, a case where a swimming competition is photographed using two photographing cameras 200A and 200B will be described as an example. In this case, two sensor cameras 10
The three-dimensional position of the target player is measured based on the photographed image of 0, and the distance from the viewpoint of the photographing camera to the three-dimensional position of each player is predicted. In addition, the target player is photographed with the reference angle of view size corresponding to each predicted distance, and each photographed image VD2a is captured.
And VD2b are combined and displayed on the same screen. For example, if players on 3rd and 7th courses are competing for 1st and 2nd place, 1 from the information on the measurement position of each player.
The first and second players are discriminated, and the shooting camera 200A and the shooting camera 200B are driven and controlled toward the positions of those players.

Then, as shown in FIG. 9B, the photographed image VD2a of the photographing camera 200A and the photographing camera 20.
The captured image VD2b of 0B is input and the images are combined. For example, as shown in FIG. 9C, a combined image V obtained by dividing the images of the players of courses 3 and 7 into the upper and lower parts of the screen is displayed.
D2 is output. By shooting with such a method, desired players in different blocks can be compared and displayed. Also, in ski downhill competitions and athletics 100m on the ground, you can shoot the subject coming toward the camera side and compare the athletes of different blocks to make a virtual confrontation as if you were competing together. become able to.

Next, an operation example of the entire system will be described with reference to FIG. Here, description of the operations of the angle of view determination unit 535 and the speed correction amount detection unit 540 described above will be omitted.

In FIG. 3, the video signals VD1a and VD1b captured by the two sensor cameras are input to the three-dimensional position measuring device 300, respectively. The subject recognition unit 310 in the three-dimensional position measuring apparatus 300 detects the video signal VD1a.
The object 1 to be photographed is recognized from the image data of the one-frame two-dimensional coordinate system obtained by digitizing (or VD1b). Recognition of the subject 1 is performed, for example, by comparing the chromaticity of each pixel of the image data with a threshold (a range of chromaticity: a lower threshold to an upper threshold) of a plurality of colors preset as subject recognition data. The threshold value is set to "1", and the value outside the range is set to "0", and is binarized in pixel units. At that time, the pixels of the color that are continuous in the two-dimensional coordinate system (X, Y coordinate system) are extracted and counted, and the counted value is set as the area S. When there are a plurality of portions of the color, for example, the portion having the largest area S is recognized as the subject 1 to be photographed. However, the recognition process based on the size is not necessary under the shooting condition in which the subject 1 can be specified with the set color without fail.

In the three-dimensional coordinate measuring section 320, the center of gravity of the extracted portion is calculated from the area S obtained by the object recognizing section 310 to obtain the center position C (x, y) of the object 1. This center position is determined by the image data VD of the two sensor cameras 100.
1a and VD1b are respectively calculated. Then, two calculated center positions C1 (x, y) and C2 (x, y),
From the position information of the sensor camera 100 and the shooting camera 200, the position of the subject 1 in the three-dimensional space (three-dimensional coordinates of the subject 1 with the viewpoint of the shooting camera 200 as the origin) is calculated by the triangulation principle, Calculated three-dimensional position information C
(X, y, z) and information indicating the size of the subject 1 (the above-described area S) are output as measurement information PD. This measurement information PD is input to the motion analysis unit 510 in the data analysis device 500.

The motion analysis unit 510 analyzes the motion of the subject 1 based on the measurement information PD from the three-dimensional position measuring apparatus 300 and sends the analysis information to the motion prediction unit 520. For example, based on the measurement information PDtn of this time (three-dimensional coordinate information) and the measurement information PDt (n-1) of the previous time, a motion vector starting from the time point of the previous measurement is obtained, and information on the calculated motion vector (time, azimuth angle) is obtained. , Distance, speed, etc.) is transmitted as analysis information. The motion prediction unit 520 obtains the vector of the motion of the subject 1 at the next moment based on the analysis information from the motion analysis unit 510, and sends the subject position, direction, subject velocity V, etc. as prediction information to the camera work control unit 530. To do.

In the camera work control section 530, based on the prediction information (subject speed V etc.) from the motion prediction section 520 and the speed correction information (correction speed ΔV) from the speed correction amount detection section 540, Determine the direction, amount of movement and speed of movement. Then, the pan / tilt speed command (V
+ ΔV), a speed command for adjusting the zoom, focus and iris of the photographing camera 200 is generated and output as drive control data Vcom, and the photographing camera 200 is drive-controlled via the drive control unit 400. To do.

In the above-described embodiment, the case where the data analyzing device 500 is provided with the function of analyzing the movement of the subject has been described as an example, but the three-dimensional position measuring device 300 is also provided.
It may be provided on the side. Although the case of unmanned shooting has been described as an example, it is naturally possible for the cameraman to operate the shooting camera 200 by remote control, in which case the input of operation information is prioritized. Further, a detailed description has been omitted regarding a mode of tracking a plurality of subjects using a plurality of photographing cameras 200, for example, in the case of capturing a moment of a baton touch, but in this case, a plurality of subjects are collected. It should be regarded as only one subject, and the operation of each device is similar.
In that case, the driving of each photographing camera 200 is controlled based on the position information of the subject or the identification information such as the color.

[0032]

As described above, according to the present invention, since the image is taken with the reference angle of view size corresponding to the distance to the subject, the difference in the size of the subject is accurately imaged. Will be able to. Further, it becomes possible to accurately represent the change in the size of the subject caused by the change in the distance to the subject. In addition, by using a plurality of shooting cameras to automatically track and shoot different subjects, and by combining the captured images and displaying them on the same screen, the subjects in different blocks are compared and displayed. be able to. For example, when shooting an athletic competition, it is possible to have a virtual confrontation as if athletes of different blocks were playing together, and it is possible to provide images that cannot be captured by manual operation. Like

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration example of an automatic photographing camera system according to the present invention.

FIG. 2 is a photographing camera 200 and a drive control unit 400 shown in FIG.
3 is a block diagram showing a configuration example of FIG.

FIG. 3 is a block diagram showing a configuration example of a three-dimensional position measurement device 300 and a data analysis device 500 of FIG.

FIG. 4 is a diagram showing an operation example of the apparatus according to the present invention in a flowchart corresponding to FIGS.

FIG. 5 is a diagram for explaining a method of determining a view angle size according to the present invention.

FIG. 6 is a diagram for explaining a method of determining a view angle size according to the present invention.

FIG. 7 is a diagram showing a relationship between an angle of view and a zoom movement amount in the shooting camera.

FIG. 8 is a diagram for explaining a difference between a method of determining a view angle size according to the present invention and a method of determining a view angle size according to a conventional technique.

FIG. 9 is a diagram for explaining an application example of the present invention.

FIG. 10 is a diagram for explaining a method of determining a view angle size in a conventional automatic shooting camera system.

[Explanation of symbols]

 1 subject 100 sensor camera 200 photographing camera 210 driving mechanism section (pan head) 211 pan axis 212 tilt axis 213, 214, 215 photographing camera control motor 220 image pickup section 300 three-dimensional position measuring device 310 subject recognition section 320 three-dimensional coordinates Measurement unit 400 Drive control unit 401 Database 410 Control CPU 420 Motor driver 500 Data analysis device 510 Motion analysis unit 520 Motion prediction unit 530 Camera work control unit 535 Angle of view determination unit 540 Speed correction amount detection unit

[Procedure amendment]

[Submission date] June 14, 1996

[Procedure amendment 1]

[Document name to be amended] Drawing

[Correction target item name] All figures

[Correction method] Change

[Correction contents]

FIG.

[Fig. 2]

[Figure 3]

[Figure 5]

FIG. 6

FIG. 4

FIG. 7

[Figure 8]

[Figure 9]

FIG. 10

Front Page Continuation (72) Inventor Kazuo Abe 1-10-11 Kinuta, Setagaya-ku, Tokyo Inside the Japan Broadcasting Corporation Broadcasting Technology Laboratory (72) Inventor Akio Ishikawa 1-1-10 Kinuta, Setagaya-ku, Tokyo Sending Association Broadcasting Technology Research Institute

Claims (3)

[Claims] 1. A photographing method in an automatic photographing camera system for automatically tracking and photographing a subject to be photographed by driving control of a photographing camera capable of controlling camera operation including a photographing direction by a control signal from the outside, From the viewpoint of the photographing camera to the three-dimensional position, the three-dimensional position of the subject is measured based on the photographed images of the first and second sensor cameras that photograph wide-angle images corresponding to the field of view of the camera operator. Of the subject, and the subject is photographed with a predetermined reference angle size corresponding to the predicted distance. 2. An image pickup in an automatic image pickup camera system for automatically tracking and photographing different objects to be photographed by driving control of a plurality of photographing cameras capable of controlling camera operations including a photographing direction by a control signal from the outside. In the method, the three-dimensional positions of the different subjects are respectively measured based on the images captured by the first and second sensor cameras that capture a wide-angle image corresponding to the field of view of the camera operator, and from the viewpoint of the capturing camera. The distances to the three-dimensional positions of the different subjects are predicted, the different subjects are photographed with a predetermined reference angle of view size corresponding to each predicted distance, and the photographed images are combined to be displayed on the same screen. A method of photographing an object in an automatic photographing camera system, characterized in that the image is displayed. 3. The method of photographing a subject in an automatic photographing camera system according to claim 2, wherein the different subject to be photographed is determined based on the predicted distance.