JP6412222B2 - Shooting device, linked shooting method, and linked shooting program - Google Patents

Description

  The present invention relates to a photographing device to which another photographing device can be attached, a cooperative photographing method, and a cooperative photographing program.

  2. Description of the Related Art In recent years, portable devices (photographing devices) with a photographing function such as digital cameras have various photographing functions by making full use of image processing. Some photographing devices have a communication function, and an image obtained by photographing can be transmitted to another device or a network.

  For example, in Patent Document 1, in a digital camera having a function of wirelessly transferring captured image data, a digital camera system and a digital camera in which a wireless communication adapter having an antenna for wireless communication is detachably attached to a hot shoe of a camera body A wireless communication adapter is disclosed.

  Conventionally, a smartphone-equipped shoe for attaching a smartphone to a shoe seat portion of a camera has also been commercialized. This is advantageous when photographing the same subject with both the smartphone and the photographing device.

JP 2005-236532 A

  However, although it is possible to point the smartphone attached to the shoe with the adapter and the shooting device in the same direction, it is necessary to perform shooting operations separately for the smartphone and the shooting device, and the angle of view must be adjusted individually. Therefore, there is a problem that it is not always advantageous for photographing and transmission of photographing data.

  The present invention provides a photographing device, a cooperative photographing method, and a cooperative photographing program capable of improving the operability of photographing and data transmission by cooperatively controlling the first photographing device and the second photographing device. With the goal.

An imaging device according to an aspect of the present invention is an imaging device including an imaging unit that outputs a first captured image obtained by capturing an image of a subject. The imaging device can perform an imaging process and a communication process. A communication unit that obtains a captured image and communicates with another imaging device separate from the imaging device having the imaging unit, and controls imaging processing of the other imaging device by communication of the communication unit A control unit that controls whether to perform shooting in the linked shooting mode with the other shooting device based on a shooting operation; and the first device related to the shooting device in the linked shooting mode. A feature determination unit that determines an image feature of the center of the screen in the captured image, and an image feature of the center of the screen in the first captured image and the second captured image of the other imaging device in the cooperative shooting mode. Compare image features An image comparison unit that performs the reduction process on the image at the center of the screen in the first captured image, while the second captured image in the other imaging device. In the above, the position having the highest degree of coincidence with the feature of the image at the center of the screen in the first captured image that is sequentially reduced is set as a candidate for the view angle display area on the second captured image, and the connection The device control unit displays an index indicating the region set as the field angle display region candidate in the image comparison unit on the second captured image in the other imaging device separate from the imaging device. The other photographing device is controlled to do so.
Cooperation photographing method according to an aspect of the present invention includes a photographing device, and the imaging device by a linkage imaging method according to the photographing unit for performing cooperative to shoot with the other imaging devices separately, An imaging step for outputting a first captured image obtained by capturing an image of a subject, and communication for communicating with another imaging device that can perform an imaging process and a communication process and obtain a second captured image by the imaging process. A connection device control step for controlling the imaging process of the other imaging device by the step, the communication step, and whether or not to shoot in the cooperative shooting mode with the other imaging device based on a shooting operation. a control step, and wherein the determination step of determining an image characteristic of the screen central portion in the first captured image according to the photographing device in the cooperative shooting mode, to the cooperative photographing mode, the first captured image An image comparison step for comparing the image feature of the central portion of the screen with the image feature of the second captured image in the other photographing device, and a reduction process sequentially for the image of the central portion of the screen in the first captured image The position where the degree of coincidence with the feature of the image at the center of the screen in the first captured image that is sequentially reduced on the second captured image in the other imaging device is the second The setting step for setting the angle of view display area as a candidate on the captured image and the index indicating the area set as the angle of view display area candidate in the setting step are used for the other imaging separately from the imaging device. Controlling the other photographing device to display on the second captured image in the device.
Cooperative photographing program according to an aspect of the present invention includes a photographing device, and the imaging device by a linkage imaging program by the photographing unit for performing cooperative to shoot with the other imaging devices separately, An imaging step of outputting a first captured image obtained by photographing a subject to a computer, and communication with another imaging device capable of performing an imaging process and a communication process and obtaining a second captured image by the imaging process A communication step for performing the communication, a connected device control step for controlling the imaging process of the other photographing device by the communication step, and whether to perform photographing in the cooperative photographing mode with the other photographing device based on a photographing operation. a control step of controlling, the characteristic determination step of determining an image characteristic of the screen central portion in the first captured image according to the photographing device in the cooperative photographing mode, the cooperative photographing mode An image comparison step for comparing the image feature of the center of the screen in the first captured image with the image feature of the second captured image in the other imaging device, and the center of the screen in the first captured image. The degree of coincidence with the feature of the image at the center of the screen in the first captured image that is sequentially reduced on the second captured image in the other photographing device while sequentially reducing the image of the image A setting step for setting a position with the highest angle as a candidate for an angle of view display area on the second captured image, and an index indicating the area set as a candidate for the angle of view display area in the setting step. And a step of controlling the other photographing device to display on the second captured image in the other photographing device separate from the above .

  According to the present invention, it is possible to improve the operability of shooting and data transmission by cooperatively controlling the first shooting device and the second shooting device.

1 is a block diagram showing a circuit configuration of a photographing apparatus according to a first embodiment of the present invention. 6 is a flowchart illustrating camera control according to the first embodiment. Explanatory drawing which shows the external appearance of the imaging device 10 and the other imaging device 20, and the mode of imaging | photography. Explanatory drawing for demonstrating the display on the display screen 18a of the display part 18. FIG. Explanatory drawing for demonstrating operation | movement of 1st Embodiment. Explanatory drawing which shows an example of the image comparison process in step S36 of FIG. 5 is a flowchart showing an operation flow of image comparison processing. Explanatory drawing for demonstrating the 2nd Embodiment of this invention. Explanatory drawing which shows the mechanism for enabling adjustment work of optical axis alignment. The flowchart which shows the operation | movement flow of adjustment work by the signal processing and the control part 61. Explanatory drawing for demonstrating how to instruct | indicate the imaging | photography direction by the imaging | photography direction instruction | indication part 11f. Explanatory drawing for demonstrating how to instruct | indicate the imaging | photography direction by the imaging | photography direction instruction | indication part 11f. Explanatory drawing for demonstrating how to instruct | indicate the imaging | photography direction by the imaging | photography direction instruction | indication part 11f. The flowchart for demonstrating operation | movement of 2nd Embodiment. Explanatory drawing for demonstrating operation | movement of 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram showing a circuit configuration of the photographing apparatus according to the first embodiment of the present invention.

  In FIG. 1, an imaging device 10 has an imaging unit 12 constituted by an imaging element such as a CCD or a CMOS sensor. The imaging unit 12 captures a subject image via a lens (not shown) provided on the front surface of the photographing apparatus 10, and performs photoelectric conversion to obtain a captured image. The imaging unit 12 is driven and controlled by the signal processing and control unit 11 to capture a subject and output a captured image.

  The signal processing and control unit 11 outputs a drive signal of the imaging unit 12 to the imaging unit 12 and reads a captured image from the imaging unit 12. The signal processing and control unit 11 performs predetermined signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing on the read captured image.

  The photographing device 10 is also provided with an operation determination unit 13. The operation determination unit 13 generates an operation signal based on a user operation with respect to an operation unit including a release button, a function button, and various switches such as a shooting mode setting (not shown) provided in the photographing apparatus 10, and a signal processing and control unit 11 is output. The signal processing and control unit 11 controls each unit based on the operation signal.

  Further, the display control unit 11a of the signal processing and control unit 11 executes various processes related to display. The display control unit 11 a can provide the captured image after the signal processing to the display unit 18 and the eyepiece display unit 17. The display unit 18 and the eyepiece display unit 17 each have a display screen such as an LCD, and display an image given from the display control unit 11a. Moreover, the display control part 11a can also display various menu displays etc. on these display screens.

  The photographing device 10 is provided with a touch panel 19. For example, by providing the touch panel 19 on the display screen of the display unit 18, it is possible to generate an operation signal corresponding to the position on the display screen pointed by the user with a finger. Thereby, the user can easily perform a selection operation or the like on the image displayed on the display screen of the display unit 18.

  Note that the display unit 18 is disposed so as to occupy substantially the entire rear surface of the imaging device 10 (see FIG. 3), and the photographer can display a through image displayed on the display screen of the display unit 18 at the time of shooting. Can be confirmed, and shooting operations can be performed while checking through images.

  The photographing apparatus 10 is also provided with an eye sensor 17b. The eyepiece sensor 17 b detects that the photographer has brought his eye close to (eyepiece) the eyepiece display unit 17, and outputs the detection result to the signal processing and control unit 11.

  The signal processing and control unit 11 can compress the captured image after the signal processing and give the compressed image to the recording unit 16 for recording. As the recording unit 16, for example, a card interface can be adopted. The recording unit 16 records image information and audio information on a recording medium such as a memory card, and also stores image and audio information recorded on the recording medium. It can also be read and played back.

  An accessory shoe (not shown) is provided on the housing of the photographing apparatus 10 so that another photographing apparatus 20 such as a smartphone can be attached. In the present embodiment, the photographing device 10 can perform photographing in cooperation with another photographing device 20. The communication unit 14 can communicate with a communication unit 24 provided in another imaging device 20, and can transmit and receive data between the signal processing and control unit 11 and the other imaging device 20. . As a result, the signal processing and control unit 11 can operate in a linked shooting mode in which shooting is performed in cooperation with another shooting device 20.

  The other imaging device 20 can be configured by a smartphone or the like, for example. The other imaging device 20 includes a signal processing and control unit 21, and the signal processing and control unit 21 controls each unit of the other imaging device 20. The other photographing device 20 includes a communication unit 25. The communication control unit 21b of the signal processing and control unit 21 can control the communication unit 25 to transmit various types of data via a predetermined network such as a telephone line and capture various types of data from the predetermined network.

  The other imaging device 20 has an imaging unit 22 configured by an imaging element such as a CCD or a CMOS sensor. The imaging unit 22 captures a subject image via a lens (not shown) provided on the front surface of another imaging device 20, and performs photoelectric conversion to obtain a captured image. The imaging unit 22 is driven and controlled by the signal processing and control unit 21 to capture a subject and output a captured image. The imaging control unit 21 c of the signal processing and control unit 21 outputs a drive signal for the imaging unit 22 to the imaging unit 22. Zoom control and focus control are possible by the imaging control unit 21c. The signal processing and control unit 21 reads the captured image from the imaging unit 22, and performs predetermined signal processing, such as color adjustment processing, matrix conversion processing, noise removal processing, and other various signal processing, on the read captured image. I do.

  Further, the display control unit 21a of the signal processing and control unit 21 executes various processes related to display. The display control unit 21 a can provide the captured image after the signal processing to the display unit 28. The display unit 28 has a display screen such as an LCD, and displays an image given from the display control unit 21a. The display control unit 21a can also display various menu displays on these display screens.

  The other photographing device 20 is provided with a touch panel 29. For example, by providing the touch panel 29 on the display screen of the display unit 28, it is possible to generate an operation signal corresponding to the position on the display screen pointed by the user with a finger. As a result, the user can easily perform a selection operation or the like on the image displayed on the display screen of the display unit 28.

  The display unit 28 is disposed so as to occupy substantially the entire area of one surface of the other imaging device 20 (see FIG. 3), and the photographer is displayed on the display screen of the display unit 28 at the time of shooting. A through image can be confirmed, and a shooting operation can be performed while confirming the through image.

  Further, the signal processing and control unit 21 can compress the captured image after the signal processing and give the compressed image to the recording unit 26 for recording. The recording unit 26 can record image information and sound information on a recording medium, and can also read and reproduce image and sound information recorded on the recording medium.

  In the present embodiment, the connected device control unit 11e of the signal processing and control unit 11 can detect that another photographing device 20 is connected to the accessory shoe. For example, the signal processing and control unit 11 shifts to the cooperative shooting mode when it is detected by the connected device control unit 11e that the other shooting device 20 is connected to the accessory shoe. The connected device control unit 11e can perform imaging control, image transmission control, display control, and the like for the other imaging devices 20 in the cooperative imaging mode.

  In the cooperative shooting mode, the feature determination unit 11b of the signal processing and control unit 11 determines the characteristics of a captured image (hereinafter also referred to as a first captured image) from the imaging unit 12. For example, the feature determination unit 11b sets a region of a predetermined size at the center of the first captured image as a feature detection region, and obtains a feature for the image in the feature detection region. In addition, the feature determination unit 11b may set an image portion in a range designated by the user in the first captured image as a feature detection region, and obtain the feature of this region.

  The image comparison unit 11c is provided with a captured image (hereinafter also referred to as a second captured image) of another imaging device 20 via the communication units 24 and 14, and the first captured image is included in the second captured image. It is determined whether or not there is an image part having a feature that substantially matches the feature of the image in the feature detection region. If there is a feature, the position of the matching image part on the first captured image is obtained.

  The angle-of-view display unit 11d is given the detection result of the image comparison unit 11c, and can generate a frame image indicating a range on the second captured image corresponding to the feature detection region of the first captured image.

  In the present embodiment, the display control unit 11a displays the first captured image from the imaging unit 12 and the second captured image from the other imaging device 20 on the same display screen in the cooperative shooting mode. Can be done. Furthermore, the display control unit 11a can also display the frame image from the angle-of-view display unit 11d so as to be superimposed on the second captured image.

  The signal processing and control unit 11 transmits the first captured image to the other imaging device 20 via the communication units 14 and 24, and the communication control unit 21b of the other imaging device 20 places it on a predetermined network. It is also possible to transmit the first captured image. In addition, the signal processing and control unit 11 generates an operation signal for another imaging device 20 based on a user operation, and transmits the operation signal to the other imaging device 20 via the communication units 14 and 24, so that another imaging is performed. The device 20 can also be operated. Thereby, it is also possible to perform imaging in the imaging unit 22 of another imaging device 20 by operating the imaging device 10.

  Next, the operation of the embodiment configured as described above will be described with reference to FIGS. FIG. 2 is a flowchart showing camera control according to the first embodiment. FIG. 3 is an explanatory diagram showing the appearance of the imaging device 10 and the other imaging device 20 and the state of imaging, and FIG. 4 is an explanatory diagram for explaining the display on the display screen 18 a of the display unit 18. FIG. 5 is an explanatory diagram for explaining the operation of the embodiment.

  The photographer wears another photographing device 20 such as a smartphone on an accessory shoe (not shown) of the photographing device 10. FIG. 3 shows this state. For example, the photographer 31 holds the casing 10a of the photographing device 10 with the right hand 32R and the left hand 32L, and captures the subject in the field of view while viewing the through image displayed on the display screen 18a of the display unit 18. You can take a picture. When the imaging device 10 and the other imaging device 20 are not linked, a captured image obtained by imaging by the imaging unit 22 of the other imaging device 20 is displayed on the display screen 28a of the other imaging device 20. Is done.

  On the other hand, in the present embodiment, the photographing device 10 and the other photographing device 20 can perform the photographing in cooperation, and when the other photographing device 20 is attached to the photographing device 10, The display on the display screen 28a of the other photographing device 20 is turned off, and the image captured by the other photographing device 20 is displayed on the display screen 18a of the photographing device 10.

  FIG. 4 shows this state. On the display screen 18 a of the display unit 18, the main display region 41 a for displaying the first captured image by the imaging unit 12 of the imaging device 10 and the imaging units of the other imaging devices 20. 22 and a sub display area 41b for displaying a second captured image. For example, assuming that the photographing devices 10 and 20 photograph in substantially the same direction, the other photographing device 20 performs wide-angle photographing, and the photographing device 10 performs telephoto photographing, the other photographing device 20 performs imaging. The imaging device 10 captures an image of a part of the imaging range. In this case, the wide-angle image 44 is displayed in the sub display area 41b, and a part of the telephoto image 42 of the wide-angle image 44 is displayed in the main display area 41a. In the example of FIG. 4, a bird image 45 is displayed on a part of the wide-angle image 44. Further, in the telephoto image 42, a bird image 43 is displayed over substantially the entire area.

  In the present embodiment, an angle-of-view display 46 based on a frame image indicating which position in the wide-angle image 44 the telephoto image 42 is displayed in the wide-angle image 44.

  Since the display areas 41a and 41b for displaying the captured images of both the photographing devices 10 and 20 are provided on the display screen 18a of the photographing device 10, the photographer can easily check both images. Note that the display unit 28 of the other photographing device 20 may be turned off, and power consumption can be reduced. In addition, for example, the entire display is displayed in the sub display area 41b, and the portion of the entire view to be photographed is displayed in the main display area 41a, so that the photographing range to be photographed by the photographing device 10 can be easily confirmed. For example, even when a subject to be imaged by the photographing device 10 moves and cannot be tracked, it is easy to search for a target subject and track again by checking the wide-angle image 44 in the sub display area 41b. . In addition, an angle-of-view display 46 indicating the range of the telephoto image 42 being captured by the photographing device 10 is displayed in the wide-angle image 44, so that it is very easy to confirm the position of the subject.

  Next, such camera control will be described with reference to FIG.

  In step S <b> 1 of FIG. 2, the signal processing and control unit 11 determines whether or not the shooting mode is set. If the shooting mode is not instructed, the signal processing and control unit 11 determines whether or not the playback mode is instructed in step S2. When the reproduction mode is instructed, the signal processing and control unit 11 reproduces an image in step S3. When the user instructs the reproduction of the tag, which is related information attached to the reproduced image, the signal processing and control unit 11 shifts the processing from step S4 to step S5 to display the information related to the reproduced image (tag display). Do.

  In step S6, the signal processing and control unit 11 determines whether or not the share button for publishing the captured image is operated. The photographic device 10 is provided with a share button (not shown), and the user operates the share button when transferring the captured image to a server on a network line such as the Internet.

  In the present embodiment, when the share button is operated, the signal processing and control unit 11 of the imaging device 10 transmits the captured image together with a command for controlling the communication of the imaging device 20 to the other via the communication unit 14. Transmit to the imaging device 20. The communication control unit 21b of the other imaging device 20 controls the communication unit 25 according to the command from the imaging device 10, and transmits the captured image transferred from the imaging device 20 on a network line (not shown) (step S7). ). Thus, even when the photographing device 10 does not have a communication unit connected to the network line, image transmission using the communication unit of the other photographing device 20 is possible.

  When the user gives an instruction to change and play back the playback image, the signal processing and control unit 11 shifts the processing from step S8 to step S9 to change the image to be played back. If the playback mode is not designated in step S2, the signal processing and control unit 11 performs image reception via the other photographing device 20 in step S22, and then returns the process to step S1.

  Here, it is assumed that the shooting mode is instructed by the user. In step S11, the signal processing and control unit 11 activates the imaging unit 12 and captures a captured image. The feature determination unit 11b of the signal processing and control unit 11 performs feature determination in step S12. The feature determination unit 11b determines the feature of the captured image obtained by the imaging unit 12. This feature is used for image comparison described later.

  In step S13, it is determined whether or not there is a zoom operation. If there is a zoom operation, zoom control is performed (step S14). Next, in step S15, it is determined whether or not a linked shooting mode with another shooting device has been set (smartphone linkage). For example, when another photographing device 20 such as a smartphone is attached to the accessory shoe of the photographing device 10, this attachment is detected by the connected device control unit 11e and the cooperative photographing mode is set.

  Now, assuming that it is not in the cooperative shooting mode, the shooting device 10 and the other shooting device 20 operate independently. For example, FIG. 5A shows a state in which substantially the same direction is photographed by the photographing device 10 and another photographing device 20. In the photographing apparatus 10, the photographed image is displayed as a through image (step S16). In FIG. 5A, the telephoto image 42 including the image 43 is displayed on the display screen 18a of the photographing apparatus 10, and the wide-angle image including the image 44 on the display screen 28a of the other photographing apparatus 20. 44 shows a state where 44 is displayed. An operation button 51 for moving image shooting is displayed on the display screen 18a.

  When a shooting operation is performed, the signal processing and control unit 11 detects the shooting operation in step S17, and performs shooting in step S18. The captured image from the imaging unit 12 is subjected to predetermined signal processing by the signal processing and control unit 11. The signal processing and control unit 11 assigns metadata in step S19 and records it in the recording unit 16 together with the captured image. In step S20, REC view display (confirmation display) is performed until a predetermined time has elapsed (step S21).

  On the other hand, when the other photographing device 20 is attached to the accessory shoe of the photographing device 10, the cooperative photographing mode is set, the process proceeds from step S15 to step S31, and the connected device control unit 11e performs the other photographing device. The 20 imaging units 22 are activated, and the other imaging device 20 is instructed to perform imaging at a wide angle (step S31). Next, the connected device control unit 11e turns off the display unit 28 of the other photographing device 20, and transfers the captured image captured by the imaging unit 22 via the communication units 24 and 14 (step S32).

  The display control unit 11a sets the main display area 41a and the sub display area 41b on the display screen 18a of the display unit 18 (step S33), and displays a captured image based on the imaging unit 12 in the main display area 41a (step S34). The captured image based on the imaging unit 22 is displayed in the sub display area 41b (step S35).

  FIG. 5B shows this state. The imaging device 10 and the other imaging device 20 image in substantially the same direction, the imaging device 10 performs imaging at telephoto, and the other imaging device 20 performs imaging at wide angle. The display screen 28a of the photographing device 20 is turned off, and the main display area 41a and the sub display area 41b are displayed on the display screen 18a of the photographing apparatus 10. A telephoto image 42 by the imaging unit 12 is displayed in the main display area 41a, and a wide-angle image 44 by the imaging unit 22 is displayed in the sub display area 41b.

  In the next step S36, image comparison is performed by the image comparison unit 11c. The image comparison unit 11c uses the image characteristics obtained in step S12 to determine in which region in the wide-angle image 44 the image similar to the telephoto image 42 in the main display region 41a is, and the range is detected. Output as. The angle-of-view display unit 11d is supplied with the detection result of the image comparison unit 11c, generates display data for displaying a frame image indicating a range based on the detection result of the image comparison unit 11c in the wide-angle image 44, and performs display control. To the unit 11a. Thus, the field angle display 46 based on the frame image is displayed in the sub display area 41b by the display control unit 11a (step S37).

  In step S38, the operation button 51 for moving image shooting is displayed on the display screen 18a by the display control unit 11a. In the next step S39, the signal processing and control unit 11 detects the operation of the moving image shooting operation button 51, and determines whether or not moving image shooting is instructed. When the operation button 51 is touched with the finger 53a, the signal processing and control unit 11 determines whether or not the moving image is being captured in step S40. Step S41) If the moving image shooting is in progress, the moving image shooting ends (step S42). When the user presses the shutter button 52 with the finger 53b, the process proceeds from step S39 to step S17, and still image shooting is performed (step S18).

  In this way, the angle of view display 46 indicating in which area of the sub display area 41b the captured image displayed in the main display area 41a is displayed in the sub display area 41b. Accordingly, the user can recognize the approximate shooting direction of the telephoto image 42 captured by the imaging unit 12 by using the view angle display 46 displayed in the wide-angle image 44, which is extremely useful for composition setting and the like. Useful.

  5B illustrates an example in which the main display area 41a and the sub display area 41b are set on the display unit 18 provided on the back surface of the housing 10a of the photographing apparatus 10, but these are displayed on the eyepiece display unit 17. An area may be provided to display captured images from the imaging units 12 and 22.

  FIGS. 5C and 5D show an example of this case, FIG. 5C shows the appearance of the photographing devices 10 and 20, and FIG. 5D shows the display screen 17 a of the eyepiece display unit 17. The above display is shown. As shown in FIG. 5D, in the eyepiece display unit 17, the main display area 41 a and the sub display area 41 b are set, the telephoto image 42 and the wide-angle image 44 are displayed, and the angle of view is displayed in the wide-angle image 44. A display 46 is displayed. In this case, an operation button 51a for moving image shooting is displayed on the display screen 18a of the display unit 18. The operation buttons 51a are displayed in a sufficiently large size so that the operation buttons 51a can be reliably operated even when the user looks into the eyepiece display unit 17.

  In addition, although the example which performs video shooting in the imaging device 10 has been described in step S41 in FIG. 2, the connected device control unit 11e controls the other imaging device 20 in accordance with the video shooting operation, so that other shooting is performed. The device 20 may perform moving image shooting. Further, in this case, in the metadata adding process in step S19, a moving image obtained by moving image shooting by another shooting device 20 may be added as still image shooting metadata in step S18. . In addition, a moving image at a predetermined time before and after the still image shooting in step S18 may be automatically recorded as metadata regardless of whether or not a moving image shooting operation is performed.

  FIG. 6 is an explanatory diagram showing an example of the image comparison process in step S36 of FIG. 2, and FIG. 7 is a flowchart showing an operation flow of the image comparison process. 6A shows a state in which the telephoto image 42 captured by the imaging unit 12 of the imaging device 10 is displayed on the display screen 18a, and FIG. 6B shows the imaging unit 22 of the other imaging device 20. The wide-angle image 44 imaged by is shown on the display screen 28a. The image 45 in the wide-angle image 44 and the image 43 in the telephoto image 42 are obtained by imaging a bird that is the same subject.

  In step S51 of FIG. 7, the feature determination unit 11b determines the feature of the image (hereinafter referred to as a determination target image) at the center of the screen of the image captured by the imaging device 10 (the telephoto image 44). Next, the image comparison unit 11c sets a determination position in a captured image (wide-angle image 44) taken by another imaging device 20, and determines the characteristics of the image at the set determination position and the determination target image obtained in step S51. Compare with the result of.

  For example, assuming that the image 43a in FIG. 6C is a determination target image, the image comparison unit 11c sets a determination region having the same size as the image 43a in the wide-angle image 44 at a predetermined determination position and is similar. The feature is determined (step S53), and the feature matching degree is obtained (step S54).

  The image comparison unit 11c moves the determination area in the wide-angle image 44 (step S56), and repeats the similarity determination in steps S53 and S54. When the similarity determination of the determination area is completed at all determination positions, the process proceeds from step S55 to step S57, and it is determined whether the reduction limit of the determination target image has been reached. If the reduction limit has not been reached, the process proceeds to step S58, the determination target image at the center of the screen is reduced (step S58), and steps S52 to S56 are repeated.

  When the reduction limit of the determination target image is reached, the image comparison unit 11c sets the portion having the highest degree of feature matching as the reduction equivalent unit, and sets this portion as a view angle display region candidate. For example, as illustrated in FIG. 6C, the determination target images are sequentially reduced from the image 43 a to the images 43 b and 43 c, and similarity determination between these images and the image in the determination region of the wide-angle image 44 is performed. For example, when the degree of coincidence of the determination area that matches the image 43 c is the highest, it is assumed that this determination area is an image corresponding to the determination target image in the telephoto image 44. FIG. 6D shows the determination region 47 with a broken line.

  In the present embodiment, as described above, the angle of view display 46 indicating the position of the determination area 47 is displayed in the sub display area 41b as a frame image.

  In FIG. 7, the feature determination unit 11b has been described as performing feature determination at the center of the screen. However, the user may specify a position for feature determination.

  As described above, in the present embodiment, in the cooperative shooting mode, control is performed on other connected imaging devices, and the captured image of the own device and the captured image of the other imaging device are displayed on the same screen. . In addition, the field angle display indicates which region of the captured image of the other device corresponds to the captured image of the own device. As a result, it is possible to track a subject that could not be tracked by the own device again using a captured image of another photographing device. In addition, power consumption can be suppressed by turning off the display portions of other photographing devices. It is also possible to perform communication control of other photographing devices, and it is also possible to transmit an image photographed by the own device to a predetermined network via the other photographing devices. As a result, even a photographing device that does not have a network communication function can perform data communication such as image publication.

(Second Embodiment)
FIG. 8 is an explanatory diagram for explaining a second embodiment of the present invention. In FIG. 8, the same components as those in FIG. In this embodiment, tracking of a subject is facilitated in the cooperative shooting mode.

  The photographing apparatus 60 in the present embodiment is different from the first embodiment in that a signal processing and control unit 61 to which a photographing direction instruction unit 11f is added is employed. In the present embodiment, a wide-angle image is picked up by another photographing device 20, and a subject in the wide-angle image is picked up by the photographing device 60 at a telephoto position. In this case, a shooting direction for shooting with the shooting device 60 can be specified by using a wide-angle image of the subject to be tracked imaged by the other shooting device 20.

  In order to make it possible to specify the shooting direction equally in all directions, it is preferable that the optical axis of the other imaging device 20 and the optical axis of the imaging device 60 match. Therefore, before actual shooting, the adjustment operation of the optical axis of the imaging device 60 and the optical axis of the other imaging device 20 is performed.

  FIG. 9 is an explanatory diagram showing a mechanism for enabling such adjustment work of optical axis alignment, and FIG. 10 is a flowchart showing an operation flow of adjustment work by the signal processing and control unit 61. Note that the mechanism of FIG. 9 and the operation flow of FIG. 10 can be similarly applied to the photographing apparatus 10 of the first embodiment. Note that the adjustment work for matching the optical axes shown in FIGS. 9 and 10 is not a configuration essential to the present embodiment, and the visual field direction can be designated without performing the adjustment work for matching the optical axes. Is possible.

  In FIG. 9, the housing 10 a of the photographic device 60 and the other photographic device 20 are coupled by a screw and a ball joint 75. An eyepiece display unit 17 is disposed on the upper surface of the housing 10a, and a screw and a ball joint 75 are disposed on the upper surface of the eyepiece display unit 17. The screw and ball joint 75 includes a mounting body 76 having a spherical receiving portion, and a ball stud 71 having a spherical portion slidably supported by the spherical receiving portion. Another photographing device 20 is attached and fixed to the upper end of the ball stud 71.

  By tightening the screw 77, the spherical receiving portion of the mounting body 76 and the ball stud 71 are fixed to each other. By loosening the screw 77, the spherical portion of the ball stud 71 becomes slidable with respect to the spherical receiving portion, and the other photographing apparatus 20 is moved around the spherical portion in the elevation angle direction of the arrow 74a and the arrow 74b in FIG. It can be rotated in the azimuth direction. By fixing the optical axis of the other photographing apparatus 20 to the optical axis of the photographing apparatus 60 and then tightening the screw 77, the optical axes of the photographing apparatuses 60 and 20 can be fixed.

  For example, in step S61 in FIG. 10, auxiliary light is irradiated from another photographing device. FIG. 9 shows a state in which auxiliary light is irradiated on a chart 72 arranged in front of another photographing apparatus 20. An elliptical high-intensity portion 73 is projected on the chart 72 by the auxiliary light. In step S62, a message display instructing to adjust the optical axis position is displayed on the display screen 18a of the display unit 18. In the example of FIG. 9, a message “Please turn to a 1 m wall” is displayed.

  In the next step S63, the high luminance part 73 of the chart 72 is imaged by the imaging part 12 of the photographing device 60. FIG. 9 shows a state in which the high brightness portion 73 is displayed as a through image on the display screen 18a. The irradiation pattern is determined based on the shape and luminance distribution of the image portion corresponding to the high luminance portion 73 in the captured image obtained by the imaging unit 12. Whether or not the optical axes of the imaging device 60 and the other imaging device 20 coincide with each other by comparing the irradiation pattern determined by the imaging device 60 with the irradiation pattern of the high-intensity portion 73 by the auxiliary light irradiated by the other imaging device 20. Alternatively, the direction of deviation of the optical axis can be determined.

  If the optical axes match, the process proceeds from step S64 to step S65 to display, for example, an OK display on the display screen 18a. If the optical axes do not match, in step S66, another direction is displayed. A direction indication display indicating whether or not the photographing apparatus 20 should be directed is displayed on the display screen 18a, for example. In this case, the user changes the direction of the other photographing device 20 in accordance with the direction instruction display.

  Thereafter, the processes in steps S62 to S66 are repeated until an OK display is displayed. When the processing is completed, the photographing by the photographing device 60 and the irradiation of the auxiliary light by the other photographing device 20 are finished.

  In FIG. 8, the imaging direction instruction unit 11 f can instruct a direction (imaging direction) in which the imaging device 60 should perform imaging based on an image captured by the imaging device 60 and an image captured by another imaging device 20. It has become. For example, even if the tracking target is located at a position other than the imaging range of the imaging device 60, the imaging direction instruction unit 11 f, if the tracking target is located within the imaging range of the other imaging device 20, The shooting direction can be indicated. Note that the tracking target may be a subject specified by the user (hereinafter referred to as a target subject). For example, the target subject can be designated by a touch operation on the display screen of the photographing device 60. Even when the target subject is removed from the imaging range of the imaging device 60, if the target subject is imaged by another imaging device 20, the imaging direction of the imaging device 60 can be instructed so that tracking can be performed again.

  Note that the imaging device 60 may automatically determine a subject that moves at a predetermined speed or more as a tracking target. It is also possible to designate a shape such as a bird, an animal, or a person as a target subject. In this case, after the designated target subject enters the imaging range of the imaging device 60, the direction of imaging can be instructed.

  In the case where the optical axis of the imaging device 60 and the optical axis of the other imaging device 20 coincide with each other, if the other imaging device 20 performs imaging at a wider angle than the imaging device 60, the imaging device 60. The tracking subject that falls within the imaging range is always imaged by the imaging device 20, and the imaging direction can be instructed thereafter. However, even when the optical axis of the imaging device 60 and the optical axis of the other imaging device 20 do not match, the tracking target that falls within the imaging range of both the imaging device 60 and the imaging device 20 is imaged by the imaging device 20. As long as it continues, it is possible to indicate the shooting direction.

  FIG. 11 to FIG. 13 are explanatory diagrams for explaining how to instruct the photographing direction by the photographing direction instructing unit 11f. FIG. 11 shows the positional relationship between the imaging ranges of the photographing devices 60 and 20 and the subject. The photographer 31 supports the photographing device 60 with the hand 32 and performs photographing. As shown in FIG. 11, the imaging ranges 81 </ b> W and 82 </ b> W are shifted due to the optical axis error between the imaging device 60 and the other imaging device 20.

  In the example shown in FIG. 11, the shooting direction is indicated by (elevation angle, azimuth), and the center of the imaging range 81T at the telephoto of the imaging device 60 is used as a reference (81C (0, 0)). The center 82C (θh0, θv0) of the imaging range 82W at a wide angle is defined. As described above, due to the deviation of the optical axes of the photographing devices 60 and 20, a deviation occurs in the center position (black circle portion) of the imaging range.

  The target subject 83 is located in the vicinity of the center of the imaging range 81W at the wide angle of the imaging device 60, and the target subject 83 is located at the upper right end of the imaging range 81T at the telephoto range of the imaging device 60. In addition, the target subject 83 is located at the lower left corner of the imaging range 82W at the wide angle of the imaging device 20. That is, the target subject 83 is located within the imaging range of the imaging devices 60 and 20. Depending on the positional relationship between the position of the target subject 83 in the imaging range 81T and the position of the target subject 83 in the imaging range 82W, the shooting direction instruction unit 11f positions the center 82C of the imaging range 82W with reference to the center 81C of the imaging range 81T. Can be obtained by (elevation angle, azimuth angle).

  Here, as shown in FIG. 12, it is assumed that the target subject 83 (hatched circle) moves to a position shifted from the imaging range 81T. In FIG. 12, the center 82C (θh0, θv0) of the imaging range of the imaging device 20 is shown based on the center 81C (0, 0) of the imaging range of the imaging device 60. The position is shown with reference to the center 82C (θh0, θv0) of the imaging range of the imaging device 20.

  When the information on the center position of the target subject 83 is given from the photographing device 20, the photographing direction instruction unit 11 f instructs the photographing direction according to the chart of FIG. 13. In the example of FIG. 13, the shooting direction is indicated by an arrow. For example, when (θhs + θh0) is a value between −θh1 and + θh1 and (θvs + θv0) is a value between −θv1 and + θv1, that is, within the imaging range 81T, an arrow is used. Do not show. Further, for example, when (θhs + θh0) is a value between −θh1 and + θh1 and (θvs + θv0) is a value larger than θv1, that is, when positioned above the range of the imaging range 81T, it is upward. The display controller 11a is controlled to display the arrow.

  Next, the operation of the embodiment configured as described above will be described with reference to the flowchart of FIG. 14 and the explanatory diagram of FIG. In FIG. 14, the same steps as those in FIG. In FIG. 14, the illustration of the processing at the time of reproduction is omitted.

  In FIG. 14, if it is determined in step S70 that the cooperative shooting mode with another shooting device has been started, the other shooting device 20 is activated to instruct wide-angle shooting, and the display unit 28 is turned off. And requests an image from the imaging unit 22 (steps S31 and S32).

  In the present embodiment, in the cooperative shooting mode, an error between the center position of the imaging range of the shooting device 60 and the center position of the shooting range of the other shooting device 20 is obtained. First, the signal processing and control unit 61 widens the angle of view of the imaging device 60 so that the same subject such as the target subject is easily included in both the imaging ranges of the imaging devices 60 and 20 (step S71). Next, the imaging direction instruction unit 11f performs image comparison of the captured images from the imaging devices 60 and 20 (step S72), and obtains an error in the center position of these captured images by the method illustrated in FIG. For example, the center position of the captured image of the photographing device 20 is obtained based on the center position of the captured image of the photographing device 60.

  When the distance to the target subject is sufficiently large, if there is no change in the amount of deviation of the optical axes of the photographing devices 60 and 20, the direction indication display of the photographing direction is performed using the error obtained in step S37. May be performed.

  In step S74, the signal processing and control unit 61 determines whether or not the cooperative shooting mode is continued. If it is continued, the process proceeds to step S33. In steps S33 to S35, the main display area 41a and the sub display area 41b are displayed on the display screen 18a of the display unit 18 of the photographing device 60 (see FIG. 4).

  In the next step S75, the shooting direction instructing unit 11f determines whether the tracking target is outside the imaging range of the imaging device 60 and within the imaging range of the imaging device 20 according to the captured images of the imaging devices 60 and 20. Determine. At this stage, the tracking target such as the target subject is often located in the imaging range of both the photographing devices 60 and 20, and the process proceeds from step S75 to step S36. In this way, similarly to the first embodiment, the angle-of-view display 46 indicating the imaging range of the main display area 41a is displayed in the sub display area 41b (step S37).

  Here, it is assumed that a zoom operation is performed in the imaging device 60 and the imaging range changes to the imaging range 81T by telephoto. Then, it is assumed that the tracking target moves to a position outside the imaging range 81T and within the imaging range 82W of the imaging device 20.

  In this case, the shooting direction instructing unit 11f shifts the process from step S75 to step S76 to determine whether or not the target subject exists, and then in step S77, the method of FIG. 12 and FIG. For example, an arrow display for direction indication is displayed. When there is no target subject, such as when the target subject is not set, the shooting direction instructing unit 11f instructs the fast-moving subject as a tracking target according to the movement (step S78).

  FIG. 15A shows a state in which the photographer 31 supports the casing 10a with the hands 32L and 32R and tries to photograph the target subject 85. The target subject 85 is located in the imaging range of the imaging device 20 on the right side of the imaging range of the imaging device 60. In this case, the shooting direction instruction unit 11f controls the display control unit 11a to display a direction instruction display 87 indicating that the shooting direction should be moved to the right side for shooting the target subject 85. Display above.

  The shooting direction instruction unit 11f can display a direction instruction display according to FIG. 13 on the display screen 18a. Thus, the photographer can recognize in which direction the photographing device 60 should be directed in order to track the target subject while viewing the direction indication display on the display screen 18a.

  Further, in the present embodiment, the signal processing and control unit 61 determines whether or not the tracking target has moved outside the imaging range of the imaging device 60 during the video shooting at the telephoto by the imaging device 20 (Step S1). In S79), when moving, the other photographing device 20 performs moving image photographing (step S80). As a result, even when it is not possible to shoot a moving image of the target subject with the photographic device 60, it is possible to shoot a wide-angle moving image with the other photographic device 20. In this case, in step S42, not only the moving image shooting by the shooting device 60 but also the moving image shooting by the shooting device 20 is stopped.

  As described above, in the present embodiment, if the tracking target is captured by another photographing device, the display unit obtains the direction to be taken to capture the tracking target even when the tracking target leaves the imaging range. Can be displayed as a direction indication display. Thereby, the photographer can easily track even a fast-moving subject. Moreover, the direction indication display is displayed in the vicinity of the through image display area, so that the direction indication display can be easily confirmed.

  In the above-described embodiment, the direction in which the imaging device is directed to track the tracking target is indicated to the user by the direction indication display. However, the direction in which the imaging device is directed to track the tracking target is indicated by sound indicating the direction. You may make it show to a user.

  In each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. A camera for moving images may be used, and a camera built in a personal digital assistant (PDA) such as a mobile phone or a smartphone may of course be used.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  It should be noted that even if the operation flow in the claims, the description, and the drawings is described using “first,” “next,” etc. for convenience, it is essential to carry out in this order. It doesn't mean. In addition, it goes without saying that the steps constituting these operation flows can be omitted as appropriate for portions that do not affect the essence of the invention.

  Of the techniques described here, the control mainly described in the flowchart is often settable by a program and may be stored in a recording medium or a recording unit. The recording method for the recording medium and the recording unit may be recorded at the time of product shipment, may be a distributed recording medium, or may be downloaded via the Internet.

    DESCRIPTION OF SYMBOLS 10 ... Imaging device, 11 ... Signal processing and control part, 11a ... Display control part, 11b ... Feature determination part, 11c ... Image comparison part, 11d ... Angle-of-view display part, 11e ... Connection apparatus control part, 11f ... Shooting direction instruction | indication Unit, 12 ... imaging unit, 14, 24 ... communication unit, 17 ... eyepiece display unit, 18 ... display unit, 19 ... recording unit, 20 ... other communication devices, 22 ... imaging unit, 21 ... signal processing and control unit, 28: Display unit.

Claims (5)

An imaging device including an imaging unit that outputs a first captured image obtained by imaging a subject ,
A communication unit capable of performing an imaging process and a communication process and obtaining a second captured image by the imaging process and communicating with another imaging apparatus separate from the imaging apparatus having the imaging unit ;
A connected device control unit that controls imaging processing of the other imaging device by communication of the communication unit;
A control unit that controls whether to perform shooting in the linked shooting mode with the other shooting device based on the shooting operation;
A feature determination unit that determines an image feature of the center of the screen in the first captured image related to the imaging device in the cooperative imaging mode;
An image comparison unit that compares the image feature of the center of the screen in the first captured image with the image feature of the second captured image in the other imaging device during the cooperative shooting mode;
Comprising
The image comparison unit sequentially reduces the first captured image on the second captured image in the other imaging device while sequentially performing a reduction process on the image at the center of the screen in the first captured image. A position having the highest degree of coincidence with the feature of the image at the center of the screen in the captured image is set as a view angle display area candidate on the second captured image,
The connected device control unit displays an index indicating the region set as the field angle display region candidate in the image comparison unit on the second captured image in the other imaging device separate from the imaging device. To control the other device to display
An imaging device characterized by that .   A linked shooting method by the shooting device for shooting in cooperation between the shooting device and another shooting device separate from the shooting device,
  An imaging step of outputting a first captured image obtained by imaging a subject;
  A communication step in which imaging processing and communication processing are possible and communication is performed with another imaging device that obtains a second captured image by the imaging processing;
  A connected device control step for controlling imaging processing of the other photographing device by the communication step;
  A control step for controlling whether to perform shooting in the linked shooting mode with the other shooting device based on the shooting operation;
  A feature determination step of determining an image feature of the center of the screen in the first captured image related to the imaging device in the cooperative imaging mode;
  An image comparison step for comparing the image feature of the central portion of the screen in the first captured image with the image feature of the second captured image in the other photographing device during the cooperative photographing mode;
  The center of the screen in the first captured image that is sequentially reduced on the second captured image in the other photographing device while sequentially performing the reduction process on the image in the center of the screen in the first captured image. A setting step of setting a position having the highest degree of coincidence with the feature of the image of the part as a candidate for an angle of view display area on the second captured image;
  The other photographing so that the index indicating the region set as the field angle display region candidate in the setting step is displayed on the second captured image in the other photographing device separate from the photographing device. Controlling the equipment;
  A cooperative photographing method characterized by comprising:   A linked shooting program by the shooting device for shooting in cooperation between the shooting device and another shooting device separate from the shooting device,
  On the computer,
  An imaging step of outputting a first captured image obtained by imaging a subject;
  A communication step in which imaging processing and communication processing are possible and communication is performed with another imaging device that obtains a second captured image by the imaging processing;
  A connected device control step for controlling imaging processing of the other photographing device by the communication step;
  A control step for controlling whether to perform shooting in the linked shooting mode with the other shooting device based on the shooting operation;
  A feature determination step of determining an image feature of the center of the screen in the first captured image related to the imaging device in the cooperative imaging mode;
  An image comparison step for comparing the image feature of the central portion of the screen in the first captured image with the image feature of the second captured image in the other photographing device during the cooperative photographing mode;
  The center of the screen in the first captured image that is sequentially reduced on the second captured image in the other photographing device while sequentially performing the reduction process on the image in the center of the screen in the first captured image. A setting step of setting a position having the highest degree of coincidence with the feature of the image of the part as a candidate for an angle of view display area on the second captured image;
  The other photographing so that the index indicating the region set as the field angle display region candidate in the setting step is displayed on the second captured image in the other photographing device separate from the photographing device. Controlling the equipment;
  Collaborative shooting program to execute.   In the linked shooting mode, a shooting direction instruction unit that instructs the shooting direction of the shooting device,
  The photographing direction instruction unit instructs the photographing direction of the photographing device when a target to be tracked in the first captured image of the photographing device moves outside the photographing range.
  The photographing apparatus according to claim 1, wherein:   The imaging direction instruction unit instructs imaging by the other imaging device when an object to be tracked in the first captured image of the imaging device moves out of the imaging range.
  The photographing apparatus according to claim 4, wherein

Images