JP2010016511A - Photographing device, control method of photographing device, image display, image display method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a photographing device easily representing the moving state of a photographing position, and to provide a control method of the photographing device, an image display, an image display method and a program. <P>SOLUTION: A camera 10 which performs continuous photographing while moving the photographing position in a fixed positional relation between a photographer and the photographing device includes: a photographing part 1 which obtains image data of an object image; a background change determination part 4 which determines a change in a background image changing with movement of the photographing position; an image processing part 7 which changes the size of continuously photographed images on the basis of the determination result; and a display part 8 which displays images processed by the image processing part 7. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to an imaging device, an imaging device control method, an image display device, an image display method, and a program. More specifically, the present invention relates to a moving image or a continuous-shot digital image captured by an imaging device such as a digital camera or a video camera. The present invention relates to a photographing apparatus that reproduces and displays a moving image, a control method for the photographing apparatus, an image display apparatus, an image display method, and a program.

  In recent years, techniques for taking digital images and image processing have been improved, the boundaries between digital cameras and video cameras have been eliminated, and it has become easier to handle a large number of images. Conventionally, a photographing apparatus such as a camera, which has been a simple photographing tool, has digitized image signals, and it has become easy to exchange data with many devices such as personal computers and televisions.

  Assuming such a state of being played back by various playback devices, effective playback suitable for each playback device is required, but conventional devices usually play back the captured images as they are. For this reason, it tends to be a monotonous image, and it has not always been suitable for reproduction by a reproduction device such as a television in front of many viewers. As a result, there was a situation in which the photographed image was not viewed while the image remained in the photographing apparatus.

Therefore, various playback apparatuses have been proposed in which images taken are not simply displayed as they are, but are arranged according to the situation. For example, Patent Document 1 includes subject images based on motion information of feature points of a subject so that the movement trajectory and motion form of a moving subject such as a sports player such as a swing such as golf can be easily grasped. An image synthesizing apparatus has been proposed that extracts an image in a specific area and displays the extracted images in a superimposed manner.
JP 2003-141505 A

Patent Document 2 discloses an image processing apparatus that realizes image display in accordance with the movement of a subject included in moving image data and generates a still image that can intuitively grasp the movement of the subject. The image processing apparatus can generate a trajectory image by processing a frame image, combine the still image and the trajectory image, and generate a still image in which the motion state of the subject is expressed.
JP 2000-187478 A

  According to the above-mentioned patent document, a device has been devised in expressing a moving subject, but it has not been intended to express a state of moving.

  The present invention has been made in view of such circumstances, and there is provided a photographing apparatus, a photographing apparatus control method, an image display apparatus, an image display method, and a program capable of easily expressing a moving state. The purpose is to provide.

  In order to achieve the above object, a photographing apparatus according to a first aspect of the present invention acquires image data of a subject image in a photographing apparatus that performs continuous photographing while moving the photographing position while keeping the positional relationship between the photographer and the photographing apparatus constant. Based on the imaging unit, a determination unit that determines a change in the background image that changes with the movement of the imaging position based on the image data, and a size of the continuously captured image based on the determination by the determination unit And an image display unit for displaying an image processed by the image processing unit.

According to a second aspect of the present invention, in the first aspect, the photographing unit can change the photographing direction toward the front and rear of the photographing apparatus.
According to a third aspect of the present invention, in the first invention, the determination unit detects a motion vector of a background image, and the image processing unit performs the continuous operation when the motion vector is centered. Image processing is performed to change the size of the image.

According to a fourth aspect of the present invention, there is provided a photographing apparatus according to the first aspect, further comprising a face detection unit that detects whether or not a person's face is present in the image, and the image processing unit includes the face detection unit. When it is detected that there is a face, image processing for changing the size of the continuous image is performed.
According to a fifth aspect of the present invention, in the first aspect, the determination unit performs the determination during continuous shooting by the shooting unit, and records the determination result together with the continuous image.

In the image processing apparatus according to a sixth aspect of the present invention, in the first aspect, the photographing unit includes a front photographing unit that photographs the front of the photographing device and a rear photographing unit that photographs the rear, and the front photographing unit. The images taken by the rear photographing unit are simultaneously recorded.
In the photographing apparatus according to a seventh aspect based on the sixth aspect, the determination unit makes a determination based on an image photographed by the front photographing unit.
According to an eighth aspect of the present invention, in the first aspect, the photographing unit includes a zoom lens, and the determination unit considers a change in zoom ratio in the determination.

  According to a ninth aspect of the present invention, there is provided a method for controlling a photographing apparatus, wherein the photographing apparatus control method performs continuous photographing while moving the photographing position while keeping the positional relationship between the photographer and the photographing apparatus constant. Determining a change in the background image that changes with the movement of the shooting position based on the image data, performing image processing for changing the size of the continuously shot image based on the determination, and Display the processed image.

  An image display device according to a tenth aspect of the present invention determines an image storage unit that stores continuously captured image data, and a change in a background image that changes as the shooting position moves based on the image data. A determination unit; an image processing unit that changes a size of the continuously photographed image based on the determination by the determination unit; and an image display unit that displays an image processed by the image processing unit. It has.

In the image display device according to an eleventh aspect according to the tenth aspect, the determination unit detects a motion vector of a background image, and the image processing unit is continued when the motion vector is centered. Image processing is performed to change the size of the image.
An image display device according to a twelfth aspect of the present invention is the image display apparatus according to the tenth aspect of the present invention, further comprising a face detection unit that detects whether or not there is a human face in the image. When it is detected that there is a face, image processing is performed to change the size of the continuous images.

In an image display device according to a thirteenth invention, in the tenth invention, the image display unit first displays the most reduced image, and thereafter gradually enlarges the most reduced image, Display each image.
In the image display device according to a fourteenth aspect based on the tenth aspect, the image display unit superimposes and displays the most reduced image on the last image. Display while removing.

  An image display method according to a fifteenth aspect of the present invention stores continuously captured image data, determines a change in a background image that changes as the shooting position moves based on the image data, and performs the above determination. Based on this, image processing for changing the size of the continuous image is performed, and the image processed image is displayed.

  A program according to a sixteenth invention includes a step of storing continuously captured image data, a step of determining a change in a background image that changes with movement of a shooting position based on the image data, Based on the determination, the computer is caused to perform an image processing for changing the size of the continuous images and a step for displaying the image processed images.

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device which can express a mode of moving easily, the control method of an imaging device, an image display apparatus, the image display method, and a program can be provided.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. The camera according to the first embodiment of the present invention has an imaging unit capable of imaging the rear of the camera for acquiring moving images, starts acquiring moving image data according to the operation of the release button, and records this. Record on media. If there is a photographer's face in the center of the recorded image and the background motion vector is in the center, that fact is recorded and person movement playback is performed during playback. In this person movement reproduction, the size of the background image is made constant, the size of the photographer's face is changed, and an image as if the photographer is moving is reproduced in the background image. ing.

  FIG. 1 is a block diagram showing the configuration of a camera according to the first embodiment of the present invention. A camera 10 is a digital camera that captures an image of a subject. The camera 10 includes a photographing unit 1, an image recording control unit 2, a face detection unit 3, a background change determination unit 4, an operation unit 5, an image processing unit 7, and a display unit 8.

  The photographing unit 1 is disposed above the main body of the camera 10, and the photographing direction is rotatable forward and backward of the main body of the camera 10 as shown in FIG. When the photographing unit 1 is directed forward, the subject can be photographed mainly, and when the photographing unit 1 is directed backward, the photographer's face can be photographed mainly. The photographing unit 1 includes an optical system for forming a subject image, an image sensor that photoelectrically converts the subject image, and an image processing unit that processes an image signal output from the image sensor. Output image data.

  The image recording control unit 2 performs overall control of the camera 10 according to a stored program and records moving image image data output from the photographing unit 1. The face detection unit 3 inputs a photographed image from the photographing unit 1 and determines whether or not a person's face exists in the photographed image. If a person's face exists, the position or face Detect the size.

  The background change determination unit 4 inputs the captured image output from the imaging unit 1 through the face detection unit 3 and determines whether or not the motion vector of the background image has changed. If the motion vector has changed, the direction is also determined. The detection result of the face detection unit 3 and the determination result of the background change determination unit 4 are output to the image processing unit 7.

  The operation unit 5 is an operation member such as a release button 5a or a zoom button provided in the camera 10. As shown in FIG. 2A, the release button 5a is arranged on the upper surface of the main body of the camera 10. When the release button 5a is operated, the camera 10 starts shooting a moving image, and the release button is operated again. Then, the movie shooting is stopped. The operation state of the operation unit 5 is transmitted to the image recording control unit 2.

  As shown in FIG. 2A, the display unit 8 includes a display device such as a liquid crystal monitor disposed on the back surface of the camera 10, and reproduces and displays a moving image recorded in the image recording control unit 2. Further, the moving image acquired by the photographing unit 1 is displayed as a so-called live view for observing the subject image.

  The image processing unit 7 performs image processing for the person movement reproduction display on the moving image acquired by the photographing unit 1 based on the detection result of the face detection unit 3 and the determination result of the background change determination unit 4. The composite image generated by the image composition unit 7 is displayed on the display unit 8.

  Next, the operation in the present embodiment will be described. First, the person movement reproduction in the present embodiment will be described with reference to FIGS. 3 and 4. FIG. 3 shows an image when the photographing unit 1 of the camera 10 is rotated toward the photographer and the user walks while holding the camera 10 in this state. The image at this time changes as shown in FIGS. That is, since the photographer holds the camera 10, the size of the face hardly changes, but the background gradually moves away as the user moves. Therefore, as shown by the broken line in the figure, the image of the peripheral portion of the background changes so as to be centered.

  However, this change is only from the viewpoint of the photographer (or camera) that is the subject, and the landscape does not change for those who are looking at this photographer from a distance. Seems to be approaching. In order to generate such an image, for example, as shown in FIG. 4, the image of FIG. 4A is reduced so that the size of the background image becomes constant (the interval indicating the background window is (It is a parallel line).

  That is, as shown in FIG. 4, the reproduction display in which the size of the person changes without changing the size of the landscape image is not unnatural and may be depending on the viewer's consciousness. Of course, the photographer himself does not want to shoot only the self-centered image, but only the self-centered image due to camera restrictions. In a device such as a digital camera in which image expression can be corrected relatively freely by image processing technology, as shown in FIG. 4, it can be played back as a slide show or video so that a person approaches the scene. It becomes possible. By adopting such an expression format, the image can be changed and enjoyed.

  Next, a flow for performing person movement reproduction as shown in FIG. 4 from a moving image will be described with reference to a flowchart shown in FIG. Such reproduction display is effective when the photographer moves forward. Therefore, in this flow, it is assumed that the photographer is walking around holding the camera 10.

  When the flow of person movement reproduction is entered, the background part (peripheral part other than the face of the person) of each frame constituting the moving image is extracted and it is determined what pattern the background part has (S21). . Subsequently, shooting frames and scene classification are performed using similar background patterns (S22). In this step, based on the determination result in step S21, it is determined whether the background patterns are similar, a group of similar frames is extracted, and scene classification is performed for each group.

  Next, the reduction ratio is determined by changing the background pattern for each scene (S23). In other words, each scene composed of a group of classified frames should change so that the background moves away. For each scene, the change rate of the background image is obtained, and the image reduction rate is calculated based on this. (S23). Subsequently, the first image for each scene is reduced according to the reduction ratio (S24).

  That is, when a moving image is photographed while the photographing unit 1 of the camera 10 is pointed at the photographer and the camera 10 is held and walking forward, the first photographed image is an image that the photographer can see small and far away. The last image taken is an image in which the photographer can see a large image nearby. Therefore, during playback, the image played back at the beginning of each scene is the most reduced image, and is then gradually enlarged from the most reduced image, with the last image being the same size image. To play.

  In step S21 to step S24, since preparation for playback display is completed, playback is started for each scene (S25). Subsequently, the background pattern determination of the reproduced frame is determined (S26), the background pattern of the reproduced frame is determined (S27), and the enlarged reproduction is performed so that there is no background pattern change (S28). That is, in steps S25 to S28, the background pattern of the frame that has been played back is compared with the background pattern of the frame to be played back, and the playback display is performed while enlarging the image from the most reduced image so that there is no change in the background pattern. I do.

  Once the enlarged reproduction is performed, it is next determined whether or not the person movement reproduction is finished (S28). In this step, it is determined whether or not the playback of all the shooting frames that are subject to person movement playback from among the shooting frames that are played back with moving images has been completed. If the result of this determination is that the processing has not ended, the process returns to step S25 to reproduce and display the next shooting scene. On the other hand, if the result of determination is that the processing has ended, the flow returns to the original flow. By executing this flowchart, the person moving reproduction as shown in FIG. 4 can be performed.

  Next, the operation of the camera 10 in the first embodiment of the present invention will be described using the flowchart shown in FIG. In the present embodiment, as described with reference to FIGS. 3 to 5, it is possible to shoot the shooting unit 1 toward the photographer's face, which is convenient for performing playback display of person playback movement. If it is good, perform “determination to move away” and record this. In the case of reproduction, in the case of a moving image that has been “decided to move away”, person movement reproduction is performed.

  When a battery is loaded into the camera 10 and a power-on reset is performed, or when a power switch is turned on, the camera control flow is entered. First, it is determined whether or not the camera 10 is set to a shooting mode (S1). ). The camera 10 can be set in a shooting mode and a playback mode by a photographer. If the result of determination in step S1 is that a shooting mode has been selected, it is determined whether or not to perform shooting (S2).

  Whether or not to perform this shooting is determined by detecting whether or not the release button of the operation unit 5 has been pressed. In the present embodiment, continuous shooting starts when the release button is pressed once, and continuous shooting ends when the release button is pressed again. Note that continuous shooting means continuous shooting and shooting with a moving image, but any mode other than this may be used as long as a plurality of frames are continuously shot.

  If the result of determination in step S2 is that shooting has not been made, processing returns to step S1. On the other hand, if it is shooting, continuous shooting and recording are performed (S3). In this step, the image is taken by the photographing unit 1 and the image data is recorded in the image recording control unit 2. Note that when the photographing unit 1 faces the rear (back side) of the camera 10, the photographer's face and the like are photographed together with the rear image, and image data is recorded.

  Subsequently, it is determined whether or not there is a face in the center of the captured image (S4). In this step, based on the image data output from the imaging unit 1, the face detection unit 3 determines whether or not there is a face in the approximate center of the captured image. If the result of determination is that there is no face in the center, processing returns to step S3 and continuous shooting is continued.

  If the result of determination in step S4 is that there is a face in the center, it is next determined whether or not the change in the face is small (S5). In this step, it is determined whether or not the temporal change in the size of the face detected by the face detection unit 3 is large. As a result of the determination, if the change is large, the process jumps to step S9. On the other hand, if the change is small, the process proceeds to a step for performing the “departure determination”.

  That is, when a face is in the center of continuously captured images and the size does not change much, it is considered that the positional relationship between the camera 10 and the subject (face) has not changed. In this state, as described above, there is a possibility that the photographing unit 1 is rotated in the direction of the photographer and the face of the photographer and the background thereof are photographed.

  Subsequently, the motion vector of the background portion is detected (S6). In this step, the background change determination unit 4 detects the motion vector of the background portion based on the image data obtained by the photographing unit 1 obtained through the face detection unit 3. Next, it is determined whether or not the detected motion vector is toward the center (S7). That is, when the motion vector is directed toward the center on both the left and right sides as indicated by the arrows shown in FIG. 3B, the direction of the motion vector is determined to be centered.

  If the result of determination in step S7 is that the motion vector is not centered, processing returns to step S3 and continuous shooting and recording are continued. On the other hand, if the result of determination is that the motion vector is centered, “determination to move away” is performed (S8). That is, this state is a state in which the camera 10 moves forward while photographing the photographer's face together with the background. In this state, as a “determination to move away”, image recording control is performed together with image data of continuous shooting. Record in Part 2.

  Subsequently, it is determined whether or not the photographing is finished (S9). In this step, it is determined whether or not the release button 5a has been operated again. If the result of this determination is that photography has not ended, processing returns to step S3, and continuous photography and recording are continued. On the other hand, if the shooting has been completed, a shooting end process is performed (S10). When the photographing is finished, the process returns to step S1.

  As described above, in this embodiment, when continuous shooting is started, it is determined whether or not the photographer's face is shot together with the background image. If this condition is met, the determination of moving away is shot. If the image is recorded together with this condition and this condition is not met, the photographed image is recorded as it is.

  Next, if the result of determination in step S1 is not shooting mode, it is playback mode. In this case, it is determined whether or not a playback image has been selected (S11). In this step, it is determined whether or not a reproduction image is selected from the continuous images by a reproduction operation member (not shown) of the operation unit 5. If the result of this determination is that a playback image has not been selected, processing returns to step S1.

  If the result of determination in step S3 is that a playback image has been selected, it is determined whether or not playback is to be performed (S12). If the result of this determination is not playback, processing returns to step S11. On the other hand, in the case of reproduction, it is determined whether or not it is “determination to move away” (S13). As described above, when the photographer's face is photographed together with the background image at the time of photographing, the “determination to move away” is recorded together with the continuous image. Therefore, in this step, is the “determination to move away” recorded. Determine whether or not.

  As a result of the determination in step S13, if “determination to move away” is recorded, person moving reproduction is performed (S14). This person movement reproduction is the flow shown in FIG. 5 described above. As described with reference to FIG. 4, the reduction rate is changed so as not to change the size of the background image, and the photographer walks from a distance. The image processing is performed so as to appear, and the image is reproduced and displayed on the display unit 8.

  If the result of determination in step S13 is that “departure determination” has not been recorded, normal image reproduction is performed (S15). The normal image reproduction is reproduction without enlarging or reducing the photographed image, and the photographed image recorded in the image recording control unit 2 is reproduced and displayed on the display unit 8 as it is. When normal image reproduction is performed, the process returns to step S1.

  As described above, according to the present embodiment, when the photographer himself / herself is photographed at the time of continuous image photographing, this (“determination to move away”) is recorded, and at the time of reproduction, the size of the background image is recorded. Reproduction display is performed while changing the reduction ratio so as to be constant. For this reason, while photographing yourself, it is possible to make an expression as if you were photographing yourself approaching as seen by a person waiting over there.

  Next, a second embodiment of the present invention will be described with reference to FIGS. In the first embodiment of the present invention, the photographing unit 1 capable of photographing only in one direction is provided, and when the photographer himself photographs the self based on the image data from the photographing unit 1, the person moves. I was playing. On the other hand, in the second embodiment, a two-camera method that can simultaneously shoot and record two images of the front and rear is adopted, and the photographer himself / herself is photographed at the time of playback to determine whether or not he has moved away. Whether or not to perform person movement reproduction is determined based on the above.

  FIG. 7 is a block diagram showing a configuration of the camera 10 according to the second embodiment of the present invention. The camera 10 according to the present embodiment is also a digital camera that captures an image of a subject and acquires an image. The camera 10 includes a front photographing unit 1a, a rear photographing unit 1b, an image recording control unit 2, a background change determination unit 4, an operation unit 5, an image processing unit 7, and a display unit 8.

  The front photographing unit 1a is disposed in front of the main body of the camera 10 and is a photographing unit mainly for photographing a subject, and acquires a front image. As shown in FIG. 8, the rear photographing unit 1 b is arranged behind the main body of the camera 10 and is a photographing unit for self-photographing mainly taking a photographer's face, and acquires a rear image. Each of the front photographing unit 1a and the rear photographing unit 1b includes an optical system for forming a subject image and an image sensor that photoelectrically converts the subject image, and processes an image signal output from each image sensor. A processing unit or the like is provided, and each image data is output. In addition, you may comprise the front imaging | photography part 1a with a zoom lens.

  Similar to the first embodiment, the image recording control unit 2 performs overall control of the camera 10 according to a stored program. The image recording control unit 2 includes an auxiliary recording unit 2a that temporarily stores image data output from the front photographing unit 1a and an auxiliary recording unit 2b that temporarily stores image data output from the rear photographing unit 1b. Then, both the image data of the continuous images output from both the photographing units 1a and 1b are recorded.

  The background change determination unit 4 receives image data from the front photographing unit 1a, and determines whether or not the motion vector of the image has changed, as in the first embodiment. If the motion vector has changed, the direction is also determined. The determination result of the background change determination unit 4 is output to the image processing unit 7.

  In the first embodiment, the person and the background are separated from the image acquired by the photographing unit 1, and the movement is determined from the background image. However, in the case of the two-camera system as in the second embodiment, the background is determined based on the forward shooting, and the person movement reproduction that emphasizes the movement of the person is performed. In the second embodiment, it is of course possible to separate only the background from the image of the rear photographing unit 1b and determine the movement from the background.

  The front image and the rear image by the front or rear photographing units 1a and 1b recorded in the auxiliary recording units 1a and 1b in the image recording control unit 2 are either one via the image processing unit 7 as necessary. It can be reproduced and displayed on the display unit 8. Further, the image processing unit 7 performs reproduction display by person movement reproduction according to the detection result of the background change determination unit 4.

  Since the configuration other than the above is the same as that of the first embodiment, the same configuration is denoted by the same reference numeral, and detailed description thereof is omitted.

  In addition, a communication unit (not shown) for outputting the image processed by the image processing unit 7 to the outside is provided, and the reproduction of the captured image is displayed on the display unit 8 and externally via this communication unit. Of course, it may be displayed on a TV monitor or the like. Further, as in the present embodiment, an image photographed by a two-camera camera may be subjected to image processing for moving and reproducing a person in a reproducing apparatus such as a television.

  Next, the operation of this embodiment will be described. First, the photographing method in this embodiment will be described. FIG. 9 shows a situation where the photographers 30 a to 30 c hold the camera 10 and take a video while walking toward the subject 35. At this time, rear images 41 a to 41 c are taken by the rear photographing unit 1 b of the camera 10.

  That is, the back image 41a is obtained by photographing at the position of the photographer 30a. In this rear image 41a, the photographer 30a and the lake 31 behind it are photographed. When the photographer 30a moves forward from the position of the photographer 30a and shoots at the position of the photographer 30b, a rear image 41b is obtained. In the rear image 41b, the photographer 30b and the lake 31 and the tree 32 behind the photographer 30b are photographed.

  When the photographer 30b moves forward from the position of the photographer 30b and shoots at the position of the photographer 30c, a rear image 41c is obtained. In the rear image 41c, the photographer 30c and the lake 31 and the tree 32 behind the photographer 30c are photographed.

  As described above, the back images 41a to 41c are obtained by the photographing method according to the present embodiment, and conventionally, the back images 41a to 41c are reproduced and displayed as they are, which is a celestial image expression. However, when the photographers 30a to 30c photographed by such a photographing method are viewed from the subject 35 side, the background does not change and appears to gradually increase as the person (photographers 30a to 30c) approaches. It should be. In the present embodiment, a person (photographers 30a to 30c) viewed from the subject 35 side is reproduced and displayed in a pseudo manner. In other words, it is reproduced and displayed with a ground motion-like image expression.

Next, the operation of this embodiment will be described with reference to the flowchart shown in FIG.
When the flow shown in FIG. 10 is entered, it is determined whether or not the shooting mode is set, as in the first embodiment (S1). If the result of this determination is that a shooting mode has been selected, it is determined whether or not to perform shooting (S2). As a result of this determination, if shooting is not performed, the process returns to step S1.

  If the result of determination in step S2 is that shooting is to be performed, two cameras are continuously shot and recorded (S102). In this step, the front photographing unit 1a and the rear photographing unit 1b respectively perform photographing, and both image data are simultaneously recorded in the image recording control unit 2. Subsequently, zoom ratio is considered (S103), and peripheral motion vector detection is performed based on the front image (S104). The detection of the peripheral motion vector is not limited to the front image, and a peripheral image of the rear image obtained from the rear photographing unit 1b may be used.

  When zooming is performed in the front photographing unit 1a, the motion vector detection in the screen is disturbed. That is, even if the subject of the front image is constant and does not move, the detection result is such that the motion vector moves when zooming. Therefore, when it is detected in step S103 that zooming is being performed, the position where the motion vector is detected before and after zooming is adjusted in step S104.

  Next, it is determined whether or not the motion vector changes radially (S105). When the photographers 30a to 30c move in a straight line and perform continuous shooting, front images 42a to 42c in which the subject 35 is shot are as shown in FIGS. 11 (a) to 11 (c). Gradually the subject 35 becomes larger. In such a case, the motion vector becomes radial.

  If the result of determination in step S105 is that the motion vector is not radial, jump to step S9. On the other hand, if the result of determination is that the motion vector is radial, determination is made that the photographer goes straight and recording is performed (S106). That is, the fact that the photographer is moving straight is recorded at the same time when the images continuously photographed by the front photographing unit 1a and the rear photographing unit 1b are recorded.

  Next, as in the first embodiment, it is determined whether or not the photographing is finished (S9). If the result of this determination is that shooting has not ended, the flow returns to step S102 to continue continuous shooting and recording with two cameras. On the other hand, if the result of determination is that photographing has not ended, photographing termination processing is performed as in the first embodiment (S10). When the photographing end process is finished, the process returns to step S1.

  As described above, in the present embodiment, when the photographer is photographing while moving straight, this information is added to the image and recorded. For this reason, when this information is detected during reproduction, the same person movement reproduction as in the first embodiment can be performed. That is, when the vehicle is traveling straight, as shown in FIGS. 12 and 13, it can be reproduced and displayed in a manner that a third person has photographed, even though the photographer has photographed himself / herself. .

  In the example shown in FIG. 12, the reduced image is displayed as the image is gradually enlarged as shown in FIGS. Further, in the example shown in FIG. 13, the reduced past image is superimposed on the final image as shown in FIGS. 13A to 13C, and the past image gradually decreases. Finally, only the final image is displayed. In any case, if the photographer goes straight ahead, the expression is such that the photographer appears from the landscape.

  Next, the playback display flow of FIG. 10 will be described. If the result of determination in step S <b> 1 is not shooting mode, it is determined whether or not a playback image has been selected as in the first embodiment (S <b> 11). If the result of this determination is that a playback image has not been selected, processing returns to step S1. On the other hand, if it is selected, as in the first embodiment, it is determined whether or not to start reproduction (S12). If the result of this determination is that playback has not started, processing returns to step S11.

  On the other hand, if the result of determination in step S12 is that playback has started, it is determined whether or not the photographer is going straight ahead (S113). As described above, when the photographer is moving straight in step S106, the information is recorded in association with the image. In step S113, it is determined whether or not this information is recorded.

  If the result of determination in step S <b> 113 is that the photographer has not traveled straight, the process jumps to step S <b> 116. On the other hand, if the photographer is traveling straight as a result of the determination, it is determined whether or not the photographer continues traveling for a predetermined time or longer (S114). When continuous shooting that is the subject of person movement playback is very short, the images are switched complicatedly and unsightly, so it is determined whether or not the images will continue for a predetermined time or longer.

  If the result of determination in step S114 is that it has not continued for a predetermined time or longer, the routine jumps to step S116. On the other hand, if the result of this determination is longer than the predetermined time, the person movement reproduction is inserted (S115). Since the continuous images satisfying the conditions of steps S113 and S114 are monotonic for a predetermined time, the flow shown in FIG. 5 is executed, and the person moving reproduction as shown in FIGS. 12 and 13 is performed. Playback display by.

  By inserting this person movement reproduction, as shown in FIGS. 14 (a) to 14 (f), even if the scene is simply approaching the subject church, FIGS. 14 (b) to 14 (d). As shown in FIG. 6, the image representation can be changed by inserting the photographer's own image.

  If the result of determination in step S113 or step S114 is No, the front image is played back as in the normal video camera video playback (S116). In step S116, the front image and the back image may be displayed alternately as shown in FIG. That is, the front images shown in FIGS. 15A, 15C, and 15E and the back images shown in FIGS. 15B and 15D are alternately displayed.

  If only the back image is to be displayed, the back image cannot be changed so much unless the face of the photographer showing the majority of the image is monotonous and its expression changes. According to the playback display shown in FIG. 15, it is possible to change the back image without the photographer being conscious, and to eliminate the embarrassment that his face frequently appears. Become.

  According to the second embodiment of the present invention, the front and rear of the camera 10 are always photographed at the same time, and when the photographer goes straight during the reproduction, the person moving reproduction is performed. Therefore, it is possible to easily express how the photographer moves based on the image photographed by the photographer himself.

  In the present embodiment, the front photographing unit 1a and the rear photographing unit 1b are integrally provided in the camera 10. However, the present invention is not limited to this, and two cameras having one photographing unit are prepared. You may make it cooperate a camera. In this case, the imaging unit of the first camera is used as the front imaging unit 1a, the imaging unit of the second camera is used as the rear imaging unit 1b, and the control unit (image recording control unit 2) of one camera is used. However, it is configured to control the photographing unit of the other camera. The control communication in this case may be wired or wireless.

  As described above, according to each embodiment of the present invention, based on the image data, the change in the background image that changes as the shooting position moves is determined, and based on this determination, the size of the continuous image is determined. Image processing that changes the height is performed. For this reason, it is possible to easily express the movement. For example, it is possible to express the excitement when visiting a certain historic site for the first time based on the positional relationship between the historic site and the state of movement, and the like.

  In each embodiment of the present invention, an example is shown in which shooting is performed with the camera 10 and playback is performed. However, the present invention is not limited to this, and playback can also be performed on a personal computer, a television, or the like. In the case of enjoying with a personal computer, a TV, or the like, image data of a moving image taken with the camera 10 may be stored.

  In each embodiment of the present invention, the camera 10 was shot and played back with a moving image. However, it is a matter of course that a still image shooting and playback display function may be provided as in a normal camera.

  Furthermore, in each embodiment of the present invention, a digital camera has been described as an apparatus for photographing. However, the camera may be a digital single lens reflex camera or a compact digital camera, such as a video camera or a movie camera. A camera for moving images may be used, and a camera built in a mobile phone, a personal digital assistant (PDA), or the like may of course be used.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Moreover, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

It is a block diagram which shows the structure of the camera concerning 1st Embodiment of this invention. 1A and 1B are external views of a camera according to a first embodiment of the present invention, in which FIG. 1A is an external perspective view seen from the back side, and FIG. It is a figure which shows the imaging | photography method in 1st Embodiment of this invention, (a) (b) is a figure which shows the image image | photographed continuously in time series order. In 1st Embodiment of this invention, the image which image-processed the continuous image is shown, (a) (b) is the figure which respectively image-processed FIG. 3 (a) (b). It is a flowchart which shows the operation | movement of person movement reproduction | regeneration in the camera concerning 1st Embodiment of this invention. It is a flowchart which shows the operation | movement of the camera control concerning 1st Embodiment of this invention. It is a block diagram which shows the structure of the camera concerning 2nd Embodiment of this invention. It is a flowchart for detecting the smile degree R concerning 1st Embodiment of this invention. It is a figure which shows the imaging | photography method in 2nd Embodiment of this invention. It is a flowchart which shows the operation | movement of the camera control concerning 2nd Embodiment of this invention. In 2nd Embodiment of this invention, the front image image | photographed with the front imaging | photography part is shown, (a) thru | or (c) show a time-sequential order. In 2nd Embodiment of this invention, an example of the reproduction | regeneration display of person movement reproduction | regeneration is shown, (a) thru | or (c) show a time-sequential order. In the second embodiment of the present invention, another example of the reproduction display of person movement reproduction is shown, and (a) to (c) show the time series order. In the second embodiment of the present invention, an example of insertion reproduction of person movement reproduction is shown, and (a) to (f) indicate time-series order. In the second embodiment of the present invention, an example in which a person is inserted and displayed at the time of front image reproduction is shown, and (a) to (e) show a time-series order.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Imaging | photography part, 1a ... Front imaging | photography part, 1b ... Back imaging | photography part, 2 ... Image recording control part, 2a ... Auxiliary recording part, 2b ... Auxiliary recording part, 3. ..Face detection unit, 4 ... background change determination unit, 5 ... operation unit, 5a ... release button, 7 ... image processing unit, 8 ... display unit, 10 ... camera, 30a-30c ... Photographer, 31 ... Lake, 32 ... Tree, 35 ... Subject, 41a-41c ... Back image, 42a-42c ... Front image

Claims (16)

In a shooting device that performs continuous shooting while moving the shooting position with the positional relationship between the photographer and the shooting device fixed,
A photographing unit for obtaining image data of a subject image;
A determination unit that determines a change in a background image that changes in accordance with the movement of the shooting position based on the image data;
An image processing unit that changes the size of the continuously shot image based on the determination by the determination unit;
An image display unit for displaying an image processed by the image processing unit;
An imaging apparatus comprising:   The photographing apparatus according to claim 1, wherein the photographing unit is capable of changing a photographing direction toward the front and rear of the photographing apparatus.   The determination unit detects a motion vector of a background image, and the image processing unit performs image processing for changing the size of the continuous images when the motion vector is centered. Item 2. The photographing apparatus according to Item 1.   The image processing unit further includes a face detection unit that detects whether or not a human face exists in the image, and the image processing unit detects the size of the continuous image when the face detection unit detects the presence of a face. The image capturing apparatus according to claim 1, wherein image processing for changing the height is performed.   The imaging apparatus according to claim 1, wherein the determination unit performs the determination during continuous shooting by the shooting unit, and records the determination result together with a continuous image.   The photographing unit includes a front photographing unit that photographs the front of the photographing device and a rear photographing unit that photographs the rear, and simultaneously records images photographed by the front photographing unit and the rear photographing unit. The imaging device according to claim 1.   The imaging apparatus according to claim 6, wherein the determination unit determines based on an image captured by the front imaging unit.   The photographing apparatus according to claim 1, wherein the photographing unit includes a zoom lens, and the determination unit considers a change in a zoom ratio in the determination. In the control method of the photographing apparatus that performs continuous photographing while moving the photographing position while keeping the positional relationship between the photographer and the photographing apparatus constant,
Obtain image data of the subject image,
Based on the image data, determine a change in the background image that changes with the movement of the shooting position,
Based on the determination, image processing is performed to change the size of the continuously shot image,
Display the image processed image,
A method for controlling an imaging apparatus. An image storage unit for storing continuously captured image data;
Based on the image data, a determination unit that determines a change in the background image that changes as the shooting position moves,
An image processing unit that changes the size of the continuously photographed image based on the determination by the determination unit;
An image display unit for displaying an image processed by the image processing unit;
An image display device comprising:   The determination unit detects a motion vector of a background image, and the image processing unit performs image processing for changing the size of the continuous images when the motion vector is centered. Item 15. The image display device according to Item 10.   The image processing unit further includes a face detection unit that detects whether or not a human face exists in the image, and the image processing unit detects the size of the continuous image when the face detection unit detects the presence of a face. The image display apparatus according to claim 10, wherein image processing for changing the height is performed.   11. The image display according to claim 10, wherein the image display unit displays the most reduced image first, and thereafter displays each image while gradually expanding the most reduced image. apparatus.   11. The image according to claim 10, wherein the image display unit superimposes and displays the most reduced image on the last image, and thereafter displays the image while removing the image in time series order. Display device. Stores continuously captured image data,
Based on the image data, determine the change of the background image that changes with the movement of the shooting position,
Based on the determination, image processing is performed to change the size of the continuous image,
Display the image processed image,
An image display method characterized by the above. Storing continuously captured image data;
Determining a change in the background image that changes with the movement of the shooting position based on the image data;
Performing image processing for changing the size of the continuous images based on the determination;
Displaying the image processed image;
A program that causes a computer to execute.