JP5603978B2 - Imaging apparatus and imaging method - Google Patents

Description

  The present invention relates to a photographing apparatus such as a digital camera, a video camera, and a camera-equipped mobile phone, and more particularly to a photographing apparatus and a photographing method having a still image and moving image photographing function.

  In photographing, generally, photographing parameters such as an aperture and a zoom position are switched. This method is effective when the shooting parameters are switched through trial and error before shooting, and a still image is shot after confirming the effect. However, when viewing still images, the subject does not move, so it may feel unsatisfactory. Therefore, it is conceivable to add an element of movie shooting. However, in movie shooting, if you try to switch shooting parameters during shooting in order to make a change when the screen becomes monotonous, camera shake occurs during operation. End up. For this reason, general users tend to hesitate to change the shooting parameters during moving image shooting. As a result, the screen was monotonous and the video was not interesting.

  Therefore, various proposals have been made in order to prevent a monotonous moving image. For example, Patent Document 1 discloses an image processing apparatus capable of sequentially joining a plurality of sections designated by a user and performing a transition effect applying process or the like at the joint. According to this image processing apparatus, it is possible to easily perform advanced desired moving image editing without being aware of specialized knowledge in moving image editing.

  Patent Documents 2 and 3 disclose a movie camera capable of shooting a still image while shooting a moving image. That is, Patent Document 2 discloses that when taking a still image during moving image shooting, the AGC circuit amplifies the image signal according to the distance information without using the stroboscopic zoom mechanism when the stroboscope emits light. Yes. Patent Document 3 discloses a camera that includes a moving image shooting switch and a still image shooting switch so that priority can be given to still image shooting or moving image priority.

JP 2003-110995 A Japanese Patent Laid-Open No. 4-331583 Japanese Patent No. 3673528

  As described above, various proposals have been made for shooting and editing of still images and moving images. However, since the image processing device disclosed in Patent Document 1 is image editing performed after moving image shooting, its effects are limited. Moreover, since it is only a moving image, the feature of a still image cannot be utilized. In addition, the movie cameras disclosed in Patent Documents 2 and 3 can only shoot a still image during shooting of a moving image, and do not obtain a variety of images by combining respective advantages. That is, the conventional techniques disclosed in the above-mentioned Patent Documents 1 to 3 are not sufficient for acquiring and reproducing a variety of images by combining still images and moving images.

  The present invention has been made in view of such circumstances, and an object thereof is to provide a photographing apparatus and a photographing method capable of acquiring a variety of images by combining still images and moving images. To do.

In order to achieve the above object, an imaging apparatus according to a first aspect of the present invention includes an imaging unit that captures a subject image and outputs image data, a motion determination unit that determines a composition of a screen or a holding method of the imaging device, and a release. When the command is issued, if the motion determination unit determines that there is no change in the composition or the manner of the image, the image data is acquired as a still image, and then differs from when the still image is captured. while changing the imaging parameters, it possesses a photographing control unit that acquires image data in a continuous photographing, and the imaging control unit, after acquiring the image data of the still picture and the continuous shooting, followed by the next still When the image data of the image and the continuous shooting are acquired, an image file in which the continuous shooting by changing the shooting parameter is generated is generated .

According to a second aspect of the present invention, there is provided a photographing apparatus according to the first aspect, further comprising: a recording unit that records the still image acquired by the photographing control unit and continuous shooting image data; and the recording unit. A display unit that reproduces and displays the image data, and the display unit reproduces an image file in which continuous shooting with the change of the shooting parameter is connected.

In the photographing apparatus according to a third aspect , in the first aspect, the motion determination unit determines a change in the composition of the screen based on the image data.
According to a fourth aspect of the present invention, in the first aspect, the motion determination unit detects a movement applied to the photographing apparatus, and determines a change in attitude based on the movement.

According to a fifth aspect of the present invention, in the first aspect, the photographing control unit ends the continuous photographing when a predetermined time has elapsed after the start of the continuous photographing.

In the photographing apparatus according to a sixth aspect based on the first aspect, the photographing parameter is at least one of an aperture value, a focal length, an exposure correction value, a focus position, and image processing.

In a photographing apparatus according to a seventh aspect based on the first aspect, the photographing parameter is determined based on a photographed person.

According to an eighth aspect of the present invention, there is provided a photographing apparatus according to the first aspect, further comprising: a recording unit that records the still image acquired by the photographing control unit and continuous shooting image data; and the reproduction of the image data. A time extension unit that performs time extension; and a display unit that reproduces and displays the image data recorded by the recording unit in a slow motion manner by the time extension unit.

According to a ninth aspect of the present invention, in the eighth aspect , the time extension unit extends the time that is not affected by the camera shake of the photographer to a time at which the effect of the shooting parameter can be confirmed.

According to a tenth aspect of the present invention, there is provided a photographing method for photographing a subject image, outputting image data, determining a composition of a screen or a manner of holding a photographing device, and a composition or a posture of the image when a release command is issued. If it is determined that there is no change in the direction, the image data is acquired with a still image, and then the image data is acquired with continuous shooting while changing to a shooting parameter different from that for shooting the still image. After acquiring the still image and the continuous shooting image data and subsequently acquiring the next still image and the continuous shooting image data, an image file in which continuous shooting is performed by changing the shooting parameters is generated .

  ADVANTAGE OF THE INVENTION According to this invention, the imaging device and imaging | photography method which can unite a still image and a moving image and can acquire the image rich in change can be provided.

It is a block diagram which shows the electric constitution of the camera concerning one Embodiment of this invention. It is a block diagram which shows the detail of the image processing part of the camera concerning one Embodiment of this invention. FIG. 4 is a diagram illustrating still images and moving images that are subsequently captured in the camera according to the embodiment of the present invention. It is a figure which shows a mode that the movie concerning one Embodiment of this invention is reproducing | regenerating the still image and the moving image continuously image | photographed. It is a figure which shows a mode that the moving image continuously image | photographed with the camera concerning one Embodiment of this invention is reversely reproduced. It is a figure which shows a mode that the direction of a camera changes after a still image photography in the camera concerning one Embodiment of this invention. In the camera according to an embodiment of the present invention, even when the orientation of the camera changes after taking a still image, the central portion of the screen is recorded and displayed as a moving image. It is a flowchart which shows the operation | movement of the camera control of the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement of the art parameter change of the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement of the exposure switch step determination of the camera concerning one Embodiment of this invention. It is a flowchart which shows the operation | movement of the exposure switching direction step determination of the camera concerning one Embodiment of this invention. It is a figure which shows a mode that the camera concerning one Embodiment of this invention reproduces and displays the moving image continuously image | photographed with the still image at the time of imaging | photography.

  Hereinafter, a preferred embodiment will be described using a camera to which the present invention is applied according to the drawings. FIG. 1 is a block diagram showing an electric circuit of a camera 10 according to an embodiment of the present invention. The camera 10 is a digital camera, and includes a control unit 1, an imaging unit 2, a face detection unit 2a, a parameter setting unit 3, a motion determination unit 4, a recording unit 6, a parameter control unit 7, a display unit 8, an operation unit 9, and a clock. It consists of part 11 grade.

  The imaging unit 2 includes a photographing lens (zoom lens) having a zoom function, an exposure control unit such as a shutter / aperture, an imaging element, a driving and reading circuit for the imaging element, and the like, and captures an object image formed by the photographing lens. It is converted into image data by the element and output. Further, the photographing lens of the imaging unit 2 includes a focusing lens and its mechanism, and when photographing a transitional moving image, it is possible to photograph while shifting the focus. In addition, an aperture adjustment mechanism for blurring the background may be provided. The face detection unit 2a is based on the image data output from the imaging unit 2 and processed by the control unit 1, whether or not a human face is included in the subject image, and if a face is included Detects the position, size, etc., and outputs the detection result to the control unit 1. In detecting a face, shadows of parts such as eyes, nose, and mouth in the face are extracted and performed by a pattern matching method or the like.

  The control unit 1 controls the entire sequence of the camera 10 according to a stored program. The control unit 1 includes a composition change determination unit 1a, a trimming unit 1b, and an image processing unit 5. The composition change determination unit 1a determines whether the composition of the screen and the way the camera 10 is held have changed. In determining the composition change of the screen, a motion vector or the like is used based on the image data output from the imaging unit 2. Further, how to hold the camera 10 is determined based on a determination output of a motion determination unit 4 described later.

  Furthermore, an expression change determination unit may be provided in the composition change determination unit 1a. The facial expression change determination unit includes the image data output from the imaging unit 2, the detection result regarding the face output from the face detection unit 2a, and the facial eyes, nose, and face stored in the facial expression change database (DB) 6a described later. A facial expression change is determined on the basis of a part pattern such as a mouth and data on the facial expression change. In this determination, the change of the facial expression may be predicted based on the speed of change when the facial expression changes.

  The trimming unit 1b performs a trimming process for cutting out part of the image data output from the imaging unit 2. When the image data is cut out, the image at the center of the screen is cut out. Alternatively, the periphery of the face of the subject may be cut out based on the position and size of the face detected by the face detection unit 2a. good.

  The image processing unit 5 includes a temporary recording unit 5a, a moving image processing unit 5h, and a still image processing unit 5i. The image processing unit 5 captures image data output from the imaging unit 2, performs thinning processing, clipping processing, edge enhancement, color correction, Various image processing such as image compression is performed, and image processing for live view display of moving images, recording of still images and moving images in the recording unit 6, and reproduction display of still images and moving images is performed. In image compression / expansion, a still image compression / expansion circuit, a moving image compression / expansion circuit, and the like are provided for still images and moving images in accordance with respective processes. Further, the image processing unit 5 can obtain a motion vector based on the image data. As will be described later, the temporary recording unit 5a is a memory for temporarily recording image data of a moving image continuously captured after still image capturing. Details of the image processing unit 5 will be described later with reference to FIG.

  The parameter setting unit 3 manually sets shooting parameters using a zoom button for changing the focal length in the shooting unit 2, an aperture value setting operation unit for setting an aperture value, and the like, and outputs them to the control unit 1. In the case of an aperture value or the like, it may be automatically set according to the result of exposure control. The parameter control unit 7 controls the imaging unit 2 based on the imaging parameters that are set manually or automatically by the parameter setting unit 3. By controlling the shooting parameters, it is possible to adjust the angle of view, background blur (depth of field), and the like. By changing these, various effects can be applied and photography can be enjoyed. The parameter control unit 7 detects a currently set value such as an aperture value or a focal length and outputs the detected value to the control unit 1.

  The motion determination unit 4 includes a six-axis sensor or the like that detects a total of six axes of physical quantities including acceleration in a three-dimensional space, that is, three-axis acceleration, and rotation speed in the three-dimensional space, that is, a three-axis angular velocity. The motion determination unit 4 can determine whether or not the way the camera 10 is held. Even if the image changes due to zooming or the like, it can be determined that the photographer's way of holding the camera 10 has not changed, and the target can be aimed at the same subject without changing the way of holding without malfunction. You can see if it is.

  The operation unit 9 includes various operation members such as a release button, a power switch, a playback mode setting button, a menu button, an art mode button, etc., determines the operation state of these operation members, and sends a determination result to the control unit 1. . The above-described control unit 1 controls photographing and reproduction in a predetermined sequence according to the operation state of the operation member. The art mode button is an operation member for setting the art mode. When the art mode button is set, the shooting with the moving image (continuous shooting) is performed while changing the shooting parameters following the shooting of the still image. The art mode may be set by displaying a menu screen on the display unit 8 by the menu button without providing an art mode button, and setting from this screen. Further, the art mode may be set without fail when the art button is not provided when the still image is released.

  The recording unit 6 records image data of still images and moving images acquired by the imaging unit 2 and compressed by the image processing unit 5 when a shooting instruction is given by the release button. The expression change DB 6a in the recording unit 6 is a database showing the relationship between the facial expression (parts) such as eyes, nose and mouth, and the facial expression. Based on this relationship, the facial expression change determination unit in the composition change determination unit 1a can express the facial expression of a person, such as the smile level, as a numerical value. The degree of smile is quantified based on the shape of the eyes and mouth, whether or not teeth are visible.

  The display unit 8 includes a display unit such as a liquid crystal panel or an organic EL panel disposed on the back surface of the camera 10, and displays a live view display before shooting, normal playback display of recorded images, and camera information display. Etc. The photographer can observe the live view display and determine the composition and timing. In addition, after shooting a still image, an image shot in an art mode for shooting a moving image is also displayed.

  The clock unit 7 performs a time measuring operation and outputs photographing date / time information. This shooting date / time information is recorded when image data of a still image or a moving image is recorded in the recording unit 6. Also, when shooting in the art mode, it is also used to determine whether or not a predetermined time has elapsed after starting a moving image (continuous shooting) after shooting a still image.

  Next, details of the configuration of the image processing unit 5 will be described with reference to FIG. As described above, the image processing unit 5 captures the image data output from the imaging unit 2 and performs various image processing such as thinning processing and clipping processing. Here, the image for backward moving image reproduction in the art mode is used. A configuration related to data generation will be mainly described.

  The temporary recording unit 5 a is a memory for temporarily storing image data from the imaging unit 2, a memory 0 for temporarily storing still image data, and a moving image (sequentially captured after the still image). And memory n for temporarily storing image data corresponding to each frame. A memory 0 for temporarily storing still image data is connected to the still image compression unit 5b. The still image compression unit 5b performs image compression such as JPEG.

  Memory 1 to memory n for storing image data of each frame of the moving image (continuous shooting) are connected to an order change switch (SW) 5c. This order change switch 5c changes the order of the image data of each frame temporarily recorded in the memories 1 to n. That is, after the moving image is recorded, the last image data temporarily stored in the memory n is read first, and then the image is sequentially performed in the order of the memory n-1, the memory n-2, ..., the memory 2, and the memory 1. Read data. As a result, the image can be reproduced as if the time was reversed.

  The order change switch 5c is connected to the appropriate image sorting selection unit 5d. The appropriate image sorting selection unit 5d selects the image data temporarily stored in the memory 1 to the memory n that is suitable for a moving image (continuous shooting), for example, other than a sudden composition change or blurring. To do. The appropriate image sorting selection unit 5d is connected to the image duplicating unit 5e. As will be described later, at the end of shooting, a moving image shot for 0.5 seconds is expanded to 2 seconds and displayed. The image duplicating unit 5e performs duplication while interpolating image data of each frame of the moving image in order to perform time expansion of the image.

  The image duplication unit 5e is connected to the moving image compression unit 5g. The moving image compression unit 5g performs moving image compression on the image data extended for 2 seconds by the image duplication unit 5e by MPEG4, motion JPEG or the like. The connection data unit 5f combines the moving image data generated by the moving image compression unit 5g and the still image data generated by the still image compression unit 5b, and continuously connects both image data. Generate information. The connection information by the connection data unit 5f, the image data from the still image compression unit 5b, and the image data from the moving image compression unit 5g are sent to the recording unit 6 and recorded as one image file.

  Next, shooting in the art mode by the camera 10 according to the present embodiment will be described with reference to FIG. FIG. 3A shows an image when the photographer decides the composition, decides the photographing parameters (some are automatically decided), decides the shutter chance, and photographs the person 21 as the subject as a still image. . 3 (b) to 3 (d) show images taken sequentially by moving images (continuous shooting) following the still image shooting in FIG. 3 (a). Since the essential shooting has already been completed in the still image, the shooting parameters determined by the photographer or automatically determined by the camera 10 or the composition determined by the photographer may be invalidated. A moving image is more interesting when there is movement. However, since it is not easy to move the subject, in this embodiment, the shooting parameters are changed to add movement to the image. In the example shown in FIGS. 3B to 3D, the effect of changing the parameter to overexposure is given while zooming up. Note that, as the shooting parameter changing operation, the focus position of the shooting lens may be shifted. By shifting the focus position, it is possible to obtain an effect that a person's face is blurred. In this case, the exposure correction value may be changed or zoomed, or may be performed independently. Further, the background may be blurred by changing the aperture.

  As described above, in the shooting in the art mode according to the present embodiment, a moving image is shot for a short time thereafter while keeping a decision moment with a still image. With this art mode, even a user who has never taken a moving image can easily enjoy moving image shooting with movement. When shooting in the art mode, although the user does not have to manually operate shooting parameters such as an aperture, it is possible to create a variety of drawings. Further, as will be described later, it is also possible to display on the display unit 8 a state in which an image is formed by using image data acquired in the art mode after shooting. If the user sees an image to which the effect of the art mode is given before shooting, it is difficult to determine the composition and the photo opportunity.

  Next, reproduction display performed by combining a plurality of images shot in the art mode (still image with moving image) described in FIG. 3 will be described with reference to FIG. If the still image with moving image shown in FIG. 3 is continuously reproduced and displayed as shown in FIG. 4, it can be enjoyed as a moving image slide show with changes in facial expressions and the like. In the example shown in FIG. 4, after a still image (see FIGS. 4A and 4E), zooming is performed with the aperture opened, and the background is blurred (FIGS. 4B to 4D and 4F). ) To (h)). At this time, it can be enjoyed that the facial expressions of the persons 21 and 22 change. At this time, instead of always providing the transition effect, an effect that the photographed person likes may be added. For example, Mr. A may be exposed, Mr. B may be in focus, Mr. C may be zoomed, Mr. D may be an aperture, and so on. Of course, when the facial expression changes or blinks, it may be determined and the transition effect may be switched.

  Image data for reproduction display as shown in FIG. 4 may be edited before reproduction. In this embodiment, image data is recorded at the time of shooting in steps S20 and S21 (see FIG. 8) described later. When generating, it generates as an image file. When the photographing time points are close to each other, both image data are combined. Of course, it may be viewed as a still image with a transition effect that fades out when a single image is viewed without being edited into a plurality of still images with moving images.

  Next, a case where a still image with a moving image is handled as a moving image as an auxiliary image and reverse reproduction is performed will be described with reference to FIG. In this backward reproduction, a moving image is not treated as an accurate recorded image but as a decorative image or art image of a person's face. In the example shown in FIG. 5, the moving image shot in FIG. 3 is reproduced from the last shot frame, and the first shot still image is displayed as the determined work. Moreover, it is good also as an expression which represents the state before a completion image is decided as a still image with a moving image.

  That is, at the time of shooting, a still image shown in FIG. 5D is first shot, and then a moving image is shot for 0.5 seconds in the order of FIGS. 5C, 5B, and 5A. When the captured image is reproduced in the reverse direction, the moving image is reproduced in the reverse direction in the order of (b) and (c) in FIG. 5D is displayed as a definitive work. In recent years, image sensors capable of acquiring hundreds of frames per second have been developed, and such slow motion playback can be easily performed. Whether or not such backward reproduction is permitted may be determined only when the facial expression change is not unnatural by judging the facial expression change of the subject and referring to the facial expression change DB 6a. For example, in the case of repeated operations such as blinking, the backward moving image may be arranged before the still image, and the forward moving image may be arranged after the still image so that it can be repeatedly reproduced.

  In the art mode according to the present embodiment, the subject is shot with a moving image (continuous shooting) even after the still image is shot. Therefore, for a predetermined time (0.5 seconds in the embodiment) after the still image is shot, the subject is shot. If the camera 10 is not pointed at, the image will be unsightly. Therefore, in this embodiment, in order to prevent the photographer from applying unnecessary stress, the person 21 located at the center of the screen is automatically extracted, and the face portion of the person 21 is trimmed and recorded. I am doing so.

  This trimming method will be described with reference to FIGS. FIG. 6 shows a state in which a person 21 as a subject is being photographed. A still image is photographed in the photographing region 15a, and a subsequent moving image is photographed in the photographing regions 15b and 15c. At this time, among images captured by the camera 10, FIG. 7A shows an image corresponding to the shooting region 15a, FIG. 7B shows an image corresponding to the shooting region 15b, and FIG. ) Is an image corresponding to the imaging region 15c.

  The image of FIG. 7A corresponding to the still image shooting area 15a is recorded as shown in FIG. 7D, but the image corresponding to the moving image shooting area 15b is the center of the screen of the shooting area 15a. A trimming area 17b including the face of the person 21 is present in the center, and the image corresponding to the moving image shooting area 15c is recorded in the trimming area 17c including the center of the screen of the shooting area 15a as shown in FIG. As shown in FIG. 7F, recording is performed. Here, the aspect ratios of the trimming regions 17b and 17c may be changed from the aspect ratio of the still image. However, by setting the same aspect ratio, the uncomfortable feeling can be eliminated. It is said.

  As described above, even if the photographer changes the composition to the shooting areas 15 a to 15 c, the image data of the trimming areas 17 b and 17 c corresponding to the central portion of the still image screen is recorded in the recording unit 6. Even if the photographer is relieved after the still image is photographed and unconsciously changes the composition to the photographing regions 15b and 15c, the center portion of the screen is trimmed and recorded. By trimming and using only the face portion, it is possible to perform moving image expression for capturing changes in the expression of the subject. That is, as shown in FIGS. 7D to 7F, it is possible to record a process in which the subject becomes a relaxed facial expression while the image transitions, and to recall memories.

  Next, the operation of the camera 10 according to the present embodiment will be described with reference to the camera control flowchart shown in FIG. When the camera 10 is powered on and activated, the flow shown in FIG. 8 starts. When starting, it is first determined whether or not the camera is in shooting mode (S1). The camera 10 is provided with a shooting mode and a playback mode, and the mode selection state of the photographer is determined based on the operation state of the operation unit 9.

  If the result of determination in step S1 is shooting mode, imaging and display are carried out (S2). In this step, the image processing unit 5 performs image processing on the image data acquired by the imaging unit 2 and performs live view display on the display unit 8. The photographer can determine the composition and the photo opportunity while viewing the live view display.

  Once imaging and display have been performed, next screen feature determination is performed (S3). In this screen feature determination, the face detection unit 2a detects whether or not a face portion is included in the image and, if included, the position and size. When a face portion is detected, exposure control values such as an aperture value and a shutter speed are calculated so that the portion is properly exposed, and automatic focus adjustment is performed so that the focus is achieved.

  Once the screen feature determination has been performed, it is next determined whether or not it is shooting (S4). Here, it is determined whether or not the release button of the operation unit 9 has been pressed. If the result of this determination is shooting, still image shooting is performed (S5). In this step, image data output from the imaging unit 2 is temporarily stored in the memory 0 in the temporary recording unit 5a of the image processing unit 5, and image compression is performed in the still image compression unit 5b.

  Once still image shooting has been carried out, it is next determined whether or not it is in art mode (S6). Since the art mode is set by operating the art mode button of the operation unit 9, it is determined in this step whether the art mode button is operated and set to the art mode. If the result of this determination is not art mode, still image recording is performed (S7). In this step, the image data of the still image obtained in step S5 and subjected to the image compression process is recorded in the recording unit 6. When still image recording is performed, the process returns to step S1.

  If the result of determination in step S6 is that the art mode has been set, next, continuous shooting (moving image) is started (S11). Here, continuous shooting (moving image) in which image data is repeatedly acquired from the imaging unit 2 at a predetermined timing is started. Subsequently, the exposure switching direction step is determined (S12). In the art parameter change described later, the shooting parameter is switched while performing continuous shooting. At this time, the aperture may be changed as the shooting parameter. FIG. 3 described above shows an example in which the exposure is shifted to the over side. However, in a dark scene, there is no room for transition to the over side, and in this case, the under side is better. In addition to the effect of overexposure and disappearing in the light, it may be an effect of underexposure and disappearing in the dark, or emerging from there. Therefore, in the determination of the exposure switching direction step, the margin direction of exposure is determined to determine whether to shift to the over side or the under side. Details of the step determination in the exposure switching direction will be described later with reference to FIG. Note that the shooting parameters may be changed according to the facial expression of the subject.

  Once the exposure switching direction step has been determined, it is next determined whether 0.5 second has elapsed (S13). Here, the time from the start of continuous shooting in step S11 is measured in the clock unit 11, and it is determined whether 0.5 second has elapsed. If 0.5 seconds have not elapsed as a result of this determination, the art parameter is changed (S14). Here, the shooting parameters are changed while continuously shooting. In the present embodiment, live view display is performed even during continuous shooting, and it is possible to confirm changes in the captured image that accompany changes in the shooting parameters. However, since it is a short time and the change is too fast for the human eye, 0.5 seconds is extended to 2 seconds and displayed as slow motion. Details of the art parameter change will be described later with reference to FIG. Wait for 0.5 seconds to elapse while changing the art parameters.

  If 0.5 second has elapsed as a result of the determination in step S13, then the continuous shooting is terminated and continuous display is performed (S15). Since 0.5 seconds have passed, continuous shooting ends, but in the art parameter change in step S14, the time is extended to 2 seconds, and continuous shooting (video) playback display is performed in art mode. This reproduction display is continued.

  Subsequently, it is determined whether or not there is a motion during continuous shooting (S16). Based on the motion vector in the image processing unit 5, it is determined whether or not there has been a motion as described in FIG. 6 between the start of continuous shooting in step S 11 and the end of continuous shooting in step S 15. . If the result of this determination is that there is a motion during continuous shooting, the image is cut out so that the portion at the center of the screen is in the center (S17). Here, as described with reference to FIG. 6, the center of the still image screen is cut out by the trimming unit 1b. In addition, you may make it trim not only the center of a screen but the face part detected by the face detection part 2a.

  If the image is cut out in step S17 or if the result of determination in step S16 is that there is no motion during continuous shooting, then the continuous shooting image is animated in the reverse direction while interpolating (S18). Here, as described with reference to FIG. 5, in the image processing unit 5, the order of the image data of each frame captured by continuous shooting is reversed, and the order of the frames is traced back from the last captured frame. Rearrange At this time, an interpolated image is inserted between each frame, and the shooting time of 0.5 seconds is extended to 2 seconds.

  Subsequently, a moving image and a still image are recorded (S19). Here, data for combining a moving image (continuous shooting, continuously shot image) and a still image is attached by the connection data unit 5f (see FIG. 2), and the still image and the moving image as an auxiliary image are stored in the recording unit 6. Record. At this time, information taken in the art mode is also attached.

  Once the moving image and still image have been recorded, it is next determined whether or not it is within a predetermined time from the previous time (S20). Here, it is determined whether the time from the end of the previous continuous shooting (S15) to the start of the next continuous shooting (S11) is within a predetermined time range. If the result of this determination is not within the predetermined time, the process returns to step S1.

  If the result of determination in step S20 is that it is within a predetermined time, next, connection with the previous video is performed (S21). As described with reference to FIG. 4, a single file is generated in this step in preparation for a case where a still image with a moving image attached as an auxiliary image is continuously reproduced. As the predetermined time, when a moving image consisting of several cuts in one hour is taken into consideration, those shot within 10 minutes may be connected. In addition, you may change how to connect by a transition effect. For example, if a white overscreen is connected after darkness, it will be unnatural, so after transitioning to black, the reverse transition video from over will not be displayed, but a still image will be displayed and then the order will be over You may make it connect a direction animation. In step S21, when connection with the previous moving image is performed, the process returns to step S1.

  If the result of determination in step S1 is not shooting mode, it is next determined whether or not playback mode is in effect (S31). Since the playback mode is set by pressing the playback button of the operation unit 9, it is determined in this step whether or not the playback mode is set. If the result of this determination is that it is not playback, processing returns to step S1.

  If the result of determination in step S31 is playback, it is next determined whether or not the mode is art mode (S32). In the recording unit 6, if image data shot by normal still image shooting is also recorded, image data shot in the art mode is also recorded. In this step, it is determined based on information attached to the image data whether or not the currently selected image is taken in the art mode.

  If the result of determination in step S32 is that it is in the art mode, the corresponding moving image portion is played back slowly (S33). In the playback in the art mode, as described with reference to FIG. 5, backward playback is performed on the display unit 8 sequentially from the last moving image. At this time, it is extended to a time longer than the moving image shooting time, and is reproduced like a slow motion.

  If the corresponding moving image portion slow playback is performed in step S33 or if the result of determination in step S32 is that it is not the art mode, then still image playback is performed (S34). In the case of a normal still image, the image selected in this step is enlarged and displayed on the display unit 8. In the case of the art mode, an auxiliary moving image is reproduced in step S33 (corresponding to FIGS. 5A to 5C), and a still image as a completed image is reproduced in step S34 (FIG. 5). 5 (d)). When the still image is reproduced, the process returns to step S1.

  As described above, in the example of the present embodiment, during shooting, as shown in FIG. 12A, after shooting a still image, continuous shooting is performed for 5 seconds (moving image shooting), and playback is performed (live view). Then, as shown in FIG.12 (b), the continuous shooting part (transition moving image) is extended and displayed for 2 second. During playback, the same image of the transition video is displayed many times and is displayed in slow motion. Considering the camera shake of the photographer, continuous shooting is preferably about 0.5 seconds, but if it is reproduced as it is, it is too fast to check the image.

  Next, the art parameter change subroutine in step S14 will be described with reference to the flowchart shown in FIG. In the art parameter change flow, first, shooting is performed (S41). In step S11, continuous shooting is started, and in this step, one frame image forming continuous shooting (moving image) is captured, and the image data obtained at this time is stored in the memory 1 to memory n of the temporary recording unit 5a. Are temporarily stored in any of the above.

  Subsequently, motion detection is performed (S43). Here, the motion determination unit 4 determines whether there is a shake or composition change. However, the present invention is not limited to this, and the determination may be made based on the motion vector detected by the image processing unit 5. If the result of this determination is that there is motion, it is next determined whether or not the still image differs from the image (S51). Here, the determination is made by comparing the still image acquired by the still image shooting in step S5 with the image acquired by the moving image shooting of step S41. This is because if the still image and the moving image are greatly different, the continuity is hindered and is not suitable for viewing as a series of images. If the result of determination in step S51 is that it is different from the still image, the process proceeds to step S15 and the continuous shooting is terminated.

  If the result of determination in step S44 is that there is no motion, it is next determined whether or not there is room for aperture change (S44). Here, it is determined from the currently set aperture value whether there is a margin for opening the aperture on the open side. If there is a margin for this determination and aperture change, the aperture is then opened so that the aperture is opened one step at 5 frames (S45). Although the exposure is appropriate when taking a still image, the image is gradually overexposed by gradually opening the aperture. In the present embodiment, the aperture is opened one step at 5 frames, but this is merely an example and may be changed as appropriate. In the present embodiment, 30 frames are captured every second. However, if 60 frames are captured every second, the aperture may be opened by one step with 10 frames, and may be changed as appropriate according to other conditions.

  If the result of determination in step S44 is that there is no allowance for aperture change, it is determined whether or not there is allowance for zoom change (S52). Here, the focal length information of the current zoom lens is acquired, and it is determined whether or not the focal length can be changed to the long focal side. As a result of this determination, if there is a margin for zoom change, the zoom is sequentially increased by 1.1 times the focal length for each frame (S53). Each time this step S53 is executed for the parameter control unit 7, the focal length is multiplied by 1.1. In addition, 1.1 times is an example. For example, when high-speed continuous shooting is possible, 1.1 times per 2 frames may be used. It may be changed as appropriate in consideration of the zooming speed, the continuous shooting speed, and the like.

  If the result of determination in step S52 is that there is no allowance for zoom change, or if the result of determination in step S51 is that the still image does not differ from the image, then an exposure switching step is determined from the remaining time ( S54). In this case, the exposure correction value is changed as a shooting parameter. A detailed flow of determining the exposure switching step will be described later with reference to FIG.

  Subsequently, the exposure is sequentially switched according to the exposure correction value determined in step S54 (S55). Here, the aperture and shutter speed are changed using the exposure correction value ΔE calculated in step S54.

  When the aperture is sequentially opened in step S45, or when zooming is sequentially performed in step S53, or when the exposure is sequentially switched in step S55, the photographing result is shifted and displayed (S55). As described above, continuous shooting (movie) is shot for 0.5 seconds, but it is too early to check the transition effect by changing the shooting parameters, so it will take about 2 seconds. The display is slow. When the shooting result is shifted, the original flow is restored.

  Next, the subroutine for determining the exposure switching step in step S54 will be described with reference to the flowchart shown in FIG. If the flow for determining the exposure switching step is entered, first, the time is measured and the remaining time t of the moving image is calculated (S61). When continuous shooting is started in step S11, steps S13 and S14 are repeatedly executed for 0.5 seconds, and during that time, image data of frames constituting the moving image is acquired in step S41. Therefore, in this step S61, the moving image remaining time t is obtained by subtracting the time from the start of continuous shooting in step S11 from 0.5 seconds.

  Subsequently, a difference E from the still image exposure is obtained (S62). Here, a difference E in the exposure amount obtained by shifting the exposure from the exposure amount at the time of still image shooting in step S5 is calculated. Every time the subroutine for determining the exposure switching step is executed, the exposure is corrected, and the exposure amount E is decreased from the still image. Therefore, here, the reduced exposure amount E is obtained.

  Once the difference E from the still image exposure is obtained, next, an exposure change amount ΔE per unit time is obtained (S63). This exposure change amount ΔE is calculated by (3 steps−E) / t. Here, the third stage is an aperture value, E is the difference in exposure amount obtained in step S62, and t is the remaining time of moving image photography obtained in step S61. In the present embodiment, three steps of exposure correction are applied at the end of the moving image with respect to still image shooting. In step S63, three steps of exposure correction are performed at the end of moving image shooting. An exposure change amount ΔE is obtained. Note that the three levels are examples, and different values may be used depending on various conditions such as facial expressions.

  Once the exposure change amount ΔE is obtained, the exposure correction amount per frame is obtained (S64). Here, it is obtained by dividing the exposure change amount ΔE per frame by the number of frames per unit time. When this calculation is performed, the process returns to the original flow, and exposure correction is performed according to the exposure correction amount ΔE (exposure correction value) per frame.

  Next, the subroutine for determining the exposure switching direction step in step S12 will be described with reference to the flowchart shown in FIG. If the flow for determining the exposure switching direction step is entered, first, the exposure margin direction is determined (S71). Here, when exposure correction is performed, it is determined whether transition to the over side or transition to the under side is possible. Even in the case of a night view, even if it is shifted to the over side, it is originally dark, so it is difficult to make it overexposed so that it is completely white due to the exposure limit and sensitivity limit of one frame. Rather, a transition that deepens the darkness is more effective and is not unreasonable. Therefore, it is determined which of the exposures has a sufficient exposure based on the exposure amount that provides the appropriate exposure during still image shooting.

  Once the exposure margin direction is determined, it is next determined whether there is a margin of three exposure levels on the over side (S72). Here, the determination is made based on the margin in step S71. If the result of this determination is that there is a margin of 3 steps on the over side, the transition is made to the over side (S73). On the other hand, if there is no margin of 3 steps on the over side, a transition is made to the under side (S74).

  If an over-side transition is performed in step S73 or an under-side transition is performed in step S74, the original flow is restored. In the case of transition to the over side, the exposure correction amount is shifted to the over side, and in the case of transition to the under side, the exposure correction amount is shifted to the under side.

  As described above, in the embodiment of the present invention, when the art mode is set, first, image data is acquired with a still image, and then changed to shooting parameters different from those for shooting a still image. The image data is acquired by continuous shooting. The still image and the continuous shot image data acquired here are displayed at a timing when they are connected to the still image with a different expression from the time transition taken by the continuous shooting. For this reason, it is possible to integrate and replay still images and moving images to acquire and reproduce images that are rich in change.

  Further, in one embodiment of the present invention, an image with a transition effect can be obtained, so that a moving image combining a plurality of cuts without a sudden scene change can be easily created. Furthermore, attachments can be recorded with changes in one image by a process such as a change in the angle of view that cannot be represented by a still image.

  In the embodiment of the present invention, the aperture value, the focal length (zoom), and the exposure correction value have been described as the shooting parameters. However, the present invention is not limited to this, and for example, the focus position may be sequentially switched. . When switching the focus position, for example, from the state in which the main subject is in focus during still image shooting, for example, when the background is gradually focused, or when there is a person other than the main subject, You may make it focus on a person. In particular, when taking a still image, it is uncomfortable if the focus is out of focus, and it is difficult to determine framing or photo opportunity. Therefore, as described in one embodiment, the specification for changing the shooting parameters after shooting is reasonable. Yes. As shown in FIG. 5, when the moving image obtained while changing the shooting parameters is reproduced in the opposite direction, a dramatic effect of focusing can be obtained. The focusing direction is determined from the focus position of the subject and the focusing limit of the taking lens. It becomes. Of course, such a specification may be prohibited because it causes a time lag during continuous shooting.

  Further, in the embodiment of the present invention, the aperture value, the focal length (zoom), and the exposure correction value are described as the shooting parameters. However, even if all of these three cannot be executed, any two or 1 It may be one. Further, in the embodiment of the present invention, the change of the blur condition as the shooting parameter is performed by controlling the aperture value. However, when the background is blurred by image processing instead of the aperture value, image processing is performed. You may make it process by.

  Furthermore, in one embodiment of the present invention, the aperture or exposure correction is changed as the shooting parameter so that the exposure is simply overexposed. However, the present invention is not limited to this, and the driving direction of the shooting parameter is changed according to the expression. You may make it change. For example, the underexposure may be set when the facial expression becomes dark, or the zooming speed may be increased when the facial expression becomes bright.

  Furthermore, in one embodiment of the present invention, continuous shooting (moving image) is performed for 0.5 seconds, and when it is played back and displayed, it is expanded to 2 seconds. But of course it does n’t matter. However, it is desirable that the continuous shooting (moving image) time is not affected by camera shake.

  Furthermore, in one embodiment of the present invention, an image shot in the art mode is displayed on the display unit 8 of the camera 10 immediately after shooting or during playback. However, the reproduction display may be performed by a computer other than the camera 10, for example. In this case, the image data recorded on the recording unit 6 may be reproduced and displayed as it is, and the camera 10 does not perform image processing for reproducing the backward moving image and does not perform image processing for the backward moving image on the personal computer. Image processing may be performed.

  Furthermore, in the present embodiment, the digital camera is used as the photographing device. However, the camera may be a digital single-lens reflex camera or a compact digital camera, and may be used for moving images such as video cameras and movie cameras. It may be a camera, or may be a camera built in a mobile phone, a personal digital assistant (PDA), a game machine, or the like. In any case, the present invention can be applied to any photographing apparatus capable of photographing still images and moving images.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 1 ... Control part, 1a ... Image processing part, 1b ... Trimming part, 2 ... Imaging part, 2a ... Face detection part, 3 ... Parameter setting part, 4 ... Motion Determination unit, 5 ... image processing unit, 5a ... temporary recording unit, 5b ... still image compression unit, 5c ... order change SW, 5d ... appropriate image sorting selection unit, 5e ... Image duplicating unit, 5f ... moving image compression unit, 5g ... connection data unit, 5h ... moving image processing unit, 5i ... still image processing unit, 6 ... recording unit, 6a ... expression change DB, 7 ... Parameter control unit, 8 ... Display unit, 9 ... Operation unit, 10 ... Camera, 11 ... Clock unit, 15a-15c ... Imaging region, 17b-17c ..Trimming area, 21 ... person, 22 ... person

Claims (10)

An imaging unit that captures a subject image and outputs image data;
A motion determination unit that determines the composition of the screen or how to hold the photographing device;
When the release command is issued, when the motion determination unit determines that there is no change in the composition or manner of the image, the image data is acquired as a still image, and then when the still image is captured. A shooting control unit that acquires image data by continuous shooting while changing to different shooting parameters;
I have a,
When the shooting control unit acquires the still image and the continuous shooting image data and then acquires the next still image and the continuous shooting image data, the shooting control unit connects the continuous shooting by changing the shooting parameter. A photographing apparatus characterized by generating an image file . The above photographing device further includes:
A recording unit that records the still image acquired by the shooting control unit and image data of continuous shooting;
A display unit for reproducing and displaying the image data recorded by the recording unit;
Have
2. The photographing apparatus according to claim 1 , wherein the display unit reproduces an image file in which continuous photographing with the photographing parameter changed is connected.   The imaging apparatus according to claim 1, wherein the motion determination unit determines a change in the composition of the screen based on the image data.   The imaging apparatus according to claim 1, wherein the motion determination unit detects a movement applied to the imaging apparatus, and determines a change in a posture based on the movement.   The imaging apparatus according to claim 1, wherein the imaging control unit ends the continuous imaging when a predetermined time has elapsed after the start of the continuous imaging.   The photographing apparatus according to claim 1, wherein the photographing parameter is at least one of an aperture value, a focal length, an exposure correction value, a focus position, and image processing.   The photographing apparatus according to claim 1, wherein the photographing parameter is determined based on a photographed person. The above photographing device further includes:
A recording unit that records the still image acquired by the shooting control unit and image data of continuous shooting;
A time extension unit that performs time extension for reproduction of the image data;
A display unit for reproducing and displaying the image data recorded by the recording unit in a slow motion by the time extension unit;
The imaging apparatus according to claim 1, comprising: The imaging apparatus according to claim 8 , wherein the time extension unit extends a time that is not affected by a camera shake of a photographer to a time when the effect of the imaging parameter can be confirmed. Capture the subject image, output the image data,
Determine the composition of the screen or how to hold the camera,
When it is determined that there is no change in the composition or manner of the image when a release command is issued, the image data is acquired as a still image, and then the shooting parameters are set differently from those during shooting of the still image. While acquiring the image data by continuous shooting, after acquiring the still image and the continuous shooting image data, and subsequently acquiring the next still image and the continuous shooting image data, Generate an image file with continuous shooting by changing
An imaging method characterized by the above.