JP5995035B1 - Imaging device - Google Patents

Abstract

An imaging apparatus capable of generating a still image shot without missing an unexpected photo opportunity. An imaging apparatus includes: an imaging unit that generates image data from optical information input via an optical system unit; an image processing unit that performs predetermined processing on image data generated by the imaging unit; A control unit that controls the optical system unit, the imaging unit, and / or the image processing unit based on the setting to generate moving image data. The control unit has a first moving image mode and a second moving image mode as moving image recording modes. In the second moving image mode, the control unit automatically sets the setting related to moving image shooting to a predetermined setting suitable for still image recording. The control unit is configured to display the first moving image mode on the display unit at least one of when recording in the second moving image mode and when displaying the moving image recorded in the second moving image mode. Display indicating that the video mode is the second mode. [Selection] Figure 7 (a)

Description

  The present disclosure relates to an imaging apparatus that generates an image of a subject.

  In general, in the case of still image shooting, a user holds an imaging device while being aware of a photo opportunity and presses a release button when a desired photo opportunity is reached, thereby taking an image at a desired moment. However, in the conventional imaging device, since an image when the release button is pressed is taken, a happening / accident photo that does not know when it occurs, or a subject (liquid, flame, etc.) that changes its state over time It was difficult to take a picture of a typical condition.

  For example, Patent Document 1 discloses an imaging apparatus that can capture a still image during moving image shooting. According to this imaging apparatus, still image data is temporarily stored in the internal memory in response to a still image shooting instruction during moving image recording, and after the moving image data is recorded on the recording medium, the still image data on the internal memory is Read and record on the recording medium. This enables still image shooting during moving image shooting.

JP-A-9-154104

  In the imaging apparatus of Patent Document 1, the user needs to perform an operation for instructing to capture a still image when a desired photo opportunity is reached during moving image recording. That is, the user needs to be aware of the timing of still image shooting, that is, the photo opportunity, and therefore it is difficult to capture images such as unexpected happenings and accidents.

  Further, in the imaging device of Patent Document 1, image data for one frame in moving image data is recorded as a still image. For this reason, the image quality of a still image is affected by the image quality of each frame image constituting the moving image. Here, moving image shooting is performed under shooting conditions (setting values related to moving image shooting) that provide high image quality and quality as a moving image. For example, in order to realize smooth moving image reproduction, during moving image shooting, the shutter speed is set to the same value as the length of one frame period. Specifically, if the frame rate for moving image shooting is 30 fps (frame per second), the shutter speed is set to 1/30 seconds. However, a still image cut out from moving image data shot at such a shutter speed may be a blurred image, particularly when the subject moves. For this reason, in the conventional imaging device, when a still image is generated from a moving image, a high-quality still image cannot be obtained.

  The present disclosure provides an imaging apparatus capable of generating a still image that is captured without missing an unexpected photo opportunity.

  An imaging apparatus according to an embodiment of the present disclosure includes an imaging unit that generates image data from optical information input via an optical system unit, an image processing unit that performs predetermined processing on image data generated by the imaging unit, and settings related to moving image shooting A control unit that controls the optical system unit, the imaging unit, and / or the image processing unit to generate moving image data, and a display unit. The control unit has a first moving image mode and a second moving image mode as moving image recording modes. In the second moving image mode, the control unit automatically sets the setting related to moving image shooting to a predetermined setting suitable for still image recording. Recording in the second moving image mode is performed from the start to the end of moving image recording. The control unit is configured to display the first moving image mode on the display unit at least one of when recording in the second moving image mode and when displaying the moving image recorded in the second moving image mode. A display indicating that the video mode is 2 is performed.

  In addition to the first moving image mode for recording a moving image, the imaging apparatus according to the present disclosure includes a second moving image for recording a moving image with shooting settings more suitable for still image recording than the first moving image mode. Has a mode. The user can extract a desired still image from the moving image data generated in the second moving image mode. For this reason, the user can generate an image photographed at a decisive moment, which has been difficult in the past, without being aware of the shutter chance.

The figure which shows the structure of the digital camera which concerns on this indication Rear view of digital camera Diagram explaining how to extract still images from video data Diagram explaining various setting values in normal movie mode and photo movie mode Diagram explaining the screen for setting to photo movie mode The figure explaining the operation member for setting to photo animation mode Flow chart showing moving image recording operation in digital camera Illustration explaining the warning message displayed when shooting in photo movie mode Illustration explaining the warning message displayed when shooting in photo movie mode A flowchart showing a process of extracting a still image from moving image data in a digital camera (A) A diagram illustrating a state in which three moving image data recorded in the photo moving image mode are stored in a memory card, (b) a diagram illustrating a screen for cutting out a still image from the moving image data. Diagram explaining operation buttons for moving between marked frames Diagram for explaining the operation for cutting out still images from video data The figure which shows another example of the display which shows the delimiter between animated picture data The figure which shows the example of a display mode change of a digital camera The figure which shows the example of arrangement of marking button of digital camera The figure explaining the display displayed when it was marked during video recording, and the operation buttons for marking Illustration for explaining the recording location of marking information of video Diagram explaining the marking database that is updated when a marking instruction is given during video recording Diagram showing an example of processing when moving between marked frames Example of a screen displaying thumbnails of marked frames as representative images Diagram for explaining bracket shooting in the photo movie mode Illustration for explaining the recording / playback screen for movies recorded in vertical shooting Flow chart showing an example of processing at the time of vertical shooting in the photo video mode of the digital camera The flowchart which shows another processing example in the case of the vertical shooting in the photo movie mode of the digital camera Flowchart explaining the process of cutting out a still image from a video recorded by vertical shooting Illustration for explaining the rotation information recorded in the header of the video

  Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed descriptions of already well-known matters and repeated descriptions for substantially the same configuration may be omitted. This is to avoid the following description from becoming unnecessarily redundant and to facilitate understanding by those skilled in the art. The inventor (s) provides the accompanying drawings and the following description in order for those skilled in the art to fully understand the present disclosure, and is intended to limit the subject matter described in the claims. Not what you want.

  Hereinafter, an embodiment of an imaging device according to the present disclosure will be described with reference to the drawings.

(Embodiment 1)
1. Configuration of Digital Camera First, an example of the electrical configuration of the digital camera according to the first embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a configuration of the digital camera 100. The digital camera 100 is an imaging device that captures an object image formed by an optical system 110 including one or a plurality of lenses with a CCD 140.

  The image data generated by the CCD 140 is subjected to various processes by the image processing unit 160 and stored in the memory card 200. Hereinafter, the configuration of the digital camera 100 will be described in detail.

  The optical system 110 includes a zoom lens and a focus lens. The subject image can be enlarged or reduced by moving the zoom lens along the optical axis. Further, the focus of the subject image can be adjusted by moving the focus lens along the optical axis.

  The lens driving unit 120 drives various lenses included in the optical system 110. The lens driving unit 120 includes, for example, a zoom motor that drives a zoom lens and a focus motor that drives a focus lens.

  The diaphragm unit 300 adjusts the amount of light to be transmitted by adjusting the size of the light opening in accordance with the setting of the user or automatically.

  The shutter unit 130 is a means for blocking light transmitted through the CCD 140. The shutter unit 130, together with the optical system 110 and the diaphragm unit 300, constitutes an optical system unit that controls optical information indicating a subject image.

  The CCD 140 captures the subject image formed by the optical system 110 and generates image data. The CCD 140 includes a color filter, a light receiving element, and an AGC (Auto Gain Controller). The light receiving element converts the optical signal collected by the interchangeable lens 101 into an electric signal, and generates image information. The AGC amplifies the electric signal output from the light receiving element. The CCD 140 further includes a drive circuit for performing various operations such as exposure, transfer, and electronic shutter. Details will be described later.

  An ADC (A / D converter: analog-digital converter) 150 converts analog image data generated by the CCD 140 into digital image data.

  The image processing unit 160 performs various processes on the digital image data generated and converted by the CCD 140 under the control of the controller 180. The image processing unit 160 generates image data to be displayed on the display monitor 220 or generates image data to be stored in the memory card 200. For example, the image processing unit 160 performs various processes such as gamma correction, white balance correction, and flaw correction on the image data generated by the CCD 140. Further, the image processing unit 160 converts the image data generated by the CCD 140 into H.264. It compresses by the compression format etc. based on H.264 standard or MPEG2 standard. The image processing unit 160 can be realized by a DSP (Digital Signal Processor), a microcomputer, or the like. The image processing unit 160 can generate moving image data (4K moving image data) having about 4000 × 2000 pixels based on the image data generated by the CCD 140. The image processing unit 160 can perform various processes to be described later on the generated 4K moving image data.

  The controller 180 is a control unit that controls the entire digital camera 100. The controller 180 can be realized by a semiconductor element or the like. The controller 180 may be configured only by hardware, or may be realized by combining hardware and software. The controller 180 can be realized by a microcomputer, CPU, MPU, ASIC, FPGA, or the like.

  The buffer 170 functions as a work memory for the image processing unit 160 and the controller 180. The buffer 170 can be realized by, for example, a DRAM (Dynamic Random Access Memory), a ferroelectric memory, or the like.

  The card slot 190 is detachable from the memory card 200. The card slot 190 can be mechanically and electrically connected to the memory card 200.

  The memory card 200 includes a flash memory, a ferroelectric memory, and the like, and can store data such as an image file generated by the image processing unit 160.

  The built-in memory 240 is composed of a flash memory or a ferroelectric memory. The built-in memory 240 stores a control program for controlling the entire digital camera 100 and the like.

  The operation member 210 is a generic name for a user interface that receives an operation from a user. The operation member 210 is, for example, a selection button or a determination button that receives an operation from the user.

  The display monitor 220 can display an image (through image) indicated by image data generated by the CCD 140 or an image indicated by image data read from the memory card 200. The display monitor 220 can also display various menu screens for performing various settings of the digital camera 100. The display monitor 220 is composed of a liquid crystal display device or an organic EL display device.

  FIG. 2 is a view showing the back surface of the digital camera 100. The operation member 210 includes a member that receives an operation by a user, such as a button, a lever, a dial, and a touch panel. For example, as shown in FIG. 2, the operation member 210 includes a release button 211, a selection button 213, a determination button 214, a moving image recording button 217, and the like. When the operation member 210 receives an operation by the user, the operation member 210 transmits various instruction signals to the controller 180.

  The release button 211 is a two-stage push button. When the release button 211 is pressed halfway by the user, the controller 180 executes autofocus control (AF control), auto exposure control (AE control), and the like. When the release button 211 is fully pressed by the user, the controller 180 records image data captured at the timing of the pressing operation on the memory card 200 or the like as a recorded image.

  The selection button 213 is a push button provided in the up / down / left / right directions. The user can move the cursor or select various condition items displayed on the display monitor 220 by pressing any direction of the selection button 213.

  The decision button 214 is a push button. When the determination button 214 is pressed by the user while the digital camera 100 is in the shooting mode or the playback mode, the controller 180 displays a menu screen on the display monitor 220. The menu screen is a screen for setting various conditions for shooting / playback. When the determination button 214 is pressed when a setting item for various conditions is selected, the controller 180 finalizes the setting of the selected item.

2. Operation of Digital Camera The digital camera 100 of the present embodiment has a moving image recording mode for recording moving images and a reproduction mode for reproducing recorded images as operation modes. Furthermore, the moving image recording mode includes a normal moving image mode (an example of the first moving image mode) for shooting a normal moving image and a photo moving image mode for shooting a moving image that enables high-quality still images to be cut out. It includes two moving image modes (an example of the second moving image mode).

2.1 Photo Movie Mode The photo movie mode is a mode for shooting a movie for cutting out a still image. That is, as shown in FIG. 3, one frame image is cut out from a plurality of frame images constituting the moving image from the moving image shot in the photo moving image mode, and recorded as a still image. In the photo moving image mode, moving images are recorded with shooting settings more suitable for still image recording than in the normal moving image mode.

  A user can cut out an image (frame image) of a desired scene as a still image from a moving image shot in such a photo moving image mode. For this reason, the user can select a desired image from the frame images constituting the moving image taken without being aware of the shutter chance, and it is possible to generate an image in which a decisive moment that has been difficult in the past is taken. That is, it is possible to easily take a picture of a happening / accident that does not know when it occurs or a picture of an instantaneous state of a subject (liquid, flame, etc.) whose state changes over time.

  Since a moving image shot in the photo moving image mode cuts out each frame image constituting the moving image as a still image, the image quality when cut out as a still image is higher than the quality and image quality (hereinafter referred to as image quality) of moving images. have priority. For this reason, when the photo moving image mode is set, various settings relating to shooting are automatically (forcedly) set to settings specific to the photo moving image mode suitable for recording a still image. FIG. 4 shows settings specific to the photo moving image mode in contrast to the settings in the normal moving image mode. In the settings specific to the photo moving image mode, various setting values are set to values that improve the image quality of a still image cut out from the moving image.

  For example, the image quality setting (resolution) is set to a value designated by the user in the range of VGA to 4K (around 4000 pixels × 2000 pixels) in the normal moving image mode. In contrast, in the photo moving image mode, the image quality setting (resolution) is set to 4K, which is the highest resolution that can be set in the digital camera 100. As a result, high-quality frame images can be recorded, and high-quality still images can be cut out. The frame rate of the moving image is set to a value designated by the user in 24p, 25p, and 30p in the normal moving image mode. On the other hand, in the photo moving image mode, the maximum frame rate is set to 30p. By setting a high frame rate, the time interval between frames in a moving image is shortened, and the timing at which a still image can be cut out increases even if recording is performed for the same time. Note that the photo moving image mode is not limited to a 4K moving image having about 4000 × 2000 pixels, and a still image with higher image quality can be obtained in a high resolution moving image mode. For example, the digital camera 100 may be able to set an 8K moving image having 8000 × 4000 pixels as the set image quality in the photo moving image mode. The digital camera 100 only needs to be able to set the highest resolution in the normal moving image mode. Alternatively, since a high-resolution moving image generally requires a lot of processing performance, it may not be recorded at the highest frame rate captured by the camera sensor 140. In this case, it is desirable to provide two modes of “image quality priority” and “photo opportunity priority” in the setting of the photo moving image mode. In the image quality priority mode, the video mode with the highest resolution is selected. On the other hand, in the photo opportunity priority mode, a moving image mode in which the highest recording frame rate can be secured within a predetermined resolution or higher is selected. As a result, the user can more intuitively select the moving image mode in which the pixels of the cut-out still image are large and the moving image mode in which there is a high possibility that a decisive moment can be stored (the frame rate of the moving image is high). .

  Also, the color tone needs to be set to a color setting on the premise that the image is cut out as a still image. Regarding the exposure setting, in the normal moving image mode, any one of the P mode (program mode), A mode (exposure priority), S mode (shutter speed priority), and M mode (manual mode) is set by the user. Is done. On the other hand, in the photo moving image mode, the S mode (shutter speed priority) is set.

  Regarding the shutter speed, in the normal moving image mode, the shutter speed is set to a value corresponding to the frame rate of the moving image to be recorded (for example, 1/30 second when the frame rate is 30 frames / second). On the other hand, in the photo moving image mode, it is set to be faster (for example, less than 1/30 seconds) than the value of the frame period. In the normal moving image mode, the shutter speed is set to a value about the frame rate of the moving image so that a smooth moving image is reproduced during moving image reproduction. However, with the above settings, for example, if you shoot a subject such as a moving animal, the video will be smooth, but if you cut it out as a still image, it will be a still image with subject blurring. Will get worse. Therefore, in this embodiment, the shutter speed in the photo moving image mode is set to a value higher than the shutter speed in the normal moving image mode. This makes it possible to cut out a high-quality still image with little subject blur when cut out as a still image. As described above, in the photo moving image mode, the shutter speed is set by giving priority to the image quality of the still image over the image quality of the moving image.

  Regarding the range of the brightness level, in the normal moving image mode, a part of the brightness level range of the digital camera is set for the reason of displaying an image on the TV using the HDMI (registered trademark) standard. In contrast, in the photo moving image mode, priority is given to the image quality as a still image, so it is not desirable to limit the luminance level. Therefore, digital camera 100 according to the present embodiment sets the brightness level range to the maximum value of the brightness level range of the digital camera in the photo moving image mode.

  The image aspect ratio is fixed at 16: 9 in the normal moving image mode. In the photo moving image mode, the ratio is set to any one of 16: 9, 4: 3, 3: 2, and 1: 1 according to the setting by the user.

  Regarding the upper limit of automatic ISO, the upper limit value of ISO in the photo moving image mode is set higher than the upper limit value of ISO in the normal moving image mode. For example, in the normal moving image mode, the upper limit of automatic ISO is set to 6400. On the other hand, in the photo moving image mode, the upper limit of the automatic ISO is set to a value higher than that of the normal moving image mode, such as 25600. Thereby, it is possible to set a higher shutter speed in the photo moving image mode than in the normal moving image mode.

  Regarding the auto focus (AF) follow-up speed, white balance (WB) follow-up speed, and automatic exposure (AE) follow-up speed, those values in the photo movie mode are set to values higher than those in the normal movie mode. . When the auto focus (AF) follow-up speed or the like is increased, the quality of the moving image is deteriorated because the focus fluctuates particularly with respect to a moving subject. For this reason, it is not preferable to control autofocus (AF) at high speed in the normal moving image mode. However, with regard to the photo video mode, the higher the autofocus (AF) speed, etc., the higher the number of frames in which the subject is in focus and the more appropriate the frame, so it met the purpose of cutting out still images. It is possible to record a moving image. In the photo movie mode, the image quality of still images is emphasized and the image quality as a movie is reduced. However, the auto focus (AF) tracking speed, white balance (WB) tracking speed, and automatic exposure (AE) tracking speed are faster. Force a value.

  When set to the photo movie mode, the setting value suitable for still image recording is automatically set (forcibly) as described above, so a movie specialized for cutting out a still image should be recorded. Is possible. For this reason, a high-quality still image can be cut out from a moving image shot in the photo moving image mode.

  In order to set the moving image mode to the photo moving image mode, as shown in FIG. 5A (a), it may be set by selecting a selection item related to the photo moving image from the setting menu. Alternatively, as shown in FIG. 5B, the digital camera 100 may be provided with a dedicated button 218 for setting the photo moving image mode, and by operating the dedicated button 218, the photo moving image mode may be set. Good. Alternatively, the photo moving image mode may be set by operating an operation system such as a mode selection dial provided in the digital camera 100. In the moving image setting screen shown in FIG. 5A, in addition to ON / OFF of the photo moving image mode, moving image settings such as color setting, recording method, and image quality setting for a photo moving image can be performed. When the setting of the photo moving image mode is performed here, a transition is made to the detailed setting screen of the photo moving image mode shown in FIG. 5A (b). Here, the user can set the aspect ratio of the moving image. In addition, on the screen at this time, it is desirable that the digital camera 100 displays the setting contents automatically set in the photo moving image mode. This is because it is difficult for the user to memorize many settings such as an angle of view when performing moving image settings. Therefore, user convenience is improved by displaying as described above. As described above, the photo moving image mode is a moving image mode specialized for cutting out a still image, and thus the image quality of the moving image is not necessarily good. Therefore, when the photo moving image mode is turned on, it is desirable to present a warning screen or a reconfirmation message to the user as shown in FIG. 5A (c). This can prevent the user from selecting an inappropriate moving image mode. When the user selects the photo movie mode in FIG. 5A (c), the screen returns to the movie setting screen. At this time, as shown in FIG. 5A (d), it is desirable that the exposure setting, brightness level, and the like that are automatically set in the photo moving image mode are displayed differently in grayout or the like.

2.2 Moving Image Recording The moving image recording operation of the digital camera 100 according to the present embodiment will be described with reference to the flowchart of FIG. In the digital camera 100, when the moving image recording button 217 is pressed by the user, the recording of the moving image is started, and when the moving image recording button 217 is pressed during the recording of the moving image, the recording of the moving image is stopped.

  When the moving image recording button 217 provided on the back of the digital camera 100 is pressed by the user (S11), the controller 180 determines whether the set moving image mode is the normal moving image mode or the photo moving image mode (S12). ).

  When the photo moving image mode is set, the controller 180 displays a message for warning the user that the photo moving image mode is set as shown in FIG. 7A (S13). In the photo moving image mode, the shutter speed is set faster than in the normal moving image mode, the moving image is not smooth, and is not suitable for moving image shooting / playback. For this reason, in order to prevent photographing in the photo moving image mode against the user's intention, an icon different from the normal moving image mode is displayed and a warning is displayed. Note that such a warning may be displayed when the moving image mode is changed from the normal moving image mode to the photo moving image mode. In addition, as shown in FIG. 7B, during recording a moving image, it is desirable to display the icon 400 on the liquid crystal monitor 220 in order to clearly indicate the photo moving image mode.

  When the photo moving image mode is set, the controller 180 sets the setting relating to the moving image recording to the setting for the photo moving image mode (see FIG. 4) (S14). When the normal moving image mode is set, the controller 180 uses the currently set setting for the normal moving image mode.

  Thereafter, the controller 180 starts moving image recording (S15). Thereafter, the controller 180 performs moving image recording based on the set value until receiving a moving image recording stop instruction (S16). During moving image recording, the moving image data is recorded on the memory card 200. In the normal moving image mode and the photo moving image mode, moving images are recorded according to a predetermined format for moving image data. For example, a moving image is recorded according to the MP4 standard (H.264 / MPEG-4 AVC format).

  Here, the digital camera 100 of the present embodiment can mark the vicinity of a target frame to be cut out later during moving image shooting. Therefore, the controller 180 determines whether or not a marking instruction is given from the user (S17). Marking is an operation for designating a frame image at a certain timing in a moving image. When a marking instruction is given (YES in S17), a marking process is performed (S18). Details of the marking process will be described later.

  When moving image recording button 217 is pressed during moving image recording (YES in S19), controller 180 stops the moving image recording operation (S20). The controller 180 continues the moving image recording operation until the moving image recording button 217 is pressed (S19).

2.3 Still Image Extraction from Movie Data The still image extraction processing from movie data recorded in the photo movie mode will be described with reference to FIGS. FIG. 8 is a flowchart of still image cutout processing from moving image data. FIG. 9A shows three moving images A, B and C recorded in the memory card 200 and recorded in the photo moving image mode. FIG. 9B shows an image selection screen (operation screen) used when a moving image for cutting out a still image is selected.

  When a predetermined button on the digital camera 100 is pressed by the user, the controller 180 displays an image selection screen as shown in FIG. 9B on the display monitor 220. On the image selection screen, thumbnail images 31 of frames at predetermined intervals are displayed for each of the moving images A to C. That is, on the image selection screen, a representative thumbnail image of the moving image data divided at predetermined time intervals (the first frame image of the divided moving image data) is displayed for each of the moving images A to C. In the example of FIG. 9B, thumbnail images corresponding to frame images every 5 seconds are displayed for each of the moving images A, B, and C. For example, for the moving image A, thumbnail images A1, A2,... Of frame images every 5 seconds are displayed. The time interval of the frame can be changed to 5 seconds or 10 seconds by buttons 41 and 42. By displaying thumbnail images of frames at predetermined time intervals in this way, the user can efficiently select a moving image including a desired scene, and as a result, it is possible to quickly find a scene to be cut out.

  The user can select one thumbnail image by operating the selection button 213 provided on the back of the camera or the touch panel to move the cursor on the image selection screen. When one thumbnail image is selected by the user (S30), the controller 180 reproduces the moving image of the selected thumbnail image from the frame of the selected thumbnail image (S31). During image reproduction, a screen on which predetermined operation buttons as shown in FIG. 10 are displayed is displayed on the liquid crystal monitor 220. With the operation buttons on the screen, the user can perform operations such as reproduction and stop on the moving image data. In addition, it is desirable that the moving image recorded in the photo moving image mode displays the icon 502 on the liquid crystal monitor 220. Thereby, the user can easily recognize that the moving image is recorded in the photo moving image mode suitable for cutting out a still image.

  When the user presses the pause button during the reproduction of the moving image (S32), the controller 180 pauses the moving image display and displays the frame image (still image) at the stopped position (S33).

  FIG. 11A shows an example of a still image displayed on the display monitor 220 at the time of pause. On the display monitor 220, frame advance buttons 55a and 55b are displayed. By operating the frame advance buttons 55a and 55b, the user can advance the still image one frame forward and backward. For example, when the frame advance button 55a is operated, the image of the frame immediately before the currently displayed image is displayed on the display monitor 220. Further, when the frame advance button 55b is operated, an image of a frame immediately after the currently displayed image is displayed on the display monitor 220. When the frame advance buttons 55a and 55b are operated (S36), the controller 180 switches the image displayed on the display monitor 220 (S37). The user operates the frame advance buttons 55a and 55b to display a desired image on the display monitor 220.

  When the determination button 214 is pressed by the user (S34), the number of frames to be cut out next is designated (S35). When the number of cutouts is specified, the specified number of images from the currently displayed image (frame image) are cut out as still images and recorded on the memory card 200 (S38). Specifically, when the determination button 214 is pressed, a confirmation message for the user as shown in FIG. 11B is displayed. When a user instruction (“Yes”) is input to the confirmation message, The controller 180 cuts out the frame data being displayed from the moving image data and records it on the memory card 200 as a still image. The moving image data recorded in the photo moving image mode is recorded in the moving image format (MP4), and compression between frames is performed. For this reason, when a frame of moving image data is cut out and cut out as a still image, the controller 180 converts the frame image data into a still image format (for example, JPEG) and records it.

  As described above, still image data can be cut out from moving image data.

  In the image selection screen shown in FIG. 9B, the thumbnail images A1, A2,... For the moving image A are followed by the thumbnail images B1, B2,. … Is displayed. In this way, the thumbnail images of the moving image A, the moving image B, and the moving image C are continuously displayed. For this reason, the display 50 which shows the division | segmentation in the boundary of a moving image is displayed so that the division | segmentation between moving images can be known. The display indicating this separation is not limited to that shown in FIG. As shown in FIG. 12, the color of the thumbnail images (B1, C1) located at the head of the boundary of the moving image may be different from other colors.

  Details of step S33 in the flowchart of FIG. 8 will be described with reference to FIG. When a still image is cut out from a moving image, the user can select a frame that is more suitable for cutting out by comparing the picture to be cut out in detail for each frame. For this reason, the digital camera 100 preferably has a function of displaying a frame that is one frame before or one frame after the paused frame by a predetermined operation on the paused screen (FIG. 13B). )reference). Furthermore, it is desirable that the digital camera 100 has a function of zooming in on the same specific area of the arranged frames in accordance with a user enlargement instruction (see FIG. 13C). This makes it easier for the user to select a still image to be cut out in more detail.

2.4 Marking Process Hereinafter, the marking process (step S18 in the flowchart of FIG. 6) will be described.

  The digital camera 100 has a function of marking the vicinity of a target frame to be cut out later during moving image shooting. The marking instruction is made by pressing a predetermined operation button. Marking is a sign of a plan to cut out as a still image or a desire to cut out. For this reason, it is desirable to assign the marking button to a button provided on the same side as the release button 211 in the digital camera 100 as shown in FIG. This is called a marking button 219. This makes it possible to select a still image cutout candidate in the photo moving image mode called marking with the same feeling as pressing the release button 211, which is an operation of taking a picture. In the following description, it is assumed that the marking button 219 is provided in the digital camera 100.

  When the marking button 219 is pressed by the user during moving image recording, the frame being recorded at that time is marked. The marked frame serves as an index for the user to search for a frame to be cut out as a still image. In the digital camera 100 of the present embodiment, the number of frames that can be marked is limited.

  When a marking instruction is given during moving image recording, the controller 180 displays a display 219a indicating that marking has been performed for a predetermined number of seconds on the display monitor 220, as shown in FIG. In the digital camera 100, the number of frames that can be marked is limited. The indication 219a indicating that marking has been performed includes information indicating the number of times marked and information indicating the maximum number (upper limit) of frames that can be marked. By referring to this display 219a, the user can grasp the number of markings at the present time, and therefore the number of markings resulting from the user inadvertently marking reaches the upper limit, and important scenes cannot be marked. Can be prevented. When there is no limit on the number of markings, information on the maximum possible number of markings is not displayed. Information indicating the number of times of marking included in the display 219a is updated every time the user presses the marking button 219.

  When a marking instruction is given, the controller 180 records information indicating the marking timing in a database (Mark Data Base) for managing the marking. This database (Mark Data Base) is stored in the header 601 of the moving image data shown in FIG. Here, the header 601 is information about the data itself that is added to the data. The still image / moving image captured by the digital camera 100 has still image / moving image data (AV data) and a header added to the AV data. For example, as shown in FIG. 17A, it is assumed that a marking instruction is given by the user when 3000, 5500, and 8000 msec have elapsed from the start of recording during moving image recording. In this case, as shown in FIG. 17B, the controller 180 records a Mark ID for identifying the performed marking in a database (Mark Data Base) in association with the marked time. By referring to this database, the controller 180 can retrieve the marked frame.

  When the image is reproduced after the recording in the photo moving image mode is completed, a plurality of predetermined operation buttons are displayed so as to be superimposed on the image as shown in FIG. With these operation buttons, the user can perform marking feed on moving image data in addition to operations such as playback, stop, and fast-forward. Hereinafter, marking feed will be described.

  A Prev Mark cursor (2191) and a Next Mark cursor (2192) are displayed on the liquid crystal monitor 220 as operation buttons for marking feeding. When the Prev Mark cursor (2191) or the Next Mark cursor (2192) displayed on the monitor is touched by the user, the controller 180 refers to the database (Mark Data Base) and displays the frame before and after the currently displayed frame. A marked frame image existing in time is detected and displayed. By operating the Prev Mark cursor (2191) and the Next Mark cursor (2192), it is possible to jump from one marked image to another marked image. By doing in this way, it becomes possible to search for the vicinity of the frame to be cut out designated (marked) during shooting in the photo moving image mode in a short time.

  Note that the cursor 2191 or 2192 may not be displayed when there is no marked frame before or after the currently displayed frame. Alternatively, the display of the cursor 2191 or 2192 may be lightened (grayed out).

  Further, the marking feed operation button is not displayed on the liquid crystal monitor 220, and marking feed may be performed by an existing operation system. For example, when the left and right buttons of the selection button 213 are double-clicked, marking feeding may be performed. Alternatively, marking feed may be performed by double-tapping the fast forward / rewind cursor appearing on the playback screen. By using the existing operation system in this way, it is not necessary to newly provide an operation system for marking feeding, and space can be used effectively.

  The digital camera 100 desirably displays the marking display 503 for a predetermined time. As a result, the user can recognize that the marked frame has passed. Therefore, after displaying the marking display 503, the user can press the pause button to easily find the frame around the marked frame, that is, the frame around the frame to be cut out as a still image. Is possible.

  The cursors 2191 and 2192 may be displayed only when a predetermined button is pressed. This predetermined button is preferably a marking button 219. Thus, the operability of the digital camera 100 is improved by assigning the marking function to one button.

  In order to improve the operability of the digital camera 100, the following operability may be used. As shown in FIG. 18, it is assumed that there is a moving image of 10,000 msec in which a marking instruction is given when 3000, 5500, and 8000 msec have elapsed from the start of recording. Here, it is assumed that the current time is 5500 msec (point 2201) and is close to Mark # 2 by a predetermined time or more in time (here, the predetermined number of seconds is set to 1000 msec, for example). In this case, when the user presses the Prev Mark cursor (2191), it is desirable to jump to Mark # 1 instead of Mark # 2. When the current playback point is 90000 msec (point 2202) and the Next Mark cursor (2192) is operated, it is desirable to move to 100000 msec at the end of the moving image and further pause. This makes it possible to easily select a still image near the end.

  When displaying the data marked by the user, as shown in FIG. 19B, in addition to the method of displaying thumbnails divided every predetermined time (for example, 5 seconds) as described above. It is also possible to display an image of each marked frame. At that time, the marked frame is displayed as a thumbnail. As shown in FIG. 19B, the screen for displaying the thumbnail of the frame with the marking is switched by pressing the button 43 displayed on the liquid crystal monitor 220.

2.5 Bracket shooting The digital camera 100 can perform various bracket shooting in the photo moving image mode. Bracketing is a method of creating a plurality of images (frames) by changing the exposure value, shutter speed, focus point, color tone, and the like. Here, for example, a case where the exposure value is changed between frames for bracket shooting will be described. Note that settings other than the settings to be changed in bracket shooting are set to values originally set in the photo moving image mode (see FIG. 4).

  As shown in FIG. 20, the digital camera 100 groups each frame acquired in the photo moving image mode every three frames. The set of frames every three frames is referred to as a GOP (Group Of Picture). The top image data (frame) of the GOP is referred to as an I image.

  The digital camera 100 performs predetermined bracket shooting in the GOP. Specifically, based on the exposure value α of the I image that is the first frame of the GOP, the second frame is shot with an exposure value of α + 1 and the third frame with an exposure value of α-1. . By performing this continuously, it is possible to switch the shooting settings at short intervals and to shoot, and it is possible to cut out a still image of the subject with the desired shooting settings later.

  Note that bracket shooting is performed in the GOP during shooting, but it is preferable to play back only the I image during playback. This is because if the moving image data obtained by bracket shooting is reproduced as it is, the shooting setting (for example, exposure value) is switched and reproduced at a high cycle, so that the user is likely to feel uncomfortable. For this reason, the digital camera 100 reproduces only the I image whose photographing setting does not change when reproducing the moving image data obtained by the bracket photographing, and displays an image other than the I image at the time of frame advance.

  In the above example, the exposure value is changed in bracket shooting, but other shooting setting conditions may be changed. For example, shooting may be performed while changing the shutter speed, focus point, color tone, and the like. Further, although an example in which only one shooting setting condition (for example, an exposure value) is changed in bracket shooting has been described, bracket shooting in which a plurality of shooting setting conditions are changed may be performed. In the above example, the GOP includes a set of three frames, but any number of GOPs may be used as long as the GOP is a set of a plurality of images.

2.6 Vertical Shooting The photo moving image mode is a mode for shooting a moving image intended to be cut out as a still image, and vertical shooting is often performed during still image shooting. For this reason, in the photo moving image mode, it is desirable that the moving image is reproduced in the portrait orientation when the camera is oriented in the portrait orientation. FIG. 21 exemplifies the case where the vertical reproduction is performed and the case where it is not performed when the moving image is shot in the vertical shooting. As shown in FIG. 21 (a), when shooting in vertical shooting, if it is played back by the camera as it is, a subject rotated 90 degrees is played back in the normal way of holding the camera as shown in FIG. 21 (b). The For this reason, in order to browse a moving image more intuitively, it is necessary to rotate the camera, which is complicated. For this reason, when a moving image is reproduced, it is desirable that the object is reproduced in the same manner as shown in FIG. 21C regardless of the shooting direction of the camera at the time of recording.

  FIG. 22 shows a flowchart of a vertically shot moving image. The digital camera 100 detects the shooting direction of the camera at the start of moving image recording (S50). When the shooting direction of the camera is normal horizontal shooting (horizontal shooting). (N in S51), the conventional photo moving image mode is shot. When the shooting direction is the vertical direction (vertical shooting) (Y in S51), the digital camera 100 rotates the video signal input from the CCD 140 by 90 degrees (S52), and compresses and records the rotated video (S52). S53). This makes it possible to record a vertically shot moving image.

  Also, since moving image recording requires higher processing performance than still image shooting, if the video signal input from the CCD 140 is rotated for each frame during recording, the processing performance may not be in time. For this reason, as shown in the flowcharts of FIGS. 23 and 24, during recording, only the rotation information (shooting direction information) is recorded in the header of the moving image, and only the display is rotated during playback to cut out still images. Sometimes, a process of rotating the shooting direction of the still image together may be executed. As a result, the processing load is reduced, so that a moving image can be taken vertically even with a digital camera equipped with a cheaper LSI.

  FIG. 23 is a flowchart during moving image recording. The video signal from the CCD 140 is not rotated, and only the rotation information (imaging direction information) is recorded in the header (S55). FIG. 24 shows a flowchart for reproduction. At the time of reproduction, the recorded rotation information is read to detect in which direction the camera is recorded (S31a). When recorded in the horizontal direction (lateral direction) (N in S31b), the digital camera 100 performs playback as usual. When recorded in the vertical direction (vertical direction) (Y in S31b), the digital camera 100 displays the recorded video by rotating it by 90 degrees, as if it were recorded in the vertical direction. Similarly, when extracting a still image, the rotation information of the moving image is detected from the header (S38a), and if the direction of the moving image is horizontal, the corresponding frame is directly extracted as a still image (S38b). In this case, the selected frame image is rotated 90 degrees (S38c). At that time, still image generation is performed by adding rotation information indicating that the image is captured in the vertical direction to the header of the still image. The other operations are assumed to be the same as those in FIG. In step S38c, the frame image may be rotated without adding the rotation information to the header, or the still image may not be rotated and only the rotation information may be added to the header. When the user reproduces the image, it is only necessary that the still image is displayed in a direction corresponding to the shooting direction of the camera at the time of recording.

  The direction of the moving image may be detected only once at the start of moving image recording, or may be continuously performed during moving image recording, and rotation information may be added to the moving image header information along with time series. Alternatively, the direction of the moving image may be detected by recording the captured moving image data while appropriately rotating the image and displaying the moving image while rotating the image appropriately. As a result, even if the camera is rotated during moving image recording, it is possible to record a still image considering the rotation information. FIG. 25 shows the rotation information recorded in the moving image header 601. Furthermore, information recorded in the Exif of a still image that can be changed in a moving image is preferably recorded in the header 601 even for information other than rotation information. One example of information recorded in the header 601 is zoom information. During movie recording, zooming is often used to frame the subject. Since the zoom information is correctly recorded in the still image cut out from the moving image, for example, when this photo is uploaded to the photo sharing site, it is possible to sort by the focal length information, and the convenience for the user is improved.

3. Effects, etc. The digital camera 100 of the present embodiment includes an optical system unit (optical system 110, shutter unit 130, aperture unit 300) that controls optical information indicating a subject image, and optical information input via the optical system unit. A CCD (imaging unit) 140 that generates image data, an image processing unit 160 that performs predetermined processing on the image data generated by the imaging unit, an optical system unit, an imaging unit, and / or image processing based on settings related to moving image shooting A controller 180 that controls the unit to generate moving image data. The controller 180 includes a normal moving image mode for recording a moving image (an example of a first moving image mode) and a photo moving image mode for recording a moving image with shooting settings more suitable for still image recording than the normal moving image mode (second moving image mode). An example of a mode). In the photo moving image mode, the controller 180 automatically sets settings related to moving image shooting to predetermined settings suitable for still image recording.

  As described above, the digital camera 100 according to the present embodiment has a photo moving image mode that enables clipping of a high-quality still image in addition to the normal moving image mode. A moving image is shot in the photo moving image mode, and then a preferable still image can be extracted from the shot moving image. Therefore, the user can generate an image photographed at a decisive moment, which has been difficult in the past, without being aware of the shutter chance. For example, it is possible to easily take a picture of a happening / accident that does not know when it occurs or a picture of an instantaneous state of a subject (liquid, flame, etc.) whose state changes over time. In the photo moving image mode, settings relating to shooting are automatically (forcedly) set to a specific setting that allows a high-quality still image to be obtained, so that an image with a suitable image quality can be obtained as a still image. .

(Other embodiments)
As described above, the first embodiment has been described as an example of the technique disclosed in the present application. However, the technology in the present disclosure is not limited to this, and can also be applied to an embodiment in which changes, replacements, additions, omissions, and the like are appropriately performed. Moreover, it is also possible to combine each component demonstrated in the said Embodiment 1, and it can also be set as a new embodiment. Therefore, other embodiments will be exemplified below.

  (1) In the above embodiment, a specific example is shown in FIG. 4 as a setting suitable for recording a still image. However, a setting suitable for recording a still image is not limited to the setting shown in FIG. Settings suitable for recording a still image may include items other than the setting items shown in FIG. 4, and need not include all of the setting items shown in FIG. 4, but include only some items. But it ’s okay.

  (2) In the above embodiment, when a predetermined button is pressed during moving image recording in the photo moving image mode, the frame recorded at that time is marked. The timing at which marking can be performed is not limited to this. When a predetermined button for marking is pressed during reproduction of a moving image recorded in the photo moving image mode, a frame being reproduced at that time may be marked.

  (3) Although the above embodiment has been described using a digital camera as an example of an imaging apparatus, the imaging apparatus is not limited to this. The idea of the present disclosure can be applied to various imaging devices capable of shooting moving images, such as a digital video camera, a smartphone, and a wearable camera.

  (4) In the above-described embodiment, the image sensor is constituted by a CCD, but the image sensor is not limited to this. The imaging device may be configured with an NMOS image sensor or a CMOS image sensor.

(5) The photo moving image mode shown in the above embodiment can be applied to both the interchangeable lens camera and the lens-integrated camera.
(6) The moving image recorded in the photo moving image mode described in the above embodiment may be displayed with an icon or the like for distinguishing it from the moving image shot in the normal moving image mode.
(7) In the photo moving image mode shown in the above embodiment, an operation system such as a marking button is separately provided. May be.

  As described above, the embodiments have been described as examples of the technology in the present disclosure. For this purpose, the accompanying drawings and detailed description are provided. Accordingly, among the components described in the accompanying drawings and the detailed description, not only the components essential for solving the problem, but also the components not essential for solving the problem in order to illustrate the above technique. May also be included. Therefore, it should not be immediately recognized that these non-essential components are essential as those non-essential components are described in the accompanying drawings and detailed description. Moreover, since the above-mentioned embodiment is for demonstrating the technique in this indication, a various change, replacement, addition, abbreviation, etc. can be performed in a claim or its equivalent range.

  The present disclosure is applicable to an imaging apparatus that can capture a moving image. Specifically, the present invention can be applied to various imaging devices that can shoot moving images, such as digital video cameras, smartphones, and wearable cameras.

100 Digital Camera 110 Optical System 120 Lens Drive Unit 130 Shutter 140 CCD
150 A / D converter 160 Image processing unit 170 Buffer 180 Controller 190 Card slot 200 Memory card 210 Operation member 220 Display monitor 240 Built-in memory 300 Aperture unit

Claims (3)

An imaging unit that generates image data from optical information input via the optical system unit;
An image processing unit that performs predetermined processing on the image data generated by the imaging unit;
A control unit that controls the optical system unit, the imaging unit, and / or the image processing unit based on settings related to moving image shooting to generate moving image data;
A display unit,
The control unit has a first moving image mode and a second moving image mode as a moving image recording mode,
The control unit automatically sets the setting relating to the moving image shooting to a predetermined setting suitable for still image recording in the second moving image mode,
Recording in the second video mode is performed from the start to the end of video recording,
The control unit is set to the second moving image mode, at least one of recording at the second moving image mode, and at the time of displaying a moving image recorded at the second moving image mode, Displaying the second moving image mode on the display unit;
Imaging device.   The imaging device according to claim 1, wherein when the second moving image mode is set, the control unit displays on the display unit a message indicating the second moving image mode using a message.   The control unit displays an icon indicating that the second moving image mode is displayed on the display unit during recording in the second moving image mode or when reproducing a moving image recorded in the second moving image mode. The imaging device according to claim 1, wherein the imaging device is used.

Images