JP2005278059A - Image pickup device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To insert an eye catch image created by a user himself/herself into a moving picture that is being photographed. <P>SOLUTION: When a spot where a scene changes greatly or a spot that revitalizes effect comes while photographing a moving picture, an insertion operation for inserting insertion data such as a still picture and a moving picture into moving image data is performed. A moving image file 93 obtained by performing photographing while performing the insertion operation consists of a plurality of pieces of moving image data and a plurality of pieces of inserted data. When the moving image file 93 is reproduced, an eye catch image of the inserted data is displayed at a part where a scene changes, therefore to clarify contents of the moving image data and enhance entertainment. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an imaging device capable of shooting a moving image, and more particularly to an imaging device capable of inserting another image into a moving image being shot.

  A digital still camera is widely used in which a subject image formed by an imaging optical system is picked up by a CCD solid-state image pickup device or the like, digital image data is generated from an analog signal output from the CCD solid-state image pickup device, and recorded on a recording medium. ing. This digital still camera can shoot not only still images but also moving images.

  It has been desired that an existing video camera as a moving image photographing device can perform editing work such as title insertion while photographing. For example, in the invention described in Patent Document 1, in order to realize this demand, while taking a video camera with one hand and operating the wireless remote controller with the other hand, the insertion title selection, insertion position, etc. It can be operated.

Japanese Patent Laid-Open No. 06-233190

  In recent video editing, the insertion of eye-catching images is the mainstream rather than the insertion of titles. The eye-catching image is a short-time display of an accent image, an image suggesting the content of the main video, an abstract image, or the like before the main video. In addition, the eye-catching image has been requested by a user to use not only an image prepared by the manufacturer but also an image actually taken by himself or an image created by a personal computer.

  An object of the present invention is to provide an imaging apparatus that can insert an eye-catching image created by a user himself into a moving image being captured.

  In order to solve the above problems, an imaging apparatus according to the present invention includes an insertion data recording unit that records insertion data to be inserted into moving image data, a registration unit that previously registers insertion data in the insertion data recording unit, and a moving image. Insertion instruction means operated when inserting insertion data into data, and switching means for switching data recorded in the image data recording unit from moving image data to insertion data in accordance with an operation of the insertion instruction means during photographing. Are provided.

  Further, the switching means switches the data recorded in the image data recording unit from the moving image data to the insertion data for a certain period from the start of the operation of the insertion instruction means or during a period when the insertion instruction means is operated. It is a thing. Furthermore, still image data or moving image data is used as insertion data.

  Further, there is provided a selection means for selecting whether to record the moving image data or the insertion data during the insertion period in the moving image data after the shooting is completed, and during the insertion period of the insertion data. is there.

  Further, the insertion data display control means for displaying the insertion data read from the insertion data recording means on the display means, and the insertion data selection for selecting the insertion data to be inserted into the moving image data from the insertion data displayed on the display means Means.

  Further, when the moving image data is reproduced and displayed by the display means, a search means for searching for insertion data in the moving image data, a reproduction point display control means for displaying an image of the searched insertion data on the display means, Reproduction point selection means for selecting an image of insertion data on the display means is provided, and moving image data after the selected insertion data is displayed on the display means.

  According to the imaging apparatus of the present invention, it is possible to make the content of captured moving image data easy to understand and to enhance entertainment. In addition, since insertion data that produces such an effect can be inserted during shooting of a moving image, the effect of the insertion data can be obtained immediately after shooting. Furthermore, since insertion data can be registered, a wide variety of insertion data can be used.

  Further, when insertion data is inserted in a certain period from the start of operation of the insertion instruction means, the insertion time of insertion data can be made constant. In addition, when insertion data is inserted during a period in which the insertion instruction unit is operated, the insertion length of the insertion data can be arbitrarily set.

  Furthermore, since still image data or moving image data is used as insertion data, the effects of the insertion data can be varied.

  Further, since it is possible to select whether to record moving image data or insertion data after completion of shooting, even if insertion data is selected during shooting, this can be canceled after completion of shooting.

  Furthermore, since the insertion data is displayed on the display means and can be selected, the optimum insertion data can be selected from a large number of insertion data, and the entertainment of the moving image data can be further enhanced.

  In addition, since insertion data can be used as an index when moving image data is reproduced and displayed, a target scene can be quickly selected from the moving image data.

  FIGS. 1A and 1B are perspective views showing the appearance of a digital still camera 2 embodying the present invention, and FIG. 2 is a block diagram showing the configuration of the digital still camera 2. On the front surface of the digital still camera (hereinafter abbreviated as “camera”) 2, there are provided an objective finder 3, a microphone slit 4, a strobe light emitting unit 5, a lens barrel 6, a lens cover 7, and the like. Behind the microphone slit 4 is incorporated a microphone 9 for inputting sound when shooting a moving image.

  The lens cover 7 has a substantially semicircular shape and is slidable in the left-right direction. The lens cover 7 is slid to the closed position on the right side in the drawing when not in use or in the reproduction mode, and protects the front surface of the camera 2. When the camera 2 takes an image, the camera 2 is slid to the left open position in the drawing to expose the lens barrel 6, the strobe light emitting unit 5 and the like to the outside.

  On the upper surface of the camera 2, a power operation member 11 that is slid in the left-right direction and a shutter button 12 that is pressed in the up-down direction are provided. A power switch for turning on / off the power of the camera 2 according to the operation is incorporated under the power operation member 11. A shutter switch 14 is incorporated under the shutter button 12 to perform shutter release according to the operation.

  On the back of the camera 2, an eyepiece finder 16, a mode operation member 17, a cross key 18, a voice output unit 19, a display monitor 20, a cancel button 21, a menu button 22, a display button 23, and the like are provided. The mode operation member 17 is an operation member for switching the operation mode of the camera 2 between a moving image shooting mode for shooting a moving image, a playback mode for reproducing and displaying a shot still image and a moving image, and a still image shooting mode for shooting a still image. It is slidable in the left-right direction. A mode switch 25 that outputs an operation signal according to the slide position is incorporated in the back of the mode operation member 17.

  The cross key 18 includes an up / down lever 27 that is operated to swing in the up / down direction, and left / right buttons 28, 29 arranged beside the up / down lever 27. The up / down lever 27 and the left / right buttons 28, 29 are used to move a cursor or a selection frame displayed on the display monitor 20 in the up / down / left / right direction. The up / down lever 27 is also used for zooming during shooting and playback, and the left and right buttons 28, 29 are used for frame advancement during playback. A cursor switch 31 for detecting the operation of each operation member is incorporated in the back of the cross key 18.

  The audio output unit 19 includes a circular convex portion 33 in which a slit 33 a is formed and a speaker 34 accommodated in the convex portion 33. The sound output unit 19 outputs an operation sound of the camera 2, a reproduction sound at the time of moving image reproduction, and the like. The display monitor 20 comprises a color LCD panel 36, reproduces and displays captured image data, and is also used as a view finder during shooting.

  The menu button 22 is used when a setting menu corresponding to the currently set mode is called on the display monitor 20. The menu button 22 also functions as a determination button for executing a setting change at various settings. The cancel button 21 is used when canceling the setting change during various settings. The display button 23 is used to switch on / off the display of the display monitor 20 and switch the display setting of the display monitor 20 in the photographing mode. In the back of the cancel button 21, menu button 22, and display button 23, a cancel switch 38, a determination switch 39, and a display switch that are turned on / off by each button are incorporated.

  The camera 2 has an edit shooting mode in which insertion data such as a still image or a moving image can be inserted into moving image data during shooting of a moving image. In this editing shooting mode, the menu button 22 is operated when the camera 2 is in the moving image shooting mode, and the selection frame in the menu screen displayed on the display monitor 20 is operated with the cross key 18 to select the editing shooting mode. It can be set by doing.

  When the edit shooting mode is set, reduced images 40a to 40f of a plurality of types of insertion data are displayed on the display monitor 20, as shown in FIG. The user moves the selection frame 41 arranged around the insertion data image 40 a by operating the cross key 18 and operates the menu button 22 to select the insertion data. If there are six or more types of insertion data, a button 42 with “next page” is displayed at the lower right of the screen. By aligning the selection frame 41 with the button 42 and operating the menu button 22, the display screen is revised, and a larger number of inserted data can be viewed. Thereafter, when the menu button 22 is pressed during moving image shooting, the previously selected insertion data is inserted into the moving image data being shot.

  A memory card slot 43 that is opened and closed by a lid member 43 a is provided on the side surface of the camera 2. A known memory card 44 is inserted into the memory card slot 43. A connector that is electrically connected to the inserted memory card 44 is incorporated in the back of the memory card slot 43, and a media controller 46 that reads and writes image files from and to the memory card 30 is connected to this connector. Has been. On the bottom surface of the camera 2, a battery storage chamber in which a battery is set is provided. The battery storage chamber is closed by a battery lid 48 that can be freely opened and closed.

  In the lens barrel 6, a diaphragm plate 50 for switching the diaphragm and a photographing lens 51 are incorporated. The diaphragm plate 50 is moved by a motor 53 driven by a motor driver 52, and diaphragm apertures having different sizes are arranged on the photographing optical axis. The photographing lens 51 is moved along the photographing optical axis by a motor 55 driven by a motor driver 54, and focusing is performed.

  A CCD solid-state imaging device 57 is disposed behind the lens barrel 6. The subject image that has passed through the photographic lens 51 is imaged on the light receiving surface of the CCD solid-state image sensor 57 and captured. The CCD solid-state image sensor 57 photoelectrically converts the captured subject image and outputs an analog image signal. The CCD solid-state image sensor 57 has an electronic shutter function for performing a shutter release operation in response to an operation of a shutter switch. This electronic shutter function is controlled based on a timing signal (clock pulse) input from the timing generator 58.

  Analog signals output from the CCD solid-state imaging device 57 are sequentially input to the CDS circuit 60, the AMP circuit 61, and the A / D converter 62. The CDS circuit 60 is a correlated double sampling circuit (CDS), and generates R, G, B image data from an analog signal input from the CCD solid-state imaging device 57. The AMP circuit 61 is an amplifier (AMP), and amplifies the image data output from the CDS circuit 60. The A / D converter 62 converts an analog RGB image signal into digital RGB image data.

  The image input controller 64 is connected to the CPU 66 via the bus 65, and controls the CCD solid-state imaging device 57, the CDS circuit 60, the AMP circuit 61, and the A / D converter 62 in accordance with a control command from the CPU 66.

  The image signal processing circuit 68 performs various image processing such as gradation conversion, white balance correction, and γ correction processing, and YC conversion processing on the RGB image data. The image data of the through image before shooting is input to the VRAM 69, subjected to simple image processing and YC conversion processing by the image signal processing circuit 68, converted into a composite signal by the video encoder 70, and the color LCD panel 36 by the driver 71. Is displayed. Further, image data at the time of shooting is input to the buffer memory 73, and full-scale image processing and YC conversion processing are performed by the image signal processing circuit 68.

  The compression / decompression processing circuit 75 compresses the image data in the buffer memory 73 that has been subjected to the YC conversion process in a predetermined compression format (for example, JPEG format), and a still image with an extension “.jpg” or an extension “ .Mpg "is generated. This image file is read from the buffer memory 73 and recorded on the memory card 44 by the media controller 46. The compression / decompression processing circuit 75 decompresses the image file when the image file stored in the memory card 44 is reproduced and displayed on the display monitor 20 or an external connection monitor.

  Connected to the bus 65 are an AF detection circuit 77 that calculates the focus position of the photographing lens 51 from the contrast of the image data, and an AE / AWB detection circuit 78 that calculates the exposure value and the white balance value from the brightness of the image data. ing. Each of the detection circuits 77 and 78 inputs a detection result to the CPU 66 via the bus 65 when the shutter button 12 is half-pressed. The CPU 66 performs focusing, automatic exposure control, and automatic white balance adjustment based on the detection results input from the detection circuits 77 and 78.

  A CPU 80 that controls the camera 2 is connected to a ROM 80 in which a control program and control data for the camera 2 are recorded. AMP circuits 82 and 83 and A / D converters 84 and 85 are connected to the microphone 9 and the speaker 34, respectively, and are connected to the bus 65.

  FIG. 4 is a schematic diagram showing a file structure in the memory card 44. A plurality of captured image folders 90 and an inserted image folder 91 are formed on the route of the memory card 44. In each captured image folder 90, a still image file 92 and a moving image file 93 created by being captured by the camera 2 are stored.

  In the insertion image folder 91, a plurality of types of still image insertion files 94, moving image insertion files 95 and the like in which insertion data used in the edit shooting mode are filed are stored. The resolution of the still image insertion file 94 is coarsened according to the moving image file 93, and the reproduction time of the moving image insertion file 95 is shortened according to the insertion time.

  The user can add and delete the still image insertion file 94 and the moving image insertion file 95 to the insertion image folder 91 of the memory card 44. As a registration method to the inserted image folder 91, for example, the camera 2 and a personal computer are connected by a connection cable attached to the camera 2 and the inserted file published on the camera manufacturer's home page or the personal computer graphic is used. The inserted file created by the software is transferred to the inserted image folder 91.

  When the still image file 92 or the moving image file 93 photographed by the camera 2 is to be used as an insertion file, the still image file 92 or the moving image file 93 is once taken into a personal computer and matched with the resolution of the moving image file. After processing such as resizing or shortening the recording time, it is transferred to the inserted image folder 91. Furthermore, the still image shooting resolution of the camera 2 can be set to the moving image level, and a still image file shot in this state can be directly recorded in the inserted image folder 91.

  Further, the camera 2 itself is provided with a function of transferring an image file from the photographed image folder 90 to the inserted image folder 91 so that processing such as resizing the resolution or shortening the recording time of the moving image is automatically performed at the time of transfer. It can also be.

  Next, the operation of the edit shooting mode of the camera 2 of the above embodiment will be described with reference to the flowchart of FIG. When the mode operation member 17 of the camera 2 is set to the moving image shooting mode and the menu button 22 is pressed, the determination switch 39 is turned on and the operation signal is input to the CPU 66. The CPU 66 reads the menu image from the ROM 80 and displays it on the display monitor 20. The user operates the cross key 18 to move the selection frame on the display monitor 20 and sets the edit shooting mode.

  When the camera 2 is set in the edit shooting mode, as shown in FIG. 3, images 40 a to 40 f of plural types of insertion data are displayed on the display monitor 20. The user operates the cross key 18 to move the selection frame 41 and selects the insertion data to be used with the menu button 22.

  When the insertion data is selected, a moving image captured by the CCD solid-state image sensor 57 is displayed on the display monitor 20 as a through display. When the shutter button 12 is pressed, moving image shooting is started, and moving image data is recorded in the captured image folder 90 of the memory card 44. When the menu button 22 is pressed during this shooting, the CPU 66 reads the previously set insertion file from the insertion image folder 91 of the memory card 44 and stores this in the back of the moving image data in the middle of shooting of the memory card 44. To record. Note that an image of the insertion data is displayed on the display monitor 20 during this insertion period.

  The insertion data may be inserted for a certain period after the menu button 22 is operated, or the section AB in the flowchart of FIG. 5 is changed to the flowchart of FIG. 6 and the menu button 22 is operated. You can also do it only while you are. Thereafter, the user appropriately operates the menu button 22 in accordance with the scene development of the captured moving image. Further, when the shutter button 12 is operated again, the moving image shooting is finished.

  As shown in FIG. 4, a moving image file 93 is formed in the captured image folder 90a of the memory card 44 after the completion of shooting. This moving image file 93 includes moving image data as shown in the time code of FIG. No. 1-No. 3, the insertion data No. 1, No. 1 2 is inserted appropriately.

  When the moving image file 93 shot in the editing shooting mode is reproduced, the moving image data No. Scene 1 consisting of 1 is reproduced, and then inserted data No. Scene 2 in which 1 is recorded is reproduced. The image of the insertion data makes it easy to understand the content of the moving image and the scene change, and improves the entertainment. Further, since insertion data can be inserted during shooting, the effect of the insertion data can be obtained immediately without performing editing work after shooting.

  In the above embodiment, the insertion data is selected before the start of moving image shooting. However, the insertion data can be selected while shooting. For example, as shown in the flowcharts of FIGS. 8 and 9, when the shutter button 12 is operated in the edit shooting mode, a through image display unit 97 is displayed on the upper part of the display monitor 20, and the insertion data is displayed below the display data. An insertion data display section 98 on which the images 98a to 98d are displayed is arranged. A selection frame 99 operated by the cross key 18 is displayed on the insertion data display section 98, and the insertion data can be selected by operating the menu button 22 at a position where the selection frame 99 is stopped. .

  When moving image shooting is started by operating the shutter button 12, the moving image being shot is displayed on the through image display unit 97 at the top. The user operates the left and right buttons 28 and 29 of the cross key 18 to select insertion data, and operates the menu button 22. Then, the selected insertion data is recorded after the moving image data being shot. According to this, since the insertion image can be selected in accordance with the content of the scene being shot, it is possible to make the content of the moving image easier to understand and enhance entertainment.

  In each of the above embodiments, when the insertion operation is performed, shooting is stopped, and the data recorded on the memory card 44 is immediately switched to the insertion data. Therefore, even if a photo opportunity comes during insertion of insertion data, the insertion operation cannot be canceled. In view of such a problem, the camera 2 of the present invention can also cancel the insertion operation.

  For example, as shown in the flowchart of FIG. 10, moving image shooting is continued even during the insertion operation of the insertion data, and the moving image data is recorded in the shooting image folder 90 of the memory card 44. In addition, the elapsed shooting time is recorded so that the insertion period of the insertion data with respect to the captured moving image data can be identified.

  When shooting of the moving image is completed, an image similar to the image shown in FIG. That is, the first frame of the portion where the operation for inserting the captured moving image data is performed is displayed at the position of the through image display portion 97 in FIG. 8, and the position of the insertion data display portion 98 below the same is displayed at the same position. An image of the insertion data is displayed on the screen. When inserting the insertion data at the moving image data display position, the user selects the insertion data with the cross key 18 and operates the menu button 22. In addition, when the captured moving image data is recorded without operating the insertion data, the cancel button 21 is operated. As described above, since the insertion operation of the insertion data can be canceled after the photographing is completed, the photographed image can be obtained and the photo opportunity is not missed.

  When there are a plurality of insertion positions of inserted data in the captured moving image data, the first frame of the insertion positions is displayed on the display monitor 20 in order, and selection of data to be recorded at the insertion positions is sequentially performed.

  In addition, as shown in the flowchart of FIG. 11, the insertion data can be used as an index when a moving image file is reproduced. In this embodiment, the CPU 66 searches for insertion data in the moving image file prior to reproduction. As shown in the time code of FIG. 1, No. 1 2 is detected, as shown in FIG. 1 and the reduced image 101 of the first frame and the insertion data No. 1, No. 1 2 are displayed side by side on the display monitor 20 as scenes 1 to 3. A selection frame 104 that can be moved by the cross key 18 is displayed on the first reduced image 101.

  The user operates the selection frame 104 with the cross key 18 and stops the selection frame 104 on the reduced image of the scene to be reproduced. When the menu button 22 is operated, the CPU 66 acquires the elapsed time T at the beginning of the selected scene, and starts playing a moving image from the elapsed time T. As described above, since the insertion data can be used not only as a function as an eye-catching image at the time of moving image reproduction but also as an index, a desired scene can be reproduced immediately. When there is no insertion data in the moving image file to be reproduced, 0 is set as the elapsed time T. Thereby, playback is started immediately from the beginning of the moving image file.

Note that when the moving image file is reproduced by the display monitor 20 provided in the camera 2, the insertion data can be used as an index. However, the moving image file is reproduced by connecting the camera 2 to an external monitor. Sometimes the inserted data can be used as an index. In addition, although several types of methods have been described as the insertion data selection timing and playback method, these can be combined in the camera 2 in an appropriate combination.
Therefore, there is no need to perform useless scene selection.

  In the above embodiment, still image data or moving image data is used as insertion data. However, audio data such as music and sound effects can be used as insertion data. Still image data, moving image data, and audio data can be used as insertion data at the same time.

    Although the above embodiment has been described by taking a digital camera as an example, it can also be applied to various portable devices such as a video camera, a digital video camera, and a mobile phone having a camera function.

It is a perspective view which shows the external appearance shape of the digital still camera which implemented this invention. It is a block diagram which shows the structure of a digital still camera. It is explanatory drawing of the display monitor on which the image of insertion data was displayed. It is explanatory drawing which shows the hierarchical structure of a memory card. It is a flowchart which shows the procedure of the edit imaging | photography mode which selects insertion data first. FIG. 10 is a part of a flowchart of an edit shooting mode in which insertion time of insertion data is changed according to an operation time of a menu button. This is a time code of a moving image file shot in the edit shooting mode. It is explanatory drawing of the display monitor on which the image during imaging | photography and the image of insertion data were displayed. It is a flowchart which shows the procedure of the edit imaging | photography mode which selects insertion data first at the time of insertion. It is a flowchart which shows the procedure of the edit photography mode which enabled it to cancel insertion of insertion data. It is a flowchart which shows the procedure of the reproduction | regeneration mode which used insertion data as an index. It is explanatory drawing of the display monitor on which the scene which can be selected was displayed.

Explanation of symbols

2 Digital still camera 12 Shutter button 17 Mode operation member 18 Four-way controller 20 Display monitor 21 Cancel button 22 Menu button 44 Memory card 66 CPU
40a to 40f Inserted data image 90 Photographed image folder 91 Inserted image folder 92 Still image file 93 Moving image file 94 Still image inserted file 95 Movie inserted file

Claims (6)

An imaging optical system, a solid-state imaging device that captures a subject image formed on a light-receiving surface by the imaging optical system, an image processing unit that generates moving image data from an imaging signal output from the solid-state imaging device, and a moving image In an imaging apparatus having image data recording means for recording data, and display means for displaying a moving image being photographed and a captured moving image,
Insertion data recording means for recording insertion data to be inserted into the moving image data, registration means for preregistering insertion data in the insertion data recording means, and an insertion instruction operated when inserting insertion data into the moving image data An image pickup apparatus comprising: a switching unit that switches data recorded in the image data recording unit from moving image data to insertion data in accordance with an operation of an insertion instruction unit during shooting.   The switching means switches data recorded in the image data recording unit from moving image data to insertion data for a certain period from the start of operation of the insertion instruction means or during a period when the insertion instruction means is operated. The imaging apparatus according to claim 1.   The imaging apparatus according to claim 1, wherein the insertion data is one or both of still image data and moving image data.   Photographing is continued during the insertion period of the insertion data, and selection means is provided for selecting which of the moving image data and the insertion data during the insertion period is recorded in the moving image data after the photographing is completed. The imaging apparatus according to claim 1, wherein the imaging apparatus is characterized in that:   Insertion data display control means for displaying the insertion data read from the insertion data recording means on the display means, and insertion data selection means for selecting insertion data to be inserted into the moving image data from among the insertion data displayed on the display means The imaging apparatus according to claim 1, wherein the imaging apparatus is provided.   When reproducing and displaying the moving image data, search means for searching for insertion data in the moving image data, reproduction point display control means for displaying an image of the searched insertion data on the display means, and insertion on the display means 6. The image pickup apparatus according to claim 1, further comprising reproduction point selection means for selecting an image of data, and displaying moving image data after the selected insertion data on the display means.

Images