JP5118465B2 - Recording apparatus, reproducing apparatus, recording method, reproducing method, and program - Google Patents

Description

  The present invention relates to a recording apparatus, a reproducing apparatus, a recording method, a reproducing method, and a program.

  Imaging devices such as video cameras and camcorders capable of recording moving images generally perform predetermined image processing (development processing) on signals output from each pixel of an image sensor such as a CCD, and then MPEG-2, Motion JPEG, etc. The image data is recorded on a recording medium such as a flash memory, an HDD, or a DVD.

  Here, the image processing is, for example, white balance control, exposure control, and the like. In addition, when still image shooting is performed simultaneously with moving image shooting, processing for cutting out a part of the frame for moving image reproduction is performed on the frame for which still image shooting has been performed, and continuity is ensured with respect to resolution and the like in moving image reproduction. Also, in Japanese Patent Application Laid-Open No. 2004-151867, when shooting a moving image, the output from the image sensor is thinned out to generate and record moving image data. When a still image shooting instruction is given during moving image shooting, an image not subjected to the thinning process is compressed. A technique for encoding and recording moving image data and still image data in association with each other is disclosed. Further, in Patent Document 2, when a still image is shot during moving image shooting, the frame is thinned out from the moving image image data in parallel with the still image compression encoding, and before and after the thinned frame. A technique is disclosed in which interframe compression processing with image data is performed, and still image data is reinforced using moving image image data that has been subjected to the compression processing during reproduction.

Japanese Patent No. 3881168 JP 2006-41861 A

  Usually, after the image processing is performed, the compression processing is performed, so that the recording / reproduction quality of the image is lower than the data before the compression processing is performed. For this reason, some image capturing apparatuses such as digital cameras that record still images directly record signals output from the image sensor without performing compression processing in the RAW format. However, in an imaging device such as a camcorder that records moving images, the amount of processing becomes large when recording in the RAW format. Therefore, a reduced image is saved, and the reduced image is reproduced at the time of work such as development work or on the imaging device. It was often used at times.

  When a still image is recorded during movie shooting, reading from the image sensor is usually different from that for a still image and a movie. Therefore, as described above, a frame for movie playback is used for a frame for which still image shooting has been performed. Process to cut out a part of. This cut-out process differs depending on the type of the image sensor, which part of the still image matches the moving image, and also differs depending on the readout mode of the imaging device.

  Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is to enable smooth reproduction of moving images using RAW image data recorded as a still image at the time of moving image shooting. Another object of the present invention is to provide a new and improved recording apparatus, reproducing apparatus, recording method, reproducing method and program.

  In order to solve the above-described problems, according to an aspect of the present invention, RAW image data sequentially output from an image sensor in units of frames is processed into reproducible image data to generate processed image data in units of frames. An image processing unit for acquiring a shooting condition for each frame to acquire a shooting condition when a still image is shot when recording processed image data necessary for sequentially reproducing RAW image data for each frame A medium recording unit that sequentially records, on a frame-by-frame basis, frame-by-frame RAW image data, frame-by-frame processed image data, and shooting conditions of frames for which still image shooting has been performed. A characteristic recording device is provided.

  The shooting conditions may be resolution at the time of still image shooting, cut-out position data for cutting out a partial area in a frame of RAW image data, or positional relationship data with a moving image playback frame.

  In order to solve the above-described problem, according to another aspect of the present invention, RAW image data in units of frames, processed image data in units of frames in which RAW image data is processed into reproducible image data, At least one of each RAW image data, each image processing data, and each shooting condition from a recording medium in which shooting conditions when still image shooting is performed when recording processed image data are recorded sequentially for each frame A data reading unit for reading the image data, and image processing for processing the RAW image data when the still image shooting is performed as a moving image reproduction based on the read shooting conditions when sequentially reproducing the RAW image data for each frame And a playback device.

  The shooting conditions may be resolution at the time of still image shooting, cut-out position data for cutting out a partial area in a frame of RAW image data, or positional relationship data with a moving image playback frame.

  In order to solve the above-described problem, according to another aspect of the present invention, RAW image data sequentially output from the image sensor in units of frames is subjected to image processing to reproducible image data, and processed images in units of frames. A step of generating data, and a step of acquiring, for each frame, shooting conditions when still image shooting is performed when recording processed image data necessary for sequentially reproducing RAW image data for each frame. There is provided a recording method comprising the step of sequentially recording RAW image data in frame units, processed image data in frame units, and imaging conditions in frame units on a recording medium for each frame.

  In order to solve the above-described problem, according to another aspect of the present invention, RAW image data in units of frames, processed image data in units of frames in which RAW image data is processed into reproducible image data, At least one of each RAW image data, each image processing data, and each shooting condition from a recording medium in which shooting conditions when still image shooting is performed when recording processed image data are recorded sequentially for each frame And a step of performing image processing on the RAW image data when still image shooting is performed as a moving image reproduction based on the read shooting conditions when sequentially reproducing the RAW image data for each frame. A reproduction method characterized by the above is provided.

  In order to solve the above-described problem, according to another aspect of the present invention, RAW image data sequentially output from the image sensor in units of frames is subjected to image processing to reproducible image data, and processed images in units of frames. Means for generating data, means for acquiring, for each frame, shooting conditions when still image shooting is performed when recording processed image data necessary for sequentially reproducing RAW image data for each frame; A program is provided for causing a computer to execute means for sequentially recording RAW image data in units, processed image data in units of frames, and imaging conditions in units of frames on a recording medium for each frame.

  In order to solve the above-described problem, according to another aspect of the present invention, RAW image data in units of frames, processed image data in units of frames in which RAW image data is processed into reproducible image data, At least one of each RAW image data, each image processing data, and each shooting condition from a recording medium in which shooting conditions when still image shooting is performed when recording processed image data are recorded sequentially for each frame When the RAW image data is sequentially reproduced for each frame, the computer executes a means for performing image processing on the RAW image data when the still image shooting is performed as a moving image reproduction based on the read shooting conditions. A program is provided.

  According to the present invention, moving image reproduction can be performed smoothly using RAW image data recorded as a still image at the time of moving image shooting.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  First, a moving image recording apparatus 100 according to an embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram illustrating a configuration of a moving image recording apparatus 100 according to the present embodiment.

  As illustrated in FIG. 1, the moving image recording apparatus 100 includes a camera 102, a camera signal processing unit 104, a format processing unit 110, a development processing unit 120, a size processing unit 122, a JPEG encoder 124, a shooting condition control unit 130, and format processing. A unit 136, a file processing unit 140, a media recording unit 150, a microphone 160, an audio signal processing unit 162, and a format processing unit 164.

  The camera signal processing unit 104 receives moving image data for each frame output from an image pickup device (a sensor such as a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS)) of the camera 102. The camera signal processing unit 104 includes an AD converter that AD converts an input signal. The digital video signal output from the camera signal processing unit 104 is sent to both the format processing unit 110 and the development processing unit 120.

  The format processing unit 110 performs processing for rearranging the digitally converted R, G, and B signals in accordance with the pixel array (for example, Bayer array, three-plate CCD) of the image sensor. Also, the format processing unit 110 performs reversible compression processing on the moving image data within the frame. Image data can be recorded and reproduced without degrading image quality or the like by compression processing using a reversible compression method. A reversible compression method includes, for example, entropy coding using a Huffman code. The reversible compression method is not limited to strict “reversible”. As described above, in the formatting process by the format processing unit 110, the image quality as the RAW image data is maintained, so that the compression process that impairs the image quality is not performed. On the other hand, since RAW image data has a very large file size, it is processed into data with less redundancy. The moving image data formatted by the format processing unit 110 is input to the file processing unit 140 as RAW image data as it is.

  In the development processing unit 120, a series of development processing such as white balance processing, interpolation processing from a Bayer array, noise removal, luminance and color correction is performed on the input video data. Data that has undergone development processing in the development processing unit 120 is sent to the size processing unit 122.

  The size processing unit 122 performs processing for reducing or enlarging the size of moving image data. Further, the size processing unit 122 performs processing for changing from the resolution for moving images to the resolution for still images when still image shooting is performed during moving image shooting. The data output from the size processing unit 122 is sent to the JPEG encoder 124.

  In addition, the size processing unit 122 adds a moving image according to the screen size of a display device such as an EVF (Electronic View Finder) (not shown) or an LCD (Liquid Crystal Display) (not shown) as necessary. A process for reducing the size of the image data is performed. The data output from the size processing unit 122 is sent to the EVF and LCD and displayed on the screen. Thereby, the user can recognize the video image | photographed with the camera 102 in real time.

  The JPEG encoder 124 performs JPEG compression encoding processing on the input data, and sends compressed image data (processed image data) to the file processing unit 140.

  The shooting condition control unit 130 controls under which shooting conditions the moving image recording apparatus 100 performs shooting. For example, the shooting condition control unit 130 is switching between still image shooting and moving image shooting, and switching of resolution during moving image shooting. The shooting condition control unit 130 instructs the camera 102, the camera signal processing unit 104, the format processing unit 110, the development processing unit 120, the size processing unit 122, the JPEG encoder 124, and the format processing unit 164 to set shooting conditions. Each of these functional blocks sets shooting conditions according to an instruction.

  Then, the shooting condition control unit 130 sends the shooting condition data to the format processing unit 136. The format processing unit 136 formats the shooting condition data and sends the data to the file processing unit 140. The format processing unit 136 is an example of a shooting condition acquisition unit, and is a shooting condition when still image shooting is performed when processing processed image data necessary for sequentially reproducing RAW image data for each frame. The imaging conditions set by the control unit 130 are acquired for each frame. The shooting conditions include resolution at the time of still image shooting, cut-out position data for cutting out a partial area in a frame of RAW image data, or positional relationship data with a moving image playback frame.

  The file processing unit 140 temporarily stores the RAW image data sent from the format processing unit 110, the compressed image data compressed by the JPEG encoder 124, and the shooting condition data sent from the format processing unit 136. . The compressed image data, RAW image data, and shooting condition data stored in the file processing unit 140 are sent to the media recording unit 150 and recorded on the recording medium according to the recording format of the recording medium. Examples of the recording medium include an optical recording medium (CD, DVD, etc.), a magneto-optical disk, a magnetic disk, and a semiconductor storage medium.

  In addition, the microphone 160 acquires the sound of the subject simultaneously with the moving image shooting by the camera 102 and sends it to the sound signal processing unit 162. The audio signal processing unit 162 includes an AD converter that AD converts an analog audio signal. The digital audio signal output from the audio signal processing unit 162 is sent to the format processing unit 164. The format processing unit 164 formats the audio data by a compression process such as an uncompressed PCM system, or ADPCM system, AAC system, AC3 system, MP3 system, or the like. The audio data formatted by the format processing unit 164 is input to the file processing unit 140. The file processing unit 140 temporarily stores audio data.

  Although not shown, the moving image recording apparatus 100 is provided with a host CPU. The host CPU controls data transmission from the file processing unit 140 to the media recording unit 150 and recording of data on the recording medium by the media recording unit 150. The host CPU sends the compressed image data, RAW image data, audio data, and shooting condition data stored in the file processing unit 140 to the media recording unit 150 every predetermined amount (for example, every one frame data amount), The filing processing unit 140 and the media recording unit 150 are controlled so as to sequentially record on the recording medium. The host CPU records the compressed image data, RAW image data, audio data, and shooting condition data on a recording medium in a predetermined order.

  The series of processing in the moving image recording apparatus 100 may be performed by hardware or may be realized by software processing using a program on a computer.

  In the moving image recording apparatus 100 of the present embodiment configured as described above, video digital data output from the image sensor of the camera 102 and AD-converted is sent to the format processing unit 110 and recorded as RAW image data. Recorded on media. Accordingly, high-quality RAW image data is recorded on the recording medium, and by reading and displaying the RAW image data, it is possible to reproduce high-quality video compared to compressed video data.

  On the other hand, since RAW image data has a large amount of data, real-time screen display on EVF and LCD cannot be performed with RAW image data as it is, and compression processing such as JPEG cannot be directly performed. The moving image recording apparatus 100 according to the present embodiment performs the development processing, the reduction processing, and the compression processing of the moving image data together with the recording of the RAW image data, so that real-time display on the EVF and the LCD can be performed at the same time as shooting. Shooting can be performed while monitoring the display screen. In addition, since the compressed image data that has been compressed together with the RAW image data is recorded on the recording medium, it is possible to perform video search, thumbnail display, and the like using the compressed image data during playback. As a result, high-quality playback using RAW image data is possible for important parts in the video, and simple playback is possible by reading compressed image data at high speed for relatively low-importance parts in the video. It becomes.

  Further, the moving image recording apparatus 100 according to the present embodiment stores the RAW image data as it is, and the still image shooting is performed when recording the compressed image necessary for sequentially reproducing the RAW image data for each frame. Create a file with the shooting conditions. Since the shooting condition data is recorded together with the RAW image data on the recording medium, the shooting condition data can be read and developed when developing the RAW image data during reproduction. As a result, RAW image data recorded as a still image frame can also be subjected to image processing as a moving image playback frame.

  Next, a recording format in the recording medium will be described. FIG. 2 is a schematic diagram showing a format of recording on a recording medium by the moving image recording apparatus 100. For example, when the image sensor is a single plate with a Bayer array, the output data is output in the order of the pixels with the Bayer array of R: G: B = 1: 2: 1. Since the moving image recording apparatus 100 records the Bayer array data without losing image quality, the moving image recording apparatus 100 rearranges them in the order of RGB by the format processing unit 110 and records without performing compression processing that impairs image quality.

  FIG. 2A shows one moving image file from video recording start (recording start) to recording stop (recording stop). FIG. 2B shows data for one frame in the recording data of FIG.

  The Bayer array RGB data is rearranged by the format processing unit 110 and recorded in the data area of the recording medium. The compressed image data encoded by the JPEG encoder 124 and the audio data formatted by the format processing unit 164 are also recorded in the data area of the recording medium. As shown in FIG. 2A, a header is recorded at the head of the recording format. The header includes the entire date and time, information on the image sensor of the camera 102, set name of the moving image recording apparatus 100, the number of audio channels, the number of bits, recording format information of the recording medium, lens 102 specification data, etc. Information is recorded. Following the header, data is recorded for each frame of the video.

  The data for each frame is composed of a frame header (Frame Header 0, 1,..., N) and data for each frame (F0, F1,..., Fn). As shown in FIG. 2B, the data for each frame is repeatedly recorded in units of frames in the order of audio data (Audio), compressed image data (Compressed Image), and RAW image data (G, B, R). The Then, following the data of the last frame Fn, a footer is recorded.

  In the frame header of each frame, for example, the data size of each frame of audio data, compressed image data, and RAW image data is recorded. In addition, shooting condition data for each frame is recorded in the frame header of each frame.

  Next, with reference to FIG. 3, an example will be described in which RAW image data taken for a still image is cut out for moving image reproduction. FIG. 3 is a schematic diagram illustrating an imaging surface of the imaging device according to the present embodiment.

  In moving image shooting using the moving image recording apparatus 100, RAW image data is sequentially output from the image sensor in units of frames. When a still image is shot during moving image shooting, the still image frame is inserted between the moving image frames. For example, FIG. 3A shows sequentially output frames, where I0 to I4, I6, and I7 are moving image frames, and I5 is a still image frame. Also, the size of the still image frame is usually larger than the size of the moving image frame. Furthermore, the time taken for still image shooting is often longer than the time between one frame for moving image shooting, and the time between the still image frame and the moving image frame may be two or more frames for moving image shooting. .

  As described above, the still image frame and the moving image frame have different sizes, and as shown in FIG. 3B, the data reading position from the image sensor at the time of shooting is different. That is, in still image shooting, shooting is performed in an area wider than the area at the time of moving image shooting, and it is necessary to capture data of the image sensor in the area outside the area at the time of moving image shooting. Therefore, by recording the resolution at the time of still image shooting, the cut-out position data for cutting out a partial area in the frame of the RAW image data, the positional relationship data with the moving image playback frame, etc. as shooting conditions, Smooth playback of moving images can be performed when RAW image data is developed and played back.

  In the example shown in FIG. 3B, coordinates are taken with reference to the upper left corner of the frame during moving image shooting, and the coordinates of the upper left corner of the frame during still image shooting are, for example, (X, Y) using the pixel position. And this is recorded as a cutout position. In addition, the difference between a moving image frame and a still image frame may be recorded as a shooting condition. For example, data on a frame rate, a resolution, a size of a pixel area, and a positional relationship with a moving image playback frame may be recorded. May be recorded as

  Next, with reference to FIG. 4, a moving image reproducing apparatus 200 for reproducing moving image data recorded by the moving image recording apparatus 100 of FIG. 1 will be described. FIG. 4 is a block diagram showing the configuration of the moving image playback apparatus 200 according to an embodiment of the present invention. As shown in FIG. 4, the moving image playback apparatus 200 includes a host CPU 202, a media reading unit 210, a De-Multiplex 212, an image position information extraction unit 220, an audio signal processing unit 230, an audio output unit 232, a JPEG decoding unit 240, an area A cutout unit 250, a development processing unit 252, a size processing unit 254, a frame rate conversion unit 256, a MUX 260, and a video output unit 262 are included.

  The media reading unit 210 reads data from the recording medium according to a command from the host CPU 202. The De-Multiplex 212 temporarily stores the data read from the media reading unit 210 and sends the data to the audio signal processing unit 230, the JPEG decoding unit 240, and the region extraction unit 250, respectively.

  The image position information extraction unit 220 extracts shooting condition data recorded in the frame header and sends it to the host CPU 202.

  The host CPU 202 controls image processing in the development processing unit 252, the size processing unit 254, or the frame rate conversion unit 256 based on the shooting condition data sent from the image position information extraction unit 220. As a result, when shooting condition data is read from the recording medium, development processing, size processing, and frame rate conversion processing are performed according to the data, so even if still image shooting is performed during movie shooting, The image frame can be converted as a moving image reproduction frame, and smooth moving image reproduction can be performed even during moving image reproduction based on RAW image data.

  The audio signal processing unit 230 deformats the audio data, DA-converts the deformatted signal, and sends it to the audio output unit 232. The audio output unit 232 outputs the audio signal subjected to analog conversion to the outside.

  Also, the JPEG decoding unit 240 decodes the compressed image data, reduces or enlarges the decoded video data, and sends it to the MUX 260.

  Further, the area extraction unit 250 performs Bayer deformatting on the RAW image data, rearranges the raw image data into a Bayer array, and sends the data to the development processing unit 252. Further, the area cutout unit 250 calculates a cutout amount for moving image reproduction based on the shooting condition data sent from the image position information extraction unit 220 via the host CPU 202, and a part of the still image frame. Crop processing to cut out the area.

  The development processing unit 252 performs a series of development processing such as white balance processing, interpolation processing from the Bayer array, noise removal, luminance, and color correction on the deformatted RAW image data. The size processing unit 254 performs a process of reducing the size of the RAW image data that has been subjected to the development process. When the time taken for still image shooting is longer than the time between one frame for moving image shooting, the frame rate conversion unit 256 duplicates two or more frames in accordance with the frame rate for moving image shooting. Is sent to the MUX 260.

  The MUX 260 sends the video data sent from the JPEG decoding unit 240 or the size processing unit 254 to the video output unit 262. The video output unit 262 performs D / A conversion on the transmitted data and outputs analog signal data to the outside.

  Note that a series of processing in the moving image reproduction apparatus 200 may be performed by hardware or may be realized by software processing by a program on a computer.

  In the moving image playback apparatus 200 of the present embodiment configured as described above, development processing and size processing are performed using the shooting condition data recorded in each frame header in the file read from the media reading unit 210. Normally, the position of the still image frame coincides with the moving image frame differs depending on the difference in the image sensor and the reading mode of the moving image recording apparatus 100. Processing such as cutting a still image frame into a moving image frame based on the conditions can be performed, and smooth reproduction can be performed.

  When the RAW image data is reproduced, the RAW image data is converted into a video signal by reading out the RAW image data of G, B, and R from the recording medium and developing the data. This signal is reduced to a predetermined image size and is output to the video output unit 262 as a video. As a result, the moving image reproducing apparatus 200 can reproduce images with high image quality.

  When the compressed image data is reproduced, the compressed image data can be reproduced by sequentially reading the compressed image data in units of frames from the recording medium. In this case, the read data size is extremely small compared to the RAW image data. By reducing and enlarging the JPEG-decoded video signal to a predetermined image size and outputting it, reproduction can be performed with lighter processing compared to RAW image data reproduction. As described above, by utilizing the simple reproduction mode based on the compressed image data, the hardware configuration of the moving image reproduction apparatus 200 can be greatly reduced, and the power consumption can be greatly reduced.

  Further, even in the high-speed playback mode as the special playback mode, processing with less load can be performed by using JPEG data. In this case, while searching only the frame header according to the playback speed, only the necessary frames are scanned and scanned from the data size information of audio data, compressed image data, and RAW image data, and the compressed image data is read out. And read it out. Reproduction in the reverse direction can be easily realized by using a similar method.

  It is also possible to display a list of photographed images in the file as thumbnails using the compressed image data. In this case, for example, one frame image may be displayed as a thumbnail for each of a plurality of video files, or each video file may be displayed as a thumbnail as a video.

  As described above, according to the present embodiment, since both RAW image data and compressed image data can be recorded in association with each other, RAW image data is used for high-quality playback, real-time display, and image search. For example, compressed image data with a small data amount can be used. Thereby, it is possible to provide the moving image recording apparatus 100 and the moving image reproducing apparatus 200 with high image quality and excellent operability.

  The preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, but the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

It is a block diagram which shows the structure of the moving image recording device which concerns on one Embodiment of this invention. It is a schematic diagram which shows the format of recording on a recording medium by a moving image recording device. It is a schematic diagram which shows the imaging surface of the image pick-up element which concerns on the same embodiment. It is a block diagram which shows the structure of the moving image reproduction apparatus which concerns on the same embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Moving image recording device 102 Camera 104 Camera signal processing part 110, 136, 164 Format processing part 120 Development processing part 122 Size processing part 124 JPEG encoder 130 Imaging condition control part 140 File processing part 150 Media recording part 160 Microphone 162 Audio signal Processing unit 200 Moving image playback device 202 Host CPU
210 Media reader 212 De-Multiplex
220 Image position information extraction unit 230 Audio signal processing unit 232 Audio output unit 240 JPEG decoding unit 250 Area extraction unit 252 Development processing unit 254 Size processing unit 256 Frame rate conversion unit 260 MUX
262 Video output section

Claims (8)

An image processing unit that processes the raw image data sequentially output from the image sensor in units of frames into reproducible image data to generate processed image data in units of frames;
A shooting condition acquisition unit that acquires, for each frame, shooting conditions when still image shooting is performed when recording the processed image data, which is necessary for sequentially reproducing the RAW image data for each frame;
A RAW image data in units of frames, the processed image data in units of frames, and a medium recording unit that sequentially records the imaging conditions of the frames on which the still image was captured, on a recording medium ;
The recording apparatus according to claim 1, wherein the photographing condition includes difference information of the RAW image data with respect to the processed image data in a data reading area from the image sensor . The photographing conditions, the resolution of the still image shooting, the feature that you further comprising a positional relationship data between the cut-out position data or moving image reproduction frame for cutting out a partial area of the frame of the RAW image data The recording apparatus according to claim 1. RAW image data in frame units, processed image data in frame units in which the RAW image data is reproducible image data, and when still image shooting is performed when the processed image data is recorded A data reading unit that reads out at least one of each of the RAW image data, each image processing data, and each of the imaging conditions from a recording medium in which the imaging conditions are sequentially recorded for each frame;
An image processing unit that performs image processing on the RAW image data when the still image shooting is performed based on the read shooting conditions as a moving image playback when sequentially reproducing the RAW image data for each frame. ,
The reproduction apparatus according to claim 1, wherein the photographing condition includes difference information of the RAW image data with respect to the processed image data in a data reading area from the image sensor . The photographing conditions, the resolution of the still image shooting, the feature that you further comprising a positional relationship data between the cut-out position data or moving image reproduction frame for cutting out a partial area of the frame of the RAW image data The playback apparatus according to claim 3. Processing the raw image data sequentially output from the image sensor in frame units into reproducible image data to generate processed image data in frame units;
Obtaining, for each frame, shooting conditions required when still image shooting is performed when recording the processed image data, which is necessary for sequentially reproducing the RAW image data for each frame;
Recording the RAW image data in units of frames, the processed image data in units of frames, and the imaging conditions of the frames on which the still image was captured, sequentially on a recording medium for each frame ,
The recording method according to claim 1, wherein the photographing condition includes difference information of the RAW image data with respect to the processed image data in a data reading area from the image sensor . RAW image data in frame units, processed image data in frame units in which the RAW image data is reproducible image data, and when still image shooting is performed when the processed image data is recorded Reading at least one of each of the RAW image data, each image processing data, and each of the imaging conditions from a recording medium in which the imaging conditions are sequentially recorded for each frame;
When the RAW image data is sequentially reproduced for each frame, the RAW image data when the still image shooting is performed based on the read shooting conditions is subjected to image processing as a moving image reproduction , and
The reproduction method according to claim 1, wherein the photographing condition includes difference information of the RAW image data with respect to the processed image data in a data reading area from the image sensor . Means for processing the raw image data sequentially output from the image sensor in frame units into reproducible image data to generate processed image data in frame units;
Means for acquiring, for each frame, a shooting condition required for still image shooting when recording the processed image data, which is necessary for sequentially reproducing the RAW image data for each frame;
In order to cause a computer to execute means for sequentially recording the RAW image data in frame units, the processed image data in frame units, and the shooting conditions of the frames on which the still image was shot on a recording medium for each frame. The program of
The program according to claim 1, wherein the photographing condition includes difference information of the RAW image data with respect to the processed image data in a data reading area from the image sensor . RAW image data in frame units, processed image data in frame units in which the RAW image data is reproducible image data, and when still image shooting is performed when the processed image data is recorded Means for reading at least one of the RAW image data, the image processing data, and the imaging conditions from a recording medium in which the imaging conditions are sequentially recorded for each frame;
When the RAW image data is sequentially reproduced for each frame, the computer executes means for processing the RAW image data as moving image reproduction when the still image shooting is performed based on the read shooting conditions. A program for
The program according to claim 1, wherein the photographing condition includes difference information of the RAW image data with respect to the processed image data in a data reading area from the image sensor .

Images