KR101824506B1 - Apparatus and method for processing a continuous shooting using a multi-preset data in camera device - Google Patents

Abstract

A method of presetting a camera device, the method comprising: acquiring an image by changing a setting value of a camera using multi-preset information composed of different preset information at the time of taking a preset image; Generating and buffering the preset image, postviewing the generated image at the end of the preset shooting, and storing the compressed image of the selected frame in the posture view process.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a multi-

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and method for photographing a camera device, and more particularly, to an apparatus and method for setting multi-preset data to acquire different multi-images.

A portable terminal device including a camera device and a camera provides a high-quality image and also provides various user-friendly functions. Currently, an image sensor (also referred to as an image sensor or a camera sensor) of a camera device can sense images having a full High Definition resolution.

Generally, in the case of a camera, most of the menus must be set manually by the user, and it takes a lot of time to set them. And when the camera is set wrong when you take a picture, you get a picture you did not want. In this case, when the camera information is set again, the same situation can not be photographed again. Conventionally, in order to overcome such disadvantages, there is a menu (scene mode, flash mode, shot mode, focus mode, exposure value, effect, white balance, ISO, metering, auto contrast etc.) Value is set to provide convenience to the user. However, the values set in the auto menu are only average values of actual values.

Accordingly, the present invention proposes an apparatus and method for setting multi-preset data in a camera in a terminal device including a camera device or a camera to obtain a multi-frame image according to different set values.

To this end, a terminal device including a camera device or a camera according to an embodiment of the present invention sets multi-preset information composed of different preset information in a camera, obtains a multi-frame image corresponding to each of the preset images can do. In addition, the present invention proposes an apparatus and method for analyzing a preview image during preset photographing, automatically setting multi-preset information, and obtaining a multi-frame image generated by the multi preset information set at the time of photographing.

A preset photographing method of a camera apparatus according to an embodiment of the present invention includes the steps of acquiring an image by changing a setting value of a camera using multi preset information composed of different preset information at the time of preset photographing, A step of post-viewing the generated image at the end of the preset photographing, and a step of storing a compressed image of a selected frame in the posture view process. .

In addition, the camera device according to the embodiment of the present invention changes the setting value of the camera using the camera and the multi-preset information composed of different preset information at the time of taking a preset, An application processing unit for buffering the display image and the compressed image, post-viewing the generated image at the end of the preset shooting, and storing a compressed image of the selected frame; A storage unit for storing images, and a display unit for displaying the display image.

The portable terminal device according to the embodiment of the present invention may further include a communication unit for performing wireless communication with an external device, a terminal control unit for controlling communication and communication of the portable terminal device through the communication unit, A camera unit for acquiring an image while changing a value of a preset image, and a multi-preset information including different preset information at the time of a preset photographing, An application processing unit for buffering the display image and the compressed image, post-viewing the created image at the end of the preset shooting, and storing a compressed image of the selected frame; And a display unit for displaying the display image The generated features.

The terminal device including the camera device or the camera according to the embodiment of the present invention can set the multi preset information according to the situation using the subject information and the camera menu information frequently taken by the user, An image can be obtained, and there is an advantage that a user can take a desired photograph in a photographing situation. In addition, the captured images can be stored based on the experience of using the user's camera, and there is an advantage that the user can easily check the similarity in the captured images in the continuous shooting mode and display them to the user in the album or postview.

1 is a view showing a configuration of a camera device according to an embodiment of the present invention;
2 is a diagram showing the configuration of the camera unit 110 according to the embodiment of the present invention
3 is a diagram showing the configuration of an image processing unit and an application processing unit according to an embodiment of the present invention
4 is a view showing a YUV image, a JPEG image, and photographing information constituting a frame according to an embodiment of the present invention
5 is a view showing an example of multi-preset information according to an embodiment of the present invention
6 is a diagram showing an example of a multi-frame image obtained by setting multi-preset information according to an embodiment of the present invention
7 is a view for explaining an operation at the time of continuous shooting in a terminal device including a camera device or a camera device according to an embodiment of the present invention;
8 is a flowchart illustrating a procedure for setting multi-preset information according to an embodiment of the present invention.
9 is a flowchart showing a procedure for performing a preset photographing in accordance with an embodiment of the present invention
10 is a flow chart illustrating a procedure for performing post view and image storage in accordance with an embodiment of the present invention.
11 is a diagram showing the configuration of a camera device having a single configuration of image and application processing in the embodiment of the present invention
Fig. 12 is a diagram showing the configuration of the processing unit in the configuration of Fig. 11
13 is a diagram showing a configuration of a portable terminal apparatus having a camera apparatus according to an embodiment of the present invention

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that the same configurations of the drawings denote the same reference numerals as possible whenever possible.

In the following description, the number of pixels of the image, the preset data, the items of the photographing information, the data size, and the like and specific matters are shown to provide a more general understanding of the present invention. It will be apparent to those skilled in the art that the present invention may be embodied in other forms without departing from the spirit and scope of the invention. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The present invention relates to a terminal device having a camera device or a camera, which processes images obtained from a camera sensor in accordance with multi-preset information set in a preset shooting mode to generate a plurality of images, and the camera sensor and / And generates and buffers the information obtained by the sensors of the imaging device as shooting information. Wherein the plurality of images may be a display image for a preview (and post view) and a compressed image for storage. In addition, the photographing information may be information obtained from the respective sensors of the camera sensor and / or the device (hereinafter, the photographing information may be used in combination with meta data, embedded data, etc.) .

When the shutter is turned on in the preset shooting mode, the multi-preset information is sequentially changed while shooting, and images obtained in the order of shooting are stored. When the continuous shooting is finished, the display image used at the preview is displayed for the postview so that the multi preset images can be quickly displayed without performing the decode operation after the end of the capture.

In the embodiment of the present invention, when setting multi-preset information, the multi-preset information can be automatically set by analyzing an image to be photographed by performing a preview mode and searching for preset information according to the result. In order to secure the performance in the preset shooting mode, the captured display and compressed images are temporarily stored in the RAM disk, and the user can move to the file system available in the background in the background at the end of the preset shooting. At the same time as the photographing is finished, the main JPEG files are stored in the file system of the user-usable path in the background while showing the postview of the photographs taken by the user.

In the following description, the preset information is the setting values of the camera unit 110 for generating an image of one frame. The setting values include a plurality of setting parameters (for example, AWB, exposure, shutter speed, ISO, , contrast, sharpness, AF, etc.). The multi-preset information is composed of a plurality of preset information for capturing an image of a multi-frame, and each preset information is set such that at least one setting parameter is different among the setting parameters. Therefore, the multi preset information is composed of a plurality of different preset information, and each preset information is set to have different camera setting values.

Hereinafter, the present invention will be described in detail with reference to the drawings. In the following description, the camera device will be described as an example.

1 is a diagram showing a configuration of a camera apparatus according to an embodiment of the present invention.

Referring to FIG. 1, the camera unit 110 includes an image sensor, and acquires an image through an image sensor when the camera is driven. Here, the image sensor can detect an image of ultra high definition (UHD) or higher. The sensor unit 120 may be one or more sensors mounted on the camera device, and the sensor may be at least one of a GPS receiver, a gyro sensor, an acceleration sensor, an altitude sensor, and a direction sensor. Here, the sensor unit 120 may be connected to the image processing unit 130, which will be described below, or may be connected to the application processing unit 140. In the embodiment of the present invention, it is assumed that the sensor unit 120 is connected to the application processing unit 140 to detect the operation, state, and position of the terminal device including the camera device or the camera device.

The image processing unit 130 may set the setting information of the camera unit 110. In the embodiment of the present invention, the image processing unit 130 sets multi-preset information, sequentially changes settings of the camera unit 110 in the multi-preset information set at the time of the preset photography, sequentially receives the images obtained according to the changed settings . At this time, the image processing unit 130 processes the image obtained from the camera unit 110 and generates a display image for display on the display unit 160 and a compressed image for storing upon capture request. Wherein the display image may be a YUV image. The image processing unit 130 performs color conversion of the image obtained by the camera unit 110 into a YUV image and scaling and / or crops the image to be displayed on the display unit 160. That is, the image processing unit 130 may generate the YUV image and may appropriately set the YUV image according to the display capability of the display unit 160. The YUV image may have a data size smaller than the size of the compressed image. The image processing unit 130 generates a compressed image for storing an image output from the camera unit 110. Here, the compressed image can use the JPEG method. That is, the compressed image may be an image for storing a user at the time of capture request, and may be an image obtained by compressing an image of a super-high resolution or higher.

Also, the image processing unit 130 acquires the photographing information at the time of acquiring the image from the camera unit 110 (or the output of the sensor unit 120 when the sensor unit 120 is connected). At this time, the photographing information can additionally acquire various information besides exif information that can be acquired at the time of photographing the image by the camera unit 110.

The image processing unit 130 may generate the display image and the compressed image at every frame period, and may also generate the display image, the compressed image, and the shooting information. The image processor 130 may generate a display image, a compressed image, and shooting information of a frame rate of 30 frames per second or more (for example, 60 frames per second) per second.

The image processing unit 130 performs a preset setting and a preset photographing mode under the control of the application processing unit 140. In this case, the image processing unit 130 receives the multi preset information from the application processing unit 140. In the preset shooting mode, the image processing unit 130 sequentially transmits the multi preset information to the camera unit 110 to change the setting of the camera unit 110, And sequentially processes the acquired images. At this time, in the preset shooting mode, the image processing unit 130 acquires an image of one frame for one preset information. Accordingly, the image processor 130 can acquire frame images corresponding to the number of preset information. In the embodiment of the present invention, the image processor 130 may acquire a frame image of 30 fps in the preview mode. In the case of the preset photographing mode, since the preset information of the camera setting information must be changed, the frame rate in the preset photographing mode may be 10 fps (the time for obtaining one frame image is 330 ms).

The application processing unit 140 performs a function of setting multi-preset information in the preset shooting mode. The multi preset information can be set manually or automatically. At this time, in the automatic setting mode, the application processing unit 140 operates the preview processing mode through the image processing unit 130, analyzes the image received through the image processing unit 130 to determine whether the image is a portrait or a landscape, database (DB), the preset information having high frequency of use may be configured as a multi-preset, and then transmitted to the image processing unit 130.

The application processing unit 140 buffers a display image, a compressed image, a display image, a compressed image, and shooting information generated by the image processing unit 130 when the camera is driven, and controls the display unit 160 to display the display image on the display unit 160. When the sensor unit 120 is connected, the application processing unit 140 merges the output of the sensor unit 120 with the shooting information transmitted from the image processing unit 130 to buffer the shooting information.

When a user's preset shooting request command is generated, the application processing unit 140 stores the buffered display image, compressed image, and shooting information in the storage unit 150, displays the stored display images on the display unit 160 at the end of the preset shooting, The compressed images are stored as they are, or finally the compressed images to be selected are stored.

The input unit 170 may generate a camera driving command and a preset photographing command to the application processing unit 140. The display unit 160 displays a display image output from the application processing unit 140 in a preview mode. In addition, the display unit 160 may display the display image as a preview image in the preset shooting mode, display images of the preset shot stored under control of the application processing unit 140 at the end of the preset shooting as a postview image, Thumbnail images of preset photographed images can be displayed. The input unit 170 may be a touch panel that senses a user's touch input, and the display unit 160 may be an LCD or an OLED panel that displays data and images generated during program execution. The input unit 170 and the display unit 160 may be integrated touch screens. The input unit 170 may include buttons located outside the camera device.

The storage unit 150 may include a DB for storing preset information used for preset photographing. The DB may be a person DB or a landscape DB. The person DB may include a person (family, lover, friend, etc.), a type (smile shot, , effect, white balance, exposure, metering, zooming, flash, etc.), or a combination thereof. Also, the landscape DB can be structured similar to the person DB. The storage unit 150 temporarily stores the display image, the compressed image, and the shooting information being buffered in the application processing unit 140 when the preset shooting is requested. The storage unit 150 stores the compressed images captured by the multi preset at the end of the preset shooting or the user and / And stores the selected compressed images. At this time, if the application processor 140 can buffer all the preset photographed multiframe images, the operation of temporarily storing the multiframe images in the storage unit 150 may be omitted.

2 is a diagram showing a configuration of a camera unit 110 according to an embodiment of the present invention.

Referring to FIG. 2, when a camera drive command is generated, the camera 110 is supplied with operation power. Further, the image processor 130 drives the motor 240, and the actuator 250 controls driving (zooming, focusing, etc.) of the optical unit 210 by driving the motor 240. The optical unit 210 picks up an image of a surrounding area, and the image sensor 220 senses an image picked up by the optical unit 220 and converts the sensed image into an electrical signal. Here, the image sensor 220 may be an image sensor having a resolution of full HD or higher. In the embodiment of the present invention, it is assumed that the image sensor 220 has an ultrahigh-resolution (UHD) image quality. The output of the image sensor 220 is converted into a digital image through the A / D conversion unit 230 and then transmitted to the image processing unit 130. The flash 260 may be driven by the image processor 130.

FIG. 3 is a diagram illustrating the configuration of an image processing unit 130 and an application processing unit 140 according to an embodiment of the present invention.

Referring to FIG. 3, the image processor 130 processes images output from the camera unit 110, controls the operation of the camera unit 110, and acquires shooting information of the camera unit 110. When the sensor unit 120 is connected to the image processing unit 130, the image processing unit 130 can generate information obtained from the camera unit 110 and the sensor unit 120 as image sensing information when the camera is driven. The application processing unit 140 controls the operation of the image processing unit 130 and processes the data (display and compressed image and photographing information) output from the image processing unit 130.

The application processing unit 140 may take other applications than the application of the image processing unit 130 (i.e., a camera-related application). Such an application may be an application of the sensor unit 120. [ As an example of such applications, the sensor unit 120 may include a GPS, and receives the GPS signal and displays the position of the device (which may be a terminal device including a camera device or a camera device) can do. In addition, the sensor unit 120 may include a motion sensor to display the state of the apparatus. For example, the motion sensor senses movement of the device in the up, down, left, and right directions, and the gyro sensor can sense movement of the axis (X, Y, Z axis). Therefore, an application for detecting the output of the motion sensor and expressing the state of the device can be processed. In this case, the sensor unit 120 may be connected to the application processing unit 140. As described above, it is assumed that the sensor unit 120 is connected to the application processing unit 140 in the embodiment of the present invention.

The image processing control unit 210 of the image processing unit 130 receives the multi preset information in the application processing unit 140 and sequentially changes the setting information of the camera unit 110 at predetermined time intervals according to the multi preset information in the preset shooting mode, And controls to acquire an image according to the preset information. Here, it is assumed that the camera 110 changes the setting in accordance with the preset data to 330 ms. In this case, the camera unit 110 changes its setting at a predetermined time interval, and acquires an image according to the changed setting, and transmits the image to the image processing unit 130. [ Accordingly, the camera unit 110 obtains multi-frame images corresponding to the number of multi-preset information under the control of the image processing unit 130, and the multi-frame images obtained at this time are images taken at different setting values.

The video processor 320 of the image processor 130 converts the image output from the camera 110 into a YUV image. The image output from the camera unit 110 is a raw image and has a number of pixels equal to or larger than the full HD level detected by the image sensor 220. The video processing unit 320 performs the color interpolation, ), And so on. Here, the 3A may be an auto white balance (AWB), an auto exposure (AE), or an auto focusing (AF), and the color conversion may be a function of converting a raw image into YUV data. Here, the video pre-processing unit 320 may perform all of the functions described above, and may perform only some functions. In addition, the image processing unit 130 includes a still image compression unit (still image encoding device) 340 for storing a still image at the time of capture, and the still image compression unit can use various still image encoding methods such as JPEG and TIFF have. In the embodiment of the present invention, it is assumed that the still image compressing unit 340 is a JPEG coder 340. The JPEG coder 340 compresses the image output from the video processor 320 into a JPEG image. The scaler 340 scales an image output from the video processor 320 with an image of a proper size to be displayed on the display unit 160. The scaler 340 may include a configuration for scaling, cropping, and / or resizing the image data, or some of these configurations. If the video processor 320 does not perform the color conversion function, the scaler 340 may be configured as a display image generator. In this case, the display image generator may include a color converter and a scaler for converting a raw image into a YUV image It is possible.

The image processing control unit 310 controls the operation of the camera unit 110 under the control of the application control unit 360 and controls the overall operation of the image processing unit 130 in the camera driving mode. In particular, in the embodiment of the present invention, as described above, the image processing control unit 310 controls the camera to generate multi-frame images having setting values mutually according to the multi-preset information in the preset shooting mode. In addition, the image processing control unit 310 may acquire information related to the setting information of the camera unit 110 and the operation of the camera unit 110 at the time of image acquisition at the time of driving the camera unit 110, and may generate shooting information. The compressed image, the display image, and the photographing information are generated in each frame, and the frame may be composed of 30 frames or more frames per second (for example, 60 frames). The multiplexing unit 350 multiplexes the compressed image, the display image, and the photographing information under the control of the image processing control unit 310, and transmits the multiplexed image to the application processing unit 140.

3, the image processing unit 130 may further include a thumbnail image generating unit for converting the display image into a thumbnail image. In this case, the image processing unit 100 generates a thumbnail image from the display image, and the JPEG coder 340 compresses an output image of the video processing unit 310 and generates an output composed of a header, the thumbnail image, and a compressed JPEG image .

Referring to the configuration of the application processing unit 140, the application processing control unit 360 controls the operation of the image processing unit 130 according to an instruction from the input unit 170, and displays the image output from the image processing unit 130 through the buffering and display unit 160. The application processing control unit 360 transmits the multi preset information set in the preset shooting mode to the image processing unit 130 and stores the received multi-frame images in the order of shooting. Further, the application processing control unit 360 drives the image processing unit 130 in the preview mode when the preset information is automatically set, analyzes the received image to determine whether it is a portrait or a landscape photograph, and then searches the DB of the storage unit 150, The multi-preset information is set.

The demultiplexing unit 355 demultiplexes the display image, the compressed image, and / or the photographing information transmitted from the image processing unit 130 under the control of the application processing controller 360. The parser 370 parses the demultiplexed image and information in the demultiplexer 355 into a display image, a compressed image, and photographing information. Here, when the application processing controller 360 controls the demultiplexer 355 to perform software-parsing of an output image, a compressed image, and / or photographing information in the image processor 130, the parser 370 may be omitted.

The buffer 380 may include a display image buffer 383, a compressed image buffer 385, and / or an imaging information buffer 387. The buffer 380 buffers the display image, the compressed image, and / or the photographing information, which are each parsed under the control of the application processing controller 360. At this time, the application processing controller 360 of the application processing unit 140 outputs the output of the sensor unit 120 (and / or additional information received from a communication unit (not shown), for example, weather information received via the Internet or the like) And outputs the sensor output (when acquiring the corresponding frame image (i. E., When acquiring the corresponding frame image) from the sensor unit 120 when buffering the photographing information of the image processing unit 130 to be parsed The application processing unit 140 merges the output power of the sensor unit 120 (which may be the second shooting information) of the image processing unit 130 The second shooting information generated by the application processing unit 140 is merged and buffered in the shooting information buffer 387.

As described above, in the embodiment of the present invention, the image processing unit 130 and / or the application processing unit 140 that receives the image of each frame generated from the camera unit 110 generates a display YUV image and a compressed image for capture, Generate shooting information of the image (composed of image data + embedded data). Here, the embedded data may include data as shown in Table 1 below.

Meta data size Remarks Flash 4byte Flash pool light flag can be checked, used for flash operation ISO 4byte Save ISO information EV 4byte Save Exposure Value Data type 4byte Save data type of JPEG, YUV, META data Data size 4byte Used to store the variable size of the JPEG size, and to store the JPEG image in the buffer. Face detection 4byte Save FACE detection function on / off Face num 4byte Save face recognized count FD start x 4byte Save the starting x value of the face recognized rectangular coordinates. FD [0] .sx, and FD [1] .sx. FD start y 4byte Save the starting y value of the face recognized rectangular coordinates. FD [0] .sy, FD [1] .sy. FD end x 4byte Save x value in lower right corner of face recognized rectangular coordinates. FD [0] .ex, FD [1] .ex. FD end y 4byte Save the y value in the lower right corner of the face recognized rectangular coordinates. FD [0] .ey, FD [1] .ey Effect 4byte Save set value White balance 4byte Save set WB value Scene mode 4byte Save the set scene mode value Metering 4byte Save the set metering mode value I-frame 4byte Save iframe information value when using MPEG P-frame 4byte Save pframe information value when using MPEG Sharpness 4byte Save set sharpness value Saturation 4byte Save the set saturation value Contrast 4byte Save the set contrast value Frame count 4byte Save count value of current incoming frame HDR 4byte Save HDR operation status Zoom 4byte Save set zoom scale AF 4byte Save AF status CAF x 4byte Save x coordinate value in CAF operation CAF y 4byte Saving y coordinate value during CAF operation Gyro data 4byte Save Gyro data value and use it to judge shaking. Anti-shake 4byte Camera shake prevention function Quality 4byte Save set Jpeg quality value Storage 4byte Store media data storage location Shooting date and time 4byte Save current time information About GPS 4byte Save GPS status Location information 4byte Save current position data value Altitude information 4byte Save current altitude information Camera angle information 4byte Save current camera angle information Acceleration sensor 4byte Accelerometer Sender Dayer value stored, used to determine the shake

Using the above-described meta data, the user can set various functions to take a photograph. Using the subject information and the camera menu information frequently taken by the user, it is possible to find a setting value suitable for the situation. In this case, if a human face is detected during preview, the menus automatically set a menu that is frequently used in the portrait DB or has good results when used. For example, the general public can take a lot of portraits of their family members, friends, relatives, family members, entertainers, etc. If the user finds appropriate information at the time of photographing the person in the person DB, the user can set menus that can be helpful in shooting. (For example, smile shot, beauty shot, portrait scene mode, AF mode, object tracking, ISO, effect, white balance, exposure, metering, zooming, flash, (E.g., outdoor visible, flash, ISO, effect, white balance, exposure, metering, landscape scene mode, fan focus mode, etc.) (For example, in the case of a lover photo, it may be stored as a lover album at the same time as shooting, or reflected in a designated SNS or cloud system). . In addition, it is possible to determine the portion of the similarity of the photographed image in the continuous shooting so that it can be easily confirmed when the album or the postview is displayed to the user.

The buffer 380 of the application processing unit 140 has a size capable of buffering a display image, a compressed image, and / or photographing information of N frames, and the structure of the buffer 380 may have a ring buffer structure. The reason why the buffer 380 is configured as a ring buffer structure is to maintain the image and information of the received frame at the set frame number. In addition, the application processing unit 140 may include a moving picture compressing unit (moving picture encoder) 390 for compressing moving picture data in response to a moving picture storing request, and the moving picture compressing unit 390 may be composed of various moving pictures such as H.264 and MPEG . In the embodiment of the present invention, it is assumed that the moving picture compression unit is the MPEG coder 390. When the user requests a moving image storage, the application processing controller 360 drives the MPEG coder 390. The MPEG coder 390 compresses the display image buffered in the display image buffer 380 of the buffer 380 and stores the compressed image in the storage unit 150 do. The application processing unit 140 further includes a thumbnail image generating unit 395 for generating a thumbnail image by resizing the display image. The thumbnail image generating unit 395 may generate a thumbnail image by resizing the display image output from the display image buffer 383. The thumbnail image may be included in the JPEG image and under the control of the application controller 360, 160 < / RTI >

Here, the application processing controller 360 stores the display image, the compressed image, and the shooting information buffered in the buffer 380 in the preset shooting mode. When the end of the preset photographing is requested, the application processing controller 360 displays the display image used in the preview as a postview image. Thus, the camera device can quickly display the images photographed by the user to the user, have.

In FIG. 3, a configuration for compressing a still image and a moving image included in the image processing unit 130 and the application processing unit 140 is shown as a coder. However, in general, a configuration for compressing and decompressing an image is composed of one chip (Coder & DECcoder: CODEC). Therefore, the still image coder 340 (for example, a JPEG coder) of the image processing unit 130 may be configured as a still image codec (JPEG codec), and the moving image coder 390 (for example, the MPEG coder 390) Codec (MPEG codec). Also, in the embodiment of the present invention, an operation of displaying and compressing an image photographed from the camera unit 110 will be described. Further, it may be necessary to decompress and display a still image (e.g., a JPEG image) stored in the storage unit 150. [ Although not shown in the figure, the application processing unit 140 may further include a still image decoder (or a still image codec). In this case, when the user requests reproduction of the compressed image stored in the storage unit 150 through the input unit 170, the application processing unit 140 decodes (decompresses) the compressed image through a still image decoder (still image codec) , And display the decoded image on the display unit 160. In the configuration of FIG. 3, the image processing unit 130 receives an image output from the camera unit 110, and displays the preview image A display image for capturing and a compressed image for capturing, and can also generate a display image, a compressed image, and shooting information. When the user generates a camera driving command through the input unit 170, the application processing controller 360 notifies the image processing unit 130 of the operation of the camera apparatus, and the image processing controller 310 drives the camera unit 110 do. The image output from the camera unit 110 is input to the video pre-processing unit 320. At this time, when the preset shooting mode is selected, the application processing controller 360 sets multi preset information for the preset shooting. At this time, the multi-preset information can be set automatically or manually. That is, in the preset shooting mode, the application processing controller 360 uses the subject information and the camera menu information frequently photographed by the user, Search. For example, when the preset shooting mode is selected, the user finds a setting value suitable for the situation by using frequently photographed subject information and camera menu information.

In this case, the application processing unit 140 commands the execution of the Preview mode through the image processing unit 130 and analyzes the received image to check whether a human face is detected (using the face detect function). At this time, if a person is detected in the received image, the application processing unit 140 may check the menus that are often used at the time of photographing the person in the person DB of the storage unit 150 or have good results at the time of use, Selects the set information and automatically sets the multi preset information. For example, the general public photographs a lot of person's photos of family members, relatives, lovers, family members, entertainers, and the like. If there is no suitable information at the time of photographing the person in the person DB of the storage unit 150, (For example, smile shot, beauty shot, portrait scene mode, AF mode, object tracking, ISO, effect, white balance, exposure, metering, zooming, flash, When the automatic information setting function is on, these functions can be executed immediately in the background and can be executed immediately. (Detect a person -> search in the person DB -> load the optimal preset data which was used when the person is in the DB, -> start shooting or detect a person -> search in the person DB -> If it does not exist in the person DB, search for the best available preset data in the web or the device and load it -> Start shooting)

If the user information can not be found in the preview information, the application processing unit 140 confirms the portion of the landscape photographing to be suitable for the landscape photograph. (Ex outdoor visible, flash, ISO, effect, white In this case, the application processing unit 140 detects landscapes similar to human face detect, and if the user has preset preset data at the time of landscape photographing, the corresponding preset data (e.g., balance, exposure, metering, landscape mode, fan focus mode, If not, search and load the preset data which gives the best result in landscape shooting on the web.

In addition, the application processing unit 140 can input preset information from the input unit 170 in the preset setting mode to set multi-preset information. The application processing unit 140 transmits the multi preset information set as described above to the image processing unit 130.

When the preset photographing is requested, the application processor 140 transmits the preset information to the image processor 130, and the image processor 130 sequentially sets the preset information of the multiple preset information in the camera unit 140. Then, the camera unit 140 sets the camera unit 140 according to the preset information sequentially input to acquire an image according to different setting values, and outputs the image to the image processing unit 130. The image processor 130 processes the images obtained according to each preset information into one frame image, and thus generates a frame image (multi-frame image) corresponding to the number of the multiple preset information.

At this time, the image processing unit 130 receives the image obtained by the camera unit 110 in the corresponding frame period, converts the image into a display image and a compressed image, generates shooting information of the camera unit 110 when the corresponding frame image is acquired, , Compressed image, and photographing information) in one frame and outputs it to the application processing unit 140. Here, the image processor 130 may generate the frame image at 30 fps or more (for example, 60 fps).

At this time, in each cycle of the frames, the video processor 320 performs a process of 3A processing a raw image input from the camera unit 110, color interpolation and / or converting a raw image into a YUV image, It can be an image having a resolution of full HD or higher. The JPEG coder 340 compression-encodes the image output from the video processor 320 according to the JPEG method and generates a compressed image for storing the captured image upon capture. At this time, the compressed data may be a compression encoder of a method different from JPEG. The scaler 330 generates a display image for previewing to reduce the image output from the video processor 320 to a predetermined data size and display the image on the display unit 160. At this time, a method of reducing the image may be a conventional scaling method, a crop method, and a resize method, and a display image may be generated by combining one of these methods or two or more methods. Here, the display image may be an image to be displayed on the display unit 160 and / or an image to be displayed on the display unit 160 as a post view after finishing the preset mode shooting. At this time, the scaler 330 of the image processing unit 130 may have a different data size of a display image for displaying on the display unit 160 and a display image for storing moving images. Also, as described above, when the video processor 320 does not perform the color conversion function, the scaler 340 may be configured as a display image generator. In this case, the display image generation unit may have a configuration including the color conversion (a function of converting a raw image into a YUV image) and a scaler function.

In addition, the image processor 130 generates the display image and the shooting information at the time of capturing an image in the camera apparatus when generating the compressed image in every frame period. At this time, the photographing information generated by the image processing unit 130 is photographing information of the camera unit 110, and the output of the sensor unit 120 is not yet merged. Accordingly, the application processing unit 140 merges the output of the sensor unit 120 (i.e., the second shooting information) with the shooting information (i.e., the first shooting information) of the camera unit 110 in the application processing unit 140 to generate final shooting information .

The multiplexing unit 350 multiplexes the display image, the compressed image, and the photographing information under the control of the image processing control unit 310 and outputs the multiplexed image to the application processing unit 140 as a single frame.

FIG. 4 is a diagram showing a YUV image, a JPEG image, and photographing information constituting a frame according to an embodiment of the present invention, FIG. 5 is a diagram showing an example of multi preset information according to an embodiment of the present invention, 6 is a diagram showing an example of a multi-frame image obtained by setting multi-preset information according to an embodiment of the present invention.

4 to 6, the image processor 130 sequentially transmits and sets the multi-preset information as shown in FIG. 5 at the time interval set in the camera unit 140 in the preset shooting mode, and the camera unit 110 sets the preset information Is changed, the image is acquired. At this time, the preset information may be a setting value of the camera unit 110 when capturing an image of one frame, and the preset information may have a plurality of setting values. The multi-preset information has a plurality of preset information, and each preset information has different setting values. FIG. 5 shows an example of multi-preset information of 10 frames. The preset information includes ten preset information, and the preset information has different setting values of the camera 110. FIG. 5 shows an example in which each frame information is composed of setting values of ISO, effect, AWB, and exposure, and the multi preset information is composed of 10 pieces of preset information. Accordingly, the image processor 130 may generate one or more frame images for one preset information. It is assumed that one frame image is processed in the embodiment of the present invention. Accordingly, the image processing unit 130 acquires a frame image having different setting values in every frame period in the preset shooting mode, and generates an image of each frame by generating a YUV image, a JPEG image, and embedded data (meta data) And the multiplexing unit 350 multiplexes the generated YUV image, JPEG image, and photographing information, and transmits the multiplexed YUV image, the JPEG image, and the photographing information to the application processing unit 140. The images of each frame transmitted at this time may be images photographed by different setting values as shown in FIG. In the case of FIG. 5, the setting values are changed according to the preset information corresponding to each of the 10 pieces of preset information, and the image processing unit displays the display image of one frame, Compressed image and shooting information. Accordingly, the image processor 130 can generate 10 frame images during the preset photographing, and the images generated at this time are images photographed by different preset information.

At this time, as shown in FIG. 4, JPEG data as a compressed image is original image data for storing as a still image upon capture request. At this time, the size of the JPEG data can be determined by the image sensor 220 of the camera unit 110, and can have a data size of 8M bytes or more, which is an ultra high resolution (UHD) image. The YUV data is an image for previewing on the display unit 160, and is scaled to a size smaller than the size of the JPEG data. The YUV data may be used as post view data in addition to the preview data. That is, the display images stored in the display image buffer 383 may be displayed on the display unit 160 during the preset shooting. The photographing information may be a camera additional function, various photographing information at the time of acquiring an image at the camera unit 110, and sensor information sensed from the sensor unit 120 located outside the camera apparatus. At this time, the shooting information is not included in the compressed image but stored independently. That is, the image processing unit 130 generates shooting information using information sensed by the camera unit 110 and the sensor unit 120 in each frame, and stores the shooting information so as to correspond to the display image and the compressed images every frame . Then, the user can efficiently store and process the image using the photographing information.

The camera frame data according to an embodiment of the present invention having the structure as shown in FIG. 4 is generated in the image processor 130 and transferred to the application processor 140. In this case, the YUV data may be 2M (Full HD): 1920 * 1080 * 2 (YUV422 foramt is 2Bytes per one pixel), JPEG data may be Max 8MB, Meta data which is photographing information is 4K . In this case, the necessary bus bandwidth when transmitting each frame data as shown in FIG. 5 is 1920 * 1080 * 2 + 8 * 1024 * 1024 + 4 * 1024 * 30fps * 8bit = 3,009,576,960bps = 2.87 Gbps.

The display image, the compressed image, and the photographing information multiplexed and transmitted by the image processor 130 are demultiplexed by the demultiplexer 355 of the application processor 140 and parsed into the display image, the compressed image, and the photographing information by the parser 370, The corresponding display image buffer 383, the compressed image buffer 385, and the photographing information buffer 387. The buffer 380 has a structure of a ring buffer, and is overwritten when data of the set frame number is buffered.

Each of the buffers 383, 385, and 387 has N ring buffer structures capable of storing corresponding data of N frames, and buffers corresponding data under the control of the application processing controller 360. At this time, if data is buffered in the N buffers, the application processing controller 360 rewrites data to be buffered from the beginning. That is, in the case of the compressed image buffer 385, N buffers capable of storing JPEG images of N frames are linked by a ring buffer structure, and N-frame JPEG images of JPEG 1 - JPEG n are stored in corresponding buffers The generated N JPEG n + 1-JPEG 2n images are overwritten with corresponding compressed image buffers, respectively. The frames of the display image buffer 383, the compressed image buffer 385, and the photographing information buffer 387 are synchronized through a frame count value. Accordingly, the application processing controller 360 can check the frame count value and process the display image, the compressed image, and the shooting information of the same frame. In addition, the application processing controller 360 may buffer the display image in the display image buffer 380 and output the display image to the display unit 160 so that the display image can be displayed.

When the user finishes the preset photographing command in the above state, the application control processor 360 detects the preset photographing instruction and stores the compressed images and photographing information photographed in the preset among the compressed images buffered in the compressed image buffer 385 in the storage unit 150 do.

FIG. 7 is a view for explaining operations at the time of continuous shooting in a terminal device including a camera device or a camera device according to an embodiment of the present invention.

Referring to FIG. 7, in operation 710, the image processor 130 generates a display image and a compressed image in each frame in step 710 and outputs the display image and the compressed image in one frame. The application processor 140 processes the display image and the compressed image / RTI > At this time, if the user instructs the continuous shooting, the application processing unit 710 confirms the continuous shooting in step 720. In step 730, the application processing unit 140 stores display images and compressed images corresponding to frames of a shooting request time point and frames thereafter, among the images buffered in the buffer 380, and displays the frames of the frames output from the image processing unit 130 And continues to buffer the image and compressed images in the buffer 380. At this time, the frame rate of images obtained during the continuous shooting can be a speed set by the user within the maximum preview speed. The images to be photographed may be stored in the photographed order until the continuous shooting is terminated. When the user sets the continuous shooting number of images, the number of images set by the user is stored. Also, the YUV data indicated by the preview is separately stored for the postview so that it can be quickly displayed to the user without decode operation after capturing.

In this case, when the compressed images are transmitted during the preset photographing, the application processing controller 360 may include a RAM disk in order to secure the storage performance of the storage unit 150, and the RAM disk may be provided in the storage unit 150 have. In this state, the image files photographed at the time of the preset photographing may be temporarily stored in the RAM disk, and may be moved to a file system available to the user of the storage unit 150 in the background at the end of the preset photographing . The image file temporarily stored in the RAM disk includes a display image. In addition, the photographed sound during the preset photographing may continuously generate a photographed sound according to the stored frame rate, and may also generate a photographed sound at a continuous photographed sound speed set by a user or a default.

Here, the reason why the display image is stored is to show the postview of the photograph taken by the user at the end of the preset photographing. That is, in the case of displaying the compressed image, since decoding must be performed, it may take time to display the compressed image as a post-view image. At this time, the user can select a desired image among the preset photographed images while viewing the post view image. Therefore, the application processing unit 140 displays the display images of the photographed images on the display unit 160 after the end of the preset photographing. At this time, the post view display method can be performed in various forms. For example, it is possible to superimpose the preset photographed images, and also to display thumbnail images. At this time, when displaying the display image, it is difficult to display the images photographed at the end of the preset photographing on one screen of the display unit 160. Therefore, the display image may be resized to an appropriate size and displayed or overlaid as shown in Fig. Images can be alternately displayed at intervals. The application processor 140 may select and store the preset shot images at the user's selection in the state of displaying the post view images as described above. That is, when the user desires to check each preset photographed image, the user searches for the selected photographed image using a finger or other pointing device displayed on the display unit 16, the application processing unit 140 displays the selected photograph as a full screen . When a storage request for the images selected by the above process is generated through the input unit 170, the application processing unit 140 stores the compressed images of the frames requested to be stored and the shooting information corresponding thereto in the storage unit 150 , The display images temporarily stored are removed.

Then, the user can set various functions using the shooting information (meta data). That is, the user can use the shooting information to frequently find a set value corresponding to the situation using the photographed subject information and the camera menu information. In this case, if a human face is detected at Preview time, the menu that is often used in the person DB in the person DB or has a good result in use can be automatically set. For example, a user of a camera device shoots a lot of portraits of his or her family members, friends, relatives, family members, entertainers, etc. If the user finds appropriate information at the time of shooting the person in the person DB, It is also possible to set the person information in the preview information (for example, smile shot, beauty shot, portrait scene mode, AF mode, object tracking, ISO, effect, white balance, exposure, metering, zooming, If you can not find it, you can check the part of the landscape photographing to make it suitable for landscape photographs (eg, outdoor visible, flash, ISO, effect, white balance, exposure, metering, landscape scene mode, , etc.) The images photographed as described above can be stored based on the experience of using the user's camera. (For example, in the case of a lover photo, it can be saved as a lover album at the same time as shooting, or reflected in a designated SNS or cloud system). In addition, it is possible to determine the portion of the similarity of the photographed image in the continuous shooting so that it can be easily confirmed when the album or the postview is displayed to the user.

7 is a flowchart showing an operation procedure at the time of taking a preset photograph according to an embodiment of the present invention in a portable terminal apparatus having a camera apparatus or a camera apparatus.

In order to perform the preset photographing, the multi preset information must first be set. At this time, the method of setting the multi-preset information may set the multi-preset information in the preset information setting mode and acquire the multi-frame images using the multi preset information set in the preset shooting mode. Also, in the automatic mode, when performing the preset shooting mode, the camera apparatus analyzes the preview image acquired by performing preview, and can perform preset shooting by setting multi preset information frequently used by the user according to the result. In the embodiment of the present invention, the latter method will be mainly described.

Referring to FIG. 7, when the preset photographing is performed, the application processing unit 140 sets multi-preset information in step 711. FIG. At this time, the method of setting the multi-preset information may be set as information input by a user, and the application processing unit 140 may automatically set the multi preset information.

FIG. 8 is a flowchart illustrating a procedure for setting multi-preset information according to an embodiment of the present invention in step 711 of FIG.

Referring to FIG. 8, if the multi-preset information is automatically set, the application processor 140 detects the multi-preset information in step 811 and requests the previewer to perform the preview mode through the image processor 130 in step 813. Then, the image processing unit 130 generates an image obtained from the camera unit 110 as a display image and a compressed image, and multiplexes and transmits the display image and the compressed image to the application processing unit 140.

In step 815, the application processor 140 searches for a character in the display image. Here, the face detection may be performed using the normal face detection method. At this time, if the face is searched, the application processor 140 regards that the current portrait is photographed, and in step 817, the preset information mainly photographed from the preset information stored in the person DB of the storage unit 150 is selected, And outputs it to the image processing unit 130 in step 819 to set multi-preset information. That is, when the face is detected at the time of preview, the application processing unit 140 automatically sets the multi-preset information by selecting menus frequently used in photographing the person in the person DB of the storage unit 150 or having a good result in use. At this time, when the multi preset information for the portrait is in operation, the corresponding function is always executed in the background, and is not displayed on the screen during the human face detection operation since it is a background operation. When the person is searched in the DB, if the person exists in the DB, the optimal preset data used at the time of photographing the person is loaded and set as the multi preset information.

If it is determined in step 815 that no character is found in the display image, the application processing unit 140 regards it as a landscape photographing operation. In step 821, the optimal preset information is selected from the landscape DB stored in the storage unit 150, And outputs it to the image processing unit 130 in step 819 to set multi-preset information. That is, when the user information can not be found in the preview information, the application processing unit 140 confirms the portion of whether or not the landscape photograph is photographed, and makes the setting suitable for the landscape photograph. At this time, the application processing unit 140 detects landscapes similar to the human face detect, and if the user has preset preset data at the time of the landscape photographing, the application processor 140 directly loads the preset data to set the multi preset information.

In addition to the above-described automatic setting, the user manually sets preset information desired by the user. In this case, the application processing unit 140 may generate the preset setting data received through the input unit 170 in step 823 as multi-preset information.

When the user performs the preset photographing in the state where the multiple preset information is set as described above, the camera device performs the preset photographing. That is, in the preset photographing mode, the application processing unit 140 and the image processing unit 130 may acquire a multi-frame image by performing photographing using the multi preset information set in step 713.

FIG. 9 is a flowchart illustrating a procedure of performing a preset photographing in step 713 of FIG. 7 according to an embodiment of the present invention.

Referring to FIG. 9, the image processor 130 receives the multi-preset information by the application processor 140 and sequentially sets the multi-preset information to the camera unit 140 when taking a preset image. First, the image processor 130 sets the camera unit 110 as the first preset information among the multiple preset information in step 911. Then, the camera unit 110 generates an image while changing the setting according to the preset information.

In step 913, the image processor 130 obtains an image to be photographed from the frame camera 110. In step 915, the image processor 130 performs preprocessing (color conversion, color interpolation, 3A processing, etc.) on the obtained image, scales the preprocessed image Generates a display image, generates a compressed image through the JPEG coder 340, and generates shooting information. The image processing unit 130 multiplexes the generated display image, compressed image, and photographing information into one frame and transmits the multiplexed image to the application processing unit 140. In step 917, the application processor 140 buffers the display image, the compressed image, and the shooting information in the buffer 380, respectively. In step 919, the application processor 140 transmits the display image to the display unit 160 and displays the display image. At this time, the application processing unit 140 may combine the sensor information acquired from the sensor unit 120 with the shooting information transmitted from the image processing unit 130 and buffer the combined sensor information in the buffer 380 to generate shooting information. Here, the compressed image is an image to be stored in the preset shooting mode, and the display image can be used as a preview and a post-view image.

After processing the image of one frame by the one preset information as described above, the image processor 130 checks whether the currently processed preset information is the last preset information of the multi preset information in step 921. Otherwise, in step 923, After the preset information is selected, the process returns to step 911 to set the camera unit 11110 as other selected preset information. Then, the camera unit 110 sets an image according to the changed preset information to generate an image.

The image processing unit 130 and the application processing unit 140 sequentially output the multi preset information having the setting values of the different camera units 110 to the camera unit 110, The setting is changed to obtain multi-frame images as shown in FIG. At this time, the frame rate may be set as a time for the image processing unit 130 to output the preset information to the camera unit 110. Accordingly, as shown in FIG. 5, the multi-preset information is composed of ten, and when the image processing unit 130 changes the preset data at a cycle of 330 ms, 10 frames of images are acquired per second. At this time, Images taken at different setting values become images. When the image corresponding to the last preset information of the multi-preset information (which may be 10th in this case) is acquired as described above, the application processing unit 140 senses the end of the preset photographing and ends the preset photographing in step 921. At this time The application processing unit 140 may buffer the images photographed in the preset photographing mode in the buffer 380 if the buffer 380 can buffer images of the number of the multi-frames or more. In addition, when the application processor 140 includes a RAM disk, the application processor 140 may temporarily store images photographed by the multi preset information in the RAM disk. Also, if the storage unit 150 includes a RAM, the application processing unit 140 may temporarily store the multi-frame images photographed in the preset shooting mode in the RAM of the storage unit 150. [ At this time, the frame images may be composed of a display image, a compressed image, and photographing information.

After the preset photographing is completed by the above procedure, the application processing unit 140 performs the post view operation in step 715 of FIG. 7 and stores the selected images in the post view process. 10 is a flowchart illustrating a procedure for performing post view and image storage in steps 715 and 717 of FIG. 7 according to an embodiment of the present invention.

Referring to FIG. 7, at the end of the preset photographing, the application processor 140 displays a preset multiframe image photographed and stored in the display unit 160 in step 1011. FIG. At this time, the image displayed on the display unit 160 may be the display image or a thumbnail image of stored images. Accordingly, if the display image is set as the post-view image in step 1011, the application processing unit 140 displays the display image stored in the RAM disk. If the display image is the thumbnail image, the application processor 140 displays the thumbnail image of the preset photographed image. Unlike the thumbnail image, the display image can be displayed on the display unit 160 in a full screen. Therefore, in the embodiment of the present invention, when the display image is set as a post-view image, a method of superimposing the display images may be used. In this case, when the display images are all superimposed, it is difficult for the user to grasp the display images at a glance. Therefore, it is possible to display a frame image at a constant interval. In addition, when displaying the display image, the application processing unit 140 may display the display images at a predetermined time interval, or may resize the display image to an appropriate size so as to be displayed on one screen.

When the user wants to check the picture in the state of displaying the post-view image, the user can select the displayed image using a finger or a pointing device. At this time, if the user selects a specific image, the application processing unit 140 can detect the selected image in step 1013 and display the selected image on the display unit 160 as a full screen in step 1015. At this time, when the selected image is displayed in full screen, photographed preset information can also be displayed together.

In the case of the preset photographing, various photographs can be photographed according to the setting value (i.e., preset information) of the camera as shown in FIG. In this case, since unnecessary photographs can also be taken, it is desirable to store only desired pictures by the user's selection. Accordingly, when performing the post view operation, the application processing unit 140 may display a UI element (e.g., an icon, a soft button, a small image, etc.) that can select whether or not to store the corresponding photo . If the corresponding UI component is selected, the application processing unit 140 senses it as a storage request in step 1017, and stores the compressed image and shooting information of the selected image in the storage unit 150. In addition, the preset information of the stored image may be stored in the DB of the storage unit 150. And may store all the images photographed in the preset.

As described above, during the preset shooting, the application processing unit 140 stores the YUV data used for the preview separately for the postview, and can promptly display to the user without performing the decode operation after the end of the preset shooting. In addition, since it is difficult to display the images photographed in the preset in the post view process on one screen, the display images of the respective frames can be overlaid or displayed at regular intervals, and can be resized and displayed in an appropriate size. When you want to check the post view picture, you can search the post view screen directly by using your finger or other pointing device, and display the selected picture in full screen in the search process.

1 and 3, the camera apparatus includes an image processing unit 130 and an application processing unit 140, and processes images sensed by the camera unit 110. FIG. However, the image processing unit 130 and the application processing unit 140 may be integrated into one processing unit. 11 is a diagram showing a configuration of a camera apparatus for processing a single configuration of image and application processing in an embodiment of the present invention, and FIG. 12 is a diagram showing the configuration of the processing unit 1100 in the configuration of FIG.

Referring to FIGS. 11 and 12, the camera unit 110 photographs an external image when the camera is driven, and the sensor unit 120 is a sensor mounted on the camera device. The sensor unit 120 includes a GPS receiver, a gyro sensor, One or more of the direction sensors.

The processing unit 1100 sequentially sets multi-preset information in the camera unit 110 in the preset shooting mode according to an embodiment of the present invention. The camera unit 110 changes the setting value according to the multi-preset information, It performs image generation function. The image processing unit 150 processes the image obtained from the camera unit 110 and generates a display image for displaying the image on the display unit 160, a compressed image and shooting information for storage, and buffers the generated images and shooting information. Here, the processing unit 1100 has a configuration for integrating the functions of the image processing unit and the application processing unit. The processing unit 1100 generates a display image, a compressed image, and shooting information in every frame period, and buffers images and information of the same frame in synchronization with each other

The input unit 170 can input preset setting information to the processing unit 1100, and can also generate a preset photographing command. The display unit 160 displays a display image output from the processing unit 1100 in a preset shooting mode and displays a post-view image after shooting is completed. Here, the input unit 170 may be a touch panel that senses a user's touch input, 160 may be an LCD or an OLED panel that displays data and images generated during program execution. The input unit 170 and the display unit 160 may be integrated touch screens. The input unit 170 may include buttons located outside the camera device.

The storage unit 150 may include a DB for storing preset information for setting multi-preset information, and stores images or images photographed with different preset information under the control of the processor 1100 in the preset shooting mode .

As shown in FIG. 12, the processing unit 1100 includes a configuration for multiplexing and transmitting frame images and shooting information from the image processing unit 130 to the application processing unit 140, and a configuration for transmitting the multiplexed frame images and information received from the application processing unit It can be seen that the configuration for multiplexing and the configuration for parsing it are omitted. Operations other than the above and the operations performed in the respective configurations are the same as those in Fig.

That is, an image having a full HD resolution or higher processed by the video pre-processing unit 1220 is compression-encoded into a JPEG image in the JPEG coder 1240, and the size thereof is adjusted in the scaler 1230 to be generated as a display image. Further, the control unit 1210 acquires the information at the time of photographing the image from the camera unit 110 and the sensor unit 120 to generate photographing information. At this time, the JPEG image, the display image, and the photographing information are generated in every frame period, and the JPEG image, the display image, and the photographing information generated in the same frame have the same frame count value. Therefore, the JPEG image, the display image, and the photographing information generated in the same frame are processed in synchronization. The JPEG image, the display image, and the photographing information are buffered in the corresponding buffers of the buffer 1250 under the control of the control unit 1210, and the display image is displayed on the display unit 150 and displayed.

The control unit 1210 stores the selected compressed image in the storage unit 150 after the preset photographing is completed. In addition, the controller 1210 may display thumbnail images generated by the thumbnail image generator 1270 or display images (post view) as described above according to a user's setting, thereby storing a compressed image selected by the user. Also, the controller 1210 may display the buffered photographic information according to the setting of the user and may store a compressed image selected by the user after the photographic information is confirmed.

13 is a diagram showing a configuration of a portable terminal apparatus having a camera apparatus according to an embodiment of the present invention.

Referring to FIG. 13, the camera unit 110 includes a sensor, and performs a function of acquiring an image through a sensor when the camera is driven. The sensor unit 120 may be one or more sensors mounted on a portable terminal device, and the sensor may be at least one of a GPS receiver, a gyro sensor, an acceleration sensor, an altitude sensor, a direction sensor, and an illuminance sensor. The sensor unit 120 may be connected to the image processing unit 130 as shown in FIGS. 1 and 3. The sensor unit 120 may be connected to the application processing unit 140 as shown in FIGS. 6 and 7, To the image processing unit 130 and to connect the remaining sensors to the application processing unit 140. In the following description, it is assumed that the sensor unit 120 is connected to the application processing unit 140.

The image processing unit 130 processes the image obtained from the camera unit 110, generates a display image for displaying the image on the display unit 160 in each frame, a compressed image for storing the image, and shooting information of an image taken in the corresponding frame. The display image may be a YUV image, and the compressed image may be a JPEG image. The photographing information can additionally acquire various information including the exif information that can be obtained at the time of photographing the image by the camera unit 110 and the output of the sensor unit 120 of the portable terminal apparatus. The image processing unit 130 may generate a display image, a compressed image, and photographing information at a frame rate of 30 frames per second or more (for example, 60 fps) per second. In the embodiment of the present invention, the image processing unit 130 receives the multi preset information in the application processing unit 140 in the preset shooting mode, changes setting values of the camera unit 110 at the set time intervals according to the multi preset information, To produce a multi-frame image.

The application processing unit 140 performs various application functions of the portable terminal device. In addition, the application processing unit 140 inputs the output of the sensor unit 120 and can process various sensor applications according to a user's request. For example, it is possible to process an application for inputting an output of a GPS reception to search for a navigation function and area information according to the location of the terminal, and an application or the like for executing a function set in the application currently executed according to the movement of the terminal Can be executed. In particular, the application processing unit 140 buffers the display image, the compressed image, and the shooting information generated in each frame in the image processing unit 130 when the camera is driven according to the embodiment of the present invention, and outputs the display image to the display unit 160 do. When the preset photographing request command is generated, the application processing unit 140 performs the preset photographing mode while transmitting the multi preset information to the image processing unit 130. In addition, the application processor 140 temporarily stores the frame images and the shooting information in the preset shooting process. At this time, the application processing unit 140 stores the set sensor information, which is output from the sensor unit 120, in the first shooting information generated by the image processing unit 130, And the final shooting information can be generated by merging the second shooting information with the first shooting information.

The communication unit 1320 performs a communication function with an external device or a base station. The communication unit 1320 includes a transmitter including a frequency up converter for increasing a transmission signal to an RF band and a power amplifier, an amplifier for low noise amplifying the RF signal, and a frequency down converter And the like. The communication unit 1320 may include a modulation unit for modulating the transmission signal and transmitting the modulated transmission signal to the transmission unit, and a demodulation unit for demodulating the signal output from the reception unit. The modulation and demodulation unit may be a modulation / demodulation unit of WCDMA, GSM, LTE, or a modulation / demodulation unit of WIFI, WIBRO, etc. according to a communication method.

The terminal control unit 1310 controls the overall operation of the portable terminal apparatus and performs functions of voice communication and data communication. Here, the terminal control unit 1310 may include a modulation and demodulation unit of the communication unit 1320. In this case, the communication unit 1320 may include only an RF communication unit. In this case, the fraudulent terminal control unit 1310 may perform the functions of modulating and / or encoding / decoding the communication signal. The audio processor 1330 is connected to the handset of the portable terminal device and processes the voice call during voice communication under the control of the terminal controller 1310. The memory 1340 may be a work memory loaded with programs of the terminal control unit 1310 and the application processing unit 140. In this case, the memory 1340 may be configured as a RAM. At this time, the application processor 140 may temporarily store the display image, the compressed image, and the shooting information of the frames obtained during the preset shooting in the memory 1340 if the RAM disk is not provided in the preset shooting mode. The memory 1340 may perform a ramdisk function for temporarily storing a display image, a compressed image, and shooting information of frames obtained during the preset shooting under the control of the application processing unit 140. [

The input unit 170 generates various operation commands and data input signals of the portable terminal device to the terminal control unit 1610 and the application processing unit 140. The display unit 160 displays the operation of the portable terminal device and the application execution state under the control of the terminal control unit 1610 and the application processing unit 140. Particularly, the display unit 160 displays a display image photographed in a preset photographing section under the control of the application processing unit 140 in a preset photographing mode. When the preset photographing is finished, the application processor 140 controls the post- Images can be displayed. Here, the input unit 170 may be a touch panel that senses a user's touch input, and the display unit 160 may be an LCD or an OLED panel. The input unit 170 and the display unit 160 may be integrated touch screens. The input unit 170 may include buttons located outside the portable terminal device.

The storage unit 150 may comprise a program memory for storing operating programs of the portable terminal apparatus and programs according to the embodiments of the present invention, and a data memory for storing data for program execution and data generated during program execution . In this case, the storage unit 150 may be a non-volatile memory such as a flash memory. In particular, the storage unit 150 stores compressed images and shooting information obtained during a preset shooting according to an embodiment of the present invention. Also, the storage unit 150 may include a RAM to temporarily store the display image, the compressed image, and the shooting information of the multi-frame generated in the preset shooting mode.

The portable terminal device having the configuration as shown in FIG. 13 can perform incoming / outgoing communication and communication services, and processes images photographed by the camera 110 according to an embodiment of the present invention in a camera photographing mode. The terminal control unit 1310 loads the communication programs, the communication programs, and the operating programs of the portable terminal unit in the memory unit 1340 in the storage unit 150. In this case, In addition, the application processor 140 loads a program for driving the applications in the storage unit 150 into the memory 1340 when an application is requested to be executed. In addition, the memory 1340 performs a work memory function in which operating programs and application programs of the portable terminal apparatus are loaded when the system is started. Here, the memory 1340 may be shared by the application processing unit 140 and the terminal control unit 1310, or may be independently configured and used.

The application processing unit 140 processes various applications of the image processing application and the mobile terminal device of the camera unit 110 according to the embodiment of the present invention. In order to perform various application processes as described above, the application processing unit 140 may input the output of the sensor unit 120, and may execute an application using the output of the sensor unit 120, The processing operation of the application can be controlled. Also, the terminal control unit 1310 inputs the output of the sensor unit 120 and can perform a call or communication service or control the call or communication service by the output of the sensor unit 120.

In an outgoing call, the user can generate an outgoing telephone number and a call request signal through the input unit 170. The terminal control unit 1310, which senses the outgoing telephone number and the call request signal, forms a call path by controlling the communication unit 1320, and performs an outgoing call function through the base station. When an incoming call is generated, the terminal control unit 1310 detects it through the communication unit 1320, alerts an incoming call through the audio processing unit 1330, and displays the incoming information through the display unit 160. At this time, when the user responds through the input unit 170, the terminal control unit 1310 forms a call connection path through the communication unit 1320 to perform a call service. In the case of data communication, a communication path is formed by an operation similar to the above-mentioned communication.

In addition, the portable terminal apparatus can execute various applications. At this time, if the user requests execution of a specific application through the input unit 170, the application processing unit 140 executes the application and displays the result on the display unit 160. At this time, when the multi preset information for preset photographing is automatically set, the application processing unit 140 can automatically set the multi preset information. In this case, the application processing unit 140 performs a preview mode to acquire an image, and analyzes the acquired image to set multi-preset information. At this time, it is checked whether there is a character by using the face detection method in the display image. If there is a character, the preset information stored in the person DB of the storage unit 150 is searched for, Information. However, if there is no corresponding person or person preset information in the person DB of the storage unit 150, the application processing unit 140 requests the terminal control unit 1310 for a web connection for setting preset information. That is, the portable terminal device stores the photographed image based on the experience of using the user's camera, and may store the photographed image as a lover album or reflect the photographed image in a designated SNS or cloud system. Accordingly, if there is no preset information in the DB of the storage unit 150, the application processing unit 140 notifies the terminal control unit 1310 that the terminal control unit 1310 can search for and download appropriate preset information by connecting to the corresponding web through the communication unit 1320 have. Also, in the case of the scenery of the image analysis, the preset information may be set in the same manner as the preset information of the person.

When the multi-preset information is set as described above, the application processor 140 and the image processor 130 may acquire a multi-frame image by photographing using the preset multi-preset information. At this time, the image processing unit 130 receives the multi-preset information by the application processing unit 140 and sequentially generates multi-frame images while setting the multi-preset information to the camera unit 140 at the time of taking a preset image. And stores the preset photographed images in the storage unit 150 when the photographing ends.

The embodiments of the present invention disclosed in the present specification and drawings are merely illustrative of specific embodiments of the present invention and are not intended to limit the scope of the present invention in order to facilitate understanding of the present invention. It will be apparent to those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.

Claims (25)

A method of photographing an electronic device,
Determining whether a person is included in the preview image when taking a preset shot;
Determining whether the setting information for a specific person corresponding to a person included in the preview image is stored in the database when the person is included in the preview image;
Sequentially changing an imaging setting value of a camera of the electronic device using setting information for the specific person when preset information about the specific person is stored in the database;
Sequentially changing the photographing setting value using the basic setting information related to the portrait photographing when the preset information on the specific person is not stored in the database;
Sequentially acquiring images based on sequential changes of the photographing setting values;
Displaying the acquired images through the display unit of the electronic device at the end of the preset shooting; And
And storing at least one image selected from the images displayed through the display unit,
Wherein the acquired images are acquired based on different shooting setting values, respectively. The method according to claim 1,
Further comprising the step of displaying the preview image through the display unit when taking a preset shot. 3. The method of claim 2,
Further comprising the step of sequentially changing the photographing setting value using basic setting information related to a predetermined landscape photographing when the person is not included in the preview image. 3. The method of claim 2,
Scaling the images obtained from the camera to generate a plurality of display images;
Encoding the images to generate a plurality of compressed images; And
Further comprising: temporarily storing the generated plurality of display images and the plurality of compressed images. 5. The method of claim 4,
Wherein the generating the plurality of display images and the generating the plurality of compressed images comprises:
Further comprising the step of generating photographing information at a photographing time point of at least one of the camera and at least one external sensor of the electronic device. 6. The method of claim 5,
The operation of displaying the images may include:
And displaying the generated plurality of display images at the end of the preset photographing. The method according to claim 6,
The operation of displaying the images may include:
And displaying the plurality of display images on a single screen in a superimposed manner. 8. The method of claim 7,
The operation of displaying the images may include:
And displaying the selected one of the plurality of display images in a full screen. The method according to claim 6,
The operation of displaying the images may include:
And displaying the thumbnail images corresponding to the images at the end of the preset photographing. 6. The method of claim 5,
Wherein the display image is a YUV image, and the compressed image is a JPEG image. In the camera device,
camera;
A storage unit;
A display section; And
Comprising:
Wherein,
It is determined whether or not a person is included in the preview image at the time of shooting the preset,
Determining whether the setting information for a specific person corresponding to a person included in the preview image is stored in the database of the storage unit when the person is included in the preview image,
When the preset information about the specific person is stored in the database, sequentially changing the shooting setting value of the camera using the setting information for the specific person,
If the preset information for the specific person is not stored in the database, the imaging setting value is sequentially changed using basic setting information related to portrait shooting,
Sequentially acquiring images through the camera based on sequential changes of the shooting set values,
And displaying the acquired images through the display unit at the end of the preset shooting,
Wherein the acquired images are acquired based on different imaging setting values, respectively. 12. The method of claim 11,
Wherein the processing unit is configured to display a preview image on the display unit during the preset photographing. 13. The method of claim 12,
Wherein,
Wherein the photographing setting value is sequentially changed using basic setting information related to a predetermined landscape photographing when the person is not included in the preview image. 14. The method of claim 13,
Further comprising a sensor portion including at least one sensor,
Wherein,
The second shooting information related to the shooting setting value, the first shooting information related to the setting value of the camera at the time of shooting, and the second shooting information related to the setting value of the sensor unit at the time of shooting A camera device characterized by. 15. The method of claim 14,
Wherein,
An image processing control unit for sequentially changing the photographing set values of the camera and generating first photographing information of the camera at the time of photographing;
A scaler for scaling an image obtained from the camera to generate a display image;
A compression coding unit for coding an image obtained from the camera to generate a compressed image; And
And a multiplexer for multiplexing the generated display image, the compressed image, and the first photographing information in one frame, and transmitting the multiplexed image. 16. The method of claim 15,
The processing unit
A demultiplexer for demultiplexing the multiplexed display image, the compressed image, and the first photographing information;
A parser for parsing the display image, the compressed image, and the first photographing information demultiplexed by the demultiplexing unit into a buffer;
A buffer for buffering the display image, the compressed image, and the first photographing information; And
An application processing control unit for generating the comprehensive shooting information by generating the output of the sensor unit as the second shooting information at the time of shooting and merging the second shooting information with the first shooting information of the buffer and temporarily storing the display image, And the camera device. 17. The method of claim 16,
The application processing control unit
Wherein the controller displays the display image temporarily stored at the end of the preset shooting through the display unit. 18. The method of claim 17,
Wherein the application processing control unit overlays and displays the display images on one screen when the display image has a plurality of display images, and displays any one of the display images selected as the full screen. 17. The method of claim 16,
The application processing control unit
And displays thumbnail images corresponding to the images at the end of the preset shooting through the display unit. 16. The method of claim 15,
Wherein the display image is a YUV image and the compressed image is a JPEG image. In the portable terminal apparatus,
A camera section;
A storage unit;
A display section; And
Comprising:
Wherein,
It is determined whether or not a person is included in the preview image at the time of shooting the preset,
Determining whether the setting information for a specific person corresponding to a person included in the preview image is stored in the database of the storage unit when the person is included in the preview image,
When the preset information about the specific person is stored in the database, sequentially changing the shooting setting value of the camera using the setting information for the specific person,
If the preset information for the specific person is not stored in the database, the imaging setting value is sequentially changed using basic setting information related to portrait shooting,
Sequentially acquiring images through the camera based on sequential changes of the shooting set values,
And displaying the acquired images through the display unit at the end of the preset shooting,
Wherein the acquired images are acquired based on different imaging setting values, respectively. 22. The method of claim 21,
Wherein the processor is configured to display a preview image on the display unit during the preset photographing. 23. The method of claim 22,
Further comprising a sensor portion including at least one sensor,
Wherein,
The second shooting information related to the shooting setting value, the first shooting information related to the setting value of the camera at the time of shooting, and the second shooting information related to the setting value of the sensor unit at the time of shooting Wherein the portable terminal device comprises: 24. The method of claim 23,
The processing unit
An image processing control unit for sequentially changing the photographing set values of the camera and generating first photographing information of the camera at the time of photographing;
A scaler for scaling an image obtained from the camera to generate a display image;
A compression coding unit for coding an image obtained from the camera to generate a compressed image; And
And a multiplexing unit multiplexing the generated display image, the compressed image, and the first photographing information in one frame, and transmitting the multiplexed image. 25. The method of claim 24,
The processing unit
A demultiplexer for demultiplexing the multiplexed display image, the compressed image, and the first photographing information;
A parser for parsing the display image, the compressed image, and the first photographing information demultiplexed by the demultiplexing unit into a buffer;
A buffer for buffering the display image, the compressed image, and the first photographing information; And
An application processing control unit for generating the comprehensive shooting information by generating the output of the sensor unit as the second shooting information at the time of shooting and merging the second shooting information with the first shooting information of the buffer and temporarily storing the display image, The portable terminal device comprising:

Images