TWI516113B - Image capture device and image synthesis method thereof - Google Patents

Description

Camera device and image synthesis method thereof

The present invention relates to an imaging apparatus and an image synthesizing method thereof, and more particularly to an imaging apparatus and a video synthesizing method thereof for performing weight adjustment on a focusing distance of a plurality of viewing angles of a scene.

With the advent of digital technology, in the travel, people like to use the camera to record the things in front of them, and the camera has a limited range of lens angles, if the user wants to record a large number of beautiful scenes in front of them, most of them It is impossible to completely record the beauty in front of you with only one image; similarly, if you want to record the scenes at various angles indoors, it is often difficult to achieve. As a result, a panoramic connection was developed to accomplish the above objectives.

When a part of the user performs the panoramic connection, the focus and the shooting are respectively performed on the respective angles of the scene, and then the plurality of images obtained by the shooting are joined into a panoramic image, because the focal length values of the respective viewing angles are different. The focal lengths of the images are inconsistent, which may cause the panoramic images to have obvious sharpness or inconsistent depth of field, which may result in poor viewing quality of the panoramic images.

Another part of the user performs the panoramic image based on the focal length value of the first shot, and uses the focal length value of the first shot to perform subsequent image capture of multiple images, thereby ensuring the scene. The focal lengths on different images are consistent to avoid unnatural phenomena caused by the inconsistency of the definition or depth of field of the panoramic image. However, when the depth of field in the scene changes too much, the foreground depth or the back depth of the scene in the panoramic image may be too blurred, and even worse, the foreground depth or the back depth may be blurred to an unrecognizable extent.

Looking at the foregoing problems, the inventors of the present invention have conceived and designed an image pickup apparatus and an image synthesis method thereof, which are improved in view of the lack of the prior art, thereby enhancing the industrial use and utilization.

In view of the above problems in the prior art, the object of the present invention is to provide an image pickup apparatus and an image synthesizing method thereof, which can solve the problem of the inconsistent focal length or the foreground or the depth of the back scene when the panoramic image is synthesized by the prior art. problem.

According to an object of the present invention, an image capturing apparatus is provided, comprising: an image capturing module and a processing module. The image capturing module pre-fetches a plurality of temporary images by using a plurality of scanning focal length values for a plurality of viewing angles of a scene. The processing module weights each scanning focal length value of the plurality of temporary images of each viewing angle to obtain a temporary focal length value; the processing module further uses a relationship according to each temporary focal length value to obtain a weighted focal length value, and according to the weight The focal length value controls the image capturing module to perform panoramic image capturing.

The relationship is a sum of the number of temporary focal lengths corresponding to the respective viewing angles of the respective viewing angles and the sum of the number of the plurality of temporary images of the respective viewing angles, and then summed. In other words, the weighted focus value is a weighted average corresponding to the temporary focus value of the angle of view, wherein the weight corresponding to the angle of view is the ratio of the number of temporary images of the captured angle of view to the number of temporary images. More specifically, the relationship is as follows: Or, simply: Wherein the weight focal length value is L _W , and the temporary focal length values corresponding to the respective viewing angles are L ₁ , L ₂ ... L _i , m is the number of viewing angles corresponding to the panoramic image, and the temporary image of the viewing angle corresponding to the temporary focal length value The number is Q ₁ , Q ₂ ... Q _i , and the number of plural temporary images is Q _tot .

The temporary focus value may be the scan focus value of one of the plurality of temporary images in the plurality of temporary images of the corresponding viewing angle.

The temporary focal length value may be an average scan focal length value of the plurality of temporary images of the corresponding viewing angle, an average value of the maximum scan focal length value and the minimum scan focal length value, or a difference between the maximum focal scan distance value and the minimum focal scan distance value.

The image capturing device may further include an image synthesizing module; the processing module controls the image capturing module to perform panoramic image capturing according to the weight focal length value to obtain one weighted image of each viewing angle; the image synthesizing module weights each viewing angle The images are synthesized to obtain a panoramic image.

The image synthesizing module can intercept the vertical image of the middle portion of each weight image to be joined into a panoramic image.

According to the purpose of the present invention, an image synthesizing method is further applied to an image capturing device. The image synthesizing method includes the following steps: an image capturing module uses a plurality of scanning focal length values for a plurality of viewing angles of a scene in advance. Taking a plurality of temporary images by a processing module, the scanning focal length values of the plurality of temporary images of each viewing angle are weighted to obtain a temporary focal length value, and a weighted focal length value is obtained by using a relational expression; Corresponding temporary focal length values are respectively multiplied by the sum of the plurality of temporary images of the corresponding viewing angles and the plurality of temporary images of the respective viewing angles, and then summed; and the processing module controls the image capturing according to the weight focal length value The module performs panoramic image capture.

The temporary focus value may be the scan focus value of one of the plurality of temporary images in the plurality of temporary images of the corresponding viewing angle.

The temporary focal length value may be an average scan focus value of the plurality of temporary images of the corresponding viewing angle, an average value of the maximum scan focal length value and the minimum scan focal length value, or a difference between the maximum scan focal length value and the minimum scan focal length value.

The method further includes the following steps: the processing module controls the image capturing module to perform panoramic image capturing according to the weight focal length value to obtain one weighted image of each viewing angle; and the image capturing module displays each viewing angle The weight images are combined to obtain a panoramic image.

The image synthesizing module can intercept the vertical image of the middle portion of each weight image to be joined into a panoramic image.

According to the purpose of the present invention, a camera device includes: a focus detection module, an image capture module, and a processing module. The focal length detecting module separately focuses on a plurality of viewing angles of a scene to generate a plurality of scanning focal length values corresponding to the respective viewing angles. The image capturing module performs image capturing on the scene according to a plurality of scanning focal length values of the respective viewing angles to obtain a plurality of temporary images corresponding to the respective viewing angles. The processing module weights each scanning focal length value of the plurality of temporary images of each viewing angle to obtain a temporary focal length value, and obtains a weighted focal length value by using a relational expression. The processing module then controls the image capturing module to perform panoramic image capturing according to the weight focal length value. The relational expression is a sum of the number of temporary temporary images corresponding to the respective perspectives of the respective viewing angles and the sum of the number of the plurality of temporary images of the respective viewing angles, and then summed.

The temporary focal length value may be the scan focal length value of one of the contrast images or the sharpness of the temporary image in the plurality of temporary images of the corresponding viewing angle.

The temporary focal length value may be an average scan focus value of the plurality of temporary images of the corresponding viewing angle, an average value of the maximum scan focal length value and the minimum scan focal length value, or a difference between the maximum scan focal length value and the minimum scan focal length value.

The image capturing device may further include an image synthesizing module; the processing module controls the image capturing module to perform panoramic image capturing according to the weight focal length value to obtain one weighted image of each viewing angle; the image synthesizing module weights each viewing angle The images are synthesized to obtain a panoramic image.

The image synthesizing module can intercept the vertical image of the middle portion of each weight image to be joined into a panoramic image.

As described above, the image pickup apparatus and the image synthesis method thereof according to the present invention may have one or more of the following advantages: (1) The camera device and the image synthesizing method thereof can obtain a weighted focal length value by performing focus measurement on the scene in advance to obtain a temporary focal length value of each angle of view in the scene, and obtain a weight focal length value according to the panorama. The image capture can effectively improve the consistency of the focal length of the panoramic image and effectively reduce the situation where the foreground depth or the back depth is too blurred.

1‧‧‧ camera

10‧‧‧Image capture module

101, 131‧‧‧ scan focus value

102‧‧‧ temporary image

Temporary images of different focal length values for a viewing angle of 102a1, 102a2, 102a3, 102a4‧‧

102b1, 102b2, 102b3‧‧‧ temporary images of different focal length values from another perspective

103‧‧‧ weight image

11‧‧‧Processing module

111‧‧‧temporary focal length value

112‧‧‧weight focal length value

12‧‧‧Image Synthesis Module

121‧‧‧ panoramic image

13‧‧‧focal length detection module

14‧‧‧Storage module

2‧‧‧Scenario

S51~S54‧‧‧Steps

Fig. 1 is a block diagram showing an embodiment of an image pickup apparatus of the present invention.

Fig. 2 is a schematic view showing an embodiment of an image pickup apparatus of the present invention.

Fig. 3 is a block diagram showing another embodiment of the image pickup apparatus of the present invention.

Fig. 4 is a schematic view showing another embodiment of the image pickup apparatus of the present invention.

Figure 5 is a step diagram of the image synthesis method of the present invention.

In order to make the above-mentioned objects, features and advantages of the present invention more comprehensible, the following description of the present invention will be described in detail with reference to the accompanying drawings. The same elements will be described with the same element symbols.

The camera device of the present invention may be a portable electronic device with a camera function such as a digital camera, a camera phone, a smart phone, a digital video camera or a tablet computer. In order to facilitate a better understanding of the technical features of the present invention, a digital camera is taken as an embodiment, but is not limited thereto.

Please refer to FIG. 1 , which is a block diagram of an embodiment of an image pickup apparatus of the present invention. As shown in the figure, the image capturing apparatus 1 of the present invention comprises an image capturing module 10 and a processing module. Group 11 and an image synthesis module 12. The image capturing module 10 captures a plurality of temporary images 102 by using a plurality of scanning focal length values 101 for a plurality of viewing angles of a scene 2 in advance. The image capturing module 10 can include a lens, a photosensitive element such as a Complementary Metal-Oxide-Semiconductor (CMOS) or a Charge-Coupled-Device (CCD), an analog/digital circuit, and image processing. And so on. The processing module 11 is electrically connected to the image capturing module 10, which may be a central processing unit (CPU) or a microprocessor (Micro-Processing Unit). The processing module 11 weights each scan focus value 101 of the plurality of temporary images 102 of each view in the scene 2 to obtain a temporary focus value 111. Then, the processing module 11 obtains a weighted focus value 112 by using a relational expression, and controls the image capturing module 10 to perform panoramic image capturing according to the weighted focal length value 112. The relationship is a sum of the number of the plurality of temporary images 102 corresponding to the temporary focal length values 111 corresponding to the respective viewing angles and the number of the plurality of temporary images 102 of the respective viewing angles, and then summing up The above detailed description of the relationship has been described in the above description, and will not be described again.

Please refer to FIG. 2, which is a schematic diagram of an embodiment of the image pickup apparatus of the present invention. Specifically, when panoramic photography is to be performed, the user performs a focus scan on the scene 2 using the image capturing apparatus 1 in advance (for example, scanning one by one from left to right in the scene or one by one from right to left), and the image is scanned. The module 10 is configured to capture a plurality of temporary images 102 by using different scan focal length values 101 for each view in the scene 2; that is, each view in the scene 2 has a plurality of temporary images 102, and the temporary images 102 They also have different scan focal length values 101, respectively. In the figure, two viewing angles are taken as an exemplary aspect, and a plurality of temporary images 102 of one viewing angle have different scanning focal length values 101, so a plurality of temporary images of the viewing angle 102 is represented by 102a1, 102a2, 102a3, and 102a4, respectively. Similarly, the plurality of temporary images 102 of another viewing angle also have different scanning focal length values 101, so that the plurality of temporary images 102 of the other viewing angle are respectively 102b1. , 102b2 and 102b3 are indicated. At this time, the processing module 11 receives a plurality of temporary images 102 of the respective viewing angles, and performs a determination (for example, 102a3, 102b3) of the plurality of temporary images 102 of the plurality of temporary images 102 of the respective viewing angles, such as 102a3, 102b3; The processing module 11 selects the scan focus value 101 of the temporary image 102 (such as 102a3, 102b3) with the best contrast or sharpness in each view as the temporary focus value 111 of each view in the scene 2, and substitutes the above related parameters into the relationship. In the formula, a weighted focus value 112 is obtained.

Then, the processing module 11 controls the image capturing module 10 to perform image capturing on each of the viewing angles in the scene 2 by using the weight focal length value 112 to obtain the weighted image 103 of each viewing angle, the processing module 11 and the image forming module. 12 The weighted images 103 of the respective viewing angles are combined to obtain a panoramic image 121 having appropriate foreground depth and back depth of field. The above methods for image synthesis are well known to those skilled in the art, and therefore will not be described herein.

Please refer to FIG. 3 and FIG. 4 together. FIG. 3 is a block diagram of another embodiment of the image pickup apparatus of the present invention; and FIG. 4 is a schematic view of another embodiment of the image pickup apparatus of the present invention. This example is similar to the foregoing, and a similar part thereof will not be described herein. As shown in the figure, the camera device 1 includes an image capturing module 10, a processing module 11, an image combining module 12, a focal length detecting module 13, and a storage module 14. In the image pickup apparatus 1 , the exposure module 11 has a mechanism of auto focus adjustment, which may include an aperture size, a focus distance, and the like, and focus each of the angles of the scene 2 to be photographed to generate each a plurality of scanning focal length values 131 in the viewing angle, so that the image capturing module 10 can generate a plurality of temporary images of each viewing angle 102, temporarily stored in the storage module 14. The storage module 14 can be an embedded memory, an external memory card, or a combination thereof.

When the user performs the pre-scanning of the scene 2 by using the camera 1 , the focal length detecting module 13 performs focusing on each of the viewing angles in the scene 2 and generates a plurality of scanning focal length values 131 in each viewing angle to make the image 撷The module 10 is configured to generate the temporary images 102 (such as images in the Live Preview) of the scenes in the scene 2, and temporarily store them in the storage module 14.

The processing module 11 reads a plurality of temporary images 102 of each viewing angle in the storage module 14 and determines one of the plurality of temporary images 102 of the respective viewing angles, which is the contrast or the sharpness of the temporary image 102, and then uses contrast or clarity. One of the best temporal images 102 is used as the temporary focal length value 111 of each viewing angle; in addition, the processing module 11 can also use the average of the scanning focal length values of the plurality of temporary images 102 of the respective viewing angles in the scene 2. The difference between the maximum scan focal length value and the minimum scan focal length value or the difference between the maximum scan focal length value and the minimum scan focal length value, as the temporary focal length value 111, should not be limited thereto. Then, the processing module 11 further uses the relationship between the temporary focal length values 111 of the respective viewing angles to obtain the weighted focal length value 112. It is worth mentioning that the distinction of the respective angles of view in the scene 2 can be differentiated according to the range of the angle of view of the camera lens of the image capturing module 10, for example, when the user presses the shutter button halfway (not shown) to operate the camera device 1 When the shutter button is released from left to right or from right to left, and the angle of view of the camera lens can be completely captured by the user's desired scene 2 with only 3 angles of view, the panoramic shot is 3 The angle of view is taken as a pre-scan of the scene 2; or may be differentiated by the setting of the original factory or the user, for example, when the user sets the control button (not shown) of the camera device 1 to 4 times, when using Pressing the shutter button halfway (not shown) to operate the camera 1 from left to right or from right to left The displacement is such that the edge of one viewing angle is joined to the edge of the next viewing angle and joined three times, and the panoramic shooting is taken with four viewing angles as the pre-scan of the scene 2.

The processing module 11 controls the image capturing module 10 to perform image capturing of the scene 2 according to the weight focal length value 112 to obtain one weighted image 103 of each viewing angle. The processing module 11 further controls the image synthesizing module 12 to synthesize the weighted images 103 of the respective viewing angles to obtain a panoramic image 121, and stores them in the storage module 14 or uses a display unit (not shown) ) Display for users to view. In addition, when the image synthesizing module 12 joins the weight images 103, the vertical images of the middle portions of the weight images 103 can be respectively intercepted and combined into a panoramic image 121; When the image capturing lens of the image capturing module 10 is at the wide-angle end, the weighted image 103 may cause the line of the joint edge to be misaligned when being joined due to the barrel deformation that may be present.

Please refer to FIG. 5, which is a step diagram of the image synthesizing method of the present invention. As shown in the figure, the image synthesizing method of the present invention is applied to an image pickup apparatus. The camera device comprises: an image capturing module and a processing module. The image synthesizing method comprises the following steps: (S51) an image capturing module pre-fetches a plurality of temporary images by using a plurality of scanning focal length values for a plurality of viewing angles of a scene; (S52) a processing module weights each perspective And scanning the focal length values of the plurality of temporary images to obtain a temporary focal length value, and obtaining a weighted focal length value by using a relationship; (S53) controlling the image capturing module to perform the panoramic image according to the weighted focal length value through the processing module. Taking a weight image of each view; and (S54) synthesizing the weight images of the respective views by an image synthesis module to obtain a panoramic image.

The detailed description and embodiments of the image synthesizing method of the image pickup apparatus of the present invention have been described in the foregoing description of the image pickup apparatus of the present invention, and will not be described here for the sake of brevity.

The above is intended to be illustrative only and not limiting. Any equivalent modifications or alterations to the spirit and scope of the invention are intended to be included in the scope of the appended claims.

1‧‧‧ camera

10‧‧‧Image capture module

101‧‧‧Scan focus value

102‧‧‧ temporary image

103‧‧‧ weight image

11‧‧‧Processing module

111‧‧‧temporary focal length value

112‧‧‧weight focal length value

12‧‧‧Image Synthesis Module

121‧‧‧ panoramic image

2‧‧‧Scenario

Claims (15)

An image capturing device includes: an image capturing module having a lens and a photosensitive element, wherein the image capturing module preliminarily uses a plurality of scanning focal length values to capture a plurality of temporary images for a plurality of viewing angles of a scene And a processing module is connected to the image capturing module, wherein the processing module weights each of the plurality of temporary images of the viewing angle to obtain a temporary focal length value, and utilizes a temporary focus value The relationship obtains a weighted focal length value, and the image capturing module is controlled to perform panoramic image capturing according to the weighted focal length value, wherein the relationship is: Where L _{w is} the weight focal length value, L _i is the temporary focal length value corresponding to each of the viewing angles, m is the number of the viewing angles, and Q _i is the number of the plurality of temporary images corresponding to the viewing angle, Q _tot is The number of the plurality of temporary images. The camera device of claim 1, wherein the temporary focus value is the scan focus value of the temporary image which is one of the plurality of temporary images corresponding to the viewing angle. The image pickup device of claim 1, wherein the temporary focus value is an average value of an average scan focus value, a maximum scan focus value, and a minimum scan focus value of the plurality of temporary images corresponding to the view angle or The difference between the maximum scan focus value and the minimum scan focus value. The image capturing device of claim 1, further comprising an image synthesizing module connected to the image capturing module and the processing module, the processing module being The weighted focus value controls the image capturing module to perform panoramic image capturing to obtain one weighted image of each of the viewing angles, and the image combining module combines the weighted images of the viewing angles to obtain a panoramic image. The image capturing device of claim 4, wherein the image synthesizing module intercepts a vertical image of a portion of each of the weighted images to join the panoramic image. An image synthesizing method is applicable to a camera device. The image synthesizing method comprises the following steps: an image capturing module pre-pickes a plurality of temporary images by using a plurality of scanning focal length values for a plurality of viewing angles of a scene; A processing module weights each of the scanning focal length values of the plurality of temporary images of the viewing angle to obtain a temporary focal length value, and obtains a weighted focal length value by using a relationship, wherein the relationship is: Where L _{w is} the weight focal length value, L _i is the temporary focal length value corresponding to each of the viewing angles, m is the number of the viewing angles, and Q _i is the number of the plurality of temporary images corresponding to the viewing angle, Q _tot is The number of the plurality of temporary images; and controlling, by the processing module, the image capturing module to perform panoramic image capturing according to the weighted focus value. The image synthesizing method according to claim 6, wherein the temporary focal length value is the scan focal length value of the temporary image which is one of the plurality of temporary images of the viewing angle corresponding to the viewing angle. The image synthesizing method according to claim 6, wherein the temporary focal length value is an average value of an average scanning focal length value, a maximum scanning focal length value, and a minimum scanning focal length value of the plurality of temporary images corresponding to the viewing angle. Or the difference between the maximum scan focus value and the minimum scan focus value. The image synthesizing method of claim 6, further comprising the step of: controlling, by the processing module, the image capturing module to perform panoramic image capturing according to the weight focal length value to obtain one of the viewing angles; And weighting the image; and synthesizing the weight images of the respective views by an image synthesis module to obtain a panoramic image. The image synthesizing method of claim 9, wherein the image synthesizing module intercepts a vertical image of each of the weighted images to join the panoramic image. An image capturing device includes: a focal length detecting module that pre-focuses a plurality of viewing angles of a scene to generate a plurality of scanning focal length values corresponding to the respective viewing angles; and an image capturing module has a The lens and a photosensitive element are connected to the focal length detecting module, and the image capturing module performs image capturing on the scene according to the plurality of scanning focal length values of the viewing angles to obtain a plurality of corresponding viewing angles. a temporary image; and a processing module connected to the image capturing module, the processing module weighting each of the plurality of temporary images of the viewing angle to obtain a temporary focal length value, and A weighted focal length value is obtained by using a relationship, and the image capturing module is controlled to perform panoramic image capturing according to the weighted focal length value, and the relationship is: Where L _{w is} the weight focal length value, L _i is the temporary focal length value corresponding to each of the viewing angles, m is the number of the viewing angles, and Q _i is the number of the plurality of temporary images corresponding to the viewing angle, Q _tot is The number of the plurality of temporary images. The camera device of claim 11, wherein the temporary focus value is the scan focus value of the temporary image of the plurality of temporary images corresponding to the viewing angle. The image pickup device of claim 11, wherein the temporary focus value is an average value of an average scan focus value, a maximum scan focus value, and a minimum scan focus value of the plurality of temporary images corresponding to the view angle or The difference between the maximum scan focus value and the minimum scan focus value. The image capturing device of claim 11, further comprising an image synthesizing module connected to the processing module, wherein the processing module controls the image capturing module to perform panoramic image capturing according to the weight focal length value Obtaining a weight image of each of the viewing angles, the image synthesizing module synthesizing the weight images of the viewing angles to obtain a panoramic image. The image capturing device of claim 14, wherein the image synthesizing module intercepts a vertical image of a portion of each of the weighted images to join the panoramic image.