WO2019041165A1

WO2019041165A1 - Square picture taking control method and apparatus with echo

Info

Publication number: WO2019041165A1
Application number: PCT/CN2017/099630
Authority: WO
Inventors: 张学熙
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-08-30
Filing date: 2017-08-30
Publication date: 2019-03-07
Also published as: CN111279681A

Abstract

Disclosed is a square picture taking control method with an echo. The method is used for a mobile phone having a rectangular picture previewing function, and comprises: S1. when an operating system of a mobile phone receives a photography instruction from a user, acquiring, by means of a camera of the mobile phone, a rectangular preview image of a current scene and displaying same on a screen; S2. blocking the rectangular preview image displayed on the screen, so that a visible region on the screen is square; S3. a user moving the square region to select and confirm a taken image; and S4. the content displayed on the screen remaining unchanged, and a background cropping the image taken in S3 according to the region selected in S2 and echoing an obtained image to the screen. According to the present invention, the waiting time for switching between different photographing modes is not needed during the photography process, and the next instance of photography can be carried out, without switching between "exit and re-entry", thanks to an image previewing function, thus greatly reducing the waiting time for a user required during the photography process and improving the user experience.

Description

Square photo shooting control method and device with echo

Technical field

The invention relates to the field of mobile phone application, and in particular relates to a method and device for controlling square photo shooting with echo.

Background technique

The phone is an old and new communication tool. Since Bell’s invention of the first wired telephone in 1876, the telephone has experienced nearly 150 years of development. Telephone communication services have entered thousands of households and become an indispensable tool for national economic construction, social life and people to exchange information. In 1972, Martin Cooper, the father of mobile phones, set out to study mobile phones. Until the first truly mobile phone was born in 1983, communication tools began to change dramatically. For more than three decades, mobile phones have evolved from the oldest "bricks" to the current multi-function smart phones. The telephone technology and business have undergone tremendous changes, and the location of communication has shifted from a fixed mode to a mobile one. The rapid development of mobile communication has made mobile phones monotonous and monotonous in function, simple and unique in function, and gradually developed into a compact, compact and versatile shape, making the pace of modern life faster and faster, and people are increasingly inseparable from mobile phones.

The first generation mobile phone (1G) refers to the analog mobile phone. The mobile phone function in the era of analog mobile phone is often limited to the call function, and is limited by various aspects of technology and materials. The style is quite simple and lacks change.

In 1994, Wu Jichuan, then Minister of the Ministry of Posts and Telecommunications, used Nokia 2110 to open the first GSM phone in Chinese history. China began the era of second-generation mobile phones (2G). The GSM network in the 2G era is a digital network. In addition to the basic call function, the mobile phone can start transmitting a small amount of text data. Thus the "short message" feature began to appear. The short message function makes up for the inconvenience or inaccessibility of people, which improves the user experience of mobile phones.

In the 1G era, the screens of mobile phones are still black and white, and the backlight is only green. The 2G era is an era in which mobile phone screens have undergone tremendous changes. In the late 1990s, due to the development of LED technology, the backlight source of mobile phone screens began to appear in different colors such as white, blue and orange. But in the end, the screen of the phone is still a single color. After entering the new century, liquid crystal technology and OLED technology have started to develop rapidly, and the mobile phone screen has opened the era of true color. With the technical foundation of color screens, the functions of mobile phones have begun to diversify, and various types of color pictures, color desktops, etc. Basic functions have been developed. The concept of cell phone photography was put into practice during this period. The highest display color of the screen has reached 20 million, and the display effect is clear enough to play high-quality videos or pictures, making the camera function an inseparable part of the phone.

The earliest mobile phone camera function is simply to put the camera function into the mobile phone. The camera function is isolated from the operating system of the mobile phone itself. The mobile phone operating system is limited to controlling whether the camera is photographed, as shown in Figure 1. At that time, the operating system (such as the classic Symbian Symbian system) could not perform various operations such as beautification, modification, etc., or only a limited number of limited image colors such as negative film, blue light, and black and white. Otherwise, the photos taken by the camera can only be processed as normal pictures in separate graphics processing software. The consumer experience is quite poor, the operation process is complicated, and time is wasted.

In the era of 3G, the operating system of mobile phones has undergone earth-shaking changes, and mobile phones have begun to install applications (APPs) by users themselves, thus providing a technical basis for the true integration of mobile phones and camera functions.

At present, Android (Andriod) system and Apple (iOS) system are the two giants of mobile operating software. The Android mobile phone has no threshold for programmers because of its open code. Anyone can develop and install application software by themselves. Therefore, the embedding of operating system and third-party software has become the trend of R&D.

For example, the common voice-activated camera function, as shown in Figure 2, establishes a control connection between the microphone and the camera through the central controller, and can control the shutter by speaking when taking a picture.

Image processing is another common feature fusion. On the one hand, in the camera software, the photos are completely beautified, decorated and shaded. On the other hand, in view of the need for photo retrieval and use by third-party software such as WeChat and QQ, all photos or pictures need to be provided. A corresponding preview image. Common photo aspect ratios are typically 4:3 (standard scale) or 16:9 (widened ratio). However, the ratio of the image during preview is not necessarily the same as the ratio of the photo at the time of shooting. A special preview function is required to process and extract the original photo.

At present, whether it is an Android mobile phone or an Apple mobile phone, its camera function is very important in the mobile phone, and it is also the most attractive place for customers, the richness of a product's camera and its extended functions, and the corresponding performance. The experience greatly affects the sales volume of the product and the choice of the customer, and ultimately determines whether the customer uses or continues to use the product. Therefore, it is very important to increase the camera function and improve the performance. In third-party applications, the square camera function has gradually become popular, and the 1:1 square camera function has been developed, which is different from the common 4:3. And the 16:9 mode camera function, and has a very good experience, occupying a very important role in the product. As shown in FIG. 3 , it is a schematic diagram of a process of converting from another preview mode to a 1:1 preview mode in the prior art, wherein two steps of S1 ' and S2 ' are the most occupied time, and the card phenomenon is prone to occur, which most affects the user experience. A step of.

Disclosure of invention

The object of the present invention is to provide a method and device for controlling square photo shooting with echo display, which is applied to mobile terminals such as mobile phones and tablet computers, which reduces the jamming during the switching preview, enriches the user's use selection, and improves the user experience.

A method for controlling a square photo shooting with echo, for a mobile phone originally having a rectangular photo preview function, including:

S1. When the mobile phone operating system receives the photographing instruction of the user, obtain a rectangular preview image of the current scene through the camera of the mobile phone and display it on the screen;

S2, occluding the rectangular preview image displayed on the screen, so that the visible area on the screen is a square;

S3. The user moves the square area to select and confirm a captured image;

S4, the screen display content is unchanged, the background crops the image captured by S3 according to the area selected by S2 and returns to the screen.

The above-mentioned method for controlling the square photo shooting of the echo, in addition to the step S4, further includes:

S5, compressing the image obtained by S4 to generate a jpeg/jpg image;

S6: The jpeg/jpg image data is fed back to the mobile phone operating system, and the image data is saved by the mobile phone operating system.

The above-mentioned method for controlling the square photographing of the echoes, before the step S1, further includes:

S0. Confirm that the current camera mode of the mobile phone is square viewfinder.

In the above-described step-by-step square photo shooting control method, in the step S3, it is confirmed that the shooting mode is a conventional button confirmation or a screen soft button touch confirmation or sound control.

Further, in order to enhance the interaction between the photographing function and other applications in the mobile phone, in accordance with the above-described echoed square photo shooting control method, the above-described method for controlling a square photo shooting with echo is described in After step S4, the method further includes:

S7. If the third party software needs to retrieve the photo data, the processing result of S4 is sent to the third party.

The above-mentioned method for controlling the square photographing of the echo, after the step S6, further includes:

S8. The third-party software provides information about the current location, the current time, and the current weather, and records the attribute information of the jpeg/jpg image;

S9. Display attribute information of the image in the jpeg/jpg image.

A photographing control device that controls the photographing process using any of the above methods, including:

An image sensor for acquiring an image to form a rectangular preview image described in step S1;

a viewfinder, connected to the image sensor, from which a square view is selected;

Shutter, connect to the viewfinder to confirm the photo taken;

The central processing unit crops the captured photos according to the selected area of the viewfinder and saves them;

The saved image is echoed back to the screen.

The above camera control device further includes:

Instantly buffering the postview buffer for caching the rectangular preview obtained in step S1;

Main buffer main buffer, storing the photos taken in step S3;

The data buffer is used to save the final square photo, which is obtained by cropping the photo in the main cache according to the area selected by the viewfinder.

In the above-mentioned photographing control device, the viewfinder is a software viewfinder that blocks a rectangular preview image with a black color block, and provides a square view in visual effect without actually cropping the photo.

A mobile phone comprising any of the above camera control devices.

The advantages and benefits of the present invention are:

(1) Better user experience;

(2) faster processing speed;

(3) More kinds of picture forms.

The user does not need to wait for switching between different camera modes in the process of taking pictures, because the preview image function does not need the "exit-re-enter" switch to take the next picture, which greatly reduces the need for the user to take pictures. The waiting time increases the user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. For those skilled in the art, other drawings may be obtained according to the contents of the embodiments of the present invention and the drawings without any creative work.

FIG. 1 is a schematic structural diagram of a method for controlling a photograph of a mobile phone in the prior art.

FIG. 2 is a second schematic structural diagram of a mobile phone photographing control method in the prior art.

FIG. 3 is a flow chart of a conventional switching preview mode.

Fig. 4 is a flow chart showing the manner of switching the preview in the present invention.

FIG. 5 is a schematic structural view of a square photographing control method in the present invention.

Fig. 6 is a schematic view showing the detailed structure of a square photographing control method in the present invention.

Figure 7 is a schematic illustration of the use of a buffer in the present invention.

Fig. 8 is a schematic structural view of a mobile phone in the present invention.

The best way to implement the invention

The present invention will be further described in detail below with reference to the accompanying drawings in detail.

As shown in FIG. 4, an echo-based square photo shooting control method can be applied to a mobile phone that originally has a rectangular photo preview function, and can of course be used alone. Adding a choice for taking a square photo to the mobile phone, and the method does not require the process of “stop first, then restart” in the prior art, and optimizes the program flow. include:

S1. When the mobile phone operating system receives the photographing instruction of the user, the image sensor 31 of the mobile phone acquires a rectangular preview image of the current scene and displays it on the screen 5;

S2, blocking the rectangular preview image displayed on the screen 5, so that the visible area on the screen 5 is a square;

S3. The user moves the square area to select and confirm a captured image;

S4, the screen 5 displays the content unchanged, and the background crops the image captured by S3 according to the area selected by S2 and returns to the screen 5.

Further, in order to completely and accurately save the acquired image, the image displayed on the screen 5 needs to be saved to the local storage. In the device, there are various storage forms, which can be jpeg/jpg, gif, bmp, and the like. On the basis of the above-mentioned method for controlling the photographing of the square photographing, the step S4 further includes:

S5, compressing the image obtained by S4 to generate a jpeg/jpg image;

The hardware structure of the mobile phone supporting steps S1 to S5 is as shown in FIG. 5. The central processing unit 2 inside the mobile phone 1 can control the camera 3 to take a picture. The control signal can be from a traditional button, a virtual button from the screen 5, or a control signal from the sound control software and the Bluetooth control software. The data of the YUV format obtained by photographing the camera 3 is preferably stored in the buffer group 6, which is advantageous for accelerating the processing time of the photo. The image processor 21 processes the photo data in the YUV format to obtain a square preview map return buffer group 6 buffer, and the obtained jpeg/jpg format picture is fed back to the central processing unit 2, and is arranged and saved by the central processing unit 2.

Further, in the prior art, a general mobile phone has a function of a rectangular preview. On the basis of this, adding the function of square photographing and previewing is equivalent to adding a branch in the original process. Before entering this branch, it must have the steps of judging and selecting the branch. After entering this branch, it can also confirm this. ,As shown in Figure 4. The above-mentioned method for controlling the square photographing of the echoes, before the step S1, further includes:

Further, based on the convergence trend of various application softwares, the mobile phone camera shutter can be diversified not only in the user's use requirements but also in the technical level. Traditionally, the phone's inherent volume button or power button or confirmation is the first choice for a mobile camera shutter, which is one of the shutter options that new technologies cannot give up. On this basis, after receiving the support of the mobile phone operating system, the rest of the input methods on the mobile phone can be used as the shutter of the mobile phone camera. The mobile phone camera and the third-party software use the mobile phone operating system as an interactive platform. As shown in FIG. 5, the control signals of the third-party software are connected to the central processing unit 2, and the central processor 2 forwards and controls the shutter 33 of the camera 3. In the above-described step S3, there is an echo-based square photo shooting control method. In the step S3, it is confirmed that the shooting mode is a conventional button confirmation or a screen 5 soft button touch confirmation or sound control or Bluetooth control.

Further, in order to enhance the interaction between the photographing function and other applications in the mobile phone, based on the above-described method for controlling the square photographing of the echo, the step of the step S4 may further include the following steps:

It should be particularly noted that in step S4, the photographed photo format is the YUV format, and YUV is a color encoding method adopted by the European television system. The importance of using the YUV color space is that its luminance signal Y and chrominance signals U, V are separated. The YUV format usually has two broad categories: a packed format and a planar format. The former stores the YUV components in the same array, usually several adjacent pixels form a macro-pixel; the latter uses three arrays to store the three components of the YUV separately, just like a three-dimensional plane. Regardless of the format, it is easy to digitally store in various types of electronic devices and its information volume is complete and specific. Therefore, the data in the YUV format is selected when transmitting to the third-party software in this step S7, so that the most original key information such as brightness and chromaticity can be retained.

In order to increase the interest of the photo and the surrounding information for the user to memorize the photo shooting, on the basis of the above-mentioned method for controlling the photographing of the square photographing, the step S6 may further include:

S9. Display attribute information of the image in the jpeg/jpg image.

A preferred solution is to perform text editing and landscaping on the information such as the location, time, and weather, and display the information in the lower right corner of the jpeg/jpg image.

As shown in FIG. 6, a photographing control device controls the photographing process using any of the above methods, and the image sensor 31 converts the light and color information into computer-recognizable electrical signals and digitizes them, and then stores them in the buffer group 6. The viewfinder 32 is a software viewfinder, and uses a software to manufacture a frame which is square transparent in the middle and black and opaque on both sides, and is superimposed on the image sensor 31 so that the image seen by the user is square.

include:

The image sensor 31 is configured to collect an image to form a rectangular preview image described in step S1;

a viewfinder 32 connected to the image sensor 31 and selecting a square view therefrom;

a shutter 33 connected to the viewfinder 32 to confirm the photograph;

The central processing unit 2 crops the captured photos according to the selected area of the viewfinder 32 and saves them;

The saved picture is echoed on screen 5.

As shown in FIG. 7, the above-mentioned photographing control device caches photos in the buffer group 6 during shooting, and finally The square photos are fed back to the operating system after confirmation and saved by the operating system to system memory. include:

a cache view 61 (postview buffer) for buffering the rectangular preview obtained in step S1;

a main buffer 62 (main buffer), storing the photos taken in step S3;

A data buffer 63 is used to save the final square photo, which is obtained by cropping the photo in the main buffer according to the area selected by the viewfinder 32.

Further, in the above-mentioned photographing control device, the viewfinder 32 is a software viewfinder that blocks a rectangular preview image with a black color block, and provides a square view in visual effect without actually cropping the photo.

Further, the above-mentioned camera control device can be applied to a plurality of mobile terminals having an operating system, such as a mobile phone or a tablet computer or a personal digital assistant, in addition to being applied to the mobile phone of the present invention. It should be specially noted that different specific programs may need to be written based on the language and file format used by different operating systems, but this should not affect the versatility of the method described in the present invention. Just as the present invention is based on the processing program compiled by the Android system, if the same function needs to be transplanted into the Apple system, only adaptive modification is required, and the modification should not be regarded as creative.

In the Android system, when running a camera application, the interaction between the camera application layer, the camera application framework layer, the camera hardware abstraction layer, and the driver layer is generally required. The initiator finds the resources of the camera application in the camera application layer, obtains the startup entry, and sequentially executes the Java code in the virtual machine for parsing and execution, and sequentially calls the interface of the camera frame layer, the interface and the driver layer of the camera hardware abstraction layer in the execution process. Drive interface. Among them, the camera application layer is a program written in the Java language and running on the camera virtual machine. Enabling the camera app requires launching the camera virtual machine. When the user takes a photo through the mobile terminal, the camera application layer issues a corresponding photographing instruction (take picture instruction), which is transmitted to the camera hardware abstraction layer via the Camera API and CameraService of the camera frame layer. When the camera hardware abstraction layer receives the photographing instruction, the camera is called to take a photo, and the driving layer saves the image data collected by the camera.

The camera hardware abstraction layer of the mobile terminal acquires image data collected by the camera from the driver layer, and transmits the image data to the camera application layer via the Camera API and the CameraService of the camera frame layer, and the camera application layer generates and displays the image data according to the image data. The corresponding picture.

A mobile phone as shown in FIG. 8 includes any of the above-described photographing control devices. The mobile phone 1 in this embodiment includes a central processing unit 2, a camera 3, a screen 5, a buffer group 6, and a memory. Central processor 2 according to the method of the invention Control camera 3, screen 5, buffer group 6 and memory, allowing the integration between different components to occupy only a small amount of system time, thereby saving system resources and customer waiting time.

The technical solution of the present invention is described in detail above with reference to the accompanying drawings. The present invention proposes a new method for controlling the square photographing, which causes a square view by occlusion of the screen display, effectively avoids the pause caused by switching the preview, and improves the preview. Speed, optimize the camera process and effects, thus improving the user experience.

Although the present invention has been described in detail by the preferred embodiments thereof, it should be understood that the foregoing description should not be construed as limiting. Various modifications and alterations of the present invention will be apparent to those skilled in the art. Therefore, the scope of the invention should be defined by the appended claims.

Claims

A method for controlling a square photo shooting with echo, for a mobile phone having a rectangular photo preview function, comprising:

S1. When the mobile phone operating system receives the photographing instruction of the user, obtain a rectangular preview image of the current scene through the camera of the mobile phone and display it on the screen;

S2, occluding the rectangular preview image displayed on the screen, so that the visible area on the screen is a square;

S3. The user moves the square area to select and confirm a captured image;

S4, the screen display content is unchanged, the background crops the image captured by S3 according to the area selected by S2 and returns to the screen.
The method for controlling the photographing of a square photograph with the echo according to claim 1, wherein after the step S4, the method further comprises:

S5, compressing the image obtained by S4 to generate a jpeg/jpg image;

S6: The jpeg/jpg image data is fed back to the mobile phone operating system, and the image data is saved by the mobile phone operating system.
The method for controlling the photographing of a square photograph with the echo according to claim 1, wherein before the step S1, the method further comprises:

S0. Confirm that the current camera mode of the mobile phone is square viewfinder.
The echo-photographed square photographing control method according to claim 1, wherein in the step S3, the manner of confirming the photographing is a conventional button confirmation or a screen soft-key touch confirmation or sound control.
The method for controlling the photographing of a square photograph with the echo according to claim 1, wherein after the step S4, the method further comprises:

S7. If the third party software needs to retrieve the photo data, the processing result of S4 is sent to the third party.
The method of claim 2, wherein after the step S6, the method further comprises:

S8. The third-party software provides information about the current location, the current time, and the current weather, and records the attribute information of the jpeg/jpg image;

S9. Display attribute information of the image in the jpeg/jpg image.
A photographing control device, characterized in that the photographing process is controlled using any one of the methods as claimed in claims 1 to 6, comprising:

An image sensor for acquiring an image to form a rectangular preview image described in step S1;

a viewfinder, connected to the image sensor, from which a square view is selected;

Shutter, connect to the viewfinder to confirm the photo taken;

The central processing unit crops the captured photos according to the selected area of the viewfinder and saves them;

The saved image is echoed back to the screen.
A camera control device according to claim 7, further comprising:

Instantly buffering the postview buffer for caching the rectangular preview obtained in step S1;

Main buffer main buffer, storing the photos taken in step S3;

The data buffer is used to save the final square photo, which is obtained by cropping the photo in the main cache according to the area selected by the viewfinder.
A photographing control device according to claim 7, wherein the viewfinder is a software viewfinder that blocks a rectangular preview image with a black color block, and provides a square view in a visual effect without actually cropping the photo.
A mobile phone characterized by comprising the photographing control device according to any one of claims 7 to 9.