CN109743504B

CN109743504B - Auxiliary photographing method, mobile terminal and storage medium

Info

Publication number: CN109743504B
Application number: CN201910059150.2A
Authority: CN
Inventors: 郭彦博
Original assignee: Nubia Technology Co Ltd
Current assignee: Nubia Technology Co Ltd
Priority date: 2019-01-22
Filing date: 2019-01-22
Publication date: 2022-02-22
Anticipated expiration: 2039-01-22
Also published as: CN109743504A

Abstract

The disclosure relates to an auxiliary photographing method, a storage medium and a mobile terminal. The method comprises the following steps: acquiring a posture template image, and extracting a figure posture contour line from the posture template image; shooting a target background picture, and placing the extracted figure posture contour line in a preset position of the target background picture; extracting a reference object contour line in the target background picture and the corresponding character posture contour line; superposing the reference object contour line and the character posture contour line on a view frame of a camera; and respectively carrying out similarity judgment on the superposed reference object contour line and the superposed character posture contour line and the reference object contour line and the character posture contour line in the actual image in the viewing frame, and displaying prompt information for indicating adjustment shooting when the similarity is lower than a preset threshold value. The method and the device can enable a photographer without photographic experience and a photographed person to better cooperate to photograph an ideal photo.

Description

Auxiliary photographing method, mobile terminal and storage medium

Technical Field

The present disclosure relates to the field of mobile device technologies, and in particular, to a method for assisting photographing, a mobile terminal, and a storage medium.

Background

Many people cannot pose when facing the lens, so that the photographing effect is not ideal. In the related art, some applications are built with some reference photographing gestures and are placed in a view-finding frame in a simple stroke mode so as to facilitate the posture of a photographed person and the composition of the photographed person. However, there are two problems with such an approach: on the other hand, the mobile phone is in the hands of the photographer, and the photographer cannot see the posture reference on the mobile phone view frame when the photographer is in the posture, so that the posture is not easy to adjust. For the photographer, unless an experienced photographer is concerned, the photographer is often inattentive to know the adjustment posture of the photographer, the distance between the photographer and the photographer, and the like, and is not clear, so that the effect of the final photographing is not ideal, and on the other hand, the posture sample given in the application is limited, and the photographing posture desired by the user may not be available. Therefore, there is a need to provide a new technical solution to improve one or more of the problems in the above solutions.

It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.

Disclosure of Invention

An object of the present disclosure is to provide a photographing assisting method, a mobile terminal, and a storage medium, thereby overcoming, at least to some extent, one or more problems due to limitations and disadvantages of the related art.

According to a first aspect of the embodiments of the present disclosure, there is provided an auxiliary photographing method, including:

acquiring a posture template image, and extracting a figure posture contour line from the posture template image;

shooting a target background picture, and placing the extracted figure posture contour line in a preset position of the target background picture;

extracting a reference object contour line in the target background picture and the corresponding character posture contour line;

superposing the reference object contour line and the character posture contour line on a view frame of a camera;

and respectively carrying out similarity judgment on the superposed reference object contour line and the superposed character posture contour line and the reference object contour line and the character posture contour line in the actual image in the viewing frame, and displaying prompt information for indicating adjustment shooting when the similarity is lower than a preset threshold value.

In an embodiment of the present disclosure, the step of obtaining an image of a gesture template includes:

and responding to a preset operation to select a corresponding gesture template image from the photo album.

In an embodiment of the present disclosure, the step of extracting a human pose contour line from the pose template image includes:

and recognizing the person and the background in the gesture template image so as to extract a person gesture outline.

In an embodiment of the disclosure, the person and the background in the gesture template image are identified through an image identification algorithm.

In an embodiment of the present disclosure, the step of superimposing the reference object contour line and the person posture contour line on a finder frame of a camera includes:

and superposing the reference object contour line and the character posture contour line on a view frame of the camera in a semitransparent mode.

In the embodiment of the present disclosure, the step of respectively determining the similarity between the superimposed reference object contour line and the superimposed character posture contour line and the reference object contour line and the character posture contour line in the actual image in the finder frame includes:

acquiring a reference object contour line and a figure posture contour line in the current actual image in the view-finding frame;

and respectively carrying out similarity judgment on the superposed reference object contour line and the superposed character posture contour line and the reference object contour line and the character posture contour line in the current actual image in the view frame through an image similarity algorithm.

In an embodiment of the present disclosure, the prompt information includes information indicating that the subject adjusts the posture.

In an embodiment of the present disclosure, the prompt information includes information instructing a photographer to adjust a shooting angle and/or direction.

According to a second aspect of the embodiments of the present disclosure, there is provided a mobile terminal including:

a processor; and

a memory for storing a computer program operable on the processor;

wherein the computer program, when executed by the processor, implements the steps of a method for assisting photographing as described in any of the above embodiments.

According to a third aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the steps of a method for assisting photographing as described in any one of the above embodiments.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects:

in an embodiment of the disclosure, a user can randomly select a posture template image according to a posture that the user wants to shoot, and can place a person posture contour line extracted from the posture template image in a target background picture, so that a shot person can finish composition of a picture in advance before shooting. In addition, by superimposing the contour line of the reference object in the extracted target background picture and the corresponding contour line of the human posture on the finder frame of the camera and displaying a prompt message instructing to adjust the shooting, the photographer who has no shooting experience can adjust the position of the finder frame according to the contour line and instruct the photographer to adjust the posture so as to take an ideal picture.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

Fig. 1 schematically illustrates a hardware configuration diagram of a mobile terminal in an exemplary embodiment of the present disclosure;

fig. 2 schematically illustrates a communication network system architecture diagram in an exemplary embodiment of the disclosure;

FIG. 3 schematically illustrates a flow chart of a method of assisted photographing in an exemplary embodiment of the present disclosure;

fig. 4 schematically illustrates a schematic diagram of an auxiliary photographing apparatus in an exemplary embodiment of the present disclosure;

fig. 5 schematically illustrates a computer-readable storage medium in an exemplary embodiment of the disclosure.

Detailed Description

Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.

Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.

In the following description, suffixes such as "module", "component", or "unit" used to denote elements are used only for facilitating the explanation of the present invention, and have no specific meaning in itself. Thus, "module", "component" or "unit" may be used mixedly.

The terminal may be implemented in various forms. For example, the terminal described in the present invention may include a mobile terminal such as a mobile phone, a tablet computer, a notebook computer, a palmtop computer, a Personal Digital Assistant (PDA), a Portable Media Player (PMP), a navigation device, a wearable device, a smart band, a pedometer, and the like, and a fixed terminal such as a Digital TV, a desktop computer, and the like.

The following description will be given by way of example of a mobile terminal, and it will be understood by those skilled in the art that the construction according to the embodiment of the present invention can be applied to a fixed type terminal, in addition to elements particularly used for mobile purposes.

Referring to fig. 1, which is a schematic diagram of a hardware structure of a mobile terminal for implementing various embodiments of the present invention, the mobile terminal 100 may include: RF (Radio Frequency) unit 101, WiFi module 102, audio output unit 103, a/V (audio/video) input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, processor 110, and power supply 111. Those skilled in the art will appreciate that the mobile terminal architecture shown in fig. 1 is not intended to be limiting of mobile terminals, which may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components.

The following describes each component of the mobile terminal in detail with reference to fig. 1:

the radio frequency unit 101 may be configured to receive and transmit signals during information transmission and reception or during a call, and specifically, receive downlink information of a base station and then process the downlink information to the processor 110; in addition, the uplink data is transmitted to the base station. Typically, radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 can also communicate with a network and other devices through wireless communication. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System for Mobile communications), GPRS (General Packet Radio Service), CDMA2000(Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division duplex Long Term Evolution), and TDD-LTE (Time Division duplex Long Term Evolution).

WiFi belongs to short-distance wireless transmission technology, and the mobile terminal can help a user to receive and send e-mails, browse webpages, access streaming media and the like through the WiFi module 102, and provides wireless broadband internet access for the user. Although fig. 1 shows the WiFi module 102, it is understood that it does not belong to the essential constitution of the mobile terminal, and may be omitted entirely as needed within the scope not changing the essence of the invention.

The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the mobile terminal 100 is in a call signal reception mode, a call mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, and the like.

The a/V input unit 104 is used to receive audio or video signals. The a/V input Unit 104 may include a Graphics Processing Unit (GPU) 1041 and a microphone 1042, the Graphics processor 1041 Processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphic processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 may receive sounds (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, or the like, and may be capable of processing such sounds into audio data. The processed audio (voice) data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 101 in case of a phone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting audio signals.

The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor that can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and a proximity sensor that can turn off the display panel 1061 and/or a backlight when the mobile terminal 100 is moved to the ear. As one of the motion sensors, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally, three axes), can detect the magnitude and direction of gravity when stationary, and can be used for applications of recognizing the posture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer and tapping), and the like; as for other sensors such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, and an infrared sensor, which can be configured on the mobile phone, further description is omitted here.

The display unit 106 is used to display information input by a user or information provided to the user. The Display unit 106 may include a Display panel 1061, and the Display panel 1061 may be configured in the form of a Liquid Crystal Display (LCD), an Organic Light-Emitting Diode (OLED), or the like.

The user input unit 107 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the mobile terminal. Specifically, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect a touch operation performed by a user on or near the touch panel 1071 (e.g., an operation performed by the user on or near the touch panel 1071 using a finger, a stylus, or any other suitable object or accessory), and drive a corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, sends the touch point coordinates to the processor 110, and can receive and execute commands sent by the processor 110. In addition, the touch panel 1071 may be implemented in various types, such as a resistive type, a capacitive type, an infrared ray, and a surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may include other input devices 1072. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and the like, and are not limited to these specific examples.

Further, the touch panel 1071 may cover the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or nearby, the touch panel 1071 transmits the touch operation to the processor 110 to determine the type of the touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of the touch event. Although the touch panel 1071 and the display panel 1061 are shown in fig. 1 as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, and is not limited herein.

The interface unit 108 serves as an interface through which at least one external device is connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from external devices and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and external devices.

The memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a sound playing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, a phonebook, etc.) created according to the use of the cellular phone, and the like. Further, the memory 109 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 110 is a control center of the mobile terminal, connects various parts of the entire mobile terminal using various interfaces and lines, and performs various functions of the mobile terminal and processes data by operating or executing software programs and/or modules stored in the memory 109 and calling data stored in the memory 109, thereby performing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The mobile terminal 100 may further include a power supply 111 (e.g., a battery) for supplying power to various components, and preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system.

Although not shown in fig. 1, the mobile terminal 100 may further include a bluetooth module or the like, which is not described in detail herein.

In order to facilitate understanding of the embodiments of the present invention, a communication network system on which the mobile terminal of the present invention is based is described below.

Referring to fig. 2, fig. 2 is an architecture diagram of a communication Network system according to an embodiment of the present invention, where the communication Network system is an LTE system of a universal mobile telecommunications technology, and the LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203, and an IP service 204 of an operator, which are in communication connection in sequence.

Specifically, the UE201 may be the terminal 100 described above, and is not described herein again.

The E-UTRAN202 includes eNodeB2021 and other eNodeBs 2022, among others. Among them, the eNodeB2021 may be connected with other eNodeB2022 through backhaul (e.g., X2 interface), the eNodeB2021 is connected to the EPC203, and the eNodeB2021 may provide the UE201 access to the EPC 203.

The EPC203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving gateway) 2034, a PGW (PDN gateway) 2035, and a PCRF (Policy and Charging Rules Function) 2036, and the like. The MME2031 is a control node that handles signaling between the UE201 and the EPC203, and provides bearer and connection management. HSS2032 is used to provide registers to manage functions such as home location register (not shown) and holds subscriber specific information about service characteristics, data rates, etc. All user data may be sent through SGW2034, PGW2035 may provide IP address assignment for UE201 and other functions, and PCRF2036 is a policy and charging control policy decision point for traffic data flow and IP bearer resources, which selects and provides available policy and charging control decisions for a policy and charging enforcement function (not shown).

The IP services 204 may include the internet, intranets, IMS (IP Multimedia Subsystem), or other IP services, among others.

Although the LTE system is described as an example, it should be understood by those skilled in the art that the present invention is not limited to the LTE system, but may also be applied to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA, and future new network systems.

Based on the above mobile terminal hardware structure and communication network system, the present invention provides various embodiments of the method.

The exemplary embodiment first provides an auxiliary photographing method, which may be applied to a terminal device with a display screen, for example, a mobile terminal such as a mobile phone, a personal digital assistant, a notebook computer, a tablet computer, and the like. Referring to fig. 3, the method may include:

step S301, acquiring a posture template image, and extracting a figure posture contour line from the posture template image;

step S302, shooting a target background picture, and placing the extracted character posture contour line in a preset position of the target background picture;

step S303, extracting a reference object contour line in the target background picture and the corresponding character posture contour line;

step S304, the contour line of the reference object and the contour line of the character posture are superposed on a view frame of a camera;

step S305, respectively carrying out similarity judgment on the superposed reference object contour line and the superposed character posture contour line and the reference object contour line and the character posture contour line in the actual image in the viewfinder frame, and displaying prompt information for instructing adjustment shooting when the similarity is lower than a preset threshold value.

By the method, the user can randomly select the posture template image according to the posture desired by the user, and the person posture contour line extracted from the posture template image can be placed in the target background picture, so that the photographer can finish composition of the picture in advance before shooting. In addition, the contour line of the reference object in the extracted target background picture and the corresponding figure posture contour line are superposed on the view frame of the camera, and prompt information for instructing adjustment shooting is displayed, so that a photographer without shooting experience can adjust the position of the view frame according to the contour line and instruct a photographer to adjust the posture, and an ideal picture can be shot.

Next, the respective steps of the above-described method in the present exemplary embodiment will be described in more detail with reference to fig. 3.

In step S301, the gesture template image may be a photo or a picture saved by the user, and the user may store a favorite photo gesture picture in an album of the mobile terminal in advance when browsing a web page, a microblog, a blog, a circle of friends, and the like.

In one embodiment, before taking a picture, a user selects a gesture template image to be taken from an album, software on the mobile terminal is used for extracting a figure gesture outline in the gesture template image, and the extracted figure outline is stored in the album of the mobile terminal or other picture taking applications, specifically, the extraction software can be matting software or picture editing software, and the color of the figure gesture outline can be selected by the user.

In step S302, the user may first photograph a desired target background, and store the photographed target background picture in the album, and then open the target background picture by using a picture editing application program, and place the character gesture contour line extracted in the previous step in a preset position of the target background picture, where the preset position is a position defined by the user. Specifically, the character gesture contour line can be wholly enlarged or reduced according to the target background so as to ensure that the whole composition is more harmonious.

In step S303, after the position of the human posture contour line in the target background pattern piece is adjusted, the software on the mobile terminal may be used to extract the reference object contour line in the target background picture and the corresponding human posture contour line, and record the reference object contour line data in the target background picture as Bg and the human posture contour line data as Fg.

In a specific example, the reference object in the target background picture may be a natural landscape, a fixed building, a background of other objects, and the like. The extraction software is the same as the extraction software in step S301, and may be matting software or picture editing software, and similarly, the reference object contour line in the target background picture and the color of the corresponding character posture contour line may be selected by the user.

In step S304, the camera of the mobile terminal is opened, and the reference object contour line and the person posture contour line are superimposed on the finder frame of the camera. At this time, the photographer can adjust the position of the finder frame or instruct the subject to adjust the posture so that the reference object contour line and the person posture contour line coincide with the reference object contour line and the person posture contour line in the actual image in the finder frame.

In step S305, the reference object contour line data in the actual image in the viewfinder frame may be recorded as Bg1, the person posture contour line data may be recorded as Fg1, then Bg and Bg1 are compared in shape, Fg and Fg1 are compared in similarity, and when the similarity between any one or two values is lower than a preset threshold, the photographing interface of the mobile terminal displays a prompt message indicating adjustment of photographing, and the prompt message may be played in a voice form, which is more convenient for the subject to adjust his/her posture.

Wherein the preset threshold is the lowest value of the similarity comparison between Bg and Bg1 or between Fg and Fg 1. For example, in one embodiment, if the preset threshold is 80%, the comparison is performed, if the similarity between Bg and Bg1 is lower than 80%, the prompt message for adjusting the shooting is displayed, and if the similarity between Fg and Fg1 is lower than 80%, the prompt message for adjusting the shooting is also displayed. The prompting information also enables the photographer and the photographed person to adjust the posture more easily, and brings convenience to the user. The specific prompting information content is different according to the similarity of Bg and Bg1 or Fg and Fg 1.

In an embodiment, based on the foregoing embodiment, the step of acquiring an image of a gesture template further includes the following steps:

step S3011, selecting a corresponding gesture template image from the album in response to a preset operation.

Optionally, the preset operation may be in the form of: the photo application interface can jump to the control of the photo album, and the photo application interface can also jump to the control of the photo album in the picture editing application program interface. For example, when a user wants to take a picture, the user may click a control in the photo application interface, which may jump to the album, and then enter the album to select a desired gesture template image, which is to select a corresponding gesture template image from the album in response to a preset operation.

In an embodiment, based on the foregoing embodiment, the step of extracting a human pose contour line from the pose template image further includes the following steps:

in step S3012, a person and a background in the gesture template image are recognized, and a person gesture contour line is extracted.

To extract a person posture contour line from a posture template image, firstly, a person and a background in the posture template image need to be recognized, otherwise, the extracted person posture contour line is inaccurate.

In an embodiment, the person and background in the gesture template image may be identified through an image recognition algorithm. Image recognition refers to a technique of processing, analyzing, and understanding an image to recognize various different patterns of objects and objects. At present, the main image recognition methods include an image recognition method based on a neural network, an image recognition method based on a wavelet moment, and the like. In a specific embodiment, image recognition software can be installed on the mobile terminal to recognize the person and the background in the gesture template image.

In an embodiment, based on the foregoing embodiment, the step of superimposing the reference object contour line and the person posture contour line on the finder frame of the camera further includes the following steps:

step S3041 of superimposing the reference object contour line and the person posture contour line on a finder frame of a camera in a semi-transparent manner.

The semi-transparent superposition mode is enough to enable a photographer to see the reference object contour line and the character posture contour line clearly, and on the other hand, the photographer cannot be influenced to see the current actual image in the view frame clearly.

In an embodiment, based on the foregoing embodiment, the step of performing similarity determination on the superimposed reference object contour line and person posture contour line and the reference object contour line and person posture contour line in the actual image in the finder frame respectively further includes the following steps:

step S3051, acquiring a reference object contour line and a figure posture contour line in a current actual image in the view-finding frame;

in this step, the manner of obtaining the reference object contour line and the person posture contour line in the current actual image in the finder frame is the same as the manner of extracting the person posture contour line in the previous step, and it is also necessary to identify the reference object and the person in the current actual image by an image recognition algorithm, and then extract the contour lines of the reference object and the person posture.

And S3052, respectively judging the similarity of the superposed reference object contour line and the superposed character posture contour line with the reference object contour line and the superposed character posture contour line in the current actual image in the view frame through an image similarity algorithm.

In the previous step, the superimposed reference object contour line data in the target background picture is denoted by Bg, the person posture contour line data is denoted by Fg, the reference object contour line data in the actual image in the finder frame is denoted by Bg1, and the person posture contour line data is denoted by Fg 1. In the step, Bg and Bg1 are directly subjected to similarity comparison, Fg and Fg1 are subjected to similarity comparison, and when any one or both of the two comparison values are lower than the preset threshold, the mobile terminal photographing interface pops up prompt information.

In an embodiment, the prompt information includes information indicating that the subject adjusts the posture. When the similarity value between Bg and Bg1 is lower than the preset threshold, the mobile terminal photographing interface pops up information indicating the adjustment posture of the photographed person, for example, similar prompts such as "head left bias", "right hand lift", "left leg forward", "turn right", etc. appear.

In an embodiment, based on the foregoing embodiment, the prompt message includes information instructing the photographer to adjust the shooting angle and/or direction. When the similarity value of Fg and Fg1 is lower than the preset threshold, the mobile terminal photographing interface pops up information indicating the adjustment posture of the photographer, for example, similar prompts such as "raise screen", "lower screen", "move screen left", "move screen right", "tilt screen down 15 degrees" appear.

It should be noted that although the various steps of the methods of the present disclosure are depicted in the drawings in a particular order, this does not require or imply that these steps must be performed in this particular order, or that all of the depicted steps must be performed, to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step execution, and/or one step broken down into multiple step executions, etc. Additionally, it will also be readily appreciated that the steps may be performed synchronously or asynchronously, e.g., among multiple modules/processes/threads.

Further, in the present exemplary embodiment, an auxiliary photographing apparatus is also provided. Referring to fig. 4, the apparatus 400 may include a first contour line extraction module 401, a photographing module 402, a second contour line extraction module 403, a superimposition module 404, and a determination module 405. Wherein:

a first contour line extraction module 401, configured to obtain a pose template image, and extract a person pose contour line from the pose template image;

a photographing module 402, configured to photograph a target background picture, and place the extracted character pose contour line in a preset position of the target background picture;

a second contour line extraction module 403, configured to extract a reference object contour line in the target background picture and the corresponding person posture contour line;

a superimposing module 404, configured to superimpose the reference object contour line and the person posture contour line on a viewfinder frame of a camera;

a judging module 405, configured to perform similarity judgment on the superimposed reference object contour line and the superimposed character pose contour line and the reference object contour line and the character pose contour line in the actual image in the viewfinder respectively, and display a prompt message indicating adjustment shooting when the similarity is lower than a preset threshold.

In one embodiment, the apparatus further comprises:

and the response module is used for responding a preset operation to select a corresponding gesture template image from the photo album.

In one embodiment, the first contour line extraction module includes:

and the recognition module is used for recognizing the person and the background in the gesture template image so as to extract the person gesture outline.

In one embodiment, the superimposing module is further configured to superimpose the reference object contour line and the person pose contour line on a viewfinder frame of the camera in a semi-transparent manner.

In one embodiment, the determining module comprises:

the first judgment module is used for acquiring a reference object contour line and a figure posture contour line in the current actual image in the view-finding frame;

and the second judgment module is used for respectively judging the similarity of the superposed reference object contour line and the superposed person posture contour line with the reference object contour line and the person posture contour line in the current actual image in the view-finding frame through an image similarity algorithm.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units. The components shown as modules or units may or may not be physical units, i.e. may be located in one place or may also be distributed over a plurality of network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the wood-disclosed scheme. One of ordinary skill in the art can understand and implement it without inventive effort.

In an exemplary embodiment of the present disclosure, a computer-readable storage medium is further provided, on which a computer program is stored, which, when being executed by at least one processor, for example, can implement the steps of a method for assisting photographing as described in any one of the above embodiments. In some possible embodiments, aspects of the invention may also be implemented in the form of a program product comprising program code means for causing a terminal device to carry out the steps according to various exemplary embodiments of the invention described in the aforementioned one of the methods of assisted photographing section of this specification, when said program product is run on the terminal device.

Referring to fig. 5, a program product 300 for implementing the above method according to an embodiment of the present invention is described, which may employ a portable compact disc read only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a mobile phone. However, the program product of the present invention is not limited in this regard and, in the present document, a readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium include: an electrical connection having one or more wires, a portable disk, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer readable storage medium may include a propagated data signal with readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A readable storage medium may also be any readable medium that is not a readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a readable storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

Program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).

In an exemplary embodiment of the present disclosure, there is also provided an electronic device, which may include a processor, and a memory for storing executable instructions of the processor. Wherein the processor is configured to execute the steps of the method for assisting photographing in any one of the above embodiments via execution of the executable instructions.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present invention.

While the present invention has been described with reference to the embodiments shown in the drawings, the present invention is not limited to the embodiments, which are illustrative and not restrictive, and it will be apparent to those skilled in the art that various changes and modifications can be made therein without departing from the spirit and scope of the invention as defined in the appended claims.

Claims

1. An auxiliary photographing method is characterized by comprising the following steps:

shooting a target background picture, and placing the extracted character posture contour line in a preset position of the target background picture, wherein the preset position is a self-defined position;

2. The method of claim 1, wherein the step of obtaining a pose template image comprises:

3. The method of claim 1, wherein the step of extracting the person's gesture outline from the gesture template image comprises:

4. The method of claim 3, wherein the person and background in the gesture template image are identified by an image recognition algorithm.

5. The method of claim 1, wherein the step of superimposing the reference object contour line and the person pose contour line on a camera's view frame comprises:

6. The method according to claim 5, wherein the step of performing similarity determination on the superimposed reference object contour line and person posture contour line and the reference object contour line and person posture contour line in the actual image in the finder frame, respectively, comprises:

7. The method according to any one of claims 1 to 6, wherein the prompt information includes information indicating that the subject has adjusted the posture.

8. The method according to claim 7, wherein the prompt message includes information instructing the photographer to adjust a photographing angle and/or direction.

9. A mobile terminal, comprising:

a processor; and

a memory for storing a computer program operable on the processor;

wherein the computer program when executed by the processor implements the steps of a method of assisting photographing as claimed in any one of claims 1 to 8.

10. A computer-readable storage medium, on which a computer program is stored, the computer program, when being executed by at least one processor, implementing the steps of a method for assisting photographing according to any one of claims 1 to 8.