CN113485621B - Image capturing method, device, electronic equipment and storage medium - Google Patents

Abstract

The present application discloses an image capture method, device, electronic device and storage medium, which belongs to the field of interface interaction technology. The image capture method includes: receiving N manipulation inputs of a user on a display interface; in response to the N manipulation inputs, generating N manipulation text information corresponding to the N manipulation inputs; wherein the manipulation text information includes text information corresponding to at least one of the input mode, input position and trigger component; taking screenshots of M interfaces corresponding to the N manipulation inputs to obtain M images; and displaying the N manipulation text information and the M images in association; wherein N and M are positive integers.

Description

Image capture method, device, electronic device and storage medium

Technical Field

The present application belongs to the field of interface interaction technology, and specifically relates to an image capture method, device, electronic device and storage medium.

Background technique

With the popularization of smart electronic devices, people are increasingly using the screen content capture function on smart electronic devices to capture images or videos to record the interface content on the screen.

In the prior art, the screen content capture method of an electronic device is mainly to manually trigger the screenshot process of the current screen display interface through the user's preset operation, and this screenshot method is mainly used to record the static screen display interface and cannot intuitively reflect the user's dynamic operation process. Therefore, if the user needs to record a dynamic operation process through the screen content capture function, it can only be recorded through screen recording.

However, since the video content captured by traditional screen recording methods is highly aggregated, for a long video, if the user needs to view a certain key content in the video, he needs to manually search for the content in the video, which makes the process of viewing the key content more cumbersome and unable to quickly obtain the key content from the screen recording results.

Summary of the invention

The purpose of the embodiments of the present application is to provide an image capture method, device, electronic device and storage medium, which can solve the problem that the traditional screenshot method cannot intuitively reflect the user's dynamic operation process, and when using the traditional screen recording method to record the user's dynamic operation process, it is impossible to quickly obtain key content from the screen recording results.

In a first aspect, an embodiment of the present application provides an image capture method, the method comprising:

Receive N control inputs from the user on the display interface;

In response to the N manipulation inputs, N manipulation text information corresponding to the N manipulation inputs is generated; wherein the manipulation text information includes text information corresponding to at least one of an input mode, an input position, and a trigger component;

Taking screenshots of M interfaces corresponding to the N control inputs to obtain M images;

Displaying the N manipulation text information and the M images in association with each other;

Wherein, N and M are positive integers.

In a second aspect, an embodiment of the present application provides an image capture device, the device comprising:

An input receiving module, used to receive N control inputs from the user on the display interface;

An information generation module, configured to generate N manipulation text information corresponding to the N manipulation inputs in response to the N manipulation inputs; wherein the manipulation text information includes at least one of the input mode, input position and trigger component;

An interface screenshot module, used to take screenshots of the M interfaces corresponding to the N control inputs to obtain M images;

An associated display module, used for associated display of the N manipulation text information and the M images;

Wherein, N and M are positive integers.

In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor, a memory, and a program or instruction stored in the memory and executable on the processor, wherein the program or instruction, when executed by the processor, implements the steps of the method described in the first aspect.

In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

In an embodiment of the present application, when recording the user's dynamic operation process, in addition to taking automatic screenshots, a plain text recording mode is also provided, that is, N control text information corresponding to the user's N operation inputs are generated, and the N control text information is associated with M images for display. In this way, since the control text information records the user's operation input in plain text form, it can reflect the logic between images, so that when the control text information and the corresponding image are displayed in association, the user's dynamic operation process can be intuitively reflected. In addition, since the control text information can describe the key content of the user's operation and is displayed in association with the corresponding image, the control text information can be used as a text index to help the user quickly find the image of the key content when the user views the interception result, so that the user can quickly obtain the key content in the interception result.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG1 is a flowchart of a method for capturing an image according to an exemplary embodiment;

Fig. 2a is one of schematic diagrams showing an image capture scene according to an exemplary embodiment;

Fig. 2b is a second schematic diagram of an image capture scene according to an exemplary embodiment;

Fig. 2c is a third schematic diagram of an image capture scene according to an exemplary embodiment;

FIG3 is a second flowchart of an image capture method according to an exemplary embodiment;

Fig. 4 is a schematic diagram of one of image display scenes according to an exemplary embodiment;

Fig. 5 is a second schematic diagram of an image display scene according to an exemplary embodiment;

FIG6a is a third flowchart of an image capture method according to an exemplary embodiment;

Fig. 6b is a schematic diagram showing an image annotation display scene according to an exemplary embodiment;

FIG7 is a structural block diagram of an image capture device according to an exemplary embodiment;

FIG8 is a structural block diagram of an electronic device according to an exemplary embodiment;

FIG. 9 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

Detailed ways

The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

The terms "first", "second", etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and/or" in the specification and claims represents at least one of the connected objects, and the character "/" generally indicates that the objects associated with each other are in an "or" relationship.

The image capture method, device, electronic device and storage medium provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

The image capture method provided by the present application can be applied to the scenario of recording the dynamic changes of the content displayed on the screen interface during the dynamic operation of the user. In addition, the image capture method provided by the embodiment of the present application can be executed by an image capture device, or a control module in the image capture device for executing the image capture method. In the embodiment of the present application, the image capture method provided by the embodiment of the present application is explained by taking the execution of the image capture method by the image capture device as an example.

Fig. 1 is a flow chart showing an image interception method according to an exemplary embodiment.

As shown in FIG1 , the image interception method may include the following steps:

Step 110: Receive N manipulation inputs from the user on the display interface.

Here, the display interface may be an interface displayed on the screen of an electronic device used by a user, and the N manipulation inputs may be one or more inputs made by the user in the display interface. The N manipulation inputs may be orderly manipulation inputs made for the same content displayed in the display interface, or may be orderly manipulation inputs made for different content displayed in the display interface. The manipulation input may be, for example, a click input, a sliding input, etc., which are not limited here. Wherein, N is a positive integer.

For example, in response to each manipulation input, the display interface in the screen can be controlled to change accordingly. The changes in the display interface include but are not limited to interface switching, layout changes, etc. For example, when the display interface is the system desktop, clicking the icon of application A on the desktop can control the current displayed system desktop to jump to the interface corresponding to application A and display it. For another example, the user drags the control displayed above the display interface to the bottom of the display interface through sliding input for display.

In a specific example, the continuous operation recording mode can be entered through a preset operation. In this mode, at least one manipulation input of the user on the display interface can be received, and then the user's continuous operation can be screenshotted and recorded, etc. The specific way to enter the operation recording mode can be, for example, that the user slides down with three fingers at the same time in the current display interface. After the device receives the user's three-finger downward input, the default screenshot function can be triggered, and a prompt message will pop up at the same time. After the user clicks the start button of the continuous operation recording in response to the prompt message, the continuous operation recording mode can be entered.

Step 120 : In response to the N manipulation inputs, generate N manipulation text information corresponding to the N manipulation inputs.

Here, the manipulation text information may include text information corresponding to at least one of the input method, input position, and trigger component. The input method may include click or slide input, the input position may include click area, slide area, or slide direction, and the trigger component may include the component targeted by the user input, and the trigger component may be a component displayed in the display interface. Here, the manipulation text information may be information describing the manipulation input in text form.

For example, a set of operation semantics can be predefined to describe the user's manipulation input in text form. For example, record whether the manipulation input is a click input or a slide input; identify the screen position of the manipulation input or the direction of the input, such as "middle", "upper right corner", "up", "right", etc.; record the characteristics of the component targeted by the manipulation input, such as "button-discovery", "text-applet".

In a specific example, for the system desktop 10 shown in FIG2a, if the user clicks the a icon 11 corresponding to the application A displayed in the middle of the system desktop 10, and then jumps to the main interface 12 corresponding to the application A shown in FIG2b, the user then clicks the b button 13 displayed in the lower right corner of the main interface 12, so that the current display interface jumps from the main interface 12 to the slave interface 14 shown in FIG2c, and the user then clicks the c text 15 displayed above the slave interface 14, thereby triggering the jump to other interfaces corresponding to the c text 15. In this way, in the continuous operation recording mode, according to the three manipulation inputs, the manipulation text information shown below can be generated:

Click on the icon a in the middle of the screen;

Click button b in the lower right corner of the screen;

Click on the text-c at the top of the screen.

In this way, control text information corresponding to each control input can be generated.

Step 130 , taking screenshots of the M interfaces corresponding to the N control inputs to obtain M images.

Here, since one control input can trigger an interface jump, of course, multiple control inputs can be performed based on the same interface. Therefore, in one case, one control input can correspond to multiple interfaces, and in another case, one interface can also correspond to multiple control inputs, which is not limited here. Wherein, M is a positive integer.

For example, a screenshot may be taken for each manipulation input of the user, and of course, a screenshot may also be taken when the manipulation input causes an interface change, wherein the interface change includes but is not limited to interface jump, interface layout change, and the like.

In addition, it should be noted that the execution order of step 130 and step 120 can be changed, and of course they can be executed simultaneously, which is not limited here.

In an optional implementation, step 130 may specifically include:

Determine whether the display interface switches at least once during the process of receiving N control inputs;

When the display interface switches at least once, screenshots are taken of the interface displayed before the switch and the interface displayed after the switch to obtain M images.

Here, the screenshot process can be triggered every time the interface switches, and the interface displayed before the switch and the interface displayed after the switch can be captured respectively.

In a specific example, when a user's click or slide operation causes the interface to jump or scroll, the background monitors this change and automatically captures the interface content of the cached previous interface, and also captures the interface content displayed after the interface jumps and changes, obtaining two images corresponding to the operation.

In this way, by taking a screenshot when the interface is switched triggered by the manipulation input, a key image recording the change process of the interface display content is obtained, thereby reducing redundant screenshots and facilitating users to quickly obtain key content in the interface change process.

In addition, when the user has finished capturing the screen content, he or she can click the button to complete the continuous screenshot or perform a preset operation gesture to exit the continuous screenshot recording mode.

Step 140 , displaying N manipulation text information and M images in association with each other.

In the embodiment of the present application, after obtaining N control text information and M images corresponding to the N control inputs, the relevant information corresponding to the N control inputs can be stored and supported for user viewing.

For example, when storing the relevant information, the N manipulation text information and the image sequence composed of the M images may be stored in association, so that when the user views the image, the corresponding image may be viewed according to the manipulation text information. In addition, when the user views the captured image, the corresponding manipulation text information may be displayed at the same time, and the user may also view the image corresponding to the information by clicking on the corresponding manipulation text information.

In addition, after completing the screenshot process, the user can also send the M captured images together with the N control text information to other users. Specifically, when sending the continuous screenshot sequence content, if the user clicks on one of the images to send, the user can be prompted that there are related screenshots. The user can select to send together, and the image sequence where the image is located and the corresponding control text information are packaged into an image set for sending, so that the N control text information and the M images can be displayed in association on other devices.

Of course, the sender may also choose to directly send the N control text messages to reduce the volume of the sent content, which is not limited here.

Therefore, when recording the user's dynamic operation process, in addition to taking automatic screenshots, the embodiment of the present application also provides a plain text recording mode, that is, generating N control text information corresponding to the user's N operation inputs, and displaying the N control text information in association with M images. In this way, since the control text information records the user's operation input in plain text form, it can reflect the logic between images, so that when the control text information and the corresponding image are displayed in association, the user's dynamic operation process can be intuitively reflected. In addition, since the control text information can describe the key content of the user's operation and is displayed in association with the corresponding image, the control text information can be used as a text index to help the user quickly find the image of the key content when the user views the interception result, so that the user can quickly obtain the key content in the interception result.

Based on this, in a possible embodiment, as shown in FIG3 , the above step 140 may specifically include: steps 1401-1404, which are specifically as follows:

Step 1401, display N control text information.

Here, the N manipulation text information may be displayed in the form of hyperlink text, so that when the user clicks on a certain manipulation text information, the user can jump to one or more images associated with the manipulation text information through the hyperlink, and then display the one or more images.

In a specific example, as shown in FIG. 4 , when three manipulation text information and their corresponding image sequences are displayed in association, hyperlink texts of the three manipulation text information may be displayed above the image display area 41 , and the text content is the manipulation text information.

Step 1402: Receive a first input from a user for a first manipulation text message among N manipulation text messages.

The first manipulation text information is the manipulation text information corresponding to the first manipulation input among the N manipulation inputs. In addition, the first input may be a selection input of the first manipulation text information, such as clicking on the first manipulation text information.

Step 1403 , in response to the first input, determining T first images corresponding to the first manipulation text information from the M images.

Wherein, T is a positive integer and T≤M.

In a specific example, as shown in FIG. 4 , the user may click on the control text information 42 whose content is “click on the button b in the lower right corner of the screen”, so that one or more images corresponding to the control text information 42 may be determined from the corresponding image sequence for display.

In an optional implementation, after step 130, the image capture method provided in the embodiment of the present application may further include:

According to the interception order of the M images, determine the index values corresponding to the M images respectively;

The index value and N pieces of manipulation text information are stored in association;

Step 1403 may specifically include:

Obtaining T target index values stored in association with the first manipulation text information;

T first images corresponding to the T target index values are determined from the M images.

Here, index values can be created for M images, and then the association relationship between the images and the control text information can be established using the index values. In this way, when displaying one or more first images corresponding to the first control text information, one or more first images can be determined based on one or more index values associated with the first control text information.

In this way, by creating an index value for each image, it is easy to establish the association between the control text information and the image, and then it is easy to find the corresponding image according to the control text information, realize the function of automatically locating the image, and also facilitate to quickly obtain the image of key content according to the control text information.

Step 1404: display T first images.

In the embodiment of the present application, if T ≥ 2, the T first images may be arranged and then displayed in the order in which they were captured. The display method includes but is not limited to automatically displaying the T first images in sequence, cyclically displaying the T first images, or triggering the image switching process by the user, etc., which is not limited here.

Regarding the specific display method of the T first images, the embodiment of the present application can provide two modes, one is a split mode, that is, only one image is displayed at a time; the other is an aggregation mode, that is, M images are spliced, and then switched to the area corresponding to the T first images for display by sliding.

With respect to the above split mode, in an optional implementation manner, when the first manipulation input is an input for controlling the display interface to switch from the first interface to the second interface, step 1404 may specifically include:

display any one of the T first images;

When displaying a first target image among the T first images, receiving a second input from the user on a target area in the first target image; wherein the first target image is an image captured corresponding to the first interface, and the target area is an area in the first target image corresponding to an input position of the first manipulation input;

In the case that the input mode of the second input matches the input mode of the first manipulation input, in response to the second input, the second target image is switched to be displayed, and the second target image is an image captured corresponding to the second interface.

Exemplarily, in the split mode, if the user views any one of the M images, it can be prompted that it is an aggregated image and its index value can be marked. For the control input that causes the interface to switch, after the user inputs the same area in the same interface content image in the same input method, it can automatically jump and display the image captured after the interface switch.

In a specific example, as shown in Figure 4, after the user clicks on the control text information 42 whose content is "Click - button b in the lower right corner of the screen", the image ranked first in one or more images corresponding to the control text information 42 can be displayed in the image display area 41. If the control input corresponding to the control text information 42 is an input for controlling the display interface to switch from the first interface to the second interface, then when the currently displayed image is a screenshot corresponding to the first interface, if the user clicks on the area 43 corresponding to the button b in the lower right corner of the image, it can trigger the switch to the screenshot corresponding to the second interface for display.

In this way, by displaying the T images in a split mode, an intuitive display method can be provided to associate and display each control text information with its corresponding image, thereby facilitating users to quickly locate images where key content is located, thereby improving user experience.

In an optional implementation, when the first manipulation input is an input for controlling the display interface to switch from the first interface to the second interface, after step 140, the image capture method provided in the embodiment of the present application may further include:

According to the screenshot sequence of the M images, the M images are stitched together to obtain a stitched image;

Step 1404 may specifically include:

Displaying the content of the area in the stitched image corresponding to any one of the T first images;

In the case of displaying the content of the first area corresponding to the first target image, receiving a third input from the user to a target sub-area in the first area; wherein the target sub-area is a sub-area in the first area corresponding to the input position of the first manipulation input;

In a case where the input mode of the third input matches the input mode of the first manipulation input, in response to the third input, content of the second area corresponding to the second target image is displayed.

Exemplarily, in the aggregation mode, the M images can be stitched into one image, i.e., a stitched image, according to the index value corresponding to each of the M images. The stitching method includes, but is not limited to, horizontal stitching or vertical stitching, which is not limited here. For the control input that causes the interface to switch, after the user inputs the same sub-area in the same interface content area in the same input method, it can automatically slide to the area corresponding to the image captured after the interface is switched for display, that is, when the user receives the third input of the target sub-area in the first area, it can slide from the current first area to the second area to display the content of the second area.

In a specific example, as shown in Figure 5, after the user clicks on the control text information 42 whose content is "Click - button - b in the lower right corner of the screen", the area corresponding to the image ranked first in one or more images corresponding to the control text information 42 can be displayed in the image display area 41. If the control input corresponding to the control text information 42 is an input for controlling the display interface to switch from the first interface to the second interface, then when the currently displayed area is the image captured corresponding to the first interface, that is, the first target image, and the area 50 to which it belongs, if the user clicks on the sub-area 51 corresponding to the button b in the lower right corner of the area 50, it can trigger sliding to the captured image corresponding to the second interface, that is, the area to which the second target image belongs, for display.

In this way, displaying the T images in an aggregated mode can also provide an intuitive display method for displaying each control text information and its corresponding image in association with each other, thereby facilitating users to quickly locate images where key content is located, thereby improving user experience.

In this way, in the embodiment of the present application, the user can quickly determine one or more images corresponding to the control text information and display them by selecting the control text information corresponding to the control input he needs from the N displayed control text information, thereby allowing the user to quickly obtain the required image from the interception results.

In addition, in a possible embodiment, when the second image among the M images is displayed, and the screenshot interface corresponding to the second image is the interface displayed when receiving P second manipulation inputs, as shown in FIG. 6a, step 140 may further include: steps 1405-1406, which are specifically as follows:

Step 1405 : Generate P pieces of annotation information corresponding to the P second manipulation inputs respectively according to the P pieces of second manipulation text information corresponding to the P second manipulation inputs respectively.

Here, after obtaining M images by screenshot, the information corresponding to the corresponding manipulation input can also be annotated in the image. Specifically, the corresponding annotation information can be generated according to the manipulation text information corresponding to the image. Among them, the annotation information may include at least one of the sorting information, input trajectory information and input method information. The sorting information can be determined according to the receiving order corresponding to the P second manipulation inputs. In the case where the input method is sliding input, the input trajectory information can be the sliding trajectory when the user performs the manipulation input. In the case where the input method is click input, the input trajectory information can be the location area clicked by the user when performing the manipulation input.

Step 1406: display P annotation information in the second image.

Wherein, P is a positive integer and P≥2.

Here, the display method of the annotation information includes but is not limited to displaying in an area marking manner, displaying in a character form, etc., which is not limited here.

In a specific example, as shown in Figure 6b, when the content of image 61 is the content of the interface displayed when two control inputs are received, two annotation information corresponding to the two control inputs can be displayed in image 61. For example, for the sliding input for dragging the icon received first, annotation information 62 can be generated and displayed in image 61 according to its corresponding control text information "drag-middle area of the screen-icon-d", and for the click input received later, annotation information 63 can be generated and displayed in image 61 according to its corresponding control text information "click-button at the bottom of the screen-jump".

It should be noted that when the above-mentioned N control inputs and M images are stored in association, the annotation information can be stored together. In addition, when the M images are sent to devices used by other users, the annotation information can also be sent together, which is not limited here.

In this way, by generating and displaying annotation information of the control input corresponding to the image in the image, the user's dynamic operation process can be displayed more intuitively, especially for the screenshot display of the interface with multiple control inputs, the user's control input process can be dynamically displayed in the form of a static image.

Based on the same inventive concept, the present application also provides an image capture device. The image capture device provided in the embodiment of the present application is described in detail below in conjunction with FIG.

Fig. 7 is a structural block diagram showing an image capturing device according to an exemplary embodiment.

As shown in FIG. 7 , the image capture device 700 may include:

The input receiving module 701 is used to receive N manipulation inputs of the user on the display interface;

The information generation module 702 is used to generate N manipulation text information corresponding to the N manipulation inputs in response to the N manipulation inputs; wherein the manipulation text information includes text information corresponding to at least one of the input mode, input position and trigger component;

The interface screenshot module 703 is used to take screenshots of M interfaces corresponding to N control inputs to obtain M images;

An associated display module 704, used for associated display of N manipulation text information and M images;

Wherein, N and M are positive integers.

The image capture device 700 is described in detail below, as follows:

In one embodiment, the interface screenshot module 703 may specifically include:

A judgment submodule, used to determine whether the display interface switches at least once during the process of receiving N control inputs;

The screenshot submodule is used to take screenshots of the interface displayed before the switch and the interface displayed after the switch respectively when the display interface switches at least once, so as to obtain M images.

In one embodiment, the above-mentioned association display module 704 may specifically include:

The first display submodule is used to display N control text information;

A receiving submodule, used to receive a first input of a user to a first manipulation text message among the N manipulation text messages; wherein the first manipulation text message is manipulation text information corresponding to the first manipulation input among the N manipulation inputs;

A determination submodule, configured to determine, in response to a first input, T first images corresponding to the first manipulation text information from the M images;

A second display submodule, used for displaying T first images;

Wherein, T is a positive integer and T≤M.

In one embodiment, when the first manipulation input is an input for controlling the display interface to switch from the first interface to the second interface, the second display submodule may specifically include:

A first display unit, used to display any one of the T first images;

A first receiving unit is used to receive a second input of a user on a target area in the first target image when displaying a first target image in the T first images; wherein the first target image is an image captured corresponding to the first interface, and the target area is an area in the first target image corresponding to an input position of the first manipulation input;

The image switching unit is used to switch to display a second target image in response to the second input when the input mode of the second input matches the input mode of the first manipulation input, where the second target image is an image captured corresponding to the second interface.

In one embodiment, when the first manipulation input is an input for controlling the display interface to switch from the first interface to the second interface, the image capture device 700 may further include:

An image stitching module, for taking screenshots of M interfaces corresponding to N control inputs to obtain M images, and then stitching the M images in a screenshot sequence of the M images to obtain a stitched image;

The second display submodule may specifically include:

A second display unit, used to display the content of a region in the spliced image corresponding to any image in the T first images;

a second receiving unit, configured to receive a third input from a user to a target sub-region in the first region while displaying the content of the first region corresponding to the first target image; wherein the target sub-region is a sub-region in the first region corresponding to an input position of the first manipulation input;

The area sliding unit is used to display the content of the second area corresponding to the second target image in response to the third input when the input mode of the third input matches the input mode of the first manipulation input.

In one embodiment, when a second image among M images is displayed and the screenshot interface corresponding to the second image is the interface displayed when P second manipulation inputs are received, the above-mentioned association display module 704 may further specifically include:

A generating submodule, configured to generate P annotation information corresponding to the P second manipulation inputs respectively according to the P second manipulation text information corresponding to the P second manipulation inputs respectively; wherein the annotation information includes at least one of sorting information, input trajectory information and input mode information, and the sorting information is determined according to the receiving order corresponding to the P second manipulation inputs;

A display submodule, used for displaying P annotation information in the second image;

Wherein, P is a positive integer and P≥2.

In one embodiment, the image capture device 700 may further include:

An index value determination module, for determining index values corresponding to the M images respectively according to the order in which the M images are captured, after taking screenshots of the M interfaces corresponding to the N control inputs to obtain the M images;

An associated storage module, used for associated storage of index values and N manipulation text information;

The above-mentioned determination submodule may specifically include:

An index value acquisition unit, used to acquire T target index values stored in association with the first manipulation text information;

The image determination unit is used to determine T first images corresponding to T target index values from the M images.

Therefore, when recording the user's dynamic operation process, in addition to taking automatic screenshots, the embodiment of the present application provides a plain text recording mode, that is, generating N control text information corresponding to the user's N operation inputs, and displaying the N control text information in association with M images. In this way, since the control text information records the user's operation input in plain text form, it can reflect the logic between images, so that when the control text information and the corresponding image are displayed in association, the user's dynamic operation process can be intuitively reflected. In addition, since the control text information can describe the key content of the user's operation and is displayed in association with the corresponding image, the control text information can be used as a text index to help the user quickly find the image of the key content when the user views the interception result, so that the user can quickly obtain the key content in the interception result.

The image capture device in the embodiment of the present application can be a device, or a component, integrated circuit, or chip in a terminal. The device can be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. The non-mobile electronic device can be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

The image capture device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

The image capture device provided in the embodiment of the present application can implement each process implemented by the method embodiments of Figures 1 to 6b, and will not be described again here to avoid repetition.

Optionally, as shown in Figure 8, an embodiment of the present application also provides an electronic device 800, including a processor 801, a memory 802, and a program or instruction stored in the memory 802 and executable on the processor 801. When the program or instruction is executed by the processor 801, each process of the above-mentioned image capture method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

FIG. 9 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 900 includes but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910 and other components.

Those skilled in the art will appreciate that the electronic device 900 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 910 through a power management system, so that the power management system can manage charging, discharging, and power consumption management. The electronic device structure shown in FIG9 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.

The user input unit 907 is used to receive N control inputs from the user on the display interface;

Processor 910 is used to generate N manipulation text information corresponding to the N manipulation inputs in response to N manipulation inputs; wherein the manipulation text information includes text information corresponding to at least one of an input method, an input position, and a trigger component; and take screenshots of M interfaces corresponding to the N manipulation inputs to obtain M images;

A display unit 906, used for displaying N manipulation text information and M images in association;

Wherein, N and M are positive integers.

Therefore, when recording the user's dynamic operation process, in addition to taking automatic screenshots, the embodiment of the present application provides a plain text recording mode, that is, generating N control text information corresponding to the user's N operation inputs, and displaying the N control text information in association with M images. In this way, since the control text information records the user's operation input in plain text form, it can reflect the logic between images, so that when the control text information and the corresponding image are displayed in association, the user's dynamic operation process can be intuitively reflected. In addition, since the control text information can describe the key content of the user's operation and is displayed in association with the corresponding image, the control text information can be used as a text index to help the user quickly find the image of the key content when the user views the interception result, so that the user can quickly obtain the key content in the interception result.

Optionally, the processor 910 is used to determine whether the display interface performs at least one interface switch in the process of receiving the N control inputs; if the display interface performs at least one interface switch, screenshots of the interface displayed before the switch and the interface displayed after the switch are respectively taken to obtain the M images.

Optionally, a display unit 906 is used to display the N manipulation text information;

A user input unit 907, used to receive a first input of a user to a first manipulation text message among the N manipulation text messages; wherein the first manipulation text message is manipulation text information corresponding to the first manipulation input among the N manipulation inputs;

The processor 910 is configured to determine, in response to the first input, T first images corresponding to the first manipulation text information from the M images;

The display unit 906 is further configured to display the T first images;

Wherein, T is a positive integer and T≤M.

Optionally, the display unit 906 is configured to display any one of the T first images;

A user input unit 907 is used to receive a second input from a user on a target area in the first target image when displaying a first target image in the T first images; wherein the first target image is an image captured corresponding to the first interface, and the target area is an area in the first target image corresponding to an input position of the first manipulation input;

The display unit 906 is also used to switch to display a second target image in response to the second input when the input mode of the second input matches the input mode of the first control input, where the second target image is an image captured corresponding to the second interface.

Optionally, the processor 910 is configured to stitch the M images in a screenshot order of the M images to obtain a stitched image;

A display unit 906, configured to display content of a region in the stitched image corresponding to any one of the T first images;

A user input unit 907 is used to receive a third input from a user to a target sub-region in the first region when displaying the content of the first region corresponding to the first target image; wherein the target sub-region is a sub-region in the first region corresponding to the input position of the first manipulation input;

The display unit 906 is further configured to display content of a second area corresponding to a second target image in response to the third input when an input mode of the third input matches an input mode of the first manipulation input.

Optionally, the processor 910 is configured to generate P annotation information corresponding to the P second manipulation inputs respectively according to the P second manipulation text information corresponding to the P second manipulation inputs respectively; wherein the annotation information includes at least one of sorting information, input trajectory information, and input mode information, and the sorting information is determined according to the receiving order corresponding to the P second manipulation inputs;

A display unit 906, configured to display the P annotation information in the second image;

Wherein, P is a positive integer and P≥2.

Optionally, the processor 910 is configured to determine index values corresponding to the M images respectively according to an interception order of the M images;

A memory 909, used for storing the index value and the N manipulation text information in association with each other;

The processor 910 is further configured to obtain T target index values stored in association with the first manipulation text information; and determine the T first images corresponding to the T target index values from the M images.

Thus, the user can quickly determine one or more images corresponding to the control text information and display them by selecting the control text information corresponding to the control input he needs from the N displayed control text information, so that the user can quickly obtain the required image from the interception result. In addition, by generating and displaying the annotation information of the control input corresponding to the image in the image, the user's dynamic operation process can be more intuitively displayed, especially for the screenshot display of the interface with multiple control inputs, the user's control input process can be dynamically displayed in the form of static images.

It should be understood that in the embodiment of the present application, the input unit 904 may include a graphics processor (Graphics Processing Unit, GPU) 9041 and a microphone 9042, and the graphics processor 9041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode. The display unit 906 may include a display panel 9061, and the display panel 9061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 907 includes a touch panel 9071 and other input devices 9072. The touch panel 9071 is also called a touch screen. The touch panel 9071 may include two parts: a touch detection device and a touch controller. Other input devices 9072 may include, but are not limited to, a physical keyboard, a function key (such as a volume control button, a switch button, etc.), a trackball, a mouse, and a joystick, which will not be repeated here. The memory 909 can be used to store software programs and various data, including but not limited to applications and operating systems. The processor 910 can integrate an application processor and a modem processor, wherein the application processor mainly processes an operating system, a user interface, and applications, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 910.

An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned image capture method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

The processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image capture method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises one..." does not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a magnetic disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims (8)

1. An image capturing method, comprising:

Receiving N control inputs of a user to a display interface;

generating N pieces of control text information corresponding to the N pieces of control inputs in response to the N pieces of control inputs; the control text information comprises text information corresponding to at least one of an input mode, an input position and a trigger component;

the M interfaces corresponding to the N control inputs are subjected to screenshot to obtain M images;

The N pieces of control text information and the M pieces of images are displayed in a correlated mode;

wherein N, M is a positive integer;

the association displaying the N pieces of manipulation text information and the M pieces of images includes:

Displaying the N pieces of control text information;

Receiving a first input of a user to a first control text message in the N control text messages; the first control text information is control text information corresponding to a first control input in the N control inputs;

Determining T first images corresponding to the first manipulation text information from the M images in response to the first input;

displaying the T first images;

wherein T is a positive integer, and T is less than or equal to M;

And displaying the T first images under the condition that the first control input is an input for controlling the display interface to be switched from a first interface to a second interface, wherein the method comprises the following steps:

displaying any one image of the T first images;

Receiving a second input of a user to a target area in a first target image in the T first images under the condition of displaying the first target image in the first target image; the first target image is an image intercepted corresponding to the first interface, and the target area is an area corresponding to the input position of the first control input in the first target image;

And when the input mode of the second input is matched with the input mode of the first control input, responding to the second input, and switching to display a second target image, wherein the second target image is an image intercepted corresponding to the second interface.

2. The method of claim 1, wherein the capturing M interfaces corresponding to the N manipulation inputs to obtain M images includes:

Determining whether the display interface performs interface switching at least once in the process of receiving the N control inputs;

And under the condition that the display interface is subjected to interface switching at least once, respectively carrying out screenshot on the interface displayed before switching and the interface displayed after switching to obtain the M images.

3. The method of claim 1, wherein, in the case where the first manipulation input is an input for controlling the display interface to switch from the first interface to the second interface, after capturing M interfaces corresponding to the N manipulation inputs to obtain M images, the method further comprises:

Splicing the M images according to the screenshot sequence of the M images to obtain spliced images;

the displaying the T first images includes:

displaying the content of an area corresponding to any one of the T first images in the spliced image;

Receiving a third input of a user to a target sub-region in a first region under the condition that the content of the first region corresponding to a first target image is displayed; the target subarea is a subarea corresponding to the input position of the first control input in the first area;

and when the input mode of the third input is matched with the input mode of the first control input, responding to the third input, and displaying the content of a second area corresponding to a second target image.

4. The method of claim 1, wherein in a case where a second image of the M images is displayed and a screenshot interface corresponding to the second image is an interface displayed when P second manipulation inputs are received, the associating displays the N pieces of manipulation text information and the M images, further comprising:

generating P labeling information corresponding to the P second control inputs according to the P second control text information corresponding to the P second control inputs respectively; the marking information comprises at least one of ordering information, input track information and input mode information, wherein the ordering information is determined according to the receiving sequence corresponding to the P second control inputs;

Displaying the P labeling information in the second image;

wherein P is a positive integer, and P is more than or equal to 2.

5. The method of claim 1, wherein after capturing M interfaces corresponding to the N manipulation inputs to obtain M images, the method further comprises:

according to the intercepting sequence of the M images, determining index values corresponding to the M images respectively;

Storing the index value and the N pieces of control text information in a correlated manner;

The determining T first images corresponding to the first manipulation text information from the M images includes:

Acquiring T target index values stored in association with the first manipulation text information;

And determining the T first images corresponding to the T target index values from the M images.

6. An image capturing apparatus, comprising:

The input receiving module is used for receiving N control inputs of a user to the display interface;

the information generation module is used for responding to the N control inputs and generating N control text information corresponding to the N control inputs; the control text information comprises at least one item of information of an input mode, an input position and a trigger component;

the interface screenshot module is used for screenshot M interfaces corresponding to the N control inputs to obtain M images;

the associated display module is used for displaying the N pieces of control text information and the M pieces of images in an associated manner;

wherein N, M is a positive integer;

The association display module comprises:

The first display sub-module is used for displaying the N pieces of control text information;

The receiving sub-module is used for receiving first input of a user on first control text information in the N control text information; the first control text information is control text information corresponding to a first control input in the N control inputs;

a determining submodule, configured to determine T first images corresponding to the first manipulation text information from the M images in response to the first input;

The second display sub-module is used for displaying the T first images;

wherein T is a positive integer, and T is less than or equal to M;

In the case that the first manipulation input is an input for controlling the display interface to be switched from the first interface to the second interface, the second display sub-module includes:

A first display unit configured to display any one of the T first images;

A first receiving unit, configured to receive a second input of a target area in a first target image in the T first images by a user, in a case where the first target image is displayed; the first target image is an image intercepted corresponding to the first interface, and the target area is an area corresponding to the input position of the first control input in the first target image;

And the image switching unit is used for responding to the second input and switching to display a second target image under the condition that the input mode of the second input is matched with the input mode of the first control input, wherein the second target image is an image intercepted corresponding to the second interface.

7. An electronic device comprising a processor, a memory and a program or instruction stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the image capture method of any of claims 1-5.

8. A readable storage medium, characterized in that the readable storage medium has stored thereon a program or instructions which, when executed by a processor, implement the steps of the image capturing method according to any of claims 1-5.