CN111277849A

CN111277849A - Image processing method and device, computer equipment and storage medium

Info

Publication number: CN111277849A
Application number: CN202010086642.3A
Authority: CN
Inventors: 张艳军; 陈明标
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2020-02-11
Filing date: 2020-02-11
Publication date: 2020-06-12
Anticipated expiration: 2040-02-11
Also published as: CN111277849B

Abstract

The embodiment of the application discloses an image processing method, an image processing device, computer equipment and a storage medium, wherein the method comprises the following steps: displaying a live broadcast interface; responding to the trigger operation of a watching user on a live interface, and acquiring a first input image drawn by the watching user on the live interface; acquiring a target electronic gift material matched with the first input image; and sending the target electronic gift corresponding to the target electronic gift material to the anchor client associated with the live interface. By adopting the method and the device, the mode that the audience sends the electronic gifts to the anchor can be enriched, and the operation cost that the audience sends the electronic gifts to the anchor can be reduced.

Description

Image processing method and device, computer equipment and storage medium

Technical Field

The present application relates to the field of computer technologies, and in particular, to an image processing method and apparatus, a computer device, and a storage medium.

Background

Live webcasting is one of keywords developed in the social networking field in recent two years, and the development of mobile terminals and the popularization of wireless networks provide communication bases for people to join live webcasting at any time. Data shows that the size of live webcast users reaches 4 hundred million, which accounts for 45% of the total number of network residents. The network live broadcast is not limited to the entertainment field any more as a unique and innovative propagation tool, and has applications in the fields of internet education, financial conferences and public welfare.

The gift appreciation function of the live webcast can not only maintain the connection between the main webcast and the audience, but also increase the interactivity between the main webcast and the audience. At present, audience presents to a main broadcast mainly selects an electronic gift to be sent on a gift page, sends the selected electronic gift to a terminal device where the main broadcast is located, and displays the gift presenting behavior in a live broadcast page in the form of animation.

Because the electronic gifts displayed on the gift pages are huge in number, the audience needs to manually search for the electronic gifts for presenting the anchor from the massive electronic gifts, so that the way for the audience to send the electronic gifts to the anchor is single, and the operation cost of the audience is increased.

Disclosure of Invention

The embodiment of the application provides an image processing method, an image processing device and related equipment, which can not only enrich the mode of sending an electronic gift to a main broadcast by audiences, but also reduce the operation cost of sending the electronic gift to the main broadcast by the audiences.

An embodiment of the present application provides an image processing method, including:

displaying a live broadcast interface;

responding to the trigger operation of a watching user on a live interface, and acquiring a first input image drawn by the watching user on the live interface;

acquiring a target electronic gift material matched with the first input image;

and sending the target electronic gift corresponding to the target electronic gift material to the anchor client associated with the live interface.

Wherein the sending of the target electronic gift corresponding to the target electronic gift material to the anchor client associated with the live interface comprises:

displaying a prompt message on the live broadcast interface; the prompt message comprises the target electronic gift material, the resource data amount of the target electronic gift and a confirmation identifier;

sending the target electronic gift to the anchor client in response to the trigger operation of the viewing user on the confirmation identifier;

transferring the resource data corresponding to the resource data amount from the user account of the viewing user to a user account of an anchor user corresponding to the anchor client;

acquiring special effect information of the target electronic gift material;

and displaying the target electronic gift material on the live broadcast interface according to the special effect information.

The first input image is an image drawn on the live broadcast interface after the watching user triggers an image drawing identifier;

the displaying the target electronic gift material on the live broadcast interface according to the special effect information comprises the following steps:

and acquiring a first display identifier corresponding to the image drawing identifier, and displaying the target electronic gift material carrying the first display identifier in the live broadcast interface according to the special effect information.

the acquiring target electronic gift material matched with the first input image includes:

acquiring at least one electronic gift material, and determining a first similarity between the first input image and each electronic gift material;

selecting an electronic gift material having a maximum first similarity from the at least one electronic gift material;

and taking the selected electronic gift materials as the target electronic gift materials.

Wherein the electronic gift material is an electronic gift image;

the determining a first similarity between the first input image and each electronic gift material includes:

adjusting the size of the first input image, and performing normalization processing on the first input image after size adjustment to obtain a first image to be processed;

normalizing the electronic gift image, and performing edge detection on the normalized electronic gift image based on an edge detection operator to obtain a second image to be processed;

and acquiring a vector distance between the first image to be processed and the second image to be processed, and taking the vector distance as the first similarity between the first input image and the electronic gift image.

displaying a live broadcast interface;

receiving a target electronic gift sent by a client of a viewer; the target electronic gift is an electronic gift corresponding to the target electronic gift material; the target electronic gift material is matched with a first input image drawn by a viewing user corresponding to the viewer client;

and displaying the notification message of the target electronic gift on the live interface.

An aspect of an embodiment of the present application provides an image processing apparatus, including:

the first display module is used for displaying a live broadcast interface;

the first response module is used for responding to the trigger operation of the watching user on the live interface and acquiring a first input image drawn by the watching user on the live interface;

the acquisition module is used for acquiring a target electronic gift material matched with the first input image;

and the sending module is used for sending the target electronic gift corresponding to the target electronic gift material to the anchor client side associated with the live interface.

Wherein, the sending module includes:

the first display unit is used for displaying a prompt message on a live interface; the prompt message comprises target electronic gift materials, the resource data volume of the target electronic gift and a confirmation identifier;

the response unit is used for responding to the trigger operation of the watching user on the confirmation identifier, sending the target electronic gift to the anchor client, transferring the resource data corresponding to the resource data amount from the user account of the watching user to the user account of the anchor user corresponding to the anchor client, and acquiring special effect information of the target electronic gift material;

and the second display unit is used for displaying the target electronic gift material on the live broadcast interface according to the special effect information.

The first input image is an image which is drawn on a live broadcast interface after a user triggers an image drawing identifier;

a second display unit comprising:

and the first display subunit is used for acquiring a first display identifier corresponding to the image drawing identifier, and displaying the target electronic gift material carrying the first display identifier in the live broadcast interface according to the special effect information.

The first input image is an image drawn on a live broadcast interface after a viewing user triggers an interactive drawing identifier;

the sending module further comprises:

the combination unit is used for acquiring the special effect material, combining the target electronic gift material and the special effect material into a preview image, and combining the preview image, the resource data volume of the target electronic gift and the confirmation identification into a prompt message;

a second display unit comprising:

and the second display subunit is used for acquiring a second display identifier corresponding to the interactive drawing identifier, and displaying the target electronic gift material carrying the second drawing identifier on the live interface according to the special effect information.

an acquisition module, comprising:

a first acquisition unit for acquiring at least one electronic gift material;

a determination unit configured to determine a first similarity between the first input image and each of the electronic gift materials;

the first acquisition unit is further used for selecting the electronic gift materials with the maximum first similarity from the at least one electronic gift material;

and the first acquisition unit is also used for taking the selected electronic gift materials as target electronic gift materials.

Wherein the electronic gift material is an electronic gift image;

the determining unit is specifically configured to adjust the size of the first input image, perform normalization processing on the first input image after the size adjustment to obtain a first to-be-processed image, perform normalization processing on the electronic gift image, perform edge detection on the normalized electronic gift image based on an edge detection operator to obtain a second to-be-processed image, obtain a vector distance between the first to-be-processed image and the second to-be-processed image, and use the vector distance as a first similarity between the first input image and the electronic gift image.

an acquisition module, comprising:

the second acquisition unit is used for acquiring a second input image input by the anchor user corresponding to the anchor client;

a first selection unit configured to acquire at least one electronic gift material if a second similarity between the first input image and the second input image is greater than a similarity threshold, determine a first similarity between the first input image and each of the electronic gift materials, select an electronic gift material having a largest first similarity from the at least one electronic gift material, and take the selected electronic gift material as a target electronic gift material.

Wherein, the acquisition module further comprises:

a second selection unit configured to fuse the first input image and the second input image into a third input image if a second similarity between the first input image and the second input image is less than or equal to a similarity threshold, determine a third similarity between the third input image and each of the electronic gift materials, select an electronic gift material having a maximum third similarity from among the at least one electronic gift material, and take the selected electronic gift material as a target electronic gift material.

The terminal equipment where the live interface is located and the terminal equipment where the anchor client is located are both block link points of a service block chain;

the sending module comprises:

the generating unit is used for determining a target electronic gift corresponding to the target electronic gift material and generating a target business block according to the target electronic gift;

and the adding unit is used for adding the target service block to the service block chain.

the second display module is used for displaying a live broadcast interface;

the receiving module is used for receiving the target electronic gift sent by the audience client; the target electronic gift is an electronic gift corresponding to the target electronic gift material; the target electronic gift material is matched with a first input image drawn by a viewing user corresponding to the viewer client;

and the third display module is used for displaying the notification message of the target electronic gift on the live broadcast interface.

The terminal equipment where the live broadcast interface is located and the terminal equipment where the audience client side is located are all block link points of a service block chain;

the receiving module is specifically configured to obtain a service block chain, where the service block chain includes a target service block, the target service block is used to store a target electronic gift, extract the target service block from the service block chain, and read the target electronic gift from a block body of the target service block.

Wherein, still include:

and the second response module is used for responding to the trigger operation of the anchor user on the live interface, acquiring a second input image, sending the second input image to the audience client, and indicating the audience client to determine the target electronic gift according to the first input image and the second input image.

The notification message comprises target electronic gift materials and special effect information of the target electronic gift materials;

and the third display module is specifically used for displaying the target electronic gift material on a live broadcast interface according to the special effect information.

An aspect of the embodiments of the present application provides a computer device, including a memory and a processor, where the memory stores a computer program, and when the computer program is executed by the processor, the processor is caused to execute the method in the foregoing embodiments.

An aspect of the embodiments of the present application provides a computer storage medium, in which a computer program is stored, where the computer program includes program instructions, and when the program instructions are executed by a processor, the method in the foregoing embodiments is performed.

The method and the system have the advantages that the first input image input by the watching user is obtained by responding to the triggering operation of the watching user on the live interface, the target electronic gift material matched with the first input image is selected from the electronic gift materials, and the electronic gift corresponding to the target electronic gift material is sent to the anchor client. Therefore, the audience client can quickly determine the target electronic gifts which the audience wants to send through the images drawn by the audience, so that the mode that the audience sends the electronic gifts to the anchor user can be enriched, the situation that the audience manually searches for the electronic gifts to be sent from massive electronic gifts can be avoided, the operation cost of the audience user sending the electronic gifts to the anchor user is reduced, the interactivity between the audience user and the live broadcast platform is increased, and the participation sense of the audience user is improved.

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

Fig. 1 is a system architecture diagram of an image processing system according to an embodiment of the present application;

2 a-2 f are schematic views of a scene of image processing provided by an embodiment of the present application;

3 a-3 h are schematic diagrams of a scene of image processing provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of an image processing provided by an embodiment of the present application;

FIG. 5a is a flowchart of acquiring a first input image according to an embodiment of the present application;

fig. 5b is a flow chart of sending an electronic gift according to an embodiment of the present application;

FIG. 6 is a schematic diagram of an image processing provided by an embodiment of the present application;

FIG. 7 is an interactive schematic diagram of image processing provided by an embodiment of the present application;

fig. 8a is a flow chart of sending an electronic gift according to an embodiment of the present application;

fig. 8b is a system architecture diagram of a blockchain according to an embodiment of the present invention;

FIG. 8c is an interactive view of image processing provided by an embodiment of the present application;

fig. 9 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;

fig. 10 is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application;

FIG. 11 is a schematic structural diagram of a computer device according to an embodiment of the present invention;

fig. 12 is a schematic structural diagram of a computer device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

Fig. 1 is a system architecture diagram of image processing according to an embodiment of the present disclosure. The application relates to a server 10d and a terminal device cluster, and the terminal device cluster may include: terminal device 10a, terminal device 10 b.

Taking the terminal device 10a and the terminal device 10b as an example, the terminal device 10a is a terminal device where the viewing user is located, and the terminal device 10b is a terminal device where the anchor user is located. The terminal device 10a displays a live interface, the viewing user draws a first input image on the live interface, and the terminal device 10a acquires the first input image drawn by the viewing user and uploads the first input image to the server 10 d. The live interface can be a game live interface, and the user can participate in the game live process through the game live interface to increase interactivity between the main broadcast and audience users, such as sending a bullet screen.

The server 10d selects a target electronic gift material matching the first input image from among the plurality of electronic gift materials, and transmits a target electronic gift corresponding to the target electronic gift material to the terminal device 10 b.

Subsequently, the server 10d may transfer resource data equivalent to the price of the target electronic gift from the user account of the viewing user to the user account of the anchor user.

It should be noted that when the terminal device cluster is in the same local area network, the server 10d may not be needed to be relied on for communication between the terminal devices, and therefore, the above-mentioned determination of the target electronic gift and the transmission of the target electronic gift to the terminal device 10b may also be performed by the terminal device 10 a.

Alternatively, selecting a target electronic gift material matching the first input image from among the plurality of electronic gift materials is performed by the server 10d, and transmitting the target electronic gift is performed by the terminal device 10 a.

The terminal device 10a, the terminal device 10b, the terminal device 10c, and the like shown in fig. 1 may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a Mobile Internet Device (MID), a wearable device, or the like. The server 10d shown in fig. 1 may refer to a single server device, or may refer to a server cluster including a plurality of server devices.

Fig. 2 a-2 f, and 3 a-3 h, described below, illustrate how the terminal device 10a determines the target electronic gift and sends the target electronic gift to the terminal device 10b where the anchor user is located.

Fig. 2 a-2 f primarily describe how a terminal device 10a of a viewing user transmits a target electronic gift to a terminal device 10b of an anchor user; fig. 3 a-3 h primarily describe how a viewing user interacts with an anchor user to cause the terminal device 10a at which the viewing user is located to send a target electronic gift to the terminal device 10b at which the anchor user is located.

Please refer to fig. 2 a-2 f, which are schematic views of scenes of image processing provided in an embodiment of the present application, and the image processing according to the present application can be applied to a live broadcast client. The application scenario of the application is as follows: and the audience draws a draft of the electronic gift through the live broadcast client so as to quickly send the electronic gift corresponding to the draft to the anchor.

In the following scenario embodiments, the watching user is user small D, the live broadcast user is user small D, the terminal device where the user small D is located is terminal device 10a, and the terminal device where the user small D is located is terminal device 10 b:

as shown in fig. 2a, the user widget D enters a live broadcast room of the user widget, and displays a live broadcast interface on the terminal device 10a, and the user widget D can input comment text (also called a bullet screen) on the live broadcast interface to interact with the user widget.

The user widget D may click on a button "gift" in the live interface, as shown in fig. 2b, displaying a gift panel on the live interface, wherein the gift panel includes: the button "gift", the button "painting gift" and the button "have spiritual happiness".

The small user D clicks a button 'painting gift' in the gift panel, as shown in FIG. 2c, a drawing board area is displayed on the live broadcast interface, the small user D can draw an image on the drawing board area, as shown in FIG. 2c, the small user D draws a love image 20a on the drawing board area, and after the drawing is completed, the small user D can click the button 'done' in the drawing board area.

After acquiring the love image 20a drawn by the small D of the user, the terminal device 10a matches the love image 20a with the electronic gift images of the plurality of electronic gifts, respectively, and selects an electronic gift image most similar to the love image 20a from the plurality of electronic gift images. As shown in fig. 2d, it is assumed that the electronic gift image most similar to the love image 20a selected by the terminal device 10a is the electronic gift image 20 b. The electronic gift image 20b is a presentation image corresponding to the "cardiac instant" of the electronic gift.

As shown in fig. 2d, the matched electronic gift image 20b, the price of the electronic gift "the moment of heartbeat" (the price is 5 yuan), the button "redraw" and the button "give away" are displayed on the live interface. The user widget D may click on the button "give" and the terminal device 10a sends the electronic gift "the moment of heartbeat" to the terminal device 10b where the user widget (which is the anchor user) is located.

As shown in fig. 2e, a notification message 20c is displayed in the terminal device 10 a: the small D gives the "heartbeat instant" and it can be known that the notification message 20c includes the user name of the small D of the user and the name of the sent electronic gift "heartbeat instant", and meanwhile, the terminal device 10a can display the electronic gift image 20b according to the preset animation special effect on the live broadcast interface.

Of course, it is also necessary to transfer the renminbi equal to the price of the "hot moment" of the electronic gift from the account of user mini D to the account of user mini D, i.e. to transfer the 5-element renminbi from the account of user mini D to the account of user mini D.

As shown in fig. 2f, after the terminal device 10b where the user is located receives the "heartbeat instant" of the electronic gift, a notification message 20c is also displayed on the live interface of the terminal device 10b, and an electronic gift image 20b of the "heartbeat instant" of the electronic gift is displayed according to a preset animation special effect.

The embodiments corresponding to fig. 2a to 2f are that the watching user draws a draft of the gifts by hand, the terminal device determines the electronic gifts corresponding to the draft, and sends the electronic gifts to the anchor user, which not only enriches the way in which the audience presents the electronic gifts to the anchor user, but also improves the participation of the watching user in the whole gifting process.

Referring to fig. 3a to fig. 3h, which are schematic views of a scene of image processing provided in an embodiment of the present application, in the following scene embodiments, a watching user is a user xiao D, a live broadcast user is a user xiao ming, a terminal device where the user xiao D is located is a terminal device 10a, and a terminal device where the user xiao ming is located is a terminal device 10 b:

as shown in fig. 3a, the user widget D enters a user widget live broadcast room, and a live broadcast interface is displayed on the terminal device 10a, and the user widget D can input comment texts on the live broadcast interface and interact with the user widget.

The user widget D may click on a button "gift" in the live interface, as shown in fig. 3b, displaying a gift panel on the live interface, wherein the gift panel includes: the button "gift", the button "painting gift" and me are "happy there is inspiration".

The small user D clicks a button 'smart' in the gift panel, as shown in fig. 3c, a drawing board area is displayed on a live broadcast interface of the terminal device 10a, the small user D can draw an image on the drawing board area, as shown in fig. 3c, the small user D draws a love image 20a on the drawing board area, and after the drawing is completed, the small user D can click the button 'complete' in the drawing board area. The terminal device 10a transmits the alert message 20d to the terminal device 10b where the user xianming (the user xianming is a live user) is located.

As shown in fig. 3d, the terminal device 10b displays the prompting message 20d, and the prompting message 20d includes prompting text: vermicelli "Xiao D" invites you to draw, the button "agree" and the button "disagree", and the user Xiao Ming can click the button "agree".

As shown in fig. 3e, a drawing board area is displayed on the live interface of the terminal device 10b, and the user xiaoming can draw an image on the drawing board area, as shown in fig. 3e, the user xiaoming draws a love image 20e on the drawing board area, and after the drawing is completed, the user xiaoming can click a button "complete" in the drawing board area.

The terminal device 10b may transmit the love image 20e drawn by the user xiao ming to the middle terminal device 10a, the terminal device 10a compares whether the love image 20a (the love image 20a is drawn by the viewing user xiao D) and the love image 20e (the love image 20e is drawn by the main user xiao ming) are similar, if so, the terminal device 10a further matches the love image 20a (or the love image 20e) and the electronic gift images of the plurality of electronic gifts, respectively, and selects the electronic gift image most similar to the love image 20a (or the love image 20e) from the plurality of electronic gift images. As shown in fig. 3h, it is assumed that the electronic gift image most similar to the love image 20a (or love image 20e) selected by the terminal device 10a is the electronic gift image 20 b. The electronic gift image 20b is a presentation image corresponding to the "cardiac instant" of the electronic gift.

As shown in fig. 3f, the matched electronic gift image 20b, the price of the electronic gift "the moment of heartbeat" (the price is 5 yuan), the button "redraw" and the button "give away" are displayed on the live interface. The user widget D may click on the button "give away" and the terminal device 10a sends the electronic gift "the moment of heartbeat" to the terminal device 10b where the user widget is located.

As shown in fig. 3g, after the electronic gift "cardiac moment" is transmitted, a notification message 20c is displayed in the terminal device 10 a: the small D gives the "heartbeat instant" and it can be known that the notification message 20c includes the user name of the small D of the user and the name of the sent electronic gift "heartbeat instant", and meanwhile, the terminal device 10a can display the electronic gift image 20b according to the preset animation special effect on the live broadcast interface.

Of course, the terminal device 10a also needs to transfer the renminbi equal to the price of the "heartbeat" of the electronic gift from the account of the user mini D to the account of the user mini, that is, to transfer the 5-element renminbi from the account of the user mini D to the account of the user mini.

As shown in fig. 3h, after the terminal device 10b where the user is located receives the "heartbeat instant" of the electronic gift, a notification message 20c is also displayed on the live interface of the terminal device 10b, and the electronic gift image 20b is displayed according to a preset animation special effect.

The embodiments of fig. 3a to 3h correspond to the viewing user and the anchor user respectively drawing the draft of the gifts, and when the draft of the gifts drawn by the viewing user and the draft of the gifts drawn by the anchor user are similar, the terminal device determines the electronic gifts corresponding to the draft of the gifts and presents the electronic gifts to the anchor user. By adopting the mode, the participation degree of the watching user can be improved, the interactivity between the watching user and the anchor user can be increased, and the interestingness is better realized.

The specific processes of acquiring the first input image (the love image 20a as in the above embodiment), determining the target electronic gift material (the electronic gift image 20b as in the above embodiment) and transmitting the target electronic gift (the "cardiac moment" as in the above embodiment) can be seen in the following embodiments corresponding to fig. 4-8 c.

Please refer to fig. 4, which is a schematic diagram of an image processing provided in an embodiment of the present application, and in the embodiment, described from the perspective of a viewer client where a viewing user (e.g., the user widget D in the embodiments corresponding to fig. 2a to fig. 2f and fig. 3a to fig. 3 h) is located, a terminal device where the viewer client is located may correspond to the terminal device 10a in the embodiments corresponding to fig. 2a to fig. 2f and fig. 3a to fig. 3h, a client where a anchor user (e.g., the user widget in the embodiments corresponding to fig. 2a to fig. 2f and fig. 3a to fig. 3 h) is located is called an anchor client, the terminal device where the anchor client is located may correspond to the terminal device 10b in the embodiments corresponding to fig. 2a to 2f and fig. 3a to 3h, and both the watching client and the anchor client belong to clients of live broadcast software.

The image processing may comprise the steps of:

and step S101, displaying a live broadcast interface.

Specifically, the audience client displays a live broadcast interface, and the live broadcast interface is a display interface of the live broadcast client.

Step S102, responding to the trigger operation of the watching user on the live interface, and acquiring a first input image drawn by the watching user on the live interface.

Specifically, the viewer may trigger an image drawing identifier on the live interface (such as the button "drawing gift" in the embodiments shown in fig. 2a to fig. 2f and fig. 3a to fig. 3 h), the viewer client creates a canvas area in the live interface, the viewer client performs a triggering operation (e.g., a sliding operation) on the canvas area of the live interface, and the viewer client responds to the triggering operation to obtain an image (referred to as a first input image, such as the love image 20a in the embodiments shown in fig. 2a to fig. 2f and fig. 3a to fig. 3 h) drawn by the viewer by the triggering operation performed in the canvas area of the live interface.

Or, the watching user may trigger an interactive drawing identifier on the live interface (e.g., a button "happy" in an embodiment corresponding to fig. 2a to 2f and fig. 3a to 3h described above), similarly, a canvas area is created in the live interface, the watching user may perform a trigger operation in the canvas area of the live interface, and the viewer client, in response to the trigger operation, acquires a first input image drawn by the watching user through the trigger operation performed in the canvas area of the live interface.

In general, a first input image acquired by a viewer client may be drawn on a live interface after a viewing user triggers an image drawing identifier; or after the watching user triggers the interactive drawing identifier, drawing on a live interface. The image drawing identification or the interactive drawing identification corresponds to different interactive functions.

A detailed description of how the viewer client obtains the first input image input by the viewing user follows. Please refer to fig. 5a, which is a flowchart illustrating an embodiment of the present disclosure for acquiring a first input image, where acquiring the first input image may include the following steps:

in step S1021, the flow starts.

In step S1022, a canvas is created in the live interface.

Specifically, if the live interface is regarded as a surface, one drawing action of the viewing user can be regarded as a line, and one drawing action is combined by a plurality of pixel points. Therefore, the key to obtain the first input image is to merge a plurality of pixel points into a line, and then merge the drawn lines into an image. Based on this idea, a viewing client can create a canvas on a live interface, which may be either a full screen canvas or a half screen canvas.

In step S1023, an operation lattice is acquired in response to a gesture operation of the user.

And step S1024, converting the operation dot matrix into lines.

In step S1025, the line is converted into an image.

Specifically, the viewer user may perform a sliding operation on the canvas, and the viewer client may obtain a gesture receiving action by using a system gesture function (e.g., touchband, touchmoved, touchend, etc.), draw a user operation path by using a system bezier curve uibezier path, and finally obtain an image.

Step S1026, the gradation processing is performed on the image.

Specifically, in order to improve the efficiency of the calculation and reduce the complexity, the viewer client may perform the gray-scale processing on the image, and only the brightness information of the image is left, and the image after the gray-scale processing may correspond to the first input image in the foregoing description.

Step S1027, normalization processing is performed on the image after the gradation processing.

Specifically, the size of the image after the gray processing is adjusted to 128 × 128, and the pixel value of the image is normalized to be within the interval of 0 to 1, which also helps to reduce the bandwidth cost when data transmission is performed with the background and improve the transmission and calculation efficiency.

The data transmission with the background means that the target electronic gift material can be determined by the server, so that the watching client can firstly perform normalization processing on the first input image to obtain a first image to be processed, then send the first image to be processed to the server, and compare the similarity between the first image to be processed and the plurality of electronic gift materials by the server to determine the target electronic gift material.

Or the audience client directly sends the first input image to the server, the server performs size adjustment and normalization on the first input image, and determines the similarity between the first input image and the plurality of electronic gift materials after size adjustment and normalization processing, so as to determine the target electronic gift materials.

In step S1028, the flow ends.

Step S103, acquiring at least one electronic gift material, and selecting a target electronic gift material matching the first input image from the at least one electronic gift material.

Specifically, the viewer client obtains at least one electronic gift material of the electronic gift, wherein the electronic gift material may be a static image, a dynamic image, a video, or the like. The electronic gift material can be regarded as externally presented multimedia data of the electronic gift.

For example, the electronic gift material may be a flower image, a car image, an airplane image, or the like.

As can be seen from the foregoing, the first input image may be obtained by a viewing user triggering an image drawing identifier or an interactive drawing identifier, and different drawing identifiers correspond to different selection strategies of the target electronic gift material, which is specifically described below:

when the first input image is drawn after the viewing user triggers the image drawing identification, the viewer client may determine a similarity (referred to as a first similarity) between the first input image and each of the electronic gift materials.

When the electronic gift material is an electronic gift image, the first similarity is the image similarity between the first input image and the electronic gift image;

when the electronic gift material is an electronic gift moving picture (or an electronic gift video), the first similarity is an image similarity between the first input image and a last frame image of the electronic gift moving picture (or the electronic gift video).

The electronic gift material with the largest first similarity is selected from the plurality of first similarities, and the selected electronic gift material is used as the target electronic gift material (e.g., the electronic gift image 20b in the corresponding embodiment of fig. 2 a-2 f and 3 a-3 h).

When the first input image is drawn after the viewing user triggers the interactive drawing identifier, the viewer client may obtain a second input image input by an anchor user (e.g., the user xiao ming in the embodiments corresponding to fig. 2 a-2 f and fig. 3 a-3 h above) corresponding to the live interface. The obtaining mode may be that the audience client receives a second input image sent by a live client where the anchor user is located.

The image similarity between the first input image and the second input image (referred to as a second similarity) is determined, and if the second similarity is greater than a preset similarity threshold, the viewer client determines the similarity between the first input image (or the second input image) and each electronic gift material (referred to as a first similarity). When the electronic gift material is an electronic gift image, the first similarity is the image similarity between the first input image (or the second input image) and the electronic gift image; when the electronic gift material is an electronic gift moving picture (or an electronic gift video), the first similarity is an image similarity between the first input image (or the second input image) and the last frame image of the electronic gift moving picture (or the electronic gift video). And selecting the electronic gift material with the maximum first similarity from the plurality of first similarities, and taking the selected electronic gift material as the target electronic gift material.

If the second similarity is less than or equal to the preset similarity threshold, the viewer client may merge the first input image of the viewing user and the second input image of the anchor user into a third input image. A similarity (referred to as a third similarity) between the third input image and each of the electronic gift materials is determined. When the electronic gift material is an electronic gift image, the third similarity is the image similarity between the third input image and the electronic gift image; when the electronic gift material is an electronic gift moving picture (or an electronic gift video), the third similarity is an image similarity between the third input image and the last frame image of the electronic gift moving picture (or the electronic gift video). And selecting the electronic gift material with the maximum third similarity from the plurality of third similarities, and taking the selected electronic gift material as the target electronic gift material.

Summarizing the above process, when the first input image is an image drawn after the image drawing identification is triggered by the viewing user, the viewer client directly selects an electronic gift material most similar to the first input image from among the plurality of electronic gift materials as a target electronic gift material. This situation may enhance the participation of the viewing user.

When the first input image is an image drawn after an interactive drawing identifier is triggered by a viewing user, the first input image and a second input image drawn by a main broadcasting user need to be fused firstly, the two images are fused into a third input image, and an electronic gift material which is most similar to the third input image is selected from a plurality of electronic gift materials and serves as a target electronic gift material. This situation may not only increase the participation of the viewing user, but may also increase the interactivity between the viewing user and the anchor user.

As can be seen from the above, determining the target electronic gift material requires calculating the similarity between the images a plurality of times, and it is described below how to calculate the first similarity by taking the electronic gift material as the electronic gift image and taking one electronic gift image as an example. The second similarity and the third similarity may be calculated in the same manner.

The viewer client obtains the size threshold, and adjusts the image size of the first input image so that the adjusted size of the first input image is the same as the size threshold. The size threshold may be 128 x 128.

And the audience client performs normalization processing on the first input image after the size adjustment, and the image after the normalization processing is called a first image to be processed.

The normalization process is to adjust the pixel value of the image to be within the interval of 0 to 1.

And the audience client also performs normalization processing on the electronic gift image, and performs edge detection on the normalized electronic gift image based on an edge detection operator to obtain a second image to be processed, wherein the size of the electronic gift image is the same as the size threshold value, and can be 128 x 128, and the size of the image after edge detection is not changed.

The viewer client pulls the first image to be processed into a vector (called a first vector) and similarly pulls the second image to be processed into a vector (called a second vector), calculates a cosine distance between the first vector and the second vector, and takes the cosine distance as a first similarity between the first input image and the electronic gift image.

The first similarity corresponding to each of the electronic gift images may be determined for the other electronic gift images in the manner described above.

As a result, edge detection refers to identifying points with obvious brightness changes in an image, connecting the identified points into an image, and an image obtained after edge detection can be regarded as a contour image outlined by the contour of an original image.

From the calculation point of view, the edge detection is to perform convolution operation on the image and an edge detection operator, and the edge detection operator can be a Prewitt operator, a Roberts operator, a Sobel operator or a Laplacian operator, and the like.

The Prewitt operator is taken as an example for explanation, the Prewitt operator is edge detection of a first-order differential operator, the edge is detected by using the gray difference of upper, lower, left and right adjacent points of a pixel point to reach an extreme value at the edge, part of false edges are removed, and the method has a smoothing effect on noise. The principle is that in image space, two direction templates are used for carrying out neighborhood convolution with an image, wherein the two direction templates are used for detecting horizontal edges and vertical edges.

For the digital image f (x,_y) The Prewitt operator is defined as follows:

G(i)＝|[f(i-1,j-1)+f(i-1,j)+f(i-1,j+1)]-[f(i+1,j-1)+f(i+1,j)+f(i+1,j+1)]|

G(j)＝|[f(i-1,j+1)+f(i,j+1)+f(i+1,j+1)]-[f(i-1,j-1)+f(i,j-1)+f(i+1,j-1)]|

then_p(i,j)＝max[G(i),G(j)]Either the first or the second substrate is, alternatively,_p(i,j)＝G(i)+G(j)。

the classical Prewitt operator considers: all pixels with a new gray value greater than or equal to the threshold are edge points. That is, an appropriate threshold value T is selected, and if P (i, j) ≧ T, (i, j) is an edge point, and P (i, j) is an edge image.

The Prewitt gradient operator method is to first average and then differentiate to determine the gradient, which has a noise suppression effect on noise by pixel averaging, because averaging can reduce or eliminate noise.

The horizontal template and the vertical template are respectively:

horizontal template:

vertical template:

each point in the image is convolved with these 2 templates, taking the maximum value as the output value.

And step S104, sending the target electronic gift corresponding to the target electronic gift material to the anchor client end associated with the live interface.

Specifically, the viewer client determines a target electronic gift corresponding to the target electronic gift material (e.g., the "hot moment" of the electronic gift in the embodiments corresponding to fig. 2 a-2 f and fig. 3 a-3 h).

As can be seen from the foregoing, the first input image is an image drawn after the viewing user triggers the image drawing identifier, or an image drawn after the viewing user triggers the interactive drawing identifier.

When the first input image is an image drawn after the image drawing identifier is triggered by the viewing user, the resource data amount of the target electronic gift (the price of "the moment of heartbeat" of the electronic gift in the corresponding embodiment of fig. 2 a-2 f and fig. 3 a-3 h as described above is 5 yuan), the gift name of the target electronic gift, and the confirmation identifier (the button "give" in the corresponding embodiment of fig. 2 a-2 f and fig. 3 a-3 h as described above) are acquired. And combining the resource data volume, the gift name, the target electronic gift material and the confirmation identifier into a prompt message, and displaying the prompt message on a live broadcast interface.

The watching user can click the confirmation mark, and the audience client responds to the click operation and sends the target electronic gift to the live broadcast client.

Subsequently, the viewer client needs to transfer the resource data equivalent to the resource data amount from the user account of the viewing user to the user account of the anchor user corresponding to the live client, and display a notification message of the target electronic gift.

The specific process of displaying the notification message is as follows:

the method comprises the steps of obtaining special effect information of a target electronic gift material, a first display identification corresponding to an image drawing identification and a target text, displaying the target electronic gift material carrying the first drawing identification and the target text on a live broadcast interface according to the special effect information, wherein the target text can comprise a user name of a watching user and a gift name of a target electronic gift.

For example, the target text may be: the user gives a super rocket for the anchor.

The first presentation identification is used to distinguish the gift type, where the first presentation identification may identify that the gift type is a viewing user interaction type.

The above process can be summarized as the following steps, please refer to fig. 5b, which is a flowchart of sending the electronic gift provided by the embodiment of the present application, and the viewing user sends the electronic gift including the following steps:

step S1031, the viewing user accesses the live room of the anchor user.

In step S1032, the viewing user clicks the button "gift" to trigger the viewer client to display the gift panel.

In step S1033, the viewing user clicks a button "painting gift" in the gift panel.

Wherein, the button "painting gift" may correspond to the image drawing identifier in the foregoing.

Step S1034, watch the user drawing the graph.

In step S1035, the viewer client matches the drawn graphics with the plurality of electronic gift images, selects the closest electronic gift image, and further takes the electronic gift corresponding to the selected electronic gift image as the target electronic gift to be presented.

In step S1036, the target electronic gift is gifted to the anchor client.

When the first input image is an image drawn after the viewing user triggers the interactive drawing identifier, the special effect material, the resource data amount of the target electronic gift, the gift name of the target electronic gift, and the confirmation identifier are acquired. And combining the special effect material and the target electronic gift material into a preview image, combining the preview image, the resource data volume, the gift name and the confirmation identifier into a prompt message, and displaying the prompt message on a live broadcast interface.

For example, in the embodiment corresponding to fig. 3f, the live interface displays: the electronic gift image 20b, the price of the "heartbeat of the electronic gift" (the price is 5 yuan), the button "redrawing", the button "presenting", and the crown material, which is a special effect material, the image formed by combining the crown material and the electronic gift image 20b is a preview image.

Subsequently, resource data equal to the resource data amount needs to be transferred from the user account of the viewing user to the user account of the anchor user corresponding to the live client, and a notification message of the target electronic gift needs to be displayed.

The specific process of displaying the notification message is as follows:

the method comprises the steps of obtaining special effect information of a target electronic gift material and a second display identifier corresponding to an interactive drawing identifier, displaying the target electronic gift material carrying the second drawing identifier on a live broadcast interface according to the special effect information, wherein the second display identifier is used for distinguishing gift types, and the gift types which can be identified by the second display identifier are watching user-anchor user interactive types.

Therefore, the audience client can quickly determine the target electronic gifts which the audience wants to send through the images drawn by the audience, so that the mode that the audience sends the electronic gifts to the anchor user can be enriched, the situation that the audience manually searches for the electronic gifts to be sent from massive electronic gifts can be avoided, the operation cost of the audience user sending the electronic gifts to the anchor user is reduced, the interactivity between the audience user and the live broadcast platform is increased, and the participation sense of the audience user is improved.

Please refer to fig. 6, which is a schematic diagram of an image processing provided in an embodiment of the present application, and in the embodiment, described from the perspective of an anchor client where an anchor user (for example, the user in the embodiment corresponding to fig. 2a to fig. 2f and fig. 3a to fig. 3 h) is located, a terminal device where the anchor client is located may correspond to the terminal device 10b in the embodiment corresponding to fig. 2a to fig. 2f and fig. 3a to fig. 3 h. The client where the watching user is located is called as a spectator client, and both the watching client and the anchor client belong to the clients of the live broadcast software.

The image processing may comprise the steps of:

and step S201, displaying a live interface.

Specifically, the anchor client displays a live interface, and the live interface is a display interface of the anchor client. The interface layout of the live interface in this embodiment and the interface layout of the live interface in the embodiment corresponding to fig. 4 may be completely the same or different.

Step S202, receiving a target electronic gift sent by a viewer client; the target electronic gift is an electronic gift corresponding to the target electronic gift material; the target electronic gift material is an electronic gift material that matches a first input image drawn by a viewing user corresponding to the viewer client.

Specifically, a target electronic gift sent by a viewer client is received, the target electronic gift is an electronic gift corresponding to a target electronic gift material, and the target electronic gift material is an electronic gift material matched with a first input image drawn by a live interface of a viewer in the viewer client corresponding to the viewer client.

The electronic gift materials are multimedia data which are externally displayed by the electronic gift.

The specific process of the viewer client determining the target electronic gift can be referred to steps S101-S104 in the corresponding embodiment of fig. 4.

Optionally, the anchor client receives an auxiliary message (such as the prompt message 20d in the corresponding embodiment of fig. 2 a-2 f and fig. 3 a-3 h) sent by the viewer client before executing step S202, and the auxiliary message is used to prompt the anchor user and the viewing user to draw an image together. The anchor user may draw an image in the live interface based on the auxiliary message, and the anchor client obtains the image drawn by the anchor user, which is referred to as a second input image (e.g., the love image 20e in the embodiments corresponding to fig. 2 a-2 f and fig. 3 a-3 h).

The auxiliary message is sent to the anchor client by the audience client after the audience user triggers the interactive drawing identifier.

The anchor client may send the second input image to the viewer client, and the viewer client compares the second input image with the first input image after receiving the second input image.

If the comparison result is similar, the audience client selects a target electronic gift material which is most similar to the first input image (or the second input image) from the plurality of electronic gift materials, and further determines the target electronic gift.

If the comparison result is not similar, the audience client fuses the first input image and the second input image into a third input image, selects a target electronic gift material which is most similar to the third input image from the plurality of electronic gift materials, and further determines the target electronic gift.

In step S203, a notification message of the target electronic gift is displayed on the live interface.

Specifically, the anchor client obtains special effect messages of the target electronic gift materials and target texts. The target text may include a user name of the viewing user and a gift name of the target electronic gift. And combining the target electronic gift materials, the special effect information and the target text into a notification message by the anchor client.

And the anchor client displays the target electronic gift material and the target text on a live broadcast interface according to the special effect information.

Please refer to fig. 7, which is an interaction diagram of image processing according to an embodiment of the present application, and this embodiment mainly describes an interaction process among a viewer client, a server, and a anchor client, and specifically includes the following steps:

step S301, the viewer client displays a live interface.

Step S302, the spectator client side responds to the trigger operation of the watching user on the live interface, and obtains a first input image drawn by the watching user on the live interface.

The specific processes of step S301 to step S302 may refer to step S101 to step S102 in the embodiment corresponding to fig. 4.

In step S303, the server receives the first input image transmitted by the viewer client, and determines a target electronic gift material matching the first input image from the at least one electronic material.

Specifically, the server receives a first input image sent by the viewer client and acquires at least one electronic gift material.

And if the first input image is an image drawn after the viewing user triggers the image drawing identifier, the server selects an electronic gift material which is most similar to the first input image from at least one electronic gift material as a target electronic gift material. The electronic gift material may be a still image, a moving image, or a video.

If the first input image is an image drawn after the viewing user triggers the interactive drawing identifier, the server generates an auxiliary message, and the auxiliary message is used for prompting the anchor user and the viewing user to draw the image together. The secondary message is sent to the anchor client.

The server receives a second input image fed back by the anchor client based on the auxiliary message, compares the first input image with the second input image, and if the comparison result is similar, the server selects a target electronic gift material which is most similar to the first input image (or the second input image) from the plurality of electronic gift materials.

If the comparison result is not similar, the server fuses the first input image and the second input image into a third input image, and selects a target electronic gift material which is most similar to the third input image from the plurality of electronic gift materials.

The specific process of determining the target electronic gift material may refer to step S103 in the embodiment corresponding to fig. 4, and only the execution subject in step S103 needs to be adjusted to the server by the viewer client.

In step S304, the server sends a target electronic gift corresponding to the target electronic gift material to the anchor client associated with the live interface.

Specifically, the server sends a prompt message to the viewer client, and instructs the viewer client to display the prompt message, wherein the prompt message includes the target electronic gift material, the resource data amount of the target electronic gift, and the confirmation identifier. And the server responds to an agreement request generated by the trigger operation of the watching user on the confirmation identifier, and sends a target electronic gift corresponding to the target electronic gift material to the live broadcast client.

The server transfers resource data equivalent to the amount of the resource data from a user account of the viewing user to a user account of the live user, and generates a notification message of the target electronic gift, transmits the notification message to the viewer client, and instructs the viewer client to display the notification message.

The specific process of sending the target electronic gift by the server may refer to step S104 in the embodiment corresponding to fig. 4, and only the execution subject in step S104 needs to be adjusted to the server by the viewer client.

Optionally, if the audience client and the anchor client are in the same local area network, the server may send the target electronic gift material to the audience client, so that the audience client displays the prompt message, and the audience client responds to the trigger operation of the viewing user on the confirmation identifier in the prompt message, and directly sends the target electronic gift corresponding to the target electronic gift material to the live broadcast client.

In step S305, the anchor client displays a notification message of the target electronic gift on a live interface in the anchor client.

The specific process of step S305 may refer to step S203 in the embodiment corresponding to fig. 6.

Please refer to fig. 8a, which is a flowchart illustrating an embodiment of a method for sending an electronic gift, including the following steps:

in step S401, the flow starts.

In step S402, the viewing user draws an image at the viewer client.

Step S403, the viewer client acquires the image drawn by the viewer, normalizes the image, and sends the normalized image to the cloud server.

In step S404, the cloud server obtains a target electronic gift material matching the image sent by the viewer client from the plurality of electronic materials.

In step S405, the cloud server issues the material ID of the target electronic gift material to the viewer client.

In step S406, the viewer client pulls the target electronic gift material according to the material ID sent by the cloud server.

In step S407, the spectator client triggers the gift sending logic, that is, sends a target electronic gift to the anchor client, where the target electronic gift is an electronic gift corresponding to the target electronic gift material.

In step S408, the flow ends.

The method for sending the electronic gift to the anchor user by the watching user can be applied to a block chain (Blockchain) scene. The blockchain is a novel application mode of computer technologies such as distributed data storage, point-to-point transmission (P2P, Peer to Peer), a consensus mechanism, an encryption algorithm and the like. The blockchain is essentially a decentralized database, which is a string of data blocks associated using cryptography, each data block containing one or more transaction messages for verifying the validity (anti-counterfeiting) of the message and generating the next block.

Fig. 8b is a system architecture diagram of a blockchain according to an embodiment of the present invention. The terminal device where the viewer client is located and the terminal device where the anchor client is located in the foregoing embodiments may respectively correspond to node 1, or node 2, or node 3, or node 4 in fig. 8b, all nodes may be combined into a blockchain system, and each node includes a hardware layer, an intermediate layer, an operating system layer, and an application layer. As can be seen from fig. 8b, the blockchain data stored by each node in the blockchain system is the same. It will be appreciated that the nodes described above may comprise computer devices.

Please refer to fig. 8c, which is an interaction diagram of image processing according to an embodiment of the present application, in which a terminal device where a viewer client is located is referred to as a viewer node, a terminal device where an anchor client is located is referred to as an anchor node, and both the viewer node and the anchor node are block chain nodes of a service block chain.

The interactive process of image processing comprises the following steps:

step S501, the audience node displays a live broadcast interface.

Step S502, the audience node responds to the trigger operation of the watching user on the live interface, and obtains a first input image drawn by the watching user on the live interface.

In step S503, the viewer node acquires the target electronic gift material matching the first input image.

The specific processes of step S501 to step S503 can refer to step S101 to step S103 in the embodiment corresponding to fig. 4, and only the execution subject needs to be adjusted from the viewer client to the viewer node.

Step S504, determining a target electronic gift corresponding to the target electronic gift material, generating a target service block according to the target electronic gift, and adding the target service block to the service block chain.

Specifically, the audience node acquires a target electronic gift corresponding to the target electronic gift material and stores the target electronic gift in the block body. And acquiring the hash value of the last service block of the current service block chain, calculating the Mercker root of the target electronic gift, and storing the hash value of the last service block of the current service block chain, the Mercker root of the target electronic gift and the current timestamp to a block head. The viewer node combines the tile body storing the target electronic gift and the tile header storing the hash value, the merkel root of the target electronic gift, and the current timestamp into a target service tile, adds the target service tile to a service tile chain maintained by the viewer node, and broadcasts the target service tile to the remaining tile chain nodes of the tile chain system, including the anchor node. And after the verification of the other block chain link points is passed, the other block chain link points add the target service block to the service block chain maintained by each block chain link point. Therefore, the service block chains respectively maintained by all the block chain nodes are synchronized.

Subsequently, the audience node acquires the resource data volume corresponding to the target electronic gift, transfers the resource data with the same amount as the resource data volume from the user account of the watching user to the user account of the anchor user corresponding to the live broadcast client, and displays the notification message of the target electronic gift. The specific process of displaying the notification message can be referred to step S104 in the corresponding embodiment of fig. 4.

Optionally, the audience node displays a prompt message on the live broadcast interface, where the prompt message includes the target electronic gift material, the resource data amount of the target electronic gift, and the confirmation identifier. And responding to the triggering operation of the watching user on the confirmation identifier, generating a target business block by the audience node according to the target electronic gift, and adding the target business block to the business block chain. And the audience node transfers the resource data corresponding to the resource data amount from the user account of the watching user to the user account of the anchor user corresponding to the anchor client, acquires the special effect information of the target electronic gift material, and displays the target electronic gift material on a live interface according to the special effect information.

Step S505, the anchor node acquires a target service block from the service block chain.

Specifically, the anchor node extracts a target service block related to the anchor node from the service block chain.

In step S506, the anchor node obtains the target electronic gift from the target service block.

Specifically, the anchor node reads the target electronic gift from the block of the target service block.

In step S507, the anchor node displays a notification message of the target electronic gift on a live interface in the anchor node.

The specific process of step S507 may refer to step S203 in the embodiment corresponding to fig. 6, and only the execution main body needs to be adjusted from the anchor client to the anchor node.

Subsequently, when the watching user needs to inquire the gift presentation record of the watching user, the watching user can acquire the business block related to the watching user through the business block chain, and the reliability of the inquiry result can be ensured by relying on the non-falsification special effect of the block chain, and the watching user can conveniently trace the electronic gift presentation process.

Application scenarios for tracing the presentation process of the electronic gift are as follows: the viewing user sends an electronic gift to the anchor user and successfully pays. But the anchor user claims not to receive the electronic gift, the viewer can inquire the transmission record through the service block chain, and even if the anchor user wants to repudiate, the rest of the block chain nodes and the audience nodes store the service block of the transmission record, so that the viewer can conveniently obtain evidence.

Further, please refer to fig. 9, which is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application. As shown in fig. 9, the image processing apparatus 1 can be applied to a terminal device (or a viewer node) where a viewer client is located in the embodiment corresponding to fig. 3a to 8c, and is particularly applied to the viewer client.

Specifically, the data processing apparatus 1 may be a computer program (including program code) running on a computer device, for example, the data processing apparatus 1 is an application software; the data processing device 1 may be configured to perform corresponding steps in the method provided by the embodiment of the present application.

The image processing apparatus 1 may include: the device comprises a first display module 11, a first response module 12, an acquisition module 13 and a sending module 14.

The first display module 11 is used for displaying a live broadcast interface;

the first response module 12 is configured to respond to a trigger operation of a viewing user on a live interface, and acquire a first input image drawn by the viewing user on the live interface;

an obtaining module 13, configured to obtain a target electronic gift material matched with the first input image;

a sending module 14, configured to send a target electronic gift corresponding to the target electronic gift material to an anchor client associated with the live interface.

For specific functional implementation manners of the first display module 11, the first response module 12, the obtaining module 13, and the sending module 14, reference may be made to steps S101 to S104 in the embodiment corresponding to fig. 4, which is not described herein again.

Referring to fig. 9, the sending module 14 may include: a first display unit 141, a response unit 142, and a second display unit 143.

The first display unit 141 is configured to display a prompt message on a live interface; the prompt message comprises target electronic gift materials, the resource data volume of the target electronic gift and a confirmation identifier;

a response unit 142, configured to send a target electronic gift to the anchor client in response to a trigger operation of the viewing user on the confirmation identifier, transfer resource data corresponding to the resource data amount from a user account of the viewing user to a user account of the anchor user corresponding to the anchor client, and obtain special effect information of a target electronic gift material;

and a second display unit 143 for displaying the target electronic gift material according to the special effect information on the live interface.

The specific processes of the first display unit 141, the response unit 142 and the second display unit 143 can refer to step S104 in the corresponding embodiment of fig. 4.

Referring to fig. 9, the first input image is an image drawn on the live interface after the viewing user triggers the image drawing identifier;

the second display unit 143 may include: a first display subunit 1431.

The first display subunit 1431 is configured to acquire a first display identifier corresponding to the image drawing identifier, and display, in the live interface, the target electronic gift material carrying the first display identifier according to the special effect information.

The specific process of the first display subunit 1431 may refer to step S104 in the embodiment corresponding to fig. 4.

Referring to fig. 9, the first input image is an image drawn on the live interface after the viewing user triggers the interactive drawing identifier;

the sending module 14 may further include: a combining unit 144.

A combining unit 144, configured to obtain a special effect material, combine the target electronic gift material and the special effect material into a preview image, and combine the preview image, the resource data amount of the target electronic gift, and the confirmation identifier into a prompt message;

the second display unit 143 may include: a second display subunit 1432.

And a second display subunit 1432, configured to acquire a second display identifier corresponding to the interactive drawing identifier, and display, on the live broadcast interface, the target electronic gift material carrying the second display identifier according to the special effect information.

The specific processes of the combining unit 144 and the second display subunit 1432 can refer to step S104 in the embodiment corresponding to fig. 4.

Referring to fig. 9 again, the first input image is an image drawn on the live interface after the user triggers the image drawing identifier;

the obtaining module 13 may include: a first acquisition unit 131 and a determination unit 132.

A first obtaining unit 131 for obtaining at least one electronic gift material;

a determination unit 132 for determining a first similarity between the first input image and each of the electronic gift materials;

the first obtaining unit 131 is further configured to select an electronic gift material with a largest first similarity from at least one electronic gift material;

a first obtaining unit 131, further configured to take the selected electronic gift material as a target electronic gift material;

the electronic gift material is an electronic gift image;

the determining unit 132 is specifically configured to adjust the size of the first input image, perform normalization processing on the first input image after the size adjustment to obtain a first to-be-processed image, perform normalization processing on the electronic gift image, perform edge detection on the normalized electronic gift image based on an edge detection operator to obtain a second to-be-processed image, obtain a vector distance between the first to-be-processed image and the second to-be-processed image, and use the vector distance as a first similarity between the first input image and the electronic gift image.

The specific processes of the first obtaining unit 131 and the determining unit 132 can refer to step S103 in the embodiment corresponding to fig. 4.

Referring to fig. 9 again, the first input image is an image drawn on the live interface after the viewing user triggers the interactive drawing identifier;

the obtaining module 13 may include: a second obtaining unit 133, a first selecting unit 134, and a second selecting unit 135.

A second obtaining unit 133, configured to obtain a second input image input by a anchor user corresponding to the anchor client;

a first selecting unit 134 for acquiring at least one electronic gift material if the second similarity between the first input image and the second input image is greater than the similarity threshold, determining a first similarity between the first input image and each electronic gift material, selecting an electronic gift material having the largest first similarity from the at least one electronic gift material, and taking the selected electronic gift material as a target electronic gift material.

A second selecting unit 135 for fusing the first input image and the second input image into a third input image if a second similarity between the first input image and the second input image is less than or equal to a similarity threshold value, determining a third similarity between the third input image and each of the electronic gift materials, selecting an electronic gift material having a maximum third similarity from among the at least one electronic gift material, and taking the selected electronic gift material as a target electronic gift material.

The specific processes of the second obtaining unit 133, the first selecting unit 134, and the second selecting unit 135 may refer to step S103 in the embodiment corresponding to fig. 4.

Referring to fig. 9 again, the terminal device where the live interface is located and the terminal device where the anchor client is located are both block link points of the service block chain;

the transmitting module 14 may include: a generating unit 145 and an adding unit 146.

The generating unit 145, configured to determine a target electronic gift corresponding to the target electronic gift material, and generate a target service block according to the target electronic gift;

an adding unit 146, configured to add the target service block to the service block chain.

The specific processes of the generating unit 145 and the adding unit 146 may refer to step S504 in the embodiment corresponding to fig. 8 c.

Further, please refer to fig. 10, which is a schematic structural diagram of an image processing apparatus according to an embodiment of the present application. As shown in fig. 10, the image processing apparatus 2 may be applied to a terminal device (or an anchor node) where an anchor client is located in the embodiment corresponding to fig. 3a to 8c, and is particularly applied to the anchor client. In particular, the data processing device 2 may be a computer program (including program code) running on a computer apparatus, for example, the data processing device 2 is an application software; the data processing device 2 may be configured to perform corresponding steps in the method provided by the embodiment of the present application.

The image processing apparatus 2 may include: a second display module 21, a receiving module 22 and a third display module 23.

The second display module 21 is configured to display a live interface;

a receiving module 22, configured to receive a target electronic gift sent by a viewer client; the target electronic gift is an electronic gift corresponding to the target electronic gift material; the target electronic gift material is matched with a first input image drawn by a viewing user corresponding to the viewer client;

a third display module 23, configured to display a notification message of the target electronic gift on the live interface;

the receiving module 22 is specifically configured to obtain a service block chain, where the service block chain includes a target service block, and the target service block is used to store a target electronic gift, extract the target service block from the service block chain, and read the target electronic gift from a block body of the target service block.

The notification message comprises a target electronic gift material and special effect information of the target electronic gift material;

the third display module 23 is specifically configured to display the target electronic gift material on the live broadcast interface according to the special effect information.

For specific functional implementation manners of the second display module 21, the receiving module 22 and the third display module 23, reference may be made to steps S201 to S203 in the embodiment corresponding to fig. 6, which is not described herein again.

Referring to fig. 10 again, the image processing apparatus may include a second display module 21, a receiving module 22, and a third display module 23, and may further include: a second response module 24.

And the second response module 24 is configured to, in response to a trigger operation of the anchor user on the live interface, acquire a second input image, send the second input image to the viewer client, and instruct the viewer client to determine the target electronic gift according to the first input image and the second input image.

The specific functional implementation manner of the second response module 24 may refer to step S202 in the embodiment corresponding to fig. 6, which is not described herein again.

Further, please refer to fig. 11, which is a schematic structural diagram of a computer device according to an embodiment of the present invention. The terminal device where the viewer client is located in the embodiments corresponding to fig. 4 to fig. 8c may be a computer device 1000, and as shown in fig. 11, the computer device 1000 may include: a user interface 1002, a processor 1004, an encoder 1006, and a memory 1008. Signal receiver 1016 is used to receive or transmit data via cellular interface 1010, WIFI interface 1012. The encoder 1006 encodes the received data into a computer-processed data format. The memory 1008 has stored therein a computer program by which the processor 1004 is arranged to perform the steps of any of the method embodiments described above. The memory 1008 may include volatile memory (e.g., dynamic random access memory DRAM) and may also include non-volatile memory (e.g., one time programmable read only memory OTPROM). In some instances, the memory 1008 can further include memory located remotely from the processor 1004, which can be connected to the computer device 1000 via a network. The user interface 1002 may include: a keyboard 1018, and a display 1020.

In the computer device 1000 shown in fig. 11, the processor 1004 may be configured to call the memory 1008 to store a computer program to implement:

displaying a live broadcast interface;

acquiring a target electronic gift material matched with the first input image;

It should be understood that the computer device 1000 described in the embodiment of the present invention may perform the description of the image processing method in the embodiment corresponding to fig. 4 to fig. 5b, and may also perform the description of the image processing apparatus 1 in the embodiment corresponding to fig. 9, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.

Further, here, it is to be noted that: an embodiment of the present invention further provides a computer storage medium, and the computer storage medium stores the aforementioned computer program executed by the image processing apparatus 1, and the computer program includes program instructions, and when the processor executes the program instructions, the description of the image processing method in the embodiment corresponding to fig. 4 to 5b can be performed, so that details are not repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer storage medium to which the present invention relates, reference is made to the description of the method embodiments of the present invention.

Further, please refer to fig. 12, which is a schematic structural diagram of a computer device according to an embodiment of the present application. The terminal device where the anchor client is located in the embodiments corresponding to fig. 4 to fig. 8c may be a computer device 2000, and as shown in fig. 12, the computer device 2000 may include: a user interface 2002, a processor 2004, an encoder 2006, and a memory 2008. The signal receiver 2016 is configured to receive or transmit data via the cellular interface 2010, the WIFI interface 2012, the. Encoder 2006 encodes the received data into a computer-processed data format. The memory 2008 has stored therein a computer program, and the processor 2004 is arranged to execute the steps of any of the method embodiments described above by means of the computer program. The memory 2008 may include a volatile memory (e.g., dynamic random access memory DRAM) and may also include a non-volatile memory (e.g., an otp rom OTPROM). In some examples, the memory 2008 may further include memory remotely located from the processor 2004, which may be connected to the computer device 2000 via a network. The user interface 2002 may include: a keyboard 2018 and a display 2020.

In the computer device 2000 shown in fig. 12, the processor 2004 may be configured to call the memory 2008 to store a computer program to implement:

displaying a live broadcast interface;

It should be understood that the computer device 2000 described in this embodiment may perform the description of the image processing method in the embodiment corresponding to fig. 6 to 8c, and may also perform the description of the image processing apparatus 2 in the embodiment corresponding to fig. 10, which is not described herein again. In addition, the beneficial effects of the same method are not described in detail.

Further, here, it is to be noted that: the embodiment of the present application further provides a computer storage medium, and the computer storage medium stores the aforementioned computer program executed by the image processing apparatus 2, and the computer program includes program instructions, and when the processor executes the program instructions, the description of the image processing method in the embodiment corresponding to fig. 6 to 8c can be performed, so that details are not repeated here. In addition, the beneficial effects of the same method are not described in detail. For technical details not disclosed in the embodiments of the computer storage medium referred to in the present application, reference is made to the description of the embodiments of the method of the present application.

It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.

The above disclosure is only for the purpose of illustrating the preferred embodiments of the present invention, and it is therefore to be understood that the invention is not limited by the scope of the appended claims.

Claims

1. An image processing method, comprising:

displaying a live broadcast interface;

responding to the trigger operation of a watching user on the live interface, and acquiring a first input image drawn by the watching user on the live interface;

acquiring a target electronic gift material matched with the first input image;

and sending a target electronic gift corresponding to the target electronic gift material to an anchor client associated with the live interface.

2. The method of claim 1, wherein sending a target electronic gift corresponding to the target electronic gift material to an anchor client associated with the live interface comprises:

acquiring special effect information of the target electronic gift material;

3. The method of claim 2, wherein the first input image is an image drawn on the live interface after the viewing user triggers an interactive drawing identifier;

before the prompt message is displayed on the live broadcast interface, the method further comprises the following steps:

obtaining a special effect material;

combining the target electronic gift material and the special effect material into a preview image;

combining the preview image, the resource data amount of the target electronic gift and the confirmation identification into the prompt message;

and acquiring a second display identifier corresponding to the interactive drawing identifier, and displaying the target electronic gift material carrying the second drawing identifier on the live broadcast interface according to the special effect information.

4. The method of claim 1, wherein the first input image is an image drawn on the live interface after the viewing user triggers an image drawing identifier;

5. The method of claim 1, wherein the first input image is an image drawn on the live interface after the viewing user triggers an interactive drawing identifier;

acquiring a second input image input by a anchor user corresponding to the anchor client;

if the second similarity between the first input image and the second input image is larger than a similarity threshold value, acquiring at least one electronic gift material, and determining the first similarity between the first input image and each electronic gift material;

6. The method of claim 5, further comprising:

if the second similarity between the first input image and the second input image is smaller than or equal to the similarity threshold, fusing the first input image and the second input image into a third input image;

determining a third similarity between the third input image and each electronic gift material;

selecting an electronic gift material having a maximum third similarity from the at least one electronic gift material;

7. The method according to claim 1, wherein the terminal device where the live interface is located and the terminal device where the anchor client is located are both block link points of a service block chain;

the sending of the target electronic gift corresponding to the target electronic gift material to the anchor client associated with the live interface includes:

determining a target electronic gift corresponding to the target electronic gift material;

and generating a target business block according to the target electronic gift, and adding the target business block to the business block chain.

8. An image processing method, comprising:

displaying a live broadcast interface;

receiving a target electronic gift sent by a client of a viewer; the target electronic gift is an electronic gift corresponding to the target electronic gift material; the target electronic gift material is an electronic gift material matched with a first input image drawn by a viewing user corresponding to the viewer client;

and displaying a notification message of the target electronic gift on the live broadcast interface.

9. The method according to claim 8, wherein the terminal device where the live interface is located and the terminal device where the viewer client is located are both block link points of a service block chain;

the receiving of the target electronic gift sent by the viewer client comprises the following steps:

acquiring the service block chain; the service block chain comprises a target service block, and the target service block is used for storing the target electronic gift;

and extracting the target service block from the service block chain, and reading the target electronic gift from the block body of the target service block.

10. The method of claim 8, further comprising:

responding to the trigger operation of the anchor user on the live interface, and acquiring a second input image;

sending the second input image to the spectator client, instructing the spectator client to determine a target electronic gift from the first input image and the second input image.

11. The method of claim 8, wherein the notification message includes the target electronic gift material and special effects information of the target electronic gift material;

the displaying a notification message of the target electronic gift on the live interface comprises:

12. An image processing apparatus characterized by comprising:

the first display module is used for displaying a live broadcast interface;

the first response module is used for responding to the trigger operation of a watching user on the live interface and acquiring a first input image drawn by the watching user on the live interface;

and the sending module is used for sending the target electronic gift corresponding to the target electronic gift material to the anchor client side associated with the live broadcast interface.

13. An image processing apparatus characterized by comprising:

the second display module is used for displaying a live broadcast interface;

the receiving module is used for receiving the target electronic gift sent by the audience client; the target electronic gift is an electronic gift corresponding to the target electronic gift material; the target electronic gift material is an electronic gift material matched with a first input image drawn by a viewing user corresponding to the viewer client;

14. A computer device comprising a memory and a processor, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1-11.

15. A computer storage medium, characterized in that the computer storage medium stores a computer program comprising program instructions which, when executed by a processor, perform the method according to any one of claims 1-11.