WO2016202287A1

WO2016202287A1 - Real-time video transmission method and electronic apparatus

Info

Publication number: WO2016202287A1
Application number: PCT/CN2016/086144
Authority: WO
Inventors: 武俊敏
Original assignee: 美国掌赢信息科技有限公司; 武俊敏
Priority date: 2015-06-19
Filing date: 2016-06-17
Publication date: 2016-12-22

Abstract

The invention relates to the field of video technology. Provided are a real-time video transmission method and electronic apparatus comprising: acquiring a shape inputted by a user; determining a region indicated by the shape inputted by the user in a current real-time video frame; performing, according to a preset condition met by a network bandwidth and a transmission strategy supported by an electronic apparatus, any of the following operations: if the network bandwidth meets a first preset condition, transmitting, according to a first transmission strategy, the current real-time video frame; if the network bandwidth meets a second preset condition, transmitting, according to a second transmission strategy, the current real-time video frame; if the network bandwidth meets a third preset condition, transmitting, according to a third transmission strategy, the current real-time video frame; and if the network bandwidth meets a fourth preset condition, transmitting, according to a fourth transmission strategy, the current real-time video frame. According to different network bandwidths, different transmission strategies are adopted for the current real-time video frame comprising the region indicated by the shape inputted by the user, thereby satisfying a variety of needs of the user in a real-time video process and improving user experience.

Description

Instant video transmission method and electronic device

Technical field

The present invention relates to the field of video, and in particular, to a method and a device for transmitting instant video.

Background technique

With the popularization of mobile devices and instant video communication technologies, more and more users choose to use mobile devices to realize real-time video interaction. In the scene of instant video interaction, users may pay attention to a certain area in real-time video. The degree is greater than other areas; or, the user's requirement for the clarity and detail retention of a certain area is greater than other areas; or, other users who want the instant video interaction may migrate the attention to the area specified by the user. The problem is that it is necessary to provide a method for transmitting instant video, which satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention is greater than other areas and users. It is hoped that other participants of the instant video interaction will migrate the attention to the diverse needs of the area specified by the user.

Since the prior art does not provide the method for transmitting the instant video, the user cannot meet the diverse needs of the user in the instant video process, and the user experience is reduced.

Summary of the invention

In order to meet the diversified needs of users in the instant video process and improve the user experience, embodiments of the present invention provide a method and an electronic device for transmitting an instant video. The technical solution is as follows:

In a first aspect, a method for transmitting an instant video is provided, the method comprising:

Get the shape entered by the user;

Determining an area indicated by the shape in a current instant video frame;

Perform any of the following operations based on the preset conditions that the network bandwidth meets and the transmission policies supported by the electronic device:

If the network bandwidth meets the first preset condition, transmitting the current instant video frame including the area indicated by the shape according to the first transmission policy; or

If the network bandwidth meets the second preset condition, transmitting the current instant video frame including the area indicated by the shape according to the second transmission policy; or

If the network bandwidth meets the third preset condition, transmitting the current instant video frame including the area indicated by the shape according to the third transmission policy; or

If the network bandwidth meets the fourth preset condition, transmitting the current instant video frame including the area indicated by the shape according to the fourth transmission policy.

In conjunction with the first aspect, in a first possible implementation, the acquiring the shape of the user input includes:

Obtaining a curve input by a user, the partial curve included in the curve is a closed curve, and determining that the shape indicated by the closed curve is a shape input by the user;

Obtaining a position parameter input by the user, the position parameter including any one of a coordinate parameter and a feature parameter.

In conjunction with the first aspect or the first possible implementation of the first aspect, in a second possible implementation, the area indicated by the shape is determined in the current instant video frame by any of the following operations:

The position parameter includes a coordinate parameter, and according to the coordinate parameter, determining an area indicated by the shape in a current instant video frame; or

The location parameter includes a description parameter that identifies details indicated by the description parameter in the current instant video frame;

According to the details, an area indicated by the shape is determined in the current instant video frame.

With reference to the first aspect to any one of the second possible implementation manners of the first aspect, in a third possible implementation, the transmitting, according to the first transmission policy, indicating that the shape including the user input is The current instant video frame of the region includes:

And processing the current instant video according to an importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame;

Transmitting the processed instant video frame.

With reference to the third possible implementation manner of the first aspect, in a fourth possible implementation, the current real video is processed according to an importance matrix corresponding to the current instant video frame, and the processing is performed. The following instant video frames include:

Obtaining an importance matrix of the area indicated by the shape;

Performing low-pass filtering on the current instant video frame to obtain the filtered current instant video frame;

And merging the current instant video frame with the filtered current instant video frame according to the importance matrix to generate the processed current instant video frame.

With reference to the first aspect to any one of the possible implementations of the fourth aspect, in a fifth possible implementation, the transmitting, according to the second transmission policy, the area indicated by the shape of the user input is transmitted The current instant video frame strategy includes:

Dividing an instant video frame including at least an area indicated by the shape of the user input into at least one macroblock, and setting a quantization parameter corresponding to the at least one macroblock;

Encoding the at least one macroblock according to the quantization parameter to generate an encoded instant video frame;

Transmitting the encoded instant video frame.

With reference to the fifth possible implementation manner of the foregoing aspect, in a sixth possible implementation, the setting, by the setting, the quantization parameter corresponding to the at least one macroblock includes:

Setting a quantization parameter of a macroblock including all or part of the area indicated by the shape as a first value;

Setting a quantization parameter of a macroblock that does not include all or part of the area indicated by the shape as a second value;

Encoding the at least one macroblock according to the quantization parameter, and generating the encoded The video frame includes:

And encoding the at least one macroblock according to the first value and the second value to generate an encoded instant video frame.

With reference to the first aspect to any one of the sixth possible implementation manners of the first aspect, in a seventh possible implementation, the transmitting, by the third transmission policy, the area indicated by the shape of the user input is transmitted The current instant video frame includes:

Acquiring residual data between a current instant video frame and a reference frame including an area indicated by the shape of the user input;

Transmitting the residual data.

With reference to the seventh possible implementation of the first aspect, in an eighth possible implementation, the acquiring includes a residual between a current instant video frame and a reference frame of an area indicated by a shape of the user input The data includes:

Obtaining a position parameter and a posture parameter of the area indicated by the shape;

Normalizing the position parameter and the posture parameter to generate a standard position parameter and a standard posture parameter;

Obtaining residual data between the current instant video frame and the reference frame including the region indicated by the shape according to the standard position parameter and the standard posture parameter.

In conjunction with the second possible implementation of the first aspect, in a ninth possible implementation, the transmitting, by the fourth transmission policy, the current instant video frame that includes an area indicated by a shape of the user input include:

Obtaining a feature parameter for describing an area indicated by the shape of the user input;

Transmitting the feature parameters.

With reference to the ninth possible implementation manner of the first aspect, in the tenth possible implementation manner, the acquiring, by using the feature parameter that is used to describe the area indicated by the shape of the user input, includes:

Triangulating the area indicated by the shape to obtain at least one triangular area;

Acquiring the attitude parameter and the position parameter corresponding to the at least one triangular area;

And generating the feature parameter according to the posture parameter and the position parameter corresponding to the at least one triangular region.

With reference to the first aspect to any one of the possible implementations of the tenth aspect, in an eleventh possible implementation, the method further includes:

The shape input by the user is sent to other electronic devices.

In a second aspect, a method for displaying an instant video is provided, the method comprising:

Obtaining a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

Get the shape entered by the user;

The current instant video frame is displayed according to the shape of the user input and a transmission policy supported by the electronic device.

In a third aspect, an electronic device is provided, the electronic device comprising:

An acquisition module for obtaining a shape input by a user;

a first processing module, configured to determine an area indicated by the shape in a current instant video frame;

a determining module, configured to determine whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition;

The first processing module is further configured to trigger any one of the following modules according to a preset condition that the network bandwidth meets and a transmission policy supported by the electronic device:

a second processing module, configured to: when the network bandwidth meets the first preset condition, transmit the current instant video frame including an area indicated by the shape of the user input according to the first transmission policy; or

a third processing module, configured to: when the network bandwidth meets the second preset condition, transmit the current instant video frame including an area indicated by the shape of the user input according to the second transmission policy; or

a fourth processing module, configured to: when the network bandwidth meets the third preset condition, transmit the current instant video frame including an area indicated by the shape of the user input according to the third transmission policy; or

And a fifth processing module, configured to: when the network bandwidth meets the fourth preset condition, transmit the current instant video frame including the area indicated by the shape of the user input according to the fourth transmission policy.

With reference to the third aspect, in a first possible implementation manner, the acquiring module is specifically configured to:

With reference to the third aspect or the first possible implementation manner of the third aspect, in a second possible implementation manner, the first processing module is configured to perform any one of the following operations:

With reference to any of the third aspect to the second possible implementation of the third aspect, in a third possible implementation, the second processing module is specifically configured to:

Transmitting the processed instant video frame.

In conjunction with the third possible implementation of the third aspect, in a fourth possible implementation, the second processing module is specifically configured to:

Obtaining an importance matrix of the area indicated by the shape;

With reference to any of the third aspect to the fourth possible implementation of the third aspect, in a fifth possible implementation, the third processing module is specifically configured to:

Dividing an instant video frame including at least an area indicated by the shape of the user input into at least one Macroblocks, and setting quantization parameters corresponding to the at least one macroblock;

Transmitting the encoded instant video frame.

In conjunction with the fifth possible implementation of the third aspect, in a sixth possible implementation, the third processing module is specifically configured to:

The third processing module is specifically configured to:

With reference to any of the third aspect to the sixth possible implementation manner of the third aspect, in a seventh possible implementation, the fourth processing module is specifically configured to:

Transmitting the residual data.

With reference to the seventh possible implementation of the third aspect, in the eighth possible implementation, the fourth processing module is specifically configured to include:

In conjunction with the second possible implementation of the third aspect, in a ninth possible implementation manner, The fifth processing module is specifically configured to include:

Transmitting the feature parameters.

In conjunction with the ninth possible implementation of the third aspect, in a tenth possible implementation, the fifth processing module is specifically configured to:

With reference to any one of the third aspect to the tenth aspect of the third aspect, in an eleventh possible implementation, the electronic device further includes: a sending module, configured to:

The shape input by the user is sent to other electronic devices.

In a fourth aspect, an electronic device is provided, the electronic device comprising a transmitting module, a memory, and a processor connected to the sending module and the memory, wherein the memory is configured to store a set of program codes, The processor calls the program code stored by the memory to perform the following operations:

Get the shape entered by the user;

Determining an area indicated by the shape in a current instant video frame;

If the network bandwidth satisfies the fourth preset condition, the transmission includes the shape according to the fourth transmission policy The current instant video frame of the indicated area.

In conjunction with the fourth aspect, in a first possible implementation, the processor invokes program code stored in the memory to perform the following operations:

With reference to the fourth aspect, or the first possible implementation manner of the fourth aspect, in a second possible implementation, the processor invokes the program code stored by the memory to perform any one of the following operations:

With reference to any of the second aspect to the second possible implementation of the fourth aspect, in a third possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Transmitting the processed instant video frame.

In conjunction with the third possible implementation of the fourth aspect, in a fourth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Obtaining an importance matrix of the area indicated by the shape;

With reference to any of the fourth aspect to the fourth possible implementation of the fourth aspect, in a fifth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Transmitting the encoded instant video frame.

In conjunction with the fifth possible implementation of the fourth aspect, in a sixth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

The processor calls the program code stored by the memory to perform the following operations:

With reference to any of the sixth aspect to the sixth possible implementation of the fourth aspect, in a seventh possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Transmitting the residual data.

In conjunction with the seventh possible implementation of the fourth aspect, in an eighth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

In conjunction with the second possible implementation of the fourth aspect, in a ninth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

Transmitting the feature parameters.

In conjunction with the ninth possible implementation of the fourth aspect, in a tenth possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

With reference to any one of the fourth to fourth possible implementations of the fourth aspect, in an eleventh possible implementation, the processor invokes the program code stored in the memory to perform the following operations:

The shape input by the user is sent to other electronic devices.

In a fifth aspect, an electronic device is provided, the electronic device comprising:

a first acquiring module, configured to acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

a second obtaining module, configured to acquire a shape input by the user;

And a display module, configured to display the current instant video frame according to the shape of the user input and a transmission policy supported by the electronic device.

In a sixth aspect, an electronic device is provided, the electronic device including a display screen, a memory, and a processor coupled to the display screen and the memory, wherein the memory stores a set of program codes, the processor The program code stored in the memory is called to perform the following operations:

Acquiring the electronic device according to the first transmission policy, the second transmission policy, the third transmission policy, and the fourth The current instant video frame transmitted by any one of the transmission policies;

Get the shape entered by the user;

The current instant video frame is displayed according to the shape of the user input.

An embodiment of the present invention provides an instant video transmission method and an electronic device, including: acquiring a shape input by a user; determining an area indicated by a shape input by the user in the current instant video frame; determining whether the network bandwidth satisfies the first preset a condition, a second preset condition, a third preset condition, and a fourth preset condition; if the network bandwidth satisfies the first preset condition, transmitting, according to the first transmission policy, the shape including the shape input by the user a current instant video frame of the area; if the network bandwidth satisfies the second preset condition, transmitting, according to the second transmission policy, a current instant video frame including an area indicated by the shape input by the user; if the network bandwidth satisfies the third preset condition, Transmitting, according to the third transmission policy, a current instant video frame including an area indicated by the shape input by the user; if the network bandwidth satisfies the fourth preset condition, transmitting, according to the fourth transmission policy, the area indicated by the shape input by the user Current instant video frame. By determining whether the network bandwidth meets any one of the first preset condition, the second preset condition, the third preset condition, and the fourth preset condition, the shape including the shape input by the user may be indicated according to different network bandwidths. The current instant video frames of the area adopt different transmission strategies. Compared with the traditional instant video transmission method, the user not only satisfies the user's attention to an area in the instant video more than other areas, and the user's definition of a certain area. As well as the requirement for detail retention is greater than other areas and other participants who want instant video interaction to divert attention to the diverse needs of the user-specified area, improve user experience, improve network bandwidth utilization, save network The resource is used to improve the transmission efficiency of the instant video, and the user experience is improved. In addition, the method of the embodiment of the present invention performs the current video frame after acquiring the area indicated by the shape of the user input from the current instant video frame. Processing so that bandwidth resources are compared to traditional instant video coding methods In the case of change, more broadband resources are used for the transmission of the area indicated by the shape input by the user, thereby ensuring the transmission of the area indicated by the shape input by the user, further satisfying the user's access to an area in the instant video. The attention is greater than other areas, the user's requirements for the clarity of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to The diverse needs of the area specified by the user enhance the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Other drawings may also be obtained from those of ordinary skill in the art in light of the inventive work.

FIG. 1 is a flowchart of a method for transmitting instant video according to an embodiment of the present invention;

2 is a flowchart of an instant video display method according to an embodiment of the present invention;

3 is a flowchart of a method for transmitting instant video according to an embodiment of the present invention;

4 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 5 is a schematic diagram of an interface according to an embodiment of the present invention; FIG.

FIG. 6 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 7 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 8 is a flowchart of a method for displaying an instant video according to an embodiment of the present invention;

FIG. 9 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 10 is a flowchart of a method for transmitting instant video according to an embodiment of the present invention;

FIG. 11 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 12 is a flowchart of a method for displaying an instant video according to an embodiment of the present invention;

FIG. 13 is a schematic diagram of an interface according to an embodiment of the present invention;

FIG. 14 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

15 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

16 is a schematic structural diagram of an electronic device according to an embodiment of the present invention;

FIG. 17 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. Some embodiments of the invention, rather than all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

An embodiment of the present invention provides a method for transmitting an instant video, where the method is used in an interactive system including at least two electronic devices, wherein in the interactive system, the at least two electronic devices are stored by running the same The application implements real-time video interaction, and the electronic device includes at least a sending/acquising module, a video input module, and a display module having a touch function, the video input module includes a camera, the display module may include a display screen, and the electronic device passes the sending/acquising module Realizing the sending and receiving of instant video, realizing the input of instant video through the video input module, realizing the display of the instant video and obtaining the instruction triggered by the user through the display module with the touch function.

It is worth noting that, depending on the electronic device, the transmission strategy supported by the electronic device is also different. The electronic device supports the transmission policy, and the electronic device pre-configures a code corresponding to the transmission policy, where the transmission strategy includes instant video transmission and instant transmission. The acquisition of the video, the supported transmission strategy of the electronic device includes: the electronic device supports the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy at the same time; the electronic device supports the first transmission policy and the second transmission policy And any one of a third transmission policy and a fourth transmission policy; the electronic device supports any two of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy; and the electronic device supports the first transmission policy Any three of the second transmission policy, the third transmission policy, and the fourth transmission policy.

The above-mentioned interactive system is merely exemplary, and is a description of the method provided by the embodiment of the present invention. The specific embodiment of the present invention does not limit the specific interactive system.

Embodiment 1 is a method for transmitting an instant video according to an embodiment of the present invention. Referring to FIG. 1, The method specifically includes:

101. Obtain a shape input by a user.

Specifically, the curve input by the user is obtained, and the partial curve included in the curve is a closed curve, and the shape indicated by the closed curve is determined to be a shape input by the user;

Obtain a position parameter input by the user, and the position parameter includes any one of a coordinate parameter and a description parameter.

102. Determine an area indicated by the shape in the current instant video frame.

Specifically, the area indicated by the shape is determined in the current instant video frame by any one of the following operations:

The position parameter includes a coordinate parameter, and the area indicated by the shape is determined in the current instant video frame according to the coordinate parameter; or

The location parameter includes a description parameter that identifies the details indicated by the description parameter in the current instant video frame;

According to the details, the area indicated by the shape is determined in the current instant video frame.

103. Determine whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition.

104. If the network bandwidth meets the first preset condition, and the electronic device supports the first transmission policy, according to the first transmission policy, the current instant video frame including the area indicated by the shape input by the user is transmitted, and ends.

Specifically, the current live video is processed according to an importance matrix corresponding to the current instant video frame, and the processed instant video frame is obtained;

Transmit processed instant video frames.

If the network bandwidth meets the first preset condition, and the electronic device does not support the first transmission policy, the process ends, and after the end, the instant video frame is transmitted by using a conventional transmission mode.

105. If the network bandwidth meets the second preset condition, and the electronic device supports the second transmission policy, according to the second transmission policy, the current instant video frame including the area indicated by the shape input by the user is transmitted, and ends.

Specifically, the instant video frame including at least the area indicated by the shape input by the user is divided into at least one macro block, and the quantization parameter corresponding to the at least one macro block is set;

Encoding at least one macroblock according to the quantization parameter to generate an encoded instant video frame;

Transmit the encoded instant video frame.

If the network bandwidth meets the second preset condition, and the electronic device supports the second transmission policy, the process ends, and after the end, the instant video frame is transmitted by using a conventional transmission mode.

106. If the network bandwidth meets the third preset condition, and the electronic device supports the third transmission policy, according to the third transmission policy, the current instant video frame including the area indicated by the shape input by the user is transmitted, and ends.

Specifically, acquiring residual data between the current instant video frame and the reference frame including the area indicated by the shape input by the user;

Transmit residual data.

If the network bandwidth satisfies the third preset condition, and the electronic device does not support the third transmission policy, the process ends, and after the end, the instant video frame is transmitted by the conventional transmission mode.

107. If the network bandwidth meets the fourth preset condition, and the electronic device supports the fourth transmission policy, according to the fourth transmission policy, the current instant video frame including the area indicated by the shape input by the user is transmitted, and ends.

Specifically, acquiring a feature parameter for describing an area indicated by a shape input by the user;

Transfer feature parameters.

If the network bandwidth satisfies the fourth preset condition, and the electronic device does not support the fourth transmission policy, the process ends, and after the end, the instant video frame is transmitted through the conventional transmission mode.

Optionally, in addition to the foregoing steps, the method provided by the embodiment of the present invention may further include:

Send the shape entered by the user to another electronic device.

An embodiment of the present invention provides a method for transmitting an instant video, by determining whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby Current instant of the area indicated by the shape including the user input according to different network bandwidths Video frames adopt different transmission strategies. Compared with the traditional method of transmitting real-time video, the user not only satisfies the user's attention to a certain area in the instant video, but also the resolution and detail retention of the user. The requirements are greater than other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improve the user experience, improve the utilization of network bandwidth, save network resources, and thus improve The transmission efficiency of the instant video improves the user experience. In addition, the method of the embodiment of the present invention processes the current instant video frame after acquiring the area indicated by the shape of the user input from the current instant video frame. Compared with the traditional instant video coding method, when the bandwidth resources are unchanged, more broadband resources are used for the transmission of the area indicated by the shape input by the user, thereby ensuring the transmission of the area indicated by the shape input by the user. , further satisfying the user's attention to a certain area in the instant video. Other areas, users of the clarity and detail of a reserved area larger than the amount of the other regions as well as the user wants to interact with real-time video of other participants to migrate attention to the diverse needs of the region specified by the user, improve the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

Embodiment 2 is a method for displaying an instant video according to an embodiment of the present invention. Referring to FIG. 2, the method includes:

201. Acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy.

202. Obtain a shape input by a user.

203. Display the current instant video frame according to the shape input by the user and the transmission policy supported by the user.

An embodiment of the present invention provides a method for displaying an instant video, which is obtained by acquiring and displaying a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by Taking the shape input by the user, increasing the form of the area indicated by the user input, improving the interest and interaction of the instant video interaction, increasing the interaction mode of the user in the process of instant video interaction, further satisfying the diversified needs of the user , improved user experience.

Embodiment 3 is a method for transmitting an instant video according to an embodiment of the present invention. In the embodiment of the present invention, the location parameter includes a coordinate parameter, and as shown in FIG. 3, the method includes:

301. Obtain a curve input by a user, and a part of the curve included in the curve is a closed curve.

Specifically, acquiring a curve of the user inputting at least one frame of the instant video frame, wherein acquiring a partial curve corresponding to the any one frame of the instant video frame input by the user in any one of the at least one frame of the instant video frame The process can be:

Obtaining, by the user, a plurality of partial curves of all frame instant video frame inputs before the any one frame of the instant video frame and position parameters of the plurality of partial curves, the position parameter including at least one of a coordinate parameter and a feature parameter;

Copying the plurality of partial curves to the arbitrary one frame of the instant video frame according to the positional parameters of the plurality of partial curves;

Obtaining a partial curve corresponding to the any one frame of the instant video frame input by the user in any one of the at least one frame of the instant video frame;

Get the positional parameters of the part of the curve entered by the user.

By obtaining the curve input by the user, it is possible to determine the area indicated by the user according to the curve input by the user, and to determine the area indicated by the user by selecting the shape of the user input by the user, the method simplifies the operation steps and improves the user. The step of inputting the indicated area improves the transmission efficiency of the instant video, further satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention is greater than other The area and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area improve the user experience; in addition, by acquiring the curve of the user input, the form of the area indicated by the user input is increased. Further satisfying the user's attention to a certain area in the instant video is greater than other areas, the user's requirement for the definition of a certain area and the amount of detail retention is greater than other areas and The user wants other participants of the instant video interaction to move the attention to the diverse needs of the user-specified area, improving the user experience.

In order to make the method of the embodiment of the present invention more familiar to those skilled in the art, the method of the embodiment of the present invention will be further described below with reference to the accompanying drawings. It is assumed that the instant video interface is as shown in a of FIG. The input curve is shown with reference to b in Fig. 4.

Optionally, if it is detected that the curve for obtaining the user input does not include the closed curve, the prompt information for indicating that the user inputs at least the closed curve is displayed to the user.

Wherein, whether the curve obtained by the user input includes a closed curve may be determined according to whether all points of the curve that constitute the user input include an identical point.

The prompt information may be text information. For example, the text information may be: “The curve you input does not include a closed curve, please input again”.

302. Determine that the shape indicated by the closed curve is a shape input by the user.

Specifically, the specific determining process is not limited in the embodiment of the present invention.

By determining that the shape indicated by the closed curve is the shape input by the user, the form of the area indicated by the user input is increased, further satisfying that the user's attention to an area in the instant video is greater than that of other areas, and the user is interested in a certain area. The clarity and detail retention requirements are greater than other areas and other participants who wish to have instant video interactions migrate the attention to the diverse needs of the user-specified area, improving the user experience.

Assuming that the curve input by the user is as shown by b in FIG. 4, it is determined that the shape indicated by the closed curve is the shape input by the user, and can be referred to FIG.

303. Obtain a location parameter input by the user, where the location parameter includes a coordinate parameter.

Specifically, the coordinate parameter is a coordinate parameter of a geometric center of a shape input by the user.

The specific manner of determining the embodiment of the present invention is not limited.

It is to be noted that the steps 301 to 303 are to implement the process of obtaining the shape of the user input. The process may be implemented in other manners in addition to the manner of the foregoing steps.

By obtaining the shape of the user input, the form of the area indicated by the user input is increased, and the interest and interaction of the instant video interaction are improved, which further satisfies the user's attention to an area in the instant video is greater than other areas and users. The requirement for the clarity and detail retention of a certain area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the area specified by the user, improving the user experience.

304. Determine an area indicated by the shape in the current instant video frame.

Specifically, the area indicated by the shape of the user input is determined in the current instant video frame according to the coordinate parameter.

The process can be:

Determining at least one point indicated by the coordinate parameter in a current instant video frame;

The at least one point is set to be at least one point describing a preset shape, and the at least one point describing the preset shape includes a center of the preset shape.

305. Determine whether the network bandwidth is greater than or equal to the first preset value. If yes, and the electronic device supports the first transmission policy, perform step 306; if not, determine whether the network bandwidth is less than the first preset value, and is greater than or equal to a second preset value; if yes, and the electronic device supports the second transmission policy, step 308 is performed; if not, determining that the network bandwidth is less than the second preset value and greater than or equal to the third preset value; if yes, and If the device supports the third transmission policy, step 311 is performed; if not, and the electronic device supports the fourth transmission policy, step 313 is performed.

Specifically, determining a numerical relationship between the network bandwidth and the first preset value, the second preset value, and the third preset value, the specific manner of determining the specific manner in the embodiment of the present invention is not limited.

If the network bandwidth is greater than or equal to the first preset value, determining that the network bandwidth meets the first preset condition;

If the network bandwidth is less than the first preset value and greater than or equal to the second preset value, determining that the network bandwidth meets the second preset condition;

If the network bandwidth is less than the second preset value and greater than or equal to the third preset value, determining that the network bandwidth meets the third preset condition;

If the network bandwidth is less than the third preset condition, determining that the network bandwidth meets the fourth preset condition.

The process of determining the numerical relationship between the network bandwidth and the first preset value, the second preset value, and the third preset value may be:

Determining whether the network bandwidth is greater than or equal to the first preset value, and if yes, determining that the network bandwidth meets the first preset condition, and performing step 306; if not, determining whether the network bandwidth is greater than or equal to the second preset value, and if so, Then, it is determined that the network bandwidth meets the second preset condition, and step 308 is performed; if not, it is determined whether the network bandwidth is greater than or equal to the third preset value, and if yes, it is determined that the network bandwidth meets the third preset condition, and step 311 is performed. If not, it is determined that the network bandwidth meets the fourth preset condition, and step 313 is performed.

The actual preset value may be 100 kb/s, the second preset value may be 50 kb/s, and the third preset value may be 10 kb/s.

Optionally, because the network bandwidth is unstable during network transmission, it may be determined whether the average value of the network bandwidth in the preset time period before the current time meets the first preset condition, the second preset condition, and the third pre-predetermined Set any of the conditions and the fourth preset condition.

Among them, in practical applications, the preset time period may be 0.2 seconds.

By determining whether the average value of the network bandwidth in the preset time period meets the preset condition, the network bandwidth instability during network transmission is eliminated, the reliability of the instant video coding is ensured, and the user experience is improved.

It should be noted that if the network bandwidth is greater than or equal to the first preset value, and the electronic device does not support the first transmission policy, the instant video frame is transmitted through the conventional transmission mode.

If the network bandwidth is less than the first preset value, greater than or equal to the second preset value, and the electronic device does not support the second transmission policy, the instant video frame is transmitted by using a conventional transmission manner.

If the network bandwidth is less than the second preset value, greater than or equal to the third preset value, and the electronic device does not support the third transmission policy, the instant video frame is transmitted through the conventional transmission mode.

If the network bandwidth is less than the third preset value, and the electronic device does not support the fourth transmission policy, the instant video frame is transmitted through the conventional transmission mode.

Since it is determined whether the network bandwidth satisfies the preset condition, when it is determined that the network bandwidth is low, Instant video processing can not only improve the utilization of network bandwidth, save network resources, improve the transmission efficiency of instant video, but also satisfy users' attention to a certain area in instant video when the network bandwidth is low. The user's requirement for the clarity and detail retention of a certain area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, further improving the user experience.

306. Process the current instant video according to an importance matrix corresponding to the current instant video frame, and obtain the processed instant video frame.

Specifically, an importance matrix of the area indicated by the shape is obtained. The obtaining process may be: setting an importance metric value of all pixels in the current instant video frame; setting an importance metric value of all pixels in the area indicated by the shape to a first value; setting a current shape in the non-shape The importance metric of all pixels in the indicated area is a second value; wherein the first value is set to be greater than the second value, and the value of the importance metric is between 0 and 1.

The current filtering mode is low-pass filtered, and the specific filtering manner is not limited in the embodiment of the present invention.

The processed instant video frame is obtained according to the filtered current instant video frame, the current instant video frame, and the importance matrix.

The current instant video frame and the filtered current instant video frame may be merged on the basis of the importance matrix by using a preset generation algorithm to obtain the processed instant video frame. The algorithm may be:

Where out is the processed instant video frame, src is the current instant video frame, and low is the filtered current instant video frame.

For the importance matrix.

By performing low-pass filtering on the current instant video, the high-frequency signal in the current instant video is eliminated, and the bandwidth resource occupied by the current instant video is reduced, thereby improving the transmission efficiency of the instant video, and further satisfying the user's One area's attention is greater than other areas, users' requirements for a certain area's clarity and detail retention are greater than other areas and other users who want instant video interactions to divert attention to the diverse needs of the user's designated area. , improved user body In addition, since the importance matrix indicates the area indicated by the shape of the user input in the instant video frame and the area indicated by the shape of the non-user input, the user input indicated by the importance matrix is passed through the importance matrix. The area indicated by the shape is reserved, and the area indicated by the shape of the non-user input in the instant video frame is replaced with the area indicated by the shape of the non-user input in the low-pass filtered instant video frame, so that the output is processed The image of the area indicated by the shape input by the user in the instant video frame is an undistorted original image, and the image of the area indicated by the shape not input by the user is an image not including the high frequency signal, so that after the processing is transmitted In the case of instant video frames, the bandwidth resources required for transmission are reduced, and the transmission efficiency of the instant video is improved, which further satisfies the user's attention to an area in the instant video is greater than that of other areas, and the user's definition of an area. And the requirement for detail retention is greater than other areas and other participation that users want for instant video interaction. The attention to the diverse needs of users to migrate specified area, improve the user experience.

307. The instant video frame after the transmission process ends.

Specifically, the processed instant video frame is input to the encoder, and the processed instant video frame is encoded by the encoder to generate code stream data;

The specific transmission mode is not limited in the embodiment of the present invention.

It should be noted that steps 306 to 307 are processes for transmitting a current instant video frame including an area indicated by a shape input by a user according to the first transmission policy, and may be implemented by other means in addition to the manner of the foregoing steps. The specific embodiment of the present invention does not limit the specific manner.

The embodiment of the present invention processes the current instant video frame according to the importance matrix, and the importance matrix indicates the importance metric value of each pixel in the current instant video, thereby processing each pixel point, thereby improving the processing. The picture quality of the instant video further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirement for the clarity and detail retention of a certain area is greater than other areas and the user wants instant video interaction. Other participants have increased the user experience by migrating their attention to the diverse needs of the area specified by the user.

308. Divide an instant video frame that includes at least an area indicated by a shape input by the user into at least one Macroblocks, and set the quantization parameters corresponding to at least one macroblock.

Specifically, the processed current instant video frame may be divided into at least one macroblock according to a preset division rule, and the specific division rule is not limited in the embodiment of the present invention.

Setting a quantization parameter of a macroblock including an area indicated by all or part of the user input shape as a first value; since the value of the quantization parameter ranges from 0 to 51 in practical applications, the first value may be Any value defined between 0 to 25 by the user or any of the systems.

The quantization parameter of the macroblock that does not include the area indicated by all or part of the user input shape is set to a second value; the second value may be any value defined by any one of the user or system between 25 and 51.

In the scenario of the instant video interaction, the mutual attention and the picture quality requirement of the area indicated by the shape input by the user such as the area of the face in the instant video are greater than other areas, so the whole or part of the inclusion may be set. The quantization parameter of the macroblock of the area indicated by the shape input by the user is a first value, and during the encoding process, more details of the area indicated by the shape of the user input are retained, so that user input can be guaranteed in the instant video process. The picture quality of the area indicated by the shape satisfies the user's requirement for the picture detail of the area indicated by the shape input by the user, further satisfies the user's attention to a certain area in the instant video is greater than that of other areas, and the user The clarity of the area and the requirement for detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improving the user experience. In addition, in the scenario of real-time video interaction, the mutual attention and the picture quality requirements of the area indicated by the shape input by the user such as the area where the face is located in the instant video are larger than other areas, so it may be set not to include all or The quantization parameter of the macroblock of the area indicated by the shape input by the part of the user is a second value, and the details of the macroblock of the area indicated by the shape not including all or part of the user input are not reserved during the encoding process, and are reduced. The bandwidth occupied by the macroblock of the area indicated by the shape indicated by all or part of the user input is not included, so that the method requires less bandwidth resources than the conventional instant video transmission method, thereby saving bandwidth resources. To improve the efficiency of instant video transmission, and further satisfy the user's attention to a certain area in the instant video is greater than other areas, The user's requirement for the clarity and detail retention of an area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improving the user experience. Further, by setting the quantization parameter of the macroblock including the area indicated by the shape of all or part of the user input as the first numerical value, setting the quantization parameter of the macroblock not including the area indicated by the shape of all or part of the user input is the second The value is such that during the encoding process, the details of the area indicated by the shape input by the user are retained, and the details of the area indicated by the shape of the non-user input are not retained, so that the area indicated by the shape input by the user is not On the basis of the distortion transmission, the bandwidth occupied by the area indicated by the shape of the non-user input is further reduced, so that the method can not only ensure the area indicated by the shape of the user input compared to the conventional instant video transmission method. The picture quality is less, and the required bandwidth resources are less, thereby further saving bandwidth resources and improving the efficiency of instant video transmission, further satisfying the user's attention to an area in the instant video is greater than other areas, the user is to a certain The definition of the area and the amount of detail retention are greater than other areas And the user wants to interact with other participants in real-time video will migrate attention to the diverse needs of the region specified by the user, improve the user experience.

309. Encode at least one macroblock according to the quantization parameter to generate an encoded instant video frame.

Specifically, the at least one macroblock is encoded according to the first value and the second value, to generate an encoded instant video frame.

The processed instant video frame is encoded according to the first value and the second value.

The specific coding manner is not limited in the embodiment of the present invention.

310. Transmit the encoded instant video frame and end.

Specifically, the specific transmission mode is not limited in the embodiment of the present invention.

It should be noted that, in step 308 to step 310, a process of transmitting a current instant video frame including an area indicated by a shape input by a user according to the second transmission policy, in addition to the manner of the foregoing steps, may be implemented by other means. The specific embodiment of the present invention does not limit the specific manner.

Due to at least one of the quantization parameters according to the degree of fineness used to indicate the macroblock in the encoding process The macroblock is encoded such that during the encoding process, the details of the area indicated by the shape of the user input are preserved, and the details of the area indicated by the shape of the non-user input are not preserved, not only more bandwidth resources are used for user input. The transmission of the area indicated by the shape, and the picture quality of the area indicated by the shape input by the user in the instant video is ensured, thereby ensuring the transmission of the area indicated by the shape input by the user, and improving the transmission efficiency of the instant video, further It satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the clarity of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to The diverse needs of the area specified by the user enhance the user experience.

Optionally, in the actual application, before step 308 is performed, step 306 may also be performed.

311. Acquire residual data between the current instant video frame and the reference frame including the area indicated by the shape input by the user.

Specifically, the position parameter and the posture parameter of the area indicated by the shape input by the user are acquired from the current instant video frame.

The position parameter and the attitude parameter are normalized to generate a standard position parameter and a standard posture parameter.

The residual data between the current instant video frame and the reference frame including the area indicated by the shape input by the user is obtained according to the standard position parameter and the standard posture parameter. The posture parameter of the area indicated by the shape input by the user in the reference frame is a standard posture parameter.

Since the attitude parameter of the area indicated by the shape of the user input in the current instant video frame and the attitude parameter of the area indicated by the shape of the user input in the reference frame are standard posture parameters, the acquisition includes the user according to the standard position parameter and the standard posture parameter. The residual data between the current instant video frame and the reference frame of the area indicated by the input shape is compared with the attitude parameter position parameter of the area indicated by the shape of the user input in the current instant video frame, and the reference frame The position parameter and the attitude parameter generate residual data, which reduces the data transmission amount and processing amount in the instant video transmission process, improves the transmission efficiency of the instant video, and further satisfies the user's attention to a certain area in the instant video is greater than other The requirements of the region and the user for the clarity and detail retention of a certain area are greater than those of other regions and users. It is hoped that other participants of the instant video interaction will move the attention to the diverse needs of the area designated by the user, improving the user experience. In addition, real-time video transmission is realized by acquiring residual data between the area indicated by the shape of the user input in the current instant video frame and the area indicated by the shape of the user input in the reference frame, compared to the conventional instant. The video transmission method further reduces the data transmission amount and the processing amount in the instant video transmission process, thereby improving the transmission efficiency of the instant video, and further satisfies the user's attention to an area in the instant video is greater than other areas and users. The requirement for the clarity and detail retention of a certain area is greater than that of other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the area specified by the user, improving the user experience.

312. Transmit residual data and end.

It should be noted that, in step 311 to step 312, a process of transmitting a current instant video frame including an area indicated by a shape input by a user according to the third transmission policy is implemented, and in addition to the manner of the foregoing steps, the method may be implemented by other means. The specific embodiment of the present invention does not limit the specific manner.

Since the residual data between the current instant video frame and the reference frame of the area indicated by the shape input by the user is acquired and transmitted, the method saves network bandwidth resources and ensures the network bandwidth resource compared to the conventional transmission of all the instant video frames. The picture quality of the area indicated by the shape input by the user in the instant video ensures the transmission of the area indicated by the shape input by the user, thereby improving the transmission efficiency of the instant video and further satisfying the user's access to an area in the instant video. The degree of attention is greater than other areas, the user's requirement for the clarity of a certain area and the amount of detail retention is greater than that of other areas and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area. user experience.

Optionally, in the actual application, before performing step 311, at least one of step 306 and step 308 may also be performed.

313. Acquire a feature parameter for describing an area indicated by a shape input by the user.

Specifically, the area indicated by the shape input by the user is triangulated to obtain at least one of three Corner area.

Obtain positional parameters and attitude parameters for describing three feature points of any one of the triangular regions.

According to the position parameter and the attitude parameter of the three feature points, the attitude parameter and the position parameter corresponding to any one of the triangular regions are generated.

The feature parameter is generated according to the attitude parameter and the position parameter corresponding to the at least one triangular region.

The specific generation manner of the embodiment of the present invention is not limited.

Since the attitude parameter and the position parameter of the triangular area indicate the current position and posture of the triangular area, by adjusting the characteristic parameter, the driving of the triangular area can be realized, and the area indicated by the shape of the current input video is formed by the current instant video. Adjusting the attitude parameter and the position parameter of the at least one triangular region to adjust the posture parameter and the position parameter of the same triangular region in the transmitted instant video frame, so as to migrate the region indicated by the shape of the user input in the current instant video frame to the already transmitted The instant video frame saves the network bandwidth compared to the transmission of the current instant video frame, improves the transmission efficiency of the instant video, and further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user is certain The clarity of the area and the requirement for detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improving the user experience.

314. Transfer characteristic parameters.

It should be noted that steps 313 to 314 are processes for implementing a current instant video frame including an area indicated by a shape input by a user according to the fourth transmission policy, and may be implemented by other means in addition to the manner of the foregoing steps. The specific embodiment of the present invention does not limit the specific manner.

By transmitting only the feature parameters for describing the area indicated by the shape of the user input, bandwidth resources are saved compared to transmitting all the instant video frame data, thereby further improving the transmission efficiency of the instant video, and further satisfying the user's instant video. One area in the area is more focused than other areas, the user's requirements for the clarity of a certain area and the amount of detail retention are greater than other areas and the user wants instant Other participants in the video interaction have increased the user experience by migrating attention to the diverse needs of the user-specified area.

315. Send the shape input by the user to other electronic devices.

By transmitting the selection instruction to other electronic devices, other electronic devices can display the shape of the user input indicated by the selection instruction, increase the interactive form of the instant video, and satisfy the diversified needs of the user in the instant video process, further Improve the user experience. In addition, by transmitting the selection command to other electronic devices, the data of the shape input by the user is transmitted to other electronic devices, thereby reducing the amount of data during transmission, saving network resources, and improving the transmission efficiency of the instant video. , further improving the user experience.

In order to further illustrate the effects achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the shape of the user input selected by the user is the shape shown in FIG. After performing the method of the embodiment of the present invention on the a in FIG. 7, the generated interface may be referred to b in FIG. 7. In FIG. 7, the resolution and the detail retention indicated by the second display effect are greater than or equal to The sharpness indicated by the first display effect and the amount of detail retention, the sharpness indicated by the third display effect and the amount of detail retention are smaller than the sharpness indicated by the first display effect and the amount of detail retention.

In the scenario of the instant video interaction, the method provided by the embodiment of the present invention satisfies the requirement that the user pays more attention to an area in the instant video than other areas, and the user's requirement for the clarity and detail retention of the area is greater than other The region and other participants who want the instant video interaction migrate the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience.

An embodiment of the present invention provides a method for transmitting an instant video, by determining whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the shape input by the user, which is not only satisfied compared with the traditional instant video transmission method. The user's attention to an area in the instant video is greater than that of other areas, the user's requirement for the clarity and detail retention of a certain area is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user. The diversified demand of the specified area improves the user experience, improves the utilization of the network bandwidth, saves network resources, thereby improving the transmission efficiency of the instant video, and improving the user experience. In addition, since the method of the embodiment of the present invention is After obtaining the area indicated by the shape of the user input from the current instant video frame, the current instant video frame is processed, so that compared with the conventional instant video encoding method, in the case where the bandwidth resource is unchanged, more The broadband resource is used for the transmission of the area indicated by the shape input by the user, thereby ensuring the transmission of the area indicated by the shape input by the user, further satisfying the user's attention to a certain area in the instant video is greater than other areas, the user pair The definition of a certain area and the amount of detail retention are greater than other areas. Users want to interact with real-time video of other participants to migrate attention to the diverse needs of the region specified by the user, improve the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

Embodiment 4 is a method for displaying an instant video according to an embodiment of the present invention. In the embodiment of the present invention, the location parameter includes a coordinate parameter, and as shown in FIG. 8, the method includes:

801. Acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy.

Specifically, the electronic device may obtain the processed current instant video frame sent by the other electronic device, and may also acquire, in the electronic device, a selection instruction triggered by the user to indicate the shape of the user input selected by the user, and the network bandwidth satisfies the pre- After the condition is set, the current instant video frame including at least the area is processed according to the importance matrix of the area indicated by the shape input by the user, and the processed current instant video frame is obtained.

802. Obtain a shape input by a user;

Specifically, the selection instruction includes a position parameter of a shape input by the user, and the position parameter includes a coordinate parameter.

The electronic device may acquire a selection instruction sent by another electronic device, or may acquire a selection instruction triggered by the user for indicating a shape of the user input selected by the user, and after the network bandwidth meets the preset condition, according to the user input An importance matrix of the area indicated by the shape, processing the current instant video frame including at least the area, and acquiring the processed current instant video frame, and acquiring the selection instruction.

803. Display a current instant video frame according to a shape input by the user and a transmission policy supported by the electronic device.

Specifically, the shape of the user input is displayed according to the position coordinates.

The specific display manner is not limited in the embodiment of the present invention.

If the electronic device does not support the transmission policy corresponding to the current current video frame, the electronic device or the server that sends the instant video frame sends a prompt message to prompt the electronic device not to support the acquired current instant video frame. Corresponding transmission policy, so that the server or the electronic device that sends the instant video frame sends the code corresponding to the transmission policy to the electronic device after the prompt information is obtained, so that the electronic device configures the code.

Since the picture quality of the area indicated by the shape input by the user in the current instant video frame is superior to other areas, the content of the user's attention of the electronic device is shifted to the area indicated by the shape of the user input in the instant video, thereby satisfying The user's attention to an area in the instant video is greater than that of other areas, the user's requirement for the clarity and detail retention of a certain area is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user. The diverse needs of the designated area enhance the user experience. In addition, by displaying the shape input by the user, the user attention of the electronic device can be further migrated to the area indicated by the shape input by the user in the instant video, thereby satisfying the user's attention to a certain area in the instant video is greater than Other areas, users' requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other users who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, improving the user experience. In addition, the selection instruction includes at least one of a size parameter of a shape input by the user, a position parameter of a shape input by the user, a frame parameter of a shape input by the user, and an effect parameter of a shape input by the user. Therefore, the display form of instant video has been added to further meet the diverse needs of users and improve the user experience.

In order to further illustrate the effects achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the shape of the user input selected by the user is the shape shown in FIG. The interface for obtaining the current current video frame display after processing may be referred to b in FIG. 9, where a in FIG. 9 is an interface displayed after acquiring the current instant video frame, and in FIG. 9, the second display effect indicates The sharpness and the detail retention amount are greater than or equal to the sharpness indicated by the first display effect and the detail retention amount, and the sharpness and the detail retention amount indicated by the third display effect are smaller than the sharpness indicated by the first display effect and the detail retention amount. .

An embodiment of the present invention provides a method for displaying an instant video, which is obtained by acquiring and displaying a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

Embodiment 5 is a method for transmitting an instant video according to an embodiment of the present invention. In the embodiment of the present invention, a location parameter of a shape input by a user includes a description parameter, where the description parameter is used to describe a user selected in an instant video frame. The details of the area indicated by the shape input by the user, exemplarily, if the shape indicated by the shape of the user input selected by the user includes at least a human face, the detail may be the eyes, nose, mouth and eyebrows of the user. And, as shown in FIG. 10, the method includes:

1001. Obtain a curve input by a user, and a part of the curve included in the curve is a closed curve.

Specifically, the step is the same as step 301, and details are not described herein again.

By obtaining the curve input by the user, it is possible to determine the area indicated by the user according to the curve input by the user, and to determine the area indicated by the user by selecting the shape of the user input by the user, the method simplifies the operation steps and improves the user. Steps to enter the indicated area to improve live video The transmission efficiency further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction. The user experience is improved by migrating the attention to the diversified needs of the area specified by the user; in addition, by obtaining the curve of the user input, the form of the area indicated by the user input is increased, and the user is further satisfied with the video in the instant video. One area's attention is greater than other areas, users' requirements for a certain area's clarity and detail retention are greater than other areas and other users who want instant video interactions to divert attention to the diverse needs of the user's designated area. , improved user experience.

1002. Determine that the shape indicated by the closed curve is a shape input by the user.

Specifically, the step is the same as step 302, and details are not described herein again.

1003. Obtain a location parameter input by a user, where the location parameter includes a description parameter.

Specifically, the step is the same as step 303, and details are not described herein again.

It is to be noted that the step 1001 to the step 1003 is a process for obtaining the shape of the user input. The process may be implemented in other manners, and the specific manner is not limited in the embodiment of the present invention.

1004. Identify details indicated by the description parameters in the current instant video frame.

Specifically, acquiring feature parameters of all feature points in the current instant video frame;

Obtaining all feature points whose similarity between the feature parameter and the feature parameter included in the selection instruction is greater than or equal to a preset threshold;

It is determined that the details of all the feature points are the details indicated by the description parameters.

The user's attention to an area in the instant video is greater than that of other areas, the user's requirement for the clarity and detail retention of a certain area is greater than that of other areas, and other participants who want the instant video interaction to migrate the attention to the user. The diversified needs of the designated area are that the attention to details in the area is greater than that of other areas, the clarity of details of the area and the amount of detail retention are greater than other areas and other participants who wish to have instant video interaction will pay attention The degree of migration to the details of the area specified by the user, by identifying the details indicated by the description parameters in the current instant video frame, satisfies the user's attention to the details in the area is greater than other areas, the clarity of the details of the area And the requirement for detail retention is greater than the diversified needs of other areas and other participants who wish to have instant video interactions to move attention to the details of the area specified by the user.

1005. Determine the area indicated by the shape in the current instant video frame according to the details.

Specifically, the coordinates of the feature points constituting the detail are set as the coordinates of the points in the input region.

In addition, the input region is determined in the current instant video frame according to the details, and the specific manner is not limited in the embodiment of the present invention.

Since the position of the detail in the input area changes, the input area is determined in the current instant video frame according to the details, which further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user is certain The clarity and detail retention requirements of an area are greater than other areas and other participants who want real-time video interactions to migrate attention to the diverse needs of the user-specified area, increasing the interactivity and interest of instant video. Further improve the user experience.

It should be noted that the steps 1004 to 1005 are a process for determining an area indicated by the shape of the user input in the current instant video frame. In addition to the manner of the foregoing steps, the process may be implemented in other manners. The specific method is not limited.

By identifying the details indicated by the description parameters in the current instant video frame, and according to the details, The area of the input video frame determines the input area, and when the detail position in the area input in the instant video frame changes, the user's attention to the details in the input area is greater than that of other areas and the input area. The definition of detail and the amount of detail retention are greater than other areas and other participants who wish to interact with the video to move the attention to the details of the input area, thereby further satisfying the user's attention to a certain area in the instant video is greater than Other areas, users have more requirements for clarity and detail retention of a certain area than other areas and other participants who want instant video interactions to migrate attention to the diverse needs of the user-specified area, adding instant video Interactivity and fun further enhance the user experience.

1006: Determine whether the network bandwidth is greater than or equal to the first preset value. If yes, and the electronic device supports the first transmission policy, perform step 1007; if not, determine whether the network bandwidth is less than the first preset value, and greater than or equal to a second preset value; if yes, and the electronic device supports the second transmission policy, step 1009 is performed; if not, determining that the network bandwidth is less than the second preset value and greater than or equal to the third preset value; if yes, and If the device supports the third transmission policy, step 1012 is performed; if not, and the electronic device supports the fourth transmission policy, step 1014 is performed.

By judging whether the network bandwidth meets the preset condition, when the network bandwidth is determined to be low, processing the instant video can not only improve the utilization of the network bandwidth, save network resources, improve the transmission efficiency of the instant video, but also can be used in the network bandwidth. When low, the user's attention to a certain area in the instant video is greater than other areas, the user's definition of a certain area and the amount of detail retention is greater than other areas and other participants who want the instant video interaction will pay attention. The diversified needs of migrating to the area specified by the user further enhances the user experience.

1007. Process the current instant video according to an importance matrix corresponding to the current instant video frame, and obtain the processed instant video frame.

Specifically, the step is the same as step 304, and details are not described herein again.

By performing low-pass filtering on the current instant video, the high-frequency signal in the current instant video is eliminated, and the bandwidth resource occupied by the current instant video is reduced, thereby improving the transmission efficiency of the instant video, and further satisfying the user's One area's attention is greater than other areas, users' requirements for a certain area's clarity and detail retention are greater than other areas and other users who want instant video interactions to divert attention to the diverse needs of the user's designated area. , the user experience is improved; in addition, since the importance matrix indicates the area indicated by the shape of the user input in the instant video frame and the area indicated by the shape of the non-user input, the importance matrix is used by the importance matrix. The indicated area indicated by the shape of the user input is reserved, replacing the area indicated by the shape of the non-user input within the instant video frame with the area indicated by the shape of the non-user input within the low pass filtered instant video frame, such that Output the shape of the user input in the processed instant video frame The image of the indicated area is an undistorted original image, and the image of the area indicated by the shape not input by the user is an image that does not include a high frequency signal, thereby reducing the transmission time when transmitting the processed instant video frame. The required bandwidth resources improve the transmission efficiency of instant video and further satisfy the user's instant video. One area of interest is greater than other areas, the user's requirements for the clarity of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to the area specified by the user. Diversified needs and improved user experience.

1008. The instant video frame after the transmission process ends.

Specifically, the step is the same as step 305, and details are not described herein again.

It should be noted that the steps 1007 to 1008 are a process for transmitting a current instant video frame including an area indicated by a shape input by a user according to the first transmission policy, and may be implemented by other means in addition to the manner of the foregoing steps. The specific embodiment of the present invention does not limit the specific manner.

1009. Divide an instant video frame including at least an area indicated by a shape input by the user into at least one macro block, and set a quantization parameter corresponding to the at least one macro block.

Specifically, the step is the same as step 306, and details are not described herein again.

In the scenario of the instant video interaction, the mutual attention and the picture quality requirement of the area indicated by the shape input by the user such as the area of the face in the instant video are greater than other areas, so the whole or part of the inclusion may be set. The quantization parameter of the macroblock of the area indicated by the shape input by the user is a first value, and during the encoding process, more details of the area indicated by the shape of the user input are retained, so that user input can be guaranteed in the instant video process. The picture quality of the area indicated by the shape satisfies the user's requirement for the picture detail of the area indicated by the shape input by the user, further satisfies the user's attention to a certain area in the instant video is greater than that of other areas, and the user The resolution of the area and the amount of detail retention are greater than other areas and other users who want instant video interaction Participants migrated their attention to the diverse needs of the area specified by the user, improving the user experience. In addition, in the scenario of real-time video interaction, the mutual attention and the picture quality requirements of the area indicated by the shape input by the user such as the area where the face is located in the instant video are larger than other areas, so it may be set not to include all or The quantization parameter of the macroblock of the area indicated by the shape input by the part of the user is a second value, and the details of the macroblock of the area indicated by the shape not including all or part of the user input are not reserved during the encoding process, and are reduced. The bandwidth occupied by the macroblock of the area indicated by the shape indicated by all or part of the user input is not included, so that the method requires less bandwidth resources than the conventional instant video transmission method, thereby saving bandwidth resources. To improve the efficiency of instant video transmission, further satisfying the user's attention to an area in the instant video is greater than other areas, the user's requirements for the clarity and detail retention of a certain area are greater than other areas and the user wants instant video interaction. Other participants migrate attention to the area specified by the user Diverse needs, improve the user experience. Further, by setting the quantization parameter of the macroblock including the area indicated by the shape of all or part of the user input as the first numerical value, setting the quantization parameter of the macroblock not including the area indicated by the shape of all or part of the user input is the second The value is such that during the encoding process, the details of the area indicated by the shape input by the user are retained, and the details of the area indicated by the shape of the non-user input are not retained, so that the area indicated by the shape input by the user is not On the basis of the distortion transmission, the bandwidth occupied by the area indicated by the shape of the non-user input is further reduced, so that the method can not only ensure the area indicated by the shape of the user input compared to the conventional instant video transmission method. The picture quality is less, and the required bandwidth resources are less, thereby further saving bandwidth resources and improving the efficiency of instant video transmission, further satisfying the user's attention to an area in the instant video is greater than other areas, the user is to a certain The definition of the area and the amount of detail retention are greater than other areas And the user wants to interact with other participants in real-time video will migrate attention to the diverse needs of the region specified by the user, improve the user experience.

1010. Encode at least one macroblock according to the quantization parameter to generate an encoded instant video frame.

Specifically, the step is the same as step 307, and details are not described herein again.

1011. Transmit the encoded instant video frame and end.

Specifically, the step is the same as step 308, and details are not described herein again.

It should be noted that the steps 1009 to 1011 are a process for transmitting a current instant video frame including an area indicated by a shape input by a user according to the second transmission policy, and may be implemented by other means in addition to the manner of the foregoing steps. The specific embodiment of the present invention does not limit the specific manner.

Since at least one macroblock is encoded according to a quantization parameter for indicating the degree of fineness of the macroblock in the encoding process, in the encoding process, the details of the area indicated by the shape of the user input are retained, the shape of the non-user input The details of the indicated area are not preserved, not only the use of more broadband resources for the transmission of the area indicated by the shape input by the user, but also the picture quality of the area indicated by the shape of the user input in the instant video, thereby ensuring The transmission of the area indicated by the shape input by the user improves the transmission efficiency of the instant video, further satisfies the user's attention to an area in the instant video is greater than other areas, the user's definition of a certain area and the detail retention The demand for quantity is greater than other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the area specified by the user, improving the user experience.

1012. Acquire residual data between the current instant video frame and the reference frame including the area indicated by the shape input by the user.

Specifically, the step is the same as step 309, and details are not described herein again.

1013. Transmit residual data and end.

Specifically, the step is the same as step 310, and details are not described herein again.

It should be noted that step 1012 to step 1013 are processes for implementing a current instant video frame including an area indicated by a shape input by a user according to the third transmission policy, and may be implemented by other means in addition to the manner of the foregoing steps. The specific embodiment of the present invention does not limit the specific manner.

Optionally, in an actual application, at least one of step 1007 and step 1011 may also be performed before step 1012 is performed.

1014. Obtain a feature parameter for describing an area indicated by a shape input by the user.

Specifically, the step is the same as step 311, and details are not described herein again.

1015. Transmission characteristic parameters.

Specifically, the step 312 is the same and will not be further described herein.

It should be noted that the step 1014 to the step 1015 is a process for transmitting a current instant video frame including an area indicated by a shape input by a user according to the fourth transmission policy, and may be implemented by other means in addition to the manner of the foregoing steps. The specific embodiment of the present invention does not limit the specific manner.

By transmitting only the feature parameters for describing the area indicated by the shape of the user input, bandwidth resources are saved compared to transmitting all the instant video frame data, thereby further improving the transmission efficiency of the instant video, and further satisfying the user's instant video. One area of interest is greater than other areas, the user's requirements for the clarity of a certain area and the amount of detail retention are greater than other areas and other participants who want the instant video interaction to migrate the attention to the area specified by the user. Diversified needs and improved user experience.

1016. Send the shape input by the user to another electronic device.

By transmitting the selection instruction to other electronic devices, other electronic devices can display the shape of the user input indicated by the selection instruction, increasing the interaction form of the instant video, satisfying the user's The diverse needs of the instant video process further enhance the user experience. In addition, by transmitting the selection command to other electronic devices, the data of the shape input by the user is transmitted to other electronic devices, thereby reducing the amount of data during transmission, saving network resources, and improving the transmission efficiency of the instant video. , further improving the user experience.

In order to further illustrate the effect achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the shape input by the user is the shape shown in FIG. After the method of the embodiment of the present invention is executed, the generated interface may be referred to b in FIG. 11. If the position of the user in the screen changes in the instant video interface, the interface may refer to c in FIG. In FIG. 11, the sharpness and the detail retention indicated by the second display effect are greater than or equal to the sharpness indicated by the first display effect and the amount of detail retention, and the sharpness and detail retention indicated by the third display effect are less than The sharpness indicated by the first display effect and the amount of detail retention.

In the scenario of the instant video interaction, the method provided by the embodiment of the present invention satisfies the requirement that the user pays more attention to an area in the instant video than other areas, and the user's requirement for the clarity and detail retention of the area is greater than other The region and other participants who want the instant video interaction migrate the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience. In addition, since the position of the detail in the area indicated by the shape input by the user may change, the area indicated by the shape of the user input is determined in the current instant video frame according to the detail, so that the shape input by the user in the instant video frame is In the case where the position of the detail in the indicated area changes, the picture quality of the area in which the detail is located can still be ensured, thereby further satisfying the user's attention to an area in the instant video is greater than that of other areas, and the user is The clarity and detail retention requirements of the area are greater than other areas and other participants who want the instant video interaction to migrate the attention to the diverse needs of the user-specified area, increasing the interactivity and interest of the instant video, further Improve the user experience. For example, the area indicated by the shape input by the user includes a human face. By performing the method of the embodiment of the present invention, when the position of the face changes, the position of the area indicated by the shape input by the user also changes with the face. To ensure that the face is located The picture quality of the area.

An embodiment of the present invention provides a method for transmitting an instant video, by determining whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the shape input by the user, and the traditional instant video transmission method not only satisfies the user's access to a certain area in the instant video. The degree of attention is greater than other areas, the user's requirement for the clarity of a certain area and the amount of detail retention is greater than that of other areas and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area. The user experience also improves the utilization of network bandwidth and saves network resources, thereby improving the transmission efficiency of the instant video and improving the user experience. In addition, the method of the embodiment of the present invention acquires the user input from the current instant video frame. After the area indicated by the shape, the current instant video frame is processed so that Compared with the traditional instant video coding method, in the case where the bandwidth resources are unchanged, more broadband resources are used for the transmission of the area indicated by the shape of the user input, thereby ensuring the area indicated by the shape input by the user. The transmission further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirement for the definition of a certain area is larger than the other areas, and other participants who want the instant video interaction will pay attention to The gradual migration to the diverse needs of the user-specified area increases the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience. In addition, by determining the area indicated by the shape of the user input in the current instant video frame according to the details, such that the detail position in the area indicated by the shape input by the user in the instant video frame changes, the detail can still be guaranteed. The picture quality of the area, which further satisfies the user's attention to an area in the instant video is greater than other areas, the user's requirements for the clarity and detail retention of a certain area are greater than other areas and the user wants instant video. Other participants in the interaction migrated the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience.

Embodiment 6 is a method for displaying an instant video according to an embodiment of the present invention. In the embodiment of the present invention, a location parameter of a shape input by a user includes a description parameter, where the description parameter is used to describe a user selected in an instant video frame. The details of the area indicated by the shape input by the user, exemplarily, if the shape indicated by the shape of the user input selected by the user includes at least a human face, the detail may be the eyes, nose, mouth and eyebrows of the user. And, as shown in FIG. 12, the method includes:

1201. Acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy.

Specifically, the step is the same as step 801, and details are not described herein again.

1202: Obtain a shape input by a user;

Specifically, the selection instruction includes a position parameter of a shape input by the user, and the position parameter includes a description parameter.

Except for this, this step is the same as step 802, and will not be described again here.

1203. Identify details indicated by the description parameters in the current instant video frame.

Specifically, the step is the same as step 1004, and details are not described herein again.

1204. Display an area indicated by the shape in the current instant video frame according to details and a transmission strategy supported by the electronic device.

Based on the coordinates, the processed current instant video frame is displayed.

In addition, the input and the input area are determined and displayed in the current instant video frame according to the details. The specific embodiment of the present invention does not limit the specific manner.

It is to be noted that the step 1203 to the step 1204 is a process of displaying the current instant video frame according to the shape input by the user. In addition to the manner of the foregoing steps, the process may be implemented in other manners. The method is not limited.

Since the picture quality of the input area in the current instant video frame is better than other areas, the user's attention of the electronic device is migrated to the input area in the instant video, thereby satisfying the user to somewhere in the instant video. One area's attention is greater than other areas, users' requirements for a certain area's clarity and detail retention are greater than other areas and other users who want instant video interactions to divert attention to the diverse needs of the user's designated area. , improved user experience. In addition, by identifying the details indicated by the description parameters in the current instant video frame, and determining the input region in the current instant video frame according to the details, in the case where the detail position in the region input in the instant video frame changes, the content is satisfied. The user's attention to details in the input area is greater than other areas, the definition of the details of the input area and the amount of detail retention are greater than other areas and other participants who wish to interact with the video migrate the attention to the input. The details of the area further satisfy the user's attention to a certain area in the instant video is greater than other areas, the user's requirements for the definition of a certain area and the amount of detail retention are greater than other areas and other participation of the user who wants instant video interaction. The migration of attention to the diverse needs of the user-specified area increases the interactivity and fun of instant video, further enhancing the user experience. In addition, by displaying the shape input by the user, it is further possible to migrate the user attention of the electronic device to the shape indicated by the user input in the instant video. The area, so that the user's attention to an area in the instant video is greater than that of other areas, the user's definition of a certain area and the amount of detail retention is greater than other areas and other participants who want the instant video interaction will pay attention The gradual migration to the diverse needs of the user-specified area increases the user experience.

In the embodiment of the present invention, after the processed current instant video frame acquires the shape input by the user, and the network bandwidth satisfies the preset condition, according to the importance matrix of the input region, the area indicated by the shape including at least the input shape is included. The current instant video frame is processed and obtained, wherein the process of obtaining the processed current instant video frame may be implemented on other electronic devices, or may be implemented on the electronic device.

In order to further illustrate the effects achieved by the method provided by the embodiment of the present invention, the method provided by the embodiment of the present invention will be further described below with reference to the accompanying drawings, assuming that the shape of the user input selected by the user is the shape shown in FIG. The interface for obtaining the current current video frame display after processing may be referred to b in FIG. 13, where a in FIG. 13 is an interface displayed after acquiring the current instant video frame, and if the user in the instant video interface is in the screen position, If the change occurs, the interface may refer to c in FIG. 13. In FIG. 13, the sharpness and the detail retention indicated by the second display effect are greater than or equal to the sharpness indicated by the first display effect and the amount of detail retention. The sharpness indicated by the third display effect and the amount of detail retention are smaller than the sharpness indicated by the first display effect and the amount of detail retention.

An embodiment of the present invention provides a method for displaying an instant video, which is obtained by acquiring and displaying a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by Taking the shape input by the user, increasing the form of the area indicated by the user input, improving the interest and interaction of the instant video interaction, increasing the interaction mode of the user in the process of instant video interaction, further satisfying the diversified needs of the user , improved user experience. In addition, by determining and displaying the area indicated by the shape of the user input in the current instant video frame according to the details, the position of the detail in the area indicated by the shape input by the user in the instant video frame is still guaranteed. The picture quality of the area in which the detail is located further satisfies the user's attention to an area in the instant video is greater than that of other areas, the user's requirement for the clarity and detail retention of a certain area is greater than other areas and the user desires Other participants in the instant video interaction migrated the attention to the diverse needs of the user-specified area, increasing the interactivity and fun of the instant video, further enhancing the user experience.

Embodiment 7 is an electronic device 14 according to an embodiment of the present invention. Referring to FIG. 14, the electronic device 14 includes:

The obtaining module 1401 is configured to acquire a shape input by the user;

The first processing module 1402 is configured to determine an area indicated by the shape in the current instant video frame;

The determining module 1403 is configured to determine whether the network bandwidth meets any one of the first preset condition, the second preset condition, the third preset condition, and the fourth preset condition;

The first processing module 1402 is further configured to trigger any one of the following modules according to a preset condition that the network bandwidth meets and a transmission policy supported by the electronic device:

The second processing module 1404 is configured to: when the network bandwidth meets the first preset condition, transmit, according to the first transmission policy, a current instant video frame that includes an area indicated by a shape input by the user; or

The third processing module 1405 is configured to: when the network bandwidth meets the second preset condition, transmit, according to the second transmission policy, a current instant video frame that includes an area indicated by a shape input by the user; or

The fourth processing module 1406 is configured to: when the network bandwidth meets the third preset condition, transmit, according to the third transmission policy, a current instant video frame that includes an area indicated by a shape input by the user; or

The fifth processing module 1407 is configured to: when the network bandwidth meets the fourth preset condition, transmit the current instant video frame including the area indicated by the shape input by the user according to the fourth transmission policy.

Optionally, the obtaining module 1401 is specifically configured to:

Obtaining a curve input by the user, the partial curve included in the curve is a closed curve, and determining that the shape indicated by the closed curve is a shape input by the user;

Obtain a position parameter input by the user, and the position parameter includes any one of a coordinate parameter and a feature parameter.

Optionally, the first processing module 1402 is configured to perform any one of the following operations:

Optionally, the second processing module 1404 is specifically configured to:

The current instant video is processed according to an importance matrix corresponding to the current instant video frame, and the processed instant video frame is obtained;

Transmit processed instant video frames.

Optionally, the second processing module 1404 is specifically configured to:

Obtaining an importance matrix of the area indicated by the shape;

Optionally, the third processing module 1405 is specifically configured to:

Dividing an instant video frame including at least an area indicated by a shape input by the user into at least one macro block, and setting a quantization parameter corresponding to the at least one macro block;

Transmit the encoded instant video frame.

Optionally, the third processing module 1405 is specifically configured to:

Setting a quantization parameter of a macroblock including all or part of the area indicated by the shape to a first number value;

The third processing module 1405 is specifically configured to:

Optionally, the fourth processing module 1406 is specifically configured to:

Obtaining residual data between a current instant video frame and a reference frame including an area indicated by a shape input by the user;

Transmit residual data.

Optionally, the fourth processing module 1406 is specifically configured to:

Optionally, the fifth processing module 1407 is specifically configured to include:

Obtaining a feature parameter for describing an area indicated by a shape input by the user;

Transfer feature parameters.

Optionally, the fifth processing module 1407 is specifically configured to:

Optionally, the electronic device further includes a sending module, configured to:

Send the shape entered by the user to another electronic device.

An embodiment of the present invention provides an electronic device, where the electronic device determines whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the shape input by the user, and the traditional instant video transmission method not only satisfies the user's access to a certain area in the instant video. The degree of attention is greater than other areas, the user's requirement for the clarity of a certain area and the amount of detail retention is greater than that of other areas and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area. The user experience also improves the utilization of network bandwidth and saves network resources, thereby improving the transmission efficiency of the instant video and improving the user experience. In addition, the method of the embodiment of the present invention acquires the user input from the current instant video frame. After the area indicated by the shape, the current instant video frame is processed so that Compared with the traditional instant video coding method, in the case where the bandwidth resources are unchanged, more broadband resources are used for the transmission of the area indicated by the shape of the user input, thereby ensuring the area indicated by the shape input by the user. The transmission further satisfies the user's attention to a certain area in the instant video is greater than other areas, the user's requirement for the definition of a certain area is larger than the other areas, and other participants who want the instant video interaction will pay attention to The gradual migration to the diverse needs of the user-specified area increases the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

Embodiment 8 is an electronic device 15 according to an embodiment of the present invention. Referring to FIG. 15 , the electronic device 15 includes a sending module 1501 , a memory 1502 , and a processor 1503 connected to the sending module 1501 and the memory 1502 . 1502 is for storing a set of program code, and the processor 1503 calls the program code stored in the memory 1502 for performing the following operations:

Get the shape entered by the user;

Determining an area indicated by the shape in the current live video frame;

If the network bandwidth meets the first preset condition, transmitting, according to the first transmission policy, a current instant video frame including an area indicated by the shape; or

If the network bandwidth meets the third preset condition, transmitting, according to the third transmission policy, the current instant video frame including the area indicated by the shape; or

If the network bandwidth satisfies the fourth preset condition, the current instant video frame including the area indicated by the shape is transmitted according to the fourth transmission policy.

Optionally, the processor 1503 calls the program code stored in the memory 1502 to perform the following operations:

Optionally, the processor 1503 calls the program code stored in the memory 1502 to perform any one of the following operations:

Transmit processed instant video frames.

Optionally, the processor 1503 calls the program code stored in the memory 1502 to perform the following operations. Make:

Obtaining an importance matrix of the area indicated by the shape;

Transmit the encoded instant video frame.

The processor 1503 calls the program code stored in the memory 1502 for performing the following operations:

Transmit residual data.

Transfer feature parameters.

Send the shape entered by the user to another electronic device.

An embodiment of the present invention provides an electronic device, where the electronic device determines whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition, thereby According to different network bandwidths, different transmission strategies are adopted for the current instant video frames including the area indicated by the shape input by the user, and the traditional instant video transmission method not only satisfies the user's access to a certain area in the instant video. The degree of attention is greater than other areas, the user's requirement for the clarity of a certain area and the amount of detail retention is greater than that of other areas and other participants who want the instant video interaction to move the attention to the diverse needs of the user-specified area. User experience, also improved The utilization of the network bandwidth saves network resources, thereby improving the transmission efficiency of the instant video and improving the user experience. In addition, since the method of the embodiment of the present invention is to obtain the shape of the user input from the current instant video frame, After the area, the current instant video frame is processed, so that compared with the traditional instant video coding method, more bandwidth resources are used for the transmission of the area indicated by the shape of the user input when the bandwidth resources are unchanged. Thereby, the transmission of the area indicated by the shape input by the user is ensured, further satisfying that the user's attention to an area in the instant video is greater than that of other areas, the user's requirement for the definition of a certain area and the amount of detail retention is greater than other areas. And the other needs of the user who wants the instant video interaction to move the attention to the diverse needs of the user-specified area, improving the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

Embodiment 9 is an electronic device 16 according to an embodiment of the present invention. Referring to FIG. 16, the electronic device 16 includes:

The first obtaining module 1601 is configured to acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

a second obtaining module 1602, configured to acquire a shape input by a user;

The display module 1603 is configured to display the current instant video frame according to the shape of the user input and the transmission policy supported by the electronic device.

An embodiment of the present invention provides an electronic device that satisfies and displays a current instant video frame transmitted according to any one of a first transmission policy, a second transmission policy, a third transmission policy, and a fourth transmission policy. In the process of instant video, the user desires to have more clarity and detail retention of the selected area than other areas, further improving the user experience. In addition, by obtaining the shape input by the user, the form of the area indicated by the user input is increased, the interest and interaction of the instant video interaction are improved, and the interaction mode of the user in the process of instant video interaction is further increased, thereby further satisfying the user's Diversified needs and improved user experience.

Embodiment 10 is an electronic device 17 according to an embodiment of the present invention. Referring to FIG. 17, the electronic device is shown in FIG. The device 17 includes a display 1701, a memory 1702, and a processor 1703 coupled to the display 1701, the memory 1702, wherein the memory 1702 stores a set of program codes, and the processor 1703 calls the program code stored in the memory 1702 for performing the following operations:

Get the shape entered by the user;

The current instant video frame is displayed according to the shape of the user input and the transmission policy supported by the electronic device.

It is to be noted that the interface in the embodiment of the present invention is merely exemplary, and is a further description of the method provided by the embodiment of the present invention. The specific embodiment of the present invention does not limit the specific interface. .

All of the above optional technical solutions may be used in any combination to form an optional embodiment of the present invention, and will not be further described herein.

It should be noted that, when the electronic device provided by the foregoing embodiment performs the encoding of the instant video, only the division of the above functional modules is illustrated. In actual applications, the function distribution may be completed by different functional modules as needed. The internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the embodiment of the present invention is the same as the embodiment of the method for transmitting an instant video. The specific implementation process is described in detail in the method embodiment, and details are not described herein again.

A person skilled in the art can understand that all or part of the steps of implementing the above embodiments may be completed by hardware, or may be executed by a program to instruct related hardware, and the program may be stored in a computer readable storage medium. The storage medium may be a read only memory, a magnetic disk or an optical disk or the like.

The above are only the preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalents, improvements, etc., which are within the spirit and scope of the present invention, should be included in the scope of the present invention. Inside.

Claims

A method for transmitting an instant video, characterized in that the method comprises:

Get the shape entered by the user;

Determining an area indicated by the shape in a current instant video frame;

Perform any of the following operations based on the preset conditions that the network bandwidth meets and the transmission policies supported by the electronic device:

If the network bandwidth meets the first preset condition, transmitting the current instant video frame including the area indicated by the shape according to the first transmission policy; or

If the network bandwidth meets the second preset condition, transmitting the current instant video frame including the area indicated by the shape according to the second transmission policy; or

If the network bandwidth meets a third preset condition, transmitting, according to the third transmission policy, the current instant video frame including the area indicated by the shape; or

If the network bandwidth meets the fourth preset condition, transmitting the current instant video frame including the area indicated by the shape according to the fourth transmission policy.
The method of claim 1 wherein said obtaining a shape of said user input comprises:

Obtaining a curve input by a user, the partial curve included in the curve is a closed curve, and determining that the shape indicated by the closed curve is a shape input by the user;

Obtaining a position parameter input by the user, the position parameter including any one of a coordinate parameter and a feature parameter.
The method according to claim 1 or 2, wherein the area indicated by the shape is determined in the current instant video frame by any one of the following operations:

The position parameter includes a coordinate parameter, and according to the coordinate parameter, determining an area indicated by the shape in a current instant video frame; or

The location parameter includes a description parameter that identifies details indicated by the description parameter in the current instant video frame;

According to the details, an area indicated by the shape is determined in the current instant video frame.
The method according to any one of claims 1 to 3, wherein the transmitting the current instant video frame including the area indicated by the shape of the user input according to the first transmission policy comprises:

And processing the current instant video according to an importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame;

Transmitting the processed instant video frame.
The method according to claim 4, wherein the processing the current instant video according to the importance matrix corresponding to the current instant video frame, and acquiring the processed instant video frame comprises:

Obtaining an importance matrix of the area indicated by the shape;

Performing low-pass filtering on the current instant video frame to obtain the filtered current instant video frame;

And merging the current instant video frame with the filtered current instant video frame according to the importance matrix to generate the processed current instant video frame.
The method according to any one of claims 1 to 5, wherein the transmitting the current instant video frame policy including the area indicated by the shape of the user input according to the second transmission policy comprises:

Dividing an instant video frame including at least an area indicated by the shape of the user input into at least one macroblock, and setting a quantization parameter corresponding to the at least one macroblock;

Encoding the at least one macroblock according to the quantization parameter to generate an encoded instant video frame;

Transmitting the encoded instant video frame.
The method of claim 6 wherein:

The setting the quantization parameter corresponding to the at least one macro block includes:

Setting a quantization parameter of a macroblock including all or part of the area indicated by the shape to a first number value;

Setting a quantization parameter of a macroblock that does not include all or part of the area indicated by the shape as a second value;

And encoding, according to the quantization parameter, the at least one macroblock, and generating the encoded instant video frame includes:

And encoding the at least one macroblock according to the first value and the second value to generate an encoded instant video frame.
The method according to any one of claims 1 to 7, wherein the transmitting the current instant video frame including the area indicated by the shape of the user input according to the third transmission policy comprises:

Acquiring residual data between a current instant video frame and a reference frame including an area indicated by the shape of the user input;

Transmitting the residual data.
The method according to claim 8, wherein the obtaining the residual data between the current instant video frame and the reference frame of the region indicated by the shape of the user input comprises:

Obtaining a position parameter and a posture parameter of the area indicated by the shape;

Normalizing the position parameter and the posture parameter to generate a standard position parameter and a standard posture parameter;

Obtaining residual data between the current instant video frame and the reference frame including the region indicated by the shape according to the standard position parameter and the standard posture parameter.
The method according to claim 3, wherein the transmitting the current instant video frame including the area indicated by the shape of the user input according to the fourth transmission policy comprises:

Obtaining a feature parameter for describing an area indicated by the shape of the user input;

Transmitting the feature parameters.
The method according to claim 10, wherein the acquiring characteristic parameters for describing an area indicated by the shape of the user input comprises:

Triangulating the area indicated by the shape to obtain at least one triangular area;

Acquiring the attitude parameter and the position parameter corresponding to the at least one triangular area;

And generating the feature parameter according to the posture parameter and the position parameter corresponding to the at least one triangular region.
The method according to any one of claims 1 to 11, wherein the method further comprises:

The shape input by the user is sent to other electronic devices.
An instant video display method, the method comprising:

Obtaining a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

Get the shape entered by the user;

The current instant video frame is displayed according to the shape of the user input and a transmission policy supported by the electronic device.
An electronic device, comprising:

An acquisition module for obtaining a shape input by a user;

a first processing module, configured to determine an area indicated by the shape in a current instant video frame;

a determining module, configured to determine whether the network bandwidth meets any one of a first preset condition, a second preset condition, a third preset condition, and a fourth preset condition;

The first processing module is further configured to trigger any one of the following modules according to a preset condition that the network bandwidth meets and a transmission policy supported by the electronic device:

a second processing module, configured to: when the network bandwidth meets the first preset condition, transmit the current instant video frame including an area indicated by the shape of the user input according to the first transmission policy; or

a third processing module, configured to: when the network bandwidth meets the second preset condition, transmit the current instant video frame including an area indicated by the shape of the user input according to the second transmission policy; or

a fourth processing module, configured to: when the network bandwidth meets the third preset condition, transmit the current instant video frame including an area indicated by the shape of the user input according to the third transmission policy; or

And a fifth processing module, configured to: when the network bandwidth meets the fourth preset condition, transmit the current instant video frame including the area indicated by the shape of the user input according to the fourth transmission policy.
An electronic device, comprising:

a first acquiring module, configured to acquire a current instant video frame that is transmitted by the electronic device according to any one of the first transmission policy, the second transmission policy, the third transmission policy, and the fourth transmission policy;

a second obtaining module, configured to acquire a shape input by the user;

And a display module, configured to display the current instant video frame according to the shape of the user input and a transmission policy supported by the electronic device.