CN112911320B

CN112911320B - Live broadcast method, live broadcast device, computer equipment and storage medium

Info

Publication number: CN112911320B
Application number: CN202110070818.0A
Authority: CN
Inventors: 卢佐卿; 麦志英; 廖卓杰
Original assignee: Guangzhou Huya Technology Co Ltd
Current assignee: Guangzhou Huya Technology Co Ltd
Priority date: 2021-01-19
Filing date: 2021-01-19
Publication date: 2023-06-20
Anticipated expiration: 2041-01-19
Also published as: CN112911320A

Abstract

The embodiment of the invention provides a live broadcast method, a live broadcast device, computer equipment and a storage medium, wherein the method comprises the following steps: receiving an opening operation, running an anchor program indicated by the opening operation in a server, publishing live broadcast data generated by the anchor program in a live broadcast room indicated by the opening operation, pushing the live broadcast data to a client side entering the live broadcast room for playing, receiving user operation sent by a viewer program at the client side, sending the user operation to the anchor program, and updating the live broadcast data according to the user operation by the anchor program.

Description

Live broadcast method, live broadcast device, computer equipment and storage medium

Technical Field

The embodiment of the invention relates to the technical field of live broadcasting, in particular to a live broadcasting method, a live broadcasting device, computer equipment and a storage medium.

Background

With the development of the internet, particularly the popularization of electronic devices such as personal computers and mobile terminals, live broadcasting is becoming popular in work, life and entertainment of people.

In general, a host user opens a live broadcast room, collects live broadcast data by using electronic equipment, distributes the live broadcast data to the live broadcast room, and a viewer user can log in the live broadcast room to watch the live broadcast data.

The audience users and the audience users can interact based on the live broadcasting room environment, part of interaction is that the audience users need to participate, for example, a plurality of the audience users are connected with each other, the audience users support different audience users in different groups, and part of interaction is that the audience users do not need to participate, for example, a plurality of the audience users participate in games such as racing cars, fighting, building blocks and the like.

For the interaction which does not need the participation of the anchor user, the live broadcasting room is still started by the anchor user, so that the operation is complicated, and the time of the anchor user is wasted.

Disclosure of Invention

The embodiment of the invention provides a live broadcasting method, a live broadcasting device, computer equipment and a storage medium, which are used for solving the problem that interaction which does not need participation of a host user depends on the host user to start a live broadcasting room.

In a first aspect, an embodiment of the present invention provides a live broadcast method, applied to a server, where the method includes:

receiving a start operation;

running a host program indicated by the opening operation in the server;

Releasing live broadcast data generated by the main broadcasting program in a live broadcasting room indicated by the opening operation so as to push the live broadcast data to a client side entering the live broadcasting room for playing;

receiving user operation sent by a viewer program at the client;

and sending the user operation to the anchor program, wherein the anchor program is used for updating the live broadcast data according to the user operation.

In a second aspect, an embodiment of the present invention further provides a live broadcast method, applied to a client, where the method includes:

displaying a page of the live broadcasting room;

loading a viewer program for application to the living room;

displaying a first area and a second area in the page, wherein the first area is used for displaying live broadcast data which is generated by a host program running on a server and is distributed in the live broadcast room, and the second area is used for displaying an operation interface of the audience program;

receiving user operation in the operation interface;

and displaying live broadcast data updated by the anchor program according to the user operation in the first area.

In a third aspect, an embodiment of the present invention further provides a live broadcast apparatus, applied to a server, where the apparatus includes:

The system comprises an operation receiving module, a program starting module and a program starting module, wherein the operation receiving module is used for receiving the operation;

the anchor program running module is used for running the anchor program indicated by the open operation in the server;

the live broadcast data release module is used for releasing live broadcast data generated by the main broadcast program in the live broadcast room indicated by the opening operation so as to push the live broadcast data to a client side entering the live broadcast room for playing;

the user operation receiving module is used for receiving user operation sent by the audience program positioned at the client;

and the user operation forwarding module is used for sending the user operation to the anchor program, and the anchor program is used for updating the live broadcast data according to the user operation.

In a fourth aspect, an embodiment of the present invention further provides a live broadcast apparatus, applied to a client, where the apparatus includes:

the page display module is used for displaying the page of the live broadcasting room;

a viewer program loading module for loading a viewer program applied to the living room;

the page area display module is used for displaying a first area and a second area in the page, wherein the first area is used for displaying live broadcast data which is generated by a host program running on a server and is distributed in the live broadcast room, and the second area is used for displaying an operation interface of the audience program;

The user operation receiving module is used for receiving user operation in the operation interface;

and the live broadcast data updating display module is used for displaying live broadcast data updated by the host program according to the user operation in the first area.

In a fifth aspect, embodiments of the present invention further provide a computer apparatus, the computer apparatus including:

one or more processors;

a memory for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the live method of the first or second aspect.

In a sixth aspect, embodiments of the present invention further provide a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the live broadcast method according to the first or second aspect.

In this embodiment, a server receives an opening operation, an anchor program indicated by the opening operation is run in the server, live broadcast data generated by the anchor program is released in a live broadcast room indicated by the opening operation, so that live broadcast data are pushed to a client side entering the live broadcast room for playing, user operation sent by the client side audience program is received, the user operation is sent to the anchor program, the anchor program is used for updating live broadcast data according to the user operation, the cloud opening framework is provided, for interaction which does not need to be participated by an anchor user, live broadcast data can be generated by the anchor program at the server, interaction of audiences is controlled, the operation is simple and convenient, time waste of the anchor user is reduced, in addition, a developer follows the cloud opening framework, different types of anchor programs and audience programs can be developed, functions realized by the anchor program and the audience program are relatively few in platform and client side, development technology threshold is low, development period is short, different types of interaction can be realized according to service requirements in the room, and diversity of live broadcast interaction between users can be enriched.

Drawings

Fig. 1 is a flowchart of a live broadcast method according to a first embodiment of the present invention;

fig. 2 is a flowchart of a live broadcast method according to a second embodiment of the present invention;

fig. 3 is an exemplary diagram of a live room according to a second embodiment of the present invention;

fig. 4 is a signaling diagram of live broadcast according to a second embodiment of the present invention;

fig. 5 is a schematic structural diagram of a live broadcast device according to a third embodiment of the present invention;

fig. 6 is a schematic structural diagram of a live broadcast device according to a fourth embodiment of the present invention;

fig. 7 is a schematic structural diagram of a computer device according to a fifth embodiment of the present invention.

Detailed Description

The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.

Example 1

Fig. 1 is a flowchart of a live broadcast method provided in an embodiment of the present invention, where the method may be applicable to a cloud end play situation, and the method may be performed by a live broadcast device, where the live broadcast device may be implemented by software and/or hardware, and may be configured in a computer device serving as a cloud end, for example, a Server, a workstation, and the like, where the computer device may deploy a Server, and the method may be applied to the Server, and specifically includes the following steps:

Step 101, receiving a start operation.

In this embodiment, an open operation may be sent to the server, where the open operation may be an operation of turning on a live broadcast, so that an open state is switched from off to on for a specified live broadcast room.

In one case, the live room is not affiliated with a host user (represented in the form of a user ID, etc.), i.e., the live room is a public live room.

In this case, the operator (expressed in the form of user ID, etc.) may set information (such as name, introduction information, etc.) of the live broadcasting room at the client side logging in the operation side according to the service requirement, actively trigger the broadcasting operation, so as to create the live broadcasting room to perform live broadcasting depending on the information, or set information of the triggering condition live broadcasting room at the client side logging in the operation side by the operator, automatically trigger the broadcasting operation when the triggering condition is satisfied, so as to create the live broadcasting room to perform live broadcasting depending on the information.

Illustratively, the triggering condition is a designated time, and the time may be a time when the access amount of the live platform is high, a time when a certain game event starts, and the like, and when the designated time is reached, the operation of opening is automatically triggered, so as to meet the service requirement.

The triggering condition is the number of idle public living rooms, and when the number of the public living rooms of all or a certain type is smaller than a preset threshold value, the operation of opening the broadcasting is automatically triggered, a new living room is created for living, and therefore the requirement that audience users use the public living rooms is met.

In one case, the living room is affiliated with a host user, i.e., the living room is a private living room.

In this case, when the live broadcasting room is required to be started, for example, the live broadcasting user completes a live broadcasting but the audience user still needs to interact, logs in the client side of the live broadcasting, sets information of the live broadcasting room, and accordingly triggers the operation of starting the live broadcasting, and creates the live broadcasting room to live broadcasting depending on the information.

Step 102, running the anchor program indicated by the opening operation in the server.

The embodiment provides a framework for cloud play, and a developer can develop a host program meeting business requirements according to the specification of the framework.

The program is a code capable of running the program logic to simulate the role of the user of the program, control the user of the audience (expressed in the form of user ID, etc.) to interact in the live broadcast room, and the program is independent of the client side of the program, and the program logic is simple and small, so the program can be called as small program.

Further, the anchor program may be in the form of JavaScript script, plug-in, executable file (such as exe file), etc., which the present embodiment is not limited to.

In a specific implementation, different hosting programs can implement different types of hosting logic, and the interaction modes supported by the hosting programs are different, for example, the hosting program can implement logic of games such as racing, fighting, stacking, and the like, audience users are supported to play games such as racing, fighting, stacking, and the like in a live broadcast room, the hosting program can implement logic of video conferences, audience users are supported to share writing information in the live broadcast room, the hosting program can implement logic of online education, audience users (students) are supported to share drawing, answering, and the like.

Of course, the above-mentioned anchor program is only an example, and other anchor programs may be set according to actual situations when implementing the embodiment of the present invention, which is not limited thereto. In addition, in addition to the above-mentioned anchor program, those skilled in the art may also adopt other anchor programs according to actual needs, which are not limited in this embodiment of the present invention.

The developer registers the anchor programs in the server, and when the registration is successful, the anchor programs are identified as legal anchor programs by the server, and can be stored in a designated database, and a mapping relationship between a first address of the anchor program in the database and an ID of the anchor program is established, where the database may be a local database of a computer device where the server is located, or a database independent of the computer device where the server is located (such as a content distribution network (Content Delivery Network, CDN)), which is not limited in this embodiment.

If the server receives the opening operation, authentication can be performed on the opening operation, if the opening operation is legal, the ID of the host program can be read from the opening operation, a first address mapped by the ID is queried in a preset mapping relation, the first address is accessed, and the host program indicated by the opening operation is searched from a database, so that the host program is locally operated at the server.

In one embodiment of the present invention, step 102 may include the steps of:

step 1021, obtaining the anchor program indicated by the open operation.

The server side responds to the opening operation, analyzes the ID of the anchor program from the opening operation, and reads the anchor program corresponding to the ID from the database.

If the anchor program is stored in the local database, the server may query the local database for the anchor program corresponding to the ID.

If the anchor program is stored in the content distribution network, the server can determine the anchor program indicated by the opening operation, inquire the first address of the anchor program stored in the content distribution network, access the first address, and download the anchor program from the content distribution network.

Step 1022, if the anchor program is a JavaScript script, creating a browsing application in the server.

If the type of the anchor program is JavaScript, the server may create a browsing application locally, which may be an application with browser functionality, supporting JavaScript script running, which may be implemented as a process, thread, etc.

Step 1023, executing the anchor program in the browsing application.

The server side sends the host program (namely, the JavaScript script) to the browsing application, and the browsing application executes the host program (namely, the JavaScript script) so that the host program (namely, the JavaScript script) runs in the environment of the browsing application.

In this embodiment, the anchor program (i.e., javaScript script) may be used to render pages that the browsing application may load, display, and/or generate audio signals that may call the API (Application Programming Interface ) of the browsing component to play.

In one embodiment of the present invention, step 102 may further include the steps of:

step 1024, establish a dual full-duplex connection with the browsing application.

In this embodiment, the server may establish a double Duplex (Full Duplex) connection with the browsing application, such as WebSocket (web nested word) connection, and communicate with the anchor program through the browsing application as a relay.

The dual-full-technology allows data to be transmitted simultaneously in two directions, which is equivalent to the combination of two simplex communication modes in terms of capability, namely, the bidirectional transmission of signals can be performed simultaneously (instantaneously), the server side can transmit data to the browsing application, and the browsing application can transmit data to the server side.

Taking WebSocket connection as an example, the process of establishing WebSocket connection between a server and a browsing application is as follows:

1. browse application protocol upgrades

The browse application initiates a protocol upgrade request, adopts a standard HTTP (HyperText Transfer Protocol ) message format, and supports a GET method.

GET/HTTP/1.1

Host:localhost:8080

Origin:http://127.0.0.1:3000

Connection:Upgrade

Upgrade:websocket

Sec-WebSocket-Version:13

Sec-WebSocket-Key:w4v7O6xFTi36lq3RNcgctw＝＝

Wherein, "Connection: upgrade" represents an Upgrade protocol, "Upgrade: webSocket" represents a WebSocket protocol to be upgraded to, "Sec-Websocket-Version:13" represents a Version of WebSocket, and if the server does not support the Version, "Sec-Websocket-Version header" is returned, the Version number supported by the server is contained therein, and "Sec-Websocket-Key" is matched with "Sec-Websocket-Accept" of the header of the server response to provide basic protection, such as malicious Connection, or unintentional Connection.

Note that, the above request omits a part of the non-emphasized request header, and the request header like Host, origin, cookie is transmitted as usual because it is a standard HTTP request. In the handshake phase, security restrictions, rights checks, etc. may be performed through the relevant request header.

2. Server-side response protocol upgrade

The server returns the following, and the status code 101 indicates a protocol switch. To this end, protocol upgrades are completed, and the subsequent data interactions are performed according to the new protocol:

HTTP/1.1 101Switching Protocols

Connection:Upgrade

Upgrade:websocket

Sec-WebSocket-Accept:Oy4NRAQ13jhfONC7bP8dTKb4PTU＝

the HTTP status code responded by the server is used in the handshake stage, and a specific error code is adopted after the handshake stage is passed.

Step 103, publishing the live broadcast data generated by the main broadcasting program in the live broadcast room indicated by the opening operation so as to push the live broadcast data to the client side entering the live broadcast room for playing.

The server responds to the on-stream operation, on one hand, the on-stream operation is inquired to indicate the on-stream live broadcasting room, on the other hand, the main broadcasting program can automatically generate live broadcasting data, the live broadcasting data generated by the main broadcasting program is received, the live broadcasting data are published in the live broadcasting room of the live broadcasting platform (such as a live broadcasting server), the live broadcasting platform can add partial information such as LOGO, online number, bandwidth value, barrage and the like of the live broadcasting platform in the live broadcasting data, the live broadcasting platform (such as the live broadcasting server) discloses the live broadcasting room, the client side of the audience side enters the live broadcasting room, the live broadcasting data are pulled from the live broadcasting platform (such as the live broadcasting server), and the live broadcasting data are played in the client side of the audience side.

In one embodiment of the invention, step 103 comprises the steps of:

step 1031, determining the live broadcasting room indicated by the operation of opening.

If the on-air operation is actively triggered by an operator or an anchor user, at this time, information (such as a name, introduction information, etc.) of the live broadcasting room may be extracted from the on-air operation, so as to create the live broadcasting room depending on the information, or an ID of the live broadcasting room may be extracted from the on-air operation, so as to determine the live broadcasting room corresponding to the ID.

If the start operation is triggered by the trigger condition, at this time, the information of the previously set live broadcasting room can be read from the database, so that the live broadcasting room is created to carry out live broadcasting according to the information, or the ID of the live broadcasting room can be read from the database, so as to determine the live broadcasting room corresponding to the ID.

Step 1032, continuously capturing image signals and/or audio signals generated by the anchor program at run-time.

During the operation of the anchor program, the server may continuously generate image signals and/or audio signals according to logic thereof, and continuously capture the image data and/or audio signals so as to generate live broadcast data.

In one example, if a host program (e.g., javaScript script) is running in the browsing application, the server may call a graphics programmer, such as OpenGL, directX, to continually capture the image signals generated by the browsing application when the page is displayed.

And/or

In another example, if a host program (e.g., javaScript script) is running in the browsing application, the audio signals generated by the host program are continually captured from the audio interface of the browsing application.

Of course, the above-mentioned manner of capturing the image signal and/or the audio signal is merely an example, and other manners of capturing the image signal and/or the audio signal may be set according to practical situations when implementing the embodiment of the present invention, for example, if the host program is an executable file, the host program may generate streaming image data by itself, and the embodiment of the present invention is not limited thereto. In addition, in addition to the above-mentioned manner of capturing the image signal and/or the audio signal, those skilled in the art may also use other manners of capturing the image signal and/or the audio signal according to actual needs, which is not limited by the embodiment of the present invention.

Step 1033 encodes the image signal and/or audio signal into live data.

In one aspect, the audio signal is mostly PCM (Pulse Code Modulation ) or other original data, and the server may call the encoder to encode the audio signal into a specified audio format, such as AAC (Advanced Audio Coding ), or the like.

On the other hand, the image signal is mostly YUV (Y represents brightness (Luminance, luma), U represents chromaticity (Chroma)), and V represents density (Chroma)), and the server may call the encoder to encode the image signal into a specified video format, as a video signal, such as h.264 (digital video compression format).

Thereafter, the server may call a packetizer to encapsulate the audio signal in the specified audio format and the Video signal in the specified Video format into live data in the specified stream format, such as MP4 (Moving Picture Experts Group ), FLV (Flash Video, streaming format), and the like.

Step 1034, publishing the live data in the live broadcast room to push the live data to the client side entering the live broadcast room for playing.

The server may send the live data to a live broadcast platform (live broadcast server) through RTSP (Real Time Streaming Protocol, real-time streaming protocol), RTMP (Real Time Messaging Protocol, real-time messaging protocol), HLS (HTTP Live Streaming, streaming media transmission protocol based on HTTP (Hyper Text Transport Protocol, hypertext transmission protocol)) and other protocols, where the live broadcast platform (live broadcast server) discloses the live broadcast room, so that the audience can open the live broadcast room in the client, receive the live broadcast data stream, and play the live broadcast data stream.

Step 104, receiving user operation sent by the audience program at the client.

The embodiment provides a framework for cloud play, a developer can develop audience programs meeting business requirements according to the specification of the framework, and the anchor programs and the audience programs are matched with each other, namely, the audience programs provide services for the anchor programs, and the anchor programs respond to requests of clients and execute corresponding business operations.

The audience program is a code capable of running audience logic, interacts with other audience users in a live broadcast room in the role of the audience users, is independent of clients on the audience side, can run in the environment of the clients on the audience side, and is simple and small in logic, so that the audience program can be called as an applet.

Further, the viewer program may be in the form of JavaScript script, plug-in, executable file (e.g., exe file), etc., which the present embodiment is not limited to.

In a specific implementation, different audience programs may implement different types of audience logic, so that the business operations that the audience user may trigger may also be different, for example, a host program may provide services for games such as racing, fighting, stacking, etc., an audience program may control virtual objects such as vehicles, characters, building blocks, etc., in a living room, for example, the host program may provide services for video conferencing, an audience program may write information in a living room, for example, the host program may provide services for online education, an audience program may draw, answer questions, etc., in a living room.

Of course, the above viewer program is merely an example, and other viewer programs may be set according to actual situations when implementing the embodiment of the present invention, which is not limited thereto. In addition, in addition to the above viewer program, those skilled in the art may also use other viewer programs according to actual needs, which are not limited by the embodiments of the present invention.

The developer registers the audience programs in the server, and when the registration is successful, the anchor program is identified as a legal audience program by the server, and can be stored in a designated database, and a mapping relationship between a second address of the audience program in the database and an ID of the audience program is established, where the database may be a database local to the computer device where the server is located, or may be a database independent of the computer device where the server is located (such as a content distribution network).

For the case that the audience program is stored in the content distribution network, the server can determine the audience program matched with the anchor program, inquire the second address of the audience program stored in the content distribution network, issue the second address in the live broadcast room indicated by the opening operation, access the second address when the client enters the live broadcast room, download the audience program from the content distribution network, execute the audience program, and the content distribution network can ensure the speed of responding to loading the live broadcast room because of the small size of the audience program and the high speed of distributing the audience program.

The client on the audience side can receive user operations triggered by a large audience user, such as clicking operations, sliding operations and the like, wherein the user operations can be used for realizing interaction in the environment of the living broadcast room and are sent to the server side in the form of a specified data structure.

Step 105, the user operation is sent to the anchor program.

The server transmits the user operation of the audience program to the anchor program, and the anchor program is used for updating live broadcast data according to the user operation and logic of the anchor program, and at the moment, clients on other audience sides in the same live broadcast room can browse the user operation triggered by the client on the current audience side, so that interaction among audience users is realized.

In a specific implementation, if a host program (e.g., javaScript script) runs in a browsing application, determining a dual-full-operation connection (e.g., webSocket connection) with the browsing application, sending interactive data to the browsing application through the dual-full-operation connection, updating a page and/or an audio signal according to user operation when the host program is executed, and then, when executing step 103, the server issues live broadcast data updated by the host program according to the user operation in a live broadcast room indicated by a start-up operation, so as to push the live broadcast data updated according to the user operation to a client side entering the live broadcast room for playing.

Example two

Fig. 2 is a flowchart of a live broadcast method provided in a second embodiment of the present invention, where the method may be applicable to a cloud end play situation, and the method may be performed by a live broadcast device, where the live broadcast device may be implemented by software and/or hardware, and may be configured in a computer device, for example, the computer device may include a mobile terminal such as a mobile phone, a tablet computer, an intelligent wearable device (such as a smart glasses, a smart watch, etc.), and the computer device may also include a non-mobile terminal such as a personal computer, and the computer device may deploy a Client, where the method specifically includes the following steps:

step 201, displaying a page in which a live broadcasting room is located.

In practical applications, the operating system of the computer device may include Android (Android), IOS, windows Phone, windows, etc., and may run a client supporting live broadcast, where the client may be a browser or a non-browser (such as an application independently used for live broadcast, an instant messaging tool, a search application, a music application, etc.), which is not limited in this embodiment.

Further, the browser may be architecturally split into two parts, namely a kernel (e.g., a Trident kernel, a Gecko kernel, a Webkit kernel, a prest kernel, etc.) and a shell. The browser kernel refers to the core part of the browser, and can be divided into two parts: rendering engines (layout engines or Rendering engines) and JS (JavaScript) engines. The rendering engine is mainly responsible for obtaining the content of the web page (including HTML (HyperText Markup Language, hypertext markup language), XML (eXtensible Markup Language ), images, etc.), finishing information (such as adding CSS (Cascading Style Sheets, cascading style sheets), etc.), calculating the display mode of the page, and outputting the calculated display mode to a display or a printer. The different browser kernels may have different syntax interpretations for the pages, so the rendering effect is also different. All page browsers, email clients, and other applications that need to edit and display web content require a kernel. The JS engine analyzes the JavaScript script and executes the JavaScript script to realize the dynamic effect of the page.

For non-browser clients, a browsing component with a browser kernel may be deployed to load pages, e.g., for a browsing component web view WebView, the browser kernel configured is a Webkit kernel.

The audience user can open the page of the live broadcasting room by clicking a certain link so as to trigger loading operation, or input a website in an address bar so as to open the page of the live broadcasting room so as to trigger loading operation, when the user initiates loading operation for displaying and browsing the page of the live broadcasting room through a client, the client downloads the content of the page of the live broadcasting room from a target website through a kernel, then analyzes the content of the page of the live broadcasting room, executes script, calculates typesetting, and finally outputs the script to the screen for display to the user.

Wherein the load operation may include an identification of the page and/or a feature of the page that the user requested to be loaded. The page identity may be information representing a uniquely determined page, such as a uniform resource identifier (Uniform Resource Identifier, URI), which in turn may specifically comprise a uniform resource locator (Uniform Resource Locator, URL), or a uniform resource name (Uniform Resource Name, URN), etc.

Taking the WebView as an example, if the page in the live broadcasting room is a webpage, the method webview.loadUrl ("http:// www.example.com") can be called to load the page in the live broadcasting room.

If the page in the live broadcasting room is a web page in the client resource file, a method webView.loadUrl ("file:// android_asset/test.html") can be called to load the page in the live broadcasting room.

In response to the load operation, the live platform (live server) may be accessed through a protocol such as HTTP (Hypertext transfer protocol ), and page documents and resource files for the pages located at the live room may be received from the live platform (live server), which may be specified by URLs and in the HTTP protocol by MIME (Multipurpose Internet Mail Extensions ).

It should be noted that, for the different live broadcast platforms (live broadcast servers), the pages of the live broadcast rooms are different due to different kinds of services, for example, live broadcast programs hosted by the host user, comments sent by the audience user, virtual gifts, lists, dynamic states of other host users, other host users recommended to the audience user, and so on, which is not limited in this embodiment.

Step 202, loading a viewer program applied to a live broadcast room.

In this embodiment, when the client parses the page document and the resource file of the page where the live broadcasting room is located, the client may parse to that the live broadcasting room applies the viewer program, and at this time, the client may acquire the viewer program, and operate the viewer program in the environment of the client.

In particular implementations, a client may obtain a viewer program for application to a live room.

If the viewer program is stored in a local database, the client may query the local database for the viewer program corresponding to the ID.

If the audience program is stored in the content distribution network, the client can determine the audience program applied to the living broadcast room, inquire the second address of the audience program stored in the content distribution network, access the second address, and download the audience program from the content distribution network, and the content distribution network can ensure the speed of loading the living broadcast room in response to the client because the audience program has smaller volume and high speed of distributing the audience program.

Among the different types of clients, the manner in which they execute viewer programs varies.

If the client is of the browser type and the viewer program is a JavaScript script, the browser can directly execute the JavaScript script, so that the viewer program can be executed in the client.

If the client is of a non-browser type and the viewer program is a JavaScript script, the browser cannot directly execute the JavaScript, and then a browsing component (such as WebView) in the client can be called to execute the viewer program.

And 203, displaying the first area and the second area in the page.

In this embodiment, two areas, namely, a first area and a second area, are divided on a page where a live broadcast room is located, where the first area is used to display live broadcast data generated by a host program running on a server and distributed in the live broadcast room, and a control that can be operated by a viewer user is displayed on the operation interface.

It should be noted that, for different types of viewer programs, the operation interfaces thereof are different, for example, if the viewer program controls virtual objects such as vehicles, characters, building blocks, etc. in the living broadcast room, the operation interfaces may display controls for controlling movement, acceleration, braking, releasing skills, etc. of the virtual characters, for example, if the viewer program writes information in the living broadcast room, the operation interfaces may display controls for adjusting parameters (such as colors, thicknesses, etc.) of handwriting, and for example, if the viewer program draws and answers questions in the living broadcast room, the operation interfaces may display controls for operating (such as turning pages, freezing, etc.) courseware, controls for adjusting parameters (such as colors, thicknesses, etc.) of handwriting, etc.

Taking a game as an example, as shown in fig. 3, in a page 300 where a live broadcasting room is located, a first interface 301 and a second interface 302 are displayed, the first interface 301 displays a fight screen among a plurality of characters, the second interface 302 displays controls for controlling the characters, including controls for controlling movement of the characters and controls for controlling skills of the characters, and a user can operate the controls in the second interface 302, thereby controlling the characters.

In a specific implementation, in a cloud-end-play framework, live broadcast data of the live broadcast room are generated by a host program running on a server side, at this time, the server side can acquire the host program, the host program indicated by a play operation is locally run on the server side, and the live broadcast data generated by the host program is released in the live broadcast room indicated by the play operation so as to push the live broadcast data to a client side entering the live broadcast room for playing.

In general, the live broadcast data is virtual live broadcast data, and is not live broadcast data in a real environment acquired by a camera, and at this time, a host user can be separated from the live broadcast in the cloud.

Further, if the anchor program is a JavaScript script, the browsing application in the server executes the anchor program, where the anchor program is used to render the page and/or generate the audio signal.

Optionally, a dual-full connection is established between the anchor program and the browsing application.

In one embodiment of the invention, the anchor program is further adapted to generate an image signal and/or an audio signal at run-time; the image signal and/or the audio signal are used for encoding as live data distributed in a live room.

In one embodiment of the invention, if the anchor program is running in a browsing application, the browsing application is further configured to generate an image signal when displaying the page;

and/or

If the anchor program is running in the browsing application, the audio interface of the browsing application is used for playing the audio signal generated by the anchor program.

Step 204, receiving user operation in an operation interface.

In a specific implementation, the user of the audience can trigger the user operation on the operation interface by using a finger or a touch pen in a touch manner, for example, clicking, long pressing, sliding, and the like, so that the client receives the user operation.

Of course, besides the touch mode, the audience user can trigger the user operation by using the key control mode through the external equipment connected with the computer equipment where the client is located, so that the client receives the user operation. The external device includes, but is not limited to, a mouse and the like.

Step 205, live broadcast data updated by the anchor program according to the user operation is displayed in the first area.

In this embodiment, the viewer program transmits the user operation to the server, and the server transmits the user operation to the anchor program in the same live broadcasting room, where the anchor program is configured to update live broadcasting data according to the user operation.

Further, if the anchor program is running in the browsing application, the dual-full connection between the server and the browsing application is used to send user operations to the browsing application to update pages and/or audio signals according to the user operations when the anchor program is executed.

In this embodiment, since the anchor program and the viewer program are substantially similar to those of the first embodiment, the description is relatively simple, and the relevant points are only referred to in the description of the first embodiment, which is not described in detail herein.

In the embodiment, the client displays the page where the live broadcasting room is located, loads the audience program applied to the live broadcasting room, displays a first area and a second area in the page, wherein the first area is used for displaying live broadcasting data which are generated by the host broadcasting program running on the server side and distributed in the live broadcasting room, the second area is used for displaying an operation interface of the audience program, user operation is received in the operation interface, live broadcasting data updated according to the user operation are displayed in the first area, the cloud broadcasting framework is provided, for interaction which does not need to be participated by the host broadcasting user, the host broadcasting program can generate live broadcasting data on the server side, interaction is controlled by the host broadcasting program, the operation is simple and convenient, time waste of the host broadcasting user is reduced, in addition, developers follow the framework of the cloud broadcasting, different types of host broadcasting programs and audience programs can be developed, functions realized by the host broadcasting programs and the programs are relatively less than those of the live broadcasting platform and the client side, the development technology threshold is low, development period is short, different types of interaction can be realized in the room according to service requirements, the interaction flexibility is high, and diversity of live broadcasting users in the middle can be enriched.

In order for those skilled in the art to better understand the present embodiment, the live broadcasting method in the present embodiment is described below by way of specific examples.

As shown in fig. 4, according to the cloud-end-play framework provided in this embodiment, a developer develops a host program and a viewer program in a JavaScript script form, which are paired with each other, in S401, registers the host program and the viewer program to a server, and after the operator checks that the host program and the viewer program are legal, in S402, the server stores the host program and the viewer program to the CDN.

When the cloud end is opened, a developer or an anchor user triggers an opening operation, an anchor program, an audience program and a live broadcasting room are designated, at this time, in S403, a server receives the opening operation, in S404, the server obtains the anchor program indicated by the opening operation from a CDN, in S405, a server creates a browsing application to execute the anchor program, establishes WebSocket connection with the anchor program, in S406, the anchor program generates live broadcasting data according to own logic, in S407, the server continuously receives the live broadcasting data generated by the anchor program through WebSocket connection, encodes according to a streaming format, and after encoding is completed, distributes the live broadcasting data to the live broadcasting room indicated by the opening operation.

In S408, the client enters the living broadcast room to display the page in the living broadcast room for the audience to browse and watch the living broadcast data, in S409, if the audience wants to participate in the interaction in the living broadcast room, the control client obtains the audience program indicated by the opening operation from the CDN, in S410, the client executes the audience program, displays the control interface of the audience program, the audience triggers the user operation on the control interface, at this time, in S411, the audience program receives the user operation, in S412, the audience program converts the user operation into a designated data structure to transmit the user operation to the server, in S413, the server transmits the user operation to the host program through WebSocket connection, in S414, the host program, after receiving the user operation, updates the living broadcast data according to own logic, at this time, the server receives the data updated by the host program through WebSocket connection, encodes according to the streaming format, after the encoding is completed, the data after the update is released to the living broadcast operation indicating the living broadcast operation in the living broadcast room, and in S413, the living broadcast operation can be watched by all the audience.

It should be noted that, for simplicity of description, the method embodiments are shown as a series of acts, but it should be understood by those skilled in the art that the embodiments are not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the embodiments. Further, those skilled in the art will appreciate that the embodiments described in the specification are presently preferred embodiments, and that the acts are not necessarily required by the embodiments of the invention.

Example III

Fig. 5 is a block diagram of a live broadcast device according to a third embodiment of the present invention, which is applied to a server, where the device may specifically include the following modules:

a multicast operation receiving module 501, configured to receive a multicast operation;

a main program running module 502, configured to run a main program indicated by the multicast operation in the server;

a live broadcast data publishing module 503, configured to publish live broadcast data generated by the main broadcast program in a live broadcast room indicated by the opening operation, so as to push the live broadcast data to a client entering the live broadcast room for playing;

a user operation receiving module 504, configured to receive a user operation sent by an audience program located at the client;

A user operation forwarding module 505, configured to send the user operation to the anchor program, where the anchor program is configured to update the live broadcast data according to the user operation.

In one embodiment of the present invention, the anchor program execution module 502 includes:

the anchor program acquisition module is used for acquiring an anchor program indicated by the open operation;

the browse application creation module is used for creating browse application in the server if the anchor program is a JavaScript script;

and the anchor program execution module is used for executing the anchor program in the browsing application, and the anchor program is used for rendering pages and/or generating audio signals.

In one embodiment of the present invention, the anchor program acquisition module includes:

the anchor program determining module is used for determining an anchor program indicated by the open operation;

a first address querying module, configured to query a first address of the anchor program stored in a content distribution network;

and the anchor program downloading module is used for accessing the first address and downloading the anchor program from the content distribution network.

In one embodiment of the present invention, the anchor program acquisition module further includes:

And the connection establishment module is used for establishing double full-duplex connection with the browsing application.

In one embodiment of the present invention, the live data publishing module 503 includes:

the live broadcasting room determining module is used for determining a live broadcasting room indicated by the opening operation;

the signal capturing module is used for continuously capturing image signals and/or audio signals generated by the anchor program during running;

the live broadcast data encoding module is used for encoding the image signal and/or the audio signal into live broadcast data;

and the live broadcast data pushing module is used for releasing the live broadcast data in the live broadcast room so as to push the live broadcast data to a client side entering the live broadcast room for playing.

In one embodiment of the present invention, the signal capturing module includes:

the image signal capturing module is used for calling a graphic programmer to continuously capture image signals generated by the browsing application when the page is displayed if the anchor program runs in the browsing application;

and/or

And the audio signal capturing module is used for continuously capturing the audio signal generated by the anchor program from the audio interface of the browsing application if the anchor program runs in the browsing application.

In one embodiment of the present invention, the user operation forwarding module 505 includes:

the connection determining module is used for determining double-full-work connection with the browsing application if the anchor program runs in the browsing application;

and the live broadcast updating module is used for sending the user operation to the browsing application through the double-full connection so as to update a page and/or an audio signal according to the user operation when the anchor program is executed.

In one embodiment of the present invention, further comprising:

a viewer program determining module for determining a viewer program matching the anchor program;

a second address querying module for querying a second address of the viewer program stored in the content distribution network;

and the audience program release module is used for releasing the second address in the live broadcast room indicated by the opening operation, accessing the second address when a client enters the live broadcast room, downloading the audience program from the content distribution network and executing the audience program.

The live broadcast device provided by the embodiment of the invention can execute the live broadcast method provided by any embodiment of the invention, and has the corresponding functional modules and beneficial effects of the execution method.

Example IV

Fig. 6 is a block diagram of a live broadcast device according to a fourth embodiment of the present invention, which is applied to a client, and the device may specifically include the following modules:

the page display module 601 is configured to display a page located in the live broadcasting room;

a viewer program loading module 602 for loading a viewer program applied to the living room;

a page area display module 603, configured to display a first area and a second area in the page, where the first area is used to display live broadcast data generated by a host program running on a server and distributed in the live broadcast room, and the second area is used to display an operation interface of the viewer program;

a user operation receiving module 604, configured to receive a user operation in the operation interface;

and the live broadcast data update display module 605 is configured to display live broadcast data updated by the anchor program according to the user operation in the first area.

In one embodiment of the invention, the viewer program loading module 602 includes:

a viewer program acquisition module for acquiring a viewer program applied to the living room;

the first execution module is used for executing the audience program in the client if the client is a browser and the audience program is a JavaScript script;

Or,

and the second execution module is used for calling a browsing component in the client to execute the audience program if the client is a non-browser and the audience program is a JavaScript script.

In one embodiment of the present invention, if the anchor program is a JavaScript script, the anchor program is executed by a browsing application in the server, and the anchor program is used for rendering a page and/or generating an audio signal.

In one embodiment of the invention, a dual full-duplex connection is established between the anchor program and the browsing application.

In one embodiment of the invention, the anchor program is further configured to generate an image signal and/or an audio signal at runtime; the image signal and/or the audio signal is/are used for encoding as live data distributed in the live room.

In one embodiment of the present invention, if the anchor program is running in a browsing application, the browsing application is further configured to generate an image signal when displaying a page;

and/or

If the anchor program runs in the browsing application, the audio interface of the browsing application is used for playing the audio signal generated by the anchor program.

In one embodiment of the present invention, if the anchor program is running in a browsing application, a dual full-duplex connection between the server and the browsing application is used to send the user operation to the browsing application to update pages and/or audio signals according to the user operation when the anchor program is executed.

Example five

Fig. 7 is a schematic structural diagram of a computer device according to a fifth embodiment of the present invention. Fig. 7 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention. The computer device 12 shown in fig. 7 is only an example and should not be construed as limiting the functionality and scope of use of embodiments of the invention.

As shown in fig. 7, the computer device 12 is in the form of a general purpose computing device. Components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.

Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, micro channel architecture (MAC) bus, enhanced ISA bus, video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus.

Computer device 12 typically includes a variety of computer system readable media. Such media can be any available media that is accessible by computer device 12 and includes both volatile and nonvolatile media, removable and non-removable media.

The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. The computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 7, commonly referred to as a "hard disk drive"). Although not shown in fig. 7, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.

A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.

The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and/or any devices (e.g., network card, modem, etc.) that enable the computer device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Moreover, computer device 12 may also communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through network adapter 20. As shown, network adapter 20 communicates with other modules of computer device 12 via bus 18. It should be appreciated that although not shown, other hardware and/or software modules may be used in connection with computer device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.

The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, for example, implementing the live method provided by the embodiments of the present invention.

Example eight

The eighth embodiment of the present invention further provides a computer readable storage medium, on which a computer program is stored, where the computer program when executed by a processor implements each process of the live broadcast method described above, and the same technical effects can be achieved, and for avoiding repetition, a detailed description is omitted herein.

The computer readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.

Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.

Claims

1. A live broadcast method, applied to a server, the method comprising:

receiving a start operation;

running a host program indicated by the opening operation in the server;

releasing live broadcast data generated by the main broadcasting program in a live broadcasting room indicated by the opening operation to push the live broadcast data to a client side entering the live broadcasting room for playing, wherein the live broadcasting room comprises a public live broadcasting room;

when the live broadcasting room is a public live broadcasting room, the operator actively triggers the operation of the broadcasting, or the operator sets triggering condition information, and when the triggering condition is met, the operation of the broadcasting is automatically triggered;

Receiving user operation sent by a viewer program at the client;

2. The method of claim 1, wherein running the anchor program indicated by the open operation in the server comprises:

acquiring an anchor program indicated by the open operation;

if the anchor program is a JavaScript script, creating a browsing application in the server;

executing the anchor program in the browsing application, the anchor program being for rendering pages and/or generating audio signals.

3. The method of claim 2, wherein the obtaining the anchor program indicated by the open operation comprises:

determining an anchor program indicated by the open operation;

querying a first address where the anchor program is stored in a content distribution network;

accessing the first address and downloading the anchor program from the content distribution network.

4. The method of claim 2, wherein running the anchor program indicated by the open operation in the server further comprises:

And establishing double full-duplex connection with the browsing application.

5. The method according to claim 1, wherein the publishing of the live data generated by the main program in the live room indicated by the open operation to push the live data to clients entering the live room for playing, comprises:

determining a live room indicated by the open operation;

continuously capturing image signals and/or audio signals generated by the anchor program during running;

encoding the image signal and/or the audio signal into live data;

and publishing the live broadcast data in the live broadcast room so as to push the live broadcast data to a client side entering the live broadcast room for playing.

6. The method of claim 5, wherein the continuously capturing image signals and/or audio signals generated by the anchor program at run-time comprises:

if the anchor program runs in the browsing application, calling a graphic programmer to continuously capture image signals generated by the browsing application when displaying a page;

and/or

If the anchor program runs in the browsing application, the audio signals generated by the anchor program are continuously captured from the audio interface of the browsing application.

7. The method of any of claims 1-6, wherein the sending the user operation to the anchor program comprises:

if the anchor program runs in the browsing application, determining double-full-work connection with the browsing application;

and sending the user operation to the browsing application through the double full-automatic connection so as to update pages and/or audio signals according to the user operation when the anchor program is executed.

8. The method of any of claims 1-6, further comprising, prior to said receiving a user action sent by an audience program located at said client:

determining a viewer program that matches the anchor program;

querying a second address where the viewer program is stored in a content distribution network;

and publishing the second address in the live broadcast room indicated by the opening operation, accessing the second address when a client enters the live broadcast room, downloading the audience program from the content distribution network, and executing the audience program.

9. A live broadcast method, applied to a client, the method comprising:

displaying a page where a live broadcast room is located, wherein the live broadcast room comprises a public live broadcast room;

When the live broadcasting room is a public live broadcasting room, displaying that the page where the live broadcasting room is positioned is a page actively triggered by an operator or setting triggering condition information by the operator, and automatically triggering the page opened when the triggering condition is met;

loading a viewer program for application to the living room;

receiving user operation in the operation interface;

10. The method of claim 9, wherein the loading is applied to the audience program of the living room, comprising:

acquiring a viewer program applied to the living room;

if the client is a browser and the audience program is a JavaScript script, executing the audience program in the client;

or,

and if the client is a non-browser and the audience program is a JavaScript, calling a browsing component in the client to execute the audience program.

11. A live broadcast device, for application to a server, the device comprising:

the live broadcast data release module is used for releasing live broadcast data generated by the main broadcast program in a live broadcast room indicated by the opening operation so as to push the live broadcast data to a client side entering the live broadcast room for playing, wherein the live broadcast room comprises a public live broadcast room;

12. A live broadcast apparatus for application to a client, the apparatus comprising:

The page display module is used for displaying pages of the live broadcasting room, wherein the live broadcasting room comprises a public live broadcasting room;

the system comprises a page area display module, a program management module and a program management module, wherein the page area display module is used for displaying a first area and a second area in the page, the first area is used for displaying live broadcast data which is generated by a host program running on a server and is distributed in the live broadcast room, and the second area is used for displaying an operation interface of the audience program;

13. A computer device, the computer device comprising:

one or more processors;

a memory for storing one or more programs,

The one or more programs, when executed by the one or more processors, cause the one or more processors to implement the live method of any of claims 1-10.

14. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a processor, implements the live method according to any of claims 1-10.