CN114064275A

CN114064275A - Data processing method and device

Info

Publication number: CN114064275A
Application number: CN202111368194.7A
Authority: CN
Inventors: 孙袁袁
Original assignee: Shanghai Bilibili Technology Co Ltd
Current assignee: Shanghai Bilibili Technology Co Ltd
Priority date: 2021-11-18
Filing date: 2021-11-18
Publication date: 2022-02-18

Abstract

The application provides a data processing method and a device, wherein the data processing method is applied to a central server and comprises the following steps: acquiring live streaming information; receiving a service processing request, and determining target live streaming information according to the service processing request; detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information; and if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can forward the target live stream to the source station server. The position of the live stream is monitored by the central server, the edge node server is triggered to forward the live stream to the source station server according to the requirement, the bearing capacity of the source station server is reduced, the flexibility of the edge node server is improved, and the forward pushing according to the requirement is realized.

Description

Data processing method and device

Technical Field

The present application relates to the field of computer network technologies, and in particular, to a data processing method. The application also relates to a data processing apparatus, a computing device, and a computer-readable storage medium.

Background

With the rise and development of the live broadcast industry, more and more users watch live broadcast, and a live broadcast service provider can build an edge node server thereof in order to improve the watching experience of the users, so that live broadcast streams are pushed to a CDN node server and are pushed to other users by the CDN node server; for some live broadcast service providers or overseas users, a main broadcast pushes live broadcast streams to a CDN node server, the live broadcast streams are pushed to a source station server by the CDN node server, the source station server transcodes and records the received live broadcast streams and other services, and live broadcast video files corresponding to the live broadcast streams are generated. The user can obtain live streaming from the CDN node server and also obtain transcoded and recorded live video files from the source station server.

The source station server is high in cost and difficult to build, is a core server, is mainly used for processing business functions, cannot perform additional functions, and is not high in flexibility. Receiving a large number of live streams may result in a source station server that is too heavily loaded. Therefore, how to reduce the load capacity of the source station server is a problem that needs to be solved urgently at present.

Disclosure of Invention

In view of this, the present application provides a data processing method. The application also relates to a data processing device, a computing device and a computer readable storage medium, which are used for solving the problems of too high bearing capacity and low resource utilization rate caused by receiving unnecessary service flows by a source station server in the prior art.

According to a first aspect of the embodiments of the present application, there is provided a data processing method applied to a central server, including:

acquiring live streaming information;

receiving a service processing request, and determining target live streaming information according to the service processing request;

detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information;

if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can push the target live stream to the source station server.

According to a second aspect of the embodiments of the present application, there is provided a data processing method applied to an edge node server, including:

receiving a live streaming push request, wherein the live streaming push request carries a live streaming identification;

determining a target live stream according to the live stream identifier;

and forwarding the target live stream to a source station server in response to the live stream forwarding request.

According to a third aspect of the embodiments of the present application, there is provided a data processing method applied to a data processing system, the system including: a central server, at least one edge node server, a source station server, wherein,

the central server acquires live streaming information; receiving a service processing request, and determining target live streaming information according to the service processing request; detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information; if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can forward the target live stream to the source station server;

the target edge node server receives a live streaming push request, wherein the live streaming push request carries a live streaming identification; determining a target live stream according to the live stream identifier; the target live stream is forwarded to a source station server in response to the live stream pushing request;

and the source station server receives and processes the target live stream.

According to a fourth aspect of the embodiments of the present application, there is provided a data processing apparatus applied to a central server, including:

an acquisition module configured to acquire live streaming information;

the determining module is configured to receive a service processing request and determine target live streaming information according to the service processing request;

the detection module is configured to detect whether a target live stream corresponding to the target live stream information is located in a source station server according to the target live stream information;

and the sending module is configured to determine a target edge node server according to the target live stream information and send a live stream push request to the target edge node server if the target live stream is detected not to be located in the source station server, so that the target edge node server pushes the target live stream to the source station server.

According to a fifth aspect of the embodiments of the present application, there is provided a data processing apparatus, applied to an edge node server, including:

determining a target live stream according to the live stream identifier;

According to a sixth aspect of embodiments herein, there is provided a data processing system, the system comprising: a central server, at least one edge node server, a source station server, wherein,

the central server is configured to acquire live streaming information; receiving a service processing request, and determining target live streaming information according to the service processing request; detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information; if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can forward the target live stream to the source station server;

the target edge node server is configured to receive a live stream pushing request, wherein the live stream pushing request carries a live stream identifier; determining a target live stream according to the live stream identifier; the target live stream is forwarded to a source station server in response to the live stream pushing request;

the source station server is configured to receive and process a target live stream.

According to a seventh aspect of embodiments of the present application, there is provided a computing device comprising a memory, a processor and computer instructions stored on the memory and executable on the processor, the processor implementing the steps of the data processing method when executing the computer instructions.

According to an eighth aspect of embodiments of the present application, there is provided a computer-readable storage medium storing computer instructions which, when executed by a processor, implement the steps of the data processing method.

The data processing method provided by the application is applied to a central server and comprises the following steps: the method comprises the steps of obtaining live stream information, receiving a service processing request, determining target live stream information according to the service processing request, detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information, if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can push the target live stream to the source station server.

According to the embodiment of the application, the live streaming information is acquired and stored through the central server on the premise that the edge node server acquires the live streaming and defaults that the live streaming is not pushed to the source station server, and the effect of monitoring the position of the live streaming is achieved; when a service processing request is received, whether a source station has a live stream or not can be judged according to the position of the live stream, if not, the edge node server is triggered to transfer and push the live stream to the source station server, so that the edge node server is changed from the previous active transfer and push to the passive transfer and push, the transfer and push on demand is realized, the flexibility of the edge node server is improved, and the bearing capacity of the source station server is reduced under the condition of not influencing the service processing.

Drawings

FIG. 1 is a schematic diagram of a prior art live broadcast architecture;

fig. 2(a) is a schematic structural diagram of a main broadcast stream to an edge node server in a conventional live broadcast system;

fig. 2(b) is a schematic structural diagram of a main broadcast stream to a CDN node server in a conventional live broadcast system;

fig. 3 is a flowchart of a data processing method applied to a central server according to an embodiment of the present application;

fig. 4 is a flowchart of a data processing method applied to an edge node server according to an embodiment of the present application;

fig. 5 is a processing flow diagram of a data processing method applied to process transcoding services according to an embodiment of the present application;

FIG. 6 is a flow chart of a data processing method applied to a data processing system according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of a data processing apparatus applied to a central server according to an embodiment of the present application;

fig. 8 is a schematic structural diagram of a data processing apparatus applied to an edge node server according to an embodiment of the present application;

FIG. 9 is a block diagram of a data processing system according to an embodiment of the present application;

fig. 10 is a block diagram of a computing device according to an embodiment of the present application.

Detailed Description

In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. This application is capable of implementation in many different ways than those herein set forth and of similar import by those skilled in the art without departing from the spirit of this application and is therefore not limited to the specific implementations disclosed below.

The terminology used in the one or more embodiments of the present application is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the present application. As used in one or more embodiments of the present application and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present application refers to and encompasses any and all possible combinations of one or more of the associated listed items.

It will be understood that, although the terms first, second, etc. may be used herein in one or more embodiments of the present application to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first aspect may be termed a second aspect, and, similarly, a second aspect may be termed a first aspect, without departing from the scope of one or more embodiments of the present application. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context.

First, the noun terms to which one or more embodiments of the present application relate are explained.

Live streaming: live audio-video data transmission that can be transmitted as a stable and continuous stream over a network for viewing by a viewer. A live broadcast room has a stream, which is in a one-to-one correspondence relationship. The unique identifier of the stream is the stream name.

Live broadcasting and stream pulling: the live streaming refers to a process of pulling the live streaming from a source station specified by a user through a live streaming cloud platform.

Content distribution network: a CDN (content Delivery network), which is an intelligent virtual network constructed on the basis of an existing network, and which depends on edge node servers deployed in various regions, and through functional modules of load balancing, content distribution, scheduling, and the like of the CDN node servers (central platform servers), enables a user to obtain required content nearby, reduces network congestion, improves user access response speed and hit rate, and is suitable for scenes of site acceleration, on-demand, live broadcast, and the like.

CDN service provider: a facilitator providing a content distribution network.

CDN node server: the central platform server of the content distribution network is mainly used for carrying out operations such as content distribution, scheduling and the like. The CDN node server can push the live stream to a corresponding edge node server according to a user request, so that a user can obtain the live stream from the edge node server closest to the CDN node server; after acquiring the live stream, the CDN node actively pushes the live stream to the source station server, so that the source station server performs processing operations such as recording and transcoding on the live stream.

An edge node server: an edge server in a content distribution network is mainly used for receiving a live stream and pushing the live stream to a node server of a user, and after receiving the pushed stream, the edge server can actively push the live stream to a source station server so as to facilitate the source station server to record, transcode and other processing operations on the live stream. When the CDN node server has a demand for acquiring a live stream, the corresponding live stream is pushed to the CDN node server.

A source station server: and the source station server receives all live streams and carries out processing operations such as recording, transcoding and the like on the live streams. In practical application, a plurality of source station servers may jointly form a source station server cluster, and each source station server may correspond to a plurality of content distribution networks to obtain a live stream therein. Specifically, the corresponding relationship between each source station server and the content distribution network may be determined according to a distributed type, a load balancing algorithm, and the like.

Specifically, referring to fig. 1, fig. 1 shows a schematic structural diagram of an existing live broadcast architecture, in which:

after receiving the live stream, each edge node server actively pushes the live stream to the source station server. When the CDN node server has a demand for acquiring the live stream, the edge node server pushes the corresponding live stream to the CDN node server according to the demand.

The CDN node server may correspond to a plurality of edge node servers, and the CDN node server may receive live streams pushed by the anchor, and may also receive live streams pushed by each edge node server. When a live stream acquisition request is received, if the live stream is in a CDN node server, pushing the live stream to a corresponding edge node server; if the live stream is on other edge node servers, the live stream is acquired from the other edge node servers, and then the live stream is pushed to the corresponding edge node servers.

The source station server receives live streams actively pushed by the edge node server and the CDN node server, and processes recording, transcoding and the like on all the live streams, so that the live video files corresponding to the live streams can be pushed to each user subsequently.

In the existing live broadcast system, the platform builds a CDN node server of the platform and distributes the stream to other edge node servers. But edge node servers are typically deployed on three operator bases only, since three operators can cover more than 90% of the anchor. For small operators and overseas anchor, the platform does not build edge node servers specially. Because the cost for building the overseas node server and the small service operator is high, the utilization rate is relatively low, and the resource waste is caused.

For small operators and overseas node servers, a main broadcast is generally enabled to directly push streams to a CDN node server and the CDN node server is enabled to be pushed to a source station server of a platform, so that in order to perform transcoding, recording and other services at a source station, after the main broadcast pushes live streams to the CDN node server, the source station server cannot be added subsequently unless the main broadcast is pushed for the first time, and all streams can default to the source station server.

Currently, there are two plug flow modes: the first is to anchor a push stream to an edge node server, as shown in fig. 2(a), fig. 2(a) shows a schematic structural diagram of an anchor push stream to an edge node server in an existing live broadcast system, which is specifically as follows:

after the live stream is pushed to the edge node server by the anchor, the edge node server can transfer to the source station server and the CDN node server by default, the CDN node server pushes the live stream to a user, the source station server receives the live stream pushed by all the edge node servers, but part of the live stream does not need the source station server to carry out any business processing operation, resources of the server are wasted, and invalid transfer pushing is caused.

The second is to anchor the push flow to the CDN node server, as shown in fig. 2(b), fig. 2(b) shows a schematic structural diagram of the anchor push flow to the CDN node server in the existing live broadcast system, which is specifically as follows:

after the live stream is pushed to the CDN node server by the anchor, the CDN node server can fixedly push the live stream to the source station server, so that the source station server can receive the live streams of all the CDN node servers, but most of the live streams do not need the source station server to carry out any operation, the bearing capacity of the source station server is too high, and invalid push forwarding is caused.

Above-mentioned two kinds of push flow modes all can push away the live circulation to source station server, lead to source station server to appear the too high problem of bearing capacity, push away the live circulation that CDN node server acquiescence changes and pushes away source station server to marginal node server also can't solve the invalid problem of pushing away that changes in above-mentioned two kinds of push modes, and concrete problem is as follows:

1. the edge node server cannot distinguish the source of the live stream, and after the edge node server receives the live stream, the edge node server cannot judge whether the current live stream is forwarded to the CDN node server by the CDN node server or directly pushed by the anchor, so that the edge node server can be caused to be forwarded to the CDN node server by default, and cyclic pushing is caused.

2. Although the above circular pushing problem can be solved, when the source station server is required to transcode and record the live stream, the live stream is not in the source station server, and the requirement of related service processing cannot be met.

3. Supposing that the edge node server can distinguish the source of the live stream, the live stream is not pushed to the CDN node server by default, and the live stream is pushed to the source station server by default, namely, both the edge node server and the source station server have the live stream, at the moment, the two problems can be solved, but compared with the existing pushing mode, the live stream is additionally subjected to the step of pushing the CDN node server to the edge node server, and redundant data exist.

Therefore, a data processing method needs to be provided, in which an edge node server receives a live stream, determines whether to forward a CDN node server or not by determining a source of the live stream according to a live stream domain name, and defaults to not forward a source station server, and when the source station server needs to process a relevant service, actively forward to the source station server, so as to maximally implement forward as needed, improve a resource utilization rate, and reduce a load capacity of the source station server.

Based on this, in the present application, a data processing method is provided, and the present application simultaneously relates to a data processing apparatus, a computing device, and a computer-readable storage medium, which are individually detailed in the following embodiments.

Fig. 3 is a flowchart illustrating a data processing method applied to a central server according to an embodiment of the present application, where the data processing method applied to the central server specifically includes the following steps:

step 302: and acquiring the live streaming information.

The central server may be understood as a monitoring server that dynamically monitors each node server, and may obtain live stream information of a live stream on the node server. The live stream information may be understood as related information of the live stream, for example, the live stream information may be information of a live stream identifier, a live stream address, a push source, and the like of the live stream. The live broadcast room identification can be a room number of a live broadcast room and an identity ID of a corresponding anchor of the live broadcast room, and the live broadcast stream can be determined to be the live broadcast stream of the anchor according to the live broadcast room identification of the live broadcast stream; determining which edge node server the live stream is stored in according to the live stream address of the live stream; according to the push source, whether the live stream is directly pushed to the edge node server from the anchor side or the live stream is pushed to the CDN node server by the anchor side first can be determined, and the CDN node server then forwards the live stream to the edge node server.

In practical application, after the central server obtains the live streaming information, the live streaming information can be stored in a database. The storage structure may be: live stream identification, live stream address, push source, and source station data information. The source station data information records whether the live stream information is sent by the source station server, i.e. whether the live stream is located at the source station server. The stored live stream information is updated in real time, so that the timeliness of the live stream information is guaranteed, and the specific position of the live stream can be accurately searched.

In a specific embodiment of the present application, the central server Z obtains 100 pieces of live streaming information, and stores the 100 pieces of live streaming information in the database. One piece of live stream information x may be as shown in table 1, where table 1 shows live stream information in an embodiment of the present application.

TABLE 1

Live stream identification	Live streaming addresses	Push source	Source station data information
				123456	192.168.1.85	Anchor end	Exist of

In another specific embodiment of the present application, the central server Z obtains 200 pieces of live streaming information, and stores the 200 pieces of live streaming information in the database. One piece of live stream information y is shown in table 2, and table 2 shows live stream information in an embodiment of the present application.

TABLE 2

Live stream identification	Live streaming addresses	Push source	Source station data information
				654321	192.168.1.86	CDN node server	Is absent from

In practical application, the central server may obtain the live stream information in two ways, one way is that the central server sends a live stream information obtaining request to all edge node servers and the source station server at regular time, and the edge node servers and the source station server send the live stream information to the central server according to the live stream information obtaining request.

Specifically, acquiring live streaming information includes:

sending a live streaming information acquisition request to each edge node server and each source station server;

and receiving the live streaming information returned by each edge node server and the source station server in response to the live streaming information acquisition request.

The live streaming information acquisition request may be understood as a request for pulling the live streaming information from the central server to the edge node server and the source station server.

In practical application, after receiving a live stream information acquisition request sent by a central server, an edge node server and a source station server generate corresponding live stream information according to existing live streams on their own servers and send the live stream information to the central server.

In a specific embodiment of the present application, following the above example, the central server Z sends a live streaming information acquisition request to all edge node servers and source station servers every 1 hour, and after receiving the live streaming information acquisition request, the edge node servers and the source station servers send corresponding live streaming information to the central server Z.

In another specific embodiment of the present application, following the above example, after the central server Z sends a live streaming information acquisition request to all edge node servers and source station servers again after 1 hour, if the live streaming information of the same live streaming is acquired, the central server Z may update the live streaming information corresponding to the live streaming in the database.

Besides the manner of acquiring the live stream information in which the edge node servers and the source station servers send the live stream information to the central server according to the live stream information acquisition request, another manner of acquiring the live stream information is to actively send the live stream information to the central server for each edge node server and the source station server.

Specifically, acquiring live streaming information includes:

and receiving the live streaming information sent by each edge node server and the source station server.

In practical application, after each edge node server and each source station server receive the live streaming, the live streaming information can be actively sent to the central server.

In a specific embodiment of the present application, following the above example, the edge node server a receives 3 live streams, and sends live stream information corresponding to the 3 live streams to the central server. And the source station server B receives the 5 live streams and sends the live stream information corresponding to the 5 live streams to the central server.

In another embodiment of the present application, following the above example, the edge node server a receives 1 live stream, and sends the live stream information corresponding to the 1 live stream to the central server, and then, the edge node server a receives 1 live stream again, and the live stream is the same as the previous live stream, but the live stream address changes, and then the edge node server a resends new live stream information to the central server, so that the live stream information in the database of the central server can be updated in time, and the accuracy of the information is ensured.

The two manners for acquiring the live stream information can ensure the timeliness of live stream data in the database of the central server, so that the specific position of the live stream is determined, whether the live stream is located in the source station server or not is judged subsequently, and no limitation is made on how to acquire the live stream information in the application, so that the method is subject to practical application.

Step 304: receiving a service processing request, and determining target live streaming information according to the service processing request.

The service processing request may be understood as a request for processing a service received by the central server. When a live stream corresponding to a certain live broadcast room needs transcoding, recording and other services, the central server receives a service processing request, and the service processing request indicates that the live stream corresponding to the live broadcast room has transcoding and recording requirements.

In practical application, when a live stream corresponding to a live broadcast room needs to be subjected to business services such as transcoding or recording, the central server receives a business processing request, and searches corresponding live stream information in the database according to the business processing request, so that subsequent processing operation is performed.

In an embodiment of the present application, following the above example, after the central server Z receives the service processing request Y1, the central server Z searches the database for the corresponding target live streaming information x according to the service processing request Y1.

Specifically, determining target live streaming information according to the service processing request includes:

acquiring a live broadcast room identifier carried by the service processing request;

and searching corresponding target live broadcast stream information according to the live broadcast room identifier.

The live room identifier may be understood as a unique identifier representing live room information, for example, the live room identifier may be a room number ID of the live room, a web page address of the live room, and the like. The live stream identifier in the live stream information and the live stream identifier in the live room identifier may be the same identifier, for example, the live room identifier and the live stream identifier may be room number IDs of the live room corresponding to the live stream, or may be anchor identity IDs corresponding to the live stream, where there is no specific limitation on whether the live room identifier and the live stream identifier are the same identifier, and the actual application is the standard.

In practical application, the central server searches the target live broadcast stream information in the database according to the live broadcast room identification carried in the service processing request.

In a specific embodiment of the present application, following the above example, after receiving the service processing request Y1, the central server Z obtains a live broadcast room identifier in the service processing request Y1, where the live broadcast room identifier is "room number ID: 123456 ", searching the corresponding live streaming information x in the database according to the live room identifier, where the live streaming information x is shown in table 1.

In a specific embodiment of the present application, following the above example, after receiving the service processing request Y2, the central server Z obtains a live broadcast room identifier in the service processing request Y2, where the live broadcast room identifier is "https:// www.zhibo.com/topic/yllmscj _ zbjrid ═ 654321", and searches for corresponding live broadcast stream information Y in the database according to the live broadcast room identifier, where the live broadcast stream information Y is shown in table 2.

After finding out the corresponding target live stream information, the position of the target live stream can be obtained, so that whether the target live stream is located in the source station server or not is judged, and the source station server provides corresponding service.

Step 306: and detecting whether the target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information.

In practical application, the central server needs to determine the storage position of the target live stream according to the target live stream information, and can provide recording and transcoding services for the live stream corresponding to the live broadcast room only under the condition that the target live stream is stored in the source station server.

In a specific embodiment of the present application, following the above example, the central server Z determines, according to the target live stream information Y, that the live stream Y is stored in the source station server. The source station server can perform business operations such as recording, decoding and the like on the live stream Y.

Specifically, detecting whether a target live stream corresponding to the target live stream information is located in a source station server according to the target live stream information includes:

acquiring source station data information in the target live streaming information;

judging whether the source station server has the target live stream or not according to the source station data information;

if yes, determining that the target live broadcast stream is located in the source station server;

if not, determining that the target live stream is not located in the source station server.

The source station data information may be understood as information indicating whether a source station has a stream. When the central server acquires the live stream information, the live stream information carries source station data information, and the source station data information records whether the corresponding live stream is located in the source station server. For example, if the source station data information is True, it indicates that the live stream is located in the source station server; and if the source station data information is False, indicating that the live stream is not located in the source station server.

In practical applications, the source station data information may have many representations, for example, True or False, 1 or 0, presence or absence, etc., and when implemented, the representation of the source station data information may be specifically set according to actual situations. And the central server acquires source station data information in the target live stream information and judges whether the corresponding live stream is in the source station server or not according to the source station data information.

In a specific embodiment of the present application, following the above example, the central server Z obtains the source station data information "existence" in the target live stream information Y, and detects that the source station server has the target live stream Y according to the source station data information. And after detecting that the source station server has the live stream Y, the central server does not perform any operation. And the source station server performs recording and decoding service operation on the live stream Y.

In another specific embodiment of the present application, following the above example, the central server Z obtains the source station data information "True" in the target live stream information Y, and detects that the source station server has the target live stream Y according to the source station data information. After detecting that the source station server has the live stream Y, the central server does not perform any operation, and the source station server performs recording and decoding service operation on the live stream Y.

In a specific embodiment of the present application, following the above example, the central server Z obtains source station data information "does not exist" in the target live stream information Y, and detects that the source station server does not have the target live stream Y according to the source station data information, and determines that the target live stream Y is not located in the source station server, and performs a push forwarding request sending operation.

In another specific embodiment of the present application, following the above example, the central server Z obtains source station data information "False" in the target live stream information Y, and if it is detected that the source station server does not have the target live stream Y according to the source station data information, it is determined that the target live stream Y is not located in the source station server, and a push forwarding request is sent.

In practical application, after the central server detects that no target live stream exists on the source station server, the edge node server with the target live stream is pushed to the source station server, so that the source station server can perform business operations such as recording, decoding and the like on the live stream.

Step 308: and if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server.

The target edge node server can be understood as an edge node server storing a target live stream. The live stream push request may be understood as a request for the edge node server to forward the live stream to the source station server.

In practical application, if the central server detects that the source station server does not have the target live stream, the central server finds out the specific position of the target live stream according to the target live stream information, so as to determine the edge node server where the target live stream is located, and sends a live stream push request to the edge node server, so that the target live stream is pushed to the source station server, and subsequent business operation is performed.

In a specific embodiment of the present application, following the above example, the central server Z detects that the target live stream is not located in the source station server, determines the target edge node server B according to the target live stream information y, and sends a live stream push request to the target edge node server B, so that the target edge node server pushes the target live stream to the source station server.

Specifically, determining a target edge node server according to the target live streaming information includes:

acquiring a live streaming address in the target live streaming information;

and determining a target edge node server according to the live streaming address.

The live streaming address can be understood as an IP address of the live streaming, a specific position of the live streaming can be determined according to the live streaming address, and an edge node server where the live streaming is located is determined.

In practical application, after the central server detects that the target live stream is not located in the source station server, a specific position of the target live stream corresponding to the target live stream information needs to be found out, the specific position can be determined according to a live stream address in the target live stream information, and the live stream address corresponds to an address of the edge node server, so that the edge node server where the target live stream is located can be determined. Then, a live stream push request may be sent to the edge node server, so that the edge node server pushes the live stream to the source station server.

In a specific embodiment of the present application, following the above example, after detecting that the target live stream is not located in the source station server, the central server Z obtains a live stream address "192.168.1.85" in the target live stream information y, finds out a corresponding target edge node server B according to the live stream address, where the live stream is stored in the target edge node server B, and sends a live stream push request to the target edge node server B, where the target edge node server B pushes the live stream to the source station server in response to the live stream push request, so that the source station server performs subsequent recording and transcoding service operations. Meanwhile, the source station data information corresponding to the live stream is changed into existence.

After the central server sends the live broadcast stream push request to the target edge node server, the edge node server needs to determine a corresponding target live broadcast stream according to the live broadcast stream push request, so that the target live broadcast stream is pushed to the source station server.

The data processing method provided by the application is applied to a central server and comprises the following steps: acquiring live streaming information; receiving a service processing request, and determining target live streaming information according to the service processing request; detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information; if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can push the target live stream to the source station server. The method comprises the steps that the live stream information of all live streams is obtained regularly through a central server, whether the live streams are located in a source station server or not is detected according to service requirements, if yes, related services are directly carried out, otherwise, a forwarding request is sent to an edge node server, the live streams are forwarded to the source station server, and then the related services are processed. The edge node server is changed from active transfer to passive transfer, and transfer as required is realized to the maximum extent, so that the resource utilization rate is improved, and the source station bearing capacity is reduced.

In practical applications, after receiving the live stream, the edge node server may push the live stream to the CDN node server and the source station server. Before determining whether to push the live stream to the CDN node server, the source of the live stream is judged according to the domain name of the live stream. For example, the domain name pushed to the edge node server by the anchor is a, the domain name pushed to the edge node server by the CDN node is B, and after the edge node server receives the live stream, the domain name information in the live stream is obtained, and the source of the live stream is determined according to the domain name information, so that whether to forward the live stream to the CDN node server is determined, and cyclic pushing is avoided.

And then determining whether to push the live streaming to the source station server according to whether the live streaming push request is received, so as to avoid the problem of invalid push. Fig. 4 is a flowchart illustrating a data processing method applied to an edge node server according to an embodiment of the present application, where the method specifically includes the following steps:

step 402: receiving a live streaming push request, wherein the live streaming push request carries a live streaming identification.

Step 404: and determining a target live stream according to the live stream identification, and forwarding the target live stream to a source station server in response to the live stream push request.

Wherein the live stream identification may be understood as a unique identification representing the live stream. For example, the live stream identification of the live room a may be an ID of the corresponding anchor, a live room number ID, or the like.

In a specific embodiment of the present application, following the above example, after the central server sends the live stream push request to the target edge node server B, the target edge node server B obtains the live stream identifier "123456" from the live stream push request, and the target edge node server B searches for a corresponding live stream in its own server according to the live stream identifier, and pushes the target live stream to the source station server in response to the live stream push request, so that the source station server performs subsequent service processing operations.

The data processing method provided by the application is applied to an edge node server and comprises the following steps: receiving a live streaming push request, wherein the live streaming push request carries a live streaming identification; determining a target live stream according to the live stream identifier; and forwarding the target live stream to a source station server in response to the live stream forwarding request. The edge node server sends the corresponding live stream to the source station server under the condition of receiving the live stream push request, so that the server processes related services, the direct stream is pushed according to the requirement, and the effect of reducing the bearing capacity of the source station server is achieved.

The following describes the data processing method further by taking an application of the data processing method provided in the present application in processing a transcoding service as an example, with reference to fig. 5. Fig. 5 shows a processing flow chart of a data processing method applied to processing a transcoding service, where the method is applied to a central server, and specifically includes the following steps:

step 502: and acquiring the live streaming information.

In a specific embodiment of the present application, the central server Z obtains 100 pieces of live streaming information, 70 pieces of live streaming information in the 100 pieces of live streaming information come from the edge node server, 30 pieces of live streaming information come from the source station server, and the 100 pieces of live streaming information are stored in the database of the central server.

Step 504: and receiving a service processing request, acquiring a live broadcast room identifier carried by the service processing request, and searching corresponding target live broadcast stream information according to the live broadcast room identifier.

In a specific embodiment of the present application, following the above example, the central server Z receives the transcoding service processing request Q, obtains the live broadcast room identifier "room number 6666" in the transcoding service processing request Q, and searches the corresponding target live broadcast stream information M in the central server database according to the live broadcast room identifier.

Step 506: and acquiring source station data information in the target live stream information, judging whether a source station server has a target live stream according to the source station data information, if so, determining that the target live stream is positioned in the source station server, and if not, determining that the target live stream is not positioned in the source station server.

In a specific embodiment of the present application, following the above example, the central server Z obtains source station data information "false" in the target live stream information M, and determines that the source station server does not have the target live stream according to the source station data information.

Step 508: and when the target live stream is detected not to be located in the source station server, acquiring a live stream address in the target live stream information, determining a target edge node server according to the live stream address, and sending a live stream push request to the target edge node server so that the target edge node server can push the target live stream to the source station server.

In a specific embodiment of the present application, following the above example, when the central server Z detects that the target live stream is not located in the source station server, the central server Z obtains a live stream address "192.168.1.200" in the target live stream information M, determines the target edge node server S1 according to the live stream address, and sends a live stream push request to the target edge node server S1, so that the target edge node server S1 pushes the target live stream to the source station server.

The application provides a processing method for processing transcoding service data, which is applied to a central server, and comprises the following steps: acquiring live streaming information; receiving a service processing request, and acquiring a live broadcast room identifier carried by the service processing request; and searching corresponding target live broadcast stream information according to the live broadcast room identifier. Acquiring source station data information in the target live streaming information; judging whether the source station server has the target live stream or not according to the source station data information; if yes, determining that the target live broadcast stream is located in the source station server; if not, determining that the target live stream is not located in the source station server. If the target live stream is detected not to be located in the source station server, acquiring a live stream address in the target live stream information; and determining a target edge node server according to the live stream address, and sending a live stream push request to the target edge node server so that the target edge node server pushes the target live stream to the source station server. By monitoring the specific position of the live stream, the source station server is actively pushed to the source station server under the condition that the source station server needs to process transcoding service, so that the transmission of invalid pushing conditions is reduced, and the bearing capacity of the source station is reduced.

Fig. 6 is a flowchart illustrating a data processing method applied to a data processing system according to an embodiment of the present application, where the system includes: the method comprises a central server, at least one edge node server and a source station server, and specifically comprises the following steps:

step 602: the central server acquires live streaming information; receiving a service processing request, and determining target live streaming information according to the service processing request; detecting whether a target live stream corresponding to the target live stream information is located in a source station server or not according to the target live stream information; if the target live stream is detected not to be located in the source station server, determining a target edge node server according to the target live stream information, and sending a live stream push request to the target edge node server so that the target edge node server can push the target live stream to the source station server.

In a specific embodiment of the present application, the central server obtains live streaming information sent by each edge node server and the source station server, and stores the live streaming information in the database. Receiving a service processing request, determining target live stream information corresponding to the to-be-processed live stream in a database according to the live room identification in the service processing request, and detecting whether the to-be-processed live stream is located in a source station server according to source station data information in the target live stream information. And when detecting that the target live stream is not located in the source station server, determining a target edge node server according to the live stream address in the target live stream information, and sending a live stream push request to the target edge node server.

In another specific embodiment of the present application, the central server obtains live streaming information sent by each edge node server and the source station server, and stores the live streaming information in the database. Receiving a service processing request, determining target live stream information corresponding to the to-be-processed live stream in a database according to the live room identification in the service processing request, and detecting whether the to-be-processed live stream is located in a source station server according to source station data information in the target live stream information. And detecting that the target live stream is located in the source station server, and then the central server does not do any operation. At this point, the representative source station server has processed the corresponding live stream.

Step 604: the target edge node server receives a live streaming push request, wherein the live streaming push request carries a live streaming identification; determining a target live stream according to the live stream identifier; and forwarding the target live stream to a source station server in response to the live stream forwarding request.

In a specific embodiment of the present application, following the above example, after receiving the live stream push request, the target edge node server determines a to-be-processed live stream according to the live stream identifier in the live stream push request, and sends the to-be-processed live stream to the source station server.

Step 606: and the source station server receives and processes the target live stream.

In a specific embodiment of the present application, following the above example, after receiving a to-be-processed live stream, a source station server processes the live stream according to a service requirement.

The data processing method is applied to a data processing system, and the effect of monitoring the position of the live stream is achieved by acquiring and storing the live stream information through the central server; when a service processing request is received, whether a source station has a live stream or not can be judged according to the position of the live stream, and if yes, the source station server represents that corresponding service operation has been executed on the live stream; if not, triggering the edge node server to forward and push to the source station server, so that the edge node server is changed from the previous active forwarding and pushing to the passive forwarding and pushing, thereby realizing the forwarding and pushing according to the requirement, improving the flexibility of the edge node server, and reducing the bearing capacity of the source station server under the condition of not influencing the service processing.

Corresponding to the above method embodiment, the present application further provides an embodiment of a data processing apparatus, and fig. 7 shows a schematic structural diagram of a data processing apparatus applied to a central server according to an embodiment of the present application. As shown in fig. 7, the apparatus, applied to a central server, includes:

an obtaining module 702 configured to obtain live stream information;

a determining module 704 configured to receive a service processing request, and determine target live streaming information according to the service processing request;

a detecting module 706 configured to detect whether a target live stream corresponding to the target live stream information is located in a source station server according to the target live stream information;

a sending module 708, configured to determine a target edge node server according to the target live streaming information if it is detected that the target live streaming is not located in the source station server, and send a live streaming push request to the target edge node server, so that the target edge node server forwards the target live streaming to the source station server;

optionally, the obtaining module 702 is further configured to send a live streaming information obtaining request to each edge node server and the source station server; receiving live streaming information returned by each edge node server and the source station server in response to the live streaming information acquisition request;

optionally, the obtaining module 702 is further configured to receive live streaming information sent by each edge node server and the source station server;

optionally, the determining module 704 is further configured to obtain a live broadcast room identifier carried by the service processing request; searching corresponding target live broadcast stream information according to the live broadcast room identification;

optionally, the detecting module 706 is further configured to obtain source station data information in the target live streaming information; judging whether the source station server has the target live stream or not according to the source station data information; if yes, determining that the target live broadcast stream is located in the source station server; if not, determining that the target live stream is not located in the source station server;

optionally, the sending module 708 is further configured to obtain a live streaming address in the target live streaming information; and determining a target edge node server according to the live streaming address.

The application provides a be applied to central server's data processing apparatus includes: an obtaining module 702 configured to obtain live stream information; a determining module 704 configured to receive a service processing request, and determine target live streaming information according to the service processing request; a detecting module 706 configured to detect whether a target live stream corresponding to the target live stream information is located in a source station server according to the target live stream information; a sending module 708, configured to determine a target edge node server according to the target live streaming information if it is detected that the target live streaming is not located in the source station server, and send a live streaming push request to the target edge node server, so that the target edge node server pushes the target live streaming to the source station server. The method comprises the steps that the live stream information of all live streams is obtained regularly through a central server, whether the live streams are located in a source station server or not is detected according to service requirements, if yes, related services are directly carried out, otherwise, a forwarding request is sent to an edge node server, the live streams are forwarded to the source station server, and then the related services are processed. The method realizes the rotation pushing as required to the maximum extent, thereby improving the resource utilization rate and reducing the bearing capacity of the source station.

Corresponding to the above method embodiment, the present application further provides an embodiment of a data processing apparatus server applied to an edge node server, and fig. 8 shows a schematic structural diagram of a data processing apparatus applied to an edge node server according to an embodiment of the present application. As shown in fig. 8, the apparatus includes:

a receiving module 802 configured to receive a live stream push request, where the live stream push request carries a live stream identifier;

a determining module 804 configured to determine a target live stream according to the live stream identifier;

a forwarding module 806 configured to forward the target live stream to a source station server in response to the live stream push request.

The application provides a data processing apparatus for edge node server, includes: a receiving module 802 configured to receive a live stream push request, where the live stream push request carries a live stream identifier; a determining module 804 configured to determine a target live stream according to the live stream identifier; a forwarding module 806 configured to forward the target live stream to a source station server in response to the live stream push request. The edge node server sends the corresponding live stream to the source station server under the condition of receiving the live stream push request, so that the server processes related services, the direct stream is pushed according to the requirement, and the effect of reducing the bearing capacity of the source station server is achieved.

Corresponding to the above method embodiment, the present application further provides an embodiment of a data processing system, and fig. 9 shows a schematic structural diagram of a data processing system provided in an embodiment of the present application. As shown in fig. 9, the system includes: a central server 902, at least one edge node server 904, a source station server 906, wherein,

the central server 902 is configured to obtain live stream information, receive a service processing request, determine target live stream information according to the service processing request, detect whether a target live stream corresponding to the target live stream information is located in a source station server according to the target live stream information, determine a target edge node server according to the target live stream information if it is detected that the target live stream is not located in the source station server, and send a live stream push request to the target edge node server, so that the target edge node server pushes the target live stream to the source station server;

the target edge node server 904 is configured to receive a live stream push request, where the live stream push request carries a live stream identifier, and determine a target live stream according to the live stream identifier; the target live stream is forwarded to a source station server in response to the live stream pushing request;

the source station server 906 is configured to receive and process a target live stream.

The application provides a data processing system, including: the central server 902 is configured to obtain live stream information, receive a service processing request, determine target live stream information according to the service processing request, detect whether a target live stream corresponding to the target live stream information is located in a source station server according to the target live stream information, determine a target edge node server according to the target live stream information if it is detected that the target live stream is not located in the source station server, and send a live stream push request to the target edge node server, so that the target edge node server pushes the target live stream to the source station server; the target edge node server 904 is configured to receive a live stream push request, where the live stream push request carries a live stream identifier, and determine a target live stream according to the live stream identifier; the target live stream is forwarded to a source station server in response to the live stream pushing request; the source station server 906 is configured to receive and process a target live stream. By monitoring the specific position of the live stream, the source station server is actively pushed to the source station server under the condition that the source station server needs to process transcoding service, so that the transmission of invalid pushing conditions is reduced, and the bearing capacity of the source station is reduced.

The above is a schematic scheme of three data processing apparatuses of the present embodiment. It should be noted that the technical solutions of the three data processing apparatuses belong to the same concept as the technical solution of the data processing method described above, and for details that are not described in detail in the technical solutions of the data processing apparatuses, reference may be made to the description of the technical solution of the data processing method described above.

Fig. 10 shows a block diagram of a computing device 1000 according to an embodiment of the present application. The components of the computing device 1000 include, but are not limited to, memory 1010 and a processor 1020. The processor 1020 is coupled to the memory 1010 via a bus 1030 and the database 1050 is used to store data.

Computing device 1000 also includes access device 1040, access device 1040 enabling computing device 1000 to communicate via one or more networks 1060. Examples of such networks include the Public Switched Telephone Network (PSTN), a Local Area Network (LAN), a Wide Area Network (WAN), a Personal Area Network (PAN), or a combination of communication networks such as the internet. Access device 1040 may include one or more of any type of network interface, e.g., a Network Interface Card (NIC), wired or wireless, such as an IEEE802.11 Wireless Local Area Network (WLAN) wireless interface, a worldwide interoperability for microwave access (Wi-MAX) interface, an ethernet interface, a Universal Serial Bus (USB) interface, a cellular network interface, a bluetooth interface, a Near Field Communication (NFC) interface, and so forth.

In one embodiment of the present application, the above-described components of computing device 1000 and other components not shown in FIG. 10 may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device architecture shown in FIG. 10 is for purposes of example only and is not limiting as to the scope of the present application. Those skilled in the art may add or replace other components as desired.

Computing device 1000 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), a mobile phone (e.g., smartphone), a wearable computing device (e.g., smartwatch, smartglasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or PC. Computing device 1000 may also be a mobile or stationary server.

Wherein the processor 1020, when executing the computer instructions, performs the steps of the data processing method.

The above is an illustrative scheme of a computing device of the present embodiment. It should be noted that the technical solution of the computing device and the technical solution of the data processing method belong to the same concept, and details that are not described in detail in the technical solution of the computing device can be referred to the description of the technical solution of the data processing method.

An embodiment of the present application further provides a computer readable storage medium, which stores computer instructions, and the computer instructions, when executed by a processor, implement the steps of the data processing method as described above.

The above is an illustrative scheme of a computer-readable storage medium of the present embodiment. It should be noted that the technical solution of the storage medium belongs to the same concept as the technical solution of the data processing method, and details that are not described in detail in the technical solution of the storage medium can be referred to the description of the technical solution of the data processing method.

The foregoing description of specific embodiments of the present application has been presented. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing may also be possible or may be advantageous.

The computer instructions comprise computer program code which may be in the form of source code, object code, an executable file or some intermediate form, or the like. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, etc. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.

It should be noted that, for the sake of simplicity, the above-mentioned method embodiments are described as a series of acts or combinations, but those skilled in the art should understand that the present application is not limited by the described order of acts, as some steps may be performed in other orders or simultaneously according to the present application. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required in this application.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

The preferred embodiments of the present application disclosed above are intended only to aid in the explanation of the application. Alternative embodiments are not exhaustive and do not limit the invention to the precise embodiments described. Obviously, many modifications and variations are possible in light of the above teaching. The embodiments were chosen and described in order to best explain the principles of the application and its practical applications, to thereby enable others skilled in the art to best understand and utilize the application. The application is limited only by the claims and their full scope and equivalents.

Claims

1. A data processing method is applied to a central server and comprises the following steps:

acquiring live streaming information;

2. The data processing method of claim 1, wherein obtaining live stream information comprises:

3. The data processing method of claim 1, wherein obtaining live stream information comprises:

4. The data processing method of claim 1, wherein determining target live stream information based on the service processing request comprises:

5. The data processing method of claim 1, wherein detecting whether a target live stream corresponding to the target live stream information is located at a source station server according to the target live stream information comprises:

6. The data processing method of claim 1, wherein determining a target edge node server based on the target live stream information comprises:

acquiring a live streaming address in the target live streaming information;

7. A data processing method is applied to an edge node server and comprises the following steps:

determining a target live stream according to the live stream identifier;

8. A data processing method applied to a data processing system, the system comprising: a central server, at least one edge node server, a source station server, wherein,

and the source station server receives and processes the target live stream.

9. A data processing device, applied to a central server, comprises:

an acquisition module configured to acquire live streaming information;

10. A data processing apparatus, applied to an edge node server, comprising:

the receiving module is configured to receive a live streaming push request, wherein the live streaming push request carries a live streaming identifier;

a determining module configured to determine a target live stream according to the live stream identifier;

and the transfer pushing module is configured to respond to the live stream push request to transfer the target live stream to the source station server.

11. A data processing system, characterized in that the system comprises: a central server, at least one edge node server, a source station server, wherein,

12. A computing device comprising a memory, a processor, and computer instructions stored on the memory and executable on the processor, wherein the processor implements the steps of the method of any one of claims 1-7 when executing the computer instructions.

13. A computer-readable storage medium storing computer instructions, which when executed by a processor, perform the steps of the method of any one of claims 1 to 7.