CN118741166A - Plug flow data display method and device in video live broadcast - Google Patents
Plug flow data display method and device in video live broadcast Download PDFInfo
- Publication number
- CN118741166A CN118741166A CN202310341196.XA CN202310341196A CN118741166A CN 118741166 A CN118741166 A CN 118741166A CN 202310341196 A CN202310341196 A CN 202310341196A CN 118741166 A CN118741166 A CN 118741166A
- Authority
- CN
- China
- Prior art keywords
- timestamp
- time
- video
- data
- push
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000010345 tape casting Methods 0.000 claims abstract description 36
- 238000005266 casting Methods 0.000 claims description 33
- 238000004590 computer program Methods 0.000 claims description 12
- 238000012545 processing Methods 0.000 claims description 7
- 230000000153 supplemental effect Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 4
- 230000001747 exhibiting effect Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000001934 delay Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/854—Content authoring
- H04N21/8547—Content authoring involving timestamps for synchronizing content
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the disclosure provides a plug-flow data display method and device in video live broadcast, and relates to the technical field of video live broadcast. The method comprises the following steps: acquiring video tape casting time delay; when receiving push data corresponding to a first event, generating data push information carrying the push data, the video tape-casting time delay and a first time stamp; the first timestamp is used for representing the occurrence time of the first event; and sending the data push information to the client device, so that the client device determines a presentation time stamp of the push data according to the first time stamp and the video tape-casting time, and presents the push data according to the presentation time stamp. The embodiment of the disclosure is used for live watching experience of a user.
Description
Technical Field
The disclosure relates to the technical field of live video broadcasting, in particular to a plug-flow data display method and device in live video broadcasting.
Background
With the rapid development of terminal technology and network technology, live video broadcast has become very popular and widely used in various fields.
In general, video streams and data streams of live video often come from different servers, and because of network transmission delay, video encoding and decoding delay and the like, the delay of the video streams is often larger than that of the data streams, which affects live viewing experience of users.
Disclosure of Invention
In view of this, the embodiments of the present disclosure provide a method and apparatus for displaying push data in live video, which are used to improve live viewing experience of a user.
In order to achieve the above object, the embodiment of the present disclosure provides the following technical solutions:
in a first aspect, an embodiment of the present disclosure provides a method for displaying push data in live video broadcast, including:
Acquiring video tape casting time delay;
When receiving push data corresponding to a first event, generating data push information carrying the push data, the video tape-casting time delay and a first time stamp; the first timestamp is used for representing the occurrence time of the first event;
And sending the data push information to the client device, so that the client device determines a presentation time stamp of the push data according to the first time stamp and the video tape-casting time, and presents the push data according to the presentation time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining video casting time includes:
Acquiring a second time stamp and a third time stamp; the second timestamp is used for representing the relative moment of a second event in video live broadcast, the second event is an event displayed by a target video frame, and the third timestamp is used for representing the encoding moment of the target video frame;
Acquiring a fourth time stamp and a fifth time stamp; the fourth timestamp is used for representing the occurrence time of a third event, and the fifth timestamp is used for representing the relative time of the third event;
Determining a sixth timestamp characterizing an occurrence time of the second event according to the second timestamp, the fourth timestamp and the fifth timestamp;
and acquiring video casting time of the video stream according to the third time stamp and the sixth time stamp.
As an optional implementation manner of the embodiment of the present disclosure, obtaining the second timestamp includes:
Determining target object information based on an image corresponding to the target video frame;
and acquiring the second time stamp according to the target object information.
As an optional implementation manner of the embodiment of the present disclosure, obtaining the third timestamp includes:
Determining supplemental enhancement information SEI frames adjacent to the target video frame from the live video stream;
and acquiring the third timestamp according to the SEI frame.
As an optional implementation of the embodiment of the disclosure, the determining a sixth timestamp according to the second timestamp, the fourth timestamp and the fifth timestamp includes:
Acquiring a time interval based on the difference between the second timestamp and the fifth timestamp;
the sixth timestamp is obtained based on the fourth timestamp and the time interval.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining the video casting time according to the second timestamp and the fifth timestamp includes:
And calculating a difference value between the third timestamp and the sixth timestamp to acquire the video casting time.
As an optional implementation manner of the embodiment of the present disclosure, the third event is an event corresponding to push data with a minimum time interval of push data corresponding to the first event.
In a second aspect, an embodiment of the present disclosure provides a method for displaying a data push in live video, including:
receiving data push information sent by a data push server, wherein the data push information comprises: the method comprises the steps of pushing stream data corresponding to a first event, a first timestamp and video streaming time delay, wherein the first timestamp is used for representing the occurrence time of the first event;
Acquiring a presentation time stamp of the push data according to the first time stamp and the video tape-casting time;
And displaying the push data according to the display time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining, according to the first timestamp and the video casting time, a presentation timestamp of the push data includes:
and carrying out delay summation on the first timestamp and the video stream to obtain a presentation timestamp of the push stream data corresponding to the first event.
As an optional implementation manner of the embodiment of the present disclosure, the displaying the push data according to the display timestamp includes:
acquiring a time stamp used for representing the encoding time of the currently displayed video frame;
Judging whether a time stamp used for representing the coding time of the currently displayed video frame is larger than or equal to the presentation time stamp;
and if yes, displaying the plug flow data.
In a third aspect, an embodiment of the present disclosure provides a data push server, including:
an acquisition unit configured to acquire video casting time;
the generating unit is used for generating data push information carrying the push data, the video tape-casting time delay and the first time stamp when receiving the push data corresponding to the first event; the first timestamp is used for representing the occurrence time of the first event;
And the sending unit is used for sending the data push information to the client equipment so that the client equipment can determine the presentation time stamp of the push data corresponding to the first event according to the first time stamp and the video tape delay and present the push data corresponding to the first event according to the presentation time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the acquiring unit is specifically configured to acquire a second timestamp and a third timestamp; the second timestamp is used for representing the relative moment of a second event in video live broadcast, the second event is an event displayed by a target video frame, and the third timestamp is used for representing the encoding moment of the target video frame; acquiring a fourth time stamp and a fifth time stamp; the fourth timestamp is used for representing the occurrence time of a third event, and the fifth timestamp is used for representing the relative time of the third event; determining a sixth timestamp characterizing an occurrence time of an event exhibited by the target video frame according to the second timestamp, the fourth timestamp and the fifth timestamp; and acquiring video casting time of the video stream according to the third time stamp and the sixth time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit is specifically configured to determine target object information based on an image corresponding to the target video frame; and acquiring the second time stamp according to the target object information.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit is specifically configured to determine, from the video stream of the live video, an SEI frame adjacent to the target video frame; and acquiring the third timestamp according to the SEI frame.
As an optional implementation manner of the embodiment of the disclosure, the obtaining unit is specifically configured to obtain a time interval based on a difference value between the second timestamp and the fifth timestamp; the sixth timestamp is obtained based on the fourth timestamp and the time interval.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit is specifically configured to calculate a difference between the third timestamp and the sixth timestamp, so as to obtain the video casting time.
As an optional implementation manner of the embodiment of the present disclosure, the third event is an event corresponding to push data with a minimum time interval of push data corresponding to the first event.
In a fourth aspect, embodiments of the present disclosure provide a client device, including:
the receiving unit is used for receiving the data push information sent by the data push server, and the data push information comprises: the method comprises the steps of pushing stream data corresponding to a first event, a first timestamp and video streaming time delay, wherein the first timestamp is used for representing the occurrence time of the first event;
the processing unit is used for acquiring the presentation time stamp of the push data according to the first time stamp and the video tape-casting time;
and the display unit is used for displaying the plug flow data according to the display time stamp. .
As an optional implementation manner of the embodiment of the present disclosure, the processing unit is specifically configured to sum the first timestamp and the video stream delay to obtain a presentation timestamp of the push stream data corresponding to the first event.
As an optional implementation manner of the embodiment of the disclosure, the display unit is specifically configured to obtain a timestamp used to characterize an encoding time of a currently displayed video frame; judging whether a time stamp used for representing the coding time of the currently displayed video frame is larger than or equal to the presentation time stamp; and if yes, displaying the plug flow data.
In a fifth aspect, embodiments of the present disclosure provide an electronic device, including: a memory and a processor, the memory for storing a computer program; the processor is configured to cause the electronic device to implement the push data display method in live video broadcast according to any one of the embodiments.
In a sixth aspect, an embodiment of the present disclosure provides a computer readable storage medium, which when executed by a computing device, causes the computing device to implement a push data presentation method in live video as set forth in any one of the foregoing embodiments.
In a seventh aspect, embodiments of the present disclosure provide a computer program product, which when run on a computer, causes the computer to implement the push data presentation method in live video as described in any one of the above embodiments.
When video live broadcasting is carried out, a data push server firstly obtains video tape casting time between the occurrence time of any event and the time when video tape of the video live broadcasting displays the event, generates data push information carrying with the push data, the video tape casting time and a first time stamp for representing the occurrence time of the first event when push data corresponding to the first event is received, and then sends the data push information to client equipment so that the client equipment can determine the display time stamp of the push data according to the first time stamp and the video tape casting time and display the push data according to the display time stamp. Because the data push information sent by the data push server to the client device comprises the video tape-casting time stamp and the first time stamp, the client determines the display time stamp of the push data according to the first time stamp and the video tape-casting time stamp, so that the push data corresponding to the first event can be prevented from being displayed before the video tape-casting of the first event, and the live broadcast watching experience of a user can be improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description, serve to explain the principles of the disclosure.
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following description will briefly introduce the drawings required for the description of the embodiments or the prior art, and it will be obvious to those skilled in the art that other drawings may be obtained from these drawings without inventive effort.
Fig. 1 is a scene architecture diagram of a push data display method in live video provided in an embodiment of the present disclosure;
fig. 2 is one of the step flowcharts of the push data display method in live video provided in the embodiment of the present disclosure;
Fig. 3 is a second flowchart of a step of a push data display method in live video provided in an embodiment of the present disclosure;
Fig. 4 is a schematic diagram of an image corresponding to a video frame according to an embodiment of the disclosure;
Fig. 5 is a schematic structural diagram of a data push server according to an embodiment of the present disclosure;
Fig. 6 is a schematic structural diagram of a client device according to an embodiment of the present disclosure;
fig. 7 is a schematic hardware structure of an electronic device according to an embodiment of the disclosure.
Detailed Description
In order that the above objects, features and advantages of the present disclosure may be more clearly understood, a further description of aspects of the present disclosure will be provided below. It should be noted that, without conflict, the embodiments of the present disclosure and features in the embodiments may be combined with each other.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present disclosure, but the present disclosure may be practiced otherwise than as described herein; it will be apparent that the embodiments in the specification are only some, but not all, embodiments of the disclosure.
In the presently disclosed embodiments, the words "exemplary" or "such as" are used to mean serving as an example, instance, or illustration. Any embodiment or design described herein as "exemplary" or "e.g." in the examples of this disclosure should not be taken as preferred or advantageous over other embodiments or designs. Rather, the invocation of words "exemplary" or "such as" are intended to present related concepts in a concrete manner. Furthermore, in the description of the embodiments of the present disclosure, unless otherwise indicated, the meaning of "a plurality" means two or more.
The following first describes a scene architecture of a push data display method in live video provided by an embodiment of the present disclosure.
Referring to fig. 1, a scene architecture of a push data presentation method in live video includes a video push server 11, a data push server 12, and a client device 13. In fig. 1, the client device 13 is illustrated as a mobile phone, but the embodiments of the present disclosure are not limited thereto, and the client device 13 may be a television, a computer, a tablet computer, virtual reality glasses, or the like.
The video push server 11 is configured to obtain a source video, and send a video stream of live video to the client device 13 according to the source video. For example: when the ball game is live broadcast, the video plug flow server 11 acquires a game picture of the ball game as a source video, and transmits a video stream to the client device 13 according to the game picture of the ball game. The data push server 12 is configured to obtain push data, and send a live video data stream to the client device 13 according to the push data. For example: when the ball game is live broadcast, the push data is generated according to the score change condition of the ball game, and corresponding push information is sent to the client device 13. The client device 13 is configured to display live video content according to the video stream sent by the video push server 11 and the data stream sent by the data push server 12.
Based on the above scene architecture, the embodiment of the disclosure provides a method for displaying push data in live video, referring to fig. 2, the method for displaying push data in live video includes the following steps:
s21, the data push server acquires video tape-casting time.
The video casting time is used for representing the time interval between the occurrence time of any event and the time when the video stream of the video live broadcast displays the event.
When live video is performed, due to time consumption of network transmission, time consumption of video encoding and decoding and the like, the time when a user views an event through a client device is later than the time when the event occurs, and the time interval between the time when the user views the event through the client device and the time when the event occurs is called video casting in the embodiment of the disclosure.
For example: when live video is played on the ball game, a ball event is generated in 08:21:15, and video frames corresponding to the ball event are shown on the client device through video streaming after the live video is played in 08:22:00, then the video streaming time can be determined according to the time (08:21:15) of the generated ball event and the time (08:22:00) of the video frames corresponding to the ball event on the client device, wherein the video streaming time is as follows: 08:22:00-08:21:15=45 seconds.
In some embodiments, the manner in which the data push server obtains the video streaming delay may include: and periodically acquiring video tape delay by taking the preset time length as a period.
In some embodiments, the manner in which the data push server obtains the video streaming delay may include: and acquiring one video casting time when the video live broadcast starts, and taking the acquired video casting time as the video casting time of the whole-field video live broadcast.
And S22, when the data push server receives push data corresponding to the first event, generating data push information carrying the push data, the video tape-casting time delay and the first time stamp.
Wherein the first timestamp is used to characterize an occurrence time of the first event.
In the embodiment, the video casting time is 45 seconds, if the push data corresponding to the goal event generated by 08:40:25 is push data for changing the score of the ball game from 1:0 to 1:1, when the push data corresponding to the goal event is received by the data push server, the data push information carrying the push data (for changing the score of the ball game from 1:0 to 1:1), the video casting time (45 seconds) and the first timestamp (08:40:25) for representing the occurrence time of the goal event may be generated.
S23, the data push server sends the data push information to the client device.
Correspondingly, the client device receives the data push information sent by the data push server. Wherein, the data push information includes: the video streaming method comprises the steps of pushing streaming data corresponding to a first event, a first time stamp and video streaming time delay, wherein the first time stamp is used for representing the occurrence time of the first event, and the video streaming time delay is used for representing the time interval between the occurrence time of any event and the time when a video stream of video live broadcast displays the event.
S24, the client device obtains the presentation time stamp of the push data according to the first time stamp and the video tape-casting time.
In some embodiments, the step S24 (the client device obtaining the presentation time stamp of the push data according to the first time stamp and the video casting time) includes:
and carrying out delay summation on the first timestamp and the video stream to obtain the presentation timestamp of the push stream data.
In the foregoing embodiment, the first timestamp is: and (08:40:25), wherein the video tape-casting time is 45 seconds, and the display time stamp of the data push stream obtained by summing the first time stamp and the video tape-casting time is: 08:41:10.
And S25, the client device displays the plug-flow data according to the display time stamp.
In some embodiments, the client device exposing the push data according to the exposure timestamp comprises:
And starting to display the push data at the moment characterized by the display time stamp.
As described in the previous embodiments, the presentation time stamp is: and if the push data starts to be displayed at the moment characterized by the display time stamp, changing the score in the live video from 08:41:10 to 1:1. Because the occurrence time of the goal event is 08:40:25 and the video casting time is 45 seconds, theoretically, the video picture of the goal event is displayed by the video stream of the live video at 08:41:10, so that the video stream of the live video can be synchronized with the data stream by changing the ratio of the video stream to 1:1 from 08:41:10, and further the user experience is improved.
When video live broadcasting is carried out, a data push server firstly obtains video tape casting time between the occurrence time of any event and the time when video tape of the video live broadcasting displays the event, generates data push information carrying with the push data, the video tape casting time and a first time stamp for representing the occurrence time of the first event when push data corresponding to the first event is received, and then sends the data push information to client equipment so that the client equipment can determine the display time stamp of the push data according to the first time stamp and the video tape casting time and display the push data according to the display time stamp. Because the data push information sent by the data push server to the client device comprises the video tape-casting time stamp and the first time stamp, the client determines the display time stamp of the push data according to the first time stamp and the video tape-casting time stamp, so that the push data corresponding to the first event can be prevented from being displayed before the video tape-casting of the first event, and the live broadcast watching experience of a user can be improved.
As an extension and refinement of the above embodiment, the embodiment of the present disclosure provides another method for displaying push data in live video, with reference to fig. 3, where the method for displaying push data in live video includes:
s31, the data push server acquires the second time stamp and the third time stamp.
The second timestamp is used for representing the relative time of a second event in video live broadcast, the second event is an event shown by a target video frame, and the third timestamp is used for representing the encoding time of the target video frame.
As an optional implementation manner of the embodiment of the present disclosure, the implementation manner of the step S31 (the data push server obtains the second timestamp) may include the following steps 311 and 312:
Step 311, determining target object information based on the image corresponding to the target video frame.
In some embodiments, the implementation manner of determining the target object information based on the image corresponding to the target video frame may include: and detecting the image corresponding to the target video frame to acquire target object information.
Step 312, obtaining the second timestamp according to the target object information.
For example, referring to fig. 4, by detecting the image 400 corresponding to the video frame shown in fig. 4, character strings such as "0:20:12", "aaaaaaaa", "bbbbbbb" may be obtained, and the obtained character strings may be further analyzed to determine that the relative time of the event shown by the target video frame is: 0:20:12, i.e., the target video frame shows that the event shown (second event) is an event that occurs at 0:20:12 of the video live.
As an optional implementation manner of the embodiment of the present disclosure, the implementation manner of the data push server to obtain the third timestamp includes the following steps 313 and 314:
Step 313, determining supplemental enhancement information (Supplemental Enhancement Information, SEI) frames adjacent to the target video frame from the video stream of the video live.
Step 314, obtaining the third timestamp according to the SEI frame.
Specifically, a frame of supplemental enhancement information frame is inserted into the video stream every preset time period (for example, 2 seconds), and the supplemental enhancement information frame contains the time of the operating system of the encoder, so that it can be determined that an SEI frame adjacent to the target video frame is acquired from the video stream of the live video stream, and the encoding time of the target video frame is acquired according to the SEI frame.
S32, the data push server acquires a fourth time stamp and a fifth time stamp.
Wherein the fourth timestamp is used for representing the occurrence time of a third event, and the fifth timestamp is used for representing the relative time of the third event.
The third event in the embodiments of the present disclosure may be any event, for example: a goal event in a ball game, etc.
For example: the third event is a goal event occurring at 20:15:13, and the relative time of the goal event is 0:15:13, and the fourth timestamp and the fifth timestamp are respectively 20:15:13 and 0:15:13.
As an optional implementation manner of the embodiment of the present disclosure, the third event is an event corresponding to push data with a minimum time interval of push data corresponding to the first event.
For example: when video live broadcasting is carried out on the ball game, the corresponding push data only exist at the goal time, and the third event is the last goal event.
And S33, the data push server determines a sixth timestamp used for representing the occurrence time of the event shown by the target video frame according to the second timestamp, the fourth timestamp and the fifth timestamp.
As an optional implementation manner of the embodiment of the disclosure, the step S34 (determining, according to the second timestamp, the fourth timestamp and the fifth timestamp, a sixth timestamp for characterizing an occurrence time of the event exhibited by the target video frame) includes the following steps 331 and 332:
step 331, acquiring a time interval based on a difference value between the second time stamp and the fifth time stamp.
In some embodiments, obtaining the time interval based on the difference between the second timestamp and the fifth timestamp comprises:
And calculating a difference value between the second time stamp and the fifth time stamp to acquire the time interval.
Setting: the second time stamp is rel_a, the fifth time stamp is rel_last, and the time interval is T, and then there are:
T＝Rel_A-Rel_Last
For example: the second time stamp is 0:20:12, the fifth time stamp is 0:15:13, and the time interval calculated according to t=rel_a-rel_last is 4 minutes and 59 seconds.
Step 332, acquiring the sixth timestamp based on the fourth timestamp and the time interval.
In some embodiments, based on the fourth timestamp and the time interval, obtaining the sixth timestamp comprises:
summing the fourth timestamp and the time interval to obtain the sixth timestamp.
Setting: the fourth timestamp is abs_last, the sixth timestamp is abs_a, and the time interval is T, then there are:
Abs_A＝T+Abs_Last＝Rel_-Rel_+Abs_Last
In the embodiment, the second time stamp is 0:20:12, the fifth time stamp is 0:15:13, the time interval is 4 minutes and 59 seconds, the sixth time stamp is 20:15:13, and the sixth time stamp is 20:20:12.
And S34, the data push server acquires video tape-casting time of the video stream according to the third time stamp and the sixth time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the step S35 (obtaining the video casting time of the video stream according to the third timestamp and the sixth timestamp) includes: and calculating a difference value between the third timestamp and the sixth timestamp to acquire the video casting time.
Setting: the third timestamp is sei_a, the video casting time is Diff, the sixth timestamp is abs_a, and there are:
Diff＝SEI_-Abs_
in the foregoing embodiment, the sixth timestamp is 20:20:12, and if the third timestamp is 20:20:57, the video casting time is 45 seconds.
And S35, when the data push server receives push data corresponding to the first event, generating data push information carrying the push data, the video tape-casting time delay and the first time stamp.
Wherein the first timestamp is used to characterize an occurrence time of the first event.
The implementation manner of step S35 is the same as that of step S22, and will not be described here again.
And S36, the data push server sends the data push information to the client device.
Correspondingly, the client device receives and transmits the data push information transmitted by the data push information.
And S37, the client device delays and sums the first timestamp and the video stream to acquire the presentation timestamp of the push stream data.
Setting: the first timestamp is abs_b, the video casting time is Diff, and the display timestamp is Disp, then there are:
Disp＝Abs_-Diff
for example: the first timestamp characterizing the occurrence of the first event is: 20:25:03, wherein the video tape casting time is 45 seconds, and the display time stamp for acquiring the push data is: 20:25:48.
S38, the client device displays the plug-flow data according to the display time stamp.
In some embodiments, the client device presents the push data according to the presentation timestamp, including:
and displaying the plug-flow data from the moment characterized by the display time stamp.
As described above, the presentation time stamp is: 20:25:48, the plug-flow data is presented starting from 20:25:48.
In some embodiments, the client device presents the push data according to the presentation timestamp, including steps 381 to 383 as follows:
step 381, a time stamp characterizing the encoding time of the currently displayed video frame is obtained.
That is, a time stamp at the time of encoding a currently displayed video frame is acquired.
In some embodiments, the timestamp of when the currently displayed video frame is encoded may be obtained through an SEI frame adjacent to the currently displayed video frame.
Step 382, determining whether a time stamp used to characterize the encoding time of the currently displayed video frame is greater than or equal to the presentation time stamp.
Whether the video stream of the live video stream has exhibited the first event can be determined by determining whether a timestamp characterizing the encoding time of the currently displayed video frame is greater than or equal to the exhibiting timestamp, if the timestamp characterizing the encoding time of the currently displayed video frame is greater than or equal to the exhibiting timestamp, it can be determined that the video stream of the live video stream has exhibited the first event, and if the timestamp characterizing the encoding time of the currently displayed video frame is less than the exhibiting timestamp, it can be determined that the video stream of the live video stream has not exhibited the first event.
In the above step 382, if the time stamp used to characterize the encoding time of the currently displayed video frame is greater than or equal to the presentation time stamp, the following step 383 is performed.
Step 382, the client device displays the push data.
Based on the same inventive concept, as an implementation of the above method, the embodiment of the present disclosure further provides a data push server and a client device, where the embodiment corresponds to the foregoing method embodiment, and for convenience of reading, details of the foregoing method embodiment are not described one by one in the present embodiment, but it should be clear that the image-based positioning device in the present embodiment can correspondingly implement all the details of the foregoing method embodiment.
An embodiment of the present disclosure provides a data push server, fig. 5 is a schematic structural diagram of the data push server, and as shown in fig. 5, the image-based positioning device 500 includes:
an acquisition unit 51 for acquiring video casting time;
The generating unit 52 is configured to generate data push information carrying the push data, the video tape-casting time delay and a first timestamp when receiving the push data corresponding to the first event; the first timestamp is used for representing the occurrence time of the first event;
and the sending unit 53 is configured to send the data push information to a client device, so that the client device determines a presentation time stamp of push data corresponding to the first event according to the first time stamp and the video casting time delay, and presents the push data corresponding to the first event according to the presentation time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit 51 is specifically configured to obtain a second timestamp and a third timestamp; the second timestamp is used for representing the relative moment of a second event in video live broadcast, the second event is an event displayed by a target video frame, and the third timestamp is used for representing the encoding moment of the target video frame; the fourth timestamp is used for representing the occurrence time of a third event, and the fifth timestamp is used for representing the relative time of the third event; determining a sixth timestamp characterizing an occurrence time of an event exhibited by the target video frame according to the second timestamp, the fourth timestamp and the fifth timestamp; and acquiring video casting time of the video stream according to the third time stamp and the sixth time stamp.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit 51 is specifically configured to determine target object information based on an image corresponding to the target video frame; and acquiring the second time stamp according to the target object information.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit 51 is specifically configured to determine, from the video stream of the live video, an SEI frame adjacent to the target video frame; and acquiring the third timestamp according to the SEI frame.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit 51 is specifically configured to obtain a time interval based on a difference value between the second timestamp and the fifth timestamp; the sixth timestamp is obtained based on the fourth timestamp and the time interval.
As an optional implementation manner of the embodiment of the present disclosure, the obtaining unit 51 is specifically configured to calculate a difference between the third timestamp and the sixth timestamp to obtain the video casting time.
As an optional implementation manner of the embodiment of the present disclosure, the third event is an event corresponding to push data with a minimum time interval of push data corresponding to the first event.
An embodiment of the present disclosure provides a client device, fig. 6 is a schematic structural diagram of the client device, as shown in fig. 6, where the client device 600 includes:
A receiving unit 61, configured to receive data push information sent by a data push server, where the data push information includes: the method comprises the steps of pushing stream data corresponding to a first event, a first timestamp and video streaming time delay, wherein the first timestamp is used for representing the occurrence time of the first event;
A processing unit 62, configured to obtain a presentation timestamp of the push data according to the first timestamp and the video casting time;
and a display unit 63, configured to display the push data according to the display timestamp. .
As an optional implementation manner of the embodiment of the present disclosure, the processing unit 62 is specifically configured to sum the first timestamp and the video stream delay to obtain a presentation timestamp of the push stream data corresponding to the first event.
As an optional implementation manner of the embodiment of the present disclosure, the display unit 63 is specifically configured to obtain a timestamp for characterizing an encoding time of a currently displayed video frame; judging whether a time stamp used for representing the coding time of the currently displayed video frame is larger than or equal to the presentation time stamp (the coding time is later than or equal to the time corresponding to the presentation time stamp); and if yes, displaying the plug flow data.
The data push server and the client device provided in this embodiment may execute the push data display method in the live video provided in the foregoing method embodiment, and the implementation principle and the technical effect are similar, and are not repeated herein.
Based on the same inventive concept, the embodiment of the disclosure also provides electronic equipment. Fig. 7 is a schematic structural diagram of an electronic device provided in an embodiment of the present disclosure, and as shown in fig. 7, the electronic device provided in the embodiment includes: a memory 701 and a processor 702, the memory 701 for storing a computer program; the processor 702 is configured to execute the push data presentation method in live video provided in the foregoing embodiment when executing a computer program.
Based on the same inventive concept, the embodiment of the present disclosure further provides a computer readable storage medium, where a computer program is stored on the computer readable storage medium, and when the computer program is executed by a processor, the computing device is caused to implement the push data display method in live video provided in the foregoing embodiment.
Based on the same inventive concept, the disclosed embodiments also provide a computer program product, which when run on a computer, causes the computing device to implement the push data presentation method in live video provided in the above embodiments.
It will be appreciated by those skilled in the art that embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present disclosure may take the form of a computer program product embodied on one or more computer-usable storage media having computer-usable program code embodied therein.
The Processor may be a central processing unit (Central Processing Unit, CPU), but may also be other general purpose processors, digital signal processors (DIGITAL SIGNAL Processor, DSP), application SPECIFIC INTEGRATED Circuit (ASIC), off-the-shelf Programmable gate array (Field-Programmable GATE ARRAY, FPGA) or other Programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, etc., such as Read Only Memory (ROM) or flash RAM. Memory is an example of a computer-readable medium.
Computer readable media include both non-transitory and non-transitory, removable and non-removable storage media. Storage media may embody any method or technology for storage of information, which may be computer readable instructions, data structures, program modules, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium which can be used to store information that can be accessed by a computing device. Computer-readable media, as defined herein, does not include transitory computer-readable media (transmission media), such as modulated data signals and carrier waves.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present disclosure, and not for limiting the same; although the present disclosure has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some or all of the technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present disclosure.
Claims (14)
1. The push data display method in the live video broadcast is characterized by comprising the following steps:
Acquiring video tape casting time delay;
When receiving push data corresponding to a first event, generating data push information carrying the push data, the video tape-casting time delay and a first time stamp; the first timestamp is used for representing the occurrence time of the first event;
And sending the data push information to the client device, so that the client device determines a presentation time stamp of the push data according to the first time stamp and the video tape-casting time, and presents the push data according to the presentation time stamp.
2. The method of claim 1, wherein the obtaining video casting time comprises:
Acquiring a second time stamp and a third time stamp; the second timestamp is used for representing the relative moment of a second event in video live broadcast, the second event is an event displayed by a target video frame, and the third timestamp is used for representing the encoding moment of the target video frame;
Acquiring a fourth time stamp and a fifth time stamp; the fourth timestamp is used for representing the occurrence time of a third event, and the fifth timestamp is used for representing the relative time of the third event;
Determining a sixth timestamp characterizing an occurrence time of the second event according to the second timestamp, the fourth timestamp and the fifth timestamp;
and acquiring video casting time of the video stream according to the third time stamp and the sixth time stamp.
3. The method of claim 2, wherein obtaining the second timestamp comprises:
Determining target object information based on an image corresponding to the target video frame;
and acquiring the second time stamp according to the target object information.
4. The method of claim 2, wherein obtaining the third timestamp comprises:
Determining supplemental enhancement information SEI frames adjacent to the target video frame from the live video stream;
and acquiring the third timestamp according to the SEI frame.
5. The method of claim 2, wherein the determining a sixth timestamp from the second timestamp, the fourth timestamp, and the fifth timestamp comprises:
acquiring a time interval based on the second timestamp and the fifth timestamp;
the sixth timestamp is obtained based on the fourth timestamp and the time interval.
6. The method of claim 2, wherein the obtaining the video casting time based on the second timestamp and the fifth timestamp comprises:
And calculating a difference value between the third timestamp and the sixth timestamp to acquire the video casting time.
7. The method of claim 2, wherein the third event is an event corresponding to push data having a smallest time interval of push data corresponding to the first event.
8. The data push stream display method in the live video broadcast is characterized by comprising the following steps:
Receiving data push information, wherein the data push information comprises: the method comprises the steps of pushing stream data corresponding to a first event, a first timestamp and video streaming time delay, wherein the first timestamp is used for representing the occurrence time of the first event;
Acquiring a presentation time stamp of the push data according to the first time stamp and the video tape-casting time;
And displaying the push data according to the display time stamp.
9. The method of claim 8, wherein the obtaining the presentation time stamp of the push data from the first time stamp and the video casting time delay comprises:
and carrying out delay summation on the first timestamp and the video stream to obtain the presentation timestamp of the push stream data.
10. The method of claim 8, wherein the presenting the push data according to the presentation time stamp comprises:
acquiring a time stamp used for representing the encoding time of the currently displayed video frame;
Judging whether a time stamp used for representing the coding time of the currently displayed video frame is larger than or equal to the presentation time stamp;
and if yes, displaying the plug flow data.
11. A data push server, comprising:
an acquisition unit configured to acquire video casting time;
the generating unit is used for generating data push information carrying the push data, the video tape-casting time delay and the first time stamp when receiving the push data corresponding to the first event; the first timestamp is used for representing the occurrence time of the first event;
And the sending unit is used for sending the data push information to the client equipment so that the client equipment can determine the presentation time stamp of the push data corresponding to the first event according to the first time stamp and the video tape delay and present the push data corresponding to the first event according to the presentation time stamp.
12. A client device, comprising:
the receiving unit is used for receiving the data push information sent by the data push server, and the data push information comprises: the method comprises the steps of pushing stream data corresponding to a first event, a first timestamp and video streaming time delay, wherein the first timestamp is used for representing the occurrence time of the first event;
the processing unit is used for acquiring the presentation time stamp of the push data according to the first time stamp and the video tape-casting time;
and the display unit is used for displaying the plug flow data according to the display time stamp.
13. An electronic device, comprising: a memory and a processor, the memory for storing a computer program; the processor is configured to cause the electronic device to implement the method for data push presentation in live video as claimed in any one of claims 1 to 10 when executing a computer program.
14. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a computer program which, when executed by a computing device, causes the computing device to implement the method of data push presentation in live video as claimed in any one of claims 1-10.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310341196.XA CN118741166A (en) | 2023-03-31 | 2023-03-31 | Plug flow data display method and device in video live broadcast |
| PCT/CN2024/085064 WO2024199498A1 (en) | 2023-03-31 | 2024-03-29 | Method and device for displaying stream pushing data in video livestreaming |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310341196.XA CN118741166A (en) | 2023-03-31 | 2023-03-31 | Plug flow data display method and device in video live broadcast |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN118741166A true CN118741166A (en) | 2024-10-01 |
Family
ID=92848220
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310341196.XA Pending CN118741166A (en) | 2023-03-31 | 2023-03-31 | Plug flow data display method and device in video live broadcast |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN118741166A (en) |
| WO (1) | WO2024199498A1 (en) |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108668158B (en) * | 2017-03-31 | 2020-07-10 | 武汉斗鱼网络科技有限公司 | Bullet screen synchronization method, client and bullet screen server |
| WO2018213481A1 (en) * | 2017-05-16 | 2018-11-22 | Sportscastr.Live Llc | Systems, apparatus, and methods for scalable low-latency viewing of integrated broadcast commentary and event video streams of live events, and synchronization of event information with viewed streams via multiple internet channels |
| CN112437316A (en) * | 2020-10-15 | 2021-03-02 | 北京三快在线科技有限公司 | Method and device for synchronously playing instant message and live video stream |
| US11470380B1 (en) * | 2021-03-26 | 2022-10-11 | Meta Platforms, Inc. | Systems and methods for adaptively managing live video streaming |
| CN115720275A (en) * | 2022-08-12 | 2023-02-28 | 尹家鸣 | Audio and video synchronization method, system, equipment and medium for AI digital person in live broadcast |
-
2023
- 2023-03-31 CN CN202310341196.XA patent/CN118741166A/en active Pending
-
2024
- 2024-03-29 WO PCT/CN2024/085064 patent/WO2024199498A1/en unknown
Also Published As
| Publication number | Publication date |
|---|---|
| WO2024199498A1 (en) | 2024-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR20210021099A (en) | Establishment and use of temporal mapping based on interpolation using low-rate fingerprinting to facilitate frame-accurate content modification | |
| KR101983107B1 (en) | Method for inserting information push into live video streaming, server and terminal | |
| WO2015090095A1 (en) | Information pushing method, device, and system | |
| CN110213635B (en) | Video mixing method, video mixing device and storage medium | |
| KR101841313B1 (en) | Methods for processing multimedia flows and corresponding devices | |
| US9426539B2 (en) | Integrated presentation of secondary content | |
| KR20210029829A (en) | Dynamic playback of transition frames while transitioning between media stream playbacks | |
| CN114079813A (en) | Picture synchronization method, coding method, video playing device and video coding device | |
| CN112911343B (en) | Multi-channel video playing method and device, electronic equipment and storage medium | |
| CN112601127A (en) | Video display method and device, electronic equipment and computer readable storage medium | |
| US11363086B2 (en) | Method and network equipment for establishing a manifest | |
| CN110139128B (en) | Information processing method, interceptor, electronic equipment and storage medium | |
| US20090282076A1 (en) | Playlist processing | |
| CN112954380B (en) | Video playing processing method and device | |
| CN108632644B (en) | Preview display method and device | |
| CN108574881B (en) | Projection type recommendation method, server and client | |
| CN118741166A (en) | Plug flow data display method and device in video live broadcast | |
| CN111010620B (en) | Method and device for multimedia resource carousel, electronic equipment and storage medium | |
| CN110602534B (en) | Information processing method and device and computer readable storage medium | |
| CN110322525B (en) | Method and terminal for processing dynamic diagram | |
| CN109862385B (en) | Live broadcast method and device, computer readable storage medium and terminal equipment | |
| CN111918074A (en) | Live video fault early warning method and related equipment | |
| CN110198457B (en) | Video playing method and device, system, storage medium, terminal and server thereof | |
| KR101936384B1 (en) | Method and apparatus for providing playing list to force viewers to watch video | |
| CN116546229A (en) | Interaction method, device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |