WO2021114552A1

WO2021114552A1 - Information processing method and apparatus, electronic device and storage medium

Info

Publication number: WO2021114552A1
Application number: PCT/CN2020/087486
Authority: WO
Inventors: 张帆
Original assignee: 北京市商汤科技开发有限公司
Priority date: 2019-12-11
Filing date: 2020-04-28
Publication date: 2021-06-17
Also published as: CN110996121A; KR20210090262A; TW202122989A; JP2022516701A

Abstract

The present disclosure relates to an information processing method and apparatus, an electronic device, and a storage medium. Said method comprises: performing face detection on a first video image in a video stream which is played back, so as to obtain face information of the first video image, sending the face information to a server, receiving a target material sent by the server, the target material being obtained on the basis of the face information, and in response to detecting that the video stream is played back to a playback start time corresponding to the target material, triggering the display of the target material. The present disclosure facilitates the implementation of automatic pop-up of third-party advertisement materials.

Description

Information processing method and device, electronic equipment and storage medium

Technical field

The present disclosure relates to the field of information processing technology, and in particular to an information processing method and device, electronic equipment, and storage medium.

Background technique

In some application scenarios of information processing, for example, in the scene of playing streaming media information (such as a video stream), other streaming media information other than the video stream, such as advertising materials, can also be displayed. However, for over-the-top (OTT) advertising materials provided by third-party service providers, since TVs and set-top boxes cannot obtain relevant content of third-party advertising materials, automatic insertion of advertising materials cannot be realized.

Summary of the invention

The present disclosure proposes a technical solution for information processing.

According to an aspect of the present disclosure, there is provided an information processing method, the method comprising: performing face detection on a first video image in a played video stream to obtain face information of the first video image; The server sends the face information; receives the target material sent by the server, wherein the target material is obtained based on the face information; in response to detecting that the video stream is played to the start playing time corresponding to the target material To trigger the display of the target material.

In a possible implementation manner, the target material includes an advertising material.

In a possible implementation manner, triggering the display of the target material includes: sending the target material to a terminal device so that the terminal device displays the target material; or, after the triggering of the display of the target material , The method further includes: displaying the target material.

In a possible implementation manner, the display mode of the target material includes: the target material is displayed in the corner of the video stream playback interface in the form of a corner mark; or the target material is associated with the playback content of the playback interface The ground is displayed on the video stream playback interface in the form of band-aids; or, the target material is displayed on the video stream playback interface in the form of banners and spans the playback interface.

In a possible implementation manner, the method further includes: receiving playback time information of the target material sent by the server, where the playback time information includes reference image information corresponding to a preset playback time period of the target material; The playing time information detects whether the video stream is played to the start playing time corresponding to the target material.

In a possible implementation manner, the reference image information includes: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material.

In a possible implementation manner, the multi-frame reference image is obtained by sampling multiple times on at least one time period adjacent to the preset playback time period.

In a possible implementation manner, based on the playback time information, detecting whether the video stream is played to the start playback time corresponding to the target material includes: comparing the second video image to be played of the video stream with the playback time The reference image information included in the information is compared to obtain a comparison result; based on the comparison result, it is determined whether the video stream is played to the start playing time corresponding to the target material. After the first video image is played, the second video image is played.

In a possible implementation manner, based on the comparison result, determining whether the video stream is played to the start playing time corresponding to the target material includes: when the comparison result is the first in the multi-frame reference image When a reference image is successfully compared, it is determined that the video stream is played to the start time corresponding to the target material, wherein the first M reference images in the multi-frame reference image include the first reference image.

In some embodiments, in response to detecting that the video stream is played to the start time corresponding to the target material, the display of the target material is triggered: in response to the second video image of the video stream and the multi-frame The first target reference image in the reference image is successfully compared, which triggers the display of the target material.

In some embodiments, in response to a successful comparison between the second video image of the video stream and the first target reference image in the multi-frame reference image, triggering the display of the target material includes: responding to detecting all If the second video image is successfully compared with the first target reference image, and the third video image of the video stream is successfully compared with the second target reference image in the multi-frame reference image, triggering the target material Displaying, wherein after the second video image is played, the third video image is played.

In a possible implementation manner, the method further includes: in a case where the comparison result is a successful comparison with a second reference image in the multi-frame reference image, determining to end the playback of the target material, wherein, The last N reference images in the multi-frame reference image include the second reference image. In some embodiments, the N reference images after the target reference image in the multi-frame reference image include the second reference image.

In some embodiments, in the case that the fourth video image of the video stream is successfully compared with the second reference image, the end playback of the target material is triggered.

In a possible implementation manner, the method further includes: in response to detecting the advertisement material meeting the preset blocking condition, displaying the target material.

In a possible implementation manner, the preset interception condition includes at least one of the following:

The default merchants listed in the blacklist;

The default advertising types listed in the blacklist;

A creative that has a different source or a different business from the target material.

According to one aspect of the present disclosure, there is provided an information processing method, the method comprising: receiving face information of at least one first video image sent by a terminal device; and determining the face information based on the face information and a face template library; The video stream information to which at least one first video image belongs, wherein the face template library includes a plurality of preset face templates; obtain target material according to the video stream information; send the target to the terminal device material.

In a possible implementation manner, determining the video stream information to which the at least one first video image belongs based on the face information and the face template library includes: based on multiple preset faces included in the face template library Template to obtain the person identity information corresponding to the face information; search a video library based on the person identity information to obtain the video stream information to which the at least one first video image belongs.

In a possible implementation, based on multiple preset face templates included in the face template library, obtaining the person identity information corresponding to the face information includes: determining that the face information corresponds to the multiple preset face templates. The first comparison result of the face template; based on the first comparison result, the person identity information corresponding to the face information is obtained.

In a possible implementation manner, the target material includes: advertising material.

In a possible implementation manner, the method further includes: sending play time information corresponding to the target material to the terminal device, wherein the play time information includes a reference image corresponding to a preset play time period of the target material information.

In a possible implementation manner, the method further includes: sampling the video stream information in at least one adjacent time period of the preset playback time period to obtain a multi-frame reference image; The feature extraction process obtains the feature information of the multi-frame reference image.

In a possible implementation manner, the method further includes: sending an advertisement blocking instruction to the terminal device, where the advertisement blocking instruction is used to indicate that when a specific advertisement material is detected in the video stream played by the terminal device, the The terminal device displays the target material.

According to an aspect of the present disclosure, there is provided an information processing device, the device comprising: a first detection unit configured to perform face detection on a first video image in a played video stream to obtain the first video The face information of the image; the first sending unit is used to send the face information to the server; the first receiving unit is used to receive the target material sent by the server, wherein the target material is based on the face information Obtained; a first response unit for triggering the display of the target material in response to detecting that the video stream is played to the start time corresponding to the target material.

According to another aspect of the present disclosure, there is provided an information processing apparatus, the apparatus comprising: a third receiving unit, configured to receive face information of at least one first video image sent by a terminal device; and an information determining unit, configured to Determine the video stream information to which the at least one first video image belongs based on the face information and face template library, where the face template library includes a plurality of preset face templates; a material acquisition unit for Obtain the target material according to the video stream information; the second sending unit is configured to send the target material to the terminal device.

According to an aspect of the present disclosure, there is provided an electronic device including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured to execute the above-mentioned information processing method.

According to an aspect of the present disclosure, there is provided a computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the foregoing information processing method is implemented.

In the embodiment of the present disclosure, face detection is performed on the first video image in the played video stream to obtain the face information of the first video image; the face information is sent to the server; the face information is received by the server The target material, wherein the target material is obtained based on the face information; in response to detecting that the video stream is played to the start time corresponding to the target material, the display of the target material is triggered, thereby facilitating the realization Automatic insertion of OTT creatives.

It should be understood that the above general description and the following detailed description are only exemplary and explanatory, rather than limiting the present disclosure.

According to the following detailed description of exemplary embodiments with reference to the accompanying drawings, other features and aspects of the present disclosure will become clear.

Description of the drawings

The drawings herein are incorporated into the specification and constitute a part of the specification. These drawings illustrate embodiments that conform to the present disclosure, and are used together with the specification to explain the technical solutions of the present disclosure.

Fig. 1 shows a flowchart of an information processing method according to an embodiment of the present disclosure.

Fig. 2a is a schematic diagram showing a frame of video image in a video stream according to an embodiment of the present disclosure.

Fig. 2b shows a schematic diagram of a frame of video image displaying target material according to an embodiment of the present disclosure.

3 to 5 show schematic diagrams of material display modes according to embodiments of the present disclosure.

Fig. 6 shows a flowchart of an information processing method according to an embodiment of the present disclosure.

Fig. 7 shows a schematic diagram of a sampling manner in a video search according to an embodiment of the present disclosure.

Fig. 8 shows a schematic diagram of a sampling manner in video stream information synchronization according to an embodiment of the present disclosure.

FIG. 9 shows a schematic diagram of the timing relationship of triggering the display of advertisement materials in the information processing method according to an embodiment of the present disclosure.

10-12 show schematic diagrams of multiple user interfaces of an information processing method according to an embodiment of the present disclosure.

FIG. 13 shows a block diagram of an information processing apparatus according to an embodiment of the present disclosure.

FIG. 14 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

FIG. 15 shows a block diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

Various exemplary embodiments, features, and aspects of the present disclosure will be described in detail below with reference to the drawings. The same reference numerals in the drawings indicate elements with the same or similar functions. Although various aspects of the embodiments are shown in the drawings, unless otherwise noted, the drawings are not necessarily drawn to scale.

The dedicated word "exemplary" here means "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" need not be construed as being superior or better than other embodiments.

The term "and/or" in this article is only an association relationship describing the associated objects, which means that there can be three relationships, for example, A and/or B, which can mean: A alone exists, A and B exist at the same time, exist alone B these three situations. In addition, the term "at least one" in this document means any one of a plurality of or any combination of at least two of the plurality, for example, including at least one of A, B, and C, may mean including A, Any one or more elements selected in the set formed by B and C.

In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. Those skilled in the art should understand that the present disclosure can also be implemented without certain specific details. In some instances, the methods, means, elements, and circuits well known to those skilled in the art have not been described in detail, so as to highlight the gist of the present disclosure.

Figure 1 shows a flow chart of an information processing method according to an embodiment of the present disclosure. The method is applied to an information processing device. For example, the information processing device is deployed on a terminal device and can play video streams, perform video synchronization checks, and display materials, etc. . Among them, terminal devices can include user equipment (UE, User Equipment), mobile devices, cellular phones, cordless phones, personal digital assistants (PDAs, Personal Digital Assistant), handheld devices, computing devices, in-vehicle devices, wearable devices, televisions, etc. . In some possible implementation manners, the information processing method may be implemented by a processor invoking computer-readable instructions stored in the memory. The flow of the information processing method shown in FIG. 1 includes steps S101-S104.

Step S101: The terminal device performs face detection on the first video image in the played video stream to obtain face information of the first video image.

In an example, the video stream may include video features such as TV shows or movies, short videos, variety shows, etc., and the video stream may be composed of multiple frames of video images. One or more frames of video images in a video stream can contain one or more face information. For example, feature extraction can be performed on the first video image through a feature extraction network to obtain multiple feature information, and then the multiple feature information Perform clustering, and obtain the face information according to the clustering results.

Step S102: The terminal device sends the face information to the server.

In an example, taking the first video image contained in a video stream as an example, if the first video image contains multiple face information, each individual face information can be extracted and sent to the server, and the server can The face information is compared with the preset face template in the face template library of the server, and the video stream information that matches the face information is obtained according to the comparison result. For example, you can search the cloud based on the comparison result. The video stream information is used to obtain a cloud drama series matching the video stream played by the terminal device, and the target material (such as advertising material, etc.) is obtained accordingly.

Step S103: The terminal device receives the target material sent by the server, where the target material is obtained based on the face information.

In an example, the target material includes an advertising material, and the advertising material can be obtained through facial information comparison performed by the server.

Step S104: In response to detecting that the video stream is played to the start time corresponding to the target material, the terminal device triggers the display of the target material.

In an example, the start playing time may be an advertising spot that displays the target material (such as an advertising material, etc.), and the starting time of playing the advertising material can be identified according to the advertising spot. Trigger the display of the creative at this ad point. Fig. 2a is a schematic diagram showing a frame of video image in a video stream according to an embodiment of the present disclosure. 2b is a schematic diagram showing a frame of video image displaying target material according to an embodiment of the present disclosure, wherein the played video stream is shown in the video feature 11, and the target material that triggers the display is shown in the advertisement material 12.

In one example, after the server obtains the target material by comparing the face information, it may send the target material to the terminal device that plays the video stream, so that the terminal device displays the target material. After triggering the display of the target material, the information processing method further includes: displaying the target material.

In the scene of playing a video stream, the above-mentioned target material may be an OTT advertising material. OTT advertising materials are provided by third-party service providers via the Internet (such as operators). By adopting the above-mentioned technical solution disclosed in this application, it is realized that "the terminal device extracts the face information from the first video image of the video stream and sends it to the server for analysis; the server searches in the cloud video stream information to obtain the corresponding target material (Such as advertising material, etc.) and send the target material to the terminal device; and complete the processing logic of the display of the target material on the terminal device. Through this processing logic, an ordinary non-smart TV can be turned into a high-definition smart TV. That is, based on this processing logic, an ordinary non-smart TV can not only obtain information through the Internet (such as the network provided by the operator) The resources of big video content can also get more diversified effective information (such as target material) from a large number of third-party material content providers on the server. Through this processing logic, face detection is performed on the first video image in the played video stream, and after obtaining the face information, the face information is sent to the server for comparison, so as to obtain the corresponding target material based on the face information , So as to realize the automatic and accurate insertion of OTT ads.

In some possible implementation manners, taking the target material as an advertising material as an example, the display mode of the advertising material may include corner marks, band-aids, banners, etc., and Figures 3 to 5 show the display of the target material according to embodiments of the present disclosure. The schematic diagram of the method is as follows:

1. The display mode may be: the advertising material 13 is displayed in the corner of the video stream playing interface in the form of a corner mark, as shown in FIG. 3.

2. The display mode may be: the advertisement material 14 is displayed on the video stream playback interface in the form of band-aids in association with the playback content of the playback interface, as shown in FIG. 4. For example, if the key information "national liberation" included in the broadcast content is detected, the key information will be queried for the key information or the creatives associated with the key information, and the queried creatives will be displayed to the broadcaster. In the interface, to echo each other with the content to be played. For example, the ad word "Lifelong Loyalty" contained in the creative is related to the key message "National Liberation". The creative can be displayed on the playback interface to echo the content of the broadcast.

3. The display mode may be: the advertisement material 15 is displayed on the video stream playback interface in the form of a banner and spans the playback interface, as shown in FIG. 5.

In some possible implementation manners, the information processing method further includes: receiving playback time information of the target material sent by the server, where the playback time information includes a reference corresponding to a preset playback time period of the target material Image information; based on the playback time information, detect whether the video stream is played to the start playback time corresponding to the target material. Wherein, the reference image information includes: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material. The multi-frame reference image is obtained by sampling multiple times on at least one time period adjacent to the preset playback time period.

In some possible implementations, based on the play time information, detecting whether the video stream is played to the start play time corresponding to the target material includes: comparing the second video image to be played of the video stream with the The reference image information included in the playback time information is compared to obtain a comparison result; based on the comparison result, it is determined whether the video stream is played to the start playback time corresponding to the target material. The playback of the second video image is after the first video image.

In an example, comparing the second video image to be played in the video stream with the reference image information to obtain the comparison result includes: performing feature extraction processing on the second video image to obtain the second video image. The feature information of the video image; based on the similarity between the feature information of the second video image and the feature information of at least one frame of reference image in the reference image information, a comparison result is obtained. By comparing the feature information of the second video image with the feature information of the reference image, the similarity between the feature information can be obtained, and the comparison result can be obtained. The terminal device can determine whether the video stream is played to the start playing time corresponding to the target material according to the comparison result, so as to trigger the display of the target material at the start playing time, and display the target material after the display of the target material is triggered.

In some embodiments, when the similarity between the feature information of the video image and the feature information of the reference image is greater than or equal to a preset threshold, it can be determined that the comparison between the video image and the reference image is successful. The preset threshold may be determined according to the method of determining the similarity actually used.

In some possible implementation manners, in the case that the second video image is successfully compared with the first reference image in the multi-frame reference image, it is determined that the video stream is played to the start playing time corresponding to the target material, Wherein, the first M reference images in the multi-frame reference image include the first reference image.

In some embodiments, the video image of the video stream may be compared with a multi-frame reference image to determine whether to trigger the display of the target material. For example, when the second video image is successfully compared with the first reference image, the display of the target material may be triggered, or when the second video image is successfully compared with the first reference image and the third video image is compared with the third When the reference image is successfully compared, the display of the target material is triggered, where the third video image is played after the second video image, and the first reference image and the third reference image may be included in multiple frames of reference images For any reference image within the first M reference images, or a preset reference image, the specific triggering mechanism can be determined according to actual requirements, which is not limited in the embodiment of the present disclosure.

In some embodiments, when the second video image of the video stream is successfully compared with the second reference image in the multi-frame reference image, it is determined to end the playback of the target material, and/or trigger the target End playback of the material, wherein the last N reference images in the multi-frame reference image include the second reference image.

In some embodiments, the reference image information includes: feature information of a multi-frame reference image associated with the start playing time of the target material. In an optional example, the multi-frame reference image is obtained by sampling multiple times on at least one time period adjacent to the preset playback time period. The preset play time period may include one or more preset time points, for example, include a time point (ie: start play time = end play time), or include start play time and end play time, or include start play time , End playing time and at least one point in time between the two. In an optional example, the multi-frame reference image is obtained by sampling the first time period and the second time period adjacent to the start playing time for multiple times, wherein the end of the first time period is the Play start time, and the start of the second time period is the start play time. The duration of the second time period may be the advertisement duration of the advertisement spot or slightly greater than the advertisement duration of the advertisement spot, or the start of the second time period is the next time point adjacent to the start playing time, At this time, optionally, in the above example, the first reference image is sampled in the first time period. The second reference image is sampled in the second time period, but the embodiment of the present disclosure does not limit this.

In some embodiments, in response to detecting that the second video image is successfully compared with the first reference image, the video synchronization check is started. When it is detected that the third video image in the video stream is successfully compared with the preset target reference image in the multi-frame reference image, the display of the target material is triggered.

In some possible implementation manners, the information processing method further includes: displaying the target material in response to detecting the advertising material that meets the preset blocking condition. Wherein, the preset blocking condition includes at least one of the following: preset merchants listed in the blacklist; preset advertisement types listed in the blacklist; or those with different sources or different merchants from the target material Creative.

In an example, the server sends an advertisement blocking instruction to the terminal device. The advertisement blocking instruction is used to indicate that the terminal device displays the target material when an advertisement that meets the preset blocking condition is detected in the video stream played by the terminal device. For example, the advertising material played in the video stream is Nike sneakers, and the terminal device determines that the Nike sneakers are listed in the blacklist according to the advertisement blocking instructions, and the target material will be displayed in the form of corner tags, band-aids or banners, for example Ads for Adidas sneakers. In another example, the advertising material played in the video stream is a Mercedes-Benz ad, which is a competing product with the target material "BMW Ad". Once found, the terminal device immediately displays the BMW ad in the form of a corner mark, band-aid or banner, etc. Improve the accuracy of playback of your own creatives. According to the present disclosure, when a creative with a preset blocking condition appears, the matched creative can be popped up, so as to perform precise blocking processing on the creative with the preset blocking condition.

6 shows a flowchart of an information processing method according to an embodiment of the present disclosure, the method is applied to an information processing device, the information processing device is deployed on the server and can perform video stream information search and play the video stream and the displayed material Synchronize. As shown in Figure 6, the process includes steps S201-S204.

Step S201: The server receives the face information of at least one first video image sent by the terminal device.

In an example, the video stream played by the terminal device contains at least one first video image. For any one of the video images, feature extraction can be performed on the first video image through a feature extraction network to obtain a corresponding video image. Multiple feature information, cluster the multiple feature information, and obtain face information according to the clustering result. After performing face detection processing on all the first video images of the at least one first video image, the face information of the at least one first video image is sent to the server, and the server receives the face information of the at least one first video image, and performs The face information is compared, and the target material corresponding to the video stream information (such as cloud drama) is obtained according to the comparison result. In an example, the cloud drama series may be a video feature, a short video, a variety show, etc. of a TV series or movie.

Step S202: The server determines the video stream information to which the at least one first video image belongs based on the face information and face template library, where the face template library includes a plurality of preset face templates.

In an example, based on a plurality of preset face templates included in the face template library, person identity information corresponding to the face information can be obtained. The video library is searched based on the identity information of the person, and the video stream information to which at least one first video image belongs can be obtained. Taking the video stream played by the terminal device as a TV series as an example, according to the character identity information (such as Huo Jianhua), a possible series matching the played TV series can be searched from the cloud series, for example, "Zhen Huan Biography".

Wherein, based on the plurality of preset face templates included in the face template library, obtaining the person identity information corresponding to the face information may include: determining the first comparison result of the face information and the plurality of preset face templates ; Based on the first comparison result, the person identity information corresponding to the face information (such as Huo Jianhua) is obtained.

Step S203: The server obtains the target material according to the video stream information.

In an example, after searching for a video according to the person's identity information and obtaining the video stream information to which at least one first video image belongs, the target material can also be obtained according to the video stream information, where the target material includes advertising materials and the like. For example, you can search the cloud (server) video stream information according to the person’s identity information to get the cloud drama series "such as Zhen Huan Chuan Episode 3" that matches the video stream played by the terminal device, and obtain the corresponding advertising materials based on this, etc., That is, get the corresponding advertising material implanted in "Zhen Huan Chuan Episode 3". Assuming that the cloud drama series to be embedded with ads includes a total of 70 episodes, each with 8 advertising spots, and the placement of advertising materials can be completed by the operator. The cast list, episode name, episode video, episode number and cast list of the episode are also uploaded to the server in advance by the operating staff. The synchronization between the playing video stream and the displayed material can be completed in advance.

Step S204: The server sends the target material to the terminal device.

In one example, after the target material (such as advertising material, etc.) is obtained through the above-mentioned face information comparison, the server sends the target material to the terminal device. After receiving the target material, the terminal device can respond to detecting that the video stream is played. To the start playing time corresponding to the target material, the display of the target material is triggered.

Using the technical solution disclosed in this application, the server receives the face information of at least one first video image sent by the terminal device, and compares the face information with a plurality of preset face templates in the face template library, so as The comparison result obtains the corresponding video stream information, and the target material is obtained according to the video stream information. Among them, when the target material is an advertising material, the advertising material can be fed back to the terminal device to complete the display of the advertising material on the terminal device. Since the loading and display method of the target material (such as advertising material, etc.) is obtained by comparing the face information in the played video stream, the target material can be accurately matched to the video stream, so that the user can get the information in real time More effective information related to the video stream (such as accurate delivery such as advertising materials, etc.).

In some possible implementation manners, the information processing method further includes: sending play time information corresponding to the target material to the terminal device, where the play time information includes a preset play time period of the target material Corresponding reference image information. The reference image information includes: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material.

In some possible implementation manners, the information processing method further includes: sampling the video stream information in at least one adjacent time period of the preset playing time period to obtain multiple frames of reference images, and The frame reference image is subjected to feature extraction processing to obtain the feature information of the above-mentioned multi-frame reference image.

In some possible implementation manners, the information processing method further includes: sending an advertisement blocking instruction to the terminal device, where the advertisement blocking instruction is used to indicate that when it is detected that a specific advertisement material appears in the video stream played by the terminal device When, the terminal device displays the target material. For example, the advertising material played in the video stream is Nike sneakers. According to the advertisement blocking instruction, the terminal device inquires that the Nike sneakers are listed in the blacklist, and the target material will be displayed in the form of corner labels, band-aids or banners. For example, ads for Adidas sneakers. For another example, the advertising material played in the video stream is a Mercedes-Benz ad, which is a competing product with the target material "BMW ad". According to the ad blocking instruction, once a Mercedes-Benz ad is found, the terminal device will immediately display it in the form of a corner mark, band-aid or banner. BMW advertising to improve the accuracy of its own advertising material playback. According to the present disclosure, according to the advertisement blocking instruction, once the advertisement material that meets the preset blocking condition is queried, the matching advertisement material can be popped up, so as to accurately intercept the advertisement material that meets the preset blocking condition.

In an example of the present disclosure, the video stream played by the terminal device includes at least one first video image, and the first video image includes one or more facial information, and the facial information needs to be detected. The target material can be an advertising material, and the server searches for cloud video stream information (such as cloud drama) based on the face information detected by the terminal device. After determining the currently playing cloud drama series and the current playing time point, the server may send the advertising material and the reference image information to the terminal device. The terminal device compares the reference image feature information to determine the starting time according to the comparison result, so that the display of the advertising material is triggered at the starting time (or advertising point), and then the advertising material is displayed. The following describes the process of video stream information search, video stream information synchronization, and creative trigger display provided by the embodiments of the present application:

One: Video stream information search: including episode search and a single episode search in the episode

As far as episode search is concerned, it is necessary to search for which cloud episode the video stream played by the terminal device belongs to. Among them, the cast list, episode name, episode video, episode number, cast list, etc. of the cloud episode can be determined by The operations staff upload to the cloud server in advance. After the terminal device starts to play the video stream, it can use the SDK (Software Development Kit) or APP (Application) of the terminal device to detect the video played within 3 minutes, and detect the independent facial information in one or more frames of the video stream as The face information to be compared is uploaded to the server. The server compares the face information to be compared with the actors in the cloud drama series to identify the identity information of the characters based on the comparison results, such as multiple actor names or the cast list of the drama. The cast of each actor name or drama series matches the most likely cloud drama (such as the biography of Zhen Huan).

For single-episode search, after confirming that the video stream played by the terminal device belongs to a known cloud episode, it is necessary to search for which episode in the cloud episode. After detecting the cloud drama series corresponding to the video stream played by the terminal device, the SDK or APP of the terminal device can upload a frame of video image in the video stream to the server at a certain frequency, for example, once every minute, to perform ordering. Set search processing. FIG. 7 shows a schematic diagram of a sampling method in a video search according to an embodiment of the present disclosure. As shown in FIG. 7, the server can sample all advertising spots in a cloud drama (for example, 70 episodes). The sampling method can be 1 minute before each advertisement point, and 1 frame per second, that is: 70 episodes, 8 advertisement spots in each episode, a total of 70*8*60=33600 frames are sampled, and 33600 frames are sampled. Frames. These 33600 sample frames correspond to multiple preset playback time periods. The server compares a frame of video image uploaded by the terminal device with all the sampled frames (33600 frames) of the cloud drama, and finds the most similar frame of sampled video image to this frame of video image among the sampled frames, thereby determining what is being played The video stream is the single episode number corresponding to the sampled video image of the frame (such as the third episode of Zhen Huan's biography) and the playback time (accurate to the second).

2: Video stream information synchronization

As far as the video stream information synchronization is concerned, the server can synchronize the video stream information in advance to ensure that the terminal device triggers the display of the advertising material at the synchronized advertising point. FIG. 8 shows a schematic diagram of a sampling method in video stream information synchronization according to an embodiment of the present disclosure. As shown in FIG. 8, during the video stream information synchronization process, the server can perform a total of 8 seconds before and after each advertisement point, according to each second Two frames are sampled to obtain 16 reference images, and then feature information is extracted for each frame of these 16 reference images. For example, the key pixel information in each frame of reference image can be extracted to compress the amount of data to be processed. Improve the efficiency of synchronization processing. After detecting the single episode number corresponding to the video stream information being played by the terminal device (such as the third episode of Zhen Huan's biography) and the playing time (accurate to the second), the server can play all subsequent advertising points after the video stream information Bit reference image feature information (for example, a total of 16*8=144 pieces of feature information in an episode of video), the time point of each frame of reference image, and the SDK or APP that the advertising material is delivered to the terminal device. By continuing to play the video stream information on the SDK or APP of the terminal device, the currently played video stream information can be compared with the feature information of the reference image downloaded locally, and the similarity between the feature information can be obtained, and the comparison result can be obtained. The terminal device confirms whether the video stream is played to the start playing time corresponding to the creative according to the comparison result, so as to trigger the display of the creative at the start playing time, and display the creative after triggering the display of the creative.

It should be pointed out that since the video stream information played by the terminal device is an episode in the target drama series, and there is more than one advertisement spot in an episode, that is, there are multiple advertisement spots, multiple sampling is required. The sampling in the video stream information synchronization is to find all the advertising spots in the set, and synchronize these advertising spots to the SDK or APP of the terminal device, and then continue to play the video stream on the SDK or APP of the terminal device Information, after comparing the video stream information with reference image feature information, the advertisement spot closest to the current playing point of the current video stream information can be obtained, so that the corresponding advertisement material can be displayed at the advertisement spot. This is different from the sampling in the above video search. The sampling here is to compare the feature information of the reference image of a certain episode in the cloud drama with the video stream information played by the terminal device to search for the currently playing video The flow information is the display of the advertising material of which advertising point should be concentrated.

Three: The creative triggers the display:

FIG. 9 shows a schematic diagram of the relationship between time nodes that trigger advertisement display in an information processing method according to an embodiment of the present disclosure. As shown in FIG. 9, when the video stream information played by the SDK or APP of the terminal device is played to the end of t1, and the video If the synchronization check is passed, for the SDK, the APP of the terminal device can be notified to display the advertising content; for the APP, the advertising content can also be displayed directly through the APP of the terminal device. During the advertisement playback, the SDK keeps the video synchronization check until the end of t2. With reference to Figure 8, the reference image information corresponding to the nearest advertising spot includes the feature information of 16 frames of reference images, these 16 frames of reference images include: the first frame of reference image, the second frame of reference image, ..., the sixth frame of reference image ,..., the sixteenth frame reference image. In the process of video stream information synchronization, if the second video image corresponding to the current playback point is successfully compared with the first reference image in the t1 time period (for example, 3s before the advertising point), it is assumed to be compared with the third frame reference image If it succeeds (also known as the first comparison success), the terminal device can determine that when it detects that the third video image in the current video stream is successfully compared with the sixth frame reference image, it will trigger the display of the advertising material, and The video synchronization check continues after the first comparison is successful. During the video synchronization check process, when it is detected that the third video image in the current video stream is successfully compared with the sixth frame reference image (also referred to as the target reference image above), the display of the advertising material is triggered. During the display of the advertising material, the terminal device continues to check the video synchronization. When it is detected that the fourth video image in the current video stream is successfully compared with the sixteenth frame reference image, the display of the advertising material ends. If the video stream information played by the SDK or APP of the terminal device cannot be successfully compared with at least one frame of the reference image from the seventh frame to the 16th frame during the advertisement display process, that is, the terminal device is deemed to have switched to the content to be played, and the advertisement is stopped. The presentation of the material. At the same time, the video stream search and video stream information synchronization are initiated again. In this embodiment, for the advertisement point, the time period for the video synchronization check is from the playback point of the second video image to the end time of t2. If the video synchronization check within the time period of the video synchronization check is successful, the creative can be played to the end of t2.

Assuming that the advertising spot is the first advertising spot in the episode video, in some embodiments, the episode video has a total of 40 minutes, including 8 advertising spots, and the first advertising spot is the 5th minute and the 0th. Second to the 5th second of the fifth minute, the second advertising point is the 0th second of the 10th minute to the 5th second of the 10th minute, and so on. After displaying the creative at the first advertising point, the terminal device will The video synchronization check of the second advertising spot starts at the 57th second of the 9th minute. During the video synchronization check process, the frequency of comparing the video image with the reference image can be twice per second, which is consistent with the sampling frequency of the reference image. 10-12 show schematic diagrams of examples of multiple user interfaces of the information processing method according to an embodiment of the present disclosure, where, as shown in FIG. 10, in the process of playing the video stream information on the terminal device, the playback of the video stream information is obtained Click "00:16" to request the server to query video resources, for example, which cloud episode is currently playing and which episode is currently playing, and you can also request the server to query the advertising point so that the corresponding advertising material can be triggered at the advertising point. display. As shown in Figure 11, after the server video search is completed and the terminal device receives the advertising material sent by the server, the video name and advertising point "00:30-00:35" are displayed on the terminal device, and the playback point is " 00:16". When the video stream reaches 00:30 and the video synchronization check passes, the creative will be displayed. As shown in Figure 12, during the process of displaying the advertising material, that is, within the interval of the advertising point "00:30-00:35", the current playback point is displayed.

Those skilled in the art can understand that in the above-mentioned methods of the specific implementation, the writing order of the steps does not mean a strict execution order but constitutes any limitation on the implementation process. The specific execution order of each step should be based on its function and possibility. The inner logic is determined.

The foregoing various method embodiments mentioned in the present disclosure can all be combined with each other to form a combined embodiment without violating the principle and logic, and the length is limited, and the details of this disclosure will not be repeated.

In addition, the present disclosure also provides information processing devices, electronic equipment, computer-readable storage media, and programs, all of which can be used to implement any information processing method provided in the present disclosure. For the corresponding technical solutions and descriptions, refer to the corresponding records in the method section. ,No longer.

FIG. 13 shows a block diagram of an information processing device according to an embodiment of the present disclosure. As shown in FIG. 13, the processing device includes: a first detection unit 51, configured to perform human operations on the first video image in the played video stream. Face detection to obtain the face information of the first video image; the first sending unit 52 is used to send the face information to the server; the first receiving unit 53 is used to receive the target material sent by the server, where The target material is obtained based on the face information; the first response unit 54 is configured to trigger the display of the target material in response to detecting that the video stream is played to the start time corresponding to the target material. After the terminal device performs face detection on the first video image in the played video stream, the face information of the first video image can be obtained. In the case where the target material includes an advertising material, through the face information comparison on the server side, the advertising material can be obtained according to the face information comparison and sent to the terminal, and the terminal device responds to detecting that the video stream is played to The start playing time corresponding to the creative will trigger the display of the creative and then display the creative.

Since the loading and display methods of materials such as creatives are obtained by comparing the face information in the first video image in the playing video stream, the display of the creatives can be accurate after the terminal device receives the creatives It is matched with the video stream being played, so that the user can get more effective information related to the video stream in real time (such as accurate delivery such as advertising materials, etc.).

In some possible implementation manners, the first response unit is configured to: send the target material to a terminal device so that the terminal device displays the target material; or, in the triggering of the target material After the display, the target material is displayed.

In some possible implementation manners, the display manner of the target material includes at least one of the following:

1) The target material is displayed in the corner of the video stream playback interface in the form of a corner mark;

2) The target material is displayed on the video stream playback interface in the form of band-aids in association with the playback content of the playback interface;

3) The target material is displayed on the video stream playback interface in the form of a banner and spans the playback interface.

In some possible implementation manners, the device further includes: a second receiving unit, configured to receive playback time information of the target material sent by the server, where the playback time information includes preset playback of the target material Reference image information corresponding to the time period; a second detection unit, configured to detect whether the video stream is played to the start playing time corresponding to the target material based on the play time information.

In some possible implementation manners, the reference image information includes: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material.

In some possible implementation manners, the multi-frame reference image is obtained by sampling multiple times on at least one time period adjacent to the preset playback time period.

In some possible implementation manners, the second detection unit is configured to: compare the second video image to be played in the video stream with the reference image information included in the playback time information to obtain a comparison result ; Based on the comparison result, it is determined whether the video stream is played to the start playing time corresponding to the target material.

In some possible implementation manners, the second detection unit is configured to: perform feature extraction processing on the second video image to obtain feature information of the second video image; and based on the feature of the second video image The similarity between the information and the feature information of at least one frame of reference image included in the reference image information, to obtain a comparison result.

In some possible implementation manners, the second detection unit is configured to determine the video stream when the comparison result is a successful comparison with the first reference image in the multi-frame reference image Play to the start time corresponding to the target material.

In some possible implementation manners, when the comparison result is a successful comparison with the second reference image in the multi-frame reference image, it is determined to end the playback of the target material.

The first M reference images in the multi-frame reference image include the first reference image, and the last N reference images in the multi-frame reference image include the second reference image.

In some possible implementation manners, the device further includes a material display unit configured to display the target material in response to detecting the advertising material that meets the preset blocking condition.

In some possible implementation manners, the preset interception condition includes at least one of the following:

The default merchants listed in the blacklist;

The default advertising types listed in the blacklist;

The present disclosure provides an information processing device. The device includes: a third receiving unit for receiving face information of at least one first video image sent by a terminal device; an information determining unit for receiving face information based on the face information Determine the video stream information to which the at least one first video image belongs with the face template library, where the face template library includes a plurality of preset face templates; the material acquisition unit is configured to obtain information based on the video stream information , Obtain the target material; the second sending unit is configured to send the target material to the terminal device. Wherein, the target material may include an advertising material to determine the video stream information to which at least one first video image belongs based on the comparison of the face information on the server side, for example, based on the face information and the face template library, so that Obtain the creative according to the video stream information. The server sends the advertisement material obtained by comparing the face information to the terminal device. In response to detecting that the video stream is played to the start time corresponding to the advertisement material on the terminal side, the display of the advertisement material is triggered to display the advertisement material. Creative.

In some possible implementation manners, the information determining unit is configured to: obtain the person identity information corresponding to the face information based on a plurality of preset face templates included in the face template library; The identity information searches the video library to obtain the video stream information to which the at least one first video image belongs.

In some possible implementations, the information determining unit is configured to: determine a first comparison result of the face information and the plurality of preset face templates; and obtain based on the first comparison result Personal identity information corresponding to the face information.

In some possible implementation manners, the apparatus further includes a third sending unit, configured to: send the play time information corresponding to the target material to the terminal device, where the play time information includes the time information of the target material The reference image information corresponding to the preset playing time period.

In some possible implementation manners, the device further includes: a sampling unit, configured to sample the video stream information in at least one adjacent time period of the preset playback time period to obtain a multi-frame reference image; The extraction unit is configured to perform feature extraction processing on the multi-frame reference image to obtain feature information of the multi-frame reference image.

In some possible implementation manners, the apparatus further includes a fourth sending unit, configured to send an advertisement blocking instruction to the terminal device, where the advertisement blocking instruction is used to indicate when a video stream played by the terminal device is detected When a specific advertising material appears in the display, the terminal device displays the target material.

In some embodiments, the functions or modules contained in the device provided in the embodiments of the present disclosure can be used to execute the methods described in the above method embodiments. For specific implementation, refer to the description of the above method embodiments. For brevity, here No longer.

The embodiments of the present disclosure also provide a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above-mentioned method when executed by a processor. The computer-readable storage medium may be a volatile computer-readable storage medium or a non-volatile computer-readable storage medium.

The embodiments of the present disclosure also provide a computer program product, which includes computer-readable code. When the computer-readable code runs on the device, the processor in the device executes the information processing method for implementing the information processing method provided by any of the above embodiments. instruction.

The embodiments of the present disclosure also provide another computer program product for storing computer-readable instructions, which when executed, cause the computer to perform the operations of the information processing method provided by any of the foregoing embodiments.

The computer program product can be specifically implemented by hardware, software, or a combination thereof. In an optional embodiment, the computer program product is specifically embodied as a computer storage medium. In another optional embodiment, the computer program product is specifically embodied as a software product, such as a software development kit (SDK), etc. Wait.

An embodiment of the present disclosure also provides an electronic device, including: a processor; a memory for storing executable instructions of the processor; wherein the processor is configured as the above-mentioned method.

The electronic device can be provided as a terminal device, a server, or other types of devices.

Fig. 14 is a block diagram showing an electronic device 800 according to an exemplary embodiment. For example, the electronic device 800 may be a mobile phone, a computer, a digital broadcasting terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and other terminal devices.

14, the electronic device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, and a sensor component 814 , And communication component 816.

The processing component 802 generally controls the overall operations of the electronic device 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the foregoing method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

The memory 804 is configured to store various types of data to support operations in the electronic device 800. Examples of these data include instructions for any application or method to operate on the electronic device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.

The power supply component 806 provides power for various components of the electronic device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with the generation, management, and distribution of power for the electronic device 800.

The multimedia component 808 includes a screen that provides an output interface between the electronic device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, sliding, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure related to the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. When the electronic device 800 is in an operation mode, such as a shooting mode or a video mode, the front camera and/or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the electronic device 800 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker for outputting audio signals.

The I/O interface 812 provides an interface between the processing component 802 and a peripheral interface module. The above-mentioned peripheral interface module may be a keyboard, a click wheel, a button, and the like. These buttons may include, but are not limited to: home button, volume button, start button, and lock button.

The sensor component 814 includes one or more sensors for providing the electronic device 800 with various aspects of state evaluation. For example, the sensor component 814 can detect the on/off status of the electronic device 800 and the relative positioning of the components. For example, the component is the display and the keypad of the electronic device 800. The sensor component 814 can also detect the electronic device 800 or the electronic device 800. The position of the component changes, the presence or absence of contact between the user and the electronic device 800, the orientation or acceleration/deceleration of the electronic device 800, and the temperature change of the electronic device 800. The sensor component 814 may include a proximity sensor configured to detect the presence of nearby objects when there is no physical contact. The sensor component 814 may also include a light sensor, such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge Coupled Device) image sensor for use in imaging applications. In some embodiments, the sensor component 814 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 816 is configured to facilitate wired or wireless communication between the electronic device 800 and other devices. The electronic device 800 can access a wireless network based on a communication standard, such as WiFi, 2G, 3G, 4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

In an exemplary embodiment, the electronic device 800 may be implemented by one or more application-specific integrated circuits (ASIC), digital signal processors (DSP), digital signal processing devices (DSPD), programmable logic devices (PLD), field-available A programmable gate array (FPGA), controller, microcontroller, microprocessor, or other electronic components are implemented to implement the above methods.

In an exemplary embodiment, there is also provided a non-volatile computer-readable storage medium, such as the memory 804 including computer program instructions, which can be executed by the processor 820 of the electronic device 800 to complete the foregoing method.

Fig. 15 is a block diagram showing an electronic device 900 according to an exemplary embodiment. For example, the electronic device 900 may be provided as a server. 15, the electronic device 900 includes a processing component 922, which further includes one or more processors, and a memory resource represented by a memory 932, for storing instructions that can be executed by the processing component 922, such as an application program. The application program stored in the memory 932 may include one or more modules each corresponding to a set of instructions. In addition, the processing component 922 is configured to execute instructions to perform the above-described methods.

The electronic device 900 may also include a power supply component 926 configured to perform power management of the electronic device 900, a wired or wireless network interface 950 configured to connect the electronic device 900 to a network, and an input output (I/O) interface 958 . The electronic device 900 can operate based on an operating system stored in the memory 932, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM or the like.

In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 932 including computer program instructions, which can be executed by the processing component 922 of the electronic device 900 to complete the foregoing method.

The present disclosure may be a system, method and/or computer program product. The computer program product may include a computer-readable storage medium loaded with computer-readable program instructions for enabling a processor to implement various aspects of the present disclosure.

The computer-readable storage medium may be a tangible device that can hold and store instructions used by the instruction execution device. The computer-readable storage medium may include, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing, for example. More specific examples (non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) Or flash memory), static random access memory (SRAM), portable compact disk read-only memory (CD-ROM), digital versatile disk (DVD), memory stick, floppy disk, mechanical encoding device, such as a printer with instructions stored thereon The protruding structure in the hole card or the groove, and any suitable combination of the above. The computer-readable storage medium used here is not interpreted as the instantaneous signal itself, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (for example, light pulses through fiber optic cables), or through wires Transmission of electrical signals.

The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to various computing/processing devices, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, optical fiber transmission, wireless transmission, routers, firewalls, switches, gateway computers, and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network, and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing/processing device .

The computer program instructions used to perform the operations of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or in one or more programming languages. Source code or object code written in any combination, the programming language includes object-oriented programming languages such as Smalltalk, C++, etc., and conventional procedural programming languages such as "C" language or similar programming languages. Computer-readable program instructions can be executed entirely on the user's computer, partly on the user's computer, executed as a stand-alone software package, partly on the user's computer and partly executed on a remote computer, or entirely on the remote computer or server carried out. In the case of a remote computer, the remote computer can be connected to the user's computer through any kind of network-including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to connect to the user's computer) connection). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), can be customized by using the status information of the computer-readable program instructions. The computer-readable program instructions are executed to realize various aspects of the present disclosure.

Here, various aspects of the present disclosure are described with reference to flowcharts and/or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each block of the flowcharts and/or block diagrams, and combinations of blocks in the flowcharts and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine that makes these instructions when executed by the processor of the computer or other programmable data processing device , A device that implements the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams is produced. It is also possible to store these computer-readable program instructions in a computer-readable storage medium. These instructions make computers, programmable data processing apparatuses, and/or other devices work in a specific manner. Thus, the computer-readable medium storing the instructions includes An article of manufacture, which includes instructions for implementing various aspects of the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

It is also possible to load computer-readable program instructions on a computer, other programmable data processing device, or other equipment, so that a series of operation steps are executed on the computer, other programmable data processing device, or other equipment to produce a computer-implemented process , So that the instructions executed on the computer, other programmable data processing apparatus, or other equipment realize the functions/actions specified in one or more blocks in the flowcharts and/or block diagrams.

The flowcharts and block diagrams in the accompanying drawings show the possible implementation architecture, functions, and operations of the system, method, and computer program product according to multiple embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, program segment, or part of an instruction, and the module, program segment, or part of an instruction contains one or more components for realizing the specified logical function. Executable instructions. In some alternative implementations, the functions marked in the block may also occur in a different order from the order marked in the drawings. For example, two consecutive blocks can actually be executed substantially in parallel, or they can sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart, can be implemented by a dedicated hardware-based system that performs the specified functions or actions Or it can be realized by a combination of dedicated hardware and computer instructions.

Without violating logic, different embodiments of the present application can be combined with each other, and the description of different embodiments is emphasized. For the part of the description, reference may be made to the records of other embodiments.

The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Without departing from the scope and spirit of the illustrated embodiments, many modifications and changes are obvious to those of ordinary skill in the art. The choice of terms used herein is intended to best explain the principles, practical applications, or technical improvements of the technologies in the market, or to enable those of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

An information processing method, including:

Performing face detection on the first video image in the played video stream to obtain face information of the first video image;

Sending the face information to the server;

Receiving target material sent by the server, where the target material is obtained based on the face information;

In response to detecting that the video stream is played to the start playing time corresponding to the target material, triggering the display of the target material.
The method according to claim 1, further comprising:

Receiving playback time information of the target material sent by the server, where the playback time information includes reference image information corresponding to a preset playback time period of the target material;

Based on the playing time information, it is detected whether the video stream is played to the start playing time corresponding to the target material.
The method according to claim 2, wherein the reference image information comprises: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material.
The method according to claim 3, wherein the multi-frame reference image is obtained by sampling multiple times on at least one time period adjacent to the preset playing time period.
The method according to any one of claims 2 to 4, wherein, based on the playing time information, detecting whether the video stream is played to the start playing time corresponding to the target material comprises:

Comparing the second video image to be played in the video stream with the reference image information to obtain a comparison result, wherein after the first video image is played, the second video image is played;

Based on the comparison result, it is determined whether the video stream is played to the start playing time corresponding to the target material.
The method according to claim 5, wherein, based on the comparison result, determining whether the video stream is played to the start playing time corresponding to the target material comprises:

In the case that the comparison result is a successful comparison with the first reference image in the multi-frame reference image, it is determined that the video stream is played to the start playing time corresponding to the target material, wherein the multi-frame The first M reference images in the reference images include the first reference image.
The method according to claim 5, further comprising:

In the case where the comparison result is a successful comparison with the second reference image in the multi-frame reference image, it is determined to end the playback of the target material, wherein the last N reference images in the multi-frame reference image The image includes the second reference image.
The method according to any one of claims 1 to 7, further comprising:

In response to detecting that the creative material that meets the preset blocking condition, the target material is displayed.
An information processing method, including:

Receiving face information of at least one first video image sent by the terminal device;

Determining the video stream information to which the at least one first video image belongs based on the face information and the face template library, where the face template library includes a plurality of preset face templates;

Obtain target material according to the video stream information;

Sending the target material to the terminal device.
The method according to claim 9, wherein, based on the face information and face template library, determining the video stream information to which the at least one first video image belongs comprises:

Based on a plurality of preset face templates included in the face template library, obtain person identity information corresponding to the face information;

Searching a video library based on the person identity information to obtain the video stream information to which the at least one first video image belongs.
The method according to claim 9 or 10, further comprising:

Sending the play time information corresponding to the target material to the terminal device, where the play time information includes reference image information corresponding to a preset play time period of the target material.
The method according to claim 11, wherein the reference image information comprises: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material.
The method according to claim 11 or 12, further comprising:

Sampling the video stream information in at least one adjacent time period of the preset playing time period to obtain a multi-frame reference image;

Perform feature extraction processing on the multi-frame reference image to obtain feature information of the multi-frame reference image.
The method according to any one of claims 9-13, further comprising:

An advertisement blocking instruction is sent to the terminal device, where the advertisement blocking instruction is used to indicate that the terminal device displays the target material when a specific advertisement material is detected in the video stream played by the terminal device.
An information processing device includes:

The first detection unit is configured to perform face detection on the first video image in the played video stream to obtain face information of the first video image;

The first sending unit is configured to send the face information to the server;

The first receiving unit is configured to receive target material sent by the server, where the target material is obtained based on the face information;

The first response unit is configured to trigger the display of the target material in response to detecting that the video stream is played to the start time corresponding to the target material.
The device according to claim 15, further comprising:

A second receiving unit, configured to receive playback time information of the target material sent by the server, where the playback time information includes reference image information corresponding to a preset playback time period of the target material;

The second detection unit is configured to detect whether the video stream is played to the start playing time corresponding to the target material based on the playing time information.
The device according to claim 16, wherein the reference image information comprises: feature information of multiple frames of reference images corresponding to the preset playing time period of the target material.
The apparatus according to claim 17, wherein the multi-frame reference image is obtained by sampling multiple times on at least one time period adjacent to the preset playback time period.
An information processing device includes:

The third receiving unit is configured to receive face information of at least one first video image sent by the terminal device;

An information determining unit, configured to determine the video stream information to which the at least one first video image belongs based on the face information and the face template library, wherein the face template library includes a plurality of preset face templates;

A material obtaining unit, configured to obtain target material according to the video stream information;

The second sending unit is configured to send the target material to the terminal device.
An electronic device including:

processor;

A memory for storing processor executable instructions;

Wherein, the processor is configured to execute the method according to any one of claims 1 to 8 and claims 9 to 14.
A computer-readable storage medium having computer program instructions stored thereon, and when the computer program instructions are executed by a processor, the method according to any one of claims 1 to 8 and claims 9 to 14 is realized.