[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN109309861A - A kind of media processing method, device, terminal device and storage medium - Google Patents

A kind of media processing method, device, terminal device and storage medium Download PDF

Info

Publication number
CN109309861A
CN109309861A CN201811280918.0A CN201811280918A CN109309861A CN 109309861 A CN109309861 A CN 109309861A CN 201811280918 A CN201811280918 A CN 201811280918A CN 109309861 A CN109309861 A CN 109309861A
Authority
CN
China
Prior art keywords
target
area information
media file
layer
target area
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811280918.0A
Other languages
Chinese (zh)
Inventor
陈理君
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangzhou Huya Technology Co Ltd
Original Assignee
Guangzhou Huya Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangzhou Huya Technology Co Ltd filed Critical Guangzhou Huya Technology Co Ltd
Priority to CN201811280918.0A priority Critical patent/CN109309861A/en
Publication of CN109309861A publication Critical patent/CN109309861A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the present application discloses a kind of media processing method, device, terminal device and storage medium, this method comprises: obtaining the target area information in media file;When playing the media file, shielding area is arranged in target figure layer according to the target area information, to hide the display elements being located in the shielding area in the target figure layer.The advantages of the embodiment of the present application, is to be not displayed for display elements of the media file in the specific figure layer when playing in specific region, and then the specific region of media file can be made not to be blocked, and can so optimize user's perception when media play.

Description

A kind of media processing method, device, terminal device and storage medium
Technical field
The invention relates to video processing technique more particularly to a kind of media processing method, device, terminal device and Storage medium.
Background technique
With the development of multimedia technology, the mode of media play is more and more, the interaction mode in media play It is more and more abundant, for example, when user's watching video live broadcast interactive information can be sent by barrage.A but if video The spectators of live streaming are more, and the barrage quantity of the net cast accordingly will be very more, in some instances it may even be possible to can block net cast Main contents influence the perception of user.
Summary of the invention
The embodiment of the present application provides a kind of media processing method, device, terminal device and storage medium, can optimize media User's perception when broadcasting.
In a first aspect, the embodiment of the present application provides a kind of media processing method, comprising:
Obtain the target area information in media file;
When playing the media file, shielding area is arranged in target figure layer according to the target area information, with Hide the display elements being located in the shielding area in the target figure layer.
Further, the target area information in acquisition media file includes:
The each frame for obtaining media file shows the corresponding target area information of picture, the target area information with it is each Frame shows that target object is corresponding in picture;
It is described that shielding area is arranged in target figure layer according to the target area information, comprising:
Corresponding shielding area is respectively set in target figure layer according to each frame target area information.
Further, the media file is live data streams, and the target object is personage.
It is further, described to be arranged before shielding area in target figure layer according to the target area information, further includes:
Each frame is shown that the target area information of picture and each frame show that the play time stamp of picture is corresponding;
It is described when playing the media file, be respectively set in target figure layer according to each frame target area information pair The shielding area answered, comprising:
When playing the media file, according to the determining corresponding target area information of current play time stamp, and according to Shielding area is arranged in target figure layer in the target area information.
Further, shielding area is arranged in target figure layer according to the target area information, comprising:
Determine that the broadcasting figure layer for showing media file, the target figure layer are located at the top for playing figure layer;
The target position information on media file is determined according to the target area information;
Mask is mapped out in target figure layer according to the target position information, and as shielding area.
Second aspect, the embodiment of the present application provide a kind of media processing method, comprising:
The display picture for obtaining media file determines target area information in the display picture;
The target area information is written in the media file, the target area information is used in target figure layer Shielding area is set, to hide the display elements being located in the shielding area in the target figure layer.
It is further, described that target area information is determined in the display picture, comprising:
It identifies that each frame shows the target object in picture, and determines that each frame shows picture pair according to the target object The target area information answered.
Further, described to determine that each frame shows the corresponding target area information of picture, packet according to the target object It includes:
The profile information of the target object is determined as each frame and shows the corresponding target area information of picture;
It is described that the target area information is written in the media file, comprising:
The target area information is stored in the corresponding custom field of each frame video image.
Further, the media file is live data streams, the display picture for obtaining media file, described aobvious Show and determine target area information in picture, comprising:
When acquiring live data streams, the personage in each frame video image is identified, and according to the area where the personage Domain determines corresponding target area information in each frame video image.
The third aspect, the embodiment of the present application also provides a kind of media processors, comprising:
Data obtaining module, for obtaining the target area information in media file;
Setup module is shielded, is used for when playing the media file, according to the target area information in target figure layer Upper setting shielding area, to hide the display elements being located in the shielding area in the target figure layer.
Fourth aspect, the embodiment of the present application also provides a kind of media processors, comprising:
Media collection module determines target area for obtaining the display picture of media file in the display picture Information;
Information writing module, for the target area information to be written in the media file, the target area letter Breath is for being arranged shielding area in target figure layer, to hide the display member being located in the shielding area in the target figure layer Element.
5th aspect the embodiment of the present application also provides a kind of media handling, including memory, processor and is stored in On reservoir and the computer program that can run on a processor, the processor realize that the application is arbitrarily real when executing described program Apply media processing method described in example.
6th aspect, the embodiment of the present application also provides a kind of computer readable storage mediums, are stored thereon with computer Program, the program realize media processing method described in the application any embodiment when being executed by processor.
The embodiment of the present application discloses a kind of media handling scheme, by obtaining the target area information in media file; When playing the media file, shielding area is arranged in target figure layer according to the target area information, it is described to hide The display elements being located in the shielding area in target figure layer.The embodiment of the present application can for media file play when Display elements in specific figure layer are not displayed in specific region, and then the specific region of media file can be made not to be blocked, User's perception when media play can so be optimized.
Detailed description of the invention
Fig. 1 is a kind of flow chart for media processing method that the embodiment of the present application one provides;
Fig. 2 is a kind of flow chart for media processing method that the embodiment of the present application two provides;
Fig. 3 is the flow chart for another media processing method that the embodiment of the present application two provides;
Fig. 4 is a kind of schematic diagram of a scenario for media processing method that the embodiment of the present application two provides;
Fig. 5 is a kind of flow chart for media processing method that the embodiment of the present application three provides;
Fig. 6 is a kind of flow chart for media processing method that the embodiment of the present application four provides;
Fig. 7 is a kind of structural schematic diagram for media processor that the embodiment of the present application five provides;
Fig. 8 is a kind of structural schematic diagram for media processor that the embodiment of the present application six provides;
Fig. 9 is a kind of hardware structural diagram for terminal device that the embodiment of the present application nine provides.
Specific embodiment
The application is described in further detail with reference to the accompanying drawings and examples.It is understood that this place is retouched The specific embodiment stated is used only for explaining the application, rather than the restriction to the application.It also should be noted that in order to just Part relevant to the application is illustrated only in description, attached drawing rather than entire infrastructure.
Embodiment one
Fig. 1 is the flow chart for the media processing method that the embodiment of the present application one provides, and this method can be filled by media handling It sets to execute, wherein the device can generally be can integrate on a hardware platform, be specifically included by software and or hardware realization Following steps:
Target area information in S101, acquisition media file.
The embodiment of the present application, which can be applied, is playing end, and playing end can be the terminal device including display screen.The matchmaker Body file is the file that can be played out by the display screen of terminal device, and illustratively, the media file includes video The multimedia file of file, audio file and extended formatting;Playback of media files terminal device can be smart phone, plate electricity Brain or other electronic equipments with corresponding operating system.
Media file can call the player plug-in in terminal device, the corresponding viewing area on the display screen of terminal device Domain is shown.If the media file is video file, it can show that it includes on the corresponding region of display screen Video stream;If the media file is audio file, media can also be shown on the corresponding region of display screen Interactive interface, media interactive interface may include the control button for controlling audio file and playing.In the display screen pair of terminal device The relevant information that media file can be not only shown on the display area answered, can also show interactive information;Illustratively, in matchmaker The display area of body file can show the interactive animation etc. for the comment and transmission that the spectators of viewing media file deliver.
Wherein, the target area information can be identified in the display picture of media file according to preset rules The location information of target area.Illustratively, the target area information can be the center in the display picture of media file Region, left area or right area.
S102, when playing the media file, blind zone is arranged in target figure layer according to the target area information Domain, to hide the display elements being located in the shielding area in the target figure layer.
Wherein, the media file play end play out when, play end can obtain the broadcast information of media file with And custom field relevant to broadcasting, broadcast information, that is, media file need the information for showing output and/or need audio defeated Information out, the producer of custom field, that is, media file relevant to the broadcasting letter attached when generating media file Breath, may include the auxiliary parameter for controlling the playing process of media file.Illustratively, customized word relevant to broadcasting Section may include being arranged or ratio setting, the color of the display interface of media file for adding display in the display interface Overlapped information etc..
Target area information is stored in custom field, play end when playing media file, can from broadcasting phase Target area information is obtained in the custom field of pass, and phase is carried out according to playing process of the target area information to media file It should control.
For the media file when the display area on broadcasting end plays out, media file itself is shown in a figure Layer, and may be provided for executing other figure layers of corresponding display function where media file above figure layer.Illustratively, A figure layer of the top of figure layer where media file is for showing that spectators watch the interactive information delivered after media file.Matchmaker The effect of the quantity, each figure layer of the figure layer of the top of figure layer can be determined according to specific actual implementation where body file, The target figure layer of the embodiment of the present application is the figure layer determined in the figure layer where media file above figure layer, can be and appoints It anticipates a figure layer, can also determine one of figure layer for being particularly shown function that executes as target figure layer according to demand.
Figure layer where target figure layer and media file is shown on the display area for playing end, so target figure Location of pixels where location of pixels and media file in layer in the figure layer phase mapping in the vertical direction of display area.Its In, it is target area in the display picture of media file that target area information is corresponding, so according to the mapping of two figure layers Relationship can map out corresponding location information according to target area information in target figure layer, and be determined as shielding area.
The display elements occurred in shielding area in target figure layer are hidden by shielding area, can be by that will show Show that element is set as transparent, or directly shield display elements, so that display elements are not displayed;The display elements It can be element corresponding with the display function of target figure layer.
Illustratively, if the comment information that the target figure layer is delivered by the spectators of display viewing media file, Comment information will be not displayed in shielding area, comment information can only be shown except shielding area.Shielding area with Target figure layer is corresponding, i.e., shielding area will not influence media file display picture display, other figure layers will not be influenced In display elements display.
The embodiment of the present application discloses a kind of media processing method, by obtaining the target area information in media file; When playing the media file, shielding area is arranged in target figure layer according to the target area information, it is described to hide The display elements being located in the shielding area in target figure layer.The embodiment of the present application can for media file play when Display elements in specific figure layer are not displayed in specific region, and then the specific region of media file can be made not to be blocked, User's perception when media play can so be optimized.
Embodiment two
Fig. 2 is the flow chart for the media processing method that the embodiment of the present application two provides, and this method can be filled by media handling It sets to execute, wherein the device can generally be can integrate on a hardware platform, by software and or hardware realization in above-mentioned reality On the basis of applying example, optionally, this method comprises the following steps:
S111, each frame for obtaining media file show the corresponding target area information of picture, the target area information Show that target object is corresponding in picture with each frame.
Wherein, the media file is display information files in stream media, i.e. media file includes the display picture that multiframe flows Face, and picture is shown for every frame, target area information can be different.Wherein, the target area information be with it is each Frame shows that the corresponding location information of target object in picture, target object are the main object in the display picture of media file Body.Illustratively, if media file is Pingong Matches video, the target object be can be with ping-pong table and sportsman Region, ping-pong table and the corresponding region of sportsman are determined as target area information, can to avoid in target figure layer right The display elements in region are answered to block the primary objects of media file.If media file is game live video, described Target object can be game charater, can be determined as the target area of media file by the region where identification game charater Domain information can also be swum by identifying the region where game charater to figure image in game picture by identification Role's title on personage in play picture determines the region where game charater.
Wherein, movement can has occurred in the target object in media file, and then becomes the display picture of media file Change, so determine that each frame shows the corresponding target area information of picture, so as to when playing media file, with display The prevalence of picture, target area information also accordingly change.
S112, when playing the media file, be respectively set in target figure layer according to each frame target area information Corresponding shielding area, to hide the display elements being located in the shielding area in the target figure layer.
The destination display area that picture is shown for each frame, is correspondingly respectively set corresponding shielding in target figure layer Region, i.e. target figure layer can be changed in the corresponding shielding area of each frame with the display picture of media file, can be with Be maintained at during playback of media files, keep target object will not the display elements in target figure layer covered.Shielding area Setting specific embodiment can refer to associated description above, details are not described herein.
Optionally, the media file in the embodiment of the present application is live data streams, and the target object is personage, the mesh Layer of marking on a map is the figure layer for showing barrage.
Wherein, the video flowing that live data streams are played out generally by live streaming platform, and live data streams are general Primary objects are to be the main broadcaster being broadcast live, i.e. personage in the display picture of live data streams.In live data streams as media text When part, the target object is personage, identifies the personage in live data streams and determines target area according to the region where personage Domain information.When playing, spectators can generally lead to be sent barrage information and interacts with main broadcaster live data streams, barrage information Text information and graphical information are generally comprised, spectators can be by inputting barrage information, and passes through the corresponding figure layer of barrage information It is shown, barrage information can generally show a period of time, usually from display area a position in display area Entrance is set, is disappeared after being moved to another position.When barrage information is more, may be filled out by barrage information in display area It is full, the picture of main broadcaster is covered, may influence whether the viewing experience of most of spectators.So the embodiment of the present application will be by that will show Show that the figure layer of barrage is determined as target figure layer, can be excessive to avoid barrage, and the picture of main broadcaster is blocked, it can optimize spectators' Viewing experience.
Optionally, described to be arranged before shielding area in target figure layer according to the target area information, further includes: will Each frame shows that the target area information of picture and each frame show that the play time stamp of picture is corresponding.It is described described in the broadcasting When media file, corresponding shielding area is respectively set in target figure layer according to each frame target area information can be under The mode of stating is implemented: when playing the media file, determining corresponding target area information, and root according to current play time stamp Shielding area is set in target figure layer according to the target area information.
Wherein, the current play time is the time of the currently viewing media file of spectators.Each frame is shown into picture Destination display area information and each frame show that the play time stamp of picture is corresponding, and each play time stamp and actual play When play time to correspond.User, can root when different play time stamps enters the broadcasting of media file Corresponding target area information is determined according to current play time, and corresponding shielding area is set.In this way, different user can be made The media file is played in different time points, or when the different time points of media file play out, is able to achieve and is avoided Target object in media file is blocked by the display elements of target figure layer.
Optionally, as shown in figure 3, the behaviour that shielding area is arranged in target figure layer according to the target area information Work can be implemented by following manner:
S1121, determine that broadcasting figure layer for showing media file, the target figure layer are located at the top for playing figure layer.
S1122, the target position information on media file is determined according to the target area information.
S1123, mask is mapped out in target figure layer according to the target position information, and as shielding area.
Wherein, the broadcasting figure layer for showing media file and target figure layer are in the display area for playing end The figure layer shown, target map overlay is in the top for playing figure layer.Target area information is corresponding to be shown in picture The position of target object, it is possible to the target position information in media file be determined according to target area information, the target position Confidence breath is the location information in the display area relative to broadcasting end, may include multiple figure layers, Ke Yigen in display area Corresponding region is mapped out in Subgraph layer according to the target position information.Mask is for by the display elements in specified region It is shielded, the function that the display elements in region except specified region are shown can be by setting mask as screen Region is covered, realization shields the display elements of target figure layer.The shape of the mask is corresponding with target area information, hides Cover can be the mask of vector bitmap-format.It is alternatively possible to mask be increased feather effect, so as to specify the side in region in mask Boundary occurs mitigating excessive effect, advanced optimizes the viewing experience of user.
Illustratively, it although as shown in figure 4, from the angle of human eye viewing display area, target figure layer and plays figure layer and is In a plane, but if the dismantling of the display elements of display area is opened, the face where with the display area for playing end On vertical angle, target figure layer 22 is located at the top for playing figure layer 20;It plays and is wrapped in the display picture of the media file in figure layer Personage region 21 is included, can determine that media file shows the target area information in picture according to personage region 21.Correspondingly, Corresponding shielding area 23 can be mapped out in target figure layer 22 according to target area information, as shown in figure 4, playing figure layer 20 In personage region 21 and target figure layer in shielding area 23 it is corresponding.Target figure layer 22 is if it is shown by barrage information Figure layer, present in figure in effect 25 it can be seen that, the barrage information in shielding area 23 is shielded, only in blind zone Region outside domain 23 can just see barrage information.
The embodiment of the present application shows the corresponding target area information of picture, the mesh by obtaining each frame of media file It marks area information and shows that target object is corresponding in picture with each frame, and when playing the media file, according to each Corresponding shielding area is respectively set in frame target area information in target figure layer, to hide in the target figure layer positioned at described Display elements in shielding area;When the target object in the display picture of media file can be made to occur mobile, blind zone Domain can correspond to movement, and then can advanced optimize media with the corresponding display elements of mobile shielding of target object and broadcast User's perception when putting.
Embodiment three
Fig. 5 is the flow chart for the media processing method that the embodiment of the present application three provides, and this method can be filled by media handling It sets to execute, wherein the device can generally be can integrate on a hardware platform, be specifically included by software and or hardware realization Following steps:
S121, the display picture for obtaining media file, determine target area information in the display picture.
The embodiment of the present application can be applicable to media and generate end, and media generate end and can be including acquisition module and/or generation The terminal device of module.The display picture of the media file is media file on the display area of the display screen of terminal device The picture of display, illustratively, if the media file is video file, the display picture includes video stream, such as Media file described in fruit is audio file, then shows that picture includes corresponding media interactive interface, media interactive interface can wrap Include the control button that control audio file plays.
Wherein, the target area information can be identified in the display picture of media file according to preset rules The location information of target area.Illustratively, the target area information can be the center in the display picture of media file Region, left area or right area.
S122, the target area information is written in the media file, the target area information is used in target Shielding area is set in figure layer, to hide the display elements being located in the shielding area in the target figure layer.
The media file is in addition to further including including needing to show the information exported and/or the information for needing audio output The producer of custom field relevant to broadcasting, custom field, that is, media file relevant to broadcasting is generating media text Attached information when part may include the auxiliary parameter for controlling the playing process of media file.
The target area information can be written in custom field relevant to broadcasting, play media to play end It is available to arrive target area information when file.
Target area information is for being arranged shielding area in target figure layer, to hide in the target figure layer positioned at described The specific embodiment of display elements in shielding area can be with the associated description in reference implementation example one, and details are not described herein.
The embodiment of the present application determines target area letter by the display picture of acquisition media file in the display picture Breath;The target area information is written in the media file, the target area information in target figure layer for being arranged Shielding area, to hide the display elements being located in the shielding area in the target figure layer;It can exist for media file Specific region when broadcasting is labeled and is written in media file, can be for media file when playing to play end Specific figure layer in display elements be not displayed in specific region, and then the specific region of media file can be made not hidden Gear, can so optimize user's perception when media play.
Example IV
Fig. 6 is the flow chart for the media processing method that the embodiment of the present application four provides, and this method can be filled by media handling It sets to execute, wherein the device can generally be can integrate on a hardware platform, by software and or hardware realization in above-mentioned reality On the basis of applying example, optionally, this method comprises the following steps:
S131, the display picture for obtaining media file identify that each frame shows the target object in picture, and according to described Target object determines that each frame shows the corresponding target area information of picture.
Wherein, the media file is display information files in stream media, i.e. media file includes the display picture that multiframe flows Face, and picture is shown for every frame, target area information can be different.Wherein, the target area information be with it is each Frame shows that the corresponding location information of target object in picture, target object are the main object in the display picture of media file Body.
It can be identified by the display picture to each frame, identify that each frame shows the target object in picture, And then it can determine that each frame shows the corresponding target area information of picture according to the target object of each frame.
S132, the target area information is written in the media file, the target area information is used in target Shielding area is set in figure layer, to hide the display elements being located in the shielding area in the target figure layer.
Specific embodiment can refer to associated description above, and details are not described herein.
Optionally, described to determine that each frame shows the operation of the corresponding target area information of picture according to the target object Following manner can be passed through: the profile information of the target object being determined as each frame and shows that the corresponding target area of picture is believed Breath;Correspondingly, the operation that the target area information is written in the media file can be implemented by following manner: The target area information is stored in the corresponding custom field of each frame video image.
Wherein, the corresponding position in target area can be determined according to the profile information of target object, by target object Profile information is determined as target area information, without all regarding the location information of entire target area as target area, is broadcasting When putting end broadcasting media file, corresponding target area information can be mapped out according to less data amount.
The custom field is attached when generating media file to relevant, media file the producer of broadcasting Information, may include the auxiliary parameter for controlling the playing process of media file.Correspondingly, can using profile information as Target area information is deposited into the corresponding custom field of each frame video image, and then broadcasting end can be made to get media It, can be by obtaining the target area information in custom field, to generate corresponding shielding area when file.
Optionally, the custom field is supplemental enhancement information (SEI, Supplemental Enhancement Information), supplemental enhancement information belongs to code stream scope, it is provided, and additional customized letter is added into video code flow Breath, usually as employed in the H.264 video file of video compression protocols.
Optionally, the media file is live data streams, correspondingly, the display picture for obtaining media file, Determine that the operation of target area information can be implemented by following manner in the display picture:
When acquiring live data streams, the personage in each frame video image is identified, and according to the area where the personage Domain determines corresponding target area information in each frame video image.
Wherein, the video flowing that live data streams are played out generally by live streaming platform, and live data streams are general Primary objects are to be the main broadcaster being broadcast live, i.e. personage in the display picture of live data streams, so being directed to live data streams conduct Media file, the target object are personage, identify the personage in live data streams and determine mesh according to the region where personage Mark area information.
Correspondingly the figure layer where barrage can be determined as target figure layer;For live data streams when playing, spectators are general It can lead to and send barrage information to interact with main broadcaster, barrage information generally comprises text information and graphical information, Guan Zhongke To pass through input barrage information, and shown that barrage information generally can be in display area by the corresponding figure layer of barrage information Middle display a period of time, usually from display area a position enter, disappear after being moved to another position.In bullet When curtain information is more, it may be filled up by barrage information in display area, cover the picture of main broadcaster, may influenced whether big The viewing experience of part spectators.So the embodiment of the present application, which passes through, is determined as target figure layer for the figure layer for showing barrage, can keep away Exempt from that barrage is excessive, and block the picture of main broadcaster, the viewing experience of spectators can be optimized.
The embodiment of the present application identifies that each frame shows the object in picture by the display picture of acquisition media file Body, and determine that each frame shows the corresponding target area information of picture according to the target object;By the target area information It is written in the media file, the target area information is for being arranged shielding area in target figure layer, to hide the mesh It marks on a map the display elements being located on layer in the shielding area;It may be implemented to move in the display picture in media file to mesh Mark object is identified, and the corresponding target area information for determining each frame and showing picture, can make to play end when playing with The corresponding display elements of mobile shielding of target object, so that the specific region of media file is not blocked, advanced optimize matchmaker User's perception when body plays.
Embodiment five
Fig. 7 is the structural schematic diagram of media processor that the embodiment of the present application five provides, the device can by software and/ Or hardware realization, it generally can integrate on a hardware platform.As shown in fig. 7, the media processor includes:
Data obtaining module 201, for obtaining the target area information in media file;
Setup module 202 is shielded, is used for when playing the media file, according to the target area information in target figure Shielding area is set on layer, to hide the display elements being located in the shielding area in the target figure layer.
Optionally, data obtaining module is specifically used for:
The each frame for obtaining media file shows the corresponding target area information of picture, the target area information with it is each Frame shows that target object is corresponding in picture;
Shielding setup module is specifically used for:
Corresponding shielding area is respectively set in target figure layer according to each frame target area information.
Optionally, the media file be live data streams, the target object be personage, the target figure layer be for Show the figure layer of barrage.
Optionally, further includes:
Time respective modules, for it is described be arranged in target figure layer according to the target area information shielding area it Before, each frame is shown that the target area information of picture and each frame show that the play time stamp of picture is corresponding;
Shielding setup module is specifically used for: when playing the media file, being stabbed according to current play time and determines correspondence Target area information, and shielding area is arranged in target figure layer according to the target area information.
Optionally, shielding setup module is specifically used for:
Determine that the broadcasting figure layer for showing media file, the target figure layer are located at the top for playing figure layer;
The target position information on media file is determined according to the target area information;
Mask is mapped out in target figure layer according to the target position information, and as shielding area.
Embodiment six
Fig. 8 is the structural schematic diagram of media processor that the embodiment of the present application six provides, the device can by software and/ Or hardware realization, it generally can integrate on a hardware platform.As shown in figure 8, the media processor includes:
Media collection module 211 determines target area for obtaining the display picture of media file in the display picture Domain information;
Information writing module 212, for the target area information to be written in the media file, the target area Information is for being arranged shielding area in target figure layer, to hide the display being located in the shielding area in the target figure layer Element.
Optionally, media collection module is specifically used for:
It identifies that each frame shows the target object in picture, and determines that each frame shows picture pair according to the target object The target area information answered.
Optionally, media collection module is specifically used for:
The profile information of the target object is determined as each frame and shows the corresponding target area information of picture;
Information writing module is specifically used for:
The target area information is stored in the corresponding custom field of each frame video image.
Optionally, the media file is live data streams, and media collection module is specifically used for:
When acquiring live data streams, the personage in each frame video image is identified, and according to the area where the personage Domain determines corresponding target area information in each frame video image.
Embodiment seven
The embodiment of the present application also provides a kind of storage medium comprising computer executable instructions, and the computer is executable Instruction is used to execute media processing method when being executed by computer processor, this method comprises:
Obtain the target area information in media file;
When playing the media file, shielding area is arranged in target figure layer according to the target area information, with Hide the display elements being located in the shielding area in the target figure layer.
Optionally, which can be also used for executing the application times when being executed by computer processor Media processing method provided by embodiment of anticipating.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the application It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more Good embodiment.Based on this understanding, the technical solution of the application substantially in other words contributes to the prior art Part can be embodied in the form of software products, which can store in computer readable storage medium In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the application.
Embodiment eight
The embodiment of the present application also provides a kind of storage medium comprising computer executable instructions, and the computer is executable Instruction is used to execute media processing method when being executed by computer processor, this method comprises:
The display picture for obtaining media file determines target area information in the display picture;
The target area information is written in the media file, the target area information is used in target figure layer Shielding area is set, to hide the display elements being located in the shielding area in the target figure layer.
Optionally, which can be also used for executing the application times when being executed by computer processor Media processing method provided by embodiment of anticipating.
By the description above with respect to embodiment, it is apparent to those skilled in the art that, the application It can be realized by software and required common hardware, naturally it is also possible to which by hardware realization, but in many cases, the former is more Good embodiment.Based on this understanding, the technical solution of the application substantially in other words contributes to the prior art Part can be embodied in the form of software products, which can store in computer readable storage medium In, floppy disk, read-only memory (Read-Only Memory, ROM), random access memory (Random such as computer Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions are with so that a computer is set Standby (can be personal computer, server or the network equipment etc.) executes method described in each embodiment of the application.
Embodiment nine
As shown in figure 9, a kind of hardware structural diagram of the terminal device provided for the embodiment of the present application five, such as Fig. 9 institute Show, which includes:
One or more processors 410, in Fig. 9 by taking a processor 410 as an example;
Memory 420;
The terminal device can also include: input unit 430 and output device 440.
Processor 410, memory 420, input unit 430 and output device 440 in the terminal device can pass through Bus or other modes connect, in Fig. 9 for being connected by bus.
Memory 420 be used as a kind of non-transient computer readable storage medium, can be used for storing software program, computer can Program and module are executed, such as the corresponding program instruction of one of the application any embodiment media processing method/module (example Such as, attached data obtaining module shown in Fig. 7 201 and shielding setup module 202 or attached 210 He of media collection module shown in Fig. 8 Information writing module 211).Software program, instruction and the module that processor 410 is stored in memory 420 by operation, from And execute the various function application and data processing of terminal device, that is, realize a kind of media handling side of above method embodiment Method.
Memory 420 may include storing program area and storage data area, wherein storing program area can store operation system Application program required for system, at least one function;Storage data area, which can be stored, uses created number according to terminal device According to etc..In addition, memory 420 may include high-speed random access memory, it can also include non-transitory memory, such as extremely A few disk memory, flush memory device or other non-transitory solid-state memories.In some embodiments, memory 420 it is optional include the memory remotely located relative to processor 410, these remote memories can pass through network connection to end End equipment.The example of above-mentioned network includes but is not limited to internet, intranet, local area network, mobile radio communication and combinations thereof.
Input unit 430 can be used for receiving the number or character information of input, and generates and set with the user of terminal device It sets and the related key signals of function control inputs.Output device 440 may include that display screen etc. shows equipment.
Note that above are only the preferred embodiment and institute's application technology principle of the application.It will be appreciated by those skilled in the art that The application is not limited to specific embodiment described here, be able to carry out for a person skilled in the art it is various it is apparent variation, The protection scope readjusted and substituted without departing from the application.Therefore, although being carried out by above embodiments to the application It is described in further detail, but the application is not limited only to above embodiments, in the case where not departing from the application design, also It may include more other equivalent embodiments, and scope of the present application is determined by the scope of the appended claims.

Claims (13)

1. a kind of media processing method characterized by comprising
Obtain the target area information in media file;
When playing the media file, shielding area is arranged in target figure layer according to the target area information, to hide The display elements being located in the shielding area in the target figure layer.
2. according to right want 1 described in method, which is characterized in that obtain media file in target area information include:
The each frame for obtaining media file shows the corresponding target area information of picture, and the target area information and each frame are aobvious Show that target object is corresponding in picture;
It is described that shielding area is arranged in target figure layer according to the target area information, comprising:
Corresponding shielding area is respectively set in target figure layer according to each frame target area information.
3. according to right want 2 described in method, which is characterized in that the media file be live data streams, the target object For personage, the target figure layer is the figure layer for showing barrage.
4. according to right want 2 described in method, which is characterized in that it is described to be set in target figure layer according to the target area information Before setting shielding area, further includes:
Each frame is shown that the target area information of picture and each frame show that the play time stamp of picture is corresponding;
It is described when playing the media file, be respectively set in target figure layer according to each frame target area information corresponding Shielding area, comprising:
When playing the media file, corresponding target area information is determined according to current play time stamp, and according to described Shielding area is arranged in target figure layer in target area information.
5. according to right want 1 to 4 described in method, which is characterized in that set in target figure layer according to the target area information Set shielding area, comprising:
Determine that the broadcasting figure layer for showing media file, the target figure layer are located at the top for playing figure layer;
The target position information on media file is determined according to the target area information;
Mask is mapped out in target figure layer according to the target position information, and as shielding area.
6. a kind of media processing method characterized by comprising
The display picture for obtaining media file determines target area information in the display picture;
The target area information is written in the media file, the target area information in target figure layer for being arranged Shielding area, to hide the display elements being located in the shielding area in the target figure layer.
7. according to the method described in claim 6, it is characterized in that, described determine target area letter in the display picture Breath, comprising:
It identifies that each frame shows the target object in picture, and determines that each frame shows that picture is corresponding according to the target object Target area information.
8. method according to claim 7, which is characterized in that described to determine that each frame shows picture according to the target object Corresponding target area information, comprising:
The profile information of the target object is determined as each frame and shows the corresponding target area information of picture;
It is described that the target area information is written in the media file, comprising:
The target area information is stored in the corresponding custom field of each frame video image.
9. the method according to the description of claim 7 is characterized in that the media file is live data streams, the acquisition matchmaker The display picture of body file determines target area information in the display picture, comprising:
When acquiring live data streams, the personage in each frame video image is identified, and true according to the region where the personage Corresponding target area information in fixed each frame video image.
10. a kind of media processor characterized by comprising
Data obtaining module, for obtaining the target area information in media file;
Setup module is shielded, for being set in target figure layer according to the target area information when playing the media file Shielding area is set, to hide the display elements being located in the shielding area in the target figure layer.
11. a kind of media processor characterized by comprising
Media collection module determines target area information for obtaining the display picture of media file in the display picture;
Information writing module, for the target area information to be written in the media file, the target area information is used In shielding area is arranged in target figure layer, to hide the display elements being located in the shielding area in the target figure layer.
12. a kind of terminal device including memory, processor and stores the calculating that can be run on a memory and on a processor Machine program, which is characterized in that the processor realizes such as claim 1-9 method when executing described program.
13. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is by processor Such as claim 1-9 method is realized when execution.
CN201811280918.0A 2018-10-30 2018-10-30 A kind of media processing method, device, terminal device and storage medium Pending CN109309861A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811280918.0A CN109309861A (en) 2018-10-30 2018-10-30 A kind of media processing method, device, terminal device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811280918.0A CN109309861A (en) 2018-10-30 2018-10-30 A kind of media processing method, device, terminal device and storage medium

Publications (1)

Publication Number Publication Date
CN109309861A true CN109309861A (en) 2019-02-05

Family

ID=65222738

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811280918.0A Pending CN109309861A (en) 2018-10-30 2018-10-30 A kind of media processing method, device, terminal device and storage medium

Country Status (1)

Country Link
CN (1) CN109309861A (en)

Cited By (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109618213A (en) * 2018-12-17 2019-04-12 华中科技大学 A method of preventing barrage shelter target object
CN110072141A (en) * 2019-04-28 2019-07-30 广州虎牙信息科技有限公司 A kind of media processing method, device, equipment and storage medium
CN111193928A (en) * 2019-10-28 2020-05-22 腾讯科技(深圳)有限公司 Method and apparatus for communicating region of interest information in video
CN111526380A (en) * 2020-03-20 2020-08-11 北京达佳互联信息技术有限公司 Video processing method, video processing device, server, electronic equipment and storage medium
CN111641870A (en) * 2020-06-05 2020-09-08 北京爱奇艺科技有限公司 Video playing method and device, electronic equipment and computer storage medium
CN111935508A (en) * 2020-08-13 2020-11-13 百度时代网络技术(北京)有限公司 Information processing and acquiring method and device, electronic equipment and storage medium
CN112037127A (en) * 2020-07-27 2020-12-04 浙江大华技术股份有限公司 Privacy shielding method and device for video monitoring, storage medium and electronic device
CN112312190A (en) * 2020-10-10 2021-02-02 游艺星际(北京)科技有限公司 Video picture display method and device, electronic equipment and storage medium
CN112423110A (en) * 2020-08-04 2021-02-26 上海哔哩哔哩科技有限公司 Live video data generation method and device and live video playing method and device
CN112449167A (en) * 2020-11-13 2021-03-05 深圳市火乐科技发展有限公司 Image sawtooth elimination and image display method and device
CN112988101A (en) * 2021-04-20 2021-06-18 西安诺瓦星云科技股份有限公司 Image processing method and device, nonvolatile storage medium and processor
CN113891154A (en) * 2020-07-02 2022-01-04 武汉斗鱼鱼乐网络科技有限公司 Method, device, medium and computer equipment for preventing bullet screen from shielding specific target
CN114339367A (en) * 2021-12-29 2022-04-12 杭州海康威视数字技术股份有限公司 Video frame processing method, device and equipment
CN114430495A (en) * 2022-01-12 2022-05-03 广州繁星互娱信息科技有限公司 Object display method and device, storage medium and electronic equipment
WO2023045867A1 (en) * 2021-09-27 2023-03-30 北京有竹居网络技术有限公司 Video-based information display method and apparatus, electronic device, and storage medium
CN118363700A (en) * 2024-04-22 2024-07-19 书行科技(北京)有限公司 Media resource display method, device, equipment, medium and product

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105847940A (en) * 2016-05-24 2016-08-10 武汉斗鱼网络科技有限公司 Bullet screen display control method and apparatus
CN105930543A (en) * 2016-06-28 2016-09-07 武汉斗鱼网络科技有限公司 Control method and device based on webpage bullet screen level
CN106060674A (en) * 2016-06-27 2016-10-26 武汉斗鱼网络科技有限公司 System and method for achieving intelligent video live broadcast on front end
CN106303731A (en) * 2016-08-01 2017-01-04 北京奇虎科技有限公司 The display packing of barrage and device
CN106792100A (en) * 2016-12-30 2017-05-31 北京奇艺世纪科技有限公司 A kind of video barrage display methods and device
CN107147941A (en) * 2017-05-27 2017-09-08 努比亚技术有限公司 Barrage display methods, device and the computer-readable recording medium of video playback
CN107809658A (en) * 2017-10-18 2018-03-16 维沃移动通信有限公司 A kind of barrage content display method and terminal
CN108124185A (en) * 2016-11-28 2018-06-05 广州华多网络科技有限公司 A kind of barrage display methods, device and terminal
US20180191987A1 (en) * 2017-01-04 2018-07-05 International Business Machines Corporation Barrage message processing
CN108401177A (en) * 2018-02-27 2018-08-14 上海哔哩哔哩科技有限公司 Video broadcasting method, server and audio/video player system

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105847940A (en) * 2016-05-24 2016-08-10 武汉斗鱼网络科技有限公司 Bullet screen display control method and apparatus
CN106060674A (en) * 2016-06-27 2016-10-26 武汉斗鱼网络科技有限公司 System and method for achieving intelligent video live broadcast on front end
CN105930543A (en) * 2016-06-28 2016-09-07 武汉斗鱼网络科技有限公司 Control method and device based on webpage bullet screen level
CN106303731A (en) * 2016-08-01 2017-01-04 北京奇虎科技有限公司 The display packing of barrage and device
CN108124185A (en) * 2016-11-28 2018-06-05 广州华多网络科技有限公司 A kind of barrage display methods, device and terminal
CN106792100A (en) * 2016-12-30 2017-05-31 北京奇艺世纪科技有限公司 A kind of video barrage display methods and device
US20180191987A1 (en) * 2017-01-04 2018-07-05 International Business Machines Corporation Barrage message processing
CN107147941A (en) * 2017-05-27 2017-09-08 努比亚技术有限公司 Barrage display methods, device and the computer-readable recording medium of video playback
CN107809658A (en) * 2017-10-18 2018-03-16 维沃移动通信有限公司 A kind of barrage content display method and terminal
CN108401177A (en) * 2018-02-27 2018-08-14 上海哔哩哔哩科技有限公司 Video broadcasting method, server and audio/video player system

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109618213A (en) * 2018-12-17 2019-04-12 华中科技大学 A method of preventing barrage shelter target object
CN110072141A (en) * 2019-04-28 2019-07-30 广州虎牙信息科技有限公司 A kind of media processing method, device, equipment and storage medium
CN110072141B (en) * 2019-04-28 2022-02-25 广州虎牙信息科技有限公司 Media processing method, device, equipment and storage medium
CN111193928A (en) * 2019-10-28 2020-05-22 腾讯科技(深圳)有限公司 Method and apparatus for communicating region of interest information in video
CN111193928B (en) * 2019-10-28 2023-08-11 腾讯科技(深圳)有限公司 Method and apparatus for delivering region of interest information in video
CN111526380A (en) * 2020-03-20 2020-08-11 北京达佳互联信息技术有限公司 Video processing method, video processing device, server, electronic equipment and storage medium
CN111641870A (en) * 2020-06-05 2020-09-08 北京爱奇艺科技有限公司 Video playing method and device, electronic equipment and computer storage medium
CN111641870B (en) * 2020-06-05 2022-04-22 北京爱奇艺科技有限公司 Video playing method and device, electronic equipment and computer storage medium
CN113891154A (en) * 2020-07-02 2022-01-04 武汉斗鱼鱼乐网络科技有限公司 Method, device, medium and computer equipment for preventing bullet screen from shielding specific target
CN113891154B (en) * 2020-07-02 2023-09-26 武汉斗鱼鱼乐网络科技有限公司 Method, device, medium and computer equipment for preventing bullet screen from shielding specific target
CN112037127A (en) * 2020-07-27 2020-12-04 浙江大华技术股份有限公司 Privacy shielding method and device for video monitoring, storage medium and electronic device
CN112423110A (en) * 2020-08-04 2021-02-26 上海哔哩哔哩科技有限公司 Live video data generation method and device and live video playing method and device
US11863801B2 (en) 2020-08-04 2024-01-02 Shanghai Bilibili Technology Co., Ltd. Method and device for generating live streaming video data and method and device for playing live streaming video
CN111935508A (en) * 2020-08-13 2020-11-13 百度时代网络技术(北京)有限公司 Information processing and acquiring method and device, electronic equipment and storage medium
CN112312190A (en) * 2020-10-10 2021-02-02 游艺星际(北京)科技有限公司 Video picture display method and device, electronic equipment and storage medium
WO2022073389A1 (en) * 2020-10-10 2022-04-14 游艺星际(北京)科技有限公司 Video picture display method and electronic device
CN112449167A (en) * 2020-11-13 2021-03-05 深圳市火乐科技发展有限公司 Image sawtooth elimination and image display method and device
CN112988101B (en) * 2021-04-20 2023-07-21 西安诺瓦星云科技股份有限公司 Image processing method and device, nonvolatile storage medium and processor
CN112988101A (en) * 2021-04-20 2021-06-18 西安诺瓦星云科技股份有限公司 Image processing method and device, nonvolatile storage medium and processor
WO2023045867A1 (en) * 2021-09-27 2023-03-30 北京有竹居网络技术有限公司 Video-based information display method and apparatus, electronic device, and storage medium
CN114339367B (en) * 2021-12-29 2023-06-27 杭州海康威视数字技术股份有限公司 Video frame processing method, device and equipment
CN114339367A (en) * 2021-12-29 2022-04-12 杭州海康威视数字技术股份有限公司 Video frame processing method, device and equipment
CN114430495A (en) * 2022-01-12 2022-05-03 广州繁星互娱信息科技有限公司 Object display method and device, storage medium and electronic equipment
CN118363700A (en) * 2024-04-22 2024-07-19 书行科技(北京)有限公司 Media resource display method, device, equipment, medium and product

Similar Documents

Publication Publication Date Title
CN109309861A (en) A kind of media processing method, device, terminal device and storage medium
US11918908B2 (en) Overlaying content within live streaming video
CN108200446B (en) On-line multimedia interaction system and method of virtual image
CN103561293B (en) System and method for strengthening video
CN102905170B (en) Screen popping method and system for video
US9965900B2 (en) Personalized video-based augmented reality
US20170201808A1 (en) System and method of broadcast ar layer
US20170157512A1 (en) Methods and systems for computer video game streaming, highlight, and replay
CN108401192A (en) Video stream processing method, device, computer equipment and storage medium
CN110418155A (en) Living broadcast interactive method, apparatus, computer readable storage medium and computer equipment
US20100050082A1 (en) Interactive Video Insertions, And Applications Thereof
US10049496B2 (en) Multiple perspective video system and method
CN104504447A (en) Method and device for distributing virtual seat images
CN108347640A (en) Information processing method based on video and device
KR101915786B1 (en) Service System and Method for Connect to Inserting Broadcasting Program Using an Avata
CN105847995A (en) Method for video position jumping via bullet screen anchor points
JP2020526125A (en) Method and system for fusing user-specific content into video production
WO2020072648A1 (en) User interface elements for content selection in 360 video narrative presentations
KR101915792B1 (en) System and Method for Inserting an Advertisement Using Face Recognition
CN109413352B (en) Video data processing method, device, equipment and storage medium
KR102374665B1 (en) Method and system for generating broadcast video for personal broadcasting
CN106060518B (en) Possesses the realization method and system of 720 degree of panorama players of view angle switch function
US20230326161A1 (en) Data processing method and apparatus, electronic device, computer-readable storage medium, and computer program product
KR101221540B1 (en) Interactive media mapping system and method thereof
CN113938752A (en) Processing method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190205