CN108632644B - Preview display method and device - Google Patents
Preview display method and device Download PDFInfo
- Publication number
- CN108632644B CN108632644B CN201710170348.9A CN201710170348A CN108632644B CN 108632644 B CN108632644 B CN 108632644B CN 201710170348 A CN201710170348 A CN 201710170348A CN 108632644 B CN108632644 B CN 108632644B
- Authority
- CN
- China
- Prior art keywords
- preview image
- client
- information
- progress bar
- server
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
- H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/643—Communication protocols
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8355—Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed
- H04N21/83555—Generation of protective data, e.g. certificates involving usage data, e.g. number of copies or viewings allowed using a structured language for describing usage rules of the content, e.g. REL
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/845—Structuring of content, e.g. decomposing content into time segments
- H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/85—Assembly of content; Generation of multimedia applications
- H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
- H04N21/8586—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
Abstract
本发明实施例提供了一种预览图的展示方法,包括客户端从服务器获取视频节目的索引文件,所述索引文件包含预览图的描述信息;所述客户端根据所述预览图描述信息获取预览图;所述客户端根据用户操作指令展示所述预览图。该方法将预览图的描述信息包含在视频节目的索引文件中,使得客户端在根据该索引文件进行视频播放时,即可直接根据该索引文件获取预览图。将预览图的实现与播放协议结合起来,保证了用户体验的一致性,也可以减轻视频业务提供商单独开发预览图实现协议的复杂度,能够实现视频业务的快速上线。
An embodiment of the present invention provides a method for displaying a preview image, including the client acquiring an index file of a video program from a server, where the index file contains description information of the preview image; and the client acquiring the preview image according to the description information of the preview image Figure; the client displays the preview image according to the user operation instruction. The method includes the description information of the preview image in the index file of the video program, so that the client can directly obtain the preview image according to the index file when playing the video according to the index file. Combining the realization of the preview image with the playback protocol ensures the consistency of the user experience, and can also reduce the complexity of developing the preview image realization protocol independently by the video service provider, and can realize the rapid online service of the video service.
Description
技术领域technical field
本发明涉及视频领域,尤其涉及一种预览图的展示方法以及设备。The present invention relates to the field of video, and in particular, to a method and device for displaying preview images.
背景技术Background technique
随着互联网的发展,视频资源越来越丰富,在视频播放中,通过拖动播放进度条来拖动视频进度是一种比较常见的用户体验。在视频进度拖动的过程中,目前很多视频服务厂商都提供了预览图效果,能准实的看到对应的播放进度条位置上的视频的预览图(videopreview),帮助用户快速定位到想看的内容。With the development of the Internet, video resources are becoming more and more abundant. In video playback, it is a common user experience to drag the video progress by dragging the playback progress bar. In the process of dragging the video progress, many video service manufacturers currently provide a preview image effect, which can accurately see the preview image of the video at the corresponding playback progress bar position (videopreview), helping users quickly locate what they want to watch. Content.
但是目前各视频服务厂商提供的预览图实现协议和视频播放协议是相互独立的,另外,各视频服务厂商提供的预览图信息不统一,各家实现差异大,不利于用户体验的一致性。However, at present, the preview image implementation protocol and video playback protocol provided by each video service provider are independent of each other. In addition, the preview image information provided by each video service provider is not uniform, and the implementations vary greatly, which is not conducive to the consistency of user experience.
发明内容SUMMARY OF THE INVENTION
有鉴于此,实有必要提供一种与播放协议结合的预览图实现方法,保证用户体验的一致性。In view of this, it is necessary to provide a preview image implementation method combined with the playback protocol to ensure the consistency of user experience.
第一方面,提供一种预览图的展示方法,包括:In a first aspect, a method for displaying a preview image is provided, including:
客户端从服务器获取视频节目的索引文件,所述索引文件包含预览图的描述信息,所述索引文件为DASH协议中的媒体展示描述MPD文件;The client obtains the index file of the video program from the server, the index file includes the description information of the preview image, and the index file is the media presentation description MPD file in the DASH protocol;
所述客户端根据所述预览图描述信息从所述服务器获取预览图;The client obtains the preview image from the server according to the preview image description information;
所述客户端根据用户操作指令展示所述预览图,比如用户拖动播放进度条时,展示对应位置的预览图。该方法将预览图的描述信息包含在视频节目的索引文件中,使得客户端在根据该索引文件进行视频播放时,即可直接根据该索引文件获取预览图。将预览图的实现与播放协议结合起来,保证了用户体验的一致性,也可以减轻视频业务提供商另外再单独开发预览图实现协议的复杂度,能够实现视频业务的快速上线。The client terminal displays the preview image according to the user operation instruction, for example, when the user drags the playback progress bar, displays the preview image at the corresponding position. The method includes the description information of the preview image in the index file of the video program, so that the client can directly obtain the preview image according to the index file when playing the video according to the index file. Combining the implementation of the preview image with the playback protocol ensures the consistency of user experience, and can also reduce the complexity of separately developing the preview image implementation protocol for the video service provider, enabling rapid online video services.
可选的,所述预览图描述信息包括:Optionally, the preview image description information includes:
预览图的地址信息和预览图对应的时间信息,地址信息可以是预览图存储的位置信息,预览图对应的时间信息可以包括该视频首个预览图的对应时间以及预览图之间的时间间隔。这样,客户端在展示预览图时,可根据预览图的时间信息与播放进度条的位置确定具体需要展示的是哪个预览图,从而获取对应的预览图进行展示,保证展示的预览图与视频的一致性。The address information of the preview image and the time information corresponding to the preview image, the address information may be the location information stored in the preview image, and the time information corresponding to the preview image may include the corresponding time of the first preview image of the video and the time interval between the preview images. In this way, when the client displays the preview image, it can determine which preview image needs to be displayed according to the time information of the preview image and the position of the playback progress bar, so as to obtain the corresponding preview image for display, and ensure that the displayed preview image and the video are consistent with each other. consistency.
可选的,客户端可以根据所述预览图的地址信息提前从服务器下载预览图存储到本地,在用户拖动播放进度条时,从本地获取对应时间的预览图,这样使得预览图展示的速度更快,实时性更强。Optionally, the client can download the preview image from the server in advance and store it locally according to the address information of the preview image. When the user drags the playback progress bar, the client can obtain the preview image at the corresponding time locally, so that the speed of displaying the preview image can be increased. Faster and more real-time.
可选的,客户端也在用户拖动播放进度条时,根据所述播放进度条的位置以及所述预览图对应的时间信息,确定对应的预览图的地址信息,根据所述确定的预览图的地址信息从服务器下载预览图。该可选方式可以减轻客户端的存储压力,节省存储空间。Optionally, when the user drags the playback progress bar, the client determines the address information of the corresponding preview image according to the position of the playback progress bar and the time information corresponding to the preview image, and determines the address information of the corresponding preview image according to the determined preview image. The address information downloads the preview image from the server. This optional method can reduce the storage pressure of the client and save storage space.
第二方面,提供一种预览图的展示方法,应用在服务器端,包括:In the second aspect, a method for displaying preview images is provided, which is applied on the server side, including:
服务器向客户端发送视频节目的索引文件,所述索引文件为DASH协议的媒体展示描述MPD文件,所述索引文件包含预览图的描述信息;The server sends the index file of the video program to the client, the index file is a media presentation description MPD file of the DASH protocol, and the index file includes the description information of the preview image;
接收客户端预览图下载请求;Receive client preview image download request;
响应所述客户端的下载请求,将所述预览图发送给所述客户端。In response to the download request of the client, the preview image is sent to the client.
可选的,所述预览图描述信息包括:Optionally, the preview image description information includes:
预览图的地址信息和预览图对应的时间信息。The address information of the preview image and the time information corresponding to the preview image.
可选的,所述方法还包括:Optionally, the method further includes:
服务器根据预览图生成规则生成预览图和预览图描述信息。The server generates a preview image and preview image description information according to the preview image generation rule.
可选的,所述预览图生成规则包括:Optionally, the preview image generation rules include:
预览图间隔时间信息和预览图分辨率信息。Preview image interval time information and preview image resolution information.
可选的,服务器可根据预览图的间隔时间信息和分辨率信息直接从视频文件中截取视频帧的方式生成预览图。Optionally, the server may generate the preview image by directly intercepting video frames from the video file according to the interval time information and resolution information of the preview image.
第三方面,提供一种客户端装置,包括:In a third aspect, a client device is provided, including:
接收器,用于从服务器获取视频节目的索引文件,所述索引文件为DASH协议的MPD文件,所述索引文件包含预览图的描述信息;a receiver, for obtaining the index file of the video program from the server, the index file is the MPD file of the DASH protocol, and the index file includes the description information of the preview image;
处理器,用于根据所述预览图描述信息从所述服务器获取预览图,根据用户操作指令展示所述预览图。The processor is configured to obtain a preview image from the server according to the preview image description information, and display the preview image according to a user operation instruction.
可选的,所述预览图描述信息包括:Optionally, the preview image description information includes:
预览图的地址信息和预览图对应的时间信息。The address information of the preview image and the time information corresponding to the preview image.
可选的,所述处理器具体用于:Optionally, the processor is specifically used for:
在用户拖动播放进度条时,根据播放进度条的位置显示对应的预览图。When the user drags the playback progress bar, a corresponding preview image is displayed according to the position of the playback progress bar.
可选的,所述处理器还用于:在用户拖动播放进度条之前,根据所述预览图的地址信息从服务器下载预览图。Optionally, the processor is further configured to: before the user drags the playback progress bar, download the preview image from the server according to the address information of the preview image.
可选的,所述处理器还用于:在用户拖动播放进度条时,根据所述播放进度条的位置以及所述预览图对应的时间信息,确定对应的预览图的地址信息,根据所述确定的预览图的地址信息从服务器下载预览图。Optionally, the processor is further configured to: when the user drags the playback progress bar, according to the position of the playback progress bar and the time information corresponding to the preview image, determine the address information of the corresponding preview image, according to the The address information of the determined preview image is used to download the preview image from the server.
第四方面,提供一种服务器,包括:In a fourth aspect, a server is provided, including:
发射器,用于向客户端发送视频节目的索引文件,所述索引文件为DASH协议的MPD文件,所述索引文件包含预览图的描述信息;The transmitter is used to send the index file of the video program to the client, the index file is the MPD file of the DASH protocol, and the index file includes the description information of the preview image;
接收器,用于接收客户端预览图下载请求;The receiver is used to receive the client preview image download request;
所述发射器还用于响应所述客户端的下载请求,将所述预览图发送给所述客户端。The transmitter is further configured to send the preview image to the client in response to the download request of the client.
可选的,该服务器还包括:Optionally, the server also includes:
处理器,用于根据预览图生成规则生成预览图和预览图描述信息。The processor is used to generate a preview image and preview image description information according to the preview image generation rule.
可选的,所述预览图生成规则包括:Optionally, the preview image generation rules include:
预览图间隔时间信息和预览图分辨率信息。Preview image interval time information and preview image resolution information.
可选的,处理器可根据预览图的间隔时间信息和分辨率信息直接从视频文件中截取视频帧的方式生成预览图。Optionally, the processor may generate the preview image by directly intercepting video frames from the video file according to the interval time information and resolution information of the preview image.
第五方面,提供一种计算机程序产品,包括可执行程序代码,其中所述程序代码包括指令,当所述处理器执行所述指令时,所述指令使所述服务器或者客户端可执行如上述方面所述的预览图展示方法。In a fifth aspect, a computer program product is provided, including executable program code, wherein the program code includes instructions that, when executed by the processor, cause the server or client to execute the above-mentioned instructions The preview image display method described in the aspect.
第六方面,本申请实施例提供了一种计算机存储介质,用于储存为上述服务器、客户端所用的计算机软件指令,其包含用于执行上述方面所设计的程序。In a sixth aspect, an embodiment of the present application provides a computer storage medium for storing computer software instructions used by the above-mentioned server and client, which includes a program designed to execute the above-mentioned aspects.
附图说明Description of drawings
图1是用于实施本申请实施例的自适应HTTP流传输的系统架构图;1 is a system architecture diagram for implementing adaptive HTTP streaming according to an embodiment of the present application;
图2是用于实施本申请实施例的网络设备结构框图;FIG. 2 is a structural block diagram of a network device for implementing an embodiment of the present application;
图3是本申请一实施例的预览图展示方法交互流程图;3 is an interactive flowchart of a preview image display method according to an embodiment of the present application;
图4是本申请另一实施例的预览图展示方法交互流程图。FIG. 4 is an interaction flowchart of a preview image display method according to another embodiment of the present application.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行描述。The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.
图1示出了用于实施本申请实施例的自适应HTTP流传输的典型系统架构。如图1所示,该系统100可包括n个HTTP服务器110,n可为任意整数数字、客户端120和网络130。HTTP服务器110和客户端120可以通过网络130和HTTP缓存(未示出)等其它网络部件彼此耦合。FIG. 1 shows a typical system architecture for implementing adaptive HTTP streaming according to an embodiment of the present application. As shown in FIG. 1 , the
HTTP服务器110可以是用于通过HTTP发送和接收数据的任意硬件计算机服务器。HTTP服务器110可包括服务器DASH模块(dash module,DM)111,用于通过HTTP并根据DASH标准发送和接收数据。HTTP服务器可形成内容分发网(CDN)140,CDN140可指通过多个骨干网部署在多个数据中心用于分发内容的分布式服务器系统。CDN140可包括任意数目的HTTP服务器110,这样n可以是任意整数数字。通常,CDN可包括成千上百个服务器。
客户端120可以是用于通过HTTP发送和接收数据的任意硬件设备。例如,客户端120可为笔记本电脑、平板电脑、台式电脑、移动电话或其它设备。客户端120可包括客户端DASH模块(dash module,DM)121、应用122和图形用户界面(GUI)123。
客户端DM121可用于通过HTTP并根据DASH标准发送和接收数据。客户端DM121可进一步包括DASH访问引擎(dash access engine,DAE)1211和媒体输出(media export,ME)1212。DAE1211可以是用于从HTTP服务器110接收原始数据并将这些数据构建为观看格式的主要部件。例如,DAE1211可将为活动图像专家组(MPEG)容器格式的数据和定时数据一起格式化,随后将格式化后的数据输出到ME1212。ME1212可负责初始化、回放和其它与内容关联的功能并将内容输出到应用122。The client DM121 can be used to send and receive data via HTTP and according to the DASH standard. The
应用122可以是具有用于下载和展示内容的接口的网页浏览器或其它应用。应用122可耦合到GUI123,这样与客户端120关联的用户可查看应用122的各种功能。应用122可包括搜索功能,这样用户能够搜索内容。例如,如果应用122为媒体播放器,那么应用122可包括搜索栏,这样用户可输入字符串搜索电影。应用122可展示搜索命中列表,用户可从命中列表中选择想要的电影。选择之后,应用122可将下载电影的指令发送到客户端DM121。DM121可下载电影和处理电影以输出到应用122。应用122可提供指令给GUI123以供GUI123展示电影给用户观看。应用122可进一步提供指令给GUI123以供GUI123展示进度条,该进度条显示电影的时间进度。
网络130可以是用于提供HTTP服务器110和客户端120之间通信的任意网络。例如,网络130以是因特网、移动电话网络或其它网络。网络130可允许沿有线或无线信道进行通信。
图2为用于实施本发明实施例的网络设备200的示意图。设备200可包括多个入端口210和/或接收器单元(Rx)220,用于接收数据;逻辑单元或处理器230,用于处理信号;多个出端口240和/或发射器单元(Tx)250,用于将数据发送到其它部件;以及存储器260。设备200可适于实施任意所公开的特征、方法和设备。例如,设备200可适于实施HTTP服务器110、和客户端120。FIG. 2 is a schematic diagram of a
逻辑单元230(可称为中央处理单元(CPU))可与入端口210、接收器单元220、出端口240、发射器单元250和存储器260通信。逻辑单元230可以实施为一个或多个CPU芯片、核(例如,多核处理器)、现场可编程门阵列(FPGA)、专用集成电路(ASIC)和/或数字信号处理器(DSP),并且/或者可以是一个或多个ASIC的一部分。The
存储器260可由一个或多个磁盘、磁带驱动器、光盘驱动器或固态驱动器组成;可用于数据的非易失性存储和用作溢流数据存储设备;可用于当选择执行此类程序时存储程序;以及可用于存储程序执行期间读取的指令和数据。存储器260可为易失性和/或非易失性的并且可以是只读存储器(ROM)、随机存取存储器(RAM)、三重内容寻址内存(TCAM)、静态随机存取存储器(SRAM)、其它合适的存储器类型、或其任意组合。存储器260可包括DM270,DM270可适于实施服务器DM111或客户端DM121。虽然存储器260示为包括DM270,但是逻辑单元230或逻辑单元230和存储器260的任意组合可包括DM270。
基于前述的HTTP流传输的典型系统架构和网络设备,图3为根据本申请实施例的预览图展示方法的流程交互图。Based on the foregoing typical system architecture and network devices for HTTP streaming, FIG. 3 is a flow interaction diagram of a method for displaying preview images according to an embodiment of the present application.
客户端110可以使用HTTP GET请求或类似的消息,以从HTTP服务器120或HTTP缓存(图未示出)下载媒体展示描述(MPD)。MPD可以是可扩展标记语言(XML)文档。MPD包含对媒体内容进行编码所使用的格式的元数据,比如比特率、编解码、屏幕解析度、以及语言等信息,在本实施例中,MPD还包括预览图的描述信息。
本实施例中,视频内容注入时,服务器可读取对应视频的预览图生成规则,例如:预览图的间隔时间、预览图的分辨率等,生成预览图以及预览图的描述信息,预览图描述信息可以有多种实现方式:In this embodiment, when the video content is injected, the server can read the preview image generation rules of the corresponding video, such as the interval time of the preview images, the resolution of the preview images, etc., to generate the preview image and the description information of the preview image, and the preview image description Information can be implemented in several ways:
第一种实现方式中,所有的预览图可以压缩成一个文件,以压缩包的形式承载,预览图的属性参数在MPD Representation中定义,描述如下:In the first implementation, all preview images can be compressed into one file and carried in the form of a compressed package. The attribute parameters of the preview images are defined in MPD Representation, which are described as follows:
Representation标签内元素介绍:Elements in the Representation tag are introduced:
id:预览图组标识.id: Preview image group ID.
width:预览图的宽,单位:像素.width: The width of the preview image, in pixels.
height:预览图的高,单位:像素.height: The height of the preview image, unit: pixel.
startTime:第一张预览图对应视频中的时间点.startTime: The first preview image corresponds to the time point in the video.
interval:相邻预览图间隔时长,单位:秒.interval: interval between adjacent preview images, unit: seconds.
number:本视频生成的预览图总个数.number: The total number of preview images generated by this video.
BaseURL:该组预览图打包成zip文件后的URL,供下载用.BaseURL: The URL of the group of preview images packaged into a zip file for download.
第二中实施方式中,通过列表描述预览图,预览图的属性参数在MPDRepresentation中定义,描述如下:In the second embodiment, the preview image is described by a list, and the attribute parameters of the preview image are defined in MPDRepresentation, and the description is as follows:
Representation标签内元素介绍:Elements in the Representation tag are introduced:
id:预览图(组)的标识.id: The ID of the preview image (group).
width:预览图的宽,单位:像素.width: The width of the preview image, in pixels.
height:预览图的高,单位:像素.height: The height of the preview image, unit: pixel.
startTime:第一张预览图对应视频中的时间点.startTime: The first preview image corresponds to the time point in the video.
interval:相邻预览图片间隔时长,单位:秒interval: interval between adjacent preview images, unit: seconds
number:本视频生成的预览图总个数.number: The total number of preview images generated by this video.
SegmentURL:标签支持多值SegmentURL: tag supports multiple values
Media:具体预览图文件URL,供终端下载用.Media: The URL of the specific preview image file for the terminal to download.
第三种实施方式中,通过模板描述预览图,预览图的属性参数在MPDRepresentation中定义,描述如下:In the third embodiment, the preview image is described by a template, and the attribute parameters of the preview image are defined in MPDRepresentation, and the description is as follows:
Representation标签内元素介绍:Elements in the Representation tag are introduced:
PreviewTemplate:预览图下载地址(URL)的规则。PreviewTemplate: Rules for the download address (URL) of the preview image.
PreviewTimeline:描述预览图对应视频内容的规则。PreviewTimeline: Describes the rules for the preview image corresponding to the video content.
startTime:第一张预览图对应视频中的时间点。startTime: The first preview image corresponds to the time point in the video.
interval:相邻预览图片间隔时长,单位:秒。interval: The interval between adjacent preview images, unit: seconds.
number:本视频生成的预览图总个数。number: The total number of preview images generated by this video.
id:预览图(组)标识。id: Preview image (group) ID.
width:预览图的宽,单位:像素。width: The width of the preview image, in pixels.
height:预览图的高,单位:像素。height: The height of the preview image, unit: pixel.
如图3所示,本实施例的预览图展示方法包括如下步骤:As shown in FIG. 3 , the preview image display method of this embodiment includes the following steps:
步骤310,客户端120可向HTTP服务器110发送对MPD的请求。In step 310 , the
步骤320,HTTP服务器110可将MPD发送到客户端120。客户端120可通过DASH访问引擎DAE1211接收MPD,其中MPD包括预览图的描述信息,具体的,预览图的描述信息可以包括预览图的地址信息、时间信息,还可以包含预览图的分辨率信息。At step 320 , the
步骤330,客户端120从MPD文件中解析出预览图的描述信息,获取预览图的地址信息、时间信息和分辨率信息,其中预览图的时间信息至少包括:第一帧预览图对应的时间、相邻预览图之间的间隔时间,以及预览图的总帧数。Step 330, the
步骤340,客户端120根据预览图的描述信息,向HTTP服务器请求预览图。In step 340, the
具体的,客户端120可以根据屏幕大小等终端参数选择合适预览图分辨率,对应的预览图xml文档,根据文档中的预览图的地址,从服务器请求下载对应的预览图。Specifically, the
步骤350,HTTP服务器将预览图发送到客户端120,客户端120将预览图缓存到本地存储器中。In step 350, the HTTP server sends the preview image to the
步骤360,客户端120在用户拖动播放进度条时,展示对应进度的预览图。Step 360, when the user drags the playback progress bar, the
具体的,在用户拖动播放进度条时,确定播放进度条停止的位置以及时间,根据时间获取对应时间的预览图进行展示。需要注意的是,拖动播放进度条可以是用户直接使用鼠标拖动,或者用户直接输入时间参数以定位播放进度条的位置实现。Specifically, when the user drags the playback progress bar, the position and time at which the playback progress bar stops are determined, and a preview image corresponding to the time is obtained and displayed according to the time. It should be noted that the dragging of the playback progress bar can be realized by the user directly dragging the playback progress bar, or the user directly inputting time parameters to locate the position of the playback progress bar.
可选的,客户端120可在视频播放开始时,根据预览图的地址信息从服务器预先将所有的预览图下载到本地存储,在用户拖动播放进度条时,从本地获取对应时间的预览图进行展示,这种方式可以在用户拖动播放进度条时实时的显示预览图,展示体验更好。Optionally, when the video playback starts, the
另外,客户端120也可以在用户拖动进度条时,判断进度条停止位置及对应的时间,根据该时间选择对应时间的预览图,根据预览图的位置信息从服务器实时下载对应的预览图进行展示,该方式可以减轻客户端的存储压力,可以节省客户端的存储空间。In addition, the
如图4所示,为本申请另一实施例的预览图展示方法交互流程图。As shown in FIG. 4 , it is an interaction flowchart of a preview image display method according to another embodiment of the present application.
本实施例中,预览图描述信息可以为独立的XML文件,MPD中可仅包括对该XML文件的描述,比如预览图XML文件的URL。客户端可解析MPD后,根据预览图XML文件的URL从服务器获取预览图XML文件。其中,MPD关于预览图XML文件的描述可如下:In this embodiment, the preview image description information may be an independent XML file, and the MPD may only include a description of the XML file, such as the URL of the preview image XML file. After the client can parse the MPD, it can obtain the preview XML file from the server according to the URL of the preview XML file. The description of MPD on the XML file of the preview image may be as follows:
参数说明:Parameter Description:
mimeType:标识application/xml,非video audio,预览图属于应用类,用XML来承载mimeType: identifies application/xml, not video audio, and the preview image belongs to the application class, which is carried by XML
value:明确是时间轴预览用,timelinepreview。value: It is clearly used for timeline preview, timelinepreview.
Representation id:当有多组分辨率的预览图提供预览时,通过id区分多个Representation。Representation id: When preview images with multiple resolutions are provided, distinguish multiple Representations by id.
width,预览图宽度,单位为像素width, the width of the preview image, in pixels
height,预览图高度,单位为像素height, the height of the preview image, in pixels
BaseURL:预览图XML文件的URL,客户端可根据该URL获取预览图详细的描述信息。BaseURL: URL of the preview image XML file, the client can obtain detailed description information of the preview image according to the URL.
具体的,预览图XML文件描述有多种方式,本实施例中,第一种实现方式中预览图XML文件为单图片模式,每张预览图都是一个单独的图片,描述如下:Specifically, there are multiple ways to describe the preview image XML file. In this embodiment, the preview image XML file in the first implementation mode is a single image mode, and each preview image is a separate image, and the description is as follows:
<!–Preview preview_240.XML--><! --Preview preview_240.XML-->
<xml version="1.0"encoding="UTF-8"><xml version="1.0"encoding="UTF-8">
<timemline><timemline>
<image time=“000006”id=“preview_240_$time$.jpg”/><image time="000006" id="preview_240_$time$.jpg"/>
<image time="000012"id="preview_240_$time$.jpg"/><image time="000012"id="preview_240_$time$.jpg"/>
<image time="005900"id="preview_240_$time$.jpg"/><image time="005900"id="preview_240_$time$.jpg"/>
</timemline></timemline>
参数说明:Parameter Description:
timemline:该XML节点下的内容是用于时间轴的场景timemline: The content under this XML node is the scene for the timeline
image:表示是对预览图对象节点进行描述image: indicates that the preview image object node is described
time:格式时分秒HHMMSStime: format hours, minutes, seconds HHMMSS
id=“preview_240_$time$.jpg”:预览图文件的URLid="preview_240_$time$.jpg": URL of preview image file
第二种实现方式中,预览图片XML文件为合并图片模式,即多个预览图合成在一张图片中:In the second implementation, the preview image XML file is in the merged image mode, that is, multiple preview images are combined into one image:
<!–Preview preview_240.XML--><! --Preview preview_240.XML-->
<xml version="1.0"encoding="UTF-8"><xml version="1.0"encoding="UTF-8">
<timemline><timemline>
<image startTime=“000000”endTime=”001000”interval=”6”<image startTime="000000" endTime="001000" interval="6"
id=“preview_$startTime$_$endTime$.jpg”/>id="preview_$startTime$_$endTime$.jpg"/>
<image startTime=“001000”endTime=”002000”interval=”6”<image startTime="001000" endTime="002000" interval="6"
id=“preview_$startTime$_$endTime$.jpg”/>id="preview_$startTime$_$endTime$.jpg"/>
……
<image startTime=“012000”endTime=”013000”interval=”6”<image startTime="012000" endTime="013000" interval="6"
id=“preview_$startTime$_$endTime$.jpg”/>id="preview_$startTime$_$endTime$.jpg"/>
</timemline></timemline>
参数说明:Parameter Description:
timemline:该XML节点下的内容是用于时间轴的场景timemline: The content under this XML node is the scene for the timeline
image:表示是对预览图对象节点进行描述image: indicates that the preview image object node is described
startTime:视频的开始时间,格式:HHMMSSstartTime: the start time of the video, format: HHMMSS
endTime:视频的结束时间,格式:HHMMSSendTime: the end time of the video, format: HHMMSS
interval:本段视频内预览图生成间隔时间,单位:秒interval: The interval for generating preview images in this video, unit: seconds
id=“preview_$startTime$_$endTime$.jpg”:预览图文件的URLid="preview_$startTime$_$endTime$.jpg": URL of preview image file
合并图片模式,能减少图片数量,客户端读取合并图片,能减少文件打开关闭的数量,提高显示的速度。The merged picture mode can reduce the number of pictures, and the client reads the merged pictures, which can reduce the number of files opened and closed, and improve the display speed.
本实施例中,预览图展示方法,包括如下步骤:In the present embodiment, the preview image display method includes the following steps:
步骤410,客户端120可向HTTP服务器110发送对MPD的请求。In step 410 , the
步骤420,HTTP服务器110可将MPD发送到客户端120。客户端120可通过DAE1211接收MPD,其中MPD包括预览图描述信息,具体的,预览图描述信息包括:预览图描述文件的URL。At step 420 , the
具体的,预览图描述信息可如下描述:Specifically, the description information of the preview image can be described as follows:
客户端120根据value=“timelinepreview,确定该视频支持预览图特性,其中多个Representation,表示有多个分辨率的预览图可以获取,终端可根据自己屏幕大小,选择合适的分辨率预览图xml,本实例中以获取的240分辨率的预览图为例。The
步骤430,客户端120从MPD文件中解析出预览图描述文件的URL。Step 430, the
步骤440,客户端120根据该预览图描述文件的URL向服务器请求该预览图描述文件。Step 440, the
具体的,客户端120可根据选择的分辨率为240的预览图的BaseURL从服务器请求该预览图的描述文件。Specifically, the
步骤450,HTTP服务器110将预览图的描述文件返回给客户端120。Step 450 , the
具体的,预览图描述文件可为XML文档,具体内容可如下:Specifically, the preview image description file may be an XML document, and the specific content may be as follows:
<!–Preview XML--><! --Preview XML-->
<xml version="1.0"encoding="UTF-8"><xml version="1.0"encoding="UTF-8">
<timemline><timemline>
<image time=“000006”id=“preview_240_000006.jpg”/><image time="000006" id="preview_240_000006.jpg"/>
<image time="000012"id="preview_240_000012.jpg"/><image time="000012"id="preview_240_000012.jpg"/>
........
<image time="013000"id="preview_240_013000.jpg"/><image time="013000"id="preview_240_013000.jpg"/>
</timemline></timemline>
步骤460,客户端120根据预览图的描述文件,向HTTP服务器请求预览图。In step 460, the
步骤470,HTTP服务器将预览图发送到客户端120,客户端120将预览图缓存到本地存储器中。In step 470, the HTTP server sends the preview image to the
步骤480,客户端120在用户拖动播放进度条时,展示对应进度的预览图。Step 480: When the user drags the playback progress bar, the
具体的,在用户拖动播放进度条时,确定播放进度条停止的位置以及时间,根据时间获取对应时间的预览图进行展示。Specifically, when the user drags the playback progress bar, the position and time at which the playback progress bar stops are determined, and a preview image corresponding to the time is obtained and displayed according to the time.
可选的,客户端120可在视频播放开始时,根据预览图的地址信息从服务器预先将所有的预览图下载到本地存储,在用户拖动播放进度条时,从本地获取对应时间的预览图进行展示,这种方式可以在用户拖动播放进度条时实时的显示预览图,展示体验更好。Optionally, the
另外,客户端120也可以在用户拖动进度条时,判断进度条停止位置及对应的时间,根据该时间选择对应时间的预览图,根据预览图的位置信息从服务器实时下载对应的预览图进行展示,该方式可以减轻客户端的存储压力,可以节省客户端的存储空间。In addition, the
需要注意的是,本申请实施例方案也可以适用于HLS等其他HTTP协议,如适用HLS协议,可将预览图的描述信息包含在M3U8文件中,具体实施方式可参考如上实施例。It should be noted that the solutions of the embodiments of the present application can also be applied to other HTTP protocols such as HLS. If the HLS protocol is applied, the description information of the preview image can be included in the M3U8 file. For the specific implementation, refer to the above embodiments.
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本发明的范围。Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. Interchangeability, the above description has generally described the components and steps of each example in terms of function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each particular application, but such implementations should not be considered beyond the scope of the present invention.
所属领域的技术人员可以清楚地了解到,为了描述的方便和简洁,上述描述的系统、装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.
在本申请所提供的几个实施例中,应该理解到,所揭露的系统、装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口、装置或单元的间接耦合或通信连接,也可以是电的,机械的或其它的形式连接。In the several embodiments provided in this application, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the apparatus embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may also be electrical, mechanical or other forms of connection.
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本发明实施例方案的目的。The units described as separate components may or may not be physically separated, and components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solutions in the embodiments of the present invention.
另外,在本发明各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以是两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware, or may be implemented in the form of software functional units.
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分,或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(ROM,Read-OnlyMemory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention is essentially or a part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium , including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: U disk, removable hard disk, Read-Only Memory (ROM, Read-Only Memory), Random Access Memory (RAM, Random Access Memory), magnetic disk or optical disk and other media that can store program codes.
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以权利要求的保护范围为准。The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited to this. Any person skilled in the art can easily think of various equivalents within the technical scope disclosed by the present invention. Modifications or substitutions should be included within the protection scope of the present invention. Therefore, the protection scope of the present invention should be subject to the protection scope of the claims.
Claims (19)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710170348.9A CN108632644B (en) | 2017-03-21 | 2017-03-21 | Preview display method and device |
PCT/CN2018/078446 WO2018171437A1 (en) | 2017-03-21 | 2018-03-08 | Display method and device for preview image |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710170348.9A CN108632644B (en) | 2017-03-21 | 2017-03-21 | Preview display method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108632644A CN108632644A (en) | 2018-10-09 |
CN108632644B true CN108632644B (en) | 2020-09-11 |
Family
ID=63586278
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710170348.9A Active CN108632644B (en) | 2017-03-21 | 2017-03-21 | Preview display method and device |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN108632644B (en) |
WO (1) | WO2018171437A1 (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109561337A (en) * | 2018-11-19 | 2019-04-02 | 青岛海信传媒网络技术有限公司 | The playing method and device of preview video |
CN110198452B (en) * | 2019-04-02 | 2021-09-14 | 腾讯科技(深圳)有限公司 | Live video previewing method, device and system |
CN115499702B (en) * | 2021-06-18 | 2024-05-14 | 阿里巴巴创新公司 | Display method and device of preview image, electronic equipment and storage medium |
CN115567652A (en) * | 2022-05-17 | 2023-01-03 | 深圳市纵维立方科技有限公司 | Preview generating method and system and electronic equipment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102316370A (en) * | 2010-06-29 | 2012-01-11 | 腾讯科技(深圳)有限公司 | Method and device for displaying playback information |
CN102932679A (en) * | 2012-11-21 | 2013-02-13 | 合一网络技术(北京)有限公司 | Network video previewing system and method |
CN103957471A (en) * | 2014-05-05 | 2014-07-30 | 华为技术有限公司 | Network video playing method and device |
CN103974147A (en) * | 2014-03-07 | 2014-08-06 | 北京邮电大学 | MPEG (moving picture experts group)-DASH protocol based online video playing control system with code rate switch control and static abstract technology |
CN104937583A (en) * | 2013-01-18 | 2015-09-23 | 华为技术有限公司 | A method and device for self-adapting media content |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20120010089A (en) * | 2010-07-20 | 2012-02-02 | 삼성전자주식회사 | Method and apparatus for improving quality of HTP-based multimedia streaming service |
-
2017
- 2017-03-21 CN CN201710170348.9A patent/CN108632644B/en active Active
-
2018
- 2018-03-08 WO PCT/CN2018/078446 patent/WO2018171437A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102316370A (en) * | 2010-06-29 | 2012-01-11 | 腾讯科技(深圳)有限公司 | Method and device for displaying playback information |
CN102932679A (en) * | 2012-11-21 | 2013-02-13 | 合一网络技术(北京)有限公司 | Network video previewing system and method |
CN104937583A (en) * | 2013-01-18 | 2015-09-23 | 华为技术有限公司 | A method and device for self-adapting media content |
CN103974147A (en) * | 2014-03-07 | 2014-08-06 | 北京邮电大学 | MPEG (moving picture experts group)-DASH protocol based online video playing control system with code rate switch control and static abstract technology |
CN103957471A (en) * | 2014-05-05 | 2014-07-30 | 华为技术有限公司 | Network video playing method and device |
Also Published As
Publication number | Publication date |
---|---|
WO2018171437A1 (en) | 2018-09-27 |
CN108632644A (en) | 2018-10-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6064249B2 (en) | Dynamic adaptive streaming over hypertext transfer protocol client behavior framework and session management implementation | |
JP6172688B2 (en) | Content-specific identification and timing behavior in dynamic adaptive streaming over hypertext transfer protocols | |
CN110876080B (en) | Video projection method, device, computer equipment and storage medium | |
JP6173485B2 (en) | URL parameter insertion and addition in adaptive streaming | |
CN105453582B (en) | A method of playing Media Stream in browser | |
WO2017063399A1 (en) | Video playback method and device | |
CN108632644B (en) | Preview display method and device | |
US20140341527A1 (en) | Creating, Editing, and Publishing a Video Using a Mobile Device | |
KR100889367B1 (en) | Virtual studio implementation system and method through network | |
CN113767608B (en) | Method, apparatus and non-volatile computer readable medium for receiving media data of a session | |
US11750864B2 (en) | Methods and apparatuses for ingesting one or more media assets across a video platform | |
US10515476B2 (en) | Image fetching for timeline scrubbing of digital media | |
US9754353B2 (en) | Method and system for video stream personalization | |
CN107197386A (en) | A kind of cross-platform video playback implementation method without client | |
CN111869223A (en) | The amount of field of view for immersive media | |
CN105898395A (en) | Network video playing method, device and system | |
CN113661680B (en) | Processing method and device for receiving media data of media content | |
WO2015143854A1 (en) | Data acquisition and interaction method, set top box, server and multimedia system | |
JP4165134B2 (en) | Information reproducing apparatus, information reproducing method, and information reproducing system | |
CN113315982A (en) | Live broadcast method, computer storage medium and equipment | |
JP6063952B2 (en) | Method for displaying multimedia assets, associated system, media client, and associated media server | |
JP2024517370A (en) | Method, apparatus and program for constructing a linear media source extension (MSE) buffer from two or more non-linear media sources using MPD chaining | |
JP7693953B2 (en) | Method, device, and computer-readable medium for processing alternative media presentation descriptions - Patents.com | |
US20250113078A1 (en) | Methods and systems for displaying content during a pause event | |
US10893331B1 (en) | Subtitle processing for devices with limited memory |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |