CN107784686B - Multi-resolution-based multi-view media presentation method - Google Patents
Multi-resolution-based multi-view media presentation method Download PDFInfo
- Publication number
- CN107784686B CN107784686B CN201610726946.5A CN201610726946A CN107784686B CN 107784686 B CN107784686 B CN 107784686B CN 201610726946 A CN201610726946 A CN 201610726946A CN 107784686 B CN107784686 B CN 107784686B
- Authority
- CN
- China
- Prior art keywords
- resolution
- video
- view
- user
- signaling information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a multi-resolution-based multi-view media presentation method, which comprises the following steps: the method comprises the following steps: the user logs in the service, and the server sends spatial block signaling information and multi-resolution multi-view signaling information to the user; step two: the user requests the server for the blocked video and the low-resolution video according to the interested area by combining the position relation of the blocked video indicated by the space blocking signaling information; step three: the server sends the requested block video and the low-resolution video to the client; step four: the media contents with different visual angles and different resolutions are presented to the user in a combined way; step five: and repeating the second step, the third step and the fourth step. The invention not only solves the problem of switching the black screen, but also ensures the flexibility of combining multi-resolution and multi-view angles.
Description
Technical Field
The present invention relates to a multi-view media presentation method, and more particularly, to a multi-view media presentation method based on multi-resolution.
Background
With the rapid development of digital media technology, the multimedia content generated in the internet shows explosive growth, especially the wide application of ultra-high resolution video services (such as 4K, 8K, etc.) and immersive video services, and multimedia services impose an increasingly heavy burden on network bandwidth. Meanwhile, terminal presentation devices are increasingly diversified, such as ultra-high-definition televisions, tablet computers, smart phones, head-mounted devices and the like, and due to the limitation of hardware capability, part of the devices do not support decoding and presentation of ultra-high-resolution videos.
In order to deal with network bandwidth overload and terminal equipment diversification, some current multimedia protocols provide that ultrahigh-resolution multimedia content is spatially blocked, and the corresponding blocked multimedia content with different viewing angles is transmitted and presented for a user according to the network condition of the user, the equipment capability and the region of interest of the user.
However, although this solution ensures that the user can consume only a part of the visual field at a time, when the user needs to consume the other part of the visual field, the solution can continue to present the corresponding visual field, but inevitably causes bad video effects such as jamming and black screen when the screen is switched.
Disclosure of Invention
Aiming at the defects in the prior art, the invention aims to provide a multi-resolution-based multi-view media presentation method, which introduces lower-resolution video content for synchronous presentation and indicates a multi-resolution and multi-view combination mode of specific multimedia content through a signaling message, thereby solving the problem of switching black screens and ensuring the flexibility of combining multi-resolution and multi-view.
According to an aspect of the present invention, there is provided a multi-resolution-based multi-view media presentation method, comprising:
the method comprises the following steps: the user logs in the service, and the server sends spatial block signaling information and multi-resolution multi-view signaling information to the user;
step two: a user requests a blocked video from a server according to an interested area and the position relation of the blocked video indicated by the spatial blocking signaling information, and simultaneously requests a corresponding low-resolution video according to the multi-resolution multi-view signaling information;
step three: the server sends the requested block video and the low-resolution video to the client;
step four: after receiving the block video and the low-resolution video, the client combines and presents media contents with different visual angles and different resolutions to a user through the space block information and the multi-resolution multi-visual angle information;
step five: and repeating the second step, the third step and the fourth step.
Preferably, the server informs the client whether there are multi-resolution media assets, and whether there are spatial tiles for each resolution of media assets.
Compared with the prior art, the invention has the following beneficial effects: the invention provides a multi-resolution based multi-view media presentation mechanism. Aiming at the problem of switching the black screen in the existing multi-view media presentation, the lower-resolution video content is introduced for synchronous presentation, and a multi-resolution and multi-view combination mode existing in specific multimedia content is indicated through a signaling message, so that the problem of switching the black screen is solved, and the flexibility of combining the multi-resolution and the multi-view is ensured.
Drawings
Other features, objects and advantages of the invention will become more apparent upon reading of the detailed description of non-limiting embodiments with reference to the following drawings:
fig. 1 is a combination diagram of a high definition blocking view and a low definition full view. The hatched portion in the figure is a portion actually viewed by the user.
Fig. 2 is a combination diagram of high definition blocking viewing angle and low definition blocking viewing angle. The hatched portion in the figure is the portion actually viewed by the user
Fig. 3 is a view of the content of the visual field seen by the user when the visual angle is switched. The hatched portion in the figure is a portion actually viewed by the user.
Detailed Description
The present invention will be described in detail with reference to specific examples. The following examples will assist those skilled in the art in further understanding the invention, but are not intended to limit the invention in any way. It should be noted that variations and modifications can be made by persons skilled in the art without departing from the spirit of the invention. All falling within the scope of the present invention.
The invention transmits the video with lower definition in a larger visual field range of the multimedia content to the user when transmitting the required visual field region to the user. When the user needs to switch the view angle, the low-definition version video with a larger view field range exists locally at the client, and the low-definition version video can be presented in the transition period of switching the view angle. And because the transition period of switching the visual angle is short, the experience that the user watches the low-definition visual angle in the period is far better than the experience of a black screen. After the high definition viewing angle content desired by the user is successfully transmitted to the user, the user may continue to watch the high definition video content.
With the rapid development of digital media technology, multimedia contents generated in the internet, especially ultra-high-definition multimedia presentation explosive growth, in order to cope with network bandwidth overload and terminal device diversification caused by the rapid development, some current multimedia protocols propose to spatially block the multimedia contents with ultra-high resolution, and to transmit and present corresponding blocked multimedia contents with different viewing angles for users according to the network conditions of the users, the device capabilities and the interested areas of the users themselves.
The multi-resolution-based multi-view media presentation method of the invention comprises the following steps:
the method comprises the following steps: the user logs in the service, and the server sends spatial block signaling information and multi-resolution multi-view signaling information to the user;
step two: a user requests a specific media resource, namely a block video, from a server according to an interested area by combining with the position relation of the block video indicated by the space block signaling information, and simultaneously requests a corresponding low-resolution video according to the multi-resolution multi-view signaling information;
step three: the server sends the requested block video and the low-resolution video to the client;
step four: after receiving the block video and the low-resolution video, the client combines and presents the media contents with different visual angles and different resolutions to a user through the spatial block information and the multi-resolution multi-visual angle information (the combined presentation mode of the client includes but is not limited to the rendering presentation after splicing the media contents with different visual angles and different resolutions);
step five: and repeating the second step, the third step and the fourth step.
When the client presents the ultra-high-definition blocked media content, the ultra-high-definition blocked video is combined with the low-definition video at the same time, and then the ultra-high-definition blocked video is presented to the user, as shown in fig. 1 and fig. 2. At this time, although the user sees only the viewing angle formed by the ultra-high-definition segmented video, since the viewing angle formed by the low-definition video actually exists around the viewing angle viewed by the user, when the viewing angle is switched, the presented content can move along with the switching operation of the user, and therefore, the display cannot be jammed or a screen is blacked, as shown in fig. 3.
Further, the server needs to inform the client of the existence of multiple views and multiple resolutions of different video contents on the server. That is, for a media content with multiple views, videos with different resolutions existing on a server related to the content are provided, and whether a corresponding spatial block video exists in each content with different resolutions or not is provided.
In the first step, the server needs to send multi-view and multi-resolution indication information to the client, besides sending spatial blocking signaling information to the client.
Taking MMT as an example, reasonably adding resolution and view combination messages includes:
a resolution _ amount indicating the number of low resolution existing in the multimedia content; resolution, indicating a specific resolution;
multiblocks, indicating whether the media asset of that resolution is spatially divided into multiple views.
And constructing a combined relationship between different resolutions and different perspectives in combination with the Asset _ id of the media Asset (Asset).
The specific implementation content of the invention is as follows:
the signaling information form is as follows: and constructing multi-resolution multi-view signaling information multi _ resolution _ view _ message (), indicating the existing multi-resolution and multi-view conditions in the media resource. As a preferable mode, the form as shown in the following table 1 may be adopted:
TABLE 1
Signaling table form: and constructing a multi-resolution multi-view signaling table multi _ resolution _ view _ table () to indicate the existing multi-resolution and multi-view conditions in the media resources. As a preferable mode, the form shown in the following table 2 may be adopted:
TABLE 2
In the above example of the signaling information and signaling table, in addition to the fields already defined above, the multi _ view _ ampout indicates that the number of super high definition video resources with multiple views are spatially partitioned; the first asset _ id () indicates the asset _ id of the original video of the partitioned ultra-high-definition video resource; the second asset _ id () indicates the asset _ id of the same low resolution video resource as the ultra high definition original video content.
Descriptor form: based on MP _ table (), adding a multi-resolution multi-view descriptor (multi _ resolution _ view _ descriptor ()) to the media Asset descriptor (Asset _ descriptors) of the highest resolution media Asset (Asset) in the same media content, indicating the existing multi-resolution and multi-view conditions in the media Asset, as shown in table 3 below:
TABLE 3
Wherein, the resolution _ amount indicates the number of different resolutions of the corresponding media content; asset _ id indicates Asset _ id of Asset corresponding to a certain low resolution of the media content; multiblocks indicate whether there are multiple views of the content at that resolution; resolution indicates the specific resolution of the resolution content.
The application method of the present invention is described below by taking a multi-resolution multi-view signaling table and an existing spatial partitioning signaling table (block _ association _ table) in the MMT as an example, where the spatial partitioning signaling table is shown in table 4 below.
TABLE 4
Firstly, a user logs in a service, and a server issues block _ association _ table () and multi _ resolution _ view _ table () to the user;
next, the user requests a specific media resource Asset set, that is, a block video, from the server according to the interested area and in combination with the block video position relationship indicated by the spatial block signaling information. Meanwhile, according to Asset _ id of the original Asset corresponding to the assets, matching a multi-resolution relationship corresponding to Asset _ id in the multi _ resolution _ view _ table, namely the multi _ resolution _ view _ table is the same as the first Asset _ id in the multi _ resolution _ view _ table;
then, according to the low resolution (values of multiblocks and resolution) under the Asset _ id and the user's own conditions, the low resolution video Asset is requested. If the required low-resolution multiblocks is false, the required low-resolution Asset is a complete low-definition video corresponding to the resolution value; if the low-resolution multiblocks required to be requested are true, finding a corresponding low-resolution sub-block Asset set in the block _ association _ table according to the Asset _ id corresponding to the resolution and requesting the server;
finally, the server sends the requested block video and the low-resolution video to the client; after receiving the block video and the low-resolution video, the client combines and presents the media contents with different visual angles and different resolutions to a user through the spatial block information and the multi-resolution multi-visual angle information (the combined presentation mode of the client includes but is not limited to the rendering presentation after splicing the media contents with different visual angles and different resolutions); and repeating the second step to the fourth step.
The proposed solutions are illustrated in the present invention by way of example in MMT, but they can also be used in other file encapsulation, transmission systems and protocols. The spatial block information applied in the present invention is described by taking MMT as an example, but is not limited to this, and all schemes for indicating the position relationship between spatial block videos and the association relationship between a block video and an original video may be combined with the present invention. Under the premise that the server has corresponding multi-resolution multi-view video resources, namely, under the condition that the server has space block videos with different views and the complete videos corresponding to the multi-view videos have multi-resolution, the server informs the client of the multi-view and multi-resolution conditions through certain signaling information, namely, the server informs the client of whether the multi-resolution media resources exist and whether the media resources of each resolution have space blocks.
It should be noted that, in the description of the resolution of video, the ultra high definition video refers to video with a resolution of 4K (including all mainstream 4K video with a resolution of 4096 × 2160), 8K (with a resolution of 7680 × 4320) and above. The ultra-high definition video is taken as a watershed, and all videos with lower resolution than the ultra-high definition video are low resolution, including mainstream high-definition and standard-definition videos with resolution of 1920x1080, 1280x720 and 720x 480. In the implementation of the present invention, when the ultra-high definition segmented video content is combined with the low-resolution video content, the selection of the low-resolution video content is not limited to a certain fixed resolution according to the low-resolution video existing at the server side and the device capability, network status, personal selection, etc. of the user himself.
The above embodiments are described in further detail to solve the technical problems, technical solutions and advantages of the present invention, and it should be understood that the above embodiments are only examples of the present invention and are not intended to limit the present invention, and any modifications, equivalent substitutions, improvements and the like made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (2)
1. A multi-resolution based multi-view media presentation method, comprising the steps of:
the method comprises the following steps: the user logs in the service, and the server sends spatial block signaling information and multi-resolution multi-view signaling information to the user;
step two: a user requests a blocked video from a server according to an interested area and the position relation of the blocked video indicated by the spatial blocking signaling information, and simultaneously requests a corresponding low-resolution video according to the multi-resolution multi-view signaling information;
step three: the server sends the requested block video and the low-resolution video to the client;
step four: after receiving the block video and the low-resolution video, the client combines and presents media contents with different visual angles and different resolutions to a user through the space block information and the multi-resolution multi-visual angle information;
step five: and repeating the second step, the third step and the fourth step.
2. The multi-resolution multi-view media rendering method as recited in claim 1, wherein the server informs the client whether multi-resolution media assets exist, and whether spatial tiles exist for each resolution of media assets.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610726946.5A CN107784686B (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
| CN202110620456.8A CN113347374A (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610726946.5A CN107784686B (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110620456.8A Division CN113347374A (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107784686A CN107784686A (en) | 2018-03-09 |
| CN107784686B true CN107784686B (en) | 2021-06-11 |
Family
ID=61439836
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610726946.5A Active CN107784686B (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
| CN202110620456.8A Withdrawn CN113347374A (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110620456.8A Withdrawn CN113347374A (en) | 2016-08-25 | 2016-08-25 | Multi-resolution-based multi-view media presentation method |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN107784686B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112153465B (en) * | 2019-06-28 | 2024-01-16 | 北京京东尚科信息技术有限公司 | Image loading method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009077082A (en) * | 2007-09-19 | 2009-04-09 | Toshiba Corp | Resolution converting apparatus, resolution converting method, and pre-view displaying apparatus |
| CN102480637A (en) * | 2010-11-30 | 2012-05-30 | 上海博路信息技术有限公司 | Method for self-adaptively displaying content resolution of IPTV |
| CN104503655A (en) * | 2014-11-28 | 2015-04-08 | 晨星半导体股份有限公司 | Application program interface display control method and device |
| CN105141876A (en) * | 2015-09-24 | 2015-12-09 | 京东方科技集团股份有限公司 | Video signal conversion method, video signal conversion device and display system |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0645736B1 (en) * | 1993-09-27 | 2003-02-05 | Canon Kabushiki Kaisha | Image processing apparatus |
| DE10129631A1 (en) * | 2001-06-20 | 2003-01-02 | Philips Corp Intellectual Pty | Process for the reconstruction of a high-resolution 3D image |
| CN101155298B (en) * | 2006-09-25 | 2012-07-04 | 华为技术有限公司 | Method and system for implementing fast switching television channel |
| US20100026737A1 (en) * | 2008-08-04 | 2010-02-04 | Kabushiki Kaisha Toshiba | Video Display Device |
| US7850306B2 (en) * | 2008-08-28 | 2010-12-14 | Nokia Corporation | Visual cognition aware display and visual data transmission architecture |
| JP5844745B2 (en) * | 2010-02-02 | 2016-01-20 | トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ | Method and apparatus for reducing vector quantization error through patch shifting |
| CN102347043B (en) * | 2010-07-30 | 2014-10-22 | 腾讯科技（北京）有限公司 | Method for playing multi-angle video and system |
| US20120079000A1 (en) * | 2010-09-27 | 2012-03-29 | Motorola-Mobility, Inc. | Selectively receiving media content |
| EP2680221B1 (en) * | 2012-06-28 | 2016-05-11 | Alcatel Lucent | Method and system for generating a high-resolution video stream |
| CN104077103A (en) * | 2014-07-09 | 2014-10-01 | 上海天奕达电子科技有限公司 | Method and device for supporting high-resolution display device through low-resolution platform |
| CN104410857A (en) * | 2014-12-26 | 2015-03-11 | 广东威创视讯科技股份有限公司 | Image display control method and related device |
-
2016
- 2016-08-25 CN CN201610726946.5A patent/CN107784686B/en active Active
- 2016-08-25 CN CN202110620456.8A patent/CN113347374A/en not_active Withdrawn
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009077082A (en) * | 2007-09-19 | 2009-04-09 | Toshiba Corp | Resolution converting apparatus, resolution converting method, and pre-view displaying apparatus |
| CN102480637A (en) * | 2010-11-30 | 2012-05-30 | 上海博路信息技术有限公司 | Method for self-adaptively displaying content resolution of IPTV |
| CN104503655A (en) * | 2014-11-28 | 2015-04-08 | 晨星半导体股份有限公司 | Application program interface display control method and device |
| CN105141876A (en) * | 2015-09-24 | 2015-12-09 | 京东方科技集团股份有限公司 | Video signal conversion method, video signal conversion device and display system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107784686A (en) | 2018-03-09 |
| CN113347374A (en) | 2021-09-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11122294B2 (en) | Methods, devices and stream for encoding and decoding volumetric video | |
| US11632571B2 (en) | Media data processing method and apparatus | |
| US8911291B2 (en) | Display system and display method for video wall | |
| US9635252B2 (en) | Live panoramic image capture and distribution | |
| WO2017201090A1 (en) | Method and apparatus for spatial enhanced adaptive bitrate live streaming for 360 degree video playback | |
| US8925019B2 (en) | Synchronous display streaming system and synchronous displaying method | |
| KR20160079357A (en) | Method for sending video in region of interest from panoramic-video, server and device | |
| EP3716634A1 (en) | Method and device for processing media data | |
| US20210067832A1 (en) | Data Streams | |
| CN104639951A (en) | Video bitstream frame extraction process and device | |
| EP3627439A1 (en) | Method and device for processing media data | |
| TWI786572B (en) | Immersive media providing method and acquiring method, device, equipment and storage medium | |
| CN115134632B (en) | Video code rate control method, device, medium and content delivery network CDN system | |
| US10917477B2 (en) | Method and apparatus for MMT integration in CDN | |
| CN107438203B (en) | Method for establishing and receiving list, network equipment and terminal | |
| CN107784686B (en) | Multi-resolution-based multi-view media presentation method | |
| CN112637671A (en) | Screen sharing method and system | |
| Kim et al. | 360‐degree video offloading using millimeter‐wave communication for cyberphysical system | |
| Syamsuddin | An experimental study of RyO Kit for Covid-19 information sharing in rural islands of Indonesia | |
| CN110225371B (en) | Storage and transmission method for supporting space blocking based on media self-attribute | |
| KR20200141203A (en) | Apparatus and method for providing video contents | |
| WO2024060720A1 (en) | Video stream transmission control method and apparatus, and system, electronic device and storage medium | |
| US20240373032A1 (en) | Data transmission method and apparatus, electronic device, and storage medium | |
| Lee et al. | Integrated approach of streaming 3d multimedia contents in real-time for mobile devices | |
| Patel et al. | Remote Control of Android Phones Using VNC |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |