CN108769680A - A kind of panoramic video is based on slope block sampling method and device - Google Patents
A kind of panoramic video is based on slope block sampling method and device Download PDFInfo
- Publication number
- CN108769680A CN108769680A CN201810544637.5A CN201810544637A CN108769680A CN 108769680 A CN108769680 A CN 108769680A CN 201810544637 A CN201810544637 A CN 201810544637A CN 108769680 A CN108769680 A CN 108769680A
- Authority
- CN
- China
- Prior art keywords
- slope
- region
- rectangle
- sampling
- spherical surface
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000005070 sampling Methods 0.000 title claims abstract description 115
- 238000000034 method Methods 0.000 title claims abstract description 51
- 238000011161 development Methods 0.000 claims abstract description 43
- 230000018109 developmental process Effects 0.000 claims abstract description 43
- 230000011218 segmentation Effects 0.000 claims abstract description 12
- 230000002093 peripheral effect Effects 0.000 claims description 14
- 238000009826 distribution Methods 0.000 claims description 8
- 238000003860 storage Methods 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 6
- 230000008707 rearrangement Effects 0.000 claims description 6
- 230000007480 spreading Effects 0.000 claims description 5
- 238000003892 spreading Methods 0.000 claims description 5
- 238000005520 cutting process Methods 0.000 claims description 4
- 238000011017 operating method Methods 0.000 claims 1
- 230000006835 compression Effects 0.000 abstract description 4
- 238000007906 compression Methods 0.000 abstract description 4
- 238000010586 diagram Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000013441 quality evaluation Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/132—Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Circuits (AREA)
- Image Processing (AREA)
Abstract
A kind of panoramic video of present invention offer is based on slope block sampling method and device.The present invention is unfolded by the way that spherical surface tiles along weft, generates two-dimensional Cartesian coordinate system by origin of the center after development of a sphere, and obtain the slope k of development of a sphere back edge curve L；Then weft W is used1、W2、W3、W4The spherical surface of expansion is divided into 5 regions, by being followed successively by O from top to bottomi, i=0,1,2,3,4；Further according to the value range of the boundary curve slope k of each region after segmentation, fixed slope is set for each region.Shape of each region after over-sampling is obtained then according to the slope；It is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is sampled；It is finally rectangle by the graphical arrangement after sampling.Rectangle after sampling reduces sampling structure redundancy so that under conditions of reaching identical spatial resolution, sampling number is few, and the data volume after sampling is small, and compression efficiency is high.
Description
Technical field
The present invention relates to video coding techniques, and slope block sampling method and dress are based on more particularly to a kind of panoramic video
It sets.
Background technology
Panoramic video refers to the scene that a point of observation surrounding is all in space, the institute that can be received by this point of observation
There is light composition.Panoramic video can be abstracted into a spherical surface centered on point of observation.
When active computer handles panoramic video, discretized space inevitably is carried out to panoramic video and is adopted
Sample.It when carrying out discretized space sampling to panoramic video, needs to ensure certain space sampling densities, needed for reaching
Clarity.Meanwhile considering that the memory of computer is not suitable for the data of storage spherical structure again, it needs in some way
Sampled point is aligned in plane.
The existing spherical surface method of sampling, is usually divided into three steps by spherical surface sampling process：The first step, mapping, spherical Map
For a region in plane；Second step, plane sampling, designs the distribution side of sampled point based on the plane domain after mapping
Formula；Third walks, and sampled point is arranged as a rectangle by arrangement.
During the first step maps, the ratio that the different zones of spherical surface are accumulated below before the mapping is different.Second
During walking plane sampling, often sampled point is designed to be uniformly distributed in plane domain in the mapped.The first step and
Second step combines, and will result in sampled point being unevenly distributed on spherical surface.Some area sampling points are closeer, some areas
Domain sampled point is diluter.The spatial resolution reached is finally sampled, is to be subject to the most sparse region of spherical surface up-sampling point.Cause
This, under conditions of given spatial resolution, uneven distribution of the sampled point on spherical surface can bring redundancy.And it is walked in third
In, rectangular in order to arrange, the position distribution of sampled point has happened change, this is just lost phase of the sampled point on spherical surface
Adjacent relationship is unfavorable for subsequent predictive coding.
Currently, there are three types of the common spherical surface method of samplings：Longitude and latitude figure samples, hexahedron sampling and pyramid sampling.
Longitude and latitude figure samples as shown in Fig. 2, any one point can use residing longitude θ and latitude on spherical surfaceDescription, θ ∈
[0,2 π),It then can be by spherical Map to θThe next the ratio of width to height of coordinate system is 2:1 square
Shape.Uniform sampling is carried out to this rectangle.Longitude and latitude figure method of sampling sampling density near the two poles of the earth of spherical surface is excessively high, will produce very
Big redundancy.
Hexahedron samples as shown in figure 3, first by six faces that spherical Map is its circumscribed regular hexahedron, to obtain six
A plane square, then uniform sampling is carried out to six plane squares, six squares are finally combined into one by some way
A rectangle.Distribution of the sampled point of hexahedron sampling on spherical surface is also non-uniform, still remains larger redundancy.
Pyramid samples as shown in figure 4, be first a circumscribed positive rectangular pyramid by spherical Map, then by the every of the positive rectangular pyramid
A side (isosceles triangle) is compressed along the direction of bottom edge vertical line, until apex angle becomes at a right angle.Bottom surface and four warps in this way
A square can be just combined by crossing the side of Quadratic Map.Uniform sampling finally is carried out to this square.Pyramid samples
Distribution of the sampled point on spherical surface be also non-uniform, degree of irregularity samples it between the sampling of longitude and latitude figure and hexahedron
Between, degree of redundancy is also between the sampling of longitude and latitude figure and hexahedron sampling.
In conclusion the major defect of the existing panoramic video method of sampling is that there are larger sampling structure redundancies.It adopts
Sampling point uneven distribution on spherical surface can not only bring sampling redundancy, and returning video quality evaluation makes troubles, because final
The corresponding area of spherical surface of sampled point is different, therefore influence of the distortion of each sampled point to video quality is also different,
Calculate panoramic video by certain processing, such as it is compressed and decompressed after mass loss when, it is necessary to consider that each sampled point
Importance be different.
Invention content
In order to overcome the deficiencies of the above existing technologies, purpose of the present invention is to provide a kind of panoramic videos to be based on slope
Block sampling method and device can make distribution of the sampled point on spherical surface meet equator sampling number more, the two poles of the earth
Neighbouring sampling number is less, so as to avoid sampling structure redundancy so that under conditions of reaching identical spatial resolution, adopt
Number of samples is reduced, moreover, the rectangle being combined into has higher content adjacency, can improve coding compression efficiency.
In view of the above and other objects, the present invention proposes that a kind of panoramic video is based on slope block sampling method, including such as
Lower step：
Step 1 is unfolded, it can be seen that the expansion on spherical surface at different latitude as shown in figure 5, spherical surface is tiled along weft
Width changes with latitude and is changed, most wide at equator, most narrow at the two poles of the earth.It is straight that two dimension is generated using the center after development of a sphere as origin
Angular coordinate system；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value model from left to right
Enclose and be [- π, π ], it is corresponding with the longitude on spherical surface；It is vertical sit with the line of the point of the point after development of a sphere bottom to the top
Parameter, value range from top to bottom areIt is corresponding with the latitude on spherical surface；Meanwhile development of a sphere back can be obtained
The slope k of edge curve L.
Step 2, as shown in fig. 6, with weft W1、W2、W3、W4The spherical surface of expansion is divided into 5 regions, by from top to bottom
It is followed successively by Oi, i=0,1,2,3,4.
Step 3 is arranged according to the value range of the boundary curve slope k of each region after segmentation for each region
Fixed slope.Wherein region O0Left hand edge slope be set asRight hand edge slope isO1Left hand edge slope is set as 1, the right
Edge slope is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge slope is 1；
O4Left hand edge slope is set asRight hand edge slope isThen shape of each region after over-sampling is obtained according to the slope,
As shown in Figure 7.
Step 4 is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is sampled, is adopted
Shape after sample is as shown in step 3.
Step 5, is rectangle by the graphical arrangement after sampling, and aligning method is as shown in Figure 8.
Further, in the above-mentioned methods, in step 1, boundary curve L is in the oblique of the part of second, third quadrant
RateWherein y is latitude；And boundary curve L is in the slope of the part of first, fourth quadrantWherein y is latitude.
Further, in the above-mentioned methods, in step 2, weft W1,W2Residing latitude is more than zero, W1In W2On；
Weft W3,W4Residing latitude is less than zero, W3In W4On.And weft W1,W2,W3,W4Residing latitude YW1,YW2,YW3,YW4Meet
The following conditions：
Further, in the above-mentioned methods, in step 3, each region is all after over-sampling, O0Lower boundary and O1It is upper
The length on boundary is not necessarily identical, O1Lower boundary and O2Coboundary length it is centainly identical, O2Lower boundary and O3Top
The length on boundary is centainly identical, O3Lower boundary and O4Coboundary length it is not necessarily identical.
Further, in the above-mentioned methods, in step 4, it is in the region O of spherical surface equator2Lateral sampled point it
With for M；O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point is N.
Further, in the above-mentioned methods, in step 5, in spliced rectangle, former region O0In rectangle
Upper-right position, and the pixel of its edge and peripheral region are non-conterminous；Former region O4Bottom-right location in rectangle, and its side
Pixel and peripheral region at edge is non-conterminous；Former region O1Top-left position in rectangle；Former region O3Lower-left in rectangle
Position；Former region O2Middle position in rectangle.The width of spliced rectangle is M, is highly N.
Further, in the above-mentioned methods, this method further includes：It is required according to spatial resolution, in storage, is remembered first
N and M is recorded, M is region O2The sum of lateral sampled point；N is O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point；Then by gained
The data of all sampled points form a line in the following order：(0,0),(0,1),...,(0,M-1),(1,0),(1,
1),...,(1,M-1),...,(N-1,0),(N-1,1),...,(N-1,M-1)。
Further, in the above-mentioned methods, this method further includes：When being shown in flat-panel screens, by the sampling of gained
Point data is arranged in the rectangular area of a N row, M row, and is the alignment of data of (i, 0), other data by each row number
It is arranged in order.
In order to achieve the above objectives, the present invention also provides a kind of panoramic videos to be based on slope block sampling device, is applied to upper
The method of stating operates with, including：
Development of a sphere unit is unfolded as shown in figure 5, spherical surface is tiled along weft, it can be seen that on spherical surface at different latitude
Spreading width change with latitude and change, it is most wide at equator, it is most narrow at the two poles of the earth.It is generated by origin of the center after development of a sphere
Two-dimensional Cartesian coordinate system；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, from left to right
Value range is [- π, π], corresponding with the longitude on spherical surface；With the line of the point of the point after development of a sphere bottom to the top
For axis of ordinates, value range from top to bottom isIt is corresponding with the latitude on spherical surface；Meanwhile spherical surface can be obtained
The slope k of back edge curve L is unfolded；
Spherical surface cutting unit, as shown in fig. 6, with weft W1、W2、W3、W4The spherical surface of expansion is divided into 5 regions, by from
Top to bottm is followed successively by Oi, i=0,1,2,3,4；
Slope allocation unit is each region according to the value range of the boundary curve slope k of each region after segmentation
Fixed slope is all set.Wherein region O0Left hand edge slope be set asRight hand edge slope isO1Left hand edge slope is set as
1, right hand edge slope is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge is oblique
Rate is 1；O4Left hand edge slope is set asRight hand edge slope isThen each region is obtained after over-sampling according to the slope
Shape, as shown in Figure 7；
Sampled value computing unit, requires according to spatial resolution, and to including Oi, i=0,1,2,3,4 each region carries out
Sampling, the shape after sampling is as shown in step 3；
Rearrangement unit, is rectangle by the graphical arrangement after sampling, and aligning method is as shown in Figure 8.
Further, in above-mentioned apparatus, the development of a sphere unit, boundary curve L is in the portion of second, third quadrant
The slope dividedWherein y is latitude；And boundary curve L is in the slope of the part of first, fourth quadrantWherein y is latitude；
Further, in above-mentioned apparatus, the spherical surface cutting unit, weft W1,W2Residing latitude is more than zero, W1?
W2On；Weft W3,W4Residing latitude is less than zero, W3In W4On.And weft W1,W2,W3,W4Residing latitude YW1,YW2,YW3,
YW4Meet the following conditions：
Further, in above-mentioned apparatus, the slope allocation unit, each region is all after over-sampling, O0Lower boundary
And O1Coboundary length it is not necessarily identical, O1Lower boundary and O2Coboundary length it is centainly identical, O2Lower boundary and
O3Coboundary length it is centainly identical, O3Lower boundary and O4Coboundary length it is not necessarily identical；
Further, in above-mentioned apparatus, the sampled value computing unit is in the region O of spherical surface equator2Laterally
The sum of sampled point is M；O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point is N；
Further, in above-mentioned apparatus, the rearrangement unit, in spliced rectangle, former region O0In square
The upper-right position of shape, and the pixel of its edge and peripheral region are non-conterminous；Former region O4Bottom-right location in rectangle, and
The pixel of its edge and peripheral region are non-conterminous；Former region O1Top-left position in rectangle；Former region O3In rectangle
Lower left position；Former region O2Middle position in rectangle.The width of spliced rectangle is M, is highly N；
Further, further include memory module in above-mentioned apparatus, for being required according to spatial resolution, in storage,
N and M is recorded first, and M is region O2The sum of lateral sampled point；N is O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point；Then
The data of all sampled points of gained are formed a line in the following order：(0,0),(0,1),...,(0,M-1),(1,0),
(1,1),...,(1,M-1),...,(N-1,0),(N-1,1),...,(N-1,M-1)。
Further, further include display module in above-mentioned apparatus, when for being shown in flat-panel screens, by gained
Sample point data be arranged in a N row, M row rectangular area in, and by each row number be (i, 0) alignment of data,
He is arranged in order data.
Compared with prior art, the present invention has obvious prominent substantive distinguishing features and notable technological progress：This hair
Bright panoramic video is based on slope block sampling method and device, reduces sampling structure redundancy so that reaching identical space
Under conditions of clarity, sampling number is few, and the data volume after sampling is small, and compression efficiency is high.
Description of the drawings
Fig. 1 is the method for sampling program chart of the present invention.
Fig. 2 is the schematic diagram that longitude and latitude figure samples in the prior art spherical surface method of sampling.
Fig. 3 is the schematic diagram that hexahedron samples in the prior art spherical surface method of sampling.
Fig. 4 is the lab diagram that pyramid samples in the prior art spherical surface method of sampling.
Fig. 5 is a kind of schematic diagram of the panoramic video based on slope block sampling method development of a sphere of the present invention.
Fig. 6 is a kind of panoramic video of the present invention based on the signal divided by weft after slope block sampling method development of a sphere
Figure.
Fig. 7 be a kind of panoramic video of the present invention be based on each region after the segmentation of slope block sampling method spherical surface determine slope with
The schematic diagram of shape after sampling.
Fig. 8 lists intention for image rearrangement after a kind of sampling of the panoramic video based on slope block sampling method of the present invention.
Specific implementation mode
In order to make the foregoing objectives, features and advantages of the present invention clearer and more comprehensible, below by way of the preferred of the present invention
Simultaneously the present invention is described with reference to the drawings in embodiment.
Embodiment one：Referring to Fig. 5~Fig. 8, this panoramic video is based on slope block sampling method, which is characterized in that operation
Steps are as follows：
Spherical surface is tiled along weft and is unfolded, it can be seen that the spreading width on spherical surface at different latitude is with latitude by step 1
Change and changes, it is most wide at equator, it is most narrow at the two poles of the earth.Two-dimensional Cartesian coordinate system is generated by origin of the center after development of a sphere；
Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value range from left to right be [- π,
π], it is corresponding with the longitude on spherical surface；Using the line of the point of the point after development of a sphere bottom to the top as axis of ordinates, under
It is [- pi/2, pi/2] to upper value range, it is corresponding with the latitude on spherical surface；Meanwhile development of a sphere back edge curve can be obtained
The slope k of L；
The spherical surface of expansion is divided into 5 regions by step 2 with weft W1, W2, W3, W4, by being followed successively by Oi from top to bottom,
I=0,1,2,3,4；
Step 3 is arranged according to the value range of the boundary curve slope k of each region after segmentation for each region
Fixed slope；Wherein the left hand edge slope of region O0 is set as 1/4, and right hand edge slope is -1/4；O1 left hand edge slopes are set as 1,
Right hand edge slope is -1；O2 left hand edge slopes are set as ∞, and right hand edge slope is ∞；O3 left hand edge slopes are set as -1, and right hand edge is oblique
Rate is 1；O4 left hand edge slopes are set as -1/4, and right hand edge slope is 1/4；Then each region is obtained through over-sampling according to the slope
Shape afterwards.
Step 4 is required according to spatial resolution, and to including Oi, i=0,1,2,3,4 each region is sampled, adopted
Shape after sample is as shown in step 3；
Graphical arrangement after sampling is rectangle by step 5.
Embodiment two：This panoramic video is based on slope block sampling device, is operated with applied to the above method, feature
It is, including：
Development of a sphere unit：Spherical surface is tiled along weft and is unfolded, it can be seen that the spreading width on spherical surface at different latitude
Change with latitude and changes, it is most wide at equator, it is most narrow at the two poles of the earth.Two-dimentional right angle is generated using the center after development of a sphere as origin to sit
Mark system；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value range from left to right is
[- π, π], it is corresponding with the longitude on spherical surface；Using the line of the point of the point after development of a sphere bottom to the top as axis of ordinates,
Value range from top to bottom is [- pi/2, pi/2], corresponding with the latitude on spherical surface；Meanwhile development of a sphere back edge can be obtained
The slope k of curve L；
Spherical surface cutting unit：The spherical surface of expansion is divided into 5 regions with weft W1, W2, W3, W4, by from top to bottom according to
It is secondary be Oi, i=0,1,2,3,4；
Slope allocation unit：It is each region according to the value range of the boundary curve slope k of each region after segmentation
Fixed slope is all set.Wherein the left hand edge slope of region O0 is set as 1/4, and right hand edge slope is -1/4；O1 left hand edge slopes
It is set as 1, right hand edge slope is -1；O2 left hand edge slopes are set as ∞, and right hand edge slope is ∞；O3 left hand edge slopes are set as -1, the right side
Edge slope is 1；O4 left hand edge slopes are set as -1/4, and right hand edge slope is 1/4.Then each region warp is obtained according to the slope
Shape after over-sampling；
Sampled value computing unit：It is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region carries out
Sampling, the shape after sampling is as shown in step 3；
Rearrangement unit：It is rectangle by the graphical arrangement after sampling.
Embodiment three：It is as follows that this panoramic video is based on slope block sampling method：
With one with resolution ratio be 4096 × 2048 longitude and latitude figure indicate panoramic video wherein piece image, in the present invention
In specific embodiment, which is color video, and there are three components for tool.Assuming that used color component is RGB, sampling
The color of each sampled point is still indicated with RGB afterwards.Assuming that three components of the requirement pair of spatial resolution are identical, all it is N
=1368, M=3456, quantified precision requirement is also identical to each component, is all to be quantified as 256 grades.Then to each component,
It repeats following steps one and arrives step 5：
Step 1 is unfolded, it can be seen that the expansion on spherical surface at different latitude as shown in figure 5, spherical surface is tiled along weft
Width changes with latitude and is changed, most wide at equator, most narrow at the two poles of the earth.It is straight that two dimension is generated using the center after development of a sphere as origin
Angular coordinate system；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value model from left to right
It is [- π, π] to enclose, corresponding with the longitude on spherical surface；It is vertical sit with the line of the point of the point after development of a sphere bottom to the top
Parameter, value range from top to bottom is [- pi/2, pi/2], corresponding with the latitude on spherical surface；Meanwhile development of a sphere can be obtained
Back edge curve L is in the slope of the part of second, third quadrantWherein y is latitude；And at boundary curve L
Slope in the part of first, fourth quadrantWherein y is latitude.
Step 2, as shown in fig. 6, respectively being with latitudeWithWeft W1、
W2、W3、W4The spherical surface of expansion is divided into 5 regions, by being followed successively by O from top to bottomi, i=0,1,2,3,4.
Step 3 is arranged according to the value range of the boundary curve slope k of each region after segmentation for each region
Fixed slope.Wherein region O0Left hand edge slope be set as 1/4, right hand edge slope is -1/4；O1Left hand edge slope is set as 1, the right side
Edge slope is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge slope is
1；O4Left hand edge slope is set as -1/4, and right hand edge slope is 1/4.Then each region is obtained after over-sampling according to the slope
Shape, as shown in Figure 7.
Step 4 is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is sampled, is adopted
In shape such as step 3 after sample shown in Fig. 7.Wherein, it is in the region O of spherical surface equator2The sum of lateral sampled point is
3456；O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point is 1368.
Step 5, is rectangle by the graphical arrangement after sampling, and aligning method is as shown in Figure 8.It is former in spliced rectangle
Region O0Upper-right position in rectangle, and the pixel of its edge and peripheral region are non-conterminous；Former region O4In rectangle
Bottom-right location, and the pixel of its edge and peripheral region are non-conterminous；Former region O1Top-left position in rectangle；Former region
O3Lower left position in rectangle；Former region O2Middle position in rectangle.The width of spliced rectangle is 3456, height
It is 1368.
In storage, the line number 1368 of each component samples and often capable sampling number 3456 are recorded first；Then by institute
The data of all sampled points obtained form a line in the following order：(0,0),(0,1),...,(0,3455),(1,0),(1,
1),...,(1,3455),...,(1367,0),(1367,1),...,(1367,3455).Three components of the same sampled point
According to B, G's, R is ranked sequentially.
When being shown in flat-panel screens, the sample point data of gained is arranged in the rectangle of 1368 rows, 3456 row
In region, and by the alignment of data that each row number is (i, 0), other data are arranged in order.
Example IV：It is as follows that this panoramic video is based on slope block sampling method：
With one with resolution ratio be 4096 × 2048 longitude and latitude figure indicate panoramic video wherein piece image, in the present invention
In specific embodiment, which is color video, and there are three components for tool.Assuming that used color component is YcbCr, adopt
Sample ratio is 4:4:4, the color of each sampled point is still indicated after sampling with YCbCr.Assuming that the requirement of spatial resolution is to Y points
Amount is N=1368, M=3456, is N=684 to Cb and Cr components, M=1728, quantified precision requirement is identical to each component
, all it is to be quantified as 256 grades.
Then to Y-component, following steps are carried out：
Step 1 is unfolded, it can be seen that the expansion on spherical surface at different latitude as shown in figure 5, spherical surface is tiled along weft
Width changes with latitude and is changed, most wide at equator, most narrow at the two poles of the earth.It is straight that two dimension is generated using the center after development of a sphere as origin
Angular coordinate system；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value model from left to right
It is [- π, π] to enclose, corresponding with the longitude on spherical surface；It is vertical sit with the line of the point of the point after development of a sphere bottom to the top
Parameter, value range from top to bottom is [- pi/2, pi/2], corresponding with the latitude on spherical surface；Meanwhile development of a sphere can be obtained
Back edge curve L is in the slope of the part of second, third quadrantWherein y is latitude；And at boundary curve L
Slope in the part of first, fourth quadrantWherein y is latitude.
Step 2, as shown in fig. 6, respectively being with latitudeWithWeft W1、
W2、W3、W4The spherical surface of expansion is divided into 5 regions, by being followed successively by O from top to bottomi, i=0,1,2,3,4.
Step 3 is arranged according to the value range of the boundary curve slope k of each region after segmentation for each region
Fixed slope.Wherein region O0Left hand edge slope be set as 1/4, right hand edge slope is -1/4；O1Left hand edge slope is set as 1, the right side
Edge slope is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge slope is
1；O4Left hand edge slope is set as -1/4, and right hand edge slope is 1/4.Then each region is obtained after over-sampling according to the slope
Shape, as shown in Figure 7.
Step 4 is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is sampled, is adopted
In shape such as step 3 after sample shown in Fig. 7.Wherein, it is in the region O of spherical surface equator2The sum of lateral sampled point is
3456；O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point is 1368.
Step 5, is rectangle by the graphical arrangement after sampling, and aligning method is as shown in Figure 8.It is former in spliced rectangle
Region O0Upper-right position in rectangle, and the pixel of its edge and peripheral region are non-conterminous；Former region O4In rectangle
Bottom-right location, and the pixel of its edge and peripheral region are non-conterminous；Former region O1Top-left position in rectangle；Former region
O3Lower left position in rectangle；Former region O2Middle position in rectangle.The width of spliced rectangle is 3456, height
It is 1368.
Then to Cb and Cr components, following steps are carried out respectively：
Step 1 is unfolded, it can be seen that the expansion on spherical surface at different latitude as shown in figure 5, spherical surface is tiled along weft
Width changes with latitude and is changed, most wide at equator, most narrow at the two poles of the earth.It is straight that two dimension is generated using the center after development of a sphere as origin
Angular coordinate system；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value model from left to right
It is [- π, π] to enclose, corresponding with the longitude on spherical surface；It is vertical sit with the line of the point of the point after development of a sphere bottom to the top
Parameter, value range from top to bottom is [- pi/2, pi/2], corresponding with the latitude on spherical surface；Meanwhile development of a sphere can be obtained
Back edge curve L is in the slope of the part of second, third quadrantWherein y is latitude；And at boundary curve L
Slope in the part of first, fourth quadrantWherein y is latitude.
Step 2, as shown in fig. 6, respectively being with latitudeWithWeft W1、
W2、W3、W4The spherical surface of expansion is divided into 5 regions, by being followed successively by O from top to bottomi, i=0,1,2,3,4.
Step 3 is arranged according to the value range of the boundary curve slope k of each region after segmentation for each region
Fixed slope.Wherein region O0Left hand edge slope be set as 1/4, right hand edge slope is -1/4；O1Left hand edge slope is set as 1, the right side
Edge slope is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge slope is
1；O4Left hand edge slope is set as -1/4, and right hand edge slope is 1/4.Then each region is obtained after over-sampling according to the slope
Shape, as shown in Figure 7.
Step 4 is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is sampled, is adopted
In shape such as step 3 after sample shown in Fig. 7.Wherein, it is in the region O of spherical surface equator2The sum of lateral sampled point is
1728；O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point is 684.
Step 5, is rectangle by the graphical arrangement after sampling, and aligning method is as shown in Figure 8.It is former in spliced rectangle
Region O0Upper-right position in rectangle, and the pixel of its edge and peripheral region are non-conterminous；Former region O4In rectangle
Bottom-right location, and the pixel of its edge and peripheral region are non-conterminous；Former region O1Top-left position in rectangle；Former region
O3Lower left position in rectangle；Former region O2Middle position in rectangle.The width of spliced rectangle is 1728, height
It is 684.
In storage, the line number 1368 of Y-component sampling and often capable sampling number 3456 are recorded first, Cb component samples
Line number 684 and often capable sampling number 1728, the line number 684 of Cr component samples and often capable sampling number 1728.Then by institute
The data of the Y-component sampled point obtained form a line in the following order：(0,0),(0,1),...,(0,3455),(1,0),(1,
1),...,(1,3455),...,(1367,0),(1367,1),...,(1367,3455).Behind the data of Y-component sampled point
The data of the Cb component samples points of gained are formed a line in the following order：(0,0),(0,1),...,(0,1727),(1,
0),(1,1),...,(1,1727),...,(683,0),(683,1),...,(683,1727).In the data of Cb component samples points
The data of the Cr component samples points of gained are formed a line in the following order below：(0,0),(0,1),...,(0,1727),
(1,0),(1,1),...,(1,1727),...,(683,0),(683,1),...,(683,1727)。
In conclusion a kind of panoramic video of the present invention is based on slope block sampling method and device, to reduce sampling structure superfluous
It is remaining, maintain neighbouring relations of the sampled point on spherical surface so that under conditions of reaching identical spatial resolution, sampling number
Few, the data volume after sampling is small, and compression efficiency is high.
Each embodiment is described by the way of progressive in this specification, the highlights of each of the examples are with other
The difference of embodiment, just to refer each other for identical similar portion between each embodiment.
Professional further appreciates that, unit described in conjunction with the examples disclosed in the embodiments of the present disclosure
And algorithm steps, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and
The interchangeability of software generally describes each exemplary composition and step according to function in the above description.These
Function is implemented in hardware or software actually, depends on the specific application and design constraint of technical solution.Profession
Technical staff can use different methods to achieve the described function each specific application, but this realization is not answered
Think beyond the scope of this invention.
Obviously, those skilled in the art can carry out invention spirit of the various modification and variations without departing from the present invention
And range.If in this way, these modifications and changes of the present invention belong to the claims in the present invention and its equivalent technologies range it
Interior, then the present invention is also intended to including these modification and variations.
Claims (16)
1. a kind of panoramic video is based on slope block sampling method, which is characterized in that operating procedure is as follows：
Spherical surface is tiled along weft and is unfolded, it can be seen that the spreading width on spherical surface at different latitude changes with latitude by step 1
And change, it is most wide at equator, it is most narrow at the two poles of the earth；Two-dimensional Cartesian coordinate system is generated by origin of the center after development of a sphere；With ball
The line of leftmost point to the point of rightmost is axis of abscissas after the expansion of face, and value range from left to right is [- π, π], with
Longitude on spherical surface corresponds to；Using the line of the point of the point after development of a sphere bottom to the top as axis of ordinates, from top to bottom
Value range beIt is corresponding with the latitude on spherical surface；Meanwhile the slope of development of a sphere back edge curve L can be obtained
k；
Step 2, with weft W1、W2、W3、W4The spherical surface of expansion is divided into 5 regions, by being followed successively by O from top to bottomi, i=0,
1,2,3,4；
Fixation is arranged for each region according to the value range of the boundary curve slope k of each region after segmentation in step 3
Slope；Wherein region O0Left hand edge slope be set asRight hand edge slope isO1Left hand edge slope is set as 1, and right hand edge is oblique
Rate is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge slope is 1；O4It is left
Edge slope is set asRight hand edge slope isThen shape of each region after over-sampling is obtained according to the slope；
Step 4 is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is sampled, after sampling
Shape is as shown in step 3；
Graphical arrangement after sampling is rectangle by step 5.
2. panoramic video as described in claim 1 is based on slope block sampling method, it is characterised in that：In the step 1,
Boundary curve L is in the slope of the part of second, third quadrantWherein y is latitude；And boundary curve L is in
The first, the slope of the part of fourth quadrantWherein y is latitude.
3. panoramic video as claimed in claim 2 is based on slope block sampling method, it is characterised in that：In the step 2,
Weft W1,W2Residing latitude is more than zero, W1In W2On；Weft W3,W4Residing latitude is less than zero, W3In W4On；And weft
W1,W2,W3,W4Residing latitude YW1,YW2,YW3,YW4Meet the following conditions：
4. panoramic video as claimed in claim 3 is based on slope block sampling method, it is characterised in that：In the step 3,
Each region is all after over-sampling, O0Lower boundary and O1Coboundary length it is not necessarily identical, O1Lower boundary and O2Top
The length on boundary is centainly identical, O2Lower boundary and O3Coboundary length it is centainly identical, O3Lower boundary and O4Coboundary
Length is not necessarily identical.
5. panoramic video as claimed in claim 4 is based on slope block sampling method, it is characterised in that：In the step 4,
Region O in spherical surface equator2The sum of lateral sampled point is M；O1With O2、O3The sum of totally 3 regions longitudinal direction sampled point is N.
6. panoramic video as claimed in claim 5 is based on slope block sampling method, it is characterised in that：In the step 5,
In spliced rectangle, former region O0Upper-right position in rectangle, and the pixel of its edge and peripheral region not phase
It is adjacent；Former region O4Bottom-right location in rectangle, and the pixel of its edge and peripheral region are non-conterminous；Former region O1It is in
The top-left position of rectangle；Former region O3Lower left position in rectangle；Former region O2Middle position in rectangle；It is spliced
The width of rectangle is M, is highly N.
7. panoramic video as claimed in claim 6 is based on slope block sampling method, it is characterised in that：According to spatial resolution
It is required that in storage, N and M is recorded first, and M is region O2The sum of lateral sampled point；N is O1With O2、O3Totally 3 regions are longitudinally adopted
The sum of sampling point；Then the data of all sampled points of gained are formed a line in the following order：(0,0),(0,1),...,(0,
M-1),(1,0),(1,1),...,(1,M-1),...,(N-1,0),(N-1,1),...,(N-1,M-1)。
8. panoramic video as claimed in claim 7 is based on slope block sampling method, it is characterised in that：In flat-panel screens
When display, the sample point data of gained is arranged in the rectangular area of a N row, M row, and is (i, 0) by each row number
Alignment of data, other data are arranged in order.
9. a kind of panoramic video is based on slope block sampling device, it is based on applied to panoramic video according to claim 1
Slope block sampling method operates with, which is characterized in that including：
Development of a sphere unit：Spherical surface is tiled along weft and is unfolded, it can be seen that the spreading width on spherical surface at different latitude is with latitude
Degree changes and changes, most wide at equator, most narrow at the two poles of the earth；Two-dimentional rectangular co-ordinate is generated by origin of the center after development of a sphere
System；Using the line of leftmost point after development of a sphere to the point of rightmost as axis of abscissas, value range from left to right be [-
π, π], it is corresponding with the longitude on spherical surface；Using the line of the point of the point after development of a sphere bottom to the top as axis of ordinates, from
Under to upper value range beIt is corresponding with the latitude on spherical surface；Meanwhile development of a sphere back edge curve can be obtained
The slope k of L；
Spherical surface cutting unit：With weft W1、W2、W3、W4The spherical surface of expansion is divided into 5 regions, by being followed successively by O from top to bottomi,
I=0,1,2,3,4；
Slope allocation unit：According to the value range of the boundary curve slope k of each region after segmentation, set for each region
Set fixed slope；Wherein region O0Left hand edge slope be set asRight hand edge slope isO1Left hand edge slope is set as 1, the right side
Edge slope is -1；O2Left hand edge slope is set as ∞, and right hand edge slope is ∞；O3Left hand edge slope is set as -1, and right hand edge slope is
1；O4Left hand edge slope is set asRight hand edge slope isThen shape of each region after over-sampling is obtained according to the slope
Shape；
Sampled value computing unit：It is required according to spatial resolution, to including Oi, i=0,1,2,3,4 each region is adopted
Sample, the shape after sampling is as shown in step 3；
Rearrangement unit：It is rectangle by the graphical arrangement after sampling.
10. panoramic video as claimed in claim 9 is based on slope block sampling device, which is characterized in that the development of a sphere
Unit：Boundary curve L is in the slope of the part of second, third quadrantWherein y is latitude；And boundary curve L
Slope in the part of first, fourth quadrantWherein y is latitude.
11. panoramic video as claimed in claim 10 is based on slope block sampling device, which is characterized in that the spherical surface segmentation
Unit：Weft W1,W2Residing latitude is more than zero, W1In W2On；Weft W3,W4Residing latitude is less than zero, W3In W4On,
And weft W1,W2,W3,W4Residing latitude YW1,YW2,YW3,YW4Meet the following conditions：
12. panoramic video as claimed in claim 11 is based on slope block sampling device, which is characterized in that the slope distribution
Unit：Each region is all after over-sampling, O0Lower boundary and O1Coboundary length it is not necessarily identical, O1Lower boundary and O2
Coboundary length it is centainly identical, O2Lower boundary and O3Coboundary length it is centainly identical, O3Lower boundary and O4It is upper
The length on boundary is not necessarily identical.
13. panoramic video as claimed in claim 12 is based on slope block sampling device, which is characterized in that the sampled value meter
Calculate unit：Region O in spherical surface equator2The sum of lateral sampled point is M；O1With O2、O3Totally 3 regions longitudinal direction sampled point
The sum of be N.
14. panoramic video as claimed in claim 13 is based on slope block sampling device, which is characterized in that the rearrangement list
Member：In spliced rectangle, former region O0Upper-right position in rectangle, and the pixel of its edge and peripheral region are not
It is adjacent；Former region O4Bottom-right location in rectangle, and the pixel of its edge and peripheral region are non-conterminous；Former region O1Place
In the top-left position of rectangle；Former region O3Lower left position in rectangle；Former region O2Middle position in rectangle；After splicing
Rectangle width be M, be highly N.
15. panoramic video as claimed in claim 14 is based on slope block sampling device, which is characterized in that further include storage mould
Block：For being required according to spatial resolution, in storage, N and M is recorded first, M is region O2The sum of lateral sampled point；N is O1
With O2、O3The sum of totally 3 regions longitudinal direction sampled point；Then the data of all sampled points of gained are lined up one in the following order
Row：(0,0),(0,1),...,(0,M-1),(1,0),(1,1),...,(1,M-1),...,(N-1,0),(N-1,1),...,
(N-1,M-1)。
16. panoramic video as claimed in claim 15 is based on slope block sampling device, which is characterized in that further include display mould
Block：When for being shown in flat-panel screens, the sample point data of gained is arranged in the rectangular area of a N row, M row,
And by the alignment of data that each row number is (i, 0), other data are arranged in order.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810544637.5A CN108769680B (en) | 2018-05-31 | 2018-05-31 | Slope-based segmented sampling method and device for panoramic video |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810544637.5A CN108769680B (en) | 2018-05-31 | 2018-05-31 | Slope-based segmented sampling method and device for panoramic video |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108769680A true CN108769680A (en) | 2018-11-06 |
| CN108769680B CN108769680B (en) | 2021-02-23 |
Family
ID=64000855
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810544637.5A Expired - Fee Related CN108769680B (en) | 2018-05-31 | 2018-05-31 | Slope-based segmented sampling method and device for panoramic video |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108769680B (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104217459A (en) * | 2014-09-04 | 2014-12-17 | 天津大学 | Spherical feature extraction method |
| US20150264259A1 (en) * | 2014-03-17 | 2015-09-17 | Sony Computer Entertainment Europe Limited | Image processing |
| CN105335748A (en) * | 2014-08-07 | 2016-02-17 | 株式会社理光 | Image feature extraction method and system |
| CN106210716A (en) * | 2016-08-01 | 2016-12-07 | 上海国茂数字技术有限公司 | A kind of panoramic video isodensity method of sampling and device |
| CN106488233A (en) * | 2016-10-31 | 2017-03-08 | 上海国茂数字技术有限公司 | A kind of panoramic video rhombus method of sampling and device |
| CN106658009A (en) * | 2016-12-29 | 2017-05-10 | 上海国茂数字技术有限公司 | Improved double-ring sampling method and device for panoramic video |
| CN106791840A (en) * | 2016-12-29 | 2017-05-31 | 上海国茂数字技术有限公司 | A kind of bicyclic band method of sampling and device of panoramic video |
| CN106899840A (en) * | 2017-03-01 | 2017-06-27 | 北京大学深圳研究生院 | Panoramic picture mapping method |
| CN106991642A (en) * | 2017-03-23 | 2017-07-28 | 上海国茂数字技术有限公司 | A kind of panoramic video octagonal method of sampling and device |
| CN107147910A (en) * | 2017-05-31 | 2017-09-08 | 上海国茂数字技术有限公司 | A kind of panoramic video hexagon method of sampling and device |
| CN107230180A (en) * | 2016-10-10 | 2017-10-03 | 华为技术有限公司 | A kind of mapping method of panoramic picture, device and equipment |
-
2018
- 2018-05-31 CN CN201810544637.5A patent/CN108769680B/en not_active Expired - Fee Related
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150264259A1 (en) * | 2014-03-17 | 2015-09-17 | Sony Computer Entertainment Europe Limited | Image processing |
| CN105335748A (en) * | 2014-08-07 | 2016-02-17 | 株式会社理光 | Image feature extraction method and system |
| CN104217459A (en) * | 2014-09-04 | 2014-12-17 | 天津大学 | Spherical feature extraction method |
| CN106210716A (en) * | 2016-08-01 | 2016-12-07 | 上海国茂数字技术有限公司 | A kind of panoramic video isodensity method of sampling and device |
| CN107230180A (en) * | 2016-10-10 | 2017-10-03 | 华为技术有限公司 | A kind of mapping method of panoramic picture, device and equipment |
| CN106488233A (en) * | 2016-10-31 | 2017-03-08 | 上海国茂数字技术有限公司 | A kind of panoramic video rhombus method of sampling and device |
| CN106658009A (en) * | 2016-12-29 | 2017-05-10 | 上海国茂数字技术有限公司 | Improved double-ring sampling method and device for panoramic video |
| CN106791840A (en) * | 2016-12-29 | 2017-05-31 | 上海国茂数字技术有限公司 | A kind of bicyclic band method of sampling and device of panoramic video |
| CN106899840A (en) * | 2017-03-01 | 2017-06-27 | 北京大学深圳研究生院 | Panoramic picture mapping method |
| CN106991642A (en) * | 2017-03-23 | 2017-07-28 | 上海国茂数字技术有限公司 | A kind of panoramic video octagonal method of sampling and device |
| CN107147910A (en) * | 2017-05-31 | 2017-09-08 | 上海国茂数字技术有限公司 | A kind of panoramic video hexagon method of sampling and device |
Non-Patent Citations (2)
| Title |
|---|
| 万亮等: "《等立方体球面映射》", 《计算机辅助设计与图形学学报》 * |
| 林畅等: "《全景视频双环带映射算法》", 《计算机应用》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108769680B (en) | 2021-02-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106488233B (en) | A kind of panoramic video diamond shape method of sampling and device | |
| CN106210716B (en) | A kind of panoramic video isodensity method of sampling and device | |
| TWI552109B (en) | A method, a non-transitory computer-readable storage medium and a system for conservative rasterization of primitives using an error term | |
| CN109377520B (en) | Heart image registration system and method based on semi-supervised circulation GAN | |
| WO2018040463A1 (en) | Data compression and decompression methods for demura table, and mura compensation method | |
| CN110543716B (en) | Three-dimensional overhead cable hierarchical power grid optimization method, device and computer equipment | |
| TWI637355B (en) | Methods of compressing a texture image and image data processing system and methods of generating a 360-degree panoramic video thereof | |
| CN106375760B (en) | A kind of panoramic video polygon method of sampling and device | |
| TW201435795A (en) | Consistent vertex snapping for variable resolution rendering | |
| CN110009561A (en) | A kind of monitor video target is mapped to the method and system of three-dimensional geographical model of place | |
| CN104574501A (en) | High-quality texture mapping method aiming at complicated three-dimensional scene | |
| Livny et al. | A GPU persistent grid mapping for terrain rendering | |
| US12106460B2 (en) | Information processing apparatus, information processing method, and non- transitory computer-readable storage medium | |
| CN106648510A (en) | Display method and device for display resolution | |
| CN104166992B (en) | Perception of content binocular image Zoom method based on distortion of the mesh | |
| CN109064391A (en) | A kind of panoramic picture processing method and panoramic picture processing unit | |
| CN107945151B (en) | Repositioning image quality evaluation method based on similarity transformation | |
| CN105957027B (en) | A kind of MRF sample block image repair methods based on required direction structure characteristic statistics | |
| CN106991642A (en) | A kind of panoramic video octagonal method of sampling and device | |
| CN108769680A (en) | A kind of panoramic video is based on slope block sampling method and device | |
| CN115239784A (en) | Point cloud generation method and device, computer equipment and storage medium | |
| CN107147910B (en) | A kind of panoramic video hexagon method of sampling and device | |
| CN106658009A (en) | Improved double-ring sampling method and device for panoramic video | |
| CN104346771B (en) | A kind of electronic map tiered management approach | |
| Wang et al. | Automatic geometry calibration for multi‐projector display systems with arbitrary continuous curved surfaces |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20210223 |