CN106157354B - A kind of three-dimensional scenic switching method and system - Google Patents
A kind of three-dimensional scenic switching method and system Download PDFInfo
- Publication number
- CN106157354B CN106157354B CN201510227642.XA CN201510227642A CN106157354B CN 106157354 B CN106157354 B CN 106157354B CN 201510227642 A CN201510227642 A CN 201510227642A CN 106157354 B CN106157354 B CN 106157354B
- Authority
- CN
- China
- Prior art keywords
- scene
- motion model
- viewpoint
- triangle gridding
- cloud data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention discloses a kind of three-dimensional scenic switching methods, comprising: is established only current scene and later scene in viewpoint triangle gridding motion model within the vision respectively based on the mobile message of viewpoint；The triangle gridding motion model established in real time is cut based on depth information, crops the triangle gridding of no point cloud data covering, and later scene is switched to from current scene based on the triangle gridding motion model after cutting.The invention also discloses a kind of three-dimensional scenic switching systems, using the present invention, so that the threedimensional model established more is simplified, so that the resource that switching system occupies greatly reduces, solves the technical problem that the switching system starting based on depth information is slow, mass motion is partially slow in the prior art, and can realize the triangle gridding motion model that texture mapping has been carried out by high-definition picture, fuzzy low-resolution image can only be used by solving texture mapping in the prior art.
Description
Technical field
The present invention relates to computer network communication fields more particularly to a kind of three-dimensional scenic switching method and three-dimensional scenic to cut
Change system.
Background technique
It is compared with traditional two-dimensional map, streetscape map is that the map of enhanced edition shows form.Pass through 360 degree for shooting
Outdoor scene photo display can give the most intuitive and accurate visual experience of user in map.The outdoor scene photo of streetscape shooting is interval
Certain distance shooting.When being roamed in streetscape, needs to be switched to another collection point from a collection point, different figures is presented
As data.In simulation of real scenes transformation, need to establish the threedimensional model of object in scene.Since the photo of streetscape shooting does not have
There is depth (distance) information, existing technology can be divided into the switching based on fixed model and the switching based on depth information.
Currently used fixed model when simulating to the movement of entire scene, can not accurately simulate real-world object
Movement；Schematic illustration in the prior art based on fixed model switching as shown in Figure 1, the upper and lower, left and right four of cuboid
A face respectively corresponds sky, ground, left facade and right facade in streetscape；However a part of ground and sky is divided into
Left and right facade, during the motion, these parts can mistake with left and right facade move.Also, switched based on fixed model
The distant relationships and three-dimensional sense of object in scene cannot be embodied, scape switching has mutation and hopping sense.
The switching based on fixed model there are aiming at the problem that, people develop the switching based on depth information, by swash
The three dimensional point cloud and image of photoscanner acquisition carry out fusion treatment, can obtain the depth information of objects in images.Base
In the threedimensional model that depth map is established, real scene can be more accurately described, realizes more natural scene switching.However, working as
It is preceding based on the switching system of depth information since the threedimensional model of foundation is complicated, occupy that resource is more, and texture mapping can only use mould
The low-resolution image of paste causes the image in the motion process switched over to show unintelligible, the prior art as shown in Figure 2
In based on depth information switching motion process effect diagram；And the switching system starting for being currently based on depth information is slow
Slowly, mass motion is partially slow.
Summary of the invention
The technical problem to be solved by the embodiment of the invention is that providing a kind of three-dimensional scenic switching method and three-dimensional scenic
Switching system, so that the resource that switching system occupies greatly reduces, improves switching system so that the threedimensional model established more is simplified
Performance.
In order to solve the above-mentioned technical problem, first aspect of the embodiment of the present invention discloses a kind of three-dimensional scenic switching method,
Include:
Based on the mobile message of viewpoint to current scene and later scene establish respectively only the viewpoint within sweep of the eye
Triangle gridding motion model；
The triangle gridding motion model established in real time is cut based on depth information, crops and does not put cloud number
Later scene is switched to from current scene according to the triangle gridding of covering, and based on the triangle gridding motion model after cutting.
With reference to first aspect, in the first possible implementation, the triangle gridding movement established in real time
Model is the triangle gridding motion model that texture mapping has been carried out by high-definition picture.
With reference to first aspect, in the second possible implementation, it is described based on the mobile message of viewpoint to working as front court
Scape and later scene are established only respectively before viewpoint triangle gridding motion model within the vision, further includes:
The point cloud data that will acquire is matched with panoramic picture, and obtaining in the panoramic picture has a cloud data cover
Pixel depth information；
There is a pixel for cloud data cover according in the panoramic picture, to the picture of no point cloud data covering
Vegetarian refreshments carries out interpolation processing, obtains the depth information of the pixel without point cloud data covering, and raw according to depth information
At depth map.
The possible implementation of second with reference to first aspect, it is in the third possible implementation, described in institute
State in panoramic picture has a pixel for cloud data cover according to, carries out interpolation to the pixel of no point cloud data covering
Processing, comprising:
Identification classification is carried out to the object in the panoramic picture；
Same category of object will be belonged to and carry out plane extraction, obtain belonging to the pixel in the plane of same category object
Point；
According to there is a pixel for cloud data cover in the plane for belonging to same category object, to it is described belong to it is same
The pixel for not having point cloud data to cover in the plane of classification object carries out interpolation processing.
The third possible implementation with reference to first aspect, in the fourth possible implementation, the basis
Depth information generates depth map
For the face index of plane where each pixel storage respectively in depth map, and travel compression is carried out, obtained
Compressed depth map.
The third possible implementation with reference to first aspect, in a fifth possible implementation, the foundation
Only include: in viewpoint triangle gridding motion model within the vision
It individually establishes only for different classes of object in viewpoint triangle gridding movement mould within the vision
Type.
Perhaps second of the first possible implementation of first aspect or first aspect with reference to first aspect
The 4th kind of possible implementation perhaps the third possible implementation of first aspect or first aspect is possible
5th kind of possible implementation of implementation or first aspect, it is in a sixth possible implementation, described to be based on
The triangle gridding motion model after cutting is switched to later scene from current scene and includes:
It is covered with the pixel of point cloud data in analysis scene, it is each to obtain the triangle gridding motion model intermediate cam shape
The three-dimensional coordinate on vertex；
Object is calculated in scene to the distance of the viewpoint according to the three-dimensional coordinate, knows in scene object to institute
State the distant relationships of viewpoint；
When being switched to later scene from current scene, object of which movement is simulated according to the distant relationships.
Second aspect of the embodiment of the present invention discloses a kind of three-dimensional scenic switching system, comprising:
Motion model establishes module, establishes respectively only for the mobile message based on viewpoint to current scene and later scene
In viewpoint triangle gridding motion model within the vision；
Module is cut, for being cut based on depth information to the triangle gridding motion model established in real time, is cut out
Cut the triangle gridding of no point cloud data covering；
Scene switching module, it is next for being switched to based on the triangle gridding motion model after cutting from current scene
Scene.
In conjunction with second aspect, in the first possible implementation, the motion model establishes what module was established in real time
The triangle gridding motion model is the triangle gridding motion model that texture mapping has been carried out by high-definition picture.
In conjunction with second aspect, in the second possible implementation, further includes:
Matching module, for establishing module based on the mobile message of viewpoint to current scene and next in the motion model
Scene establishes the point cloud data that only before viewpoint triangle gridding motion model within the vision, will acquire and complete respectively
Scape image is matched, and obtaining in the panoramic picture has a depth information for the pixel of cloud data cover；
Interpolation generation module, for there is a pixel for cloud data cover according in the panoramic picture, to not having
There is the pixel of a cloud data cover to carry out interpolation processing, the depth for obtaining the pixel without point cloud data covering is believed
Breath, and depth map is generated according to depth information.
In conjunction with second of possible implementation of second aspect, in the third possible implementation, the interpolation
Generation module includes:
Taxon is identified, for carrying out identification classification to the object in the panoramic picture；
Plane extraction unit carries out plane extraction for that will belong to same category of object, obtains belonging to same category object
Pixel in the plane of body；
Interpolating unit has a pixel for cloud data cover in the plane for belonging to same category object according to,
Interpolation processing is carried out to the pixel for not having point cloud data to cover in the plane for belonging to same category object.
In conjunction with the third possible implementation of second aspect, in the fourth possible implementation, the interpolation
Generation module further include:
Compression unit for the face index for plane where each pixel storage respectively in depth map, and carries out
Travel compression obtains compressed depth map.
In conjunction with the third possible implementation of second aspect, in a fifth possible implementation, the movement
Model building module is being established only in viewpoint triangle gridding motion model within the vision, is specifically included: for not
Generic object is individually established only in viewpoint triangle gridding motion model within the vision.
In conjunction with second of second aspect perhaps the first possible implementation of second aspect or second aspect
The 4th kind of possible implementation perhaps the third possible implementation of second aspect or second aspect is possible
5th kind of possible implementation of implementation or second aspect, in a sixth possible implementation, the scene
Switching module includes:
Obtaining unit is analyzed, for analyzing the pixel for being covered with point cloud data in scene, obtains the triangle gridding fortune
The three-dimensional coordinate on each vertex of movable model intermediate cam shape；
Unit is known in calculating, the distance for object in scene to be calculated to the viewpoint according to the three-dimensional coordinate,
Know in scene object to the distant relationships of the viewpoint；
Skimulated motion unit when for being switched to later scene from current scene, simulates object according to the distant relationships
Movement.
The third aspect of the embodiment of the present invention discloses a kind of computer storage medium, and the computer storage medium is stored with
Program, described program include the first possible realization side of first aspect of the embodiment of the present invention or first aspect when executing
Formula perhaps first aspect second of possible implementation perhaps the third possible implementation of first aspect or
5th kind of possible implementation or first party of the 4th kind of possible implementation of first aspect perhaps first aspect
The Overall Steps of three-dimensional scenic switching method in the 6th kind of possible implementation in face.
Implement the embodiment of the present invention, by establishing only in viewpoint triangle gridding motion model within the vision, and
The triangle gridding motion model established in real time is cut based on depth information, crops no point cloud data covering
Triangle gridding, so that the resource that switching system occupies greatly reduces, solves existing skill so that the threedimensional model established more is simplified
Switching system in art based on depth information starts technical problem slow, that mass motion is partially slow, and can realize and pass through high-resolution
Rate image has carried out the triangle gridding motion model of texture mapping, and solving texture mapping in the prior art can only be low using what is obscured
Image in different resolution causes the image in the motion process switched over to show unsharp technical problem；And inhomogeneity can be directed to
Other object is individually established only in viewpoint triangle gridding motion model within the vision, is arrived according to object in scene
The distant relationships of the viewpoint simulate object of which movement, greatly improve switching system performance, can more accurately describe real scene,
It realizes more natural scene switching, improves the sense of reality and feeling of immersion of the user when streetscape browses.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Fig. 1 is the schematic illustration in the prior art based on fixed model switching；
Fig. 2 is the effect diagram of the motion process in the prior art based on depth information switching；
Fig. 3 is the flow diagram of three-dimensional scenic switching method provided in an embodiment of the present invention；
Fig. 4 is the method flow schematic diagram that depth map provided in an embodiment of the present invention is generated and handled；
Fig. 5 is the schematic diagram of the point cloud chart picture after spherical projection provided in an embodiment of the present invention；
Fig. 6 is the schematic diagram of identification classification provided in an embodiment of the present invention；
Fig. 7 is the schematic diagram that plane provided in an embodiment of the present invention is extracted；
Fig. 8 is the schematic illustration of triangle gridding motion model provided in an embodiment of the present invention；
Fig. 9 is the flow diagram of another embodiment of three-dimensional scenic switching method provided by the invention；
Figure 10 is the schematic illustration of before and after frames fusion provided in an embodiment of the present invention；
Figure 11 is the structural schematic diagram of three-dimensional scenic switching system provided in an embodiment of the present invention；
Figure 12 is the structural schematic diagram of another embodiment of three-dimensional scenic switching system provided by the invention；
Figure 13 is the structural schematic diagram of interpolation generation module provided in an embodiment of the present invention；
Figure 14 is the structural schematic diagram of another embodiment of interpolation generation module provided by the invention；
Figure 15 is the structural schematic diagram of scene switching module provided by the invention；
Figure 16 is the structural schematic diagram of another embodiment of three-dimensional scenic switching system provided by the invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
The specific embodiment for carrying out the present invention will be described in detail three-dimensional scenic switching method below with reference to Fig. 3 to Fig. 7, illustrates such as
What carries out three-dimensional scenic switching:
Fig. 3 shows the flow diagram of three-dimensional scenic switching method provided in an embodiment of the present invention, comprising:
Step S300: current scene and later scene are established respectively based on the mobile message of viewpoint and only regarded in the viewpoint
Triangle gridding motion model in wild range；
Specifically, the viewpoint in the embodiment of the present invention, that is, video camera roaming point, such as user passes through the end Web in three-dimensional
On map roam when viewpoint, user can by electric terminal operate viewpoint movement, such as move forward, turn left or
It rotates backward；Mobile message of the switching system based on viewpoint can analyze whether need to carry out scene switching, when needing to carry out
When scene switching, current scene and later scene are established respectively and only move mould in viewpoint triangle gridding within the vision
Type, i.e. the triangle gridding motion model of the foundation can only carry out the view centrum for entering current view point scene within the vision
It renders and shows, not to having left the view centrum of current view point within sweep of the eye (i.e. not in the view centrum visual field model of current view point
In enclosing) scene rendered and shown, to establish the triangle grid model of a minimum field range, while guaranteeing should
Triangle grid model can cover the visual field of user and the visual field rotation of certain angle.
Step S302: the triangle gridding motion model established in real time is cut based on depth information, is cropped
The triangle gridding for not having point cloud data to cover, and be switched to based on the triangle gridding motion model after cutting from current scene
Later scene.
Specifically, switching system can call the depth information of the three-dimensional map obtained in advance, then to establishing in real time
The triangle gridding motion model is cut, and crops the triangle gridding of no point cloud data covering, i.e., does not have depth in figure
The triangle gridding of the pixel of information, and be finally switched to based on the triangle gridding motion model after cutting from current scene
Later scene, so that the triangle gridding motion model established more is simplified, so that the resource that switching system occupies subtracts significantly
It is few, solve the technical problem that the switching system starting based on depth information is slow, mass motion is partially slow in the prior art, and can
Realize the triangle gridding motion model that texture mapping has been carried out by high-definition picture, the i.e. triangulation network established in real time
Lattice motion model is the triangle gridding motion model that texture mapping has been carried out by high-definition picture, solves line in the prior art
Fuzzy low-resolution image can only be used by managing textures, and the image in the motion process switched over is caused to show unsharp skill
Art problem.
Further, the depth map provided in an embodiment of the present invention in conjunction with shown in Fig. 4 generates and the method flow of processing shows
It is intended to, to the processing method of depth map in the present invention will be described in detail three-dimensional scenic handoff procedure, comprising:
Step S400: the point cloud data that will acquire is matched with panoramic picture, is obtained a little in the panoramic picture
The depth information of the pixel of cloud data cover；
Specifically, switching system establishes only current scene and later scene in mobile message of the execution based on viewpoint respectively
Before viewpoint triangle gridding motion model within the vision, the point cloud data and the panoramic picture progress that also will acquire
With processing, range information of the pixel apart from viewpoint after being matched, i.e., obtaining in the panoramic picture has a cloud data cover
Pixel depth information；
It should be noted that the embodiment of the present invention can be come real by being equipped with three-dimensional laser scanner to streetscape collecting vehicle
Its existing geological information for acquiring surrounding objects in the process of moving.Spherical projection provided in an embodiment of the present invention as shown in Figure 5
The schematic diagram of point cloud chart picture afterwards, from the point cloud chart picture after spherical projection can be seen that due to the number of sampled point be it is certain,
Therefore point cloud data can only cover one part of pixel point in panoramic picture, after being matched by step S400, can find out complete
There is a depth information for the pixel of cloud data cover in scape image.
After step S400, switching system has a pixel for cloud data cover in the panoramic picture according to,
Interpolation processing is carried out to the pixel of no point cloud data covering, obtains the depth of the pixel without point cloud data covering
Information, and depth map is generated according to depth information.Specifically comprise the following steps S402 to step S406.
Step S402: identification classification is carried out to the object in the panoramic picture；
Specifically, the schematic diagram of identification classification provided in an embodiment of the present invention as shown in Figure 6, switching system can be to complete
Object in scape image carries out identification classification, i.e., point cloud data is carried out identification classification, can identify road surface, flooring and tree etc.
The data of different classes of object.
Step S404: same category of object will be belonged to and carry out plane extraction, obtain the plane for belonging to same category object
In pixel；
Specifically, switching system can carry out plane extraction to different classes of object according to different strategies, thus
To the pixel in the plane for belonging to same category object, what plane provided in an embodiment of the present invention as shown in Figure 7 was extracted shows
It is intended to, for example extracts and obtain the pixel belonged in this plane of flooring.
Step S406: according to there is a pixel for cloud data cover in the plane for belonging to same category object, to institute
Stating does not have point cloud data to cover pixel in the plane for belonging to same category object carries out interpolation processing, and according to depth information
Generate depth map.
Specifically, there is a pixel for cloud data cover in the plane by belonging to same category object according to, it is right
The pixel for not having point cloud data to cover in the plane for belonging to same category object carries out interpolation processing, can eat it raw and includes
The depth map of more depth informations.
Still further, the embodiment of the present invention is when generating depth map according to depth information, it can also include: for depth
The face index of plane where each pixel storage respectively in figure, and travel compression is carried out, obtain compressed depth map.
Specifically, it is indexed as an index can be set as face in affiliated conplane multiple pixels, for example " 1 " is made
It is indexed for the face of the plane, then could be stored as " 1 " to multiple pixel, to indicate that multiple pixel belongs to this
Plane；So after carrying out travel compression to depth map, the size of depth map can be greatly reduced.
Still further, the embodiment of the present invention is being established only in viewpoint triangle gridding motion model within the vision
During may include: individually to establish only for different classes of object in the viewpoint triangulation network within the vision
Lattice motion model.
Specifically, it when switching system establishes the triangle gridding motion model of three-dimensional scenic based on depth information, can be directed to
Different objects, the schematic illustration of triangle gridding motion model provided in an embodiment of the present invention as shown in Figure 8, for for example
Ground, sky, building etc. individually establish corresponding viewpoint triangle gridding motion model within the vision, thus into
One step simplifies the triangle gridding motion model of foundation.
Below with reference to the process signal of another embodiment of the three-dimensional scenic switching method provided by the invention shown in Fig. 9
Figure, comprising:
Step S900: current scene and later scene are established respectively based on the mobile message of viewpoint and only regarded in the viewpoint
Triangle gridding motion model in wild range；
Step S902: the triangle gridding motion model established in real time is cut based on depth information, is cropped
The triangle gridding for not having point cloud data to cover；
Specifically, step S900 and step S902 can be corresponded to reference to the step S400 and step in above-mentioned Fig. 4 embodiment
S402, which is not described herein again.
Step S904: it is covered with the pixel of point cloud data in analysis scene, obtains in the triangle gridding motion model
The three-dimensional coordinate on each vertex of triangle；
Specifically, as shown in figure 8, in modeling process, the point of pixel covering in the scene that switching system passes through acquisition
Cloud data, analysis obtain the three-dimensional coordinate on each each vertex of triangle in figure.
Step S906: object in scene is calculated according to the three-dimensional coordinate and knows scene to the distance of the viewpoint
Distant relationships of the middle object to the viewpoint；
Specifically, according to the distance of object each in calculated scene to viewpoint, it can be deduced that in scene object to should
The distant relationships of viewpoint, for example in Fig. 8, the distance of higher building to viewpoint is greater than the lower building in right side to viewpoint at a distance
Distance, then would know that the higher building will be distal to the lower building in the right side.
Step S908: when being switched to later scene from current scene, object of which movement is simulated according to the distant relationships.
Specifically, the schematic illustration of before and after frames fusion provided in an embodiment of the present invention as shown in Figure 10, to working as front court
The movement key frame of scape is merged with the movement key frame of later scene, and according to object each in scene in fusion process
Distant relationships simulation carry out object of which movement, realize current scene gradually go out and the transition effect that is fade-in of later scene, so as to
Enough more accurately description real scenes, realize more natural scene switching.
By implementing the embodiment of the present invention, mould only is moved in viewpoint triangle gridding within the vision by establishing
Type, and the triangle gridding motion model established in real time is cut based on depth information, crop no point cloud data
The triangle gridding of covering, so that the resource that switching system occupies greatly reduces, solves so that the threedimensional model established more is simplified
The technical problem that the switching system starting based on depth information is slow in the prior art, mass motion is partially slow, and can realize and pass through
High-definition picture has carried out the triangle gridding motion model of texture mapping, and mould can only be used by solving texture mapping in the prior art
The low-resolution image of paste causes the image in the motion process switched over to show unsharp technical problem；And it can be directed to
Different classes of object is individually established only in viewpoint triangle gridding motion model within the vision, according in scene
The distant relationships of object to the viewpoint simulate object of which movement, greatly improve switching system performance, can more accurately describe true
Real field scape realizes more natural scene switching, improves the sense of reality and feeling of immersion of the user when streetscape browses.
For the ease of better implementing the above scheme of the embodiment of the present invention, the present invention also correspondence provides a kind of three dimensional field
Scape switching system, the structural schematic diagram of three-dimensional scenic switching system provided in an embodiment of the present invention as shown in Figure 11, three dimensional field
Scape switching system 110 may include: that motion model establishes module 1100, cuts module 1102 and scene switching module 1104,
In
Motion model is established module 1100 and is built respectively for the mobile message based on viewpoint to current scene and later scene
It stands only in viewpoint triangle gridding motion model within the vision；
Module 1102 is cut to be used to cut the triangle gridding motion model established in real time based on depth information,
Crop the triangle gridding of no point cloud data covering；
Scene switching module 1104 based on the triangle gridding motion model after cutting from current scene for being switched to
Later scene.
Specifically, it is to pass through high-resolution that motion model, which establishes the triangle gridding motion model that module 1100 is established in real time,
Rate image has carried out the triangle gridding motion model of texture mapping.
Further, the structure of another embodiment of three-dimensional scenic switching system provided by the invention as shown in Figure 12 is shown
It is intended to, three-dimensional scenic switching system 110 may include that motion model establishes module 1100, cuts module 1102 and scene switching mould
Outside block 1104, can also include matching module 1106 and interpolation generation module 1108, wherein
Matching module 1106 be used for motion model establish module 1100 based on the mobile message of viewpoint to current scene and
Later scene establishes the point cloud data that only before viewpoint triangle gridding motion model within the vision, will acquire respectively
It is matched with panoramic picture, obtaining in the panoramic picture has a depth information for the pixel of cloud data cover；
Interpolation generation module 1108 is right for there is a pixel for cloud data cover according in the panoramic picture
The pixel for not having point cloud data to cover carries out interpolation processing, and the depth for obtaining the pixel without point cloud data covering is believed
Breath, and depth map is generated according to depth information.
Still further, the structural schematic diagram of interpolation generation module provided in an embodiment of the present invention as shown in Figure 13, is inserted
Value generation module 1108 may include identification taxon 11080, plane extraction unit 11082 and interpolating unit 11084, wherein
Identification taxon 11080 is for carrying out identification classification to the object in the panoramic picture；
Plane extraction unit 11082 carries out plane extraction for that will belong to same category of object, obtains belonging to same class
Pixel in the plane of other object；
Interpolating unit 11084, which is used to belong to according in the plane of same category object, a pixel for cloud data cover
Point carries out interpolation processing to the pixel for not having point cloud data to cover in the plane for belonging to same category object.
Still further, the structural representation of another embodiment of interpolation generation module provided by the invention as shown in Figure 14
Figure, interpolation generation module 1108 include identifying outside taxon 11080, plane extraction unit 11082 and interpolating unit 11084,
It can also include compression unit 11086, for storing the face index of respectively place plane for each pixel in depth map,
And travel compression is carried out, obtain compressed depth map.
It is establishing still further, the motion model in the embodiment of the present invention establishes module 1100 only in the viewpoint visual field
When triangle gridding motion model in range, specifically includes: individually establishing only for different classes of object in the view
Point triangle gridding motion model within the vision.
Still further, the structural schematic diagram of scene switching module provided by the invention as shown in Figure 15, scene switching
Module 1104 may include analysis obtaining unit 11040, calculate and know unit 11042 and skimulated motion unit 11044, wherein
Analysis obtaining unit 11040 obtains the triangulation network for analyzing the pixel for being covered with point cloud data in scene
The three-dimensional coordinate on each vertex of lattice motion model intermediate cam shape；
Calculate know unit 11042 for according to the three-dimensional coordinate be calculated object in scene to the viewpoint away from
From knowing in scene object to the distant relationships of the viewpoint；
Skimulated motion unit 11044 according to the distant relationships for simulating when being switched to later scene from current scene
Object of which movement.
Figure 16 is please referred to, Figure 16 is the structural representation of another embodiment of three-dimensional scenic switching system provided by the invention
Figure.Wherein, as shown in figure 16, three-dimensional scenic switching system 160 may include: at least one processor 1601, such as CPU, until
A few network interface 1604, user interface 1603, memory 1605, at least one communication bus 1602 and display screen
1606.Wherein, communication bus 1602 is for realizing the connection communication between these components.Wherein, user interface 1603 can wrap
Include keyboard or mouse etc..Network interface 1604 optionally may include that (such as WI-FI connects standard wireline interface and wireless interface
Mouthful).Memory 1605 can be high speed RAM memory, be also possible to non-labile memory (non-volatile
Memory), a for example, at least magnetic disk storage, memory 1605 include the flash in the embodiment of the present invention.Memory 1605
It optionally can also be that at least one is located remotely from the storage system of aforementioned processor 1601.As shown in figure 16, as a kind of meter
It may include operating system, network communication module, Subscriber Interface Module SIM and three-dimensional in the memory 1605 of calculation machine storage medium
Scene switching program.
Processor 1601 can be used for calling the three-dimensional scenic changeover program stored in memory 1605, and execute following behaviour
Make:
Based on the mobile message of viewpoint to current scene and later scene establish respectively only the viewpoint within sweep of the eye
Triangle gridding motion model；
The triangle gridding motion model established in real time is cut based on depth information, crops and does not put cloud number
Later scene is switched to from current scene according to the triangle gridding of covering, and based on the triangle gridding motion model after cutting.
Specifically, the triangle gridding motion model that processor 1601 is established in real time is to be carried out by high-definition picture
The triangle gridding motion model of texture mapping.
Further, processor 1601 establishes current scene and later scene respectively based on the mobile message of viewpoint and only exists
Before the viewpoint triangle gridding motion model within the vision, it can also be performed:
The point cloud data that will acquire is matched with panoramic picture, and obtaining in the panoramic picture has a cloud data cover
Pixel depth information；
There is a pixel for cloud data cover according in the panoramic picture, to the picture of no point cloud data covering
Vegetarian refreshments carries out interpolation processing, obtains the depth information of the pixel without point cloud data covering, and raw according to depth information
At depth map.
Further, processor 1601 has a pixel for cloud data cover in the panoramic picture according to, right
The pixel for not having point cloud data to cover carries out interpolation processing, may include:
Identification classification is carried out to the object in the panoramic picture；
Same category of object will be belonged to and carry out plane extraction, obtain belonging to the pixel in the plane of same category object
Point；
According to there is a pixel for cloud data cover in the plane for belonging to same category object, to it is described belong to it is same
The pixel for not having point cloud data to cover in the plane of classification object carries out interpolation processing.
Further, processor 1601 may include: according to depth information generation depth map
For the face index of plane where each pixel storage respectively in depth map, and travel compression is carried out, obtained
Compressed depth map.
Further, the foundation of processor 1601 only can wrap in viewpoint triangle gridding motion model within the vision
It includes:
It individually establishes only for different classes of object in viewpoint triangle gridding movement mould within the vision
Type.
Further, processor 1601 is switched to down based on the triangle gridding motion model after cutting from current scene
One scene may include:
It is covered with the pixel of point cloud data in analysis scene, it is each to obtain the triangle gridding motion model intermediate cam shape
The three-dimensional coordinate on vertex；
Object is calculated in scene to the distance of the viewpoint according to the three-dimensional coordinate, knows in scene object to institute
State the distant relationships of viewpoint；
When being switched to later scene from current scene, object of which movement is simulated according to the distant relationships.
It should be noted that three-dimensional scenic switching system 110 or three-dimensional scenic switching system 160 in the embodiment of the present invention
The function of each functional module can be implemented according to the method in above method embodiment, specific implementation process is referred to
The associated description of above method embodiment, details are not described herein again.
In conclusion implementing the embodiment of the present invention, only transported in viewpoint triangle gridding within the vision by establishing
Movable model, and the triangle gridding motion model established in real time is cut based on depth information, it crops and does not put cloud
The triangle gridding of data cover, so that the resource that switching system occupies greatly reduces, solves so that the threedimensional model established more is simplified
The switching system based on depth information in the prior art of having determined starts technical problem slow, that mass motion is partially slow, and can realize
The triangle gridding motion model of texture mapping is carried out by high-definition picture, solving texture mapping in the prior art can only make
With fuzzy low-resolution image, the image in the motion process switched over is caused to show unsharp technical problem；And it can
It individually establishes for different classes of object only in viewpoint triangle gridding motion model within the vision, according to field
The distant relationships of object to the viewpoint simulate object of which movement in scape, greatly improve switching system performance, can more accurately retouch
Real scene is stated, realizes more natural scene switching, improves the sense of reality and feeling of immersion of the user when streetscape browses.
Those of ordinary skill in the art will appreciate that realizing all or part of the process in above-described embodiment method, being can be with
Relevant hardware is instructed to complete by computer program, the program can be stored in a computer-readable storage medium
In, the program is when being executed, it may include such as the process of the embodiment of above-mentioned each method.Wherein, the storage medium can be magnetic
Dish, CD, read-only memory (Read-Only Memory, ROM) or random access memory (Random Access
Memory, RAM) etc..
The above disclosure is only the preferred embodiments of the present invention, cannot limit the right model of the present invention with this certainly
It encloses, therefore equivalent changes made in accordance with the claims of the present invention, is still within the scope of the present invention.
Claims (14)
1. a kind of three-dimensional scenic switching method characterized by comprising
Current scene and later scene are established only respectively in the viewpoint within the vision three based on the mobile message of viewpoint
Angle mesh motion model；The mobile message of the viewpoint includes the information that the movement of viewpoint is operated by electric terminal；Wherein, institute
It states only in viewpoint triangle gridding motion model within the vision only to entering the view centrum of current view point within sweep of the eye
Scene rendered and shown, not to having left being rendered and shown depending on centrum scene within the vision for current view point
Show；
The triangle gridding motion model established in real time is cut based on depth information, no point cloud data is cropped and covers
The triangle gridding of lid, and later scene is switched to from current scene based on the triangle gridding motion model after cutting.
2. the method as described in claim 1, which is characterized in that the triangle gridding motion model established in real time is logical
Cross the triangle gridding motion model that high-definition picture has carried out texture mapping.
3. the method as described in claim 1, which is characterized in that it is described based on the mobile message of viewpoint to current scene and next
Scene is established only respectively before viewpoint triangle gridding motion model within the vision, further includes:
The point cloud data that will acquire is matched with panoramic picture, and obtaining in the panoramic picture has a picture for cloud data cover
The depth information of vegetarian refreshments；
There is a pixel for cloud data cover according in the panoramic picture, to the pixel of no point cloud data covering
Interpolation processing is carried out, obtains the depth information of the pixel without point cloud data covering, and generate deeply according to depth information
Degree figure.
4. method as claimed in claim 3, which is characterized in that described to have point cloud data according in the panoramic picture
The pixel of covering carries out interpolation processing to the pixel of no point cloud data covering, comprising:
Identification classification is carried out to the object in the panoramic picture；
Same category of object will be belonged to and carry out plane extraction, obtain belonging to the pixel in the plane of same category object；
According to there is a pixel for cloud data cover in the plane for belonging to same category object, belong to same category to described
The pixel for not having point cloud data to cover in the plane of object carries out interpolation processing.
5. method as claimed in claim 4, which is characterized in that described to include: according to depth information generation depth map
For the face index of plane where each pixel storage respectively in depth map, and travel compression is carried out, is compressed
Depth map afterwards.
6. method as claimed in claim 4, which is characterized in that the foundation is only in the viewpoint triangulation network within the vision
Lattice motion model includes:
It individually establishes only for different classes of object in viewpoint triangle gridding motion model within the vision.
7. as the method according to claim 1 to 6, which is characterized in that the triangle gridding fortune based on after cutting
Movable model is switched to later scene from current scene
It is covered with the pixel of point cloud data in analysis scene, obtains each vertex of the triangle gridding motion model intermediate cam shape
Three-dimensional coordinate；
Object is calculated in scene to the distance of the viewpoint according to the three-dimensional coordinate, knows in scene object to the view
The distant relationships of point；
When being switched to later scene from current scene, object of which movement is simulated according to the distant relationships.
8. a kind of three-dimensional scenic switching system characterized by comprising
Motion model establishes module, establishes only current scene and later scene in institute respectively for the mobile message based on viewpoint
State viewpoint triangle gridding motion model within the vision；The mobile message of the viewpoint includes operating viewpoint by electric terminal
Movement information；Wherein, described that forward sight only only is worked as to entrance in viewpoint triangle gridding motion model within the vision
Point is rendered and is shown depending on centrum scene within the vision, not to having left the view centrum of current view point within sweep of the eye
Scene rendered and shown；
Module is cut to crop for cutting the triangle gridding motion model established in real time based on depth information
The triangle gridding for not having point cloud data to cover；
Scene switching module, for being switched to next field from current scene based on the triangle gridding motion model after cutting
Scape.
9. system as claimed in claim 8, which is characterized in that the motion model establishes the triangle that module is established in real time
Mesh motion model is the triangle gridding motion model that texture mapping has been carried out by high-definition picture.
10. system as claimed in claim 8, which is characterized in that further include:
Matching module, for establishing module based on the mobile message of viewpoint to current scene and later scene in the motion model
It is established only before viewpoint triangle gridding motion model within the vision respectively, the point cloud data and panorama sketch that will acquire
As being matched, obtaining in the panoramic picture has a depth information for the pixel of cloud data cover；
Interpolation generation module, for there is a pixel for cloud data cover according in the panoramic picture, to no point
The pixel of cloud data cover carries out interpolation processing, obtains the depth information of the pixel without point cloud data covering, and
Depth map is generated according to depth information.
11. system as claimed in claim 10, which is characterized in that the interpolation generation module includes:
Taxon is identified, for carrying out identification classification to the object in the panoramic picture；
Plane extraction unit carries out plane extraction for that will belong to same category of object, obtains belonging to same category object
Pixel in plane；
Interpolating unit has a pixel for cloud data cover in the plane for belonging to same category object according to, to institute
Stating does not have point cloud data to cover pixel in the plane for belonging to same category object carries out interpolation processing.
12. system as claimed in claim 11, which is characterized in that the interpolation generation module further include:
Compression unit, for the face index for plane where each pixel storage respectively in depth map, every trade of going forward side by side journey
Compression, obtains compressed depth map.
13. system as claimed in claim 11, which is characterized in that the motion model is established module and established only in the view
When point triangle gridding motion model within the vision, specifically includes: individually establishing for different classes of object and only exist
The viewpoint triangle gridding motion model within the vision.
14. such as the described in any item systems of claim 8-13, which is characterized in that the scene switching module includes:
Obtaining unit is analyzed, for analyzing the pixel for being covered with point cloud data in scene, obtains the triangle gridding movement mould
The three-dimensional coordinate on each vertex of type intermediate cam shape；
Unit is known in calculating, knows for object in scene to be calculated according to the three-dimensional coordinate to the distance of the viewpoint
Distant relationships of the object to the viewpoint in scene；
Skimulated motion unit when for being switched to later scene from current scene, simulates object of which movement according to the distant relationships.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510227642.XA CN106157354B (en) | 2015-05-06 | 2015-05-06 | A kind of three-dimensional scenic switching method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510227642.XA CN106157354B (en) | 2015-05-06 | 2015-05-06 | A kind of three-dimensional scenic switching method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106157354A CN106157354A (en) | 2016-11-23 |
| CN106157354B true CN106157354B (en) | 2019-08-23 |
Family
ID=57348058
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510227642.XA Active CN106157354B (en) | 2015-05-06 | 2015-05-06 | A kind of three-dimensional scenic switching method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106157354B (en) |
Families Citing this family (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106952340A (en) * | 2017-03-14 | 2017-07-14 | 长江涪陵航道管理处 | The method and device of three-dimensional modeling |
| CN107102794B (en) * | 2017-04-27 | 2020-08-11 | 武汉数文科技有限公司 | Operation processing method and device |
| CN107480346A (en) * | 2017-07-24 | 2017-12-15 | 核动力运行研究所 | A kind of simulation system and method for nuclear power unit major accident |
| CN107918948B (en) * | 2017-11-02 | 2021-04-16 | 深圳市自由视像科技有限公司 | 4D video rendering method |
| WO2020034086A1 (en) * | 2018-08-14 | 2020-02-20 | 深圳前海达闼云端智能科技有限公司 | Three-dimensional reconstruction method and apparatus for scene, and electronic device and storage medium |
| US11138694B2 (en) * | 2018-12-05 | 2021-10-05 | Tencent America LLC | Method and apparatus for geometric smoothing |
| CN109729285B (en) * | 2019-01-17 | 2021-03-23 | 广州方硅信息技术有限公司 | Fuse grid special effect generation method and device, electronic equipment and storage medium |
| CN110021210B (en) * | 2019-03-26 | 2021-03-23 | 江苏航空职业技术学院 | Unmanned aerial vehicle VR training method with extensible virtual space |
| US11055835B2 (en) | 2019-11-19 | 2021-07-06 | Ke.com (Beijing) Technology, Co., Ltd. | Method and device for generating virtual reality data |
| CN111105347B (en) * | 2019-11-19 | 2020-11-13 | 贝壳找房(北京)科技有限公司 | Method, device and storage medium for generating panoramic image with depth information |
| CN113115023B (en) * | 2020-01-09 | 2022-09-27 | 百度在线网络技术（北京）有限公司 | Panoramic scene switching method, device and equipment |
| CN111695182B (en) * | 2020-05-28 | 2023-05-26 | 北京朔方天城智能科技有限公司 | BIM (building information modeling) on-demand loading switching method and system |
| CN113112613B (en) * | 2021-04-22 | 2022-03-15 | 贝壳找房(北京)科技有限公司 | Model display method and device, electronic equipment and storage medium |
| CN114565872A (en) * | 2022-02-25 | 2022-05-31 | 腾讯科技（深圳）有限公司 | Video data processing method, device, equipment and computer readable storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AU5010399A (en) * | 1998-09-25 | 2000-03-30 | Lucent Technologies Inc. | Display techniques for three-dimensional virtual reality |
| KR100551132B1 (en) * | 2003-07-28 | 2006-02-13 | 학교법인연세대학교 | Filtering Triangle Strips in View-Dependent Lod Based Rendering Systems |
| JP3806457B2 (en) * | 1994-10-14 | 2006-08-09 | フィリップス メディカル システムズ（クリーヴランド） インコーポレイテッド | Medical diagnostic imaging apparatus and method |
| CN101493528A (en) * | 2009-03-13 | 2009-07-29 | 中国海洋石油总公司 | Magnanimity earthquake three-dimensional visual display method |
| CN103345771A (en) * | 2013-06-28 | 2013-10-09 | 中国科学技术大学 | Efficient image rendering method based on modeling |
| CN103971399A (en) * | 2013-01-30 | 2014-08-06 | 深圳市腾讯计算机系统有限公司 | Street view image transition method and device |
| CN104182999A (en) * | 2013-05-21 | 2014-12-03 | 百度在线网络技术（北京）有限公司 | Panoramic animation jumping method and system |
-
2015
- 2015-05-06 CN CN201510227642.XA patent/CN106157354B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3806457B2 (en) * | 1994-10-14 | 2006-08-09 | フィリップス メディカル システムズ（クリーヴランド） インコーポレイテッド | Medical diagnostic imaging apparatus and method |
| AU5010399A (en) * | 1998-09-25 | 2000-03-30 | Lucent Technologies Inc. | Display techniques for three-dimensional virtual reality |
| KR100551132B1 (en) * | 2003-07-28 | 2006-02-13 | 학교법인연세대학교 | Filtering Triangle Strips in View-Dependent Lod Based Rendering Systems |
| CN101493528A (en) * | 2009-03-13 | 2009-07-29 | 中国海洋石油总公司 | Magnanimity earthquake three-dimensional visual display method |
| CN103971399A (en) * | 2013-01-30 | 2014-08-06 | 深圳市腾讯计算机系统有限公司 | Street view image transition method and device |
| CN104182999A (en) * | 2013-05-21 | 2014-12-03 | 百度在线网络技术（北京）有限公司 | Panoramic animation jumping method and system |
| CN103345771A (en) * | 2013-06-28 | 2013-10-09 | 中国科学技术大学 | Efficient image rendering method based on modeling |
Non-Patent Citations (2)
| Title |
|---|
| 三维场景中实时渲染算法的研究和应用;刘井丽;《中国优秀硕士学位论文全文数据库》;20070815(第2期);第2章 |
| 多视场深度像造型中的若干关键技术;刘晓利;《中国博士学位论文全文数据库》;20090715(第7期);全文 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106157354A (en) | 2016-11-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106157354B (en) | A kind of three-dimensional scenic switching method and system | |
| KR102524422B1 (en) | Object modeling and movement method and device, and device | |
| CN110874864B (en) | Method, device, electronic equipment and system for obtaining three-dimensional model of object | |
| CN104835138B (en) | Make foundation drawing picture and Aerial Images alignment | |
| CN109461210B (en) | Panoramic roaming method for online home decoration | |
| CN110163942A (en) | A kind of image processing method and device | |
| CN112270736B (en) | Augmented reality processing method and device, storage medium and electronic equipment | |
| US11232628B1 (en) | Method for processing image data to provide for soft shadow effects using shadow depth information | |
| CN108114471B (en) | AR service processing method and device, server and mobile terminal | |
| CN108765576B (en) | OsgEarth-based VIVE virtual earth roaming browsing method | |
| CN104735435A (en) | Image processing method and electronic device | |
| CN103606151A (en) | A wide-range virtual geographical scene automatic construction method based on image point clouds | |
| CN108043027B (en) | Storage medium, electronic device, game screen display method and device | |
| CN113379901A (en) | Method and system for establishing house live-action three-dimension by utilizing public self-photographing panoramic data | |
| CN108958469A (en) | A method of hyperlink is increased in virtual world based on augmented reality | |
| CN108205822B (en) | Picture pasting method and device | |
| CN112669448A (en) | Virtual data set development method, system and storage medium based on three-dimensional reconstruction technology | |
| CN112435337A (en) | Landscape visual field analysis method and system | |
| CN114863014A (en) | Fusion display method and device for three-dimensional model | |
| CN108846900B (en) | Method and system for improving spatial sense of user in room source virtual three-dimensional space diagram | |
| CN109064533B (en) | 3D roaming method and system | |
| KR20220104639A (en) | Device for multi-angle screen coverage analysis | |
| KR102688669B1 (en) | Method for gaining 3d mesh model sequence from multi-view video sequence based on mixed reality | |
| CN108510433A (en) | Space representation method, apparatus and terminal | |
| CN114615487B (en) | Three-dimensional model display method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230705 Address after: 518057 Tencent Building, No. 1 High-tech Zone, Nanshan District, Shenzhen City, Guangdong Province, 35 floors Patentee after: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. Patentee after: TENCENT CLOUD COMPUTING (BEIJING) Co.,Ltd. Address before: 2, 518000, East 403 room, SEG science and Technology Park, Zhenxing Road, Shenzhen, Guangdong, Futian District Patentee before: TENCENT TECHNOLOGY (SHENZHEN) Co.,Ltd. |