CN115713595A - Method, device and system for generating common photos into entity model - Google Patents
Method, device and system for generating common photos into entity model Download PDFInfo
- Publication number
- CN115713595A CN115713595A CN202211469271.2A CN202211469271A CN115713595A CN 115713595 A CN115713595 A CN 115713595A CN 202211469271 A CN202211469271 A CN 202211469271A CN 115713595 A CN115713595 A CN 115713595A
- Authority
- CN
- China
- Prior art keywords
- dimensional
- model
- image
- entity object
- point cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Processing Or Creating Images (AREA)
Abstract
The invention discloses a method, a device and a system for generating a common photo into a solid model, wherein the method comprises the following steps: close-range photographing is carried out on the entity object to obtain a plurality of two-dimensional high-definition images of the entity object; storing a plurality of two-dimensional high-definition images locally or uploading the two-dimensional high-definition images to a cloud server; carrying out image synthesis on a local or cloud server through a built-in image synthesis algorithm, and generating a three-dimensional model of the entity object; the three-dimensional model of the solid object is printed through the output port to generate the three-dimensional solid model. The invention can synthesize images on a local or cloud server through a built-in image synthesis algorithm to generate a three-dimensional model of an entity object, and quickly print the high-precision three-dimensional entity model, can be used for establishing a novel entertainment network, and can also be used for other scenes such as entity replication, commodity display and the like. The system provided by the invention can deploy each device in different places, can fully utilize system resources and realize differentiated services, and reduces the waiting time of users.
Description
Technical Field
The invention belongs to the technical field of digital services, and particularly relates to a method, a device and a system for generating a common photo into a physical model.
Background
Three-dimensional imaging is a popular direction in the field of digital technology, wherein the most important technology is three-dimensional holographic imaging technology, and other technologies such as three-dimensional laser scanning, aviation, terrestrial photogrammetry and the like are also included, all the technologies depend on professional equipment, software or professional manual service, are usually specific to a specific application scene, are difficult to realize unattended operation, have relatively high application cost, and are difficult to realize popularization and application for serving public needs. The combination of three-dimensional laser scanning and three-dimensional printing technology is a typical case, and although the price of the three-dimensional scanner is continuously lowered in the last 20 years, the price is still hundreds of thousands, professional software and advanced computer processing data are required to be configured, and the high cost makes the technology difficult to realize the popularization application and create new business opportunities. And due to the cost, the commodities of all E-commerce platforms are displayed by a plurality of common photos, and the conditions required for carrying out leisure and entertainment activities are not provided.
The method comprises the steps that a three-dimensional entity model generated by common photos needs to take a plurality of photos which are overlapped with each other, wherein the core of the three-dimensional entity model is a three-dimensional imaging technology, the final effect mainly depends on two links, firstly, the quality of the common photos comprises the difference degree, the overlapping degree and the like of the illumination conditions among the photos, and the final effect and the success or failure are influenced by slight flaws; the second is a three-dimensional model algorithm, which has been adopted to date.
The invention patent with publication number CN106023302A discloses a mobile communication terminal, a server and a method for realizing three-dimensional reconstruction thereof, wherein photos are synthesized into three-dimensional data through the server, the server sends three-dimensional model data to the mobile communication terminal, and the mobile communication terminal carries out three-dimensional visual rendering according to the three-dimensional model data. Although the method is simple and rapid to operate, the quality of the pictures shot by the mobile terminal equipment is uneven due to the fact that the pictures are highly dependent on the mobile communication terminal, and the high requirements of three-dimensional reconstruction on the quality, the angle and the overlapping degree of the pictures are difficult to meet, so that the large-scale three-dimensional reconstruction of the high-precision instance model is difficult.
The patent with publication number CN109816594a discloses a method for making an entity panoramic photo, which takes space multi-surface photos and then splices the space multi-surface photos into a panoramic photo, performs digital model modeling by using three-dimensional modeling software after post-processing of the photos, and makes an entity model by using a 3D printing technology, which can restore mapping of panoramic space information of a shot scene in an entity space, but depends on various existing image processing and three-dimensional modeling software, has higher requirements on professional software, computer performance and manual operation, and cannot realize high-precision printing of an entity object.
Disclosure of Invention
In view of this, the present invention provides a method, an apparatus, and a system for generating a normal photo as a physical model, which are used to solve the problem that it is difficult to generate a high-precision instance model from a normal photo.
In a first aspect of the present invention, a method for generating a general photograph into a solid model is disclosed, the method comprising:
close-range photographing is carried out on the entity object through the camera equipment, and a plurality of two-dimensional high-definition images of the entity object are obtained;
storing a plurality of two-dimensional high-definition images locally or uploading the two-dimensional high-definition images to a cloud server;
carrying out image synthesis on a local or cloud server through a built-in image synthesis algorithm, and generating a three-dimensional model of the entity object; the image synthesis algorithm establishes dense point clouds of the entity object according to a plurality of two-dimensional high-definition images, establishes a preliminary three-dimensional image of the entity object through a triangularization grid technology and a discrete smooth interpolation algorithm, generates a point cloud projection image according to the corresponding relation of the dense point clouds and the two-dimensional high-definition images, maps the surface of the preliminary three-dimensional image, repeats the operations until the fineness degree and the smoothness degree of a grid surface meet the precision requirement, and generates a three-dimensional model of the entity object;
the three-dimensional model of the solid object is printed through the output port to generate the three-dimensional solid model.
On the basis of the technical scheme, preferably, the camera equipment comprises a shooting frame, a plurality of cameras and a shadowless lamp, wherein the cameras and the shadowless lamp are respectively arranged on the inner wall of the shooting frame; the cameras have the same specification and are formed by jointly calibrating a digital camera and a depth sensor.
On the basis of the above technical scheme, preferably, in the process of close-range shooting of the entity object through the camera device, the entity object is shot synchronously in all directions in view, and the overlapping degree of adjacent pictures is ensured to be larger than a preset threshold value.
On the basis of the above technical solution, preferably, the establishing a preliminary three-dimensional image of the entity object by using a triangulated mesh technique and a discrete smooth interpolation algorithm specifically includes:
presetting a triangular mesh surface based on a triangularization mesh technology;
taking the dense point cloud of the entity object as a target point, and dynamically approximating the triangular mesh surface to the position of the target point;
continuously carrying out encryption and approximation calculation on the triangular mesh surface by a discrete smooth interpolation algorithm and a mesh encryption technology, and repeating the operations until the fineness and the smoothness of the mesh surface meet the precision requirement to obtain a preliminary three-dimensional image of the entity object.
On the basis of the above technical solution, preferably, the generating a point cloud projection image according to a correspondence between the dense point cloud and the two-dimensional high-definition image, and mapping the surface of the preliminary three-dimensional image, wherein the generating a three-dimensional model of the entity object specifically includes:
performing point cloud projection according to the corresponding relation between the dense point cloud and the two-dimensional high-definition image to generate a point cloud projection image;
adopting the point cloud projection image to map the surface of the preliminary three-dimensional image to generate a texture map of the whole preliminary three-dimensional image;
and filling the meshes of the preliminary three-dimensional image through the texture mapping and gradually forming a covering surface to obtain a three-dimensional model of the entity object.
In a second aspect of the present invention, an apparatus for generating a general photograph into a solid model is disclosed, the apparatus comprising:
the camera shooting device is used for shooting the close shot of the entity object to obtain a plurality of two-dimensional high-definition images of the entity object;
the storage module is used for storing a plurality of two-dimensional high-definition images shot by the camera equipment to the local;
the synthesis module is used for acquiring a plurality of two-dimensional high-definition images from the storage module, synthesizing the images through a built-in image synthesis algorithm and generating a three-dimensional model of the entity object; the image synthesis algorithm establishes dense point clouds of the entity object according to a plurality of two-dimensional high-definition images, establishes a preliminary three-dimensional image of the entity object through a triangularization grid technology and a discrete smooth interpolation algorithm, generates a point cloud projection image according to the corresponding relation between the dense point clouds and the two-dimensional high-definition images, maps the surface of the preliminary three-dimensional image to generate a three-dimensional model of the entity object, and sends the three-dimensional model to the printing equipment through an output port;
and the printing device is used for printing the three-dimensional model of the solid object and generating the three-dimensional solid model.
On the basis of the above technical solution, preferably, the synthesis module specifically includes:
a point cloud generation module: the system comprises a storage module, a data acquisition module and a data processing module, wherein the storage module is used for storing a plurality of two-dimensional high-definition images;
a preliminary three-dimensional image module: presetting a triangular mesh surface based on a triangularization mesh technology; taking the dense point cloud of the entity object as a target point, and dynamically approximating the triangular mesh surface to the position of the target point; continuously carrying out encryption and approximation calculation on the triangular mesh surface by a discrete smooth interpolation algorithm and a mesh encryption technology, and repeating the operations until the fineness and the smoothness of the mesh surface meet the precision requirement to obtain a preliminary three-dimensional image of the entity object;
a texture mapping module: the system comprises a point cloud projection module, a point cloud storage module, a point cloud processing module and a point cloud processing module, wherein the point cloud projection module is used for performing point cloud projection according to the corresponding relation between dense point cloud and a two-dimensional high-definition image to generate a point cloud projection image; adopting the point cloud projection image to map the surface of the preliminary three-dimensional image to generate a texture map of the whole preliminary three-dimensional image; and filling the grids of the preliminary three-dimensional image through the texture mapping and gradually forming a covering surface to obtain a three-dimensional model of the entity object.
In a third aspect of the present invention, a system for generating a general photograph into a solid model is disclosed, the system comprising:
a plurality of devices for generating the common photos into the entity model according to the second aspect of the present invention, the plurality of devices being deployed geographically and dispersedly and being used for generating the common photos into the entity model in a self-service manner;
the cloud server is internally provided with the image synthesis algorithm and is respectively connected with each device for generating the common photos into the entity model through the internet;
the cloud server automatically detects the working state of each device, automatically adjusts task allocation of each device according to the busyness degree, or receives and stores a plurality of two-dimensional high-definition images shot by the camera equipment of the corresponding device, carries out image synthesis through a built-in image synthesis algorithm, generates a three-dimensional model of the entity object, and feeds the three-dimensional model of the entity object back to the corresponding device.
Compared with the prior art, the invention has the following beneficial effects:
1) The invention can carry out image synthesis on a local or cloud server through a built-in image synthesis algorithm to generate a three-dimensional model of an entity object; the image synthesis algorithm does not depend on the conventional three-dimensional reconstruction technology, but carries out grid approximation and texture mapping through a triangularization grid technology and a discrete smooth interpolation algorithm, outputs a three-dimensional model reflecting the surface contour of an entity object, can obtain the three-dimensional contour of the surface of a shot object meeting the precision requirement with the minimum grid number, can greatly reduce the technical requirement of data processing and improve the efficiency at the same time, quickly prints the high-precision three-dimensional entity model, can be used for establishing a novel leisure and entertainment network, and can also be used for other scenes such as entity replication, commodity display and the like;
2) The method takes dense point cloud of an entity object as a target point, dynamically approaches a triangular mesh surface to the position of the target point, continuously encrypts and approaches the triangular mesh surface through a discrete smooth interpolation algorithm and a mesh encryption technology to obtain a preliminary three-dimensional image of the entity object, performs point cloud projection according to the corresponding relation of the dense point cloud and a two-dimensional high-definition image, and performs high-precision mapping on the surface of the preliminary three-dimensional image, so that the method not only can ensure the mesh quality, but also can eliminate manual intervention and realize unmanned operation, avoids cavities possibly occurring in a common three-dimensional reconstruction type algorithm, avoids manual operation and cost consumption required by repair work, and realizes rapid and low-cost popularization application;
3) The system for generating the common photos into the entity model can enable each device to be deployed in different places, each device can generate the three-dimensional entity model from the common photos in an unattended and self-service mode, the cloud server automatically detects the working state of each device, task allocation of each device is automatically adjusted according to the busyness degree, system resources can be fully utilized, differentiated services such as image synthesis or printing in different places can be achieved, and waiting time of users can be shortened.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the prior art descriptions will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a flow chart of a method of generating a generic photograph into a mockup according to the present invention;
fig. 2 is an exemplary view of an image pickup apparatus of the present invention;
FIG. 3 is a schematic diagram of the system structure for generating a general photograph into a solid model according to the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
Referring to fig. 1, the present invention provides a method for generating a general photograph into a solid model, the method comprising:
s1, close-range shooting is carried out on the entity object through the camera equipment, and a plurality of two-dimensional high-definition images of the entity object are obtained.
The camera equipment comprises a shooting frame, a plurality of cameras and a shadowless lamp, wherein the cameras and the shadowless lamp are respectively arranged on the inner wall of the shooting frame; the cameras have the same specification and are formed by jointly calibrating a digital camera and a depth sensor. The spatial arrangement, the number, the focal length, the shooting synchronism and the like are designed according to the requirements of three-dimensional picture synthesis, the shooting angle can be freely adjusted, and the high requirements on the picture quality during three-dimensional synthesis are met.
Fig. 2 is an exemplary view of an image capturing apparatus, in which the main body of the capturing frame is a hemispherical design, and a plurality of cameras and shadowless lamps are embedded in the spherical inner wall, so as to obtain a finer panoramic view and better picture quality than other shapes under the same illumination and capturing conditions. The hemispherical design includes but is not limited to 1/2 of the sphere volume, generally suggested to be between 1/2 and 3/4, and the diameter of the hemisphere is different according to the requirements of the application scene, generally suggested to be within 1 m. The pixel of camera is not less than 1000 ten thousand, and the shooting object can be arranged in the shooting region of spherical device base, and camera focus and visual angle are adjustable, and the shooting object distance is bigger, the more meticulous complicacy of appearance the pixel requirement is corresponding higher.
In the process of close-range shooting of the entity object through the camera equipment, the entity object is synchronously shot in all directions at a visual angle, and the overlapping area of more than 60% between pictures shot in adjacent directions is ensured.
The appearance of camera equipment is not only limited to the spheroid, and the size does not do specifically and restricts yet, and the difference of shape and size of a dimension will lead to camera equipment's shooting position and focus to have diversified selection, need to make corresponding regulation according to the appearance, size and the application scene requirement of shooing the thing, and the size of a dimension is adjusted through computer instruction cooperation mechanical equipment, can carry out automatic shrink and extension under unmanned on duty's the condition.
And S2, storing the plurality of two-dimensional high-definition images to the local or uploading the two-dimensional high-definition images to a cloud server.
The image of the entity object collected by the invention can be selectively stored to the local or directly uploaded to the cloud server, and the data can be selectively processed on the local or cloud server.
And S3, carrying out image synthesis on a local or cloud server through a built-in image synthesis algorithm, and generating a three-dimensional model of the entity object.
The image synthesis process of the invention can be selected to be synthesized locally or synthesized on a cloud server according to actual needs. The cloud server monitors the local image synthesis task state, when the local synthesis tasks are too many, the cloud server can allocate the tasks, select the synthesis on the cloud server, and then return the image synthesis result to the local.
When the common photos are combined into the three-dimensional photos, the common photos shot in different directions are firstly paired according to optical characteristics, a large number of coordinate points reflecting the surface contour of the object, namely point clouds, are obtained through complex coordinate calculation, and the discrete points are connected into a continuous surface through the connection among the discrete points in the point clouds, so that the three-dimensional digital model of the contour of the object is obtained. The density degree, uniformity and defects of each discrete point in the point cloud not only determine the model precision, but also directly influence the requirements of the data processing process on professional software, computer performance and manual operation, thereby influencing the application cost and the popularity and providing the possibility of entertainment services. Therefore, the photo synthesis process of the invention adopts the triangularization grid technology and the discrete smooth interpolation algorithm to carry out grid approximation and texture mapping, and outputs a three-dimensional model reflecting the surface contour of the solid object.
The image synthesis algorithm of the invention establishes dense point clouds of an entity object according to a plurality of two-dimensional high-definition images, establishes a preliminary three-dimensional image of the entity object through a triangularization grid technology and a discrete smooth interpolation algorithm, generates a point cloud projection image according to the corresponding relation between the dense point clouds and the two-dimensional high-definition images, maps the surface of the preliminary three-dimensional image, and generates a three-dimensional model of the entity object.
Specifically, the step of performing image synthesis by an image synthesis algorithm to generate a three-dimensional model of the solid object includes:
and S31, establishing dense point cloud of the entity object according to the plurality of two-dimensional high-definition images.
When the camera collects the two-dimensional high-definition image of the entity object, corresponding depth data are collected at the same time, a three-dimensional point cloud cluster is created by utilizing the depth data, namely, dense point cloud is formed according to the depth value of the center of a shot object, and the position of the corresponding two-dimensional high-definition image in three-dimensional imaging is obtained at the same time.
S32, presetting a triangular mesh surface based on the triangularization mesh technology, taking the dense point cloud of the entity object as a target point, and dynamically approaching the triangular mesh surface to the position of the target point;
and S33, continuously encrypting and approximating the triangular mesh surface through a discrete smooth interpolation algorithm and a mesh encryption technology, and repeating the operations until the fineness and the smoothness of the mesh surface meet the precision requirement to obtain a preliminary three-dimensional image of the entity object.
S34, performing point cloud projection according to the corresponding relation between the dense point cloud and the two-dimensional high-definition image to generate a point cloud projection image;
s35, adopting the point cloud projection image to map the surface of the preliminary three-dimensional image to generate a texture map of the whole preliminary three-dimensional image; and filling the meshes of the preliminary three-dimensional image through the texture mapping and gradually forming a covering surface to obtain a three-dimensional model of the entity object.
And S4, printing the three-dimensional model of the entity object through an output port to generate the three-dimensional entity model.
The three-dimensional information contained in the three-dimensional model of the synthesized entity object can help to greatly improve the accuracy of image recognition, interaction with a user can be realized by operations such as rotation and zooming of the display screen, the printed three-dimensional entity model can replace a common photo to be used in scenes such as commodity display, and the printed three-dimensional entity model can obtain a better display effect and has entertainment attributes.
Corresponding to the above method embodiment, the present invention further provides an apparatus for generating a general photo as a solid model, where the apparatus includes:
the camera shooting device is used for shooting the close shot of the entity object to obtain a plurality of two-dimensional high-definition images of the entity object;
the storage module is used for storing a plurality of two-dimensional high-definition images shot by the camera equipment to the local;
the synthesis module is used for acquiring a plurality of two-dimensional high-definition images from the storage module, synthesizing the images through built-in image synthesis software and generating a three-dimensional model of the entity object; the image synthesis software embeds an image synthesis algorithm.
The image synthesis algorithm establishes dense point clouds of the entity object according to a plurality of two-dimensional high-definition images, establishes a preliminary three-dimensional image of the entity object through a triangularization grid technology and a discrete smooth interpolation algorithm, generates a point cloud projection image according to the corresponding relation between the dense point clouds and the two-dimensional high-definition images, maps the surface of the preliminary three-dimensional image to generate a three-dimensional model of the entity object, and sends the three-dimensional model to the printing equipment through an output port;
the synthesis module specifically comprises:
a point cloud generating module: the system comprises a storage module, a data acquisition module, a data processing module and a data processing module, wherein the storage module is used for storing a plurality of two-dimensional high-definition images;
a preliminary three-dimensional image module: presetting a triangular mesh surface based on a triangularization mesh technology; taking the dense point cloud of the entity object as a target point, and dynamically approximating the triangular mesh surface to the position of the target point; continuously carrying out encryption and approximation calculation on the triangular mesh surface by a discrete smooth interpolation algorithm and a mesh encryption technology, and repeating the operations until the fineness and the smoothness of the mesh surface meet the precision requirement to obtain a preliminary three-dimensional image of the entity object;
a texture mapping module: the system comprises a point cloud projection module, a point cloud storage module, a point cloud processing module and a point cloud processing module, wherein the point cloud projection module is used for performing point cloud projection according to the corresponding relation between dense point cloud and a two-dimensional high-definition image to generate a point cloud projection image; adopting the point cloud projection image to map the surface of the preliminary three-dimensional image to generate a texture map of the whole preliminary three-dimensional image; and filling the grids of the preliminary three-dimensional image through the texture mapping and gradually forming a covering surface to obtain a three-dimensional model of the entity object.
The printing device is used for printing the three-dimensional model of the entity object to generate a three-dimensional entity model;
the device for generating the common photo into the entity model comprises the camera device, the storage module, the synthesis module and the printing device, and also comprises a display screen, a processor, a control panel, a power supply, a USB interface, bluetooth and other components, so that the display, control, entity printing and data transmission of the photo/three-dimensional model can be conveniently carried out.
The device for generating the common picture into the entity model directly faces to the user, and completes picture shooting, synthesis and entity model printing when the device works independently; during networking operation, a plurality of devices are connected with the cloud server to form a system, each device plays a role of a system port, and system optimization task allocation, system fault diagnosis and the like can be performed.
On the basis of the above apparatus for generating a plain photograph as a physical model, the present invention further provides a system for generating a plain photograph as a physical model, as shown in fig. 3, the system comprising:
a plurality of the above-mentioned devices for generating the common photos into the entity model, the plurality of the devices being deployed geographically dispersedly and used for generating the common photos into the entity model in a self-service manner;
the cloud server is internally provided with image synthesis software and is respectively connected with each device for generating the common photos into the entity model through the Internet;
the cloud server automatically detects the working state of each device, automatically adjusts task allocation of each device according to the busyness degree, or receives and stores a plurality of two-dimensional high-definition images shot by the camera equipment of the corresponding device, performs image synthesis by running an image synthesis algorithm through built-in image synthesis software, generates a three-dimensional model of the entity object, and feeds the three-dimensional model of the entity object back to the corresponding device.
The photo synthesis software is installed on the cloud server and the local device at the same time, a user does not directly operate the software, photo synthesis can be achieved in a cloud service mode, and self-service and unattended operation can be achieved.
The device for generating the common photos into the solid model has the characteristics of self-service and independence, and the self-service and independence of the device show that each device can finish the process of generating the three-dimensional solid model by the common photos in a self-service mode, so that the device can be deployed in a scattered manner geographically and meets the requirement of generating commercial scale. The system for generating the common photos into the entity model is formed by connecting one or more devices deployed in different places with a cloud server through the Internet, can automatically synthesize the common photos into three-dimensional photos without manual intervention, and then prints the three-dimensional photos into the three-dimensional entity model through an output port. Under the networking condition, the server can automatically detect the working state of each device, realize automatic or as required task allocation, for example, automatically adjust the task of each device according to the busy degree, when the task of a certain device is more, allocate part of the tasks of the device to other idle devices, and complete the synthesis of the three-dimensional photos through remote cooperative work. And when the network is disconnected, each device is allowed to independently complete three-dimensional photo synthesis and solid model printing.
The above device embodiments and system embodiments are implemented based on method embodiments, and please refer to the method embodiments where the device embodiments and system embodiments are briefly described.
The above-described system embodiments are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, i.e. may be distributed over a plurality of network units. Without creative labor, a person skilled in the art can select some or all of the modules according to actual needs to achieve the purpose of the solution of the embodiment.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (8)
1. A method of generating a generic photograph as a solid model, the method comprising:
close-range photographing is carried out on the entity object through the camera equipment, and a plurality of two-dimensional high-definition images of the entity object are obtained;
storing a plurality of two-dimensional high-definition images locally or uploading the two-dimensional high-definition images to a cloud server;
carrying out image synthesis on a local or cloud server through a built-in image synthesis algorithm, and generating a three-dimensional model of the entity object; the image synthesis algorithm establishes dense point clouds of the entity object according to a plurality of two-dimensional high-definition images, establishes a preliminary three-dimensional image of the entity object through a triangularization grid technology and a discrete smooth interpolation algorithm, generates a point cloud projection image according to the corresponding relation between the dense point clouds and the two-dimensional high-definition images, maps the surface of the preliminary three-dimensional image and generates a three-dimensional model of the entity object;
the three-dimensional model of the solid object is printed through the output port to generate the three-dimensional solid model.
2. The method for generating the common photo into the entity model according to claim 1, wherein the camera device comprises a shooting frame, a plurality of cameras and a shadowless lamp, and the plurality of cameras and the shadowless lamp are respectively arranged on the inner wall of the shooting frame; the cameras have the same specification and are formed by jointly calibrating a digital camera and a depth sensor.
3. The method for generating an entity model from a common photo according to claim 2, wherein during the close-up photographing of the entity object by the camera device, the entity object is photographed synchronously from all directions, and the overlapping degree of the adjacent photos is ensured to be greater than a preset threshold.
4. The method for generating a physical model from a plain photograph as claimed in claim 1, wherein the establishing a preliminary three-dimensional image of the physical object by the triangulation mesh technique and the discrete smooth interpolation algorithm specifically comprises:
presetting a triangular mesh surface based on a triangularization mesh technology;
taking the dense point cloud of the entity object as a target point, and dynamically approaching the triangular mesh surface to the position of the target point;
continuously carrying out encryption and approximation calculation on the triangular mesh surface by a discrete smooth interpolation algorithm and a mesh encryption technology, and repeating the operations until the fineness and the smoothness of the mesh surface meet the precision requirement to obtain a preliminary three-dimensional image of the entity object.
5. The method of claim 4, wherein generating a point cloud projection image according to a correspondence between the dense point cloud and the two-dimensional high-definition image, mapping a surface of the preliminary three-dimensional image, and generating the three-dimensional model of the solid object specifically comprises:
performing point cloud projection according to the corresponding relation between the dense point cloud and the two-dimensional high-definition image to generate a point cloud projection image;
adopting the point cloud projection image to map the surface of the preliminary three-dimensional image to generate a texture map of the whole preliminary three-dimensional image;
and filling the meshes of the preliminary three-dimensional image through the texture mapping and gradually forming a covering surface to obtain a three-dimensional model of the entity object.
6. An apparatus for generating a generic photograph as a physical model, the apparatus comprising:
the camera shooting device is used for shooting the close shot of the entity object to obtain a plurality of two-dimensional high-definition images of the entity object;
the storage module is used for storing a plurality of two-dimensional high-definition images shot by the camera equipment to the local;
the synthesis module is used for acquiring a plurality of two-dimensional high-definition images from the storage module, synthesizing the images through a built-in image synthesis algorithm and generating a three-dimensional model of the entity object; the image synthesis algorithm establishes dense point clouds of the entity object according to a plurality of two-dimensional high-definition images, establishes a preliminary three-dimensional image of the entity object through a triangularization grid technology and a discrete smooth interpolation algorithm, generates a point cloud projection image according to the corresponding relation between the dense point clouds and the two-dimensional high-definition images, maps the surface of the preliminary three-dimensional image to generate a three-dimensional model of the entity object, and sends the three-dimensional model to the printing equipment through an output port;
and the printing device is used for printing the three-dimensional model of the solid object and generating the three-dimensional solid model.
7. The apparatus for generating a physical model from a generic photo as claimed in claim 6, wherein the synthesis module specifically comprises:
a point cloud generation module: the system comprises a storage module, a data acquisition module and a data processing module, wherein the storage module is used for storing a plurality of two-dimensional high-definition images;
a preliminary three-dimensional image module: the method comprises the steps of presetting a triangular mesh surface based on a triangularization mesh technology; taking the dense point cloud of the entity object as a target point, and dynamically approximating the triangular mesh surface to the position of the target point; continuously carrying out encryption and approximation calculation on the triangular mesh surface by a discrete smooth interpolation algorithm and a mesh encryption technology, and repeating the operations until the fineness and the smoothness of the mesh surface meet the precision requirement to obtain a preliminary three-dimensional image of the entity object;
a texture mapping module: the system comprises a point cloud projection module, a point cloud storage module, a point cloud processing module and a point cloud processing module, wherein the point cloud projection module is used for performing point cloud projection according to the corresponding relation between dense point cloud and a two-dimensional high-definition image to generate a point cloud projection image; adopting the point cloud projection image to map the surface of the preliminary three-dimensional image to generate a texture map of the whole preliminary three-dimensional image; and filling the meshes of the preliminary three-dimensional image through the texture mapping and gradually forming a covering surface to obtain a three-dimensional model of the entity object.
8. A system for generating a generic photograph as a solid model, the system comprising:
a plurality of the devices for generating the common photos into the entity model according to any one of claims 6 to 7, wherein the devices are deployed in a geographically dispersed manner and are used for generating the common photos into the entity model in a self-service manner;
the cloud server is internally provided with an image synthesis algorithm and is respectively connected with each device for generating the common photos into the entity model through the Internet;
the cloud server automatically detects the working state of each device, automatically adjusts task allocation of each device according to the busyness degree, or receives and stores a plurality of two-dimensional high-definition images shot by the camera equipment of the corresponding device, carries out image synthesis through a built-in image synthesis algorithm, generates a three-dimensional model of the entity object, and feeds the three-dimensional model of the entity object back to the corresponding device.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211469271.2A CN115713595A (en) | 2022-11-22 | 2022-11-22 | Method, device and system for generating common photos into entity model |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211469271.2A CN115713595A (en) | 2022-11-22 | 2022-11-22 | Method, device and system for generating common photos into entity model |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115713595A true CN115713595A (en) | 2023-02-24 |
Family
ID=85234251
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211469271.2A Pending CN115713595A (en) | 2022-11-22 | 2022-11-22 | Method, device and system for generating common photos into entity model |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115713595A (en) |
-
2022
- 2022-11-22 CN CN202211469271.2A patent/CN115713595A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110335343B (en) | Human body three-dimensional reconstruction method and device based on RGBD single-view-angle image | |
| US10218903B2 (en) | Digital 3D/360 degree camera system | |
| JP2006107213A (en) | Stereoscopic image printing system | |
| US20200219301A1 (en) | Three dimensional acquisition and rendering | |
| JP6496093B1 (en) | Exposure control of 3D 360 degree virtual reality camera | |
| US9992473B2 (en) | Digital multi-dimensional image photon platform system and methods of use | |
| US20060028476A1 (en) | Method and system for providing extensive coverage of an object using virtual cameras | |
| JP2017520944A (en) | Generation and use of 3D radon images | |
| US20180288241A1 (en) | Digital multi-dimensional image photon platform system and methods of use | |
| KR20140100656A (en) | Point video offer device using omnidirectional imaging and 3-dimensional data and method | |
| CN206563985U (en) | 3-D imaging system | |
| US10033990B2 (en) | Digital multi-dimensional image photon platform system and methods of use | |
| US10354399B2 (en) | Multi-view back-projection to a light-field | |
| CN109906600A (en) | Simulate the depth of field | |
| CN107610213A (en) | A kind of three-dimensional modeling method and system based on panorama camera | |
| CN115713595A (en) | Method, device and system for generating common photos into entity model | |
| EP3977405A1 (en) | 3d model capture system | |
| EP3983870A1 (en) | Digital mission preparation system | |
| JP3387856B2 (en) | Image processing method, image processing device, and storage medium | |
| JP3392078B2 (en) | Image processing method, image processing device, and storage medium | |
| Matsuyama | Exploitation of 3D video technologies | |
| CN112915536A (en) | Rendering method and device of virtual model | |
| TWI517666B (en) | Portable device with single image capturing module to form sterio-image and the method thereof | |
| JP6768431B2 (en) | Image generator and program | |
| CN116245741B (en) | Image processing method and related device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |