CN114727083B - A data processing method, device, terminal and network side equipment - Google Patents
A data processing method, device, terminal and network side equipment Download PDFInfo
- Publication number
- CN114727083B CN114727083B CN202110001458.9A CN202110001458A CN114727083B CN 114727083 B CN114727083 B CN 114727083B CN 202110001458 A CN202110001458 A CN 202110001458A CN 114727083 B CN114727083 B CN 114727083B
- Authority
- CN
- China
- Prior art keywords
- point cloud
- cloud data
- status information
- preset
- transmission status
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 37
- 230000005540 biological transmission Effects 0.000 claims abstract description 324
- 238000007906 compression Methods 0.000 claims abstract description 80
- 238000009877 rendering Methods 0.000 claims abstract description 67
- 230000006835 compression Effects 0.000 claims abstract description 53
- 238000012545 processing Methods 0.000 claims abstract description 51
- 238000000034 method Methods 0.000 abstract description 21
- 230000008569 process Effects 0.000 abstract description 12
- 238000004891 communication Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 239000000779 smoke Substances 0.000 description 4
- 101001121408 Homo sapiens L-amino-acid oxidase Proteins 0.000 description 2
- 102100026388 L-amino-acid oxidase Human genes 0.000 description 2
- 101100233916 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) KAR5 gene Proteins 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 101000827703 Homo sapiens Polyphosphoinositide phosphatase Proteins 0.000 description 1
- 102100023591 Polyphosphoinositide phosphatase Human genes 0.000 description 1
- 101100012902 Saccharomyces cerevisiae (strain ATCC 204508 / S288c) FIG2 gene Proteins 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- -1 rain Substances 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/122—Improving the 3D impression of stereoscopic images by modifying image signal contents, e.g. by filtering or adding monoscopic depth cues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T9/00—Image coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
- H04L67/025—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
- H04L69/04—Protocols for data compression, e.g. ROHC
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/128—Adjusting depth or disparity
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/167—Position within a video image, e.g. region of interest [ROI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2210/00—Indexing scheme for image generation or computer graphics
- G06T2210/62—Semi-transparency
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- General Engineering & Computer Science (AREA)
- Geometry (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
技术领域Technical Field
本发明涉及通信技术领域，特别是指一种数据处理方法、装置、终端和网络侧设备。The present invention relates to the field of communication technology, and in particular to a data processing method, device, terminal and network side equipment.
背景技术Background Art
目前，增强现实(Augmented Reality，AR)技术发展迅速，5G网络的低延时、大带宽特性，为AR技术的纵深发展带来巨大的契机。云AR技术使得真实世界信息和虚拟世界信息内容相融合，将虚拟信息内容在真实世界中加以有效应用，以至在这一过程中能够被人类感官所感知，从而实现超越现实的感官体验。为了尽量真实地模拟环境变化情况，经常需要在特定场景中增加特效。所谓特效，就是在远离用户视角的方向上，使得物体看起来像是被叠加了烟、雨、雾等介质的效果。相关技术中，先对终端采集的点云数据进行三维重建，再对三维重建场景直接进行介质渲染操作，使得点云数据的渲染过程难以适应资源传输的变化情况。At present, augmented reality (AR) technology is developing rapidly, and the low latency and large bandwidth characteristics of 5G networks have brought huge opportunities for the in-depth development of AR technology. Cloud AR technology integrates real-world information and virtual-world information content, and effectively applies virtual information content in the real world, so that it can be perceived by human senses in the process, thereby achieving a sensory experience beyond reality. In order to simulate environmental changes as realistically as possible, it is often necessary to add special effects in specific scenes. The so-called special effects are the effects that make objects look like they are superimposed with media such as smoke, rain, and fog in the direction away from the user's perspective. In related technologies, the point cloud data collected by the terminal is first reconstructed in three dimensions, and then the medium rendering operation is directly performed on the three-dimensional reconstructed scene, making it difficult for the rendering process of the point cloud data to adapt to changes in resource transmission.
发明内容Summary of the invention
本发明的目的是提供一种数据处理方法、装置、终端和网络侧设备，以解决现有点云数据的渲染过程难以适应资源传输的变化情况的问题。The purpose of the present invention is to provide a data processing method, apparatus, terminal and network-side equipment to solve the problem that the existing point cloud data rendering process is difficult to adapt to changes in resource transmission.
为达到上述目的，本发明的实施例提供一种数据处理方法，由终端执行，包括：To achieve the above object, an embodiment of the present invention provides a data processing method, which is executed by a terminal and includes:
获取终端与网络侧设备之间的传输状况信息；Obtaining the transmission status information between the terminal and the network side device;
根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩；compressing the point cloud data according to the relationship between the transmission status information and the preset transmission condition;
将压缩后的点云数据发送给网络侧设备。Send the compressed point cloud data to the network side device.
可选地，所述根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩，包括：Optionally, compressing the point cloud data according to the relationship between the transmission status information and the preset transmission condition includes:
在所述传输状况信息不满足预设传输条件的情况下，对所述点云数据进行第一压缩处理，得到第一点云数据；When the transmission status information does not satisfy a preset transmission condition, performing a first compression process on the point cloud data to obtain first point cloud data;
或者，在所述传输状况信息满足所述预设传输条件的情况下，对所述点云数据进行第二压缩处理，得到第二点云数据。Alternatively, when the transmission status information satisfies the preset transmission condition, a second compression process is performed on the point cloud data to obtain second point cloud data.
可选地，所述第二点云数据的精度大于所述第一点云数据的精度。Optionally, the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
可选地，所述对所述点云数据进行第一压缩处理，包括：Optionally, the performing a first compression process on the point cloud data includes:
根据所述点云数据的深度信息和曲率特征，在所述点云数据对应的图像中确定感兴趣区域；Determining a region of interest in an image corresponding to the point cloud data according to the depth information and curvature features of the point cloud data;
在所述感兴趣区域按照第一压缩比例进行压缩，在除所述感兴趣区域之外的非感兴趣区域按照第二压缩比例进行压缩；Compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
其中，所述第一压缩比例小于所述第二压缩比例。The first compression ratio is smaller than the second compression ratio.
可选地，所述感兴趣区域内的点云数据满足以下至少一项：Optionally, the point cloud data within the region of interest satisfies at least one of the following:
深度信息对应的深度值小于第一阈值；The depth value corresponding to the depth information is less than a first threshold;
曲率特征对应的曲率值大于第二阈值。The curvature value corresponding to the curvature feature is greater than the second threshold.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
本发明的实施例还提供了一种数据处理方法，由网络侧设备执行，包括：An embodiment of the present invention further provides a data processing method, which is executed by a network side device, and includes:
获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的；Acquire compressed point cloud data, where the compressed point cloud data is obtained by compressing according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission condition;
根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染。The compressed point cloud data is rendered according to the relationship between the transmission status information and the preset transmission condition.
获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的；Acquire compressed point cloud data, where the compressed point cloud data is obtained by compressing according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission condition;
根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染。The compressed point cloud data is rendered according to the relationship between the transmission status information and the preset transmission condition.
可选地，所述根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染，包括：Optionally, rendering the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition includes:
根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景；According to the relationship between the transmission status information and the preset transmission condition, a three-dimensional reconstruction operation is performed on the compressed point cloud data to obtain a target scene;
根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染。According to the relationship between the transmission status information and the preset transmission condition, medium rendering is performed in the target scene.
可选地，所述根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景，包括：Optionally, performing a three-dimensional reconstruction operation on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition to obtain a target scene includes:
在所述传输状况信息满足预设传输条件的情况下，对压缩后的点云数据进行第一精度的三维重建操作，得到第一目标场景；When the transmission status information satisfies a preset transmission condition, performing a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene;
或者，在所述传输状况信息不满足预设传输条件的情况下，对压缩后的点云数据进行第二精度的三维重建操作，得到第二目标场景。Alternatively, when the transmission status information does not satisfy a preset transmission condition, a second precision three-dimensional reconstruction operation is performed on the compressed point cloud data to obtain a second target scene.
可选地，所述第一精度大于第二精度。Optionally, the first precision is greater than the second precision.
可选地，所述根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染，包括：Optionally, performing media rendering in the target scene according to the relationship between the transmission status information and the preset transmission condition includes:
在所述传输状况信息不满足预设传输条件的情况下，在所述目标场景中设置第三精度的介质；When the transmission status information does not satisfy a preset transmission condition, setting a medium of a third precision in the target scene;
或者，在所述传输状况信息满足预设传输条件的情况下，在所述目标场景中设置第四精度的介质。Alternatively, when the transmission status information satisfies a preset transmission condition, a medium of fourth precision is set in the target scene.
可选地，所述第三精度大于所述第四精度。Optionally, the third precision is greater than the fourth precision.
可选地，所述在所述目标场景中进行介质渲染，还包括：Optionally, performing media rendering in the target scene further includes:
对于所述目标场景中曲率值大于预设曲率阈值的区域，设置透明度为第一数值的介质；For an area in the target scene whose curvature value is greater than a preset curvature threshold, setting a medium with a transparency of a first value;
和/或，对于所述目标场景中曲率值小于或者等于预设曲率值的区域，设置透明度为第二数值的介质。And/or, for an area in the target scene whose curvature value is less than or equal to a preset curvature value, a medium with a transparency of a second value is set.
可选地，所述第一数值小于所述第二数值。Optionally, the first value is smaller than the second value.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
本发明实施例还提供了一种数据处理装置，应用于终端，包括：The embodiment of the present invention further provides a data processing device, applied to a terminal, comprising:
第一获取模块，用于获取终端与网络侧设备之间的传输状况信息；A first acquisition module is used to acquire the transmission status information between the terminal and the network side device;
第一处理模块，用于根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩；A first processing module, configured to compress the point cloud data according to the relationship between the transmission status information and the preset transmission condition;
第一传输模块，用于将压缩后的点云数据发送给网络侧设备。The first transmission module is used to send the compressed point cloud data to the network side device.
可选地，所述第一处理模块用于在所述传输状况信息不满足预设传输条件的情况下，对所述点云数据进行第一压缩处理，得到第一点云数据；Optionally, the first processing module is used to perform a first compression process on the point cloud data to obtain first point cloud data when the transmission status information does not meet a preset transmission condition;
或者，在所述传输状况信息满足所述预设传输条件的情况下，对所述点云数据进行第二压缩处理，得到第二点云数据。Alternatively, when the transmission status information satisfies the preset transmission condition, a second compression process is performed on the point cloud data to obtain second point cloud data.
可选地，所述第二点云数据的精度大于所述第一点云数据的精度。Optionally, the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
可选地，所述第一处理模块包括：Optionally, the first processing module includes:
第一确定子模块，用于根据所述点云数据的深度信息和曲率特征，在所述点云数据对应的图像中确定感兴趣区域；A first determination submodule is used to determine a region of interest in an image corresponding to the point cloud data according to the depth information and curvature characteristics of the point cloud data;
第一处理子模块，用于在所述感兴趣区域按照第一压缩比例进行压缩，在除所述感兴趣区域之外的非感兴趣区域按照第二压缩比例进行压缩；A first processing submodule, configured to compress the region of interest according to a first compression ratio, and compress a non-region of interest other than the region of interest according to a second compression ratio;
其中，所述第一压缩比例小于所述第二压缩比例。The first compression ratio is smaller than the second compression ratio.
本发明实施例还提供了一种数据处理装置，应用于网络侧设备，包括：The embodiment of the present invention further provides a data processing device, which is applied to a network side device, including:
第二获取模块，用于获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的；A second acquisition module is used to acquire compressed point cloud data, where the compressed point cloud data is obtained by compression according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission condition;
渲染模块，用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染。The rendering module is used to render the compressed point cloud data according to the relationship between the transmission status information and the preset transmission conditions.
可选地，所述渲染模块包括：Optionally, the rendering module includes:
第一渲染子模块，用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景；A first rendering submodule is used to perform a three-dimensional reconstruction operation on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition to obtain a target scene;
第二渲染子模块，用于根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染。The second rendering submodule is configured to perform medium rendering in the target scene according to the relationship between the transmission status information and the preset transmission condition.
可选地，所述第一渲染子模块用于在所述传输状况信息满足预设传输条件的情况下，对压缩后的点云数据进行第一精度的三维重建操作，得到第一目标场景；Optionally, the first rendering submodule is used to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission status information meets a preset transmission condition;
或者，在所述传输状况信息不满足预设传输条件的情况下，对压缩后的点云数据进行第二精度的三维重建操作，得到第二目标场景。Alternatively, when the transmission status information does not satisfy a preset transmission condition, a second precision three-dimensional reconstruction operation is performed on the compressed point cloud data to obtain a second target scene.
可选地，所述第一精度大于第二精度。Optionally, the first precision is greater than the second precision.
可选地，所述第二渲染子模块用于在所述传输状况信息不满足预设传输条件的情况下，在所述目标场景中设置第三精度的介质；Optionally, the second rendering submodule is used to set a medium of a third precision in the target scene when the transmission status information does not meet a preset transmission condition;
或者，在所述传输状况信息满足预设传输条件的情况下，在所述目标场景中设置第四精度的介质。Alternatively, when the transmission status information satisfies a preset transmission condition, a medium of fourth precision is set in the target scene.
可选地，所述第三精度大于所述第四精度。Optionally, the third precision is greater than the fourth precision.
可选地，所述第二渲染子模块还用于对于所述目标场景中曲率值大于预设曲率阈值的区域，设置透明度为第一数值的介质；Optionally, the second rendering submodule is further used to set a medium with a transparency of a first value for an area in the target scene whose curvature value is greater than a preset curvature threshold;
和/或，对于所述目标场景中曲率值小于或者等于预设曲率值的区域，设置透明度为第二数值的介质。And/or, for an area in the target scene whose curvature value is less than or equal to a preset curvature value, a medium with a transparency of a second value is set.
可选地，所述第一数值小于所述第二数值。Optionally, the first value is smaller than the second value.
本发明实施例还提供了一种终端，包括：收发机和处理器：The embodiment of the present invention further provides a terminal, including: a transceiver and a processor:
所述收发机用于获取终端与网络侧设备之间的传输状况信息；The transceiver is used to obtain transmission status information between the terminal and the network side device;
所述处理器用于根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩；The processor is used to compress the point cloud data according to the relationship between the transmission status information and the preset transmission condition;
所述收发机用于将压缩后的点云数据发送给网络侧设备。The transceiver is used to send the compressed point cloud data to the network side device.
本发明实施例还提供了一种网络侧设备，包括：收发机和处理器：The embodiment of the present invention further provides a network side device, including: a transceiver and a processor:
所述收发机用于获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的；The transceiver is used to obtain compressed point cloud data, wherein the compressed point cloud data is compressed according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission conditions;
所述处理器用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染。The processor is used to render the compressed point cloud data according to the relationship between the transmission status information and the preset transmission conditions.
本发明实施例还提供了一种数据处理装置，包括：收发器、处理器、存储器及存储在所述存储器上并可在所述处理器上运行的程序或指令；所述处理器执行所述程序或指令时实现如上所述数据处理方法中的步骤。An embodiment of the present invention also provides a data processing device, comprising: a transceiver, a processor, a memory, and a program or instruction stored in the memory and executable on the processor; when the processor executes the program or instruction, the steps in the data processing method described above are implemented.
本发明实施例还提供了一种可读存储介质，其上存储有程序或指令，所述程序或指令被处理器执行时实现如上所述数据处理方法中的步骤。An embodiment of the present invention further provides a readable storage medium on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps in the data processing method described above are implemented.
本发明的上述技术方案的有益效果如下：The beneficial effects of the above technical solution of the present invention are as follows:
本发明实施例中，网络侧设备获取压缩后的点云数据，根据传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行介质渲染，如在传输状况良好时进行高精度的三维重建与渲染操作，在传输状况不佳时，进行低精度的三维重建与渲染操作，从而使得点云数据的渲染过程能够适应资源传输的变化情况，能够降低资源传输状况不佳时对用户体验造成的影响。In an embodiment of the present invention, a network side device obtains compressed point cloud data, and performs medium rendering on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission conditions, such as performing high-precision three-dimensional reconstruction and rendering operations when the transmission conditions are good, and performing low-precision three-dimensional reconstruction and rendering operations when the transmission conditions are poor, thereby enabling the rendering process of the point cloud data to adapt to changes in resource transmission and reduce the impact on user experience when the resource transmission conditions are poor.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例中终端与网络侧设备的交互示意图；FIG1 is a schematic diagram of interaction between a terminal and a network-side device according to an embodiment of the present invention;
图2为本发明实施例的数据处理方法的流程示意图之一；FIG2 is a schematic diagram of a flow chart of a data processing method according to an embodiment of the present invention;
图3为本发明实施例的数据处理方法的流程示意图之二；FIG3 is a second flow chart of a data processing method according to an embodiment of the present invention;
图4为本发明实施例的数据处理装置的模块示意图之一；FIG4 is a schematic diagram of a module of a data processing device according to an embodiment of the present invention;
图5为本发明实施例的数据处理装置的模块示意图之二；FIG5 is a second schematic diagram of a module of a data processing device according to an embodiment of the present invention;
图6为本发明实施例的终端的结构框图；FIG6 is a block diagram of a terminal according to an embodiment of the present invention;
图7为本发明实施例的网络侧设备的结构框图；FIG7 is a structural block diagram of a network side device according to an embodiment of the present invention;
图8为本发明实施例的数据处理装置的结构框图之一；FIG8 is a structural block diagram of a data processing device according to an embodiment of the present invention;
图9为本发明实施例的数据处理装置的结构框图之二。FIG. 9 is a second structural block diagram of the data processing device according to an embodiment of the present invention.
具体实施方式DETAILED DESCRIPTION
为使本发明要解决的技术问题、技术方案和优点更加清楚，下面将结合附图及具体实施例进行详细描述。In order to make the technical problems, technical solutions and advantages to be solved by the present invention more clear, a detailed description will be given below with reference to the accompanying drawings and specific embodiments.
应理解，说明书通篇中提到的“一个实施例”或“一实施例”意味着与实施例有关的特定特征、结构或特性包括在本发明的至少一个实施例中。因此，在整个说明书各处出现的“在一个实施例中”或“在一实施例中”未必一定指相同的实施例。此外，这些特定的特征、结构或特性可以任意适合的方式结合在一个或多个实施例中。It should be understood that the references to "one embodiment" or "an embodiment" throughout the specification mean that the specific features, structures, or characteristics associated with the embodiment are included in at least one embodiment of the present invention. Therefore, the references to "in one embodiment" or "in an embodiment" appearing throughout the specification do not necessarily refer to the same embodiment. In addition, these specific features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
在本发明的各种实施例中，应理解，下述各过程的序号的大小并不意味着执行顺序的先后，各过程的执行顺序应以其功能和内在逻辑确定，而不应对本发明实施例的实施过程构成任何限定。In various embodiments of the present invention, it should be understood that the size of the serial numbers of the following processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.
另外，本文中术语“系统”和“网络”在本文中常可互换使用。Additionally, the terms "system" and "network" are often used interchangeably herein.
在本申请所提供的实施例中，应理解，“与A相应的B”表示B与A相关联，根据A可以确定B。但还应理解，根据A确定B并不意味着仅仅根据A确定B，还可以根据A和/或其它信息确定B。In the embodiments provided in the present application, it should be understood that "B corresponding to A" means that B is associated with A, and B can be determined according to A. However, it should also be understood that determining B according to A does not mean determining B only according to A, and B can also be determined according to A and/or other information.
本发明实施例提供了一种数据处理方法，由终端执行，如图1所示，该终端可包括采集模块、数据压缩模块和显示模块，该采集模块可以采集物体表面数据点的集合，具有可通过激光雷达等扫描仪器获取物体表面数据点的集合，除包含三维位置坐标之外，还可以包含包括颜色、强度值、时间等丰富的信息。该终端备具有轻量化的特征，可以进行简单的动作捕捉和画面显示。终端还可包括计算模块，可以实现较低处理能力的计算功能。The embodiment of the present invention provides a data processing method, which is executed by a terminal. As shown in FIG1 , the terminal may include a collection module, a data compression module and a display module. The collection module may collect a set of data points on the surface of an object, and may obtain the set of data points on the surface of the object through a scanning instrument such as a laser radar. In addition to the three-dimensional position coordinates, it may also include rich information including color, intensity value, time, etc. The terminal has a lightweight feature and can perform simple motion capture and screen display. The terminal may also include a computing module, which can realize computing functions with lower processing power.
如图2所示，该方法包括：As shown in FIG. 2 , the method includes:
步骤201：获取终端与网络侧设备之间的传输状况信息。Step 201: Acquire transmission status information between the terminal and the network side device.
可选地，上述传输状况信息包括传输时延。Optionally, the above transmission status information includes transmission delay.
本步骤中，该网络侧设备可具体为基站，基站中设置有边缘云或中心云。可选地，由边缘云检测终端与网络侧设备之间的传输状况信息，并将该传输状况信息发送给终端。即终端从边缘云获取上述传输状况信息。当然，也可由终端自身缺点终端与网络侧设备之间的传输状况信息。In this step, the network side device may be specifically a base station, in which an edge cloud or a central cloud is provided. Optionally, the edge cloud detects the transmission status information between the terminal and the network side device, and sends the transmission status information to the terminal. That is, the terminal obtains the above transmission status information from the edge cloud. Of course, the transmission status information between the terminal and the network side device may also be obtained by the terminal itself.
步骤202：根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩。Step 202: compressing the point cloud data according to the relationship between the transmission status information and the preset transmission condition.
可选地，该预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
上述点云数据为终端采集的物体表面数据点的集合。The above point cloud data is a collection of object surface data points collected by the terminal.
在传输状况信息满足预设传输条件时表明当前传输状况良好，在传输状况信息不满足预设传输条件时表明当前传输状况不佳，终端可以根据不同的传输状况，对点云数据进行不同的压缩处理。例如，传输状况良好时，对点云数据进行较小程度的压缩，传输状况不佳时，对点云数据进行较大程度的压缩，以降低资源传输状况不佳时对用户体验造成的影响。When the transmission status information meets the preset transmission conditions, it indicates that the current transmission status is good. When the transmission status information does not meet the preset transmission conditions, it indicates that the current transmission status is poor. The terminal can perform different compression processing on the point cloud data according to different transmission conditions. For example, when the transmission status is good, the point cloud data is compressed to a lesser extent. When the transmission status is poor, the point cloud data is compressed to a greater extent, so as to reduce the impact on the user experience when the resource transmission status is poor.
步骤203：将压缩后的点云数据发送给网络侧设备。Step 203: Send the compressed point cloud data to the network side device.
这里，将压缩后的点云数据发送给网络侧设备，如边缘云，由边缘云根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染，从而使得点云数据的渲染过程能够适应资源传输的变化情况，能够降低资源传输状况不佳时对用户体验造成的影响。Here, the compressed point cloud data is sent to a network side device, such as an edge cloud, which renders the compressed point cloud data based on the relationship between the transmission status information and the preset transmission conditions, so that the rendering process of the point cloud data can adapt to changes in resource transmission and reduce the impact on user experience when resource transmission conditions are poor.
可选地，所述根据所述传输状况信息与预设传输条件之间的关系，对所述点云数据进行压缩，包括：Optionally, compressing the point cloud data according to the relationship between the transmission status information and the preset transmission condition includes:
在所述传输状况信息不满足预设传输条件的情况下，对所述点云数据进行第一压缩处理，得到第一点云数据；When the transmission status information does not satisfy a preset transmission condition, performing a first compression process on the point cloud data to obtain first point cloud data;
或者，在所述传输状况信息满足所述预设传输条件的情况下，对所述点云数据进行第二压缩处理，得到第二点云数据，其中，所述第二点云数据的精度大于所述第一点云数据的精度。Alternatively, when the transmission status information satisfies the preset transmission condition, a second compression process is performed on the point cloud data to obtain second point cloud data, wherein the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
其中，上述第二点云数据的精度大于第一点云数据的精度可以理解为第二点云数据对应的图像的数据量大于第一点云数据对应的图像的数据量。The fact that the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data can be understood as the data volume of the image corresponding to the second point cloud data is greater than the data volume of the image corresponding to the first point cloud data.
可选地，所述对所述点云数据进行第一压缩处理，包括：Optionally, the performing a first compression process on the point cloud data includes:
根据所述点云数据的深度信息和曲率特征，在所述点云数据对应的图像中确定感兴趣区域；Determining a region of interest in an image corresponding to the point cloud data according to the depth information and curvature features of the point cloud data;
在所述感兴趣区域按照第一压缩比例进行压缩，在除所述感兴趣区域之外的非感兴趣区域按照第二压缩比例进行压缩；Compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
其中，所述第一压缩比例小于所述第二压缩比例。The first compression ratio is smaller than the second compression ratio.
本发明实施例中，在传输状况不佳时，结合点云数据的深度信息和曲率特征，确定感兴趣区域，并对感兴趣区域进行较低程度的压缩，以保证精确的重建效果，突出感兴趣区域的特征，对非感兴趣区域进行较高程度的压缩，以降低渲染负载与功耗，保证用户体验。In an embodiment of the present invention, when the transmission condition is poor, the depth information and curvature characteristics of the point cloud data are combined to determine the region of interest, and the region of interest is compressed to a lower degree to ensure an accurate reconstruction effect and highlight the characteristics of the region of interest. A higher degree of compression is performed on non-regions of interest to reduce rendering load and power consumption and ensure user experience.
可选地，所述感兴趣区域内的点云数据满足以下至少一项：Optionally, the point cloud data within the region of interest satisfies at least one of the following:
深度信息对应的深度值小于第一阈值；The depth value corresponding to the depth information is less than a first threshold;
曲率特征对应的曲率值大于第二阈值。The curvature value corresponding to the curvature feature is greater than the second threshold.
也就是说，本发明实施例中，感兴趣区域是指深度信息对应的深度至小于第一阈值，和/或，曲率特征对应的曲率值大于第二阈值的区域。That is to say, in the embodiment of the present invention, the region of interest refers to a region where the depth corresponding to the depth information is less than the first threshold, and/or the curvature value corresponding to the curvature feature is greater than the second threshold.
本发明实施例的数据处理方法，终端在传输状况不佳时，结合点云数据的深度信息和曲率特征，确定感兴趣区域，并对感兴趣区域进行较低程度的压缩，以保证精确的重建效果，突出感兴趣区域的特征，对非感兴趣区域进行较高程度的压缩，以降低渲染负载与功耗，保证用户体验。The data processing method of the embodiment of the present invention is that when the transmission condition of the terminal is poor, the depth information and curvature characteristics of the point cloud data are combined to determine the area of interest, and the area of interest is compressed to a lower degree to ensure accurate reconstruction effect and highlight the characteristics of the area of interest. The non-interested areas are compressed to a higher degree to reduce rendering load and power consumption, thereby ensuring user experience.
本发明实施例还提供了一种数据处理方法，由网络侧设备执行，该网络侧设备为基站，具体包括边缘云，边缘云具有高运行速率的服务器，可以进行计算量庞大的渲染以及复杂的三维重建操作。如图1所示，该边缘云包括资源管理模块，数据处理模块，显示处理模块，该资源管理模块用于对数据传输的资源进行管理，数据处理模块用于与终端传输点云数据，显示处理模块可进行三维重建和介质渲染。The embodiment of the present invention also provides a data processing method, which is executed by a network side device, which is a base station, specifically including an edge cloud, and the edge cloud has a server with a high operating rate, which can perform rendering with huge computational complexity and complex three-dimensional reconstruction operations. As shown in Figure 1, the edge cloud includes a resource management module, a data processing module, and a display processing module. The resource management module is used to manage the resources for data transmission, the data processing module is used to transmit point cloud data with the terminal, and the display processing module can perform three-dimensional reconstruction and media rendering.
如图3所示，该方法包括：As shown in FIG3 , the method includes:
步骤301：获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的。Step 301: Obtain compressed point cloud data, where the compressed point cloud data is compressed according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission conditions.
这里，终端根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩发送给该网络侧设备，具体的压缩过程已在终端侧的方法实施例中进行详细说明，此处不再赘述。Here, the terminal compresses the point cloud data and sends it to the network side device according to the relationship between the transmission status information and the preset transmission conditions. The specific compression process has been described in detail in the method embodiment on the terminal side and will not be repeated here.
步骤302：根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行介质渲染。Step 302: Performing medium rendering on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition.
可选地，上述传输状况信息包括传输时延。该预设传输条件包括传输时延小于预设时延阈值。Optionally, the transmission status information includes a transmission delay. The preset transmission condition includes that the transmission delay is less than a preset delay threshold.
具体地，在传输状况信息满足预设传输条件时，对压缩后的点云数据进行高精度的三维重建与渲染操作，在传输状况信息不满足预设传输条件时，对压缩后的点云数据进行低精度的三维重建与渲染操作。Specifically, when the transmission status information meets the preset transmission conditions, high-precision three-dimensional reconstruction and rendering operations are performed on the compressed point cloud data; when the transmission status information does not meet the preset transmission conditions, low-precision three-dimensional reconstruction and rendering operations are performed on the compressed point cloud data.
本发明实施例的数据处理方法，获取压缩后的点云数据，根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行介质渲染，如在传输状况良好时进行高精度的三维重建与渲染操作，在传输状况不佳时，进行低精度的三维重建与渲染操作，从而使得点云数据的渲染过程能够适应资源传输的变化情况，能够降低资源传输状况不佳时对用户体验造成的影响。The data processing method of the embodiment of the present invention obtains compressed point cloud data, and performs medium rendering on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission conditions, such as performing high-precision three-dimensional reconstruction and rendering operations when the transmission conditions are good, and performing low-precision three-dimensional reconstruction and rendering operations when the transmission conditions are poor, so that the rendering process of the point cloud data can adapt to the changes in resource transmission and reduce the impact on user experience when the resource transmission conditions are poor.
可选地，所述根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染，包括：Optionally, rendering the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition includes:
根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景；According to the relationship between the transmission status information and the preset transmission condition, a three-dimensional reconstruction operation is performed on the compressed point cloud data to obtain a target scene;
根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染。According to the relationship between the transmission status information and the preset transmission condition, medium rendering is performed in the target scene.
进一步可选地，所述根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景，包括：Further optionally, performing a three-dimensional reconstruction operation on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition to obtain a target scene includes:
在所述传输状况信息满足预设传输条件的情况下，对压缩后的点云数据进行第一精度的三维重建操作，得到第一目标场景；When the transmission status information satisfies a preset transmission condition, performing a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene;
或者，在所述传输状况信息不满足预设传输条件的情况下，对压缩后的点云数据进行第二精度的三维重建操作，得到第二目标场景；Alternatively, when the transmission status information does not satisfy the preset transmission condition, a three-dimensional reconstruction operation with a second precision is performed on the compressed point cloud data to obtain a second target scene;
其中，所述第一精度大于第二精度。The first precision is greater than the second precision.
本发明实施例中，在传输状况良好时，进行高精度的三维重建操作，得到高精度的目标场景，在传输状况不佳时，进行低精度的三维重建操作，得到低精度的目标场景，即上述第二目标场景的精度小于上述第一目标场景的精度。In an embodiment of the present invention, when the transmission condition is good, a high-precision three-dimensional reconstruction operation is performed to obtain a high-precision target scene, and when the transmission condition is poor, a low-precision three-dimensional reconstruction operation is performed to obtain a low-precision target scene, that is, the accuracy of the second target scene is less than the accuracy of the first target scene.
进一步可选地，所述根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染，包括：Further optionally, performing media rendering in the target scene according to the relationship between the transmission status information and the preset transmission condition includes:
在所述传输状况信息不满足预设传输条件的情况下，在所述目标场景中设置第三精度的介质；When the transmission status information does not satisfy a preset transmission condition, setting a medium of a third precision in the target scene;
或者，在所述传输状况信息满足预设传输条件的情况下，在所述目标场景中设置第四精度的介质；Alternatively, in a case where the transmission status information satisfies a preset transmission condition, a medium of a fourth precision is set in the target scene;
其中，所述第三精度大于所述第四精度。The third precision is greater than the fourth precision.
本发明实施例中，结合终端与基站的传输状况情况，进行烟、云、雾等介质的数据处理。当传输状况良好时，由于三维重建的目标场景精度高，设置低精度的叠加介质；当传输状况不佳时，三维重建的目标场景精度低，采用高精度的叠加介质，不同精度的介质设置充分保障了用户体验。In the embodiment of the present invention, data processing of media such as smoke, cloud, and fog is performed in combination with the transmission conditions between the terminal and the base station. When the transmission condition is good, since the target scene of the three-dimensional reconstruction has high precision, a low-precision superimposed medium is set; when the transmission condition is poor, the target scene of the three-dimensional reconstruction has low precision, and a high-precision superimposed medium is used. The setting of media with different precisions fully guarantees the user experience.
进一步可选地，所述在所述目标场景中进行介质渲染，还包括：Further optionally, the performing media rendering in the target scene further includes:
对于所述目标场景中曲率值大于预设曲率阈值的区域，设置透明度为第一数值的介质；For an area in the target scene whose curvature value is greater than a preset curvature threshold, setting a medium with a transparency of a first value;
和/或，对于所述目标场景中曲率值小于或者等于预设曲率值的区域，设置透明度为第二数值的介质；And/or, for an area in the target scene whose curvature value is less than or equal to a preset curvature value, setting a medium with a transparency of a second value;
其中，所述第一数值小于所述第二数值。The first value is smaller than the second value.
首先，先对透明度进行以下说明。First, let's explain transparency.
在进行烟、云、雾等介质的透明度混合时，方法是将前景(介质)的RGB值(用R1,G1,B1表示)，分别与目标场景(背景)的RGB(用R2,G2,B2表示)按比例混合，透明度alpha取值为0-1，alpha值为0表示全透明，alpha值为1表示不透明，最后得到混合后的RGB值。公式如下：When mixing the transparency of smoke, cloud, fog and other media, the method is to mix the RGB value of the foreground (medium) (expressed by R1, G1, B1) with the RGB of the target scene (background) (expressed by R2, G2, B2) in proportion, and the transparency alpha value is 0-1, alpha value 0 means full transparency, alpha value 1 means opaque, and finally get the mixed RGB value. The formula is as follows:
R3＝R1*alpha+R2*(1-alpha)；R3＝R1*alpha+R2*(1-alpha);
G3＝G1*alpha+G2*(1-alpha)；G3 = G1*alpha + G2*(1-alpha);
B3＝B1*alpha+B2*(1-alpha)。B3 = B1*alpha+B2*(1-alpha).
本发明实施例中，根据存储的三维点云数据的曲率信息，进行烟、云、雾等介质透明度值的设置。对于曲率值较大的区域(如，陡峭的山峰、人脸与肢体轮廓)，需要更加清晰的显示效果；而曲率值较小的区域(如，平坦的大山、平坦的后背)，对视觉显示效果的要求不高。因此，可以根据曲率特征对介质的透明度值进行设置。为曲率值较大的区域设置较小的介质透明度值，为曲率值较小的区域设置较大的介质透明度值，从而清晰地展现重点区域(如，人脸与肢体轮廓)，提高模拟真实感。In an embodiment of the present invention, the transparency value of the medium such as smoke, cloud, and fog is set according to the curvature information of the stored three-dimensional point cloud data. For areas with larger curvature values (such as steep peaks, human faces and limb contours), a clearer display effect is required; while areas with smaller curvature values (such as flat mountains and flat backs) do not require high visual display effects. Therefore, the transparency value of the medium can be set according to the curvature characteristics. A smaller medium transparency value is set for areas with larger curvature values, and a larger medium transparency value is set for areas with smaller curvature values, so as to clearly display key areas (such as human faces and limb contours) and improve the simulation realism.
本发明实施例的数据处理方法，获取压缩后的点云数据，根据传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行介质渲染，如在传输状况良好时进行高精度的三维重建与渲染操作，在传输状况不佳时，进行低精度的三维重建与渲染操作，从而使得点云数据的渲染过程能够适应资源传输的变化情况，能够降低资源传输状况不佳时对用户体验造成的影响。The data processing method of the embodiment of the present invention obtains compressed point cloud data, and performs medium rendering on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission conditions, such as performing high-precision three-dimensional reconstruction and rendering operations when the transmission conditions are good, and performing low-precision three-dimensional reconstruction and rendering operations when the transmission conditions are poor, so that the rendering process of the point cloud data can adapt to the changes in resource transmission and reduce the impact on user experience when the resource transmission conditions are poor.
如图4所示，本发明实施例还提供了一种数据处理装置400，应用于终端，包括：As shown in FIG. 4 , an embodiment of the present invention further provides a data processing device 400, which is applied to a terminal and includes:
第一获取模块401，用于获取终端与网络侧设备之间的传输状况信息；The first acquisition module 401 is used to acquire the transmission status information between the terminal and the network side device;
第一处理模块402，用于根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩；A first processing module 402, configured to compress the point cloud data according to the relationship between the transmission status information and the preset transmission condition;
第一传输模块403，用于将压缩后的点云数据发送给网络侧设备。The first transmission module 403 is used to send the compressed point cloud data to the network side device.
可选地，所述第一处理模块用于在所述传输状况信息不满足预设传输条件的情况下，对所述点云数据进行第一压缩处理，得到第一点云数据；Optionally, the first processing module is used to perform a first compression process on the point cloud data to obtain first point cloud data when the transmission status information does not meet a preset transmission condition;
或者，在所述传输状况信息满足所述预设传输条件的情况下，对所述点云数据进行第二压缩处理，得到第二点云数据，其中，所述第二点云数据的精度大于所述第一点云数据的精度。Alternatively, when the transmission status information satisfies the preset transmission condition, a second compression process is performed on the point cloud data to obtain second point cloud data, wherein the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
可选地，所述第一处理模块包括：Optionally, the first processing module includes:
第一确定子模块，用于根据所述点云数据的深度信息和曲率特征，在所述点云数据对应的图像中确定感兴趣区域；A first determination submodule is used to determine a region of interest in an image corresponding to the point cloud data according to the depth information and curvature characteristics of the point cloud data;
第一处理子模块，用于在所述感兴趣区域按照第一压缩比例进行压缩，在除所述感兴趣区域之外的非感兴趣区域按照第二压缩比例进行压缩；A first processing submodule, configured to compress the region of interest according to a first compression ratio, and compress a non-region of interest other than the region of interest according to a second compression ratio;
其中，所述第一压缩比例小于所述第二压缩比例。The first compression ratio is smaller than the second compression ratio.
可选地，所述感兴趣区域内的点云数据满足以下至少一项：Optionally, the point cloud data within the region of interest satisfies at least one of the following:
深度信息对应的深度值小于第一阈值；The depth value corresponding to the depth information is less than a first threshold;
曲率特征对应的曲率值大于第二阈值。The curvature value corresponding to the curvature feature is greater than the second threshold.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
该数据处理装置能够实现上述数据处理方法实施例中的所有实现方式，为避免重复，此处不再赘述。The data processing device can implement all the implementation methods in the above data processing method embodiments, and will not be described again here to avoid repetition.
如图5所示，本发明实施例还提供了一种数据处理装置500，应用于网络侧设备，包括：As shown in FIG. 5 , an embodiment of the present invention further provides a data processing device 500, which is applied to a network side device, and includes:
第二获取模块501，用于获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的；The second acquisition module 501 is used to acquire compressed point cloud data, where the compressed point cloud data is obtained by compression according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission condition;
渲染模块502，用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染。The rendering module 502 is used to render the compressed point cloud data according to the relationship between the transmission status information and the preset transmission conditions.
可选地，所述渲染模块包括：Optionally, the rendering module includes:
第一渲染子模块，用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景；A first rendering submodule is used to perform a three-dimensional reconstruction operation on the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition to obtain a target scene;
第二渲染子模块，用于根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染。The second rendering submodule is configured to perform medium rendering in the target scene according to the relationship between the transmission status information and the preset transmission condition.
可选地，所述第一渲染子模块用于在所述传输状况信息满足预设传输条件的情况下，对压缩后的点云数据进行第一精度的三维重建操作，得到第一目标场景；Optionally, the first rendering submodule is used to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission status information meets a preset transmission condition;
或者，在所述传输状况信息不满足预设传输条件的情况下，对压缩后的点云数据进行第二精度的三维重建操作，得到第二目标场景；Alternatively, when the transmission status information does not satisfy the preset transmission condition, a three-dimensional reconstruction operation with a second precision is performed on the compressed point cloud data to obtain a second target scene;
其中，所述第一精度大于第二精度。The first precision is greater than the second precision.
可选地，所述第二渲染子模块用于在所述传输状况信息不满足预设传输条件的情况下，在所述目标场景中设置第三精度的介质；Optionally, the second rendering submodule is used to set a medium of a third precision in the target scene when the transmission status information does not meet a preset transmission condition;
或者，在所述传输状况信息满足预设传输条件的情况下，在所述目标场景中设置第四精度的介质；Alternatively, in a case where the transmission status information satisfies a preset transmission condition, a medium of a fourth precision is set in the target scene;
其中，所述第三精度大于所述第四精度。The third precision is greater than the fourth precision.
可选地，所述第二渲染子模块还用于对于所述目标场景中曲率值大于预设曲率阈值的区域，设置透明度为第一数值的介质；Optionally, the second rendering submodule is further used to set a medium with a transparency of a first value for an area in the target scene whose curvature value is greater than a preset curvature threshold;
和/或，对于所述目标场景中曲率值小于或者等于预设曲率值的区域，设置透明度为第二数值的介质；And/or, for an area in the target scene whose curvature value is less than or equal to a preset curvature value, setting a medium with a transparency of a second value;
其中，所述第一数值小于所述第二数值。The first value is smaller than the second value.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
该数据处理装置能够实现上述应用于网络侧设备的数据处理方法实施例中的所有实现方式，为避免重复，此处不再赘述。The data processing device can implement all the implementation methods in the above-mentioned data processing method embodiment applied to the network side device. To avoid repetition, they are not described here.
如图6所示，本发明实施例还提供了一种终端600，包括：收发机620和处理器610：As shown in FIG6 , an embodiment of the present invention further provides a terminal 600, including: a transceiver 620 and a processor 610:
所述收发机620用于获取终端与网络侧设备之间的传输状况信息；The transceiver 620 is used to obtain the transmission status information between the terminal and the network side device;
所述处理器610用于根据所述传输状况信息与预设传输条件之间的关系，对点云数据进行压缩；The processor 610 is used to compress the point cloud data according to the relationship between the transmission status information and the preset transmission condition;
所述收发机620用于将压缩后的点云数据发送给网络侧设备。The transceiver 620 is used to send the compressed point cloud data to the network side device.
可选地，所述处理器610用于在所述传输状况信息不满足预设传输条件的情况下，对所述点云数据进行第一压缩处理，得到第一点云数据；Optionally, the processor 610 is configured to perform a first compression process on the point cloud data to obtain first point cloud data when the transmission status information does not meet a preset transmission condition;
或者，在所述传输状况信息满足所述预设传输条件的情况下，对所述点云数据进行第二压缩处理，得到第二点云数据，其中，所述第二点云数据的精度大于所述第一点云数据的精度。Alternatively, when the transmission status information satisfies the preset transmission condition, a second compression process is performed on the point cloud data to obtain second point cloud data, wherein the accuracy of the second point cloud data is greater than the accuracy of the first point cloud data.
可选地，所述处理器610用于根据所述点云数据的深度信息和曲率特征，在所述点云数据对应的图像中确定感兴趣区域；Optionally, the processor 610 is used to determine a region of interest in an image corresponding to the point cloud data according to the depth information and curvature features of the point cloud data;
在所述感兴趣区域按照第一压缩比例进行压缩，在除所述感兴趣区域之外的非感兴趣区域按照第二压缩比例进行压缩；Compressing the region of interest according to a first compression ratio, and compressing the non-region of interest except the region of interest according to a second compression ratio;
其中，所述第一压缩比例小于所述第二压缩比例。The first compression ratio is smaller than the second compression ratio.
可选地，所述感兴趣区域内的点云数据满足以下至少一项：Optionally, the point cloud data within the region of interest satisfies at least one of the following:
深度信息对应的深度值小于第一阈值；The depth value corresponding to the depth information is less than a first threshold;
曲率特征对应的曲率值大于第二阈值。The curvature value corresponding to the curvature feature is greater than the second threshold.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
该数据处理装置能够实现上述数据处理方法实施例中的所有实现方式，为避免重复，此处不再赘述。The data processing device can implement all the implementation methods in the above data processing method embodiments, and will not be described again here to avoid repetition.
本发明的实施例还提供了一种网络侧设备700，如图7所示，包括：收发机720和处理器710：The embodiment of the present invention further provides a network side device 700, as shown in FIG7 , including: a transceiver 720 and a processor 710:
所述收发机720用于获取压缩后的点云数据，所述压缩后的点云数据是根据终端与网络侧设备之间的传输状况信息与预设传输条件之间的关系进行压缩得到的；The transceiver 720 is used to obtain compressed point cloud data, where the compressed point cloud data is compressed according to the relationship between the transmission status information between the terminal and the network side device and the preset transmission conditions;
所述处理器710用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据进行渲染。The processor 710 is used to render the compressed point cloud data according to the relationship between the transmission status information and the preset transmission condition.
可选地，所述处理器710用于根据所述传输状况信息与预设传输条件之间的关系，对压缩后的点云数据，进行三维重建操作，得到目标场景；根据所述传输状况信息与预设传输条件之间的关系，在所述目标场景中进行介质渲染。Optionally, the processor 710 is used to perform a three-dimensional reconstruction operation on the compressed point cloud data to obtain a target scene based on the relationship between the transmission status information and the preset transmission conditions; and perform medium rendering in the target scene based on the relationship between the transmission status information and the preset transmission conditions.
可选地，所述处理器710用于在所述传输状况信息满足预设传输条件的情况下，对压缩后的点云数据进行第一精度的三维重建操作，得到第一目标场景；Optionally, the processor 710 is configured to perform a three-dimensional reconstruction operation with a first precision on the compressed point cloud data to obtain a first target scene when the transmission status information meets a preset transmission condition;
或者，在所述传输状况信息不满足预设传输条件的情况下，对压缩后的点云数据进行第二精度的三维重建操作，得到第二目标场景；Alternatively, when the transmission status information does not satisfy the preset transmission condition, a three-dimensional reconstruction operation with a second precision is performed on the compressed point cloud data to obtain a second target scene;
其中，所述第一精度大于第二精度。The first precision is greater than the second precision.
可选地，所述处理器710用于在所述传输状况信息不满足预设传输条件的情况下，在所述目标场景中设置第三精度的介质；Optionally, the processor 710 is configured to set a medium of a third precision in the target scene if the transmission status information does not satisfy a preset transmission condition;
或者，在所述传输状况信息满足预设传输条件的情况下，在所述目标场景中设置第四精度的介质；Alternatively, in a case where the transmission status information satisfies a preset transmission condition, a medium of a fourth precision is set in the target scene;
其中，所述第三精度大于所述第四精度。The third precision is greater than the fourth precision.
可选地，所述处理器710还用于对于所述目标场景中曲率值大于预设曲率阈值的区域，设置透明度为第一数值的介质；Optionally, the processor 710 is further configured to set a medium with a transparency of a first value for an area in the target scene whose curvature value is greater than a preset curvature threshold;
和/或，对于所述目标场景中曲率值小于或者等于预设曲率值的区域，设置透明度为第二数值的介质；And/or, for an area in the target scene whose curvature value is less than or equal to a preset curvature value, setting a medium with a transparency of a second value;
其中，所述第一数值小于所述第二数值。The first value is smaller than the second value.
可选地，所述预设传输条件包括传输时延小于预设时延阈值。Optionally, the preset transmission condition includes that the transmission delay is less than a preset delay threshold.
本发明另一实施例还提供了一种数据处理装置，如图8所示，包括收发器810、处理器800、存储器820及存储在所述存储器820上并可在所述处理器800上运行的程序或指令；所述处理器800执行所述程序或指令时实现上述应用于终端的数据处理方法的步骤。Another embodiment of the present invention further provides a data processing device, as shown in Figure 8, including a transceiver 810, a processor 800, a memory 820, and a program or instruction stored in the memory 820 and executable on the processor 800; when the processor 800 executes the program or instruction, the steps of the above-mentioned data processing method applied to the terminal are implemented.
所述收发器810，用于在处理器800的控制下接收和发送数据。The transceiver 810 is used to receive and send data under the control of the processor 800 .
其中，在图8中，总线架构可以包括任意数量的互联的总线和桥，具体由处理器800代表的一个或多个处理器和存储器820代表的存储器的各种电路链接在一起。总线架构还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路链接在一起，这些都是本领域所公知的，因此，本文不再对其进行进一步描述。总线接口提供接口。收发器810可以是多个元件，即包括发送机和接收机，提供用于在传输介质上与各种其他装置通信的单元。针对不同的用户设备，用户接口830还可以是能够外接内接需要设备的接口，连接的设备包括但不限于小键盘、显示器、扬声器、麦克风、操纵杆等。Among them, in Figure 8, the bus architecture may include any number of interconnected buses and bridges, specifically one or more processors represented by processor 800 and various circuits of memory represented by memory 820 are linked together. The bus architecture can also link various other circuits such as peripherals, regulators, and power management circuits together, which are all well known in the art and are therefore not further described herein. The bus interface provides an interface. The transceiver 810 can be a plurality of components, namely, a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium. For different user devices, the user interface 830 can also be an interface that can be connected to external or internal devices, and the connected devices include but are not limited to keypads, displays, speakers, microphones, joysticks, etc.
处理器800负责管理总线架构和通常的处理，存储器820可以存储处理器800在执行操作时所使用的数据。The processor 800 is responsible for managing the bus architecture and general processing, and the memory 820 can store data used by the processor 800 when performing operations.
本发明一实施例提供了一种数据处理装置，如图9所示，包括收发器910、处理器900、存储器920及存储在所述存储器920上并可在所述处理器900上运行的程序或指令；所述处理器900执行所述程序或指令时实现上述应用于网络侧设备的数据处理方法。An embodiment of the present invention provides a data processing device, as shown in Figure 9, including a transceiver 910, a processor 900, a memory 920, and a program or instruction stored in the memory 920 and executable on the processor 900; when the processor 900 executes the program or instruction, the above-mentioned data processing method applied to the network side device is implemented.
所述收发器910，用于在处理器900的控制下接收和发送数据。The transceiver 910 is used to receive and send data under the control of the processor 900 .
其中，在图9中，总线架构可以包括任意数量的互联的总线和桥，具体由处理器900代表的一个或多个处理器和存储器920代表的存储器的各种电路链接在一起。总线架构还可以将诸如外围设备、稳压器和功率管理电路等之类的各种其他电路链接在一起，这些都是本领域所公知的，因此，本文不再对其进行进一步描述。总线接口提供接口。收发器910可以是多个元件，即包括发送机和接收机，提供用于在传输介质上与各种其他装置通信的单元。处理器900负责管理总线架构和通常的处理，存储器920可以存储处理器900在执行操作时所使用的数据。Among them, in Figure 9, the bus architecture can include any number of interconnected buses and bridges, specifically one or more processors represented by processor 900 and various circuits of memory represented by memory 920 are linked together. The bus architecture can also link various other circuits such as peripherals, voltage regulators, and power management circuits together, which are all well known in the art, so they are not further described herein. The bus interface provides an interface. The transceiver 910 can be a plurality of components, that is, including a transmitter and a receiver, providing a unit for communicating with various other devices on a transmission medium. The processor 900 is responsible for managing the bus architecture and general processing, and the memory 920 can store data used by the processor 900 when performing operations.
本发明实施例还提供了一种可读存储介质，其上存储有程序或指令，所述程序或指令被处理器执行时实现如上所述的数据处理方法中的步骤，且能达到相同的技术效果，为避免重复，这里不再赘述。An embodiment of the present invention further provides a readable storage medium on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps in the data processing method as described above are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
其中，所述处理器为上述实施例中所述的数据处理装置中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器(Read-Only Memory，简称ROM)、随机存取存储器(Random Access Memory，简称RAM)、磁碟或者光盘等。The processor is a processor in the data processing device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
进一步需要说明的是，此说明书中所描述的终端包括但不限于智能手机、平板电脑等，且所描述的许多功能部件都被称为模块，以便更加特别地强调其实现方式的独立性。It should be further explained that the terminals described in this specification include but are not limited to smart phones, tablet computers, etc., and many of the functional components described are called modules in order to more particularly emphasize the independence of their implementation methods.
本发明实施例中，模块可以用软件实现，以便由各种类型的处理器执行。举例来说，一个标识的可执行代码模块可以包括计算机指令的一个或多个物理或者逻辑块，举例来说，其可以被构建为对象、过程或函数。尽管如此，所标识模块的可执行代码无需物理地位于一起，而是可以包括存储在不同位里上的不同的指令，当这些指令逻辑上结合在一起时，其构成模块并且实现该模块的规定目的。In the embodiment of the present invention, module can be implemented with software so that it can be executed by various types of processors. For example, an executable code module of an identification can include one or more physical or logical blocks of computer instructions, for example, it can be constructed as an object, process or function. Nevertheless, the executable code of the identified module does not need to be physically located together, but can include different instructions stored in different positions, and when these instructions are logically combined together, it constitutes a module and realizes the specified purpose of the module.
实际上，可执行代码模块可以是单条指令或者是许多条指令，并且甚至可以分布在多个不同的代码段上，分布在不同程序当中，以及跨越多个存储器设备分布。同样地，操作数据可以在模块内被识别，并且可以依照任何适当的形式实现并且被组织在任何适当类型的数据结构内。所述操作数据可以作为单个数据集被收集，或者可以分布在不同位置上(包括在不同存储设备上)，并且至少部分地可以仅作为电子信号存在于系统或网络上。In fact, executable code module can be a single instruction or many instructions, and can even be distributed on a plurality of different code segments, distributed among different programs, and distributed across a plurality of memory devices. Similarly, operating data can be identified in the module, and can be implemented and organized in the data structure of any appropriate type according to any appropriate form. The operating data can be collected as a single data set, or can be distributed in different locations (including on different storage devices), and can only be present on a system or network as an electronic signal at least in part.
在模块可以利用软件实现时，考虑到现有硬件工艺的水平，所以可以以软件实现的模块，在不考虑成本的情况下，本领域技术人员都可以搭建对应的硬件电路来实现对应的功能，所述硬件电路包括常规的超大规模集成(VLSI)电路或者门阵列以及诸如逻辑芯片、晶体管之类的现有半导体或者是其它分立的元件。模块还可以用可编程硬件设备，诸如现场可编程门阵列、可编程阵列逻辑、可编程逻辑设备等实现。When a module can be implemented by software, considering the level of existing hardware technology, a person skilled in the art can build a corresponding hardware circuit to implement the corresponding function of the module that can be implemented by software without considering the cost. The hardware circuit includes a conventional very large scale integration (VLSI) circuit or gate array and existing semiconductors such as logic chips, transistors, or other discrete components. The module can also be implemented by a programmable hardware device, such as a field programmable gate array, a programmable array logic, a programmable logic device, etc.
上述范例性实施例是参考该些附图来描述的，许多不同的形式和实施例是可行而不偏离本发明精神及教示，因此，本发明不应被建构成为在此所提出范例性实施例的限制。更确切地说，这些范例性实施例被提供以使得本发明会是完善又完整，且会将本发明范围传达给那些熟知此项技术的人士。在该些图式中，组件尺寸及相对尺寸也许基于清晰起见而被夸大。在此所使用的术语只是基于描述特定范例性实施例目的，并无意成为限制用。如在此所使用地，除非该内文清楚地另有所指，否则该单数形式“一”、“一个”和“该”是意欲将该些多个形式也纳入。会进一步了解到该些术语“包含”及/或“包括”在使用于本说明书时，表示所述特征、整数、步骤、操作、构件及/或组件的存在，但不排除一或更多其它特征、整数、步骤、操作、构件、组件及/或其族群的存在或增加。除非另有所示，陈述时，一值范围包含该范围的上下限及其间的任何子范围。The above exemplary embodiments are described with reference to the accompanying drawings, and many different forms and embodiments are feasible without departing from the spirit and teachings of the present invention. Therefore, the present invention should not be constructed as a limitation of the exemplary embodiments proposed herein. More specifically, these exemplary embodiments are provided so that the present invention will be perfect and complete, and the scope of the present invention will be conveyed to those who are familiar with the technology. In these figures, the component sizes and relative sizes may be exaggerated for clarity. The terms used here are only based on the purpose of describing specific exemplary embodiments and are not intended to be limiting. As used herein, unless the text clearly indicates otherwise, the singular forms "one", "an" and "the" are intended to include these multiple forms. It will be further understood that the terms "including" and/or "comprising" when used in this specification indicate the presence of the features, integers, steps, operations, components and/or components, but do not exclude the presence or increase of one or more other features, integers, steps, operations, components, components and/or their groups. Unless otherwise indicated, when stated, a range of values includes the upper and lower limits of that range and any subranges therebetween.
以上所述是本发明的优选实施方式，应当指出，对于本技术领域的普通技术人员来说，在不脱离本发明所述原理的前提下，还可以作出若干改进和润饰，这些改进和润饰也应视为本发明的保护范围。The above is a preferred embodiment of the present invention. It should be pointed out that for ordinary technicians in this technical field, several improvements and modifications can be made without departing from the principles of the present invention. These improvements and modifications should also be regarded as the scope of protection of the present invention.
Claims (26)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110001458.9A CN114727083B (en) | 2021-01-04 | 2021-01-04 | A data processing method, device, terminal and network side equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110001458.9A CN114727083B (en) | 2021-01-04 | 2021-01-04 | A data processing method, device, terminal and network side equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114727083A CN114727083A (en) | 2022-07-08 |
| CN114727083B true CN114727083B (en) | 2024-10-15 |
Family
ID=82233549
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110001458.9A Active CN114727083B (en) | 2021-01-04 | 2021-01-04 | A data processing method, device, terminal and network side equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114727083B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2024108607A1 (en) * | 2022-11-26 | 2024-05-30 | 华为技术有限公司 | Data compression method, communication apparatus, and communication system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331676A (en) * | 2016-08-31 | 2017-01-11 | 贾岳杭 | Three-dimensional data processing and transmission method based on virtual reality environment |
| CN111243072A (en) * | 2020-01-10 | 2020-06-05 | 北京腾文科技有限公司 | WebVR three-dimensional display method, device and system and readable storage medium |
| CN111901635A (en) * | 2020-06-17 | 2020-11-06 | 北京视博云信息技术有限公司 | Video processing method, device, storage medium and equipment |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2012078640A2 (en) * | 2010-12-06 | 2012-06-14 | The Regents Of The University Of California | Rendering and encoding adaptation to address computation and network bandwidth constraints |
| CN110971906B (en) * | 2018-09-29 | 2021-11-30 | 上海交通大学 | Hierarchical point cloud code stream packaging method and system |
| CN109801353A (en) * | 2019-01-16 | 2019-05-24 | 北京七鑫易维信息技术有限公司 | A kind of method of image rendering, server and terminal |
-
2021
- 2021-01-04 CN CN202110001458.9A patent/CN114727083B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331676A (en) * | 2016-08-31 | 2017-01-11 | 贾岳杭 | Three-dimensional data processing and transmission method based on virtual reality environment |
| CN111243072A (en) * | 2020-01-10 | 2020-06-05 | 北京腾文科技有限公司 | WebVR three-dimensional display method, device and system and readable storage medium |
| CN111901635A (en) * | 2020-06-17 | 2020-11-06 | 北京视博云信息技术有限公司 | Video processing method, device, storage medium and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114727083A (en) | 2022-07-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109903366B (en) | Virtual model rendering method and device, storage medium and electronic equipment | |
| CN102186067B (en) | Image frame transmission method, device, display method and system | |
| CN113946402B (en) | Cloud mobile phone acceleration method, system, equipment and storage medium based on rendering separation | |
| WO2022174517A1 (en) | Crowd counting method and apparatus, computer device and storage medium | |
| CN113610958B (en) | A 3D image construction method, device and terminal based on style transfer | |
| CN113989174A (en) | Image fusion method and training method and device of image fusion model | |
| CN108665510B (en) | Rendering method and device of continuous shooting image, storage medium and terminal | |
| CN116385622B (en) | Cloud image processing method, cloud image processing device, computer and readable storage medium | |
| CN117292039A (en) | Vertex coordinate generation method, vertex coordinate generation device, electronic equipment and computer storage medium | |
| CN114727083B (en) | A data processing method, device, terminal and network side equipment | |
| CN112565883A (en) | Video rendering processing system and computer equipment for virtual reality scene | |
| CN116205069A (en) | Scene injection method, system and device based on intelligent driving domain controller | |
| CN115049717A (en) | Depth estimation method and device | |
| CN114359048A (en) | Image data enhancement method, device, terminal device and storage medium | |
| CN113870271A (en) | 3D point cloud compression method, device, equipment and storage medium | |
| CN113625923B (en) | Remote cloud desktop-based mouse processing method and device, storage medium and equipment | |
| CN112087612A (en) | Multi-scene-based panoramic imaging method and device, computer equipment and storage medium | |
| CN113592875A (en) | Data processing method, image processing method, storage medium and computing device | |
| CN114419293B (en) | Augmented reality data processing method, device and equipment | |
| CN117115326A (en) | Rendering method and device of three-dimensional scene model and distributed rendering server | |
| CN116258738A (en) | Image processing method, device, electronic device and storage medium | |
| CN117546472A (en) | Asset reusability of light field or holographic media | |
| CN114119831A (en) | Snow accumulation model rendering method and device, electronic equipment and readable medium | |
| CN114429512A (en) | Fusion display method and device for BIM and live-action three-dimensional model of coal preparation plant | |
| CN111524240A (en) | Scene switching method and device and augmented reality equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |