[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN115661045A - Quality 3D visual holographic detection method, device, equipment and medium of automobile tires - Google Patents

Quality 3D visual holographic detection method, device, equipment and medium of automobile tires Download PDF

Info

Publication number
CN115661045A
CN115661045A CN202211214366.XA CN202211214366A CN115661045A CN 115661045 A CN115661045 A CN 115661045A CN 202211214366 A CN202211214366 A CN 202211214366A CN 115661045 A CN115661045 A CN 115661045A
Authority
CN
China
Prior art keywords
depth
point set
tire
visual
dimensional
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202211214366.XA
Other languages
Chinese (zh)
Inventor
程涛
张培江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Technology University
Original Assignee
Shenzhen Technology University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Technology University filed Critical Shenzhen Technology University
Priority to CN202211214366.XA priority Critical patent/CN115661045A/en
Publication of CN115661045A publication Critical patent/CN115661045A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention relates to the field of three-dimensional images, and discloses a 3D visual holographic detection method, a device, equipment and a medium for the quality of an automobile tire, wherein the method comprises the following steps: acquiring three-dimensional contour data of an automobile tire, performing three-dimensional shape reconstruction on the automobile tire to obtain a three-dimensional reconstruction image, and dividing a depth detection area and a width detection area of the three-dimensional reconstruction image; sampling a depth vision point set in a depth detection area, calculating the average gravity center of the point set of the depth vision point set, performing plane fitting on the average gravity center of the point set to obtain a fitted vision plane of the depth vision point set, and calculating the tire detection depth of an automobile tire; detecting edge vision points of the width detection area, performing edge line fitting on the edge vision points to obtain a fitted vision line, and calculating the tire detection width of the automobile tire; and determining a three-dimensional visual quality detection result of the automobile tire according to the tire detection depth and the tire detection width. The invention can improve the defect detection comprehensiveness of the automobile tire.

Description

汽车轮胎的质量3D视觉全息检测方法、装置、设备及介质Quality 3D visual holographic detection method, device, equipment and medium of automobile tires

技术领域technical field

本发明涉及三维图像领域,尤其涉及一种汽车轮胎的质量3D视觉全息检测方法、装置、设备及介质。The invention relates to the field of three-dimensional images, in particular to a quality 3D visual holographic detection method, device, equipment and medium of automobile tires.

背景技术Background technique

汽车轮胎的质量3D视觉全息检测是指对汽车轮胎进行三维视觉的检测,以用于检测汽车轮胎是否存在质量问题。The 3D visual holographic inspection of the quality of automobile tires refers to the inspection of three-dimensional vision of automobile tires to detect whether there are quality problems in automobile tires.

目前,长期以来,只有当汽车被扎破漏气时才考虑对轮胎进行检查,但是也只对漏气的地方进行检测,并没有完全对整个轮胎从胎纹深度、宽度,磨损情况进行全面、科学、可量化的检测;汽车轮胎检测流程为:将车辆开到检测区域后,首先人工通过肉眼对轮胎进行一个整体的外观检查、然后采用卡尺或胎纹深度检测器随机选取轮胎某些部位进行检测,由此得出轮胎是否需要更换和维护,这种检测方式存在的缺陷一方面是人工检测存在测量误差,测量不准确;另一方面,人工对轮胎随机抽检较为局限,并没有对全胎面进行检测,使得汽车轮胎质量没有得到根本全面的检测,常见的检测方式主要有两种:一种是人工使用卡尺在轮胎任意几个位置对胎纹宽度、深度进行抽检,将这些值作为参考来判断轮胎是否磨耗过度及是否需要更换的指标,但在轮胎实际使用过程中,当某个部位碰到尖锐异物后,该处的磨损往往比轮胎其他部位更容易被磨损,人工抽检的往往导致漏检,使得汽车在运行过程中存在交通安全风险;除了通过卡尺的人工检测外,另一种是手持式的轮胎检测设备也是目前轮胎检测的一种技术,将该设备贴近轮胎面,通过内部测距传感器实时的对胎纹深度进行测量,该方案效率和检测精度虽然比人工方式有所提升,但是仍然不能很好的对整个轮胎面的质量进行检测,若需要轮胎全检,这需要耗费大量的劳动力对轮胎逐一的进行检测,通过上述分析,目前汽车轮胎检测技术缺陷在于人工检测效率低,检测流程不可靠、轮胎的检测区域有限使得大概率存在漏检可能,这些问题导致汽车轮胎质量检测存在缺陷。因此,汽车轮胎质量检测的全面性不足。At present, for a long time, the tires are only considered to be inspected when the car is punctured and air leaked, but only the leaked places are tested, and the entire tire is not fully inspected in terms of tread depth, width, and wear. Scientific and quantifiable detection; the inspection process of automobile tires is as follows: after the vehicle is driven to the detection area, the overall appearance of the tire is first manually inspected by the naked eye, and then some parts of the tire are randomly selected by calipers or tread depth detectors. Inspection, from which it can be concluded whether the tire needs to be replaced and maintained. On the one hand, the defect of this inspection method is that there are measurement errors and inaccurate measurement in manual inspection; There are two common detection methods: one is to manually use calipers to randomly check the tread width and depth at any position of the tire, and use these values as a reference It is an indicator to judge whether the tire is excessively worn and whether it needs to be replaced. However, in the actual use of the tire, when a certain part encounters a sharp foreign object, the wear at that part is often more likely to be worn than other parts of the tire. Manual sampling often leads to Missed inspections cause traffic safety risks during the operation of the car; in addition to manual inspection through calipers, the other is hand-held tire inspection equipment, which is also a current tire inspection technology. The ranging sensor measures the tread depth in real time. Although the efficiency and detection accuracy of this solution are improved compared with the manual method, it still cannot detect the quality of the entire tire surface well. If a full tire inspection is required, it will cost A large number of laborers inspect the tires one by one. Through the above analysis, the shortcomings of the current automobile tire inspection technology lie in the low efficiency of manual inspection, the unreliable inspection process, and the limited inspection area of the tires, which makes it possible to miss inspection with a high probability. These problems lead to the quality of automobile tires. Detection is flawed. Therefore, the comprehensiveness of automobile tire quality inspection is insufficient.

发明内容Contents of the invention

为了解决上述问题,本发明提供了一种汽车轮胎的质量3D视觉全息检测方法、装置、设备及介质,可以提高汽车轮胎的缺陷检测全面性。In order to solve the above problems, the present invention provides a quality 3D visual holographic detection method, device, equipment and medium of automobile tires, which can improve the comprehensiveness of defect detection of automobile tires.

第一方面,本发明提供了一种汽车轮胎的质量3D视觉全息检测方法,包括:In a first aspect, the present invention provides a quality 3D visual holographic detection method for automobile tires, comprising:

采集汽车轮胎的三维轮廓数据,根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,得到三维重建图像,并划分所述三维重建图像的深度检测区域与宽度检测区域;Collecting three-dimensional contour data of automobile tires, performing three-dimensional shape reconstruction on the automobile tires according to the three-dimensional contour data, obtaining a three-dimensional reconstruction image, and dividing a depth detection area and a width detection area of the three-dimensional reconstruction image;

采样所述深度检测区域中的深度视觉点集,计算所述深度视觉点集的点集平均重心,对所述点集平均重心进行平面拟合,得到所述深度视觉点集的拟合视觉平面,根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度;Sampling the depth vision point set in the depth detection area, calculating the average center of gravity of the point set of the depth vision point set, and performing plane fitting on the average center of gravity of the point set, to obtain the fitting visual plane of the depth vision point set , calculating the tire detection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane;

检测所述宽度检测区域的边缘视觉点,对所述边缘视觉点进行边缘线拟合,得到拟合视觉线,根据所述边缘视觉点与所述拟合视觉线,计算所述汽车轮胎的轮胎检测宽度;Detecting the edge visual points of the width detection area, performing edge line fitting on the edge visual points to obtain a fitted visual line, and calculating the tire size of the automobile tire according to the edge visual points and the fitted visual line detection width;

根据所述轮胎检测深度与所述轮胎检测宽度,确定所述汽车轮胎的三维视觉质量检测结果。According to the tire detection depth and the tire detection width, the three-dimensional visual quality detection result of the automobile tire is determined.

在第一方面的一种可能实现方式中,所述采集汽车轮胎的三维轮廓数据,包括:In a possible implementation manner of the first aspect, the collecting three-dimensional profile data of automobile tires includes:

利用三维视觉传感器与电机编码器配置所述汽车轮胎的旋转检测平台;Using a three-dimensional vision sensor and a motor encoder to configure the rotation detection platform of the automobile tire;

在所述旋转检测平台中,利用下述公式计算所述电机编码器的旋转编码信号:In the rotation detection platform, the following formula is used to calculate the rotation encoding signal of the motor encoder:

Figure BDA0003876267550000021
Figure BDA0003876267550000021

其中,E表示所述旋转编码信号,C表示所述汽车轮胎的轮胎周长,n表示轮廓间距;Wherein, E represents the rotary encoding signal, C represents the tire circumference of the automobile tire, and n represents the contour spacing;

根据所述旋转编码信号,利用所述三维视觉传感器构建所述汽车轮胎的发射激光信号及其对应的反射激光信号;Constructing the emitted laser signal of the automobile tire and its corresponding reflected laser signal by using the three-dimensional vision sensor according to the rotary encoding signal;

根据所述发射激光信号及其对应的反射激光信号,确定所述汽车轮胎的三维轮廓数据。According to the emitted laser signal and its corresponding reflected laser signal, the three-dimensional profile data of the automobile tire is determined.

可以看出,本发明实施例通过利用三维视觉传感器与电机编码器配置所述汽车轮胎的旋转检测平台采集汽车轮胎的三维轮廓数据可以获得整个3D轮胎表面和侧面的3D点云数据。It can be seen that in the embodiment of the present invention, the 3D point cloud data of the entire 3D tire surface and side can be obtained by using the 3D vision sensor and the motor encoder to configure the rotation detection platform of the car tire to collect the 3D profile data of the car tire.

在第一方面的一种可能实现方式中,所述根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,得到三维重建图像,包括:In a possible implementation manner of the first aspect, the three-dimensional shape reconstruction of the automobile tire according to the three-dimensional contour data to obtain a three-dimensional reconstruction image includes:

确定所述三维轮廓数据对应的二维深度图像;determining a two-dimensional depth image corresponding to the three-dimensional contour data;

利用下述公式计算所述二维深度图像的深度平移坐标:The depth translation coordinates of the two-dimensional depth image are calculated using the following formula:

P(x′,0,z′)=P(x,y,z+r)P(x',0,z')=P(x,y,z+r)

其中,P(x′,0,z′)表示所述二维深度图像的深度平移坐标,r表示所述汽车轮胎的轮胎半径,x,y,z表示所述二维深度图像中所采集的汽车轮胎点云数据点的坐标;Wherein, P(x', 0, z') represents the depth translation coordinates of the two-dimensional depth image, r represents the tire radius of the automobile tire, and x, y, z represent the collected values in the two-dimensional depth image Coordinates of car tire point cloud data points;

根据所述深度平移坐标,利用下述公式对所述二维深度图像进行三维形态重建,得到三维重建图像:According to the depth translation coordinates, the following formula is used to perform three-dimensional reconstruction on the two-dimensional depth image to obtain a three-dimensional reconstructed image:

θ=360°÷Nθ=360°÷N

Figure BDA0003876267550000031
Figure BDA0003876267550000031

x′=xx'=x

y′=cosα*y-sinα*zy'=cosα*y-sinα*z

z′=cosα*y+sinα*zz'=cosα*y+sinα*z

P(x″,y″,z″)=P(x′,0,z′)→P(x,cosα*y-sinα*z,cosα*y+sinα*z)P(x", y", z")=P(x', 0, z')→P(x, cosα*y-sinα*z, cosα*y+sinα*z)

其中,P(x″,y″,z″)表示所述三维重建图像中的点云数据,x″,y″,z″表示所述点云数据在所述三维重建图像中的坐标,i表示所述二维深度图像中轮廓线的序号,范围为[0,N],x,y,z表示所述二维深度图像中所采集的汽车轮胎点云数据点的坐标,P(x′,0,z′)表示所述二维深度图像的深度平移坐标。Wherein, P (x ", y ", z ") represents the point cloud data in the described three-dimensional reconstructed image, x ", y ", z " represents the coordinate of described point cloud data in the described three-dimensional reconstructed image, i Represents the serial number of the contour line in the two-dimensional depth image, the range is [0, N], x, y, z represent the coordinates of the car tire point cloud data points collected in the two-dimensional depth image, P(x' , 0, z') represent the depth translation coordinates of the two-dimensional depth image.

可以看出,本发明实施例通过对所述二维深度图像进行三维形态重建,可以将汽车轮胎表面的二维深度图转换为汽车轮胎的立体三维模型图。It can be seen that in the embodiment of the present invention, the 2D depth image of the surface of the automobile tire can be converted into a three-dimensional 3D model image of the automobile tire by performing 3D shape reconstruction on the 2D depth image.

在第一方面的一种可能实现方式中,所述划分所述三维重建图像的深度检测区域与宽度检测区域,包括:In a possible implementation manner of the first aspect, the dividing the depth detection area and the width detection area of the 3D reconstructed image includes:

在所述三维重建图像中查询所述汽车轮胎的胎纹轮廓线;Querying the tread profile of the automobile tire in the three-dimensional reconstructed image;

将所述胎纹轮廓线对应的轮廓线区域作为所述三维重建图像的深度检测区域与宽度检测区域。The contour line area corresponding to the tread contour line is used as a depth detection area and a width detection area of the three-dimensional reconstructed image.

可以看出,本发明实施例通过将所述胎纹轮廓线对应的轮廓线区域作为所述三维重建图像的深度检测区域与宽度检测区域,以用于检测胎纹的凹陷深度与胎纹宽度。It can be seen that in the embodiment of the present invention, the contour area corresponding to the tread contour line is used as the depth detection area and width detection area of the three-dimensional reconstruction image to detect the concave depth and tread width of the tread pattern.

在第一方面的一种可能实现方式中,所述计算所述深度视觉点集的点集平均重心,包括:In a possible implementation manner of the first aspect, the calculating the point set average center of gravity of the depth vision point set includes:

利用下述公式计算所述深度视觉点集的点集平均重心:Utilize the following formula to calculate the point set average center of gravity of the depth vision point set:

Figure BDA0003876267550000041
Figure BDA0003876267550000041

其中,Pi表示所述深度视觉点集的点集平均重心,i表示所述深度视觉点集中的序列号,j表示所述深度视觉点集中深度视觉点的序列号,xj,yj,zj表示所述深度视觉点集中序列号为j的深度视觉点的三维坐标,m表示所述深度视觉点集中深度视觉点的总数。Wherein, P i represents the point set average center of gravity of the depth vision point set, i represents the sequence number in the depth vision point set, j represents the sequence number of the depth vision point in the depth vision point set, x j , y j , z j represents the three-dimensional coordinates of the depth vision point whose sequence number is j in the depth vision point set, and m represents the total number of depth vision points in the depth vision point set.

可以看出,本发明实施例通过计算深度视觉点集中视觉点的平均值,以用于在所述深度视觉点集中选取出视觉点的中心点。It can be seen that in the embodiment of the present invention, the average value of the visual points in the depth visual point set is calculated to select the central point of the visual point in the deep visual point set.

在第一方面的一种可能实现方式中,所述对所述点集平均重心进行平面拟合,得到所述深度视觉点集的拟合视觉平面,包括:In a possible implementation manner of the first aspect, performing plane fitting on the average center of gravity of the point set to obtain a fitted visual plane of the depth vision point set includes:

利用下述公式确定所述点集平均重心的平面拟合面参数:Utilize the following formula to determine the plane fitting surface parameters of the mean center of gravity of the point set:

Figure BDA0003876267550000042
Figure BDA0003876267550000042

Figure BDA0003876267550000051
Figure BDA0003876267550000051

其中,a,b,c表示所述点集平均重心的平面拟合面参数,xi,yi,zi表示所述点集平均重心的坐标,n表示深度视觉点集的点集数量;Wherein, a, b, c represent the plane fitting surface parameters of the average center of gravity of the point set, x i , y i , z i represent the coordinates of the average center of gravity of the point set, and n represents the number of point sets of the depth vision point set;

根据所述平面拟合面参数,利用下述公式构建所述深度视觉点集的拟合视觉平面:According to the plane fitting surface parameters, the following formula is used to construct the fitting vision plane of the depth vision point set:

z=ax+by+cz=ax+by+c

其中,z=ax+by+c表示所述深度视觉点集的拟合视觉平面,z,x,y表示平面函数的变量,a表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量x的参数,b表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量y的参数,c表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的常数。Wherein, z=ax+by+c represents the fitting visual plane of described depth vision point set, and z, x, y represent the variable of plane function, and a represents fitting in the plane fitting surface parameter of described point set mean center of gravity The parameter of the variable x of the visual plane function, b represents the parameter of the variable y of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and c represents the plane fitting surface parameter of the average center of gravity of the point set Constant for fitting the visual plane function.

可以看出,本发明实施例通过构建所述深度视觉点集的拟合视觉平面,以用于构建所述深度视觉点集中视觉点之间的平面函数关系。It can be seen that, in the embodiment of the present invention, the fitting visual plane of the depth visual point set is constructed to construct the plane function relationship among the visual points in the depth visual point set.

在第一方面的一种可能实现方式中,所述根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度,包括:In a possible implementation manner of the first aspect, the calculating the tire detection depth of the automobile tire according to the average center of gravity of the point set and the fitted visual plane includes:

利用下述公式计算所述汽车轮胎的轮胎检测深度:Utilize following formula to calculate the tire detection depth of described automobile tire:

Figure BDA0003876267550000052
Figure BDA0003876267550000052

其中,di表示所述汽车轮胎的轮胎检测深度,a表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量x的参数,b表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量y的参数,c表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的常数,d表示拟合视觉平面函数的变量z的参数,xi,yi,zi表示所述点集平均重心的坐标。Wherein, di represents the tire detection depth of the automobile tire, a represents the parameter of the variable x of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and b represents the plane of the average center of gravity of the point set The parameter of the variable y of the fitting visual plane function in the fitting surface parameter, c represents the constant of the fitting visual plane function in the plane fitting surface parameter of the mean center of gravity of the point set, and d represents the variable z of the fitting visual plane function The parameters, x i , y i , zi represent the coordinates of the mean center of gravity of the point set.

可以看出,本发明实施例通过计算所述汽车轮胎的轮胎检测深度,以用于检测深度是否与标准深度有偏差,以此来检测汽车轮胎是否存在缺陷。It can be seen that the embodiment of the present invention calculates the tire inspection depth of the automobile tire to detect whether the inspection depth deviates from the standard depth, so as to detect whether there is a defect in the automobile tire.

在第一方面的一种可能实现方式中,所述检测所述宽度检测区域的边缘视觉点,包括:In a possible implementation manner of the first aspect, the detecting the edge vision point of the width detection area includes:

利用下述公式对所述宽度检测区域进行二值化操作,得到二值化区域:The binarization operation is performed on the width detection area by using the following formula to obtain the binarization area:

Figure BDA0003876267550000061
Figure BDA0003876267550000061

其中,pi(xi,yi)表示所述二值化区域中的点云数据的坐标值,xi,yi,zi表示所述点集平均重心的坐标,k表示预先设置的图像像素参数;Wherein, p i (xi , y i ) represents the coordinate value of the point cloud data in the binarized region, xi , y i , z i represent the coordinates of the average center of gravity of the point set, and k represents the preset Image pixel parameters;

利用下述公式计算所述二值化区域的边缘点梯度:The edge point gradient of the binarized region is calculated using the following formula:

Figure BDA0003876267550000062
Figure BDA0003876267550000062

Figure BDA0003876267550000063
Figure BDA0003876267550000063

Figure BDA0003876267550000064
Figure BDA0003876267550000064

其中,|G(x,y)|表示所述二值化区域的边缘点梯度,sprt表示平方根计算,f(x+1,y),f(x,y),f(x,y+1)表示所述二值化区域的像素函数,

Figure BDA0003876267550000065
表示所述二值化区域中像素的一阶导数差分;Among them, |G(x, y)| represents the edge point gradient of the binarized region, sprt represents the square root calculation, f(x+1, y), f(x, y), f(x, y+1 ) represents the pixel function of the binarized region,
Figure BDA0003876267550000065
Representing the first-order derivative difference of pixels in the binarized region;

根据所述边缘点梯度,确定所述宽度检测区域的边缘视觉点。Determine the edge visual point of the width detection area according to the gradient of the edge point.

可以看出,本发明实施例通过计算所述二值化区域的边缘点梯度,以用于在所述二值化区域中找到像素梯度变换较大的点,作为宽度的缺陷检测的边缘线上的点。It can be seen that in the embodiment of the present invention, by calculating the edge point gradient of the binarized region, it is used to find a point with a larger pixel gradient transformation in the binarized region as the width of the defect detection edge line point.

在第一方面的一种可能实现方式中,所述对所述边缘视觉点进行边缘线拟合,得到拟合视觉线,包括:In a possible implementation manner of the first aspect, the performing edge line fitting on the edge visual point to obtain the fitted visual line includes:

利用下述公式计算所述边缘视觉点的拟合线参数:Utilize following formula to calculate the fitting line parameter of described edge vision point:

Figure BDA0003876267550000066
Figure BDA0003876267550000066

Figure BDA0003876267550000067
Figure BDA0003876267550000067

其中,A,B表示所述边缘视觉点的拟合线参数,xj,yj表示第j个边缘视觉点,M表示所述边缘视觉点的数量;Wherein, A, B represent the fitting line parameter of described edge vision point, x j , y j represent the jth edge vision point, M represents the quantity of described edge vision point;

利用下述公式对所述边缘视觉点进行边缘线拟合,得到拟合视觉线:Use following formula to carry out edge line fitting to described edge visual point, obtain fitting visual line:

Y=AX+BY=AX+B

其中,Y=AX+B表示所述拟合视觉线,A,B表示所述边缘视觉点的拟合线参数,Y,X表示直线函数的自变量。Wherein, Y=AX+B represents the fitting visual line, A, B represent the fitting line parameters of the peripheral vision point, Y, X represent the independent variable of the straight line function.

可以看出,本发明实施例通过对所述边缘视觉点进行边缘线拟合,以用于将宽度检测区域中与宽度有关的区域的边缘部分通过边缘线进行标识。It can be seen that, in the embodiment of the present invention, edge line fitting is performed on the edge visual point, so as to identify the edge part of the width-related area in the width detection area by the edge line.

第二方面,本发明提供了一种汽车轮胎的质量3D视觉全息检测装置,所述装置包括:In a second aspect, the present invention provides a quality 3D visual holographic detection device for automobile tires, said device comprising:

检测区域划分模块,用于采集汽车轮胎的三维轮廓数据,根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,得到三维重建图像,并划分所述三维重建图像的深度检测区域与宽度检测区域;The detection area division module is used to collect the three-dimensional contour data of the automobile tire, perform three-dimensional shape reconstruction on the automobile tire according to the three-dimensional contour data, obtain a three-dimensional reconstruction image, and divide the depth detection area and width of the three-dimensional reconstruction image Detection area;

检测深度计算模块,用于采样所述深度检测区域中的深度视觉点集,计算所述深度视觉点集的点集平均重心,对所述点集平均重心进行平面拟合,得到所述深度视觉点集的拟合视觉平面,根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度;The detection depth calculation module is used to sample the depth vision point set in the depth detection area, calculate the point set average center of gravity of the depth vision point set, and perform plane fitting on the point set average center of gravity to obtain the depth vision point set A fitting visual plane of the point set, calculating the tire detection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane;

检测宽度计算模块,用于检测所述宽度检测区域的边缘视觉点,对所述边缘视觉点进行边缘线拟合,得到拟合视觉线,根据所述边缘视觉点与所述拟合视觉线,计算所述汽车轮胎的轮胎检测宽度;The detection width calculation module is used to detect the edge visual point of the width detection area, and perform edge line fitting on the edge visual point to obtain a fitted visual line. According to the edge visual point and the fitted visual line, Calculate the tire detection width of the automobile tire;

检测结果确定模块,用于根据所述轮胎检测深度与所述轮胎检测宽度,确定所述汽车轮胎的三维视觉质量检测结果。The detection result determining module is used to determine the three-dimensional visual quality detection result of the automobile tire according to the tire detection depth and the tire detection width.

第三方面,本发明提供一种电子设备,包括:In a third aspect, the present invention provides an electronic device, comprising:

至少一个处理器;以及与所述至少一个处理器通信连接的存储器;at least one processor; and a memory communicatively coupled to the at least one processor;

其中,所述存储器存储有可被所述至少一个处理器执行的计算机程序,以使所述至少一个处理器能够执行如上述第一方面中任意一项所述的汽车轮胎的质量3D视觉全息检测方法。Wherein, the memory stores a computer program that can be executed by the at least one processor, so that the at least one processor can perform the quality 3D visual holographic inspection of automobile tires as described in any one of the first aspects above. method.

第四方面,本发明提供一种计算机可读存储介质,存储有计算机程序,所述计算机程序被处理器执行时实现如上述第一方面中任意一项所述的汽车轮胎的质量3D视觉全息检测方法。In a fourth aspect, the present invention provides a computer-readable storage medium, which stores a computer program, and when the computer program is executed by a processor, the 3D visual holographic detection of the quality of automobile tires as described in any one of the above-mentioned first aspects is realized. method.

与现有技术相比,本方案的技术原理及有益效果在于:Compared with the existing technology, the technical principle and beneficial effect of this scheme are:

本发明实施例首先通过采集汽车轮胎的三维轮廓数据,以用于对所述汽车轮胎的轮胎缺陷进行3D视觉全息检测,进一步地,本发明实施例通过根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,以用于构建所述汽车轮胎的三维虚拟模型,包含所述汽车轮胎的形态特征的三维虚拟模型实现对所述汽车轮胎的全面的检测,进一步地,本发明实施例通过划分所述三维重建图像的深度检测区域与宽度检测区域,以用于在对应的区域中检测轮胎胎纹的深度与宽度;In the embodiment of the present invention, firstly, the three-dimensional profile data of the automobile tire is collected for 3D visual holographic detection of the tire defect of the automobile tire. The three-dimensional shape reconstruction of the tire is used to construct the three-dimensional virtual model of the automobile tire, and the three-dimensional virtual model including the shape characteristics of the automobile tire realizes the comprehensive detection of the automobile tire. Further, the embodiment of the present invention adopts dividing the depth detection area and the width detection area of the three-dimensional reconstruction image, so as to detect the depth and width of the tire tread in the corresponding area;

进一步地,本发明实施例通过采样所述深度检测区域中的深度视觉点集,以用于整合所述深度检测区域中的点云数据实现对所述深度检测区域的全面检测,进一步地,本发明实施例通过计算所述深度视觉点集的点集平均重心,以用于确定所述深度视觉点集中的点的中心,进一步地,本发明实施例通过对所述点集平均重心进行平面拟合,以用于得到符合数据的函数关系,确定点云数据之间的联系,提升对所述点云数据的特征表征能力,保障对汽车轮胎缺陷检测的统一标准的检测流程,进一步地,本发明实施例通过根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度,以用于确定所述汽车轮胎的表面胎纹凹陷是否存在缺陷;Furthermore, in the embodiment of the present invention, the depth vision point set in the depth detection area is sampled to integrate the point cloud data in the depth detection area to achieve comprehensive detection of the depth detection area. Further, this The embodiment of the invention calculates the average center of gravity of the point set of the depth vision point set to determine the center of the point in the depth vision point set. combined to obtain the functional relationship of conforming data, determine the connection between point cloud data, improve the feature representation ability of the point cloud data, and ensure a unified standard detection process for automobile tire defect detection. Further, this The embodiment of the invention calculates the tire inspection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane, so as to determine whether there is a defect in the surface tread depression of the automobile tire;

进一步地,本发明实施例通过检测所述宽度检测区域的边缘视觉点,以用于标识数字图像中亮度变化明显的点,进一步地,本发明实施例通过对所述边缘视觉点进行边缘线拟合,以用于利用直线函数确定所述边缘视觉点中每个点与其他点的函数关系,进一步地,本发明实施例通过根据所述边缘视觉点与所述拟合视觉线,计算所述汽车轮胎的轮胎检测宽度,以用于通过查询宽度是否存在偏差来达到对轮胎缺陷检测的目的;Furthermore, the embodiment of the present invention detects the edge vision points in the width detection area to identify points with obvious brightness changes in the digital image. Further, the embodiment of the present invention performs edge line simulation on the edge vision points. to determine the functional relationship between each point in the peripheral vision points and other points by using a straight line function. Further, the embodiment of the present invention calculates the The tire detection width of automobile tires is used to detect tire defects by inquiring whether there is a deviation in the width;

进一步地,本发明实施例通过根据所述轮胎检测深度与所述轮胎检测宽度,确定所述汽车轮胎的三维视觉质量检测结果,以用于利用所检测到的深度与宽度数据确定所述汽车轮胎的表面是否存在缺陷。Further, in the embodiment of the present invention, the three-dimensional visual quality inspection result of the automobile tire is determined according to the tire inspection depth and the tire inspection width, so as to use the detected depth and width data to determine the automobile tire whether there are defects on the surface.

因此,本发明实施例提出的一种汽车轮胎的质量3D视觉全息检测方法、装置、电子设备以及存储介质,可以提高汽车轮胎的缺陷检测全面性。Therefore, the 3D visual holographic inspection method, device, electronic equipment, and storage medium for the quality of automobile tires proposed by the embodiments of the present invention can improve the comprehensiveness of defect detection of automobile tires.

附图说明Description of drawings

此处的附图被并入说明书中并构成本说明书的一部分,示出了符合本发明的实施例,并与说明书一起用于解释本发明的原理。The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and together with the description serve to explain the principles of the invention.

为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,对于本领域普通技术人员而言,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, for those of ordinary skill in the art, In other words, other drawings can also be obtained from these drawings without paying creative labor.

图1为本发明一实施例提供的一种汽车轮胎的质量3D视觉全息检测方法的流程示意图;Fig. 1 is a schematic flow diagram of a 3D visual holographic detection method for the quality of automobile tires provided by an embodiment of the present invention;

图2-图5为本发明一实施例中提供的三维轮廓数据的获取示意图;Fig. 2-Fig. 5 are schematic diagrams of acquisition of three-dimensional profile data provided in an embodiment of the present invention;

图6-图7为本发明一实施例中对汽车轮胎进行三维形态重建的示意图;6-7 are schematic diagrams of three-dimensional shape reconstruction of automobile tires in an embodiment of the present invention;

图8为本发明一实施例提供的一种汽车轮胎的质量3D视觉全息检测装置的模块示意图;Fig. 8 is a block diagram of a 3D visual holographic detection device for the quality of automobile tires provided by an embodiment of the present invention;

图9为本发明一实施例提供的实现汽车轮胎的质量3D视觉全息检测方法的电子设备的内部结构示意图。FIG. 9 is a schematic diagram of the internal structure of an electronic device implementing a 3D visual holographic inspection method for the quality of automobile tires provided by an embodiment of the present invention.

具体实施方式Detailed ways

应当理解,此处所描述的具体实施方式仅仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described here are only used to explain the present invention, and are not intended to limit the present invention.

本发明实施例提供一种汽车轮胎的质量3D视觉全息检测方法,汽车轮胎的质量3D视觉全息检测方法的执行主体包括但不限于服务端、终端等能够被配置为执行本发明实施例提供的该方法的电子设备中的至少一种。换言之,汽车轮胎的质量3D视觉全息检测方法可以由安装在终端设备或服务端设备的软件或硬件来执行,软件可以是区块链平台。服务端包括但不限于:单台服务器、服务器集群、云端服务器或云端服务器集群等。服务器可以是独立的服务器,也可以是提供云服务、云数据库、云计算、云函数、云存储、网络服务、云通信、中间件服务、域名服务、安全服务、内容分发网络(Content Delivery Network,CDN)、以及大数据和人工智能平台等基础云计算服务的云服务器。An embodiment of the present invention provides a 3D visual holographic detection method for the quality of automobile tires. The execution subject of the 3D visual holographic detection method for automobile tires includes but is not limited to a server, a terminal, etc., which can be configured to execute the method provided by the embodiment of the present invention. At least one of the electronic devices of the method. In other words, the 3D visual holographic inspection method for the quality of automobile tires can be implemented by software or hardware installed on terminal equipment or server equipment, and the software can be a blockchain platform. The server includes but is not limited to: single server, server cluster, cloud server or cloud server cluster, etc. The server can be an independent server, or it can provide cloud services, cloud database, cloud computing, cloud function, cloud storage, network service, cloud communication, middleware service, domain name service, security service, content delivery network (Content Delivery Network, CDN), and cloud servers for basic cloud computing services such as big data and artificial intelligence platforms.

参阅图1所示,是本发明一实施例提供的汽车轮胎的质量3D视觉全息检测方法的流程示意图。其中,图1中描述的汽车轮胎的质量3D视觉全息检测方法包括:Referring to FIG. 1 , it is a schematic flowchart of a 3D visual holographic inspection method for the quality of automobile tires provided by an embodiment of the present invention. Wherein, the quality 3D vision holographic detection method of automobile tire described in Fig. 1 comprises:

S1、采集汽车轮胎的三维轮廓数据,根据三维轮廓数据,对汽车轮胎进行三维形态重建,得到三维重建图像,并划分三维重建图像的深度检测区域与宽度检测区域。S1. Collect the 3D contour data of the automobile tire, reconstruct the 3D shape of the automobile tire according to the 3D contour data, obtain a 3D reconstruction image, and divide the depth detection area and the width detection area of the 3D reconstruction image.

本发明实施例通过采集汽车轮胎的三维轮廓数据,以用于对汽车轮胎的轮胎缺陷进行3D视觉全息检测。其中,三维轮廓数据是指利用3D视觉传感器采集的汽车轮胎表面的3D点云轮廓数据,3D视觉传感器主要利用激光三角测距原理测量三维数据,3D视觉传感器从激光发射端发射激光轮廓线,3D视觉传感器接收端接收到从轮胎表面反射回来的激光束后,即可获得当前轮胎表面单条轮廓数据。In the embodiment of the present invention, the three-dimensional profile data of the automobile tires are collected for 3D visual holographic detection of the tire defects of the automobile tires. Among them, the three-dimensional contour data refers to the 3D point cloud contour data of the automobile tire surface collected by the 3D visual sensor. The 3D visual sensor mainly uses the principle of laser triangulation to measure the three-dimensional data. After the receiving end of the visual sensor receives the laser beam reflected from the tire surface, it can obtain the single contour data of the current tire surface.

本发明的一实施例中,采集汽车轮胎的三维轮廓数据,包括:利用三维视觉传感器与电机编码器配置汽车轮胎的旋转检测平台;在旋转检测平台中,利用下述公式计算电机编码器的旋转编码信号:In one embodiment of the present invention, collecting three-dimensional profile data of automobile tires includes: using a three-dimensional vision sensor and a motor encoder to configure a rotation detection platform for automobile tires; on the rotation detection platform, using the following formula to calculate the rotation of the motor encoder Coded signal:

Figure BDA0003876267550000101
Figure BDA0003876267550000101

其中,E表示旋转编码信号,C表示汽车轮胎的轮胎周长,n表示轮廓间距;Among them, E represents the rotary encoding signal, C represents the tire circumference of the automobile tire, and n represents the contour spacing;

根据旋转编码信号,利用三维视觉传感器构建汽车轮胎的发射激光信号及其对应的反射激光信号;根据发射激光信号及其对应的反射激光信号,确定汽车轮胎的三维轮廓数据。According to the rotary encoding signal, the emitted laser signal and the corresponding reflected laser signal of the automobile tire are constructed by using the three-dimensional vision sensor; the three-dimensional contour data of the automobile tire is determined according to the emitted laser signal and the corresponding reflected laser signal.

示例性地,配备三个3D视觉传感器,从三个角度对汽车轮胎整体进行扫描检测,当轮胎为滚动状态时,三个3D视觉传感器的位置分别为轮胎的正上方与左右两侧,轮胎旋转一圈后,3台3D视觉传感器可以收集到整个轮胎胎冠面轮廓数据、两胎侧面轮廓数据,在检测时,轮胎的转动是由外部伺服电机带动轮胎被动旋转,将轮胎拆卸下来后,穿过连杆安装到轮胎检测装置,连杆另一端连接了伺服电机,伺服电机旋转带动轮胎旋转,当伺服电机带动轮胎旋转一圈时,伺服电机内的编码器也产生对应一圈3D轮胎轮廓线的信号的时间序列,本发明采用编码器信号中的A相信号作为触发信号,当伺服电机旋转使得A相脉冲为上升沿时,3D视觉传感器就会触发获取当前位置的轮廓线。For example, three 3D vision sensors are equipped to scan and detect the whole car tire from three angles. When the tire is in a rolling state, the positions of the three 3D vision sensors are directly above the tire and on the left and right sides respectively, and the tire rotates After one lap, the three 3D vision sensors can collect the profile data of the entire tire crown surface and the profile data of the two tires. During detection, the rotation of the tire is driven by the external servo motor to rotate passively. After the tire is removed, wear The connecting rod is installed to the tire detection device, and the other end of the connecting rod is connected to the servo motor. The rotation of the servo motor drives the tire to rotate. When the servo motor drives the tire to rotate a circle, the encoder in the servo motor also generates a corresponding circle of 3D tire contour lines. The time sequence of the signal, the present invention uses the A-phase signal in the encoder signal as the trigger signal, when the servo motor rotates so that the A-phase pulse is a rising edge, the 3D vision sensor will trigger to obtain the contour line of the current position.

为进一步了解三维轮廓数据的采集过程,可以参阅图2-图5所示,是本发明一实施例提供的三维轮廓数据的获取示意图,其中,图2用于表示三维视觉传感器发射激光信号的原理,其中三维视觉传感器发射至汽车轮胎表面的发射激光信号的高度通过z轴表示,通过y轴表示沿轮胎滚动方向的发射激光信号,通过x轴表示轮胎横向的发射激光信号,发射激光信号对应的反射激光信号从轮胎表面反射至三维视觉传感器,轮胎旋转一圈后,即可获得轮胎整个表面轮廓的3D点云数据;图3用于表示在所述旋转检测平台中构建的三维视觉传感器放置位置,三维视觉传感器分别放置在汽车轮胎的正上方与轮胎两侧,图4用于表示包含电机编码器的旋转检测平台,左侧的伺服电机表示电机编码器,在检测时,轮胎的转动是由外部伺服电机带动轮胎被动旋转,将轮胎拆卸下来后,穿过连杆安装到轮胎检测装置,连杆另一端连接了伺服电机,伺服电机旋转带动轮胎旋转,当伺服电机带动轮胎旋转一圈时,伺服电机内的编码器也产生对应一圈3D轮胎轮廓线的信号的时间序列;图5用于表示旋转编码信号触发三维视觉传感器采集是三维轮廓数据,本发明采用编码器信号中的A相信号作为触发信号,当伺服电机旋转使得A相脉冲为上升沿时,3D视觉传感器就会触发获取当前位置的轮廓线,触发方式可以考虑一个脉冲触发一次,也可以多个脉冲触发一次,或者当需要更为精细的触发信号,结合编码器A+、A-、B+、B-四项信号差分实现。In order to further understand the acquisition process of three-dimensional contour data, please refer to Figures 2-5, which are schematic diagrams of acquisition of three-dimensional contour data provided by an embodiment of the present invention, wherein Figure 2 is used to represent the principle of emitting laser signals from a three-dimensional vision sensor , wherein the height of the emitted laser signal emitted by the three-dimensional vision sensor to the surface of the automobile tire is represented by the z-axis, the emitted laser signal along the rolling direction of the tire is represented by the y-axis, and the emitted laser signal in the lateral direction of the tire is represented by the x-axis, and the corresponding The reflected laser signal is reflected from the tire surface to the three-dimensional vision sensor. After the tire rotates one circle, the 3D point cloud data of the entire surface contour of the tire can be obtained; Figure 3 is used to indicate the placement position of the three-dimensional vision sensor built in the rotation detection platform , the three-dimensional vision sensors are respectively placed on the top of the car tire and on both sides of the tire. Figure 4 is used to represent the rotation detection platform including the motor encoder. The servo motor on the left represents the motor encoder. During detection, the rotation of the tire is determined by The external servo motor drives the tire to rotate passively. After the tire is removed, it is installed on the tire detection device through the connecting rod. The other end of the connecting rod is connected to the servo motor. The rotation of the servo motor drives the tire to rotate. When the servo motor drives the tire to rotate one circle, The encoder in the servo motor also produces a time sequence of signals corresponding to a circle of 3D tire contour lines; Fig. 5 is used to indicate that the rotation encoding signal triggers the three-dimensional vision sensor to collect the three-dimensional contour data, and the present invention adopts the A-phase signal in the encoder signal As a trigger signal, when the servo motor rotates so that the phase A pulse is a rising edge, the 3D vision sensor will trigger to obtain the contour line of the current position. The trigger method can be considered to be triggered once by one pulse, or once by multiple pulses, or when needed A more precise trigger signal is realized by combining the encoder A+, A-, B+, and B- four signal differentials.

进一步地,本发明实施例通过根据三维轮廓数据,对汽车轮胎进行三维形态重建,以用于构建汽车轮胎的三维虚拟模型,包含汽车轮胎的形态特征的三维虚拟模型实现对汽车轮胎的全面的检测。其中,三维重建图像是指将原本由汽车轮胎表面的二维图像以及轮胎凹陷处的深度构成的二维深度图像转换得到的三维的立体图像,即汽车轮胎的三维虚拟模型结构图。Further, the embodiment of the present invention reconstructs the three-dimensional shape of the automobile tire according to the three-dimensional contour data, so as to construct the three-dimensional virtual model of the automobile tire, and the three-dimensional virtual model including the morphological characteristics of the automobile tire realizes the comprehensive detection of the automobile tire . Wherein, the 3D reconstructed image refers to a 3D stereoscopic image obtained by converting a 2D depth image originally composed of a 2D image of the surface of the tire and the depth of the tire depression, that is, a structural diagram of a 3D virtual model of the tire.

本发明的一实施例中,根据三维轮廓数据,对汽车轮胎进行三维形态重建,得到三维重建图像,包括:确定三维轮廓数据对应的二维深度图像;利用下述公式计算二维深度图像的深度平移坐标:In one embodiment of the present invention, according to the three-dimensional contour data, the automobile tire is reconstructed in three-dimensional form to obtain the three-dimensional reconstructed image, including: determining the two-dimensional depth image corresponding to the three-dimensional contour data; using the following formula to calculate the depth of the two-dimensional depth image Translation coordinates:

P(x′,0,z′)=P(x,y,z+r)P(x',0,z')=P(x,y,z+r)

其中,P(x′,0,z′)表示二维深度图像的深度平移坐标,r表示汽车轮胎的轮胎半径,x,y,z表示二维深度图像中所采集的汽车轮胎点云数据点的坐标;Among them, P(x′, 0, z′) represents the depth translation coordinates of the 2D depth image, r represents the tire radius of the car tire, and x, y, z represent the point cloud data points of the car tire collected in the 2D depth image coordinate of;

根据深度平移坐标,利用下述公式对二维深度图像进行三维形态重建,得到三维重建图像:According to the depth translation coordinates, the following formula is used to reconstruct the 3D shape of the 2D depth image to obtain a 3D reconstructed image:

θ=360°÷Nθ=360°÷N

Figure BDA0003876267550000121
Figure BDA0003876267550000121

x′=xx'=x

y′=cosα*y-sinα*zy'=cosα*y-sinα*z

z′=cosα*y+sinα*zz'=cosα*y+sinα*z

P(x″,y″,z″)=P(x′,0,z′)→P(x,cosα*y-sinα*z,cosα*y+sinα*z)P(x", y", z")=P(x', 0, z')→P(x, cosα*y-sinα*z, cosα*y+sinα*z)

其中,P(x″,y″,z″)表示三维重建图像中的点云数据,x″,y″,z″表示点云数据在三维重建图像中的坐标,i表示二维深度图像中轮廓线的序号,范围为[0,N],x,y,z表示二维深度图像中所采集的汽车轮胎点云数据点的坐标,P(x′,0,z′)表示二维深度图像的深度平移坐标。Among them, P(x", y", z") represents the point cloud data in the 3D reconstruction image, x", y", z" represents the coordinates of the point cloud data in the 3D reconstruction image, and i represents the point cloud data in the 2D depth image The serial number of the contour line, the range is [0, N], x, y, z represent the coordinates of the car tire point cloud data points collected in the two-dimensional depth image, P(x', 0, z') represents the two-dimensional depth The depth translation coordinates of the image.

为进一步了解对汽车轮胎进行三维形态重建的过程,可以参阅图6-图7所示,是本发明一实施例提供的对汽车轮胎进行三维形态重建的示意图,其中,图6用于表示三维轮廓数据对应的二维深度图像,设扫描整个轮胎面产生的轮廓数为N条,每个轮廓的间距为n(单位:mm),每条轮廓线由M个空间点组成,点与点之间的间距为m(单位:mm),在三维空间中,Y方向为轮廓线周长方向,X方向为单条轮廓线点点方向,3D视觉传感器为每个点提供Z方向的高度数据,由此可以对轮廓线沿着XOY投影面“拉抻”形成一个具有高度信息的2D高度图,每个图像像素信息P=(xi,yi,zi)为轮胎相对于相机坐标系下的坐标值,zi为轮胎表面到相机坐标系的高度值,且

Figure BDA0003876267550000122
yi∈(0,N*n),zi∈(-l,l),l属于3D视觉传感器的量程,由于系统坐标系原点在轮胎中心,所以空间点x坐标和z坐标值范围在正负区间中,图7用于表示三维重建图像,原始获取到深度图在XOY平面上,将平面上的若干条轮廓线先平移,再通过沿X轴方向旋转坐标变换后,达到对轮胎数据进行重构,实现对轮胎3D形态的还原。In order to further understand the process of reconstructing the three-dimensional shape of automobile tires, please refer to Figures 6-7, which are schematic diagrams of three-dimensional reconstruction of automobile tires provided by an embodiment of the present invention, wherein Figure 6 is used to represent the three-dimensional contour The two-dimensional depth image corresponding to the data, assuming that the number of contours generated by scanning the entire tire surface is N, the distance between each contour is n (unit: mm), and each contour line is composed of M spatial points. The spacing is m (unit: mm). In three-dimensional space, the Y direction is the perimeter direction of the contour line, and the X direction is the point direction of a single contour line. The 3D vision sensor provides height data in the Z direction for each point, so that The contour line is "stretched" along the XOY projection plane to form a 2D height map with height information, and the pixel information of each image P=( xi , y , zi ) is the coordinate value of the tire relative to the camera coordinate system , z i is the height value from the tire surface to the camera coordinate system, and
Figure BDA0003876267550000122
y i ∈ (0, N*n), z i ∈ (-l, l), l belongs to the range of the 3D vision sensor, since the origin of the system coordinate system is at the center of the tire, the range of the x coordinate and z coordinate values of the space point is positive In the negative interval, Figure 7 is used to represent the 3D reconstruction image. The original obtained depth map is on the XOY plane, and several contour lines on the plane are first translated, and then rotated along the X-axis direction to achieve the tire data. Reconstruction to restore the 3D shape of the tire.

进一步地,本发明实施例通过划分三维重建图像的深度检测区域与宽度检测区域,以用于在对应的区域中检测轮胎胎纹的深度与宽度。其中,深度检测区域是指需要计算轮胎的胎纹的凹陷深度的区域,宽度检测区域是指需要计算轮胎的胎纹的宽度的区域。Further, the embodiment of the present invention divides the depth detection area and the width detection area of the three-dimensional reconstructed image, so as to detect the depth and width of the tire tread in the corresponding area. Wherein, the depth detection area refers to the area where the concave depth of the tread of the tire needs to be calculated, and the width detection area refers to the area where the width of the tire tread needs to be calculated.

本发明的一实施例中,划分三维重建图像的深度检测区域与宽度检测区域,包括:在三维重建图像中查询汽车轮胎的胎纹轮廓线;将胎纹轮廓线对应的轮廓线区域作为三维重建图像的深度检测区域与宽度检测区域。In an embodiment of the present invention, dividing the depth detection area and the width detection area of the three-dimensional reconstruction image includes: querying the tread contour line of the automobile tire in the three-dimensional reconstruction image; taking the contour line area corresponding to the tread contour line as the three-dimensional reconstruction The depth detection area and width detection area of the image.

示例性地,胎纹轮廓线是指三维图像中汽车轮胎的滚动面中与滚动方向垂直的胎纹线条。Exemplarily, the tread outline refers to the tread lines perpendicular to the rolling direction in the rolling surface of the automobile tire in the three-dimensional image.

S2、采样深度检测区域中的深度视觉点集,计算深度视觉点集的点集平均重心,对点集平均重心进行平面拟合,得到深度视觉点集的拟合视觉平面,根据点集平均重心与拟合视觉平面,计算汽车轮胎的轮胎检测深度。S2. Sampling the depth vision point set in the depth detection area, calculating the average center of gravity of the point set of the depth vision point set, and performing plane fitting on the average center of gravity of the point set to obtain the fitting visual plane of the depth vision point set, according to the average center of gravity of the point set Compute the tire detection depth of a car tire with the fitted visual plane.

本发明实施例通过采样深度检测区域中的深度视觉点集,以用于整合深度检测区域中的点云数据实现对深度检测区域的全面检测。其中,深度视觉点集是指深度检测区域内的点云数据的数据点的集合。In the embodiment of the present invention, the depth vision point set in the depth detection area is sampled to integrate the point cloud data in the depth detection area to achieve comprehensive detection of the depth detection area. Wherein, the depth vision point set refers to a set of data points of the point cloud data in the depth detection area.

本发明的一实施例中,采样深度检测区域中的深度视觉点集,包括:采集深度检测区域中的深度视觉点坐标;将深度视觉点坐标对应的坐标集合作为深度视觉点集。In an embodiment of the present invention, sampling the depth vision point set in the depth detection area includes: collecting the depth vision point coordinates in the depth detection area; and using the coordinate set corresponding to the depth vision point coordinates as the depth vision point set.

进一步地,本发明实施例通过计算深度视觉点集的点集平均重心,以用于确定深度视觉点集中的点的中心。其中,点集平均重心是指重心是指地球对物体中每一微小部分引力的合力作用点,在本发明中表示深度视觉点集中的点的中心。Further, in the embodiment of the present invention, the point set average center of gravity of the depth vision point set is calculated to determine the center of the points in the depth vision point set. Wherein, the average center of gravity of the point set refers to the point where the resultant force of the earth's gravitational force on each tiny part of the object acts, and in the present invention represents the center of the concentrated point of the depth vision point.

本发明的一实施例中,利用下述公式计算深度视觉点集的点集平均重心:In one embodiment of the present invention, the point set average center of gravity of the depth vision point set is calculated using the following formula:

Figure BDA0003876267550000131
Figure BDA0003876267550000131

其中,Pi表示深度视觉点集的点集平均重心,i表示深度视觉点集中的序列号,j表示深度视觉点集中深度视觉点的序列号,xj,yj,zj表示深度视觉点集中序列号为j的深度视觉点的三维坐标,m表示深度视觉点集中深度视觉点的总数。Among them, P i represents the average center of gravity of the point set of the depth vision point set, i represents the sequence number of the depth vision point set, j represents the sequence number of the depth vision point in the depth vision point set, x j , y j , z j represent the depth vision point Set the three-dimensional coordinates of the depth vision point whose serial number is j, and m represents the total number of depth vision points in the depth vision point set.

进一步地,本发明实施例通过对点集平均重心进行平面拟合,以用于得到符合数据的函数关系,确定点云数据之间的联系,提升对点云数据的特征表征能力,保障对汽车轮胎缺陷检测的统一标准的检测流程。其中,拟合视觉平面是指利用平面函数表征的深度视觉点集。Further, the embodiment of the present invention performs plane fitting on the average center of gravity of the point set to obtain the functional relationship conforming to the data, determine the connection between the point cloud data, improve the feature representation ability of the point cloud data, and ensure the accuracy of the vehicle. A unified standard inspection process for tire defect detection. Wherein, the fitting visual plane refers to a set of depth visual points represented by a plane function.

本发明的一实施例中,对点集平均重心进行平面拟合,得到深度视觉点集的拟合视觉平面,包括:利用下述公式确定点集平均重心的平面拟合面参数:In an embodiment of the present invention, the plane fitting is carried out to the average center of gravity of the point set to obtain the fitted visual plane of the depth vision point set, including: using the following formula to determine the plane fitting surface parameters of the average center of gravity of the point set:

Figure BDA0003876267550000141
Figure BDA0003876267550000141

Figure BDA0003876267550000142
Figure BDA0003876267550000142

其中,a,b,c表示点集平均重心的平面拟合面参数,xi,yi,zi表示点集平均重心的坐标,n表示深度视觉点集的点集数量;Among them, a, b, c represent the plane fitting surface parameters of the average center of gravity of the point set, x i , y i , z i represent the coordinates of the average center of gravity of the point set, and n represents the number of point sets of the depth vision point set;

根据平面拟合面参数,利用下述公式构建深度视觉点集的拟合视觉平面:According to the parameters of the plane fitting surface, use the following formula to construct the fitting vision plane of the depth vision point set:

z=ax+by+cz=ax+by+c

其中,z=ax+by+c表示深度视觉点集的拟合视觉平面,z,x,y表示平面函数的变量,a表示点集平均重心的平面拟合面参数中拟合视觉平面函数的变量x的参数,b表示点集平均重心的平面拟合面参数中拟合视觉平面函数的变量y的参数,c表示点集平均重心的平面拟合面参数中拟合视觉平面函数的常数。Wherein, z=ax+by+c represents the fitting vision plane of depth vision point set, z, x, y represents the variable of plane function, and a represents the value of fitting vision plane function in the plane fitting surface parameter of point set mean center of gravity The parameter of the variable x, b represents the parameter of the variable y of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and c represents the constant of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set.

进一步地,本发明实施例通过根据点集平均重心与拟合视觉平面,计算汽车轮胎的轮胎检测深度,以用于确定汽车轮胎的表面胎纹凹陷是否存在缺陷。其中,轮胎检测深度是指轮胎表面胎纹的凹陷程度。Further, the embodiment of the present invention calculates the tire inspection depth of the automobile tire according to the average center of gravity of the point set and the fitted visual plane, so as to determine whether there is a defect in the surface tread depression of the automobile tire. Wherein, the tire detection depth refers to the degree of depression of the tread pattern on the tire surface.

本发明的一实施例中,根据点集平均重心与拟合视觉平面,利用下述公式计算汽车轮胎的轮胎检测深度:In one embodiment of the present invention, according to the average center of gravity of the point set and the fitting visual plane, the tire detection depth of the automobile tire is calculated using the following formula:

Figure BDA0003876267550000151
Figure BDA0003876267550000151

其中,di表示汽车轮胎的轮胎检测深度,a表示点集平均重心的平面拟合面参数中拟合视觉平面函数的变量x的参数,b表示点集平均重心的平面拟合面参数中拟合视觉平面函数的变量y的参数,c表示点集平均重心的平面拟合面参数中拟合视觉平面函数的常数,d表示拟合视觉平面函数的变量z的参数,xi,yi,zi表示点集平均重心的坐标。Among them, d i represents the tire detection depth of the car tire, a represents the parameter of the variable x of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and b represents the parameter of the plane fitting surface parameter of the average center of gravity of the point set The parameter of the variable y that fits the visual plane function, c represents the constant of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and d represents the parameter of the variable z that fits the visual plane function, x i , y i , z i represent the coordinates of the mean center of gravity of the point set.

S3、检测宽度检测区域的边缘视觉点,对边缘视觉点进行边缘线拟合,得到拟合视觉线,根据边缘视觉点与拟合视觉线,计算汽车轮胎的轮胎检测宽度。S3. Detecting the edge visual points of the width detection area, performing edge line fitting on the edge visual points to obtain a fitted visual line, and calculating the tire detection width of the automobile tire according to the edge visual points and the fitted visual line.

本发明实施例通过检测宽度检测区域的边缘视觉点,以用于标识数字图像中亮度变化明显的点。其中,边缘视觉点是指宽度检测区域中的边缘点。In the embodiment of the present invention, the edge vision points in the width detection area are detected to identify the points with obvious brightness changes in the digital image. Wherein, the edge visual point refers to the edge point in the width detection area.

本发明的一实施例中,检测宽度检测区域的边缘视觉点,包括:利用下述公式对宽度检测区域进行二值化操作,得到二值化区域:In an embodiment of the present invention, detecting the edge vision point of the width detection area includes: using the following formula to perform a binarization operation on the width detection area to obtain a binarized area:

Figure BDA0003876267550000152
Figure BDA0003876267550000152

其中,pi(xi,yi)表示二值化区域中的点云数据的坐标值,xi,yi,zi表示点集平均重心的坐标,k表示预先设置的图像像素参数;Among them, p i (xi , y i ) represents the coordinate value of the point cloud data in the binarization area, xi , y i , z i represent the coordinates of the average center of gravity of the point set, and k represents the preset image pixel parameters;

利用下述公式计算二值化区域的边缘点梯度:Use the following formula to calculate the edge point gradient of the binarized region:

Figure BDA0003876267550000153
Figure BDA0003876267550000153

Figure BDA0003876267550000154
Figure BDA0003876267550000154

Figure BDA0003876267550000155
Figure BDA0003876267550000155

其中,|G(x,y)|表示二值化区域的边缘点梯度,sprt表示平方根计算,f(x+1,y),f(x,y),f(x,y+1)表示二值化区域的像素函数,

Figure BDA0003876267550000156
表示二值化区域中像素的一阶导数差分;Among them, |G(x,y)|represents the edge point gradient of the binarized area, sprt represents the square root calculation, f(x+1,y), f(x,y), f(x,y+1) represents The pixel function of the binarized region,
Figure BDA0003876267550000156
Represents the first-order derivative difference of pixels in the binarized region;

根据边缘点梯度,确定宽度检测区域的边缘视觉点。Determine the edge vision point of the width detection area according to the gradient of the edge point.

可选地,根据边缘点梯度,确定宽度检测区域的边缘视觉点可以通过将边缘点梯度与预设阈值进行比较,若边缘点梯度大于预设阈值,则表示梯度变化较大,梯度对应的点为边缘点。Optionally, according to the gradient of the edge point, determining the edge visual point of the width detection area can be performed by comparing the gradient of the edge point with a preset threshold, if the gradient of the edge point is greater than the preset threshold, it means that the gradient changes greatly, and the point corresponding to the gradient for the edge points.

进一步地,本发明实施例通过对边缘视觉点进行边缘线拟合,以用于利用直线函数确定边缘视觉点中每个点与其他点的函数关系。其中,拟合视觉线通过直线函数表示。Further, in the embodiment of the present invention, edge line fitting is performed on the edge vision points, so as to use a straight line function to determine the functional relationship between each point in the edge vision points and other points. Wherein, the fitting visual line is represented by a straight line function.

本发明的一实施例中,对边缘视觉点进行边缘线拟合,得到拟合视觉线,包括:利用下述公式计算边缘视觉点的拟合线参数:In an embodiment of the present invention, performing edge line fitting on the edge visual point to obtain the fitted visual line includes: calculating the fitted line parameters of the edge visual point by using the following formula:

Figure BDA0003876267550000161
Figure BDA0003876267550000161

Figure BDA0003876267550000162
Figure BDA0003876267550000162

其中,A,B表示边缘视觉点的拟合线参数,xj,yj表示第j个边缘视觉点,M表示边缘视觉点的数量;Wherein, A, B represent the fitting line parameter of edge vision point, x j , y j represent the jth edge vision point, M represents the quantity of edge vision point;

利用下述公式对边缘视觉点进行边缘线拟合,得到拟合视觉线:Use the following formula to fit the edge line to the edge vision point to get the fitted vision line:

Y=AX+BY=AX+B

其中,Y=AX+B表示拟合视觉线,A,B表示边缘视觉点的拟合线参数,Y,X表示直线函数的自变量。Among them, Y=AX+B represents the fitting visual line, A and B represent the fitting line parameters of the edge visual points, and Y and X represent the independent variables of the straight line function.

进一步地,本发明实施例通过根据边缘视觉点与拟合视觉线,计算汽车轮胎的轮胎检测宽度,以用于通过查询宽度是否存在偏差来达到对轮胎缺陷检测的目的。其中,轮胎检测宽度是指轮胎胎纹宽度。Further, the embodiment of the present invention calculates the tire detection width of the automobile tire according to the edge visual point and the fitted visual line, so as to achieve the purpose of tire defect detection by querying whether there is a deviation in the width. Wherein, the tire detection width refers to the tire tread width.

本发明的一实施例中,根据边缘视觉点与拟合视觉线,利用下述公式计算汽车轮胎的轮胎检测宽度:In one embodiment of the present invention, according to the edge vision point and the fitted vision line, the tire detection width of the automobile tire is calculated using the following formula:

Figure BDA0003876267550000163
Figure BDA0003876267550000163

其中,W表示汽车轮胎的轮胎检测宽度,x,y表示待求取的边缘点P(x,y),A,B表示边缘视觉点的拟合线参数。Among them, W represents the tire detection width of the car tire, x, y represent the edge point P(x, y) to be obtained, and A, B represent the fitting line parameters of the edge visual point.

S4、根据轮胎检测深度与轮胎检测宽度,确定汽车轮胎的三维视觉质量检测结果。S4. Determine the three-dimensional visual quality inspection result of the automobile tire according to the tire inspection depth and the tire inspection width.

本发明实施例通过根据轮胎检测深度与轮胎检测宽度,确定汽车轮胎的三维视觉质量检测结果,以用于利用所检测到的深度与宽度数据确定汽车轮胎的表面是否存在缺陷。其中,三维视觉质量检测结果是指轮胎检测深度与轮胎检测宽度的组合。The embodiment of the present invention determines the three-dimensional visual quality inspection result of the automobile tire according to the tire inspection depth and the tire inspection width, so as to use the detected depth and width data to determine whether there is a defect on the surface of the automobile tire. Wherein, the three-dimensional visual quality detection result refers to a combination of tire detection depth and tire detection width.

可以看出,本发明实施例首先通过采集汽车轮胎的三维轮廓数据,以用于对所述汽车轮胎的轮胎缺陷进行3D视觉全息检测,进一步地,本发明实施例通过根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,以用于构建所述汽车轮胎的三维虚拟模型,包含所述汽车轮胎的形态特征的三维虚拟模型实现对所述汽车轮胎的全面的检测,进一步地,本发明实施例通过划分所述三维重建图像的深度检测区域与宽度检测区域,以用于在对应的区域中检测轮胎胎纹的深度与宽度;It can be seen that the embodiment of the present invention first collects the three-dimensional contour data of the automobile tires for 3D visual holographic detection of the tire defects of the automobile tires. Further, the embodiment of the present invention uses the three-dimensional contour data to Reconstructing the three-dimensional shape of the automobile tire to construct a three-dimensional virtual model of the automobile tire, the three-dimensional virtual model including the shape characteristics of the automobile tire realizes the comprehensive detection of the automobile tire, further, this The embodiment of the invention divides the depth detection area and the width detection area of the three-dimensional reconstruction image to detect the depth and width of the tire tread in the corresponding area;

进一步地,本发明实施例通过采样所述深度检测区域中的深度视觉点集,以用于整合所述深度检测区域中的点云数据实现对所述深度检测区域的全面检测,进一步地,本发明实施例通过计算所述深度视觉点集的点集平均重心,以用于确定所述深度视觉点集中的点的中心,进一步地,本发明实施例通过对所述点集平均重心进行平面拟合,以用于得到符合数据的函数关系,确定点云数据之间的联系,提升对所述点云数据的特征表征能力,保障对汽车轮胎缺陷检测的统一标准的检测流程,进一步地,本发明实施例通过根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度,以用于确定所述汽车轮胎的表面胎纹凹陷是否存在缺陷;Furthermore, in the embodiment of the present invention, the depth vision point set in the depth detection area is sampled to integrate the point cloud data in the depth detection area to achieve comprehensive detection of the depth detection area. Further, this The embodiment of the invention calculates the average center of gravity of the point set of the depth vision point set to determine the center of the point in the depth vision point set. combined to obtain the functional relationship of conforming data, determine the connection between point cloud data, improve the feature representation ability of the point cloud data, and ensure a unified standard detection process for automobile tire defect detection. Further, this The embodiment of the invention calculates the tire inspection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane, so as to determine whether there is a defect in the surface tread depression of the automobile tire;

进一步地,本发明实施例通过检测所述宽度检测区域的边缘视觉点,以用于标识数字图像中亮度变化明显的点,进一步地,本发明实施例通过对所述边缘视觉点进行边缘线拟合,以用于利用直线函数确定所述边缘视觉点中每个点与其他点的函数关系,进一步地,本发明实施例通过根据所述边缘视觉点与所述拟合视觉线,计算所述汽车轮胎的轮胎检测宽度,以用于通过查询宽度是否存在偏差来达到对轮胎缺陷检测的目的;Furthermore, the embodiment of the present invention detects the edge vision points in the width detection area to identify points with obvious brightness changes in the digital image. Further, the embodiment of the present invention performs edge line simulation on the edge vision points. to determine the functional relationship between each point in the peripheral vision points and other points by using a straight line function. Further, the embodiment of the present invention calculates the The tire detection width of automobile tires is used to detect tire defects by inquiring whether there is a deviation in the width;

进一步地,本发明实施例通过根据所述轮胎检测深度与所述轮胎检测宽度,确定所述汽车轮胎的三维视觉质量检测结果,以用于利用所检测到的深度与宽度数据确定所述汽车轮胎的表面是否存在缺陷。Further, in the embodiment of the present invention, the three-dimensional visual quality inspection result of the automobile tire is determined according to the tire inspection depth and the tire inspection width, so as to use the detected depth and width data to determine the automobile tire whether there are defects on the surface.

因此,本发明实施例提出的一种汽车轮胎的质量3D视觉全息检测方法可以提高汽车轮胎的缺陷检测全面性。Therefore, the 3D visual holographic inspection method for the quality of automobile tires proposed by the embodiment of the present invention can improve the comprehensiveness of defect detection of automobile tires.

如图8所示,是本发明汽车轮胎的质量3D视觉全息检测装置功能模块图。As shown in FIG. 8 , it is a functional block diagram of the 3D visual holographic detection device for the quality of automobile tires of the present invention.

本发明汽车轮胎的质量3D视觉全息检测装置800可以安装于电子设备中。根据实现的功能,汽车轮胎的质量3D视觉全息检测装置可以包括检测区域划分模块801、检测深度计算模块802、检测宽度计算模块803以及检测结果确定模块804。本发明模块也可以称之为单元,是指一种能够被电子设备处理器所执行,并且能够完成固定功能的一系列计算机程序段,其存储在电子设备的存储器中。The 3D visual holographic detection device 800 for the quality of automobile tires of the present invention can be installed in electronic equipment. According to the realized functions, the quality 3D visual holographic detection device for automobile tires may include a detection area division module 801 , a detection depth calculation module 802 , a detection width calculation module 803 and a detection result determination module 804 . The module of the present invention can also be called a unit, which refers to a series of computer program segments that can be executed by the processor of the electronic device and can complete fixed functions, and are stored in the memory of the electronic device.

在本发明实施例中,关于各模块/单元的功能如下:In the embodiment of the present invention, the functions of each module/unit are as follows:

检测区域划分模块801,用于采集汽车轮胎的三维轮廓数据,根据三维轮廓数据,对汽车轮胎进行三维形态重建,得到三维重建图像,并划分三维重建图像的深度检测区域与宽度检测区域;The detection area division module 801 is used to collect the three-dimensional contour data of the automobile tire, perform three-dimensional shape reconstruction on the automobile tire according to the three-dimensional contour data, obtain a three-dimensional reconstruction image, and divide the depth detection area and the width detection area of the three-dimensional reconstruction image;

检测深度计算模块802,用于采样深度检测区域中的深度视觉点集,计算深度视觉点集的点集平均重心,对点集平均重心进行平面拟合,得到深度视觉点集的拟合视觉平面,根据点集平均重心与拟合视觉平面,计算汽车轮胎的轮胎检测深度;The detection depth calculation module 802 is used to sample the depth vision point set in the depth detection area, calculate the average center of gravity of the point set of the depth vision point set, and perform plane fitting on the average center of gravity of the point set to obtain the fitted vision plane of the depth vision point set , calculate the tire detection depth of the car tire according to the average center of gravity of the point set and the fitted visual plane;

检测宽度计算模块803,用于检测宽度检测区域的边缘视觉点,对边缘视觉点进行边缘线拟合,得到拟合视觉线,根据边缘视觉点与拟合视觉线,计算汽车轮胎的轮胎检测宽度;The detection width calculation module 803 is used to detect the edge visual points of the width detection area, and perform edge line fitting on the edge visual points to obtain the fitted visual line, and calculate the tire detection width of the automobile tire according to the edge visual points and the fitted visual line ;

检测结果确定模块804,用于根据轮胎检测深度与轮胎检测宽度,确定汽车轮胎的三维视觉质量检测结果。The detection result determining module 804 is configured to determine the three-dimensional visual quality detection result of the automobile tire according to the tire detection depth and the tire detection width.

详细地,本发明实施例中汽车轮胎的质量3D视觉全息检测装置800中的各模块在使用时采用与上述的图1至图7中的汽车轮胎的质量3D视觉全息检测方法一样的技术手段,并能够产生相同的技术效果,这里不再赘述。如图9所示,是本发明实现汽车轮胎的质量3D视觉全息检测方法的电子设备的结构示意图。In detail, each module in the 3D visual holographic detection device 800 for car tire quality in the embodiment of the present invention adopts the same technical means as the above-mentioned 3D visual holographic test method for car tire quality in FIGS. 1 to 7 , And can produce the same technical effect, and will not repeat them here. As shown in FIG. 9 , it is a schematic structural diagram of an electronic device implementing a 3D visual holographic detection method for the quality of automobile tires according to the present invention.

电子设备可以包括处理器90、存储器91、通信总线92以及通信接口93,还可以包括存储在存储器91中并可在处理器90上运行的计算机程序,如汽车轮胎的质量3D视觉全息检测程序。The electronic device may include a processor 90, a memory 91, a communication bus 92, and a communication interface 93, and may also include a computer program stored in the memory 91 and operable on the processor 90, such as a 3D visual holographic inspection program for the quality of automobile tires.

其中,处理器90在一些实施例中可以由集成电路组成,例如可以由单个封装的集成电路所组成,也可以是由多个相同功能或不同功能封装的集成电路所组成,包括一个或者多个中央处理器(Central Processing unit,CPU)、微处理器、数字处理芯片、图形处理器及各种控制芯片的组合等。处理器90是电子设备的控制核心(Control Unit),利用各种接口和线路连接整个电子设备的各个部件,通过运行或执行存储在存储器91内的程序或者模块(例如执行汽车轮胎的质量3D视觉全息检测程序等),以及调用存储在存储器91内的数据,以执行电子设备的各种功能和处理数据。Wherein, the processor 90 may be composed of integrated circuits in some embodiments, for example, may be composed of a single packaged integrated circuit, or may be composed of multiple integrated circuits with the same function or different functions packaged, including one or more Combination of central processing unit (Central Processing unit, CPU), microprocessor, digital processing chip, graphics processor and various control chips, etc. The processor 90 is the control core (Control Unit) of the electronic equipment. It uses various interfaces and lines to connect the various components of the entire electronic equipment, and runs or executes programs or modules stored in the memory 91 (for example, the quality 3D vision of automobile tires is executed). holographic detection program, etc.), and call the data stored in the memory 91 to execute various functions of the electronic device and process data.

存储器91至少包括一种类型的可读存储介质,可读存储介质包括闪存、移动硬盘、多媒体卡、卡型存储器(例如:SD或DX存储器等)、磁性存储器、磁盘、光盘等。存储器91在一些实施例中可以是电子设备的内部存储单元,例如该电子设备的移动硬盘。存储器91在另一些实施例中也可以是电子设备的外部存储设备,例如电子设备上配备的插接式移动硬盘、智能存储卡(Smart Media Card,SMC)、安全数字(Secure Digital,SD)卡、闪存卡(Flash Card)等。进一步地,存储器91还可以既包括电子设备的内部存储单元也包括外部存储设备。存储器91不仅可以用于存储安装于电子设备的应用软件及各类数据,例如数据库配置化连接程序的代码等,还可以用于暂时地存储已经输出或者将要输出的数据。The memory 91 includes at least one type of readable storage medium, and the readable storage medium includes a flash memory, a mobile hard disk, a multimedia card, a memory card (for example: SD or DX memory, etc.), a magnetic memory, a magnetic disk, an optical disk, and the like. In some embodiments, the memory 91 may be an internal storage unit of the electronic device, such as a mobile hard disk of the electronic device. In other embodiments, the memory 91 may also be an external storage device of the electronic device, such as a plug-in mobile hard disk equipped on the electronic device, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card , Flash Card (Flash Card), etc. Further, the memory 91 may also include both an internal storage unit of the electronic device and an external storage device. The memory 91 can not only be used to store application software and various data installed in electronic equipment, such as codes of database configuration connection programs, etc., but also can be used to temporarily store data that has been output or will be output.

通信总线92可以是外设部件互连标准(peripheral component interconnect,简称PCI)总线或扩展工业标准结构(extended industry standard architecture,简称EISA)总线等。该总线可以分为地址总线、数据总线、控制总线等。总线被设置为实现存储器91以及至少一个处理器90等之间的连接通信。The communication bus 92 may be a peripheral component interconnect (PCI for short) bus or an extended industry standard architecture (EISA for short) bus or the like. The bus can be divided into address bus, data bus, control bus and so on. The bus is set to realize connection communication between the memory 91 and at least one processor 90 and the like.

通信接口93用于上述电子设备9与其他设备之间的通信,包括网络接口和用户接口。可选地,网络接口可以包括有线接口和/或无线接口(如WI-FI接口、蓝牙接口等),通常用于在该电子设备与其他电子设备之间建立通信连接。用户接口可以是显示器(Display)、输入单元(比如键盘(Keyboard)),可选地,用户接口还可以是标准的有线接口、无线接口。可选地,在一些实施例中,显示器可以是LED显示器、液晶显示器、触控式液晶显示器以及OLED(Organic Light-Emitting Diode,有机发光二极管)触摸器等。其中,显示器也可以适当的称为显示屏或显示单元,用于显示在电子设备中处理的信息以及用于显示可视化的用户界面。The communication interface 93 is used for communication between the electronic device 9 and other devices, including a network interface and a user interface. Optionally, the network interface may include a wired interface and/or a wireless interface (such as a WI-FI interface, a Bluetooth interface, etc.), and is generally used to establish a communication connection between the electronic device and other electronic devices. The user interface may be a display (Display) or an input unit (such as a keyboard (Keyboard)). Optionally, the user interface may also be a standard wired interface or a wireless interface. Optionally, in some embodiments, the display may be an LED display, a liquid crystal display, a touch-sensitive liquid crystal display, an OLED (Organic Light-Emitting Diode, Organic Light-Emitting Diode) touch panel, and the like. Wherein, the display may also be properly referred to as a display screen or a display unit, and is used for displaying information processed in the electronic device and for displaying a visualized user interface.

图9仅示出了具有部件的电子设备,本领域技术人员可以理解的是,图9示出的结构并不构成对电子设备的限定,可以包括比图示更少或者更多的部件,或者组合某些部件,或者不同的部件布置。FIG. 9 only shows an electronic device with components. Those skilled in the art can understand that the structure shown in FIG. Combining certain parts, or different arrangements of parts.

例如,尽管未示出,电子设备还可以包括给各个部件供电的电源(比如电池),优选地,电源可以通过电源管理装置与至少一个处理器90逻辑相连,从而通过电源管理装置实现充电管理、放电管理、以及功耗管理等功能。电源还可以包括一个或一个以上的直流或交流电源、再充电装置、电源故障检测电路、电源转换器或者逆变器、电源状态指示器等任意组件。电子设备还可以包括多种传感器、蓝牙模块、Wi-Fi模块等,在此不再赘述。For example, although not shown, the electronic device may also include a power supply (such as a battery) for supplying power to various components. Preferably, the power supply may be logically connected to at least one processor 90 through a power management device, thereby implementing charging management, discharge management, and power management functions. The power supply may also include one or more DC or AC power supplies, recharging devices, power failure detection circuits, power converters or inverters, power status indicators and other arbitrary components. The electronic device may also include various sensors, bluetooth modules, Wi-Fi modules, etc., which will not be repeated here.

应该了解,实施例仅为说明之用,在专利发明范围上并不受此结构的限制。It should be understood that the embodiment is only for illustration, and is not limited by the structure in the scope of the patented invention.

电子设备中的存储器91存储的数据库配置化连接程序是多个计算机程序的组合,在处理器90中运行时,可以实现:The database configuration connection program stored in the memory 91 in the electronic device is a combination of multiple computer programs. When running in the processor 90, it can realize:

采集汽车轮胎的三维轮廓数据,根据三维轮廓数据,对汽车轮胎进行三维形态重建,得到三维重建图像,并划分三维重建图像的深度检测区域与宽度检测区域;Collect the 3D profile data of the car tires, reconstruct the 3D shape of the car tires according to the 3D profile data, obtain the 3D reconstructed image, and divide the depth detection area and width detection area of the 3D reconstruction image;

采样深度检测区域中的深度视觉点集,计算深度视觉点集的点集平均重心,对点集平均重心进行平面拟合,得到深度视觉点集的拟合视觉平面,根据点集平均重心与拟合视觉平面,计算汽车轮胎的轮胎检测深度;Sample the depth vision point set in the depth detection area, calculate the point set average center of gravity of the depth vision point set, and perform plane fitting on the point set average center of gravity to obtain the fitted visual plane of the depth vision point set. Combined with the visual plane, calculate the tire detection depth of the car tire;

检测宽度检测区域的边缘视觉点,对边缘视觉点进行边缘线拟合,得到拟合视觉线,根据边缘视觉点与拟合视觉线,计算汽车轮胎的轮胎检测宽度;Detecting the edge visual points of the width detection area, performing edge line fitting on the edge visual points to obtain the fitted visual lines, and calculating the tire detection width of the automobile tires according to the edge visual points and the fitted visual lines;

根据轮胎检测深度与轮胎检测宽度,确定汽车轮胎的三维视觉质量检测结果。According to the tire detection depth and tire detection width, the 3D visual quality detection results of automobile tires are determined.

具体地,处理器90对上述计算机程序的具体实现方法可参考图1对应实施例中相关步骤的描述,在此不赘述。Specifically, for a specific implementation method of the above computer program by the processor 90, reference may be made to the description of relevant steps in the embodiment corresponding to FIG. 1 , and details are not repeated here.

进一步地,电子设备集成的模块/单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个非易失性计算机可读取存储介质中。存储介质可以是易失性的,也可以是非易失性的。例如,计算机可读介质可以包括:能够携带计算机程序代码的任何实体或装置、记录介质、U盘、移动硬盘、磁碟、光盘、计算机存储器、只读存储器(ROM,Read-Only Memory)。Furthermore, if the integrated module/unit of the electronic device is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a non-volatile computer-readable storage medium. Storage media can be either volatile or nonvolatile. For example, a computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, removable hard disk, magnetic disk, optical disk, computer memory, and read-only memory (ROM, Read-Only Memory).

本发明还提供一种存储介质,可读存储介质存储有计算机程序,计算机程序在被电子设备的处理器所执行时,可以实现:The present invention also provides a storage medium. The readable storage medium stores a computer program. When the computer program is executed by the processor of the electronic device, it can realize:

采集汽车轮胎的三维轮廓数据,根据三维轮廓数据,对汽车轮胎进行三维形态重建,得到三维重建图像,并划分三维重建图像的深度检测区域与宽度检测区域;Collect the 3D profile data of the car tires, reconstruct the 3D shape of the car tires according to the 3D profile data, obtain the 3D reconstructed image, and divide the depth detection area and width detection area of the 3D reconstruction image;

采样深度检测区域中的深度视觉点集,计算深度视觉点集的点集平均重心,对点集平均重心进行平面拟合,得到深度视觉点集的拟合视觉平面,根据点集平均重心与拟合视觉平面,计算汽车轮胎的轮胎检测深度;Sample the depth vision point set in the depth detection area, calculate the point set average center of gravity of the depth vision point set, and perform plane fitting on the point set average center of gravity to obtain the fitted visual plane of the depth vision point set. Combined with the visual plane, calculate the tire detection depth of the car tire;

检测宽度检测区域的边缘视觉点,对边缘视觉点进行边缘线拟合,得到拟合视觉线,根据边缘视觉点与拟合视觉线,计算汽车轮胎的轮胎检测宽度;Detecting the edge visual points of the width detection area, performing edge line fitting on the edge visual points to obtain the fitted visual lines, and calculating the tire detection width of the automobile tires according to the edge visual points and the fitted visual lines;

根据轮胎检测深度与轮胎检测宽度,确定汽车轮胎的三维视觉质量检测结果。According to the tire detection depth and tire detection width, the 3D visual quality detection results of automobile tires are determined.

在本发明所提供的几个实施例中,应该理解到,所揭露的设备,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。In the several embodiments provided by the present invention, it should be understood that the disclosed devices, devices and methods can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division, and there may be other division methods in actual implementation.

作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。A module described as a separate component may or may not be physically separated, and a component shown as a module may or may not be a physical unit, that is, it may be located in one place, or may also be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

另外,在本发明各个实施例中的各功能模块可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能模块的形式实现。In addition, each functional module in each embodiment of the present invention may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware, or in the form of hardware plus software function modules.

对于本领域技术人员而言,显然本发明不限于上述示范性实施例的细节,而且在不背离本发明的精神或基本特征的情况下,能够以其他的具体形式实现本发明。It will be apparent to those skilled in the art that the invention is not limited to the details of the above-described exemplary embodiments, but that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention.

因此,无论从哪一点来看,均应将实施例看作是示范性的,而且是非限制性的,本发明的范围由所附权利要求而不是上述说明限定,因此旨在将落在权利要求的等同要件的含义和范围内的所有变化涵括在本发明内。不应将权利要求中的任何附关联图标记视为限制所涉及的权利要求。Accordingly, the embodiments should be regarded in all points of view as exemplary and not restrictive, the scope of the invention being defined by the appended claims rather than the foregoing description, and it is therefore intended that the scope of the invention be defined by the appended claims rather than by the foregoing description. All changes within the meaning and range of equivalents of the elements are embraced in the present invention. Any reference sign in a claim should not be construed as limiting the claim concerned.

需要说明的是,在本文中,诸如“第一”和“第二”等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relative terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these No such actual relationship or order exists between entities or operations. Furthermore, the term "comprises", "comprises" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article, or apparatus comprising a set of elements includes not only those elements, but also includes elements not expressly listed. other elements of or also include elements inherent in such a process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

以上仅是本发明的具体实施方式,使本领域技术人员能够理解或实现本发明。对这些实施例的多种修改对本领域的技术人员来说将是显而易见的,本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下,在其它实施例中实现。因此,本发明将不会被限制于本文所示的这些实施例,而是要符合与本文所发明的原理和新颖特点相一致的最宽的范围。The above are only specific embodiments of the present invention, so that those skilled in the art can understand or implement the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features of the invention herein.

Claims (12)

1.一种汽车轮胎的质量3D视觉全息检测方法,其特征在于,所述方法包括:1. a quality 3D visual holographic detection method of automobile tire, is characterized in that, described method comprises: 采集汽车轮胎的三维轮廓数据,根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,得到三维重建图像,并划分所述三维重建图像的深度检测区域与宽度检测区域;Collecting three-dimensional contour data of automobile tires, performing three-dimensional shape reconstruction on the automobile tires according to the three-dimensional contour data, obtaining a three-dimensional reconstruction image, and dividing a depth detection area and a width detection area of the three-dimensional reconstruction image; 采样所述深度检测区域中的深度视觉点集,计算所述深度视觉点集的点集平均重心,对所述点集平均重心进行平面拟合,得到所述深度视觉点集的拟合视觉平面,根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度;Sampling the depth vision point set in the depth detection area, calculating the average center of gravity of the point set of the depth vision point set, and performing plane fitting on the average center of gravity of the point set, to obtain the fitting visual plane of the depth vision point set , calculating the tire detection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane; 检测所述宽度检测区域的边缘视觉点,对所述边缘视觉点进行边缘线拟合,得到拟合视觉线,根据所述边缘视觉点与所述拟合视觉线,计算所述汽车轮胎的轮胎检测宽度;Detecting the edge visual points of the width detection area, performing edge line fitting on the edge visual points to obtain a fitted visual line, and calculating the tire size of the automobile tire according to the edge visual points and the fitted visual line detection width; 根据所述轮胎检测深度与所述轮胎检测宽度,确定所述汽车轮胎的三维视觉质量检测结果。According to the tire detection depth and the tire detection width, the three-dimensional visual quality detection result of the automobile tire is determined. 2.根据权利要求1所述的方法,其特征在于,所述采集汽车轮胎的三维轮廓数据,包括:2. The method according to claim 1, wherein the three-dimensional profile data of said collection of automobile tires comprises: 利用三维视觉传感器与电机编码器配置所述汽车轮胎的旋转检测平台;Using a three-dimensional vision sensor and a motor encoder to configure the rotation detection platform of the automobile tire; 在所述旋转检测平台中,利用下述公式计算所述电机编码器的旋转编码信号:In the rotation detection platform, the following formula is used to calculate the rotation encoding signal of the motor encoder:
Figure FDA0003876267540000011
Figure FDA0003876267540000011
其中,E表示所述旋转编码信号,C表示所述汽车轮胎的轮胎周长,n表示轮廓间距;Wherein, E represents the rotary encoding signal, C represents the tire circumference of the automobile tire, and n represents the contour spacing; 根据所述旋转编码信号,利用所述三维视觉传感器构建所述汽车轮胎的发射激光信号及其对应的反射激光信号;Constructing the emitted laser signal of the automobile tire and its corresponding reflected laser signal by using the three-dimensional vision sensor according to the rotary encoding signal; 根据所述发射激光信号及其对应的反射激光信号,确定所述汽车轮胎的三维轮廓数据。According to the emitted laser signal and its corresponding reflected laser signal, the three-dimensional profile data of the automobile tire is determined.
3.根据权利要求1所述的方法,其特征在于,所述根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,得到三维重建图像,包括:3. The method according to claim 1, wherein, according to the three-dimensional profile data, performing three-dimensional shape reconstruction on the automobile tire to obtain a three-dimensional reconstructed image comprises: 确定所述三维轮廓数据对应的二维深度图像;determining a two-dimensional depth image corresponding to the three-dimensional contour data; 利用下述公式计算所述二维深度图像的深度平移坐标:The depth translation coordinates of the two-dimensional depth image are calculated using the following formula: P(x′,0,z′)=P(x,y,z+r)P(x',0,z')=P(x,y,z+r) 其中,P(x′,0,z′)表示所述二维深度图像的深度平移坐标,r表示所述汽车轮胎的轮胎半径,x,y,z表示所述二维深度图像中所采集的汽车轮胎点云数据点的坐标;Wherein, P(x', 0, z') represents the depth translation coordinates of the two-dimensional depth image, r represents the tire radius of the automobile tire, and x, y, z represent the collected values in the two-dimensional depth image Coordinates of car tire point cloud data points; 根据所述深度平移坐标,利用下述公式对所述二维深度图像进行三维形态重建,得到三维重建图像:According to the depth translation coordinates, the following formula is used to perform three-dimensional reconstruction on the two-dimensional depth image to obtain a three-dimensional reconstructed image: θ=360°÷Nθ=360°÷N
Figure FDA0003876267540000021
Figure FDA0003876267540000021
x′=xx'=x y′=cosα*y-sinα*zy'=cosα*y-sinα*z z′=cosα*y+sinα*zz'=cosα*y+sinα*z P(x″,y″,z″)=P(x′,0,z′)→P(x,cosα*y-sinα*z,cosα*y+sinα*z)P(x", y", z")=P(x', 0, z')→P(x, cosα*y-sinα*z, cosα*y+sinα*z) 其中,P(x″,y″,z″)表示所述三维重建图像中的点云数据,x″,y″,z″表示所述点云数据在所述三维重建图像中的坐标,i表示所述二维深度图像中轮廓线的序号,范围为[0,N],x,y,z表示所述二维深度图像中所采集的汽车轮胎点云数据点的坐标,P(x′,0,z′)表示所述二维深度图像的深度平移坐标。Wherein, P (x ", y ", z ") represents the point cloud data in the described three-dimensional reconstructed image, x ", y ", z " represents the coordinate of described point cloud data in the described three-dimensional reconstructed image, i Represents the serial number of the contour line in the two-dimensional depth image, the range is [0, N], x, y, z represent the coordinates of the car tire point cloud data points collected in the two-dimensional depth image, P(x' , 0, z') represent the depth translation coordinates of the two-dimensional depth image.
4.根据权利要求1所述的方法,其特征在于,所述划分所述三维重建图像的深度检测区域与宽度检测区域,包括:4. The method according to claim 1, wherein said dividing the depth detection area and the width detection area of the three-dimensional reconstructed image comprises: 在所述三维重建图像中查询所述汽车轮胎的胎纹轮廓线;Querying the tread profile of the automobile tire in the three-dimensional reconstructed image; 将所述胎纹轮廓线对应的轮廓线区域作为所述三维重建图像的深度检测区域与宽度检测区域。The contour line area corresponding to the tread contour line is used as a depth detection area and a width detection area of the three-dimensional reconstructed image. 5.根据权利要求1所述的方法,其特征在于,所述计算所述深度视觉点集的点集平均重心,包括:5. The method according to claim 1, wherein said calculating the point set average center of gravity of said depth vision point set comprises: 利用下述公式计算所述深度视觉点集的点集平均重心:Utilize the following formula to calculate the point set average center of gravity of the depth vision point set:
Figure FDA0003876267540000022
Figure FDA0003876267540000022
其中,Pi表示所述深度视觉点集的点集平均重心,i表示所述深度视觉点集中的序列号,j表示所述深度视觉点集中深度视觉点的序列号,xj,yj,zj表示所述深度视觉点集中序列号为j的深度视觉点的三维坐标,m表示所述深度视觉点集中深度视觉点的总数。Wherein, P i represents the point set average center of gravity of the depth vision point set, i represents the sequence number in the depth vision point set, j represents the sequence number of the depth vision point in the depth vision point set, x j , y j , z j represents the three-dimensional coordinates of the depth vision point whose sequence number is j in the depth vision point set, and m represents the total number of depth vision points in the depth vision point set.
6.根据权利要求1所述的方法,其特征在于,所述对所述点集平均重心进行平面拟合,得到所述深度视觉点集的拟合视觉平面,包括:6. The method according to claim 1, wherein the said point set mean center of gravity is carried out to plane fitting to obtain the fitting visual plane of the depth vision point set, comprising: 利用下述公式确定所述点集平均重心的平面拟合面参数:Utilize the following formula to determine the plane fitting surface parameters of the mean center of gravity of the point set:
Figure FDA0003876267540000031
Figure FDA0003876267540000031
Figure FDA0003876267540000032
Figure FDA0003876267540000032
其中,a,b,c表示所述点集平均重心的平面拟合面参数,xi,yi,zi表示所述点集平均重心的坐标,n表示深度视觉点集的点集数量;Wherein, a, b, c represent the plane fitting surface parameters of the average center of gravity of the point set, x i , y i , z i represent the coordinates of the average center of gravity of the point set, and n represents the number of point sets of the depth vision point set; 根据所述平面拟合面参数,利用下述公式构建所述深度视觉点集的拟合视觉平面:According to the plane fitting surface parameters, the following formula is used to construct the fitting vision plane of the depth vision point set: z=ax+by+cz=ax+by+c 其中,z=ax+by+c表示所述深度视觉点集的拟合视觉平面,z,x,y表示平面函数的变量,a表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量x的参数,b表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量y的参数,c表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的常数。Wherein, z=ax+by+c represents the fitting visual plane of described depth vision point set, and z, x, y represent the variable of plane function, and a represents fitting in the plane fitting surface parameter of described point set mean center of gravity The parameter of the variable x of the visual plane function, b represents the parameter of the variable y of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and c represents the plane fitting surface parameter of the average center of gravity of the point set Constant for fitting the visual plane function.
7.根据权利要求1所述的方法,其特征在于,所述根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度,包括:7. The method according to claim 1, wherein the calculation of the tire detection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane comprises: 利用下述公式计算所述汽车轮胎的轮胎检测深度:Utilize following formula to calculate the tire detection depth of described automobile tire:
Figure FDA0003876267540000041
Figure FDA0003876267540000041
其中,di表示所述汽车轮胎的轮胎检测深度,a表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量x的参数,b表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的变量y的参数,c表示所述点集平均重心的平面拟合面参数中拟合视觉平面函数的常数,d表示拟合视觉平面函数的变量z的参数,xi,yi,zi表示所述点集平均重心的坐标。Wherein, di represents the tire detection depth of the automobile tire, a represents the parameter of the variable x of the fitting visual plane function in the plane fitting surface parameters of the average center of gravity of the point set, and b represents the plane of the average center of gravity of the point set The parameter of the variable y of the fitting visual plane function in the fitting surface parameter, c represents the constant of the fitting visual plane function in the plane fitting surface parameter of the mean center of gravity of the point set, and d represents the variable z of the fitting visual plane function The parameters, x i , y i , zi represent the coordinates of the mean center of gravity of the point set.
8.根据权利要求1所述的方法,其特征在于,所述检测所述宽度检测区域的边缘视觉点,包括:8. The method according to claim 1, wherein the detecting the edge visual point of the width detection area comprises: 利用下述公式对所述宽度检测区域进行二值化操作,得到二值化区域:The binarization operation is performed on the width detection area by using the following formula to obtain the binarization area:
Figure FDA0003876267540000042
Figure FDA0003876267540000042
其中,pi(xi,yi)表示所述二值化区域中的点云数据的坐标值,xi,yi,zi表示所述点集平均重心的坐标,k表示预先设置的图像像素参数;Wherein, p i (xi , y i ) represents the coordinate value of the point cloud data in the binarized region, xi , y i , z i represent the coordinates of the average center of gravity of the point set, and k represents the preset Image pixel parameters; 利用下述公式计算所述二值化区域的边缘点梯度:The edge point gradient of the binarized region is calculated using the following formula:
Figure FDA0003876267540000043
Figure FDA0003876267540000043
Figure FDA0003876267540000044
Figure FDA0003876267540000044
Figure FDA0003876267540000045
Figure FDA0003876267540000045
其中,|G(x,y)|表示所述二值化区域的边缘点梯度,sprt表示平方根计算,f(x+1,y),f(x,y),f(x,y+1)表示所述二值化区域的像素函数,
Figure FDA0003876267540000046
表示所述二值化区域中像素的一阶导数差分;
Among them, |G(x, y)| represents the edge point gradient of the binarized region, sprt represents the square root calculation, f(x+1, y), f(x, y), f(x, y+1 ) represents the pixel function of the binarized region,
Figure FDA0003876267540000046
Representing the first-order derivative difference of pixels in the binarized region;
根据所述边缘点梯度,确定所述宽度检测区域的边缘视觉点。Determine the edge visual point of the width detection area according to the gradient of the edge point.
9.根据权利要求1所述的方法,其特征在于,所述对所述边缘视觉点进行边缘线拟合,得到拟合视觉线,包括:9. The method according to claim 1, wherein said performing edge line fitting on said edge visual point to obtain a fitted visual line comprises: 利用下述公式计算所述边缘视觉点的拟合线参数:Utilize following formula to calculate the fitting line parameter of described edge vision point:
Figure FDA0003876267540000051
Figure FDA0003876267540000051
Figure FDA0003876267540000052
Figure FDA0003876267540000052
其中,A,B表示所述边缘视觉点的拟合线参数,xj,yj表示第j个边缘视觉点,M表示所述边缘视觉点的数量;Wherein, A, B represent the fitting line parameter of described edge vision point, x j , y j represent the jth edge vision point, M represents the quantity of described edge vision point; 利用下述公式对所述边缘视觉点进行边缘线拟合,得到拟合视觉线:Use following formula to carry out edge line fitting to described edge visual point, obtain fitting visual line: Y=AX+BY=AX+B 其中,Y=AX+B表示所述拟合视觉线,A,B表示所述边缘视觉点的拟合线参数,Y,X表示直线函数的自变量。Wherein, Y=AX+B represents the fitting visual line, A, B represent the fitting line parameters of the peripheral vision point, Y, X represent the independent variable of the straight line function.
10.一种汽车轮胎的质量3D视觉全息检测装置,其特征在于,所述装置包括:10. A quality 3D visual holographic detection device for automobile tires, characterized in that the device comprises: 检测区域划分模块,用于采集汽车轮胎的三维轮廓数据,根据所述三维轮廓数据,对所述汽车轮胎进行三维形态重建,得到三维重建图像,并划分所述三维重建图像的深度检测区域与宽度检测区域;The detection area division module is used to collect the three-dimensional contour data of the automobile tire, perform three-dimensional shape reconstruction on the automobile tire according to the three-dimensional contour data, obtain a three-dimensional reconstruction image, and divide the depth detection area and width of the three-dimensional reconstruction image Detection area; 检测深度计算模块,用于采样所述深度检测区域中的深度视觉点集,计算所述深度视觉点集的点集平均重心,对所述点集平均重心进行平面拟合,得到所述深度视觉点集的拟合视觉平面,根据所述点集平均重心与所述拟合视觉平面,计算所述汽车轮胎的轮胎检测深度;The detection depth calculation module is used to sample the depth vision point set in the depth detection area, calculate the point set average center of gravity of the depth vision point set, and perform plane fitting on the point set average center of gravity to obtain the depth vision point set A fitting visual plane of the point set, calculating the tire detection depth of the automobile tire according to the average center of gravity of the point set and the fitting visual plane; 检测宽度计算模块,用于检测所述宽度检测区域的边缘视觉点,对所述边缘视觉点进行边缘线拟合,得到拟合视觉线,根据所述边缘视觉点与所述拟合视觉线,计算所述汽车轮胎的轮胎检测宽度;The detection width calculation module is used to detect the edge visual point of the width detection area, and perform edge line fitting on the edge visual point to obtain a fitted visual line. According to the edge visual point and the fitted visual line, Calculate the tire detection width of the automobile tire; 检测结果确定模块,用于根据所述轮胎检测深度与所述轮胎检测宽度,确定所述汽车轮胎的三维视觉质量检测结果。The detection result determination module is used to determine the three-dimensional visual quality detection result of the automobile tire according to the tire detection depth and the tire detection width. 11.一种电子设备,其特征在于,所述电子设备包括:11. An electronic device, characterized in that the electronic device comprises: 至少一个处理器;以及,at least one processor; and, 与所述至少一个处理器通信连接的存储器;其中,a memory communicatively coupled to the at least one processor; wherein, 所述存储器存储有可被所述至少一个处理器执行的计算机程序,所述计算机程序被所述至少一个处理器执行,以使所述至少一个处理器能够执行如权利要求1至9中任意一项所述的汽车轮胎的质量3D视觉全息检测方法。The memory stores a computer program executable by the at least one processor, the computer program is executed by the at least one processor, so that the at least one processor can perform any one of claims 1 to 9 The quality 3D visual holographic detection method of the automobile tire described in the item. 12.一种计算机可读存储介质,存储有计算机程序,其特征在于,所述计算机程序被处理器执行时实现如权利要求1至9中任意一项所述的汽车轮胎的质量3D视觉全息检测方法。12. A computer-readable storage medium, storing a computer program, characterized in that, when the computer program is executed by a processor, the quality 3D visual holographic detection of automobile tires according to any one of claims 1 to 9 is realized method.
CN202211214366.XA 2022-09-30 2022-09-30 Quality 3D visual holographic detection method, device, equipment and medium of automobile tires Pending CN115661045A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202211214366.XA CN115661045A (en) 2022-09-30 2022-09-30 Quality 3D visual holographic detection method, device, equipment and medium of automobile tires

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202211214366.XA CN115661045A (en) 2022-09-30 2022-09-30 Quality 3D visual holographic detection method, device, equipment and medium of automobile tires

Publications (1)

Publication Number Publication Date
CN115661045A true CN115661045A (en) 2023-01-31

Family

ID=84986206

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202211214366.XA Pending CN115661045A (en) 2022-09-30 2022-09-30 Quality 3D visual holographic detection method, device, equipment and medium of automobile tires

Country Status (1)

Country Link
CN (1) CN115661045A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116007526A (en) * 2023-03-27 2023-04-25 西安航天动力研究所 An automatic measuring system and measuring method for the notch depth of a diaphragm
CN117291893A (en) * 2023-09-28 2023-12-26 广州市西克传感器有限公司 Tire tread wear detection method based on 3D images

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116007526A (en) * 2023-03-27 2023-04-25 西安航天动力研究所 An automatic measuring system and measuring method for the notch depth of a diaphragm
CN117291893A (en) * 2023-09-28 2023-12-26 广州市西克传感器有限公司 Tire tread wear detection method based on 3D images

Similar Documents

Publication Publication Date Title
CN113252700B (en) Method, equipment and system for detecting structural cracks
US10311835B1 (en) Method for detection and estimation of tire tread wear
US8255184B2 (en) Programming system for a coordinate measuring machine and method thereof
CN106918299B (en) A kind of line-structured light machine vision tire wear measurement method
CN115661045A (en) Quality 3D visual holographic detection method, device, equipment and medium of automobile tires
CN102920459B (en) Human body circumference parameter measuring method based on three-dimensional point cloud
CN113514849B (en) Vehicle parameter detection method, system and storage medium
CN116229007B (en) Four-dimensional digital image construction method, device, equipment and medium using BIM modeling
CN104132613A (en) Noncontact optical volume measurement method for complex-surface and irregular objects
TW201341106A (en) Cutting tool detection system and method
CN104634242A (en) Point adding system and method of probe
CN110675455B (en) Natural scene-based self-calibration method and system for vehicle body looking-around camera
CN107504917B (en) Three-dimensional size measuring method and device
CN108133477A (en) A kind of object detecting method and intelligent machine arm
CN116134482A (en) Method and device for recognizing surface features in three-dimensional images
CN110597249A (en) Robot and recharging positioning method and device thereof
JP6119225B2 (en) Intersection road boundary detection device and program
CN113192013A (en) Method and system for detecting defects of light-reflecting surface and electronic equipment
CN103884294B (en) Method and device for three-dimensional shape measurement with infrared light with wide field of view
CN116152208A (en) Defect detection method, device, equipment and storage medium
CN111671360B (en) Sweeping robot position calculating method and device and sweeping robot
CN108020172A (en) A kind of aircraft surface workmanship detection method based on 3D data
CN118392084A (en) Tunnel flatness detection device
CN110348408A (en) Pupil positioning method and device
CN211178314U (en) Measuring device, separated measuring system, integrated measuring system and terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination