[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN115063409A - Method and system for detecting surface material of mechanical cutter - Google Patents

Method and system for detecting surface material of mechanical cutter Download PDF

Info

Publication number
CN115063409A
CN115063409A CN202210895287.3A CN202210895287A CN115063409A CN 115063409 A CN115063409 A CN 115063409A CN 202210895287 A CN202210895287 A CN 202210895287A CN 115063409 A CN115063409 A CN 115063409A
Authority
CN
China
Prior art keywords
gray
initial
pixel
category
cutter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210895287.3A
Other languages
Chinese (zh)
Other versions
CN115063409B (en
Inventor
杨彩红
陈小勤
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nantong Hengqiang Mill Roll Co ltd
Original Assignee
Nantong Hengqiang Mill Roll Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nantong Hengqiang Mill Roll Co ltd filed Critical Nantong Hengqiang Mill Roll Co ltd
Priority to CN202210895287.3A priority Critical patent/CN115063409B/en
Publication of CN115063409A publication Critical patent/CN115063409A/en
Application granted granted Critical
Publication of CN115063409B publication Critical patent/CN115063409B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/0008Industrial image inspection checking presence/absence
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4053Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/13Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20092Interactive image processing based on input by user
    • G06T2207/20104Interactive definition of region of interest [ROI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Image Analysis (AREA)

Abstract

The invention relates to the field of defect detection, in particular to a method and a system for detecting surface materials of a mechanical cutter. The method comprises the following steps: performing superpixel segmentation on the ROI area image to obtain an initial superpixel block; obtaining a Gaussian model of each initial pixel block according to the gray value of the pixel point; calculating the correlation of any two initial superpixel blocks according to a Gaussian model; iteratively merging the initial pixel blocks according to the correlation to obtain N target superpixel blocks; iteratively updating each particle according to the speed and position of each particle; constructing a fitness sequence according to the fitness of each particle updated at the last time, and taking the gray values corresponding to the first (N-1) fitness in the sequence as gray threshold values; dividing the ROI area image into N categories according to the gray threshold; calculating defect indexes according to gray values of pixel points in all categories; and judging whether the defect index is greater than a threshold value, and if so, judging that the surface of the cutter is abnormal. The method is a method for detecting the mechanical cutter by using an optical means, and improves the detection efficiency.

Description

Method and system for detecting surface material of mechanical cutter
Technical Field
The invention relates to the field of defect detection, in particular to a method and a system for detecting surface materials of a mechanical cutter.
Background
In the field of machine part production, metal cutting machine tools and various machine tools are basic process equipment in machining. In the production process of the cutter, due to the influence of various external factors such as operators, machine equipment, environment and the like and the influence of the factors of the cutter material, various conditions such as convex-concave, coating peeling, edge gaps, scratches and the like can appear on the surface of the cutter, and the abnormal defects not only can influence the appearance of the cutter, but also can influence the quality and the service life of the cutter in serious cases. The cutter surface detects at present and detects the manual work on placing the cutter on fixed workstation mostly, and the manual work detects and has increased the amount of labour, has reduced work efficiency, and detects the precision lower, and the false retrieval rate is higher.
Disclosure of Invention
In order to solve the problems of low detection efficiency and high false detection rate when the surface defects of the cutter are detected by the conventional method, the invention aims to provide a method and a system for detecting the surface material of the mechanical cutter, and the adopted technical scheme is as follows:
in a first aspect, the present invention provides a method for detecting a surface material of a mechanical tool, the method comprising the following steps:
acquiring a surface image of a cutter to be detected, carrying out edge detection on the surface image of the cutter to be detected, and taking an internal region image of the edge image of the cutter to be detected as an ROI region image;
performing superpixel segmentation on the ROI area image to obtain a corresponding initial superpixel block; obtaining a Gaussian model corresponding to each initial pixel block according to the gray value of the pixel point in each initial super pixel block; calculating the correlation of any two initial superpixel blocks according to the Gaussian models corresponding to the initial superpixel blocks; according to the correlation of any two initial superpixel blocks, carrying out iterative combination on the initial superpixel blocks to obtain N target superpixel blocks;
calculating the speed and the position corresponding to each particle updating according to the speed and position updating formula of the particles, wherein the particles are the gray values of the pixel points, and the number of the particles is more than (N-1); iteratively updating each particle according to the speed and position corresponding to each updating of each particle; calculating the fitness value corresponding to each particle updated at the last time according to the fitness function; sorting the fitness values from large to small to construct a sequence of the fitness values; acquiring gray values of particles corresponding to the first (N-1) fitness values in the fitness value sequence, and taking the gray values of the particles corresponding to the first (N-1) fitness values as gray threshold values; dividing the ROI area image into N categories according to the gray threshold;
calculating the defect index of the cutter to be detected according to the gray values of the pixel points in each category; and judging whether the defect index is larger than a threshold value, and if so, judging that the surface of the tool to be detected is abnormal.
In a second aspect, the present invention provides a system for detecting a surface material of a mechanical tool, including a memory and a processor, where the processor executes a computer program stored in the memory to implement the method for detecting a surface material of a mechanical tool.
Preferably, the correlation of any two initial superpixel blocks is calculated using the following formula:
Figure DEST_PATH_IMAGE001
wherein,
Figure 330197DEST_PATH_IMAGE001
is an initial super-pixel block
Figure 778495DEST_PATH_IMAGE002
And an initial superpixel block
Figure 699178DEST_PATH_IMAGE003
The correlation of (a) with (b) is,
Figure 625546DEST_PATH_IMAGE004
for the correlation factor, c for the model bias,
Figure 643180DEST_PATH_IMAGE005
is an initial super-pixel block
Figure 872167DEST_PATH_IMAGE002
Gray scale of middle pixel pointThe mean value of the values is determined,
Figure 670359DEST_PATH_IMAGE006
as an initial superpixel block
Figure 10205DEST_PATH_IMAGE003
The mean value of the gray values of the middle pixels,
Figure 210242DEST_PATH_IMAGE007
initial superpixel block
Figure 406868DEST_PATH_IMAGE002
The standard deviation of the gray value of the middle pixel point,
Figure 567722DEST_PATH_IMAGE008
is an initial super-pixel block
Figure 835892DEST_PATH_IMAGE003
And standard deviation of gray values of the middle pixel points.
Preferably, the inertia weight coefficient in the velocity and position updating formula is optimized, and the optimized inertia weight coefficient is as follows:
Figure 765802DEST_PATH_IMAGE009
wherein,
Figure 726805DEST_PATH_IMAGE010
in order to optimize the inertial weight coefficient after optimization,
Figure 106446DEST_PATH_IMAGE011
is the maximum value of the weight coefficient,
Figure 584832DEST_PATH_IMAGE012
is the minimum value of the weight coefficient,
Figure 759462DEST_PATH_IMAGE013
is a first control factor to be used for controlling the motor,
Figure 235573DEST_PATH_IMAGE014
is a second control factor for the control of the motor,
Figure 167757DEST_PATH_IMAGE015
in order to be the maximum number of iterations,
Figure 777730DEST_PATH_IMAGE016
is the number of iterations.
Preferably, the fitness function is:
Figure 682232DEST_PATH_IMAGE017
wherein,
Figure 985038DEST_PATH_IMAGE018
are particles
Figure 76622DEST_PATH_IMAGE019
The corresponding value of the degree of fitness is,
Figure 490285DEST_PATH_IMAGE020
is the ratio of the number of pixels in the 1 st category to the number of pixels in the ROI area image,
Figure 249294DEST_PATH_IMAGE021
is the ratio of the number of pixels in the 2 nd category to the number of pixels in the ROI area image,
Figure 723001DEST_PATH_IMAGE022
is the ratio of the number of pixels in the Nth category to the number of pixels in the ROI area image,
Figure 567460DEST_PATH_IMAGE023
is the average value of the gray levels of the pixels in the 1 st category,
Figure 188410DEST_PATH_IMAGE024
is the average value of the gray levels of the pixels in the 2 nd category,
Figure 192138DEST_PATH_IMAGE025
the gray level mean value of the pixel points in the ROI area image is obtained.
Preferably, the iteratively combining the initial pixel blocks according to the correlation between any two initial superpixel blocks to obtain N target superpixel blocks includes:
for any initial superpixel block: combining the initial superpixel block and the initial superpixel block with the maximum correlation to obtain a first superpixel block;
calculating the correlation of any two first superpixel blocks;
for any first superpixel block: combining the first super-pixel block and the first super-pixel block with the maximum correlation to obtain a second super-pixel block;
and when the correlations among the super pixel blocks are all smaller than a set threshold value, stopping merging the super pixel blocks, and marking the super pixel block obtained by the last merging as a target super pixel block.
Preferably, the calculating the defect index of the tool to be detected according to the gray values of the pixel points in each category includes:
counting the number of pixel points in each category, taking the category with the largest number of pixel points as a cutter surface normal category, and taking other categories as defect categories, wherein the other categories are the categories except the cutter surface normal category in the N categories;
calculating the gray average value of the pixel points in the normal category of the surface of the cutter according to the gray value of each pixel point in the normal category of the surface of the cutter;
for any defect class: calculating the gray average value of the pixel points in the category according to the gray value of each pixel point in the category;
and calculating the defect index of the cutter to be detected according to the gray average value of the pixel points in the normal category of the surface of the cutter and the gray average value of the pixel points in each defect category.
Preferably, the defect index of the tool to be detected is calculated by adopting the following formula:
Figure 446533DEST_PATH_IMAGE026
wherein,
Figure 902922DEST_PATH_IMAGE027
is an index of the defects of the cutter to be detected,
Figure 330492DEST_PATH_IMAGE028
is the sum of the number of pixels in the defect category,
Figure 798514DEST_PATH_IMAGE029
is the total number of defect classes,
Figure 614023DEST_PATH_IMAGE030
is the gray average value of the pixel points in the normal category of the surface of the cutter to be detected,
Figure 433074DEST_PATH_IMAGE031
is as follows
Figure 992232DEST_PATH_IMAGE032
The mean value of the gray levels of the pixels in each defect category,
Figure 580339DEST_PATH_IMAGE033
is the base of the natural logarithm.
The invention has the following beneficial effects: the invention provides a method for detecting a mechanical cutter by using a visible light image in order to judge whether the surface of the cutter to be detected has defects, and the method can be applied to new material related services and can realize new material detection, metering, related standardization, authentication and approval services and the like. Considering that the gray value of the pixel point in the defect area is different from the gray value of the pixel point in the normal area, the invention analyzes whether the surface of the mechanical cutter to be detected has defects or not by utilizing the visible light image. The specific process is as follows: firstly, obtaining an ROI (region of interest) area image in a surface image of a tool to be detected, performing superpixel segmentation on the ROI area image to obtain corresponding initial superpixel blocks, then calculating the correlation of any two initial superpixel blocks, and merging the initial superpixel blocks according to the correlation to obtain N target superpixel blocks; considering that the segmentation of the superpixel blocks is very inaccurate, the method adopts a particle iterative updating method to obtain (N-1) optimal gray threshold values for dividing the pixel point categories; dividing the ROI area image into N categories according to the optimal gray threshold, dividing the N categories into a normal category and a defect category according to the number of pixel points in each category, calculating a defect index of the tool to be detected according to the gray value of the pixel points in each category, and judging whether the surface of the tool to be detected is abnormal or not according to the defect index. The system provided by the embodiment is an artificial intelligence system in the production field, the method provided by the invention is a method for analyzing the mechanical cutter by using an optical means, and particularly, the existence of the surface flaws or defects of the mechanical cutter is tested.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions and advantages of the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without creative efforts.
Fig. 1 is a flowchart of a method for detecting a surface material of a mechanical tool according to the present invention.
Detailed Description
To further illustrate the technical means and effects of the present invention for achieving the predetermined objects, the following detailed description of a method for detecting surface material of a mechanical cutting tool according to the present invention is provided with the accompanying drawings and preferred embodiments.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
The following describes a specific scheme of the method for detecting the surface material of the mechanical cutter in detail with reference to the accompanying drawings.
Embodiment of method for detecting surface material of mechanical cutter
The existing method has the problems of low detection efficiency and high false detection rate when detecting the surface defects of the cutter. In order to solve the above problem, the present embodiment provides a method for detecting a surface material of a mechanical tool, as shown in fig. 1, the method for detecting a surface material of a mechanical tool of the present embodiment includes the following steps:
and step S1, acquiring a surface image of the tool to be detected, performing edge detection on the surface image of the tool to be detected, and taking an internal region image of the edge image of the tool to be detected as an ROI region image.
The embodiment is provided with image acquisition equipment for acquiring images of the surface of the tool to be detected, the embodiment arranges a camera above the tool to be detected, the tool to be detected is placed on a black background, a camera shooting range can cover the surface of the tool to be detected so as to comprehensively detect the surface of the tool, the camera acquires surface images of the tool to be detected at a overlooking visual angle, the influence of the camera visual angle on the acquisition of the surface images of the tool is prevented, the system precision is improved, so that the tool area is accurately extracted in the following process, and the front-view images of the surface of the tool to be detected are obtained.
In the embodiment, the defect detection is mainly performed on the tool surface based on the acquired front-view image of the tool surface to be detected, and considering that a large amount of noise exists in the environment and floating dust on the tool surface can affect the acquisition of the tool surface image in the image acquisition process, the embodiment performs filtering and denoising processing on the acquired front-view image of the tool surface to be detected, eliminates noise points of the tool surface image, achieves denoising processing on the tool surface image, obtains a denoised filtered image, and an implementer can select a denoising processing method of a mean filtering algorithm, a median filtering algorithm, a gaussian filtering algorithm or a bilinear filtering algorithm to perform denoising processing on the front-view image of the tool surface to be detected. And then, the illumination equalization is carried out on the filtered image through gamma conversion, so that the brightness in the image is more uniform, and the influence of uneven brightness and the like on the surface anomaly detection result caused by the illumination of the light source on the surface of the cutter is avoided. And taking the finally processed image as a surface image of the tool to be detected. The mean filtering algorithm, the median filtering algorithm, the gaussian filtering, the bilinear filtering and the gamma transformation are all the prior art, and are not described herein again.
In the embodiment, the region of interest of the surface image of the tool to be detected is extracted, so that the influence of irrelevant factors on the detection of the tool surface is avoided. The method for extracting the region of interest specifically comprises the following steps: firstly, extracting edge pixel points in a surface image of a tool to be detected by adopting an edge detection operator to obtain an edge image of the tool to be detected, and taking an image in a communication domain inside an edge as a surface area image of the tool to be detected, namely an interested area image. According to the characteristic that the position of a corresponding pixel point of an image is unchanged, the image is cut based on the edge pixel point so as to obtain image data only containing the surface of the tool, and the image data is used as an ROI (region for region analysis) for subsequent detection and analysis of the surface of the tool to be detected.
Step S2, performing superpixel segmentation on the ROI area image to obtain a corresponding initial superpixel block; obtaining a Gaussian model corresponding to each initial pixel block according to the gray value of the pixel point in each initial super pixel block; calculating the correlation of any two initial superpixel blocks according to the Gaussian models corresponding to the initial superpixel blocks; and according to the correlation of any two initial superpixel blocks, carrying out iterative combination on the initial superpixel blocks to obtain N target superpixel blocks.
In this embodiment, the pixel points on the surface of the tool are divided so as to identify the defective pixel points on the surface of the tool, thereby implementing the detection and analysis of the material of the surface of the tool. Considering that when different defect conditions occur on the surface of a tool, gray information corresponding to different defects may have certain difference, in order to primarily identify the surface condition of the tool, the embodiment firstly adopts a superpixel segmentation algorithm to divide an ROI area image into a plurality of initial superpixel blocks, and a Gaussian model is fitted based on the gray value of a pixel point in each superpixel block
Figure 301170DEST_PATH_IMAGE034
And x is the gray value of the pixel point,
Figure 341939DEST_PATH_IMAGE034
a Gaussian model corresponding to the initial super-pixel block i, each Gaussian model having two characteristic parameters
Figure 439208DEST_PATH_IMAGE035
In this embodiment, the correlation of the initial superpixel block is analyzed based on the characteristic parameters of the gaussian model, so as to further merge the initial superpixel blocks obtained by the preliminary division, and calculate the correlation of any two initial superpixel blocks, that is:
Figure 147401DEST_PATH_IMAGE036
wherein,
Figure 39133DEST_PATH_IMAGE001
is an initial super-pixel block
Figure 829847DEST_PATH_IMAGE002
And an initial superpixel block
Figure 730807DEST_PATH_IMAGE003
Is related to (A) and
Figure 824665DEST_PATH_IMAGE037
Figure 28244DEST_PATH_IMAGE004
for the correlation factor, c is the model bias,
Figure 168239DEST_PATH_IMAGE005
is an initial super-pixel block
Figure 748256DEST_PATH_IMAGE002
The mean value of the gray values of the middle pixels,
Figure 290096DEST_PATH_IMAGE006
is an initial super-pixel block
Figure 664576DEST_PATH_IMAGE003
The mean value of the gray values of the middle pixel points,
Figure 291867DEST_PATH_IMAGE038
initial superpixel block
Figure 144416DEST_PATH_IMAGE002
The standard deviation of the gray values of the middle pixel points,
Figure 540762DEST_PATH_IMAGE008
is an initial super-pixel block
Figure 351724DEST_PATH_IMAGE003
And standard deviation of gray values of the middle pixel points. This example arrangement
Figure 200731DEST_PATH_IMAGE039
In a specific application, the setting can be carried out according to specific situations.
Normalizing the Gaussian model to ensure that the function value is in [0,1 ]]The larger the model function value is, the more similar the two corresponding superpixel blocks are, and this embodiment calculates the correlation between the initial superpixel blocks based on the gaussian model, and merges the initial superpixel blocks. Specifically, the initial superpixel blocks to be combined and each initial superpixel block corresponding to the maximum correlation are combined to obtain combined superpixel blocks, in order to realize the merging precision of the superpixel blocks, the correlation of the combined superpixel blocks is calculated based on a Gaussian model of the combined superpixel blocks, and the method is adopted for iterative combination according to the correlation of the combined superpixel blocks until the correlation between any two superpixel blocks is lower than a correlation threshold value
Figure 856971DEST_PATH_IMAGE040
The present embodiment sets the correlation threshold value
Figure 42577DEST_PATH_IMAGE041
In a specific application, the setting is carried out according to specific situations. And obtaining N target superpixel blocks after the superpixel blocks are combined in an iterative manner.
Step S3, calculating the speed and position corresponding to each particle update according to the speed and position update formula of the particles, wherein the particles are the gray values of pixel points, and the number of the particles is more than (N-1); iteratively updating each particle according to the speed and position corresponding to each updating of each particle; calculating the fitness value corresponding to each particle updated for the last time according to the fitness function; sorting the fitness values from large to small to construct a sequence of the fitness values; acquiring gray values of particles corresponding to the first (N-1) fitness values in the fitness value sequence, and taking the gray values of the particles corresponding to the first (N-1) fitness values as gray threshold values; and dividing the ROI area image into N categories according to the gray threshold.
In order to accurately identify and divide the pixels on the surface of the tool, the present embodiment sets a pixel classification model for accurately dividing the pixels in the ROI image. The pixel point classification model specifically comprises: firstly, based on the segmentation and merging process of the superpixel blocks in step S2, the types of the pixel points on the surface of the tool are obtained, and in this embodiment, the obtained target number N of the superpixel blocks is used as the number of the types of the tool pixel point division, so as to realize the tool pixel point division. Then, the embodiment extracts the optimal gray scale threshold value set for pixel point division to obtain (N-1) optimal pixel point division threshold values, and performs category division on the cutter pixel points again.
The method for obtaining the optimal division gray level threshold value comprises the following steps:
in this embodiment, the gray value of a pixel point is abstracted into particles, and the number m of the particles is set, that is, m gray threshold values are selected first, and the value range [0,255] is selected, where m is greater than N-1. Then, each particle is endowed with a random initial position and speed, the fitness of each particle is calculated according to a fitness function, then the corresponding speed and position of each particle in the next updating process are calculated by using an updating formula of the speed and the position, each particle is updated according to the corresponding speed and position of each particle in the next updating process, and the updating formula of the speed and the position is as follows:
Figure 883494DEST_PATH_IMAGE042
Figure 360743DEST_PATH_IMAGE043
wherein,
Figure 945308DEST_PATH_IMAGE044
for the kth iteration speed of particle i,
Figure 191613DEST_PATH_IMAGE045
for the (k-1) th iteration speed of particle i,
Figure 203431DEST_PATH_IMAGE046
the position of the target is the best position of the group,
Figure 902397DEST_PATH_IMAGE047
for the optimal position of the particle i, k is the number of iterations,
Figure 25074DEST_PATH_IMAGE048
for the (k-1) th iteration position of particle i,
Figure 125885DEST_PATH_IMAGE049
for the kth iteration position of particle i,
Figure 308605DEST_PATH_IMAGE050
is at [0,1 ]]The random number is randomly distributed on the random number,
Figure 760446DEST_PATH_IMAGE051
is at [0,1 ]]The random number is randomly distributed on the random number,
Figure 686814DEST_PATH_IMAGE010
is the coefficient of the inertial weight, and,
Figure 438869DEST_PATH_IMAGE052
is a first one of the learning factors, and,
Figure 933435DEST_PATH_IMAGE053
is the second learning factor, in this embodiment
Figure 731627DEST_PATH_IMAGE054
The conventional updating strategy adopting linear decreasing is that linear decreasing updating is adopted, and considering that the optimal value is easily not searched in the initial stage of iteration, subsequent iteration is possibly trapped in a local extreme value, therefore, the embodiment optimizes and corrects the inertia weight coefficient to ensure that an accurate pixel point division threshold is searched, and the optimization of the inertia weight coefficient specifically comprises the following steps:
Figure 334122DEST_PATH_IMAGE009
wherein,
Figure 268580DEST_PATH_IMAGE010
in order to optimize the inertial weight coefficient after optimization,
Figure 668469DEST_PATH_IMAGE011
is the maximum value of the weight coefficients smaller than 1,
Figure 953956DEST_PATH_IMAGE012
is the minimum value of the weight coefficients smaller than 1,
Figure 97493DEST_PATH_IMAGE013
is a first control factor to be used for controlling the motor,
Figure 824140DEST_PATH_IMAGE014
is a second control factor for the control of the motor,
Figure 785143DEST_PATH_IMAGE015
in order to be the maximum number of iterations,
Figure 902135DEST_PATH_IMAGE016
is the number of iterations. This example arrangement
Figure 239575DEST_PATH_IMAGE055
Figure 23992DEST_PATH_IMAGE056
Figure 890317DEST_PATH_IMAGE057
In the case of a particular application,
Figure 25763DEST_PATH_IMAGE011
Figure 307840DEST_PATH_IMAGE012
Figure 336976DEST_PATH_IMAGE058
Figure 270076DEST_PATH_IMAGE059
and
Figure 17452DEST_PATH_IMAGE060
the value of (a) is set according to specific conditions.
The present embodiment updates the position and velocity of each particle based on the optimized inertial weight coefficient. Calculating the fitness value of each particle according to the fitness function at each time of updating, namely:
Figure 40903DEST_PATH_IMAGE017
wherein,
Figure 924545DEST_PATH_IMAGE018
are particles
Figure 273618DEST_PATH_IMAGE019
The value of the corresponding degree of fitness is,
Figure 914815DEST_PATH_IMAGE020
is the ratio of the number of pixels in the 1 st category to the number of pixels in the ROI area image,
Figure 866590DEST_PATH_IMAGE021
is the ratio of the number of pixels in the 2 nd category to the number of pixels in the ROI area image,
Figure 745685DEST_PATH_IMAGE022
is the ratio of the number of pixels in the Nth category to the number of pixels in the ROI area image,
Figure 124713DEST_PATH_IMAGE023
is the average value of the gray levels of the pixels in the 1 st category,
Figure 190889DEST_PATH_IMAGE061
is the average value of the gray levels of the pixels in the 2 nd category,
Figure 946356DEST_PATH_IMAGE025
the gray level mean value of the pixel points in the ROI area image is obtained.
In the embodiment, the fitness value of each particle is obtained through a fitness function and an iterative update process, and in order to prevent infinite iteration and a locally optimal loop, the maximum iteration number K =100 is set in the embodiment. In this embodiment, the tool surface pixel division threshold is selected according to the fitness value corresponding to each particle after final update, and the specific selection process is as follows: the fitness of each particle corresponding to the last update is sorted from large to small, and a fitness value sequence is constructed
Figure 679957DEST_PATH_IMAGE062
Wherein, in the process,
Figure 167570DEST_PATH_IMAGE063
the embodiment will be arranged at the front of the sequence of fitness values
Figure 111255DEST_PATH_IMAGE064
Using particles corresponding to each fitness value as tool surface pixel stippling linesRespective optimal gray threshold values, which constitute a set
Figure 11690DEST_PATH_IMAGE065
Based on this
Figure 724431DEST_PATH_IMAGE029
The pixel points in the ROI area image are divided into N categories by the gray threshold, then corresponding gray values are endowed to the pixel points in each category again, after assignment, the gray values of the pixel points in the same category are equal, and the method specifically comprises the following steps:
Figure 382946DEST_PATH_IMAGE066
wherein,
Figure 689293DEST_PATH_IMAGE067
is a pixel point
Figure 786562DEST_PATH_IMAGE068
The gray value after assignment is in the gray value of the pixel point
Figure 229176DEST_PATH_IMAGE069
) In between, the gray value of the corresponding pixel point is set
Figure 386488DEST_PATH_IMAGE070
(ii) a When the gray value of the pixel point is in the value of [ 2 ]
Figure 914553DEST_PATH_IMAGE071
) In between, the gray value of the corresponding pixel point is set
Figure 549933DEST_PATH_IMAGE072
(ii) a And so on; when the gray value of the pixel point is at
Figure 112633DEST_PATH_IMAGE073
]And in the middle, the gray value of the corresponding pixel point is set to 1. Subsequent liftingThe gray values to the pixel points are the gray values after assignment.
Step S4, calculating defect indexes of the cutter to be detected according to the gray values of the pixel points in each category; and judging whether the defect index is larger than a threshold value, and if so, judging that the surface of the tool to be detected is abnormal.
The dividing of pixel points in the ROI area image is completed based on the method, and most of defect areas on the surface of the cutter are considered to be small target features, so after the classification of the pixel points in the cutter area is divided, the number of the pixel points in each classification is counted in the embodiment, the classification with the largest number of the pixel points is taken as a normal classification of the surface of the cutter, the rest classifications are taken as defect classifications, the area where each defect classification is located is the defect area, and the embodiment determines the sum of the number of the pixel points in each defect area
Figure 440846DEST_PATH_IMAGE028
The total number of the pixel points of the surface defects of the cutter to be detected is used as the total number; obtaining the gray value of each pixel point in the normal category of the surface of the cutter, and calculating the gray average value of the pixel points in the normal category of the surface of the cutter according to the gray value of each pixel point in the normal category of the surface of the cutter
Figure 456206DEST_PATH_IMAGE030
Meanwhile, for any defect category: acquiring the gray value of each pixel point in the category, and calculating the gray average value of the pixel points in the category according to the gray value of each pixel point in the category; calculating the surface defect index of the cutter to be detected according to the gray average value of the pixel points in the normal category of the surface of the cutter and the gray average value of each defect area, namely:
Figure 832961DEST_PATH_IMAGE026
wherein,
Figure 374801DEST_PATH_IMAGE027
is an index of the surface defect of the cutter to be detected,
Figure 480773DEST_PATH_IMAGE074
is the sum of the number of pixels in the defect category,
Figure 108063DEST_PATH_IMAGE029
is the total number of defect classes,
Figure 757350DEST_PATH_IMAGE030
is the gray average value of the pixel points in the normal category of the surface of the cutter to be detected,
Figure 294642DEST_PATH_IMAGE031
is as follows
Figure 964658DEST_PATH_IMAGE032
The mean value of the gray levels of the pixels in each defect class,
Figure 689031DEST_PATH_IMAGE033
is the base of the natural logarithm.
Defect index of tool to be detected
Figure 469905DEST_PATH_IMAGE027
The larger the surface, the more abnormal the surface of the tool to be detected is; index of surface defect of tool to be detected
Figure 861704DEST_PATH_IMAGE027
The smaller the tool, the better the surface condition of the tool to be detected. The embodiment sets a defect index threshold
Figure 374725DEST_PATH_IMAGE075
Judging whether the surface defect index of the tool to be detected is greater than
Figure 711028DEST_PATH_IMAGE075
If the number of the machining defects is larger than the preset number, judging that the surface of the tool to be detected is abnormal, and the tool cannot be used in the machining process of mechanical manufacturing, and needs to be machined again, so that the defective rate is reduced, and accidents in the subsequent use process are prevented; if the surface defect index of the tool to be detected is less than or equal to
Figure 170959DEST_PATH_IMAGE075
And judging that the surface of the tool to be detected is not abnormal. Defect index threshold
Figure 214002DEST_PATH_IMAGE075
The value of (a) is set according to specific conditions.
In order to determine whether the surface of the tool to be detected has defects, the embodiment provides a method for detecting a mechanical tool by using a visible light image, and the method can be applied to new material related services, and can realize new material detection, metering, related standardization, authentication and approval services and the like. In consideration of a certain difference between the gray value of the pixel point in the defect area and the gray value of the pixel point in the normal area, the embodiment utilizes the visible light image to analyze whether the surface of the mechanical tool to be detected has a defect. The specific process is as follows: firstly, obtaining an ROI (region of interest) area image in a surface image of a tool to be detected, performing superpixel segmentation on the ROI area image to obtain corresponding initial superpixel blocks, then calculating the correlation of any two initial superpixel blocks, and merging the initial superpixel blocks according to the correlation to obtain N target superpixel blocks; considering that the segmentation of the superpixel blocks is very inaccurate, the embodiment then adopts a particle iterative update method to obtain (N-1) optimal gray level thresholds for dividing the pixel point categories; dividing the ROI area image into N categories according to the optimal gray threshold, dividing the N categories into a normal category and a defect category according to the number of pixel points in each category, calculating a defect index of the tool to be detected according to the gray value of the pixel points in each category, and judging whether the surface of the tool to be detected is abnormal or not according to the defect index. The system of the embodiment is an artificial intelligence system in the production field, the method provided by the embodiment is a method for analyzing the mechanical cutter by using an optical means, and particularly, the existence of surface flaws or defects of the mechanical cutter is tested.
Embodiment of mechanical cutter surface material detection system
The system for detecting the surface material of the mechanical tool in this embodiment includes a memory and a processor, and the processor executes a computer program stored in the memory to implement the method for detecting the surface material of the mechanical tool.
Since the method for detecting the surface material of the mechanical cutting tool has been described in the embodiment of the method for detecting the surface material of the mechanical cutting tool, the method for detecting the surface material of the mechanical cutting tool is not described in detail in this embodiment.
It should be noted that: the above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims (8)

1. A method for detecting the surface material of a mechanical cutter is characterized by comprising the following steps:
acquiring a surface image of a tool to be detected, carrying out edge detection on the surface image of the tool to be detected, and taking an internal region image of the edge image of the tool to be detected as an ROI region image;
performing superpixel segmentation on the ROI area image to obtain a corresponding initial superpixel block; obtaining a Gaussian model corresponding to each initial pixel block according to the gray value of the pixel point in each initial super pixel block; calculating the correlation of any two initial superpixel blocks according to the Gaussian models corresponding to the initial superpixel blocks; according to the correlation of any two initial superpixel blocks, carrying out iterative combination on the initial superpixel blocks to obtain N target superpixel blocks;
calculating the speed and the position corresponding to each particle updating according to the speed and position updating formula of the particles, wherein the particles are the gray values of the pixel points, and the number of the particles is more than (N-1); iteratively updating each particle according to the speed and position corresponding to each updating of each particle; calculating the fitness value corresponding to each particle updated for the last time according to the fitness function; sorting the fitness values from large to small to construct a fitness value sequence; acquiring gray values of particles corresponding to the first (N-1) fitness values in the fitness value sequence, and taking the gray values of the particles corresponding to the first (N-1) fitness values as gray threshold values; dividing the ROI area image into N categories according to the gray threshold;
calculating the defect index of the cutter to be detected according to the gray values of the pixel points in each category; and judging whether the defect index is larger than a threshold value, and if so, judging that the surface of the tool to be detected is abnormal.
2. The method for detecting the surface material quality of the mechanical cutter according to claim 1, characterized in that the correlation between any two initial superpixel blocks is calculated by the following formula:
Figure 255880DEST_PATH_IMAGE002
wherein,
Figure DEST_PATH_IMAGE003
is an initial super-pixel block
Figure DEST_PATH_IMAGE005
And an initial superpixel block
Figure DEST_PATH_IMAGE007
The correlation of (a) with (b),
Figure 892529DEST_PATH_IMAGE008
for the correlation factor, c is the model bias,
Figure DEST_PATH_IMAGE009
is an initial super-pixel block
Figure 890572DEST_PATH_IMAGE005
The mean value of the gray values of the middle pixels,
Figure 319279DEST_PATH_IMAGE010
is an initial super-pixel block
Figure 642944DEST_PATH_IMAGE007
The mean value of the gray values of the middle pixels,
Figure DEST_PATH_IMAGE011
initial superpixel block
Figure 826276DEST_PATH_IMAGE005
The standard deviation of the gray value of the middle pixel point,
Figure 893589DEST_PATH_IMAGE012
is an initial super-pixel block
Figure 114486DEST_PATH_IMAGE007
And standard deviation of gray values of the middle pixel points.
3. The method for detecting the surface material quality of the mechanical cutter according to claim 1, wherein the inertia weight coefficient in the speed and position updating formula is optimized, and the optimized inertia weight coefficient is as follows:
Figure 609053DEST_PATH_IMAGE014
wherein,
Figure DEST_PATH_IMAGE015
in order to optimize the inertial weight coefficient after optimization,
Figure 751452DEST_PATH_IMAGE016
the maximum value of the weight coefficient is the value,
Figure DEST_PATH_IMAGE017
is the minimum value of the weight coefficient,
Figure 291630DEST_PATH_IMAGE018
is a first control factor for the first control factor,
Figure DEST_PATH_IMAGE019
is a second control factor for the control of the motor,
Figure 367034DEST_PATH_IMAGE020
in order to be the maximum number of iterations,
Figure DEST_PATH_IMAGE021
is the number of iterations.
4. The method for detecting the surface material quality of the mechanical cutter according to claim 1, wherein the fitness function is as follows:
Figure DEST_PATH_IMAGE023
wherein,
Figure 501343DEST_PATH_IMAGE024
are particles
Figure DEST_PATH_IMAGE025
The corresponding value of the degree of fitness is,
Figure 193355DEST_PATH_IMAGE026
is the ratio of the number of pixels in the 1 st category to the number of pixels in the ROI area image,
Figure DEST_PATH_IMAGE027
is the ratio of the number of pixels in the 2 nd category to the number of pixels in the ROI area image,
Figure 602471DEST_PATH_IMAGE028
the number of pixels in the Nth category and the pixels in the ROI area imageThe ratio of the number of the first and second groups,
Figure DEST_PATH_IMAGE029
is the average value of the gray levels of the pixels in the 1 st category,
Figure 266802DEST_PATH_IMAGE030
is the average value of the gray levels of the pixels in the 2 nd category,
Figure DEST_PATH_IMAGE031
the gray level mean value of the pixel points in the ROI area image is obtained.
5. The method for detecting the surface material of the mechanical tool according to claim 1, wherein the iteratively combining the initial pixel blocks according to the correlation between any two initial superpixel blocks to obtain N target superpixel blocks comprises:
for any initial superpixel block: combining the initial superpixel block and the initial superpixel block with the maximum correlation to obtain a first superpixel block;
calculating the correlation of any two first superpixel blocks;
for any first superpixel block: combining the first super-pixel block and the first super-pixel block with the maximum correlation to obtain a second super-pixel block;
and when the correlations among the super pixel blocks are all smaller than a set threshold value, stopping merging the super pixel blocks, and marking the super pixel block obtained by the last merging as a target super pixel block.
6. The method for detecting the surface material of the mechanical cutter according to claim 1, wherein the step of calculating the defect index of the cutter to be detected according to the gray values of the pixel points in each category comprises the following steps:
counting the number of pixel points in each category, taking the category with the largest number of pixel points as a normal category of the surface of the cutter, and taking other categories as defect categories, wherein the other categories are the categories except the normal category of the surface of the cutter in the N categories;
calculating the gray average value of the pixel points in the normal category of the surface of the cutter according to the gray value of each pixel point in the normal category of the surface of the cutter;
for any defect class: calculating the gray average value of the pixel points in the category according to the gray value of each pixel point in the category;
and calculating the defect index of the cutter to be detected according to the gray average value of the pixel points in the normal category of the surface of the cutter and the gray average value of the pixel points in each defect category.
7. The method for detecting the surface material of the mechanical cutter according to claim 6, wherein the defect index of the cutter to be detected is calculated by adopting the following formula:
Figure DEST_PATH_IMAGE033
wherein,
Figure 444449DEST_PATH_IMAGE034
is an index of the defects of the cutter to be detected,
Figure DEST_PATH_IMAGE035
the sum of the number of pixels in the defect class,
Figure 233544DEST_PATH_IMAGE036
is the total number of defect classes,
Figure DEST_PATH_IMAGE037
is the gray average value of the pixel points in the normal category of the surface of the cutter to be detected,
Figure 584367DEST_PATH_IMAGE038
is as follows
Figure DEST_PATH_IMAGE039
Pixel point in defect categoryThe average value of the gray levels of (a),
Figure 165521DEST_PATH_IMAGE040
is the base of the natural logarithm.
8. A machine tool surface material detection system comprising a memory and a processor, wherein the processor executes a computer program stored in the memory to implement a machine tool surface material detection method according to any one of claims 1 to 7.
CN202210895287.3A 2022-07-28 2022-07-28 Method and system for detecting surface material of mechanical cutter Active CN115063409B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210895287.3A CN115063409B (en) 2022-07-28 2022-07-28 Method and system for detecting surface material of mechanical cutter

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210895287.3A CN115063409B (en) 2022-07-28 2022-07-28 Method and system for detecting surface material of mechanical cutter

Publications (2)

Publication Number Publication Date
CN115063409A true CN115063409A (en) 2022-09-16
CN115063409B CN115063409B (en) 2022-11-11

Family

ID=83206342

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210895287.3A Active CN115063409B (en) 2022-07-28 2022-07-28 Method and system for detecting surface material of mechanical cutter

Country Status (1)

Country Link
CN (1) CN115063409B (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115272353A (en) * 2022-10-07 2022-11-01 山东盛世恒机械制造有限公司 Image processing method suitable for crack detection
CN115294113A (en) * 2022-09-30 2022-11-04 南通佳木汇木制品有限公司 Wood veneer quality detection method
CN115393657A (en) * 2022-10-26 2022-11-25 金成技术股份有限公司 Metal pipe production abnormity identification method based on image processing
CN115439474A (en) * 2022-11-07 2022-12-06 山东天意机械股份有限公司 A fast fault location method for power equipment
CN115431101A (en) * 2022-10-18 2022-12-06 南通钜德智能科技有限公司 Method and system for detecting state of numerical control machine tool
CN115965624A (en) * 2023-03-16 2023-04-14 山东宇驰新材料科技有限公司 Detection method for anti-wear hydraulic oil pollution particles
CN117124139A (en) * 2023-10-26 2023-11-28 合肥亚明汽车部件有限公司 Visual detection method for intelligent machine tool cutter abrasion
CN117274241A (en) * 2023-11-17 2023-12-22 四川赢信汇通实业有限公司 Brake drum surface damage detection method and device based on rapid image analysis
CN118365633A (en) * 2024-06-17 2024-07-19 陕西中盛天泽复合材料科技有限公司 Industrial product defect detection method and system based on image processing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108053413A (en) * 2017-12-12 2018-05-18 上海斐讯数据通信技术有限公司 A kind of method for detecting image edge and system based on particle cluster algorithm
CN109120230A (en) * 2018-07-19 2019-01-01 苏州热工研究院有限公司 A kind of solar battery sheet EL image detection and defect identification method
CN114549497A (en) * 2022-02-28 2022-05-27 扬州市恒邦机械制造有限公司 Method for detecting surface defects of walking board based on image recognition and artificial intelligence system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108053413A (en) * 2017-12-12 2018-05-18 上海斐讯数据通信技术有限公司 A kind of method for detecting image edge and system based on particle cluster algorithm
CN109120230A (en) * 2018-07-19 2019-01-01 苏州热工研究院有限公司 A kind of solar battery sheet EL image detection and defect identification method
CN114549497A (en) * 2022-02-28 2022-05-27 扬州市恒邦机械制造有限公司 Method for detecting surface defects of walking board based on image recognition and artificial intelligence system

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115294113A (en) * 2022-09-30 2022-11-04 南通佳木汇木制品有限公司 Wood veneer quality detection method
CN115294113B (en) * 2022-09-30 2023-10-27 南通佳木汇木制品有限公司 Quality detection method for wood veneer
CN115272353A (en) * 2022-10-07 2022-11-01 山东盛世恒机械制造有限公司 Image processing method suitable for crack detection
CN115431101A (en) * 2022-10-18 2022-12-06 南通钜德智能科技有限公司 Method and system for detecting state of numerical control machine tool
CN115393657A (en) * 2022-10-26 2022-11-25 金成技术股份有限公司 Metal pipe production abnormity identification method based on image processing
CN115439474A (en) * 2022-11-07 2022-12-06 山东天意机械股份有限公司 A fast fault location method for power equipment
CN115965624A (en) * 2023-03-16 2023-04-14 山东宇驰新材料科技有限公司 Detection method for anti-wear hydraulic oil pollution particles
CN117124139A (en) * 2023-10-26 2023-11-28 合肥亚明汽车部件有限公司 Visual detection method for intelligent machine tool cutter abrasion
CN117124139B (en) * 2023-10-26 2024-01-09 合肥亚明汽车部件有限公司 Visual detection method for intelligent machine tool cutter abrasion
CN117274241A (en) * 2023-11-17 2023-12-22 四川赢信汇通实业有限公司 Brake drum surface damage detection method and device based on rapid image analysis
CN117274241B (en) * 2023-11-17 2024-02-09 四川赢信汇通实业有限公司 Brake drum surface damage detection method and device based on rapid image analysis
CN118365633A (en) * 2024-06-17 2024-07-19 陕西中盛天泽复合材料科技有限公司 Industrial product defect detection method and system based on image processing

Also Published As

Publication number Publication date
CN115063409B (en) 2022-11-11

Similar Documents

Publication Publication Date Title
CN115063409B (en) Method and system for detecting surface material of mechanical cutter
CN113435460B (en) A recognition method for bright crystal granular limestone images
CN110148130B (en) Method and device for detecting part defects
CN116777907A (en) Sheet metal part quality detection method
CN115147409B (en) Mobile phone shell production quality detection method based on machine vision
CN116152242B (en) Visual detection system of natural leather defect for basketball
CN116664565A (en) Hidden crack detection method and system for photovoltaic solar cell
CN116030060B (en) Plastic particle quality detection method
CN113469951A (en) Hub defect detection method based on cascade region convolutional neural network
CN118279304B (en) Abnormal recognition method, device and medium for special-shaped metal piece based on image processing
CN109359604B (en) Method for identifying instrument under shadow interference facing inspection robot
CN116703251A (en) Rubber ring production quality detection method based on artificial intelligence
CN114495098B (en) Diaxing algae cell statistical method and system based on microscope image
CN118071749B (en) A training method and system for steel surface defect detection model
CN113673396B (en) Spore germination rate calculation method, device and storage medium
CN119599994A (en) An intelligent visual inspection system and method for non-standard automated production lines
CN119151938A (en) Surface defect detection method and detection system based on vision
CN114548250A (en) Mobile phone appearance detection method and device based on data analysis
CN118967644A (en) A workpiece surface defect detection method based on multi-attention mechanism
CN116630814B (en) Quick positioning and evaluating method for building disasters based on machine learning
CN118967474A (en) A defect image enhancement method based on traditional data enhancement
CN118587496A (en) Automatic identification system and method of parts processing accuracy based on computer vision
CN118429320A (en) Method and system for detecting coating defects of photovoltaic glass
CN118333929B (en) A method for handling uncertainty in multi-defect classification
CN119941725B (en) Chip defect detection method, device, equipment and medium based on diffusion model

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant