[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN109685756A - Image feature automatic identifier, system and method - Google Patents

Image feature automatic identifier, system and method Download PDF

Info

Publication number
CN109685756A
CN109685756A CN201710970382.4A CN201710970382A CN109685756A CN 109685756 A CN109685756 A CN 109685756A CN 201710970382 A CN201710970382 A CN 201710970382A CN 109685756 A CN109685756 A CN 109685756A
Authority
CN
China
Prior art keywords
image
image feature
testing
standard
sample
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710970382.4A
Other languages
Chinese (zh)
Inventor
黄哲瑄
黄玺轩
张书修
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Leda Creative Technology Co Ltd
Original Assignee
Leda Creative Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Leda Creative Technology Co Ltd filed Critical Leda Creative Technology Co Ltd
Priority to CN201710970382.4A priority Critical patent/CN109685756A/en
Publication of CN109685756A publication Critical patent/CN109685756A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10004Still image; Photographic image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection

Landscapes

  • Engineering & Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)

Abstract

The present invention relates to a kind of image feature automatic identifiers, system and method.The image feature automatic identification method includes the following steps: to carry out image processing program to the multiple sample images for being respectively provided with different image features, and respectively overlaps processing result image caused by image processing program and standard picture to generate multiple sample images of amplification;The multiple sample images for expanding forward and backward are supplied to deep learning system, to establish the automatic identification algorithm of image feature comprising there is the appreciative standard for image feature;The testing image of object to be detected is captured, testing image is analyzed with image feature automatic identification algorithm, and judges whether testing image has image feature according to appreciative standard.Effectively improve processing procedure with image feature automatic identification technique and reduce flaw, saves a large amount of time and cost.

Description

Image feature automatic identifier, system and method
Technical field
The present invention relates to a kind of image feature automatic identifiers, system and method, will be used for depth more particularly to a kind of Image feature automatic identifier, the system and method that the sample image of degree learning system is first expanded.
Background technique
As machine learning (Machine Learning) technology reaches its maturity, no matter in image identification, speech recognition Or the various aspects such as natural language processing, there is more diversified application.
Wherein, the combination of image identification technology and machine learning techniques is especially outstanding, in addition to distinguishing in basic handwriting Except the application such as knowledge, Object identifying and human face recognition, the skill of deep learning (Deep Learning) and image identification integration Art also combines automatic optics inspection (Automated Optical Inspection, abbreviation AOI) system often, and is applied Product quality management control in process of producing product.
Machine learning algorithm is that a kind of automatically analyze from data obtains rule, and assimilated equations carry out in advance unknown data The algorithm of survey.It will be apparent that in order to ensure the algorithm come out produced by deep learning can correctly differentiate unknown data, it is necessary to A large amount of sample data is provided in the training process (Training) of deep learning especially largely has the sample of label (Label) Product data can sufficiently and correctly learn the key to differentiation so as to the model (model) of deep learning.
However, the collection not a duck soup of a large amount of samples, especially when deep learning system is used in process of producing product In quality control, the label of Learning Identification is usually wanted to be the unwanted visual characteristic of product, if require the producer elder generation output of product Extremely large amount of flaw product, and after hand picking goes out a large amount of flaw sample and is marked, it can effectively apply depth Learning system assists to generate the algorithm that can recognize unwanted visual characteristic automatically, and then the algorithm by recognizing unwanted visual characteristic automatically, returns Head come assist the producer carry out quality control and improve processing procedure, this is not obviously an ideal scheme.
Summary of the invention
Technical problem to be solved by the present invention lies in provide a kind of image feature in view of the deficiencies of the prior art and distinguish automatically Identification device, system and method can pass through the quantity of massive amplification sample image, effectively promote training under deep learning system The data diversity that Cheng Suoneng is touched, so can promote efficiency that deep learning system is recognized automatically applied to image feature with Correctness.
In order to solve the above technical problems, it is special to be to provide a kind of image for a wherein technical solution of the present invention Levy automatic identifier comprising a storage element, a processing unit and an image acquisition unit, wherein the storage is single Member stores a database, and the database stores one first image feature classification group and an at least standard picture, institute It states the first image feature classification group and stores multiple first sample images, each described first sample image is respectively provided with not The first same image feature;The processing unit is connect with the storage element signal;The image acquisition unit and the place Cell signal connection is managed, with the testing image for capturing an object to be detected, the processing unit is read in the database Multiple first sample images, multiple first sample images carry out image processing programs to generate multiple images respectively Processing result, and multiple described image processing results are overlapped with multiple standard pictures respectively, to generate amplification respectively Multiple first sample images, the processing unit executes according to multiple first sample images before amplification and after amplification The training program of one deep learning system, to establish the automatic identification algorithm of an image feature, the image feature recognizes calculation automatically Method includes one first appreciative standard for first image feature, and the processing unit takes from the image acquisition unit The testing image is obtained, the processing unit executes the automatic identification algorithm of image feature and divides the testing image Analysis, and the processing unit judges whether the testing image has first image special according to first appreciative standard Sign.
In order to solve the above technical problems, it is special to be to provide a kind of image for an other technical solution of the present invention Levy automatic identification system comprising a server-side and a test side, wherein the server-side includes a storage element and one Processing unit, the storage element store a database, the database store one first image feature classification group with And an at least standard picture, the first image feature classification group store multiple first sample images, each described A sample image is respectively provided with the first different image features;The processing unit is connect with the storage element signal.Wherein, The processing unit reads multiple first sample images in the database, and carries out an image processing program respectively, And processing result image caused by described image processing routine is respectively overlapped with the standard picture to generate respectively Multiple first sample images of amplification;The processing unit is executed according to multiple first sample images before amplification and after amplification The training program of one deep learning system, to establish the automatic identification algorithm of an image feature, the image feature recognizes calculation automatically Method includes one first appreciative standard for first image feature.The test side is connect with the servo end signal, And the automatic identification algorithm of image feature can be received by the server-side, the test side include an image acquisition module and One processing module, a testing image of the image acquisition module to capture an object to be detected;The processing module with it is described The connection of image acquisition module signal, to obtain the testing image from the image acquisition module, the processing module executes institute The automatic identification algorithm of image feature is stated to analyze the testing image, and according to first appreciative standard judgement it is described to Whether altimetric image has first image feature.
In order to solve the above technical problems, it is special to be to provide a kind of image for an other technical solution of the present invention Levy automatic identification method comprising the following steps: to multiple first sample images for being respectively provided with the first different image features Carry out an image processing program, and respectively by processing result image caused by described image processing routine with do not have described the One standard picture of one image feature is overlapped to generate multiple first sample images of amplification;Before expanding and after amplification Multiple first sample images be supplied to a deep learning system, to establish the automatic identification algorithm of an image feature, the image The automatic identification algorithm of feature includes one first appreciative standard for first image feature;Capture the one of an object to be detected Testing image analyzes the testing image with the automatic identification algorithm of the image feature, and according to first identification Standard judges whether the testing image has first image feature.
The beneficial effects of the present invention are image feature automatic identifiers, system provided by technical solution of the present invention And method, can by " to be respectively provided with different images feature multiple sample images carry out image processing program, and with do not have There is the standard picture of the image feature to be overlapped to generate multiple sample images of amplification " and " before expanding and expand Multiple sample images after increasing are supplied to deep learning system " technical characteristic, to promote training under deep learning system The data diversity that Cheng Suoneng is touched, so can promote efficiency that deep learning system is recognized automatically applied to image feature with Correctness, and the stage of extremely large amount of flaw sample is arrived in not yet accumulation, it will be able to it is special to generate image using deep learning system Automatic identification algorithm is levied, in the early stage of new product processing procedure, can effectively be improved with image feature automatic identification technique Processing procedure reduces flaw, saves a large amount of time and cost.
For that can be further understood that feature and technology contents of the invention, please refer to the following detailed descriptions related to the present invention With attached drawing, however provided attached drawing is merely provided for reference and description, is not intended to limit the present invention.
Detailed description of the invention
Fig. 1 is the image feature automatic identifier functional block diagram of first embodiment of the invention.
Fig. 2A is that the image processing program of first embodiment through the invention adjusts the image shape of the first sample image Adjust result schematic diagram.
Fig. 2 B is that the image processing program of first embodiment through the invention adjusts the image gray scale of the second sample image Adjust result schematic diagram.
Fig. 3 is the image feature automatic identification system functional block diagram of second embodiment of the invention.
Fig. 4 is the broad flow diagram of the image feature automatic identification method of third embodiment of the invention.
Fig. 5 is that the image feature automatic identification method of fourth embodiment of the invention executes the flow chart of Pre-testing program.
Specific embodiment
Be below illustrated by specific specific example it is presently disclosed it is related " image feature automatic identifier, The embodiment of system and method ", those skilled in the art can understand advantages of the present invention by content disclosed in this specification With effect.The present invention can be implemented or be applied by other different specific embodiments, the various details in this specification Various modifications and change can be carried out without departing from the spirit of the present invention based on different viewpoints and application.In addition, of the invention is attached Figure is only simple schematically illustrate, not according to the description of actual size, states in advance.The following embodiments and the accompanying drawings will further specifically Bright the relevant technologies content of the invention, but the protection scope that disclosure of that is not intended to limit the invention.
First embodiment
It please refers to shown in Fig. 1, Fig. 2A and Fig. 2 B, Fig. 1 is that the image feature of first embodiment of the invention recognizes dress automatically Set functional block diagram.Fig. 2A is that the image processing program of first embodiment through the invention adjusts the image shape of the first sample image The adjustment result schematic diagram of shape.Fig. 2 B is that the image processing program of first embodiment through the invention adjusts the second sample image The adjustment result schematic diagram of image gray scale.By in above-mentioned figure it is found that first embodiment of the invention to provide a kind of image feature automatic Device for identifying 1 comprising storage element 11, processing unit 12 and image acquisition unit 13.
Refering to Figure 1, storage element 11 stores database 111, database 111 stores the first image feature class Other group G1, the second image feature classification group G2 and an at least standard picture P0.First image feature classification group G1 storage There are multiple first sample image P11~P1N;Second image feature classification group G2 stores multiple second sample image P21 ~P2N.Processing unit 12 is connect with 11 signal of storage element;Image acquisition unit 13 is connect with 12 signal of processing unit, with In the testing image for capturing object (attached drawing is not shown) to be detected.
For convenience of explanation, for below by way of the Defect Detection of contact lenses, illustrate the shadow of first embodiment of the invention As the function mode of feature automatic identifier 1.Please arrange in pairs or groups the functional block diagram of Fig. 1, together refering to shown in Fig. 2A and Fig. 2 B. In the first embodiment of the present invention, the storage element 11 of device 1 regards as qualified contact lenses after storing artificial screening Image (i.e. standard picture P0) and multiple and different flaw contact lens images (i.e. first sample image P11~P1N and second Sample image P21~P2N), the contact lens image of aforementioned qualification and multiple and different flaw contact lens images are all stored up There are in database 111.
In the present embodiment, multiple first sample image P11~P1N are respectively provided with different first image feature D1, more A second sample image P21~P2N is respectively provided with the second different image feature D2.More specifically, working as specific contact lenses When with bubble, contact lenses sample image obtained is shot, compared to qualified contact lens image, can have " has The unwanted visual characteristic (calling " bubble artifacts " in the following text) of bubble ", in the present embodiment just by the unwanted visual characteristic of this " bubble artifacts " as One image feature D1, and the sample image for having the first image feature D1 be the first sample image P11 in the present embodiment~ P1N.According to the flaw contact lenses taken, the first image feature D1 on each first sample image P11~P1N is (i.e. Bubble) it can all be slightly different.On the other hand, when specific contact lenses are during production, in edge generation when demoulding Flaw then shoots contact lenses sample image obtained, compared to qualified contact lens image, can have " edge The unwanted visual characteristic (calling " demoulding flaw " in the following text) of generation flaw ", in the present embodiment just does the unwanted visual characteristic of this " demoulding flaw " For the second image feature D2, and the sample image for having the second image feature D2 is the second sample image in the present embodiment P21~P2N.The second image feature according to the flaw contact lenses taken, on each second sample image P21~P2N D2 (i.e. " demoulding flaw ") also can be slightly different.
In order to allow deep learning system that can correctly pick out different unwanted visual characteristics, it is necessary to suitably by unwanted visual characteristic Classified and is marked.In addition, importantly, sufficient amount of sample image must be provided for deep learning system It practises.In the present embodiment, the producer of contact lenses may first in a manual manner (can certainly be in AOI detection device Under auxiliary), circle selects sample image defective, and according to the type of flaw, will categorizedly have the first image feature First sample image P11~P1N of D1 is stored into the first image feature classification group G1 of database 111, will have second Second sample image P21~P2N of image feature D2 is stored into the second image feature classification group G2 of database 111.It lifts The first sample image P11~P1N data that respectively can have the first image feature D1 for 100 for example and 100 tools There is second sample image P21~P2N data storage of the second image feature D2 into database 111.
However, recognizing automatically to allow the algorithm of subsequent generation that can accurately carry out image feature, therefore, the present invention is first Sample image is expanded.In the present embodiment, multiple sample images in the first reading database 111 of the meeting of processing unit 12, And image processing program is carried out to multiple sample images, to generate multiple images processing result respectively.Image processing program packet Include image shape adjustment programme, image contrast's adjustment programme, image gray scale adjustment programme and photo dazzle color temperature adjustment programme it One or more of combination.Processing unit 12 carries out multiple images processing result with multiple standard picture P0 respectively Overlapping, to generate multiple sample images of amplification respectively.
Specifically for example, it please refers to shown in Fig. 2A, in the present embodiment, processing unit 12 can first reading database The first sample image P11 in 111, and the first sample image P11 is stretched or deformed by image shape adjustment programme, To generate multiple images processing result, and multiple images processing result is overlapped with standard picture P0 respectively, to generate respectively Multiple first sample image P111~P113 of amplification.It more specifically, is the first image spy for being directed to the first sample image P11 Sign D1 (i.e. on image by " bubble artifacts " part that circle is selected) is stretched or is deformed, and by deformed processing result image It is overlapped respectively with standard picture P0.
Separately please refer to shown in Fig. 2 B, in the present embodiment, processing unit 12 can also in first reading database 111 second Sample image P21, and by image gray scale adjustment programme to the second image feature D2 of the second sample image P21 (or only for Upper " demoulding flaw " part at contact lenses edge of image) grayscale adjustment is carried out, to generate multiple images processing result, and Multiple images processing result is overlapped with standard picture P0 respectively, to generate multiple second sample images of amplification respectively P211 and P212.
Although the first sample image P11 is stretched or deformed with image shape adjustment programme respectively above, and lead to It crosses image gray scale adjustment programme and grayscale adjustment, but the classification of image processing program and first is carried out to the second sample image P21 There is no fixed corresponding relationships for the classification of image feature D1 or the second image feature D2.In addition, aforementioned image shape adjusts journey It is between sequence, image contrast's adjustment programme, image gray scale adjustment programme and photo dazzle color temperature adjustment programme nor mutually exclusive Relationship, but can be combined with each other collocation and carry out image adjustment, or even other image regulating methods are added jointly to sample drawing As being adjusted, to increase the diversity of processing result image.It accordingly, just can be by original respective only 100 the first samples Product image P11~P1N and second sample image P21~P2N data massive amplification (for example, be expanded to 100,000 stroke counts respectively According to).
Special one is needed to be mentioned that, in the present embodiment, database 111 only stores a standard picture P0, but originally Invention is not limited thereto, the specific practice, can also store a standard respectively in each image feature classification group Image P0, and the operations such as image procossing and overlapping are executed respectively.
Next, processing unit 12 is according to multiple first sample image P11~P1N and more before amplification and after amplification A second sample image P21~P2N executes the training program of deep learning system, to establish the automatic identification algorithm of image feature. Specifically, used deep learning system can be Caffe, Theano, TensorFlow or Lasagne, Keras very To the frame of DSSTNE etc., the present invention is not limited specifically and is carried out using which kind of frame.Pass through image caused by foregoing manner The automatic identification algorithm of feature includes the first identification for the first image feature D1 (being in the present embodiment " bubble artifacts ") Standard and the second appreciative standard for being directed to the second image feature D2 (being in the present embodiment " demoulding flaw ").
After the completion of the automatic identification algorithm of image feature is established, detectable substance progress just can be treated with the device of the invention 1 Detection.Specifically, image acquisition unit 13 (such as pick-up lens) captures the testing image of object to be detected, then, processing unit 12 self imaging acquisition units 13 obtain testing image, and execute the automatic identification algorithm of image feature and analyze testing image. Processing unit 12 judges whether testing image has the first image feature D1 according to the first appreciative standard, and is marked according to the second identification Standard judges whether testing image has the second image feature D2.
It so far, is exactly the function mode on 1 basis of image feature automatic identifier of the invention.In the present embodiment, lead to Massive amplification the first sample image P11~P1N and second sample image P21~P2N is crossed, so that in the instruction of deep learning system Practice in program, the automatic identification algorithm of more accurately image feature can be established out.
The discovery and foundation of flaw classification
Although it should be strongly noted that doing example explanation immediately above with " bubble artifacts " and " demoulding flaw ", originally Invention is not limited to set a variety of flaw types at the very start to be detected, and most can also start only to set a kind of flaw Defect feature detects, and during the automatic identification algorithm of subsequent execution image feature analyzes testing image, ability root Other the unwanted visual characteristic classifications to be tested are screened and established according to testing result.
As an example it is assumed that only storing the first image feature classification group G1 in original database 111, and generated The automatic identification algorithm of image feature, which is only set, recognizes the first image feature D1 of first sample image P11~P1N The first appreciative standard.However, during being tested by the automatic identification algorithm of image feature to multiple testing images, Processing unit 12 judges that multiple testing images do not meet standard picture P0, but all has the second image feature D2, at this point, processing is single Member 12 can establish the second image feature D2 classification group G2 in database 111, and have the second image special for multiple respectively The testing image of sign D2 is respectively recorded as multiple second sample image P21, and is stored in the second image feature D2 classification group G2 In.By this mode, help to find and establish new flaw classification, to lack for unknown on product more initiatively Be trapped into row improves in real time.
Accuracy verifying and improvement
By process presented hereinbefore, it has been enough to enable deep learning system of the invention using very huge and more The sample image of sample is trained, and can generate the judgement more accurately automatic identification algorithm of image feature.However, aforementioned expansion Generated sample image after increasing, naturally it is also possible to carry out image processing program again, further amplification becomes a greater amount of samples Product image, and may further improve the precision of the automatic identification algorithm identification of image feature.It must in order to be confirmed whether to have Sample image is expanded again, the device of the invention 1 can also be in the automatic identification algorithm pair of practice image feature Before testing image is tested, the accuracy that the generated automatic identification algorithm of image feature carries out identification operation is verified in advance.
The specific practice is by processing unit 12 before the training program for the deep learning system that executes, first by multiple the The first sample image of a part (such as 2 one-tenth) P11 in a sample image P11 is selected as the first verifying image, and with remaining The training program of multiple (such as remaining 8 one-tenth) first sample image P12~P1N execution deep learning system.Also, in depth After learning system establishes the automatic identification algorithm of image feature, processing unit 12 executes the automatic identification algorithm of image feature to previously choosing The first verifying selected is verified with image.That is, being marked according to the first identification in the automatic identification algorithm of image feature Standard, judges whether the first verifying image has the first image feature D1, to confirm in the automatic identification algorithm of image feature The correctness of one appreciative standard.If the first verifying image can not be picked out with the first image feature D1, or will not have The image (such as standard picture P0) of first image feature D1 is recognized as having the first image feature D1, then it represents that identification result is wrong Accidentally;Conversely, indicating that identification result is correct.
The user of device 1 can preset the first accuracy threshold value with through the processing unit 12, further, it is also possible to according to Need to adjust the quantity of the first verifying image ratio shared in multiple first sample image P11.It is practical when carrying out, it can be with The quantity of first verifying image is set in 3% to 50% in all the first sample image P11.Executing image feature certainly Dynamic identification algorithm, and whether have first according to the first appreciative standard judgment criteria image P0 and multiple first verifying images After image feature D1, its identification result is recorded correctly or incorrectly, in other words, the first appreciative standard pair is recorded according to judging result The first identification accuracy of first image feature D1.
Next, the first identification accuracy is compared to each other with preset first accuracy threshold value.It is distinguished first When knowing accuracy lower than the first accuracy threshold value, expression is supplied to the sample image that deep learning system is trained may be simultaneously Not enough, therefore, in order to execute further training, processing unit 12 by multiple first sample image P11 again into Row image processing program, with the further multiple first sample image P11 for generating amplification.Certainly, expand again again to verify Sample image after increasing is provided to deep learning system and is trained, and after the first appreciative standard of amendment, if has been able to The automatic identification algorithm of sufficiently accurate image feature is generated, therefore, is still to carry out proving program above-mentioned.Specifically, processing For unit 12 in multiple first sample image P11 after expanding again, selecting 3% to 50% again is the first verifying image, And remaining multiple first sample image P11 is again supplied to deep learning system, to correct the first appreciative standard, and to repair Whether judgment criteria image P0 and multiple first verifying images have the first image special to the first appreciative standard after just again D1 is levied, and obtains the first identification accuracy again.If will be returned to that is, the first accuracy threshold value cannot be reached Image processing program further expands sample image.Until the first identification accuracy is being higher than (including just reaching) first just When true rate threshold value, the automatic identification algorithm of image feature is just applied to the detection of object to be detected, and by processing unit 12 The automatic identification algorithm of image feature is executed, with according to modified first appreciative standard final in the automatic identification algorithm of image feature, Judge capture from the testing image of object to be detected whether there is the first image feature D1.In order to avoid setting excessively high at the beginning One accuracy threshold value leads to that standard is not achieved always, and image processing program is caused constantly to expand sample image, can also be with Set other stop conditions, but itself and non-present invention institute and the emphasis emphasized, in addition how actual conditions set is not gone to live in the household of one's in-laws on getting married herein It states.
Pre-testing
On the other hand, it is also necessary to a problem of consideration is, if the first image is special in the sample image being initially provided of The diversity for levying D1 is just insufficient, then the automatic identification algorithm of image feature for being likely to influence subsequent foundation is being identified When correctness, even if carrying out repeated amplification to sample image, it is also possible to because diversity at the beginning is too low to carry out Efficient training program.In order to solve the problems, such as this one, in the present embodiment, device 1 is before executing image processing program, moreover it is possible to Processing unit 12 is enough set to first carry out a Pre-testing program in advance.
Specifically, multiple first sample image P11~P1N (are not yet carried out any image procossing journey by processing unit 12 Sequence) in 3% to 50% be selected as the first preliminary examination image, and by remaining multiple first sample drawing in the first sample image P11 It include one first preliminary examination standard inspection for the first image feature D1 to establish as P11~P1N is supplied to deep learning system It is quasi-.It is enough due to only tentatively to confirm whether first acquired sample image P11~P1N has herein during one Diversity, therefore can be carried out using the more simplified deep learning system of framework.It similarly, also will 12 setting through the processing unit Door is defined as the first Pre-testing threshold value herein.Due to the diversity only for first sample image P11~P1N A preliminary judgement is done, therefore, the first Pre-testing threshold value need not set too high.It is quasi- compared to being previously used for ensuring finally judging First accuracy threshold value of true rate, the numerical requirements of the first Pre-testing threshold value herein are lower, therefore, take at the same time In the case of Pre-testing and accuracy verifying, the first Pre-testing threshold value can be lower than the first accuracy threshold value.Processing unit Whether 12 have the first image feature according to the first Pre-testing standard judgment criteria image P0 and multiple first verifying images D1, and the first Pre-testing standard is recorded to the first Pre-testing accuracy of the first image feature D1 according to judging result.
In aforementioned Pre-testing program, if the first Pre-testing accuracy, which has, reaches the first Pre-testing threshold value, the is indicated The diversity of a sample image P11~P1N, which has, reaches desired standard, therefore can continue main flow of the invention, In other words, image processing program can then be executed;Conversely, if the first Pre-testing accuracy is lower than the first Pre-testing door When value, indicate first sample image P11~P1N diversity be in fact it is inadequate, just should terminate that program at this time, not hold The subsequent image processing program of row, and should first acquire more the first sample image P11 with the first image feature D1 of difference ~P1N, to guarantee to carry out deep learning system the effective training of essence.
Second embodiment
It please refers to shown in Fig. 3, Fig. 3 is 2 functional block diagram of image feature automatic identification system of second embodiment of the invention. By upper figure it is found that the second embodiment of the present invention provides a kind of image feature automatic identification system 2 comprising server-side 21, inspection End 22 and sample image feed end 23 are surveyed, in the present embodiment, server-side 21 is the offer of the automatic identification algorithm of image feature Person, test side 22 are connect with 21 signal of server-side, and can receive the automatic identification algorithm of image feature by server-side 21, so that detection End 22 is able to carry out the automatic identification algorithm of image feature, and the testing image for treating detectable substance is detected and analyzed.As for sample Image feed end 23 is also to connect with 21 signal of server-side, and be capable of providing multiple first sample image P11~P1N to server-side 21.On the practical framework of system 2, test side 22 may be same with sample image feed end 23, it is also possible to by distinguishing Setting.
It illustrates, can be seen that in the present embodiment from block diagram shown in Fig. 3, server-side 21, test side 22 And sample image feed end 23 be by network each other signal connect, and can exchange each other signal (such as transmission sample drawing Picture or the automatic identification algorithm of image feature), however, so-called " signal connection " of the invention is not limited to this, by server-side 21, inspection The data storage of end 22 and 23 either end of sample image feed end is surveyed in storage medium such as CD, flash memory or hard disks, then Other any one end are served data to, " signal connection " referred to herein is also complied with, indicates hereby.
Equally using the Defect Detection of contact lenses as example, in simple terms, (the contact lenses production of sample image feed end 23 With proofer) image feature that can recognize " bubble artifacts " (the first image feature D1) automatically in order to obtain recognizes calculation automatically Method, therefore multiple first sample image P11~P1N with the first different image feature D1 are supplied to server-side 21 and (are calculated Method supplier).Server-side 21 generates image by a series of step after receiving multiple first sample image P11~P1N The automatic identification algorithm of feature, and the automatic identification algorithm of image feature is supplied to test side 22 (contact lenses production and inspection Person), so that test side 22 can apply the automatic identification algorithm of image feature in contact lenses produced (object to be detected) In detection.It in other words, can be from the sample image supply for having demand although server-side 21 and the detection without contact lenses The material for obtaining at 23 and generating the automatic identification algorithm of image feature is held, and finished product (the automatic identification algorithm of image feature) is provided To equally having demand and the test side 22 of the automatic identification algorithm of image feature will be executed.
Specifically, server-side 21 includes storage element 211 and processing unit 212, and storage element 211 stores data Library 2111, database 2111 store the first image feature classification group G1 and at least a standard picture P0, and the first image is special Sign classification group G1 stores multiple first sample image P11~P1N (being provided by sample image feed end 23), each the A sample image P11~P1N is respectively provided with the first different image feature D1.Processing unit 212 and 211 signal of storage element connect Connect, and can multiple first sample image P11~P1N in reading database 2111, and carry out an image processing program respectively. Image processing program includes image shape adjustment programme, image contrast's adjustment programme, image gray scale adjustment programme and image A combination of one or more among colour temperature adjustment programme.Processing unit 212 respectively will be caused by image processing program Processing result image is respectively overlapped with standard picture P0 to generate multiple first sample image P11~P1N of amplification.
Processing unit 212 executes a depth according to multiple first sample image P11~P1N before amplification and after amplification The training program of learning system, to establish the automatic identification algorithm of image feature, the automatic identification algorithm of image feature includes for The first appreciative standard of one image feature D1.
More specifically, in the present embodiment, processing unit 212 is before the training program for executing deep learning system, just At least a sample image in multiple first sample image P11~P1N first can be selected as the first verifying image, and with remaining Multiple first sample image P11~P1N execute the training program of deep learning system.When practical operation, image is used in the first verifying Quantity be it is multiple, and the quantity of the first verifying image accounts for the 3% to 50% of multiple first sample image P11~P1N quantity. In addition, processing unit 212 sets the first accuracy threshold value, and image feature is established in deep learning system and recognizes calculation automatically After method, processing unit 212 executes the automatic identification algorithm of image feature, with according to the first appreciative standard judgment criteria image P0 and Whether multiple first verifying images have the first image feature D1, to confirm the correctness of the first appreciative standard.Processing unit 212, which record the first appreciative standard according to judging result, recognizes accuracy to the first of the first image feature D1, and first is distinguished Accuracy is known compared with aforementioned first accuracy threshold value.
When the first identification accuracy is lower than the first accuracy threshold value, processing unit 212 is by multiple first sample images P11~P1N carries out image processing program again, with the further multiple first sample image P11~P1N for generating amplification, and In multiple first sample image P11~P1N after expanding again, 3% to 50% is selected again as the first verifying image, and Remaining multiple first sample image P11~P1N is again supplied to deep learning system, to correct the first appreciative standard, and With revised first appreciative standard, whether judgment criteria image P0 and multiple first verifying images have the first shadow again As feature D1, and the first identification accuracy is obtained again.Conversely, if the first identification accuracy has reached the first accuracy door The automatic identification algorithm of image feature can then be provided and give test side 22 by bank value.
Test side 22 include image acquisition module 222 and processing module 221, image acquisition module 222 to capture to The testing image of detectable substance.Processing module 221 is connect with 222 signal of image acquisition module, and can be from image acquisition module 222 Obtain testing image.After the reception automatic identification algorithm of image feature of server-side 21, processing module 221 executes image for test side 22 The automatic identification algorithm of feature analyzes testing image, and judges whether testing image has first according to the first appreciative standard Image feature D1.
Special one is needed to be mentioned that, since database 2111 in the present embodiment is to be located at server-side 21, without examining End 22 is surveyed, therefore, in the present embodiment, when the processing module 221 of test side 22 judges that multiple testing images do not meet standard drawing As P0, but when all there is the second image feature D2, test side 22 can respectively by it is multiple have the second image feature D2 to mapping As being respectively recorded as multiple second sample images, and multiple second sample images are supplied to server-side 21.After this, then by The processing unit 212 of server-side 21 establishes the second image feature classification group G2 in database 2111, and by it is multiple received from Second sample image of test side 22 is stored in the second image feature classification group G2.
After completing new classification and establishing, the processing unit 212 of server-side 21 can also further reading database Multiple second sample images in 2111, and image processing program is carried out respectively, and respectively will be caused by image processing program Processing result image is respectively overlapped with standard picture P0 to generate multiple second sample images of amplification.And processing unit 212 execute the training program of deep learning system according to multiple first sample image P11~P1N before amplification and after amplification, To establish the second appreciative standard for being directed to the second image feature D2 in the automatic identification algorithm of image feature.After completion, servo End 21 can provide the automatic identification algorithm of image feature to test side 22 again.When test side 22 receives image feature certainly again It is according to the after dynamic identification algorithm, and when processing module 221 analyzes testing image with the automatic identification algorithm of image feature One appreciative standard judges whether testing image has the first image feature D1, and judges that testing image is according to the second appreciative standard It is no that there is the second image feature D2.
As described in previously, the present invention can make test side 22 that image feature is automatic by above-mentioned technical characteristic The actual use of identification algorithm is as a result, Real-time Feedback allows server-side 21 that can do further analysis to server-side 21.
Another embodiment is the discovery after test side 22 is detected using the automatic identification algorithm of image feature It is undetected (regardless of whether presetting the unwanted visual characteristic to be recognized) there are bad products, and will be corresponded to by the mode of manual record Testing image store into sample image, and be supplied to server-side 21 and analyzed.If server-side 21 finds have after an analysis New flaw classification, the then adjustment of test side 22 of issuing a separate notice, optimization processing procedure, forms a kind of benign interactive process.
It mentions as in the first embodiment, if in the sample image being initially provided of, the first image feature D1's Diversity is just insufficient, then being likely to influence the automatic identification algorithm of image feature of subsequent foundation when being identified just True property.Therefore, in the present embodiment, device 1 is before executing image processing program, additionally it is possible to processing unit 12 be made to first carry out one in advance A Pre-testing program.After server-side 21 receives multiple first sample image P11~P1N from sample image feed end 23, also can Enough Pre-testing programs that first carries out are to confirm whether first received sample image P11~P1N has enough diversity.Tool For body, the processing unit 212 of server-side 21 by 3% to 50% in multiple first sample image P11~P1N (preferably 15% to 25%) it is selected as the first preliminary examination image, and by remaining multiple first sample drawing in first sample image P11~P1N As P11~P1N (i.e. 50% to 97% first sample image P11~P1N, preferably 75% to 85% the first sample image P11~P1N) it is supplied to deep learning system, it include the first Pre-testing standard for the first image feature D1 with foundation.Together Sample, also 212 it can set the first Pre-testing threshold value through the processing unit in the present embodiment.Processing unit 212 is according to depth Whether the first Pre-testing standard judgment criteria image P0 and multiple first verifying images that learning system is established have first Image feature D1, and it is correct to the first Pre-testing of the first image feature D1 according to judging result the first Pre-testing standard of record Rate.After obtaining the first Pre-testing accuracy, processing unit 212 is by the first Pre-testing accuracy and preset first Pre-testing Threshold value compares.
If the first Pre-testing accuracy is lower than the first Pre-testing threshold value, then it represents that sample image feed end 23 provided First sample image P11~P1N diversity is insufficient, at this point, in the present embodiment, subsequent shadow item amplification is not carried out in server-side 21 Program, but more first different sample image P11~P1N are asked for sample image feed end 23, to enrich the first sample The diversity of image P11~P1N.It in the nature of things, still will be again after receiving more first sample image P11~P1N Confirm whether its diversity has reached standard by educating check problem.Conversely, it is pre- to reach first in the first Pre-testing accuracy When examining threshold value, server-side 21 can continue main flow of the invention, in other words, can hold to received Row the first sample image P11~P1N image processing program is to be expanded.
3rd embodiment
It please refers to shown in Fig. 4, Fig. 4 is the main flow of the image feature automatic identification method of third embodiment of the invention Figure.Illustrate the main flow of image feature automatic identification method provided by the present invention below by way of Fig. 4.Image of the invention is special Sign automatic identification method mainly includes the following steps:
S100: sample image is obtained;
S102: sample image is expanded by image processing program;
S104: verifying image is chosen in multiple sample images;
S106: remaining sample image is supplied to deep learning system and is trained;
S108: with the verifying automatic identification algorithm of image feature of vision inspections deep learning system output;
S110: judge to recognize whether accuracy reaches accuracy threshold value, if so, entering step S112;(it is lower than) if not, Then return to step S102;
S112: the testing image of object to be detected is captured;
S114: testing image is recognized with the automatic identification algorithm of image feature.
Specifically, image feature automatic identification method of the invention can be directed to sample after obtaining sample image first Image carries out image processing program to be expanded (step S100 and step S102).Its specific practice is to be directed to be respectively provided with Multiple first sample images of the first different image features, carry out image shape adjustment programme, image contrast's adjustment programme, A combination of one or more among image gray scale adjustment programme and photo dazzle color temperature adjustment programme, and respectively will be at image Processing result image caused by reason program is overlapped with the standard picture for not having the first image feature to generate amplification Multiple first sample images.
In order to verify whether the first sample image after amplification has been enough to establish the image for providing accurate test effect Therefore at least a sample image in multiple first sample images is selected as in advance in this stage by the automatic identification algorithm of feature Image (step S104) is used in one verifying.At the same time, the first accuracy threshold value can also be set together.In the present embodiment, The quantity of first verifying image accounts for 3% to 50% (for example, taking 20%) of multiple first sample image quantity.First is correct Rate threshold value can do appropriate adjustment for the serious forgiveness of specific flaw depending on product, for example, for " the gas of contact lenses Steep flaw ", due to belonging to more serious flaw, and detection difficulty is not very high, accuracy that should be more demanding, at this point, First accuracy threshold value can be set as 99% or more.On the other hand, when image feature automatic identification method of the invention is same When be applied to detection the second image feature when, can also for the second image feature and with the second image feature second Sample image selects the second verifying image, and sets the second accuracy threshold value.For " demoulding flaw " of contact lenses, Due to belonging to the more difficult flaw accurately judged, if the second image feature is " demoulding flaw " of contact lenses, at this time it is contemplated that Second accuracy threshold value is set as 90~95% or so.
Next, multiple first sample images (or including second sample image) before amplification and after amplification are supplied to Deep learning system is trained, to establish the automatic identification algorithm (step S106) of image feature.Image feature recognizes calculation automatically Method includes the first appreciative standard for the first image feature.
Due to previously selecting a part in multiple first sample images as the first verifying image, After deep learning system establishes the automatic identification algorithm of image feature, whether the first verifying image is judged according to the first appreciative standard With the first image feature, test (step to the automatic identification algorithm of image feature of deep learning system output accordingly S108).Specific practice is, executes the automatic identification algorithm of image feature, and according to the first appreciative standard judgment criteria image and Whether multiple first verifying images have the first image feature, record the first appreciative standard to the first image according to judging result First identification accuracy of feature then compares the first identification accuracy with preset first accuracy threshold value, Whether it is higher than preset first accuracy threshold value (step S110) with confirmation the first identification accuracy.
If the first identification accuracy is lower than the first accuracy threshold value, then step S102 is returned to, by multiple first samples Image carries out image processing program again, with further multiple first sample images for generating amplification, and sequentially executes step S104 to step S110 selects 3% to 50% again and uses for the first verifying from multiple first sample images after amplification again Image, and remaining multiple first sample image is again supplied to deep learning system, to correct the first appreciative standard, and with Whether judgment criteria image and multiple first verifying images have the first image special to revised first appreciative standard again Sign, and the first identification accuracy is obtained again.It is correct with preset first again after obtaining the first identification accuracy again Rate threshold value compares, until the first identification accuracy reaches the first accuracy threshold value.
After the first identification accuracy reaches the first accuracy threshold value, so that it may which the image feature established is automatic Identification algorithm is applied to detect object to be detected.Specifically, first have to capture the testing image (step of object to be detected S112), next, being analyzed with the automatic identification algorithm of image feature testing image, and judged according to the first appreciative standard Whether testing image has the first image feature (step S114).
It is above exactly the main flow of image feature automatic identification method of the invention.Certainly, image feature of the invention Automatic identification method, additionally it is possible to when judging that multiple testing images do not meet standard picture, but all there is the second image feature, point Multiple testing images multiple second sample images are not recorded as.This part details can refer to first and second embodiment, herein It does not repeat to repeat.In addition, image feature automatic identification method of the invention to be applied to have the second different image features Multiple second sample images when, equally to carry out following procedure: to being respectively provided with multiple the of the second different image features Two sample images carry out image processing program, and respectively by processing result image caused by image processing program with do not have the The standard picture of two image features is overlapped to generate multiple second sample images of amplification;It will be before amplification and after amplification Multiple second sample images are supplied to deep learning system, are directed to the second image to establish in the automatic identification algorithm of image feature One second appreciative standard of feature;The testing image of object to be detected is captured, with the automatic identification algorithm of image feature to testing image It is analyzed;Wherein, judge whether testing image has the first image feature according to the first appreciative standard;Wherein, according to second Appreciative standard judges whether testing image has the second image feature.
Fourth embodiment
In order to ensure the sample image most started has enough diversity, image feature automatic identification method of the invention Can also aforementioned third embodiment step S100 to the centre of step S102, add Pre-testing process.Please refer to Fig. 5 institute Show, Fig. 5 is that the image feature automatic identification method of fourth embodiment of the invention executes the flow chart of Pre-testing program.Of the invention Image feature automatic identification method mainly includes the following steps: when executing Pre-testing program
S100: sample image is obtained;
S116: preliminary examination image is chosen in multiple sample images;
S118: remaining sample image is supplied to deep learning system and is trained;
S120: with preliminary examination vision inspections sample image diversity;
S122: judge to recognize whether accuracy is higher than Pre-testing threshold value, if so, entering step S102;(it is lower than) if not, Then return to step S100;
S102: sample image is expanded by image processing program;
Specifically, image feature automatic identification method of the invention, can be first by multiple first after obtaining sample image 3% to 50% in sample image is selected as the first preliminary examination image (step S100 and step S116).It at the same time, can also be with The first Pre-testing threshold value is set together.As described in previously, the first Pre-testing threshold value is not necessarily like the first accuracy threshold value It is so high, therefore, it can be set as 70% to 90%, certainly, concrete condition optionally can be adjusted voluntarily.
It is instructed next, remaining multiple first sample image in the first sample image are supplied to deep learning system Practice, includes the first Pre-testing standard (step S118) for the first image feature with foundation.
After the completion of abovementioned steps, with preliminary examination vision inspections sample image diversity (step S120).Specifically, it is Whether there is the first image feature according to the first Pre-testing standard judgment criteria image and multiple first preliminary examination images, according to Judging result records the first Pre-testing standard to the first Pre-testing accuracy of the first image feature.
Next, the first Pre-testing accuracy is compared (step S122) with the first Pre-testing threshold value.Wherein, When one Pre-testing accuracy is lower than the first Pre-testing threshold value, indicate that the diversity of the first sample image is insufficient, it is necessary to increase The quantity of the first sample image with the first different image features, therefore step S100 is returned to, obtaining more has difference The first image feature the first sample image;Conversely, when the first Pre-testing accuracy reaches the first Pre-testing threshold value, i.e., The main flow for carrying out image feature automatic identification method of the present invention can be connected, in other words, S102 can be entered step, executes figure As processing routine expands the first sample image.
The beneficial effects of the present invention are image feature automatic identifiers, system provided by technical solution of the present invention And method, can by " to be respectively provided with different images feature multiple sample images carry out image processing program, and with do not have There is the standard picture of image feature to be overlapped to generate multiple sample images of amplification " and " will be before amplification and after amplification Multiple sample images be supplied to deep learning system " technical characteristic, to promote the training process institute under deep learning system The data diversity that can be touched, and then efficiency that deep learning system is recognized automatically applied to image feature and correct can be promoted Property, and the stage of extremely large amount of flaw sample is arrived in not yet accumulation, it will be able to image feature is generated certainly using deep learning system Dynamic identification algorithm effectively can improve processing procedure with image feature automatic identification technique in the early stage of new product processing procedure Flaw is reduced, a large amount of time and cost are saved.
Content disclosed above is only preferred possible embodiments of the invention, not thereby limits to right of the invention and wants The protection scope of book is sought, so all equivalence techniques variations done with description of the invention and accompanying drawing content, are both contained in In the protection scope of claims of the present invention.

Claims (22)

1. a kind of image feature automatic identifier characterized by comprising
One storage element, stores a database, and the database stores one first image feature classification group and extremely A few standard picture, the first image feature classification group store multiple first sample images, each described first sample Product image is respectively provided with the first different image features;
One processing unit is connect with the storage element signal;And
One image acquisition unit is connect with the processing unit signal, with the testing image for capturing an object to be detected:
Wherein, the processing unit reads multiple first sample images in the database, multiple first samples Image carries out image processing program to generate multiple images processing result respectively, and multiple described image processing results respectively with it is more A standard picture is overlapped, to generate multiple first sample images of amplification respectively;
Wherein, the processing unit executes a deep learning according to multiple first sample images before amplification and after amplification The training program of system, to establish the automatic identification algorithm of an image feature, the automatic identification algorithm of image feature includes needle To one first appreciative standard of first image feature;
Wherein, the processing unit obtains the testing image from the image acquisition unit, described in the processing unit executes The automatic identification algorithm of image feature analyzes the testing image, and the processing unit is according to first appreciative standard Judge whether the testing image has first image feature.
2. the apparatus according to claim 1, which is characterized in that described image processing routine includes image shape adjustment journey Sequence, image contrast's adjustment programme, image gray scale adjustment programme and photo dazzle color temperature adjustment programme one or both of with On combination.
3. the apparatus according to claim 1, which is characterized in that the processing unit also further executes following procedure:
Before the training program for the deep learning system that executes, by least one first sample in multiple first sample images Image is selected as one first verifying image, and executes the deep learning system with remaining multiple described first sample image Training program;And
After the deep learning system establishes the automatic identification algorithm of the image feature, judged according to first appreciative standard Whether the first verifying image has first image feature, to confirm the correctness of first appreciative standard.
4. device according to claim 3, which is characterized in that the first verifying quantity of image is multiple, and institute The quantity for stating the first verifying image accounts for the 3% to 50% of multiple first sample image quantity, the processing unit also into One step executes following procedure:
Set one first accuracy threshold value;And
It executes the automatic identification algorithm of the image feature, and the standard picture and is judged according to first appreciative standard more Whether a first verifying image has first image feature, records first appreciative standard according to judging result Accuracy is recognized to the one first of first image feature;
Wherein, the following steps are executed when the first identification accuracy is lower than the first accuracy threshold value:
Multiple first sample images are subjected to described image processing routine again, with further multiple first samples for generating amplification Image;And
In multiple first sample images after expanding again, select 3% to 50% again as the first verifying image, and by its Remaining multiple first sample images are again supplied to the deep learning system, to correct first appreciative standard, and to repair First appreciative standard after just judges whether the standard picture and multiple first verifying images have again First image feature, and the first identification accuracy is obtained again;
Wherein, when the first identification accuracy reaches the first accuracy threshold value, according to first appreciative standard Judge capture from the testing image of the object to be detected whether there is first image feature.
5. the apparatus according to claim 1, which is characterized in that the processing unit also further executes following procedure:
When judging that multiple testing images do not meet the standard picture, but all there is second image feature, described One second image feature classification group of Database, and have multiple described in second image feature to mapping respectively As being respectively recorded as multiple second sample images, and it is stored in the second image feature classification group.
6. device according to claim 5, which is characterized in that the processing unit also further executes following procedure:
Multiple second sample images in the database are read, and carry out described image processing routine respectively, and respectively Processing result image caused by described image processing routine is respectively overlapped with the standard picture to generate amplification Multiple second sample images;
Execute the training program of the deep learning system according to multiple first sample images before amplification and after amplification, with One second appreciative standard for being directed to second image feature is established in the automatic identification algorithm of image feature;And
Judge whether the testing image has first image feature according to first appreciative standard, and according to described Two appreciative standards judge whether the testing image has second image feature.
7. the apparatus according to claim 1, which is characterized in that the processing unit is executing described image processing routine Before, also further execute following procedure:
3% to 50% in multiple first sample images is selected as the first preliminary examination image, and by first sample drawing Remaining multiple first sample image as in are supplied to the deep learning system, include for first image to establish One first Pre-testing standard of feature;
Set one first Pre-testing threshold value;And
Judge whether the standard picture and multiple first verifying images have according to the first Pre-testing standard First image feature records the first Pre-testing standard to the one first of first image feature according to judging result Pre-testing accuracy;
Wherein, it when the first Pre-testing accuracy reaches the first Pre-testing threshold value, executes described image and handles journey Sequence;And
Wherein, when the first Pre-testing accuracy is lower than the first Pre-testing threshold value, terminator.
8. a kind of image feature automatic identification system characterized by comprising
One server-side comprising:
One storage element, stores a database, and the database stores one first image feature classification group and extremely A few standard picture, the first image feature classification group store multiple first sample images, each described first sample Product image is respectively provided with the first different image features;And
One processing unit is connect with the storage element signal;
Wherein, the processing unit reads multiple first sample images in the database, and carries out an image respectively Processing routine, and respectively respectively fold processing result image caused by described image processing routine with the standard picture It closes to generate multiple first sample images of amplification;
Wherein, the processing unit executes a deep learning system according to multiple first sample images before amplification and after amplification Training program, to establish the automatic identification algorithm of an image feature, the automatic identification algorithm of image feature includes for institute State one first appreciative standard of the first image feature;And
One test side is connect with the servo end signal, and can be received the image feature by the server-side and be recognized automatically Algorithm, the test side include:
One image acquisition module, to capture a testing image of an object to be detected;And
One processing module is connect with the image acquisition module signal, described to be measured to obtain from the image acquisition module Image, the processing module execute the automatic identification algorithm of image feature and analyze the testing image, and according to institute It states the first appreciative standard and judges whether the testing image has first image feature.
9. system according to claim 8, which is characterized in that described image processing routine includes image shape adjustment journey Sequence, image contrast's adjustment programme, image gray scale adjustment programme and photo dazzle color temperature adjustment programme one or both of with On combination.
10. system according to claim 8, which is characterized in that the processing unit also further executes following procedure:
Before the training program for the deep learning system that executes, by least a sample image in multiple first sample images It is selected as the first verifying image, and executes the training program of the deep learning system with remaining multiple first sample image; And
After the deep learning system establishes the automatic identification algorithm of the image feature, judged according to first appreciative standard Whether the first verifying image has first image feature, to confirm the correctness of first appreciative standard.
11. system according to claim 10, which is characterized in that the quantity of the first verifying image is multiple, and The quantity of the first verifying image accounts for the 3% to 50% of multiple first sample image quantity, and the processing unit is also Further execute following procedure:
Set one first accuracy threshold value;And
It executes the automatic identification algorithm of the image feature, and the standard picture and is judged according to first appreciative standard more Whether a first verifying image has first image feature, records first appreciative standard according to judging result Accuracy is recognized to the one first of first image feature;
Wherein, when the first identification accuracy is lower than the first accuracy threshold value, the following steps are executed:
Multiple first sample images are subjected to described image processing routine again, with further multiple first samples for generating amplification Image;And
In multiple first sample images after expanding again, select 3% to 50% again as the first verifying image, and by its Remaining multiple first sample images are again supplied to the deep learning system, to correct first appreciative standard, and to repair First appreciative standard after just judges whether the standard picture and multiple first verifying images have again First image feature, and the first identification accuracy is obtained again;
Wherein, when the first identification accuracy reaches the first accuracy threshold value, the image feature is distinguished automatically Algorithm offer is provided and gives the test side.
12. system according to claim 8, it is characterised in that:
The processing module of the test side is judging that multiple testing images do not meet the standard picture, but all has When one second image feature, multiple testing images with second image feature are respectively recorded as multiple respectively Two sample images, and multiple second sample images are supplied to the server-side;
The processing unit of the server-side is in the one second image feature classification group of Database, and by multiple institutes The second sample image is stated to be stored in the second image feature classification group.
13. system according to claim 12, which is characterized in that the processing unit also further executes following procedure:
Multiple second sample images in the database are read, and carry out described image processing routine respectively, and respectively Processing result image caused by described image processing routine is respectively overlapped with the standard picture to generate amplification Multiple second sample images;And
Execute the training program of the deep learning system according to multiple first sample images before amplification and after amplification, with One second appreciative standard for being directed to second image feature is established in the automatic identification algorithm of image feature.
14. system according to claim 13, which is characterized in that the processing module is recognized automatically with the image feature It is to judge whether the testing image has institute according to first appreciative standard when algorithm analyzes the testing image The first image feature is stated, and judges whether the testing image has second image special according to second appreciative standard Sign.
15. system according to claim 8, which is characterized in that may further comprise:
A sample image feed end is connect with the servo end signal, to provide multiple first sample images to described Server-side;
Wherein, the processing unit of the server-side also further executes following procedure:
3% to 50% in multiple first sample images is selected as the first preliminary examination image, and by first sample drawing Remaining multiple first sample image as in are supplied to the deep learning system, include for first image to establish One first Pre-testing standard of feature;
Set one first Pre-testing threshold value;And
Judge whether the standard picture and multiple first verifying images have according to the first Pre-testing standard First image feature records the first Pre-testing standard to the one first of first image feature according to judging result Pre-testing accuracy;
Wherein, it when the first Pre-testing accuracy is lower than the first Pre-testing threshold value, is supplied from the sample image End receives first sample image more with the first different image features;
Wherein, it when the first Pre-testing accuracy reaches the first Pre-testing threshold value, executes described image and handles journey Sequence.
16. a kind of image feature automatic identification method, characterized in that it comprises the following steps:
One image processing program is carried out to multiple first sample images for being respectively provided with the first different image features, and respectively will Processing result image caused by described image processing routine is carried out with the standard picture for not having first image feature It overlaps to generate multiple first sample images of amplification;
Multiple first sample images before amplification and after amplification are supplied to a deep learning system, to establish an image feature Automatic identification algorithm, the automatic identification algorithm of image feature include the one first identification mark for first image feature It is quasi-;And
A testing image of an object to be detected is captured, the testing image is divided with the image feature automatic identification algorithm Analysis, and judge whether the testing image has first image feature according to first appreciative standard.
17. according to the method for claim 16, which is characterized in that described image processing routine includes image shape adjustment journey Sequence, image contrast's adjustment programme, image gray scale adjustment programme and photo dazzle color temperature adjustment programme one or both of with On combination.
18. according to the method for claim 16, which is characterized in that may further comprise:
Before multiple first sample images are supplied to the deep learning system, by multiple first sample images extremely Few a sample image is selected as the first verifying image, and remaining multiple first sample image in first sample image are mentioned Supply the deep learning system;And
After the deep learning system establishes the automatic identification algorithm of the image feature, judged according to first appreciative standard Whether the first verifying image has first image feature, to confirm the correctness of first appreciative standard.
19. according to the method for claim 18, which is characterized in that the quantity of the first verifying image is multiple, and The quantity of the first verifying image accounts for the 3% to 50% of multiple first sample image quantity, and the method is also into one Step includes:
Set one first accuracy threshold value;And
It executes the automatic identification algorithm of the image feature, and the standard picture and is judged according to first appreciative standard more Whether a first verifying image has first image feature, records first appreciative standard according to judging result Accuracy is recognized to the one first of first image feature;
Wherein, when the first identification accuracy is lower than the first accuracy threshold value, the following steps are executed:
Multiple first sample images are subjected to described image processing routine again, with further multiple first samples for generating amplification Image;And
In multiple first sample images after expanding again, select 3% to 50% again as the first verifying image, and by its Remaining multiple first sample images are again supplied to the deep learning system, to correct first appreciative standard, and to repair First appreciative standard after just judges whether the standard picture and multiple first verifying images have again First image feature, and the first identification accuracy is obtained again;
Wherein, when the first identification accuracy reaches the first accuracy threshold value, according to first appreciative standard Judge capture from the testing image of the object to be detected whether there is first image feature.
20. according to the method for claim 16, which is characterized in that may further comprise:
When judging that multiple testing images do not meet the standard picture, but all there is second image feature, respectively will Multiple testing images are recorded as multiple second sample images.
21. according to the method for claim 20, which is characterized in that may further comprise:
Described image processing routine is carried out to multiple second sample images for being respectively provided with the second different image features, and respectively By processing result image caused by described image processing routine and without the standard picture of second image feature It is overlapped to generate multiple second sample images of amplification;
Multiple second sample images before amplification and after amplification are supplied to the deep learning system, with special in the image Levy one second appreciative standard established in automatic identification algorithm and be directed to second image feature;And
Capture the testing image of the object to be detected, with the automatic identification algorithm of the image feature to the testing image into Row analysis;Wherein, judge whether the testing image has first image feature according to first appreciative standard;Its In, judge whether the testing image has second image feature according to second appreciative standard.
22. according to the method for claim 16, which is characterized in that before executing described image processing routine, first carry out one Pre-testing program, the Pre-testing program include:
3% to 50% in multiple first sample images is selected as the first preliminary examination image, and by first sample drawing Remaining multiple first sample image as in are supplied to the deep learning system, include for first image to establish One first Pre-testing standard of feature;
Set one first Pre-testing threshold value;And
Judge whether the standard picture and multiple first preliminary examination images have according to the first Pre-testing standard First image feature records the first Pre-testing standard to the one first of first image feature according to judging result Pre-testing accuracy;
Wherein, when the first Pre-testing accuracy is lower than the first Pre-testing threshold value, increasing has different first The quantity of first sample image of image feature;And
Wherein, it when the first Pre-testing accuracy reaches the first Pre-testing threshold value, executes described image and handles journey Sequence.
CN201710970382.4A 2017-10-16 2017-10-16 Image feature automatic identifier, system and method Pending CN109685756A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710970382.4A CN109685756A (en) 2017-10-16 2017-10-16 Image feature automatic identifier, system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710970382.4A CN109685756A (en) 2017-10-16 2017-10-16 Image feature automatic identifier, system and method

Publications (1)

Publication Number Publication Date
CN109685756A true CN109685756A (en) 2019-04-26

Family

ID=66183291

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710970382.4A Pending CN109685756A (en) 2017-10-16 2017-10-16 Image feature automatic identifier, system and method

Country Status (1)

Country Link
CN (1) CN109685756A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112308816A (en) * 2019-07-23 2021-02-02 纬创资通股份有限公司 Image recognition device, image recognition method and computer program product thereof
CN113311006A (en) * 2020-02-26 2021-08-27 乐达创意科技股份有限公司 Automatic optical detection system and method for detecting edge defects of contact lens
CN114264657A (en) * 2020-09-16 2022-04-01 南亚科技股份有限公司 Wafer inspection method and system
WO2023007110A1 (en) * 2021-07-28 2023-02-02 Coopervision International Limited Acquiring and inspecting images of ophthalmic lenses
EP4375939A3 (en) * 2021-10-19 2024-08-21 Johnson & Johnson Vision Care, Inc. Defect detection using synthetic data and machine learning

Citations (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002001504A2 (en) * 2000-06-28 2002-01-03 Teradyne, Inc. Image processing system for use with inspection systems
US20030182251A1 (en) * 2002-03-22 2003-09-25 Donglok Kim Accelerated learning in machine vision using artificially implanted defects
JP2006048370A (en) * 2004-08-04 2006-02-16 Kagawa Univ Method for recognizing pattern, method for generating teaching data to be used for the method and pattern recognition apparatus
US20090136117A1 (en) * 2004-10-26 2009-05-28 May High-Tech Solutions Ltd. Method and apparatus for residue detection on a polished wafer
CN101852768A (en) * 2010-05-05 2010-10-06 电子科技大学 Workpiece flaw identification method based on compound characteristics in magnaflux powder inspection environment
CN101981683A (en) * 2008-03-27 2011-02-23 东京毅力科创株式会社 Method for classifying defects, computer storage medium, and device for classifying defects
CN101996405A (en) * 2010-08-30 2011-03-30 中国科学院计算技术研究所 Method and device for rapidly detecting and classifying defects of glass image
JP2012026982A (en) * 2010-07-27 2012-02-09 Panasonic Electric Works Sunx Co Ltd Inspection device
CN102664158A (en) * 2010-11-09 2012-09-12 东京毅力科创株式会社 Substrate treatment apparatus, program, computer sotrage medium, and method of transferring substrate
CN103679208A (en) * 2013-11-27 2014-03-26 北京中科模识科技有限公司 Broadcast and television caption recognition based automatic training data generation and deep learning method
CN103745072A (en) * 2014-01-29 2014-04-23 上海华力微电子有限公司 Method for automatically expanding defect pattern library
CN103886332A (en) * 2014-04-02 2014-06-25 哈尔滨工业大学 Method for detecting and identifying defects of metallic meshes
CN104102919A (en) * 2014-07-14 2014-10-15 同济大学 Image classification method capable of effectively preventing convolutional neural network from being overfit
CN104850858A (en) * 2015-05-15 2015-08-19 华中科技大学 Injection-molded product defect detection and recognition method
CN105531581A (en) * 2013-09-10 2016-04-27 蒂森克虏伯钢铁欧洲股份公司 Method and device for testing an inspection system for detecting surface defects
CN105678315A (en) * 2014-12-05 2016-06-15 戴尔菲技术公司 Method of generating training image for automated vehicle object recognition system
CN105844238A (en) * 2016-03-23 2016-08-10 乐视云计算有限公司 Method and system for discriminating videos
CN106127780A (en) * 2016-06-28 2016-11-16 华南理工大学 A kind of curved surface defect automatic testing method and device thereof
KR101688458B1 (en) * 2016-04-27 2016-12-23 디아이티 주식회사 Image inspection apparatus for manufactured articles using deep neural network training method and image inspection method of manufactured articles thereby
CN106504064A (en) * 2016-10-25 2017-03-15 清华大学 Clothes classification based on depth convolutional neural networks recommends method and system with collocation
CN106503724A (en) * 2015-09-04 2017-03-15 佳能株式会社 Grader generating means, defective/zero defect determining device and method

Patent Citations (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002001504A2 (en) * 2000-06-28 2002-01-03 Teradyne, Inc. Image processing system for use with inspection systems
US20030182251A1 (en) * 2002-03-22 2003-09-25 Donglok Kim Accelerated learning in machine vision using artificially implanted defects
JP2006048370A (en) * 2004-08-04 2006-02-16 Kagawa Univ Method for recognizing pattern, method for generating teaching data to be used for the method and pattern recognition apparatus
US20090136117A1 (en) * 2004-10-26 2009-05-28 May High-Tech Solutions Ltd. Method and apparatus for residue detection on a polished wafer
CN101981683A (en) * 2008-03-27 2011-02-23 东京毅力科创株式会社 Method for classifying defects, computer storage medium, and device for classifying defects
CN101852768A (en) * 2010-05-05 2010-10-06 电子科技大学 Workpiece flaw identification method based on compound characteristics in magnaflux powder inspection environment
JP2012026982A (en) * 2010-07-27 2012-02-09 Panasonic Electric Works Sunx Co Ltd Inspection device
CN101996405A (en) * 2010-08-30 2011-03-30 中国科学院计算技术研究所 Method and device for rapidly detecting and classifying defects of glass image
CN102664158A (en) * 2010-11-09 2012-09-12 东京毅力科创株式会社 Substrate treatment apparatus, program, computer sotrage medium, and method of transferring substrate
CN105531581A (en) * 2013-09-10 2016-04-27 蒂森克虏伯钢铁欧洲股份公司 Method and device for testing an inspection system for detecting surface defects
US20160203593A1 (en) * 2013-09-10 2016-07-14 Thyssenkrupp Steel Europe Ag Method and device for testing an inspection system for detecting surface defects
CN103679208A (en) * 2013-11-27 2014-03-26 北京中科模识科技有限公司 Broadcast and television caption recognition based automatic training data generation and deep learning method
CN103745072A (en) * 2014-01-29 2014-04-23 上海华力微电子有限公司 Method for automatically expanding defect pattern library
CN103886332A (en) * 2014-04-02 2014-06-25 哈尔滨工业大学 Method for detecting and identifying defects of metallic meshes
CN104102919A (en) * 2014-07-14 2014-10-15 同济大学 Image classification method capable of effectively preventing convolutional neural network from being overfit
CN105678315A (en) * 2014-12-05 2016-06-15 戴尔菲技术公司 Method of generating training image for automated vehicle object recognition system
CN104850858A (en) * 2015-05-15 2015-08-19 华中科技大学 Injection-molded product defect detection and recognition method
CN106503724A (en) * 2015-09-04 2017-03-15 佳能株式会社 Grader generating means, defective/zero defect determining device and method
CN105844238A (en) * 2016-03-23 2016-08-10 乐视云计算有限公司 Method and system for discriminating videos
KR101688458B1 (en) * 2016-04-27 2016-12-23 디아이티 주식회사 Image inspection apparatus for manufactured articles using deep neural network training method and image inspection method of manufactured articles thereby
CN106127780A (en) * 2016-06-28 2016-11-16 华南理工大学 A kind of curved surface defect automatic testing method and device thereof
CN106504064A (en) * 2016-10-25 2017-03-15 清华大学 Clothes classification based on depth convolutional neural networks recommends method and system with collocation

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
DANIEL WEIMER 等: "Design of deep convolutional neural network architectures for automated feature extraction in industrial inspection", 《CIRP ANNALS - MANUFACTURING TECHNOLOGY》 *
T Y LIM 等: "Automatic classification of weld defects using simulated data and an MLP neural network", 《OR INSIGHT》 *
张振尧 等: "磁瓦表面缺陷的机器视觉检测方法", 《光学技术》 *
黎明 等: "机械加工零件表面纹理缺陷检测", 《中国图象图形学报》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112308816A (en) * 2019-07-23 2021-02-02 纬创资通股份有限公司 Image recognition device, image recognition method and computer program product thereof
CN112308816B (en) * 2019-07-23 2024-02-06 纬创资通股份有限公司 Image recognition device, image recognition method and storage medium thereof
CN113311006A (en) * 2020-02-26 2021-08-27 乐达创意科技股份有限公司 Automatic optical detection system and method for detecting edge defects of contact lens
CN114264657A (en) * 2020-09-16 2022-04-01 南亚科技股份有限公司 Wafer inspection method and system
WO2023007110A1 (en) * 2021-07-28 2023-02-02 Coopervision International Limited Acquiring and inspecting images of ophthalmic lenses
KR20240014575A (en) * 2021-07-28 2024-02-01 쿠퍼비젼 인터내셔널 리미티드 Acquisition and examination of images of ophthalmic lenses
KR102676508B1 (en) 2021-07-28 2024-06-24 쿠퍼비젼 인터내셔널 리미티드 Acquisition and examination of images of ophthalmic lenses
US12051191B2 (en) 2021-07-28 2024-07-30 Coopervision International Limited Systems and methods for acquiring and inspecting lens images of ophthalmic lenses
EP4375939A3 (en) * 2021-10-19 2024-08-21 Johnson & Johnson Vision Care, Inc. Defect detection using synthetic data and machine learning

Similar Documents

Publication Publication Date Title
CN110570410B (en) Detection method for automatically identifying and detecting weld defects
CN111179251B (en) Defect detection system and method based on twin neural network and by utilizing template comparison
CN109685756A (en) Image feature automatic identifier, system and method
US10964013B2 (en) System, method for training and applying defect classifiers in wafers having deeply stacked layers
US20080281548A1 (en) Method and System for Automatic Defect Detection of Articles in Visual Inspection Machines
CN113222913B (en) Circuit board defect detection positioning method, device and storage medium
CN113706490B (en) Wafer defect detection method
CN110473179A (en) A kind of film surface defects detection method, system and equipment based on deep learning
JP2011158373A (en) Method for creation of teacher data for use in automatic defect classification, and method and apparatus for automatic defect classification
CN1323369C (en) Image recognition apparatus and image recognition method, and teaching apparatus and teaching method of the image recognition apparatus
TW202127014A (en) Intelligent Production Line Monitoring System and Implementation Method Thereof
CN109146873A (en) A kind of display screen defect intelligent detecting method and device based on study
CN114066848A (en) FPCA appearance defect visual inspection system
TWI747686B (en) A defect detection method and a defect detection device
CN114972342B (en) Method for detecting surface defects of gearbox gear
CN106528665A (en) AOI equipment test file searching method and system
US11727673B1 (en) Visual analysis method for cable element identification
CN112858341B (en) Detection method, shooting system and detection system
CN115909493A (en) Teacher improper gesture detection method and system for classroom real-time recorded video
CN114637893A (en) FMEA database system and processing method thereof
TWI647658B (en) Device, system and method for automatically identifying image features
CN107123105A (en) Images match defect inspection method based on FAST algorithms
KR102686135B1 (en) Method of inspecting defect using artificial intelligence and apparatus for inspecting defect using artificial intelligence
CN110252686A (en) Method and device for determining quality of remote controller
CN114813746B (en) Method, system, storage medium and equipment for curved needle detection based on machine vision

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20190426