WO2014167566A1 - Apparatus for inspection and quality assurance of material samples - Google Patents
Apparatus for inspection and quality assurance of material samples Download PDFInfo
- Publication number
- WO2014167566A1 WO2014167566A1 PCT/IL2014/050337 IL2014050337W WO2014167566A1 WO 2014167566 A1 WO2014167566 A1 WO 2014167566A1 IL 2014050337 W IL2014050337 W IL 2014050337W WO 2014167566 A1 WO2014167566 A1 WO 2014167566A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sample
- color
- samples
- lighting
- imaging
- Prior art date
Links
- 239000000463 material Substances 0.000 title claims description 17
- 238000007689 inspection Methods 0.000 title description 7
- 238000000275 quality assurance Methods 0.000 title description 3
- 238000004458 analytical method Methods 0.000 claims abstract description 39
- 238000005286 illumination Methods 0.000 claims abstract description 15
- 238000012937 correction Methods 0.000 claims abstract description 12
- 238000004611 spectroscopical analysis Methods 0.000 claims abstract 2
- 238000000034 method Methods 0.000 claims description 16
- 238000005259 measurement Methods 0.000 claims description 10
- 238000003384 imaging method Methods 0.000 claims description 9
- 230000009466 transformation Effects 0.000 claims description 7
- 238000010606 normalization Methods 0.000 claims description 4
- 230000000007 visual effect Effects 0.000 claims description 4
- 238000003780 insertion Methods 0.000 abstract description 4
- 230000037431 insertion Effects 0.000 abstract description 4
- 238000012545 processing Methods 0.000 abstract description 4
- 239000000523 sample Substances 0.000 description 69
- 235000013339 cereals Nutrition 0.000 description 11
- 239000000843 powder Substances 0.000 description 6
- 241000209094 Oryza Species 0.000 description 5
- 235000007164 Oryza sativa Nutrition 0.000 description 5
- 238000004519 manufacturing process Methods 0.000 description 5
- 235000009566 rice Nutrition 0.000 description 5
- 235000021186 dishes Nutrition 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 239000003086 colorant Substances 0.000 description 3
- 239000007789 gas Substances 0.000 description 3
- 239000002245 particle Substances 0.000 description 3
- 235000013599 spices Nutrition 0.000 description 3
- 239000004753 textile Substances 0.000 description 3
- XKRFYHLGVUSROY-UHFFFAOYSA-N Argon Chemical compound [Ar] XKRFYHLGVUSROY-UHFFFAOYSA-N 0.000 description 2
- IJGRMHOSHXDMSA-UHFFFAOYSA-N Atomic nitrogen Chemical compound N#N IJGRMHOSHXDMSA-UHFFFAOYSA-N 0.000 description 2
- 230000004075 alteration Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 239000013043 chemical agent Substances 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 235000021251 pulses Nutrition 0.000 description 2
- 238000003908 quality control method Methods 0.000 description 2
- 230000011218 segmentation Effects 0.000 description 2
- 238000012360 testing method Methods 0.000 description 2
- 240000009164 Petroselinum crispum Species 0.000 description 1
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 1
- 229910052782 aluminium Inorganic materials 0.000 description 1
- 229910052786 argon Inorganic materials 0.000 description 1
- 238000013528 artificial neural network Methods 0.000 description 1
- QVGXLLKOCUKJST-UHFFFAOYSA-N atomic oxygen Chemical compound [O] QVGXLLKOCUKJST-UHFFFAOYSA-N 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 235000015114 espresso Nutrition 0.000 description 1
- 235000013312 flour Nutrition 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000003702 image correction Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 239000007791 liquid phase Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 240000004308 marijuana Species 0.000 description 1
- 229910052757 nitrogen Inorganic materials 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 239000001301 oxygen Substances 0.000 description 1
- 229910052760 oxygen Inorganic materials 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 235000011197 perejil Nutrition 0.000 description 1
- 239000004033 plastic Substances 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000002265 prevention Effects 0.000 description 1
- 239000013074 reference sample Substances 0.000 description 1
- 238000002310 reflectometry Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000007790 solid phase Substances 0.000 description 1
- 230000003595 spectral effect Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/47—Scattering, i.e. diffuse reflection
-
- C—CHEMISTRY; METALLURGY
- C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
- C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
- C12M41/00—Means for regulation, monitoring, measurement or control, e.g. flow regulation
- C12M41/30—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration
- C12M41/36—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration of biomass, e.g. colony counters or by turbidity measurements
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0251—Colorimeters making use of an integrating sphere
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0254—Spectrometers, other than colorimeters, making use of an integrating sphere
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0262—Constructional arrangements for removing stray light
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0267—Sample holders for colorimetry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8806—Specially adapted optical and illumination features
Definitions
- the present invention relates to the field of automated quality assurance, sample inspection, and absolute color determination of samples such as grains, pulses, spices, powders, medical cannabis, liquids, bolts, printed circuits, and the like.
- Optical devices for quality assurance are common for inspection and quality control, where special precautions are taken to assure necessary conditions of lighting, shadowing and the like.
- special precautions are taken to assure necessary conditions of lighting, shadowing and the like.
- different setups will often have slightly different conditions (of ambient lighting and the like) and hence direct comparison of analyses performed at two different sites (even for production of the same product) may not be possible.
- the invention comprises a method for automatically checking samples in terms of correctness of color, shape, size, and other parameters using image processing technology. 'Correctness' here is defined in comparison to an instance called the Master sample which is used to define the desired characteristics.
- the invention comprises a combination of hardware and data processing methods adapted to produce 'go/no-go' assessments, and discrimination into classes of samples of materials such as: grains, seeds, flours, processed materials, spices, mechanical parts, printed circuits, and the like.
- the invention also comprises a device adapted to perform the above operations.
- the hardware comprises a closed box having a hemispherical reflection chamber, described in provisional patent application US61/809429 which is incorporated herein by reference.
- the hardware is referred to in the figures to follow, and the data processing methods employed use routines described by the figures as well.
- the device consists of a portable, fully enclosed sample analysis chamber such as that shown in Fig. la,b.
- the chamber has two halves which may be opened (Fig. lb) and closed (Fig. la) to allow insertion of a sample and then closing of the device to keep out ambient light.
- the upper half has a downward-facing hemispherical dome, attached by hinges to the lower half which supports a planar analysis surface.
- the dome is provided with lighting means such as RGB LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed.
- the device is opened and a sample of material (which may be powder, granular, bulk, or the like) is placed on the analysis surface (or on a jig placed on the surface).
- the device is then closed and the sample is subsequently analyzed, automatically or manually, by means of a calibrated camera at the top of the dome. described in the detailed description to follow, including a top LED ring, structured light illumination, and more.
- Figs. 1A,B shows side views of the inventive device in closed and opened configurations.
- Fig. 2 shows a side view of the top half of the device.
- Fig. 3 shows a side view of the device.
- Fig. 4A shows details of the device assembly including sample stage.
- Fig. 4B shows details of the device assembly including gain correction plate.
- Figs. 4C,D illustrate the multiple lighting sources of the invention.
- Fig. 5A shows a sample stage having grasping means.
- Figs. 5B,C shows a sample stage having target plate positioning means and sample positioning means.
- Figs. 5D,E shows a sample stage with a homography calibration plate in place.
- Figs. 6A,B,C presents a vibration stage.
- Figs. 7A,B,C show means of producing structured light.
- Fig. 8 illustrates a human operator near a machine of the invention.
- Fig. 9 presents a flowchart for image analysis using the system. of the system.
- Fig. 11 shows one exemplary embodiment of the invention.
- Fig. 12 shows a result of rice analysis screenshot, where some of the rice is found broken.
- Fig. 13 is a screenshot of parsley analysis, where the areas with dark or bright exceptional color are marked. The total amount of relative area with exceptional color in the sample is high, and therefore the sample is classified as a reject.
- Quadrometry Expert User refers hereinafter to a user of the device having the privileges to set the standards for acceptable samples of a given checked material.
- the term "Operator User” refers hereinafter to a user that uses the device to perform checking of material samples.
- Positive sample refers hereinafter a sample acceptable by the device according to what was set by the Quality Expert User
- Negative sample refers hereinafter a sample not acceptable by the device according to what was set by the Quality Expert User
- Master refers hereinafter the definitions of Positive sample of a certain kind, consisting of reference images and other data items which are stored in the device memory, and used by the device software when the automatic check is performed
- the Quality Expert Users are persons with adequate knowledge in the quality requirements of the discussed samples. Such users can distinguish between the adequate background knowledge about to configure a corresponding check in the device. As a result, the Quality Expert Users can configure checks in the device that distinguish between Positive and Negative samples of a given material, called Masters.
- the Operator Users are persons holding the knowledge of placing the material sample correctly in the device, and triggering the check of the material which is usually triggered by closing the top half of the device and/or pressing one or several buttons in a defined order.
- a sample description textually or numerically might be required, for example a batch number, date, time, or any other relevant information which doesn't require the specific knowledge of configuration of checks in the device.
- the device consists of a portable, fully enclosed sample analysis chamber such as that shown in Fig. la,b.
- the chamber has two halves 7, 8 which may be opened (Fig. lb) and closed (Fig. la) to allow insertion of a sample. After insertion of a sample the device may be closed as in Fig. la to keep out ambient light.
- the upper half 7 has a downward-facing hemispherical dome 4, attached by hinges 1 to the lower half 8 which holds the planar analysis surface 2.
- the dome 4 is provided with lighting means such as RGB, UV, IR, or other LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed.
- the device is opened as in Fig. lb and a sample of material (which may be powder, granular, bulk, or the like) is placed on the analysis surface 2 (or on a jig placed on the surface).
- the device is then closed as in Fig. la and the sample is subsequently analyzed by means of a calibrated camera 3 at the top of the dome.
- the entire device may be disposed on legs allowing for vibration isolation and height adjustment.
- connection will preferably be made as gas-tight as possible, for example by use of an O-ring and clasps or connectors providing an airtight seal.
- a computing device and associated electronics all be housed within the bottom half 8 of the device.
- a touchscreen may be attached to top or bottom halves of the device to allow user interaction with the system.
- the associated electronics may comprise, inter alia, digital to analog converters for control over the lighting conditions, temperature sensing and control means, weight sensing means, humidity sensing and control means, vibration means adapted to vibrate the sample, pressure sensing and control means, and gas handling apparatus for fixing well-defined partial pressures of a variety of gasses such as oxygen, nitrogen, argon and the like.
- Fig. 2 shows a sectional view of the upper half of the device, including hemispherical dome 4 and lighting sources 5 which may be for instance upward-facing LEDs of variable intensity and/or color.
- Fig. 3 shows a further sectional view of the top half and part of the bottom half of the device.
- a background having defined color and reflectivity 2 lies beneath a sample-holding jig 9 that is bolted 10 in place.
- Fig. 4A shows in exploded view the hemispherical cover and positioning stage.
- the positioning stage has background 2, and jig 9 allowing for precise positioning of samples.
- Fig. 4B shows a cutaway view showing the gain correction plate 450, which allows for gain correction due to variations in CCD response, lighting changes, or both.
- LED rings for illumination, a first LED ring at the perimeter of the dome, facing upwards and illumination reflect this incoming light evenly down onto the sample.
- a second ring may be employed near the top of the dome, these LEDs being downward facing and providing direct illumination of the sample.
- the use of two lighting sources in this fashion is of use since one (the upwards facing elements) provide diffuse illumination, while the other (the downwards facing LED ring) provide direct illumination.
- the hemispherical shape of the top dome allows for the diffuse lighting to illuminate from shallow angles, while the direct illumination allows for prevention of shadows and ample illumination of the background.
- Figs. 4C,D (in side and x-ray top views, respectively) show exemplary embodiments having a ring of upward-facing lighting elements 402, which illuminate the diffusely reflective dome from below. Downward facing lighting elements 401 illuminate the sample directly, from above.
- the sample height may be quite large, for instance a dome having radius of 10cm being capable of admitting samples of 5 cm height without any problem.
- a sample positioning jig allowing for precise positioning and holding of various objects such as printed circuit boards, petri dishes, mechanical elements, and the like.
- the use of such positioning jigs allows for determination of characteristics such accuracy as registration, relative position of elements, and the like.
- a jig system is employed as shown in Fig. 5 A.
- the sample 12 is held in place by arms 13 which may be spring loaded so as to firmly grasp the sample and retain it in a fixed position.
- the background 2 is visible and provides uniform reflectance at a well-defined color value.
- Figs. 5B,C show a further embodiment of the invention adapted for holding samples in position.
- Jigs 502 in this case taking the form of rectangular rectangular samples of slightly smaller size fit securely.
- the sample plate 503 itself fits securely into the device by means of protrusions 501, which define a rectangular area into which the various different sample plates fit securely and repeatably.
- jigs may be used with the device, the jigs being replaceable.
- one jig adapted for printed circuit boards of a given size and shape may be employed for a time, and a different jig suited for holding a petri dish or other shape may be used at a different time.
- FIGs. 5D, E A jig used for purposes of determining the homography or rigid body transformation allowing for precise distance measurement is shown in Figs. 5D, E.
- the protrusions 501 hold the homography plate 511, which has several precisely placed marks 510 which allow the system to determine the rigid body transformation relating the sample plane to the orientation and position of the camera (which is not necessarily exactly perpendicular to the sample plane, and whose distance therefrom is not necessarily known before the homography plate is used to determine these parameters).
- analysis For purposes of analysis, conditions of temperature, humidity, lighting conditions, and atmosphere are chosen (by the user or by default). Once the chosen environment has been fixed, analysis may begin.
- the analysis consists of visual analysis by means of the camera 3, and possibly weight measurement by suitable means in the sample holding tray.
- the visual analysis allows for inspection of bulk samples (of grains, powders, etc. ) in terms of shape, color, morphology, and other visual characteristics.
- the analysis provides for measurement of statistics regarding these characteristics, thereby allowing determination of percentage of a sample that is within allowed tolerances (for size, morphology, color, etc.), sample quality, and other statistical measures that will be clear to one skilled in the art.
- the sample environment may be controlled by means of sensors for and control over lighting, temperature, humidity, pressure, atmosphere, and pressure.
- Vibration means may be employed to vibrate the sample at a given frequency and amplitude, to allow dispersing of a given connected to the vibration such as stiction, angle of repose, and the like.
- the vibration means may be supplied within a removable plate such as those providing jigs for positioning samples. Furthermore it is within provision of the invention to separately monitor and control the camera temperature and lighting element temperature, to provide even more exact control over the measurement conditions.
- Figs. 6A-C shows an example of one possible provision for vibrating a sample.
- Fig. 6A is a fully shaded figure while Figs. 6B,C are isometric section views.
- the base 603 holding a rubber sheet 602.
- This sheet in turn holds vibration plate 601 which is in mechanical communication with mechanical actuators 604 such as voice coils, piezoelectric actuators or the like.
- the vibration plate may itself be outfitted with various sample holding means such as jigs (not shown).
- sample-holding jigs in conjunction with vibration means.
- a sample table may be supported by vibrating means, or may have vibrating means in mechanical communication therewith, and this table may also be outfitted with jigs or other holding means adapted to (for example) hold a set of petri dishes in place, such that the dishes do not travel during vibration but the contents of the dishes are vibrated all the same.
- a color standard or 'gain correction standard'
- a color standard or 'gain correction standard'
- a standardized, diffusely reflecting grayscale bar may be used in each system.
- Lighting corrections may also be made in hardware, by (for instance) changing the current supplied to various lighting elements such lighting intensity (for a given color channel) may be varied until the expected value of intensity is detected by the camera.
- Target plates may be used for the purposes of color correction and also for correcting for spatial aberrations caused by lens distortion of the camera optics.
- a checkerboard of white and black squares of exact dimensions such as 1cm x 1cm for each square may be used as a target plate, and due to the exact and known spacing of squares, images of this plate may be used for an 'image undistortion' calibration which performs an arbitrary nonlinear transformation between the measured pixel coordinates and real- space coordinates.
- the geometric calibrations are as follows: A lens undistortion is applied using the [1] calibration method. The geometric transformation from the Image to the Real World Coordinates is performed using Homography estimation. The homography matrix H 3x3 is calculated from N points, fulfilling the equation
- W P W j H ⁇ 7 P, where W P is the point in Homogenous representation in [mm], 7 P is the same point on image in Homogenous representation in pixels.
- the point ( i ; 2, 3)' has to be extracted from homogenous representation by the following scaling operation
- the multiple levels of feedback and control over measurement conditions will allow for repeatable and measurements in extremely well -characterized conditions.
- users of separate instances of the inventive machine will measure precisely the same statistics for a given sample, allowing for direct comparison between (for example) color of textile from a Chinese production line vs. factory output from Bangladesh for the same product.
- the samples may be flatted for instance by knife edge, doctor blade, or a flattening accessory such as that used in preparing espresso shots.
- the analysis of color can be used to implement an 'area spectrometer' in the following way.
- the color values output by the camera are either measured in or transformed to the 'LAB' palette instead of the more common RGB or CMYK.
- the 'Euclidean distance' between one color value (Li,Ai,Bi) and a second value (L 2 ,A 2 ,B 2 ) may be measured as with the advantage over similar measures in other palettes, that this distance in LAB has physiological import; for instance, it has been found that for colors having a difference D ⁇ 2, the average human eye cannot distinguish between them.
- the rubric D ⁇ 2 is used as an acceptable maximum variation between product and a master.
- the inventive device allows for measurement of such over large areas, allowing for comparison of hundreds or thousands of points. As will be appreciated this allows for significantly better statistics and signal- to-noise ratio than a small set of tens of points.
- Image processing means of the invention allow for segmentation of separate objects in an image, and individual measurement of a number of object details such as color, shape, area, perimeter, morphology, curvature, and the like.
- object details such as color, shape, area, perimeter, morphology, curvature, and the like.
- the details may all be measured and used for statistical analyses, e.g. production of histograms, calculation of averages and variances, etc.
- the classification can be accomplished by means of direct input of characteristics (such as minimum/maximum sizes, color ranges, curvatures, etc.) or by means of simply giving examples of 'pass' and 'fail' items. For instance a set of acceptable grains of rice is introduced to the system, analyzed, and stored in software associated with the system as representing acceptable grains. Then a set of unacceptable grains (e.g. discolored, bent, broken, etc) are introduced to the system and analyzed, and then stored in the system as representing unacceptable grains. Based on the statistics of these samples, the definitions of acceptable and unacceptable samples are inferred.
- characteristics such as minimum/maximum sizes, color ranges, curvatures, etc.
- 'pass' and 'fail' items For instance a set of acceptable grains of rice is introduced to the system, analyzed, and stored in software associated with the system as representing acceptable grains. Then a set of unacceptable grains (e.g. discolored, bent, broken, etc) are introduced to the system and analyzed, and then stored in the system
- This inference may be a simple statistical inference or may employ machine learning techniques such as SVM, neural nets, Bayesian inference, Markov chains, or the like, using one or many samples of any number of categories.
- Particulate samples - a sample that consists of particles, which are a small and separate pieces of material like grains or screws, when the inspection of each particle is important
- Powder samples - a sample of a powder, usually having a homogenous color that should be determined more accurately than in a Bulk sample d.
- Panel samples - a nearly flat panel to be inspected, such as a printed electronic circuit or a keyboard
- structured light for illumination of the sample, allowing for detailed three-dimensional information to be gathered therefrom.
- a matrix or other collection of points may be projected onto the sample, and their actual positions measured to determine three-dimensional structure.
- it may also be useful to vary the position of the sample with respect to the camera. If a known (and preferably small) depth of field is used, the points in focus vs. those not in focus as a function of sample table-camera distance, also allows for production of a three-dimensional map of the sample.
- Figs. 7A,B,C Some exemplary embodiments of a system adapted to provide structured lighting upon the sample plane are shown in Figs. 7A,B,C.
- the camera 702, dome 704, and structured light 705 are shown, the structured light taking the form of a set of lines, grid, points, or other pattern be it regular or irregular.
- the structured light is provided by means of lighting elements 701 which shine through gratings or slits 703, thereby forming pattern 705.
- Fig. 7B shows an embodiment where a projector 706 is used to directly produce a pattern of structured light 705 of any desired type.
- Fig. 7C shows an embodiment using lasers 710 adapted to produce several beams 711, which together form a structured light pattern 705.
- Fig. 8 shows an example of a system of the invention, placed on a table 807 for use by a user 806.
- the system has top half 801 containing the hemispherical dome 803, bottom half 802 containing target plane 804, a handle 805 adapted to allow user 806 to open the device, and hinges 808 attaching top and bottom halves.
- top half 801 containing the hemispherical dome 803, bottom half 802 containing target plane 804, a handle 805 adapted to allow user 806 to open the device, and hinges 808 attaching top and bottom halves.
- an appropriate background is chosen (appropriate in terms of contrast for example).
- the sample is inserted and the device closed.
- environmental conditions light, temperature, humidity, atmosphere
- Brightness normalization and image undistortion are carried out as mentioned above, with use of color, geometry, and other standards in the testing chamber either during analysis or at some other time (e.g. during monthly calibrations of the machine).
- background segmentation is done and then the image processing steps of feature calculation and classification. Once classification is finished, results are reported and another sample may be inserted.
- Fig. 10 wherein a color histogram for one color channel is presented.
- the percentage exceptional values may be quantified, as can the levels for exceptional values.
- the system Since the system is designed for industrial use, it is produced with an ergonomic design, of high rigidity of design and high ruggedness. This is accomplished for example by use of high-impact plastic and T-slot aluminum profile for the major structural components of the device.
- the image capture of the device may be extremely fast because of the use of an array camera, as opposed to (for example) a linescan camera which may take for example 60 seconds or longer for the formation of a single image.
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biochemistry (AREA)
- Analytical Chemistry (AREA)
- General Health & Medical Sciences (AREA)
- Wood Science & Technology (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Organic Chemistry (AREA)
- Zoology (AREA)
- Microbiology (AREA)
- Sustainable Development (AREA)
- Biotechnology (AREA)
- General Engineering & Computer Science (AREA)
- Genetics & Genomics (AREA)
- Biomedical Technology (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361809429P | 2013-04-08 | 2013-04-08 | |
US61/809,429 | 2013-04-08 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014167566A1 true WO2014167566A1 (en) | 2014-10-16 |
Family
ID=51689027
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/IL2014/050337 WO2014167566A1 (en) | 2013-04-08 | 2014-04-07 | Apparatus for inspection and quality assurance of material samples |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2014167566A1 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150317786A1 (en) * | 2014-05-05 | 2015-11-05 | Alcoa Inc. | Apparatus and methods for weld measurement |
WO2016080824A1 (en) * | 2014-11-20 | 2016-05-26 | Universidad Tecnologica De La Mixteca | Device for in-line monitoring of fluid colours |
EP3147348A1 (en) * | 2015-09-24 | 2017-03-29 | Iul, S.A. | Image capturing device for capturing images of plate bacterial cultures |
US20170316556A1 (en) * | 2016-03-25 | 2017-11-02 | Arconic Inc. | Resistance Welding Fasteners, Apparatus and Methods for Joining Dissimilar Materials and Assessing Joints Made Thereby |
WO2017165814A3 (en) * | 2016-03-25 | 2017-12-14 | Arconic Inc. | Resistance welding fasteners, joints and methods for joining dissimilar materials |
JP2018189420A (en) * | 2017-04-28 | 2018-11-29 | 株式会社イマジオム | Color pattern discrimination probe, and color patten discrimination device |
US10293428B2 (en) | 2013-06-26 | 2019-05-21 | Arconic Inc. | Resistance welding fastener, apparatus and methods |
US10384296B2 (en) | 2014-12-15 | 2019-08-20 | Arconic Inc. | Resistance welding fastener, apparatus and methods for joining similar and dissimilar materials |
IT201800004498A1 (en) * | 2018-04-13 | 2019-10-13 | Apparatus and method for determining physical and chemical parameters of an inhomogeneous sample by acquiring and processing color images of the sample | |
US10507514B2 (en) | 2015-09-16 | 2019-12-17 | Arconic Inc. | Rivet feeding apparatus |
US10903587B2 (en) | 2014-02-03 | 2021-01-26 | Howmet Aerospace Inc. | Resistance welding fastener, apparatus and methods |
CN112304896A (en) * | 2020-10-29 | 2021-02-02 | 南京林业大学 | Portable flour multi-quality detector based on near infrared and detection method |
EP4083184A1 (en) * | 2021-04-26 | 2022-11-02 | Sener Aeroespacial, S.A. | Device for obtaining images of petri dishes |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4350442A (en) * | 1976-05-19 | 1982-09-21 | Accusort Corporation | Light and color detecting scanner for a sorting apparatus |
US5533628A (en) * | 1992-03-06 | 1996-07-09 | Agri Tech Incorporated | Method and apparatus for sorting objects by color including stable color transformation |
US20040239919A1 (en) * | 2003-04-30 | 2004-12-02 | Byk Gardner Gmbh | Device and method for determining the properties of surfaces |
WO2009097193A1 (en) * | 2008-01-28 | 2009-08-06 | Innovative Imaging, Inc. | Table gauge |
US20120002957A1 (en) * | 2006-09-29 | 2012-01-05 | Microscan Systems, Inc. | Methods for providing diffuse light |
US20120201448A1 (en) * | 2011-02-03 | 2012-08-09 | Seiko Epson Corporation | Robotic device, inspection device, inspection method, and inspection program |
US8368762B1 (en) * | 2010-04-12 | 2013-02-05 | Adobe Systems Incorporated | Methods and apparatus for camera calibration based on multiview image geometry |
-
2014
- 2014-04-07 WO PCT/IL2014/050337 patent/WO2014167566A1/en active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4350442A (en) * | 1976-05-19 | 1982-09-21 | Accusort Corporation | Light and color detecting scanner for a sorting apparatus |
US5533628A (en) * | 1992-03-06 | 1996-07-09 | Agri Tech Incorporated | Method and apparatus for sorting objects by color including stable color transformation |
US20040239919A1 (en) * | 2003-04-30 | 2004-12-02 | Byk Gardner Gmbh | Device and method for determining the properties of surfaces |
US20120002957A1 (en) * | 2006-09-29 | 2012-01-05 | Microscan Systems, Inc. | Methods for providing diffuse light |
WO2009097193A1 (en) * | 2008-01-28 | 2009-08-06 | Innovative Imaging, Inc. | Table gauge |
US8368762B1 (en) * | 2010-04-12 | 2013-02-05 | Adobe Systems Incorporated | Methods and apparatus for camera calibration based on multiview image geometry |
US20120201448A1 (en) * | 2011-02-03 | 2012-08-09 | Seiko Epson Corporation | Robotic device, inspection device, inspection method, and inspection program |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10293428B2 (en) | 2013-06-26 | 2019-05-21 | Arconic Inc. | Resistance welding fastener, apparatus and methods |
US10903587B2 (en) | 2014-02-03 | 2021-01-26 | Howmet Aerospace Inc. | Resistance welding fastener, apparatus and methods |
US9927367B2 (en) * | 2014-05-05 | 2018-03-27 | Arconic Inc. | Apparatus and methods for weld measurement |
US20150317786A1 (en) * | 2014-05-05 | 2015-11-05 | Alcoa Inc. | Apparatus and methods for weld measurement |
WO2016080824A1 (en) * | 2014-11-20 | 2016-05-26 | Universidad Tecnologica De La Mixteca | Device for in-line monitoring of fluid colours |
US10384296B2 (en) | 2014-12-15 | 2019-08-20 | Arconic Inc. | Resistance welding fastener, apparatus and methods for joining similar and dissimilar materials |
US10507514B2 (en) | 2015-09-16 | 2019-12-17 | Arconic Inc. | Rivet feeding apparatus |
WO2017051238A1 (en) * | 2015-09-24 | 2017-03-30 | Iul, S.A. | Device for obtaining images of bacterial cultures in a dish |
US10801006B2 (en) | 2015-09-24 | 2020-10-13 | Iul, S.A. | Device for obtaining images of bacterial cultures in a dish |
EP3147348A1 (en) * | 2015-09-24 | 2017-03-29 | Iul, S.A. | Image capturing device for capturing images of plate bacterial cultures |
WO2017165814A3 (en) * | 2016-03-25 | 2017-12-14 | Arconic Inc. | Resistance welding fasteners, joints and methods for joining dissimilar materials |
US20170316556A1 (en) * | 2016-03-25 | 2017-11-02 | Arconic Inc. | Resistance Welding Fasteners, Apparatus and Methods for Joining Dissimilar Materials and Assessing Joints Made Thereby |
US10593034B2 (en) | 2016-03-25 | 2020-03-17 | Arconic Inc. | Resistance welding fasteners, apparatus and methods for joining dissimilar materials and assessing joints made thereby |
JP2018189420A (en) * | 2017-04-28 | 2018-11-29 | 株式会社イマジオム | Color pattern discrimination probe, and color patten discrimination device |
IT201800004498A1 (en) * | 2018-04-13 | 2019-10-13 | Apparatus and method for determining physical and chemical parameters of an inhomogeneous sample by acquiring and processing color images of the sample | |
WO2019197952A1 (en) * | 2018-04-13 | 2019-10-17 | Universita' Degli Studi Di Modena E Reggio Emilia | Apparatus and method for determining physical and chemical parameters of an unhomogeneous sample through acquisition and processing of colour images of the sample |
CN112304896A (en) * | 2020-10-29 | 2021-02-02 | 南京林业大学 | Portable flour multi-quality detector based on near infrared and detection method |
CN112304896B (en) * | 2020-10-29 | 2022-10-18 | 南京林业大学 | Portable flour multi-quality detector based on near infrared and detection method |
EP4083184A1 (en) * | 2021-04-26 | 2022-11-02 | Sener Aeroespacial, S.A. | Device for obtaining images of petri dishes |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2014167566A1 (en) | Apparatus for inspection and quality assurance of material samples | |
AU2017344741B2 (en) | System and method for performing automated analysis of air samples | |
JP7048718B2 (en) | Stray light compensation method and equipment for evaluating sample characteristics | |
EP2497823A1 (en) | Device for harvesting bacterial colony and method therefor | |
US12085511B2 (en) | Imaging assisted scanning spectroscopy for gem identification | |
CN106596073A (en) | Method and system for detecting image quality of optical system, and testing target plate | |
JP5922865B2 (en) | Method and apparatus for determining the characteristics of a textured surface | |
US10012584B2 (en) | System and method for determining solute concentration in a colored liquid sample | |
EP3311144A1 (en) | Colour measurement of gemstones | |
US12007332B2 (en) | Portable scanning device for ascertaining attributes of sample materials | |
US12111258B2 (en) | Instruments and methods for characterizing the appearance of samples | |
US20200300782A1 (en) | Electronic component handler and electronic component tester | |
US20010048765A1 (en) | Color characterization for inspection of a product having nonuniform color characteristics | |
CN107389511B (en) | Crop seed phenotype measuring method and portable device | |
RU2638910C1 (en) | Method of object express control | |
CN113252585B (en) | Method and device for judging gold surface coating based on hyperspectral image | |
Szwedziak | Artificial neural networks and computer image analysis in the evaluation of selected quality parameters of pea seeds | |
WO2015004672A1 (en) | A method and apparatus for inspection and quality assurance of material samples using qualified user definitions and data derived from images in a controlled environment | |
JP2021099285A (en) | Color unevenness inspection device and color unevenness inspection method | |
WO2017173501A1 (en) | Method and system for validating resolvable detail across a depth of field | |
WO2017173500A1 (en) | Method and test chart for testing operation of an image capture system | |
Beyaz | LabVIEW Based Real-time Color Measurement System | |
AKSOY et al. | Developing a Solution Density Analysis Program with Image Processing Technique | |
WO2024138150A1 (en) | Portable multimodal optical sensing system | |
JP2020201188A (en) | Color unevenness inspection method, color unevenness inspection device, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14782483 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14782483 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 04/05/2016) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14782483 Country of ref document: EP Kind code of ref document: A1 |