[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2014167566A1 - Apparatus for inspection and quality assurance of material samples - Google Patents

Apparatus for inspection and quality assurance of material samples Download PDF

Info

Publication number
WO2014167566A1
WO2014167566A1 PCT/IL2014/050337 IL2014050337W WO2014167566A1 WO 2014167566 A1 WO2014167566 A1 WO 2014167566A1 IL 2014050337 W IL2014050337 W IL 2014050337W WO 2014167566 A1 WO2014167566 A1 WO 2014167566A1
Authority
WO
WIPO (PCT)
Prior art keywords
sample
color
samples
lighting
imaging
Prior art date
Application number
PCT/IL2014/050337
Other languages
French (fr)
Inventor
Igal Loevsky
Original Assignee
Vibe Technologies
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vibe Technologies filed Critical Vibe Technologies
Publication of WO2014167566A1 publication Critical patent/WO2014167566A1/en

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47Scattering, i.e. diffuse reflection
    • CCHEMISTRY; METALLURGY
    • C12BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12MAPPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
    • C12M41/00Means for regulation, monitoring, measurement or control, e.g. flow regulation
    • C12M41/30Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration
    • C12M41/36Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration of biomass, e.g. colony counters or by turbidity measurements
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0205Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G01J3/0251Colorimeters making use of an integrating sphere
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0205Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
    • G01J3/0254Spectrometers, other than colorimeters, making use of an integrating sphere
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0262Constructional arrangements for removing stray light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/0267Sample holders for colorimetry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/10Arrangements of light sources specially adapted for spectrometry or colorimetry
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/8806Specially adapted optical and illumination features

Definitions

  • the present invention relates to the field of automated quality assurance, sample inspection, and absolute color determination of samples such as grains, pulses, spices, powders, medical cannabis, liquids, bolts, printed circuits, and the like.
  • Optical devices for quality assurance are common for inspection and quality control, where special precautions are taken to assure necessary conditions of lighting, shadowing and the like.
  • special precautions are taken to assure necessary conditions of lighting, shadowing and the like.
  • different setups will often have slightly different conditions (of ambient lighting and the like) and hence direct comparison of analyses performed at two different sites (even for production of the same product) may not be possible.
  • the invention comprises a method for automatically checking samples in terms of correctness of color, shape, size, and other parameters using image processing technology. 'Correctness' here is defined in comparison to an instance called the Master sample which is used to define the desired characteristics.
  • the invention comprises a combination of hardware and data processing methods adapted to produce 'go/no-go' assessments, and discrimination into classes of samples of materials such as: grains, seeds, flours, processed materials, spices, mechanical parts, printed circuits, and the like.
  • the invention also comprises a device adapted to perform the above operations.
  • the hardware comprises a closed box having a hemispherical reflection chamber, described in provisional patent application US61/809429 which is incorporated herein by reference.
  • the hardware is referred to in the figures to follow, and the data processing methods employed use routines described by the figures as well.
  • the device consists of a portable, fully enclosed sample analysis chamber such as that shown in Fig. la,b.
  • the chamber has two halves which may be opened (Fig. lb) and closed (Fig. la) to allow insertion of a sample and then closing of the device to keep out ambient light.
  • the upper half has a downward-facing hemispherical dome, attached by hinges to the lower half which supports a planar analysis surface.
  • the dome is provided with lighting means such as RGB LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed.
  • the device is opened and a sample of material (which may be powder, granular, bulk, or the like) is placed on the analysis surface (or on a jig placed on the surface).
  • the device is then closed and the sample is subsequently analyzed, automatically or manually, by means of a calibrated camera at the top of the dome. described in the detailed description to follow, including a top LED ring, structured light illumination, and more.
  • Figs. 1A,B shows side views of the inventive device in closed and opened configurations.
  • Fig. 2 shows a side view of the top half of the device.
  • Fig. 3 shows a side view of the device.
  • Fig. 4A shows details of the device assembly including sample stage.
  • Fig. 4B shows details of the device assembly including gain correction plate.
  • Figs. 4C,D illustrate the multiple lighting sources of the invention.
  • Fig. 5A shows a sample stage having grasping means.
  • Figs. 5B,C shows a sample stage having target plate positioning means and sample positioning means.
  • Figs. 5D,E shows a sample stage with a homography calibration plate in place.
  • Figs. 6A,B,C presents a vibration stage.
  • Figs. 7A,B,C show means of producing structured light.
  • Fig. 8 illustrates a human operator near a machine of the invention.
  • Fig. 9 presents a flowchart for image analysis using the system. of the system.
  • Fig. 11 shows one exemplary embodiment of the invention.
  • Fig. 12 shows a result of rice analysis screenshot, where some of the rice is found broken.
  • Fig. 13 is a screenshot of parsley analysis, where the areas with dark or bright exceptional color are marked. The total amount of relative area with exceptional color in the sample is high, and therefore the sample is classified as a reject.
  • Quadrometry Expert User refers hereinafter to a user of the device having the privileges to set the standards for acceptable samples of a given checked material.
  • the term "Operator User” refers hereinafter to a user that uses the device to perform checking of material samples.
  • Positive sample refers hereinafter a sample acceptable by the device according to what was set by the Quality Expert User
  • Negative sample refers hereinafter a sample not acceptable by the device according to what was set by the Quality Expert User
  • Master refers hereinafter the definitions of Positive sample of a certain kind, consisting of reference images and other data items which are stored in the device memory, and used by the device software when the automatic check is performed
  • the Quality Expert Users are persons with adequate knowledge in the quality requirements of the discussed samples. Such users can distinguish between the adequate background knowledge about to configure a corresponding check in the device. As a result, the Quality Expert Users can configure checks in the device that distinguish between Positive and Negative samples of a given material, called Masters.
  • the Operator Users are persons holding the knowledge of placing the material sample correctly in the device, and triggering the check of the material which is usually triggered by closing the top half of the device and/or pressing one or several buttons in a defined order.
  • a sample description textually or numerically might be required, for example a batch number, date, time, or any other relevant information which doesn't require the specific knowledge of configuration of checks in the device.
  • the device consists of a portable, fully enclosed sample analysis chamber such as that shown in Fig. la,b.
  • the chamber has two halves 7, 8 which may be opened (Fig. lb) and closed (Fig. la) to allow insertion of a sample. After insertion of a sample the device may be closed as in Fig. la to keep out ambient light.
  • the upper half 7 has a downward-facing hemispherical dome 4, attached by hinges 1 to the lower half 8 which holds the planar analysis surface 2.
  • the dome 4 is provided with lighting means such as RGB, UV, IR, or other LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed.
  • the device is opened as in Fig. lb and a sample of material (which may be powder, granular, bulk, or the like) is placed on the analysis surface 2 (or on a jig placed on the surface).
  • the device is then closed as in Fig. la and the sample is subsequently analyzed by means of a calibrated camera 3 at the top of the dome.
  • the entire device may be disposed on legs allowing for vibration isolation and height adjustment.
  • connection will preferably be made as gas-tight as possible, for example by use of an O-ring and clasps or connectors providing an airtight seal.
  • a computing device and associated electronics all be housed within the bottom half 8 of the device.
  • a touchscreen may be attached to top or bottom halves of the device to allow user interaction with the system.
  • the associated electronics may comprise, inter alia, digital to analog converters for control over the lighting conditions, temperature sensing and control means, weight sensing means, humidity sensing and control means, vibration means adapted to vibrate the sample, pressure sensing and control means, and gas handling apparatus for fixing well-defined partial pressures of a variety of gasses such as oxygen, nitrogen, argon and the like.
  • Fig. 2 shows a sectional view of the upper half of the device, including hemispherical dome 4 and lighting sources 5 which may be for instance upward-facing LEDs of variable intensity and/or color.
  • Fig. 3 shows a further sectional view of the top half and part of the bottom half of the device.
  • a background having defined color and reflectivity 2 lies beneath a sample-holding jig 9 that is bolted 10 in place.
  • Fig. 4A shows in exploded view the hemispherical cover and positioning stage.
  • the positioning stage has background 2, and jig 9 allowing for precise positioning of samples.
  • Fig. 4B shows a cutaway view showing the gain correction plate 450, which allows for gain correction due to variations in CCD response, lighting changes, or both.
  • LED rings for illumination, a first LED ring at the perimeter of the dome, facing upwards and illumination reflect this incoming light evenly down onto the sample.
  • a second ring may be employed near the top of the dome, these LEDs being downward facing and providing direct illumination of the sample.
  • the use of two lighting sources in this fashion is of use since one (the upwards facing elements) provide diffuse illumination, while the other (the downwards facing LED ring) provide direct illumination.
  • the hemispherical shape of the top dome allows for the diffuse lighting to illuminate from shallow angles, while the direct illumination allows for prevention of shadows and ample illumination of the background.
  • Figs. 4C,D (in side and x-ray top views, respectively) show exemplary embodiments having a ring of upward-facing lighting elements 402, which illuminate the diffusely reflective dome from below. Downward facing lighting elements 401 illuminate the sample directly, from above.
  • the sample height may be quite large, for instance a dome having radius of 10cm being capable of admitting samples of 5 cm height without any problem.
  • a sample positioning jig allowing for precise positioning and holding of various objects such as printed circuit boards, petri dishes, mechanical elements, and the like.
  • the use of such positioning jigs allows for determination of characteristics such accuracy as registration, relative position of elements, and the like.
  • a jig system is employed as shown in Fig. 5 A.
  • the sample 12 is held in place by arms 13 which may be spring loaded so as to firmly grasp the sample and retain it in a fixed position.
  • the background 2 is visible and provides uniform reflectance at a well-defined color value.
  • Figs. 5B,C show a further embodiment of the invention adapted for holding samples in position.
  • Jigs 502 in this case taking the form of rectangular rectangular samples of slightly smaller size fit securely.
  • the sample plate 503 itself fits securely into the device by means of protrusions 501, which define a rectangular area into which the various different sample plates fit securely and repeatably.
  • jigs may be used with the device, the jigs being replaceable.
  • one jig adapted for printed circuit boards of a given size and shape may be employed for a time, and a different jig suited for holding a petri dish or other shape may be used at a different time.
  • FIGs. 5D, E A jig used for purposes of determining the homography or rigid body transformation allowing for precise distance measurement is shown in Figs. 5D, E.
  • the protrusions 501 hold the homography plate 511, which has several precisely placed marks 510 which allow the system to determine the rigid body transformation relating the sample plane to the orientation and position of the camera (which is not necessarily exactly perpendicular to the sample plane, and whose distance therefrom is not necessarily known before the homography plate is used to determine these parameters).
  • analysis For purposes of analysis, conditions of temperature, humidity, lighting conditions, and atmosphere are chosen (by the user or by default). Once the chosen environment has been fixed, analysis may begin.
  • the analysis consists of visual analysis by means of the camera 3, and possibly weight measurement by suitable means in the sample holding tray.
  • the visual analysis allows for inspection of bulk samples (of grains, powders, etc. ) in terms of shape, color, morphology, and other visual characteristics.
  • the analysis provides for measurement of statistics regarding these characteristics, thereby allowing determination of percentage of a sample that is within allowed tolerances (for size, morphology, color, etc.), sample quality, and other statistical measures that will be clear to one skilled in the art.
  • the sample environment may be controlled by means of sensors for and control over lighting, temperature, humidity, pressure, atmosphere, and pressure.
  • Vibration means may be employed to vibrate the sample at a given frequency and amplitude, to allow dispersing of a given connected to the vibration such as stiction, angle of repose, and the like.
  • the vibration means may be supplied within a removable plate such as those providing jigs for positioning samples. Furthermore it is within provision of the invention to separately monitor and control the camera temperature and lighting element temperature, to provide even more exact control over the measurement conditions.
  • Figs. 6A-C shows an example of one possible provision for vibrating a sample.
  • Fig. 6A is a fully shaded figure while Figs. 6B,C are isometric section views.
  • the base 603 holding a rubber sheet 602.
  • This sheet in turn holds vibration plate 601 which is in mechanical communication with mechanical actuators 604 such as voice coils, piezoelectric actuators or the like.
  • the vibration plate may itself be outfitted with various sample holding means such as jigs (not shown).
  • sample-holding jigs in conjunction with vibration means.
  • a sample table may be supported by vibrating means, or may have vibrating means in mechanical communication therewith, and this table may also be outfitted with jigs or other holding means adapted to (for example) hold a set of petri dishes in place, such that the dishes do not travel during vibration but the contents of the dishes are vibrated all the same.
  • a color standard or 'gain correction standard'
  • a color standard or 'gain correction standard'
  • a standardized, diffusely reflecting grayscale bar may be used in each system.
  • Lighting corrections may also be made in hardware, by (for instance) changing the current supplied to various lighting elements such lighting intensity (for a given color channel) may be varied until the expected value of intensity is detected by the camera.
  • Target plates may be used for the purposes of color correction and also for correcting for spatial aberrations caused by lens distortion of the camera optics.
  • a checkerboard of white and black squares of exact dimensions such as 1cm x 1cm for each square may be used as a target plate, and due to the exact and known spacing of squares, images of this plate may be used for an 'image undistortion' calibration which performs an arbitrary nonlinear transformation between the measured pixel coordinates and real- space coordinates.
  • the geometric calibrations are as follows: A lens undistortion is applied using the [1] calibration method. The geometric transformation from the Image to the Real World Coordinates is performed using Homography estimation. The homography matrix H 3x3 is calculated from N points, fulfilling the equation
  • W P W j H ⁇ 7 P, where W P is the point in Homogenous representation in [mm], 7 P is the same point on image in Homogenous representation in pixels.
  • the point ( i ; 2, 3)' has to be extracted from homogenous representation by the following scaling operation
  • the multiple levels of feedback and control over measurement conditions will allow for repeatable and measurements in extremely well -characterized conditions.
  • users of separate instances of the inventive machine will measure precisely the same statistics for a given sample, allowing for direct comparison between (for example) color of textile from a Chinese production line vs. factory output from Bangladesh for the same product.
  • the samples may be flatted for instance by knife edge, doctor blade, or a flattening accessory such as that used in preparing espresso shots.
  • the analysis of color can be used to implement an 'area spectrometer' in the following way.
  • the color values output by the camera are either measured in or transformed to the 'LAB' palette instead of the more common RGB or CMYK.
  • the 'Euclidean distance' between one color value (Li,Ai,Bi) and a second value (L 2 ,A 2 ,B 2 ) may be measured as with the advantage over similar measures in other palettes, that this distance in LAB has physiological import; for instance, it has been found that for colors having a difference D ⁇ 2, the average human eye cannot distinguish between them.
  • the rubric D ⁇ 2 is used as an acceptable maximum variation between product and a master.
  • the inventive device allows for measurement of such over large areas, allowing for comparison of hundreds or thousands of points. As will be appreciated this allows for significantly better statistics and signal- to-noise ratio than a small set of tens of points.
  • Image processing means of the invention allow for segmentation of separate objects in an image, and individual measurement of a number of object details such as color, shape, area, perimeter, morphology, curvature, and the like.
  • object details such as color, shape, area, perimeter, morphology, curvature, and the like.
  • the details may all be measured and used for statistical analyses, e.g. production of histograms, calculation of averages and variances, etc.
  • the classification can be accomplished by means of direct input of characteristics (such as minimum/maximum sizes, color ranges, curvatures, etc.) or by means of simply giving examples of 'pass' and 'fail' items. For instance a set of acceptable grains of rice is introduced to the system, analyzed, and stored in software associated with the system as representing acceptable grains. Then a set of unacceptable grains (e.g. discolored, bent, broken, etc) are introduced to the system and analyzed, and then stored in the system as representing unacceptable grains. Based on the statistics of these samples, the definitions of acceptable and unacceptable samples are inferred.
  • characteristics such as minimum/maximum sizes, color ranges, curvatures, etc.
  • 'pass' and 'fail' items For instance a set of acceptable grains of rice is introduced to the system, analyzed, and stored in software associated with the system as representing acceptable grains. Then a set of unacceptable grains (e.g. discolored, bent, broken, etc) are introduced to the system and analyzed, and then stored in the system
  • This inference may be a simple statistical inference or may employ machine learning techniques such as SVM, neural nets, Bayesian inference, Markov chains, or the like, using one or many samples of any number of categories.
  • Particulate samples - a sample that consists of particles, which are a small and separate pieces of material like grains or screws, when the inspection of each particle is important
  • Powder samples - a sample of a powder, usually having a homogenous color that should be determined more accurately than in a Bulk sample d.
  • Panel samples - a nearly flat panel to be inspected, such as a printed electronic circuit or a keyboard
  • structured light for illumination of the sample, allowing for detailed three-dimensional information to be gathered therefrom.
  • a matrix or other collection of points may be projected onto the sample, and their actual positions measured to determine three-dimensional structure.
  • it may also be useful to vary the position of the sample with respect to the camera. If a known (and preferably small) depth of field is used, the points in focus vs. those not in focus as a function of sample table-camera distance, also allows for production of a three-dimensional map of the sample.
  • Figs. 7A,B,C Some exemplary embodiments of a system adapted to provide structured lighting upon the sample plane are shown in Figs. 7A,B,C.
  • the camera 702, dome 704, and structured light 705 are shown, the structured light taking the form of a set of lines, grid, points, or other pattern be it regular or irregular.
  • the structured light is provided by means of lighting elements 701 which shine through gratings or slits 703, thereby forming pattern 705.
  • Fig. 7B shows an embodiment where a projector 706 is used to directly produce a pattern of structured light 705 of any desired type.
  • Fig. 7C shows an embodiment using lasers 710 adapted to produce several beams 711, which together form a structured light pattern 705.
  • Fig. 8 shows an example of a system of the invention, placed on a table 807 for use by a user 806.
  • the system has top half 801 containing the hemispherical dome 803, bottom half 802 containing target plane 804, a handle 805 adapted to allow user 806 to open the device, and hinges 808 attaching top and bottom halves.
  • top half 801 containing the hemispherical dome 803, bottom half 802 containing target plane 804, a handle 805 adapted to allow user 806 to open the device, and hinges 808 attaching top and bottom halves.
  • an appropriate background is chosen (appropriate in terms of contrast for example).
  • the sample is inserted and the device closed.
  • environmental conditions light, temperature, humidity, atmosphere
  • Brightness normalization and image undistortion are carried out as mentioned above, with use of color, geometry, and other standards in the testing chamber either during analysis or at some other time (e.g. during monthly calibrations of the machine).
  • background segmentation is done and then the image processing steps of feature calculation and classification. Once classification is finished, results are reported and another sample may be inserted.
  • Fig. 10 wherein a color histogram for one color channel is presented.
  • the percentage exceptional values may be quantified, as can the levels for exceptional values.
  • the system Since the system is designed for industrial use, it is produced with an ergonomic design, of high rigidity of design and high ruggedness. This is accomplished for example by use of high-impact plastic and T-slot aluminum profile for the major structural components of the device.
  • the image capture of the device may be extremely fast because of the use of an array camera, as opposed to (for example) a linescan camera which may take for example 60 seconds or longer for the formation of a single image.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Biochemistry (AREA)
  • Analytical Chemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Wood Science & Technology (AREA)
  • Immunology (AREA)
  • Pathology (AREA)
  • Engineering & Computer Science (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Organic Chemistry (AREA)
  • Zoology (AREA)
  • Microbiology (AREA)
  • Sustainable Development (AREA)
  • Biotechnology (AREA)
  • General Engineering & Computer Science (AREA)
  • Genetics & Genomics (AREA)
  • Biomedical Technology (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

The invention is a fully enclosed sample analysis chamber with two halves which may be opened and closed to allow insertion of a sample and closing to keep out ambient light. The upper half has a downward-facing hemispherical dome, attached by hinges to the lower half which holds the planar analysis surface. The dome is provided with lighting means such as RGB LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed. Image processing is carried out by camera under exactly reproducible conditions including use of automatic gain correction and area spectroscopy.

Description

us or nspec on an qua y assurance o ma er a , a
This application claims the benefit of U.S. Provisional Application No. 61/809,429, filed 8 April, 2013.
Field of the Invention
The present invention relates to the field of automated quality assurance, sample inspection, and absolute color determination of samples such as grains, pulses, spices, powders, medical cannabis, liquids, bolts, printed circuits, and the like.
Background of the Invention
Optical devices for quality assurance are common for inspection and quality control, where special precautions are taken to assure necessary conditions of lighting, shadowing and the like. However as will be appreciated, different setups will often have slightly different conditions (of ambient lighting and the like) and hence direct comparison of analyses performed at two different sites (even for production of the same product) may not be possible.
There is therefore a long-felt need for a device capable of guaranteeing exact conditions of lighting and hence direct comparison of analyses performed at different locations.
There are also in many cases requirements for checking a color of a sample or its parts, which are met in primitive fashion by employing a spectrophotometer to analyze a single point or small group of points. This method has the drawbacks that noise may severely affect the statistical accuracy of a small number of datapoints, and that furthermore spatial color patterns cannot be checked.
Thus there is also a longfelt need for a device capable of determining the spatial spectral distribution of a sample, suitable for use in the production of textiles, grains, pulses, spices, and the like, able to replace a human inspector, and performing faster tests with more accurate and repeatable results, as will be explained further. Summary of the Invention
The invention comprises a method for automatically checking samples in terms of correctness of color, shape, size, and other parameters using image processing technology. 'Correctness' here is defined in comparison to an instance called the Master sample which is used to define the desired characteristics.
The invention comprises a combination of hardware and data processing methods adapted to produce 'go/no-go' assessments, and discrimination into classes of samples of materials such as: grains, seeds, flours, processed materials, spices, mechanical parts, printed circuits, and the like.
The invention also comprises a device adapted to perform the above operations.
The hardware comprises a closed box having a hemispherical reflection chamber, described in provisional patent application US61/809429 which is incorporated herein by reference. The hardware is referred to in the figures to follow, and the data processing methods employed use routines described by the figures as well.
The device consists of a portable, fully enclosed sample analysis chamber such as that shown in Fig. la,b. The chamber has two halves which may be opened (Fig. lb) and closed (Fig. la) to allow insertion of a sample and then closing of the device to keep out ambient light. The upper half has a downward-facing hemispherical dome, attached by hinges to the lower half which supports a planar analysis surface. The dome is provided with lighting means such as RGB LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed.
The device is opened and a sample of material (which may be powder, granular, bulk, or the like) is placed on the analysis surface (or on a jig placed on the surface). The device is then closed and the sample is subsequently analyzed, automatically or manually, by means of a calibrated camera at the top of the dome. described in the detailed description to follow, including a top LED ring, structured light illumination, and more.
The foregoing embodiments of the invention have been described and illustrated in conjunction with systems and methods thereof, which are meant to be merely illustrative, and not limiting. Furthermore just as every particular reference may embody particular methods/sy stems, yet not require such, ultimately such teaching is meant for all expressions notwithstanding the use of particular embodiments.
Brief Description of the Drawings
Embodiments and features of the present invention are described herein in conjunction with the following drawings:
Figs. 1A,B shows side views of the inventive device in closed and opened configurations.
Fig. 2 shows a side view of the top half of the device. Fig. 3 shows a side view of the device.
Fig. 4A shows details of the device assembly including sample stage. Fig. 4B shows details of the device assembly including gain correction plate. Figs. 4C,D illustrate the multiple lighting sources of the invention. Fig. 5A shows a sample stage having grasping means.
Figs. 5B,C shows a sample stage having target plate positioning means and sample positioning means.
Figs. 5D,E shows a sample stage with a homography calibration plate in place.
Figs. 6A,B,C presents a vibration stage.
Figs. 7A,B,C show means of producing structured light.
Fig. 8 illustrates a human operator near a machine of the invention.
Fig. 9 presents a flowchart for image analysis using the system. of the system.
Fig. 11 shows one exemplary embodiment of the invention.
Fig. 12 shows a result of rice analysis screenshot, where some of the rice is found broken.
Fig. 13 is a screenshot of parsley analysis, where the areas with dark or bright exceptional color are marked. The total amount of relative area with exceptional color in the sample is high, and therefore the sample is classified as a reject.
It should be understood that the drawings are not necessarily drawn to scale.
Detailed Description of Preferred Embodiments
The term "Quality Expert User" refers hereinafter to a user of the device having the privileges to set the standards for acceptable samples of a given checked material.
The term "Operator User" refers hereinafter to a user that uses the device to perform checking of material samples.
The term "Positive sample" refers hereinafter a sample acceptable by the device according to what was set by the Quality Expert User
The term "Negative sample" refers hereinafter a sample not acceptable by the device according to what was set by the Quality Expert User
The term "Master" refers hereinafter the definitions of Positive sample of a certain kind, consisting of reference images and other data items which are stored in the device memory, and used by the device software when the automatic check is performed
As the device is used by manufacturers, traders, and other entities and organizations interested to examine the quality of the discussed materials, effective modus operandi for the device is dividing the users of the single device instance, within an organization, to two types: the Quality Expert Users and the Operator Users.
The Quality Expert Users are persons with adequate knowledge in the quality requirements of the discussed samples. Such users can distinguish between the adequate background knowledge about to configure a corresponding check in the device. As a result, the Quality Expert Users can configure checks in the device that distinguish between Positive and Negative samples of a given material, called Masters.
The Operator Users are persons holding the knowledge of placing the material sample correctly in the device, and triggering the check of the material which is usually triggered by closing the top half of the device and/or pressing one or several buttons in a defined order. Inputting a sample description textually or numerically might be required, for example a batch number, date, time, or any other relevant information which doesn't require the specific knowledge of configuration of checks in the device.
The present invention will be understood from the following detailed description of preferred embodiments, which are meant to be descriptive and not limiting. For the sake of brevity, some well-known features, methods, systems, procedures, components, circuits, and so on, are not described in detail.
The device consists of a portable, fully enclosed sample analysis chamber such as that shown in Fig. la,b. The chamber has two halves 7, 8 which may be opened (Fig. lb) and closed (Fig. la) to allow insertion of a sample. After insertion of a sample the device may be closed as in Fig. la to keep out ambient light. The upper half 7 has a downward-facing hemispherical dome 4, attached by hinges 1 to the lower half 8 which holds the planar analysis surface 2. The dome 4 is provided with lighting means such as RGB, UV, IR, or other LEDs disposed so as to provide uniform illumination of controllable color and intensity to the planar analysis surface when the device is closed.
The device is opened as in Fig. lb and a sample of material (which may be powder, granular, bulk, or the like) is placed on the analysis surface 2 (or on a jig placed on the surface). The device is then closed as in Fig. la and the sample is subsequently analyzed by means of a calibrated camera 3 at the top of the dome. The entire device may be disposed on legs allowing for vibration isolation and height adjustment.
The upper and lower halves are joined when closed in such a manner that no light can enter, for example by using a labyrinthine or multiple-step junction control over various gas pressures, the connection will preferably be made as gas-tight as possible, for example by use of an O-ring and clasps or connectors providing an airtight seal.
It is within provision of the invention that a computing device and associated electronics all be housed within the bottom half 8 of the device. A touchscreen may be attached to top or bottom halves of the device to allow user interaction with the system.
The associated electronics may comprise, inter alia, digital to analog converters for control over the lighting conditions, temperature sensing and control means, weight sensing means, humidity sensing and control means, vibration means adapted to vibrate the sample, pressure sensing and control means, and gas handling apparatus for fixing well-defined partial pressures of a variety of gasses such as oxygen, nitrogen, argon and the like.
It is further within provision of the invention that various chemical agents be released into the sample chamber during or before analysis, either in the gas, liquid, or solid phases. This will allow analysis of reaction between sample and various chemical agents, as for example may be useful in the pharmaceutical industry.
Fig. 2 shows a sectional view of the upper half of the device, including hemispherical dome 4 and lighting sources 5 which may be for instance upward-facing LEDs of variable intensity and/or color.
Fig. 3 shows a further sectional view of the top half and part of the bottom half of the device. A background having defined color and reflectivity 2 lies beneath a sample-holding jig 9 that is bolted 10 in place.
Fig. 4A shows in exploded view the hemispherical cover and positioning stage. The positioning stage has background 2, and jig 9 allowing for precise positioning of samples.
Fig. 4B shows a cutaway view showing the gain correction plate 450, which allows for gain correction due to variations in CCD response, lighting changes, or both.
It is within provision of the invention to use two LED rings for illumination, a first LED ring at the perimeter of the dome, facing upwards and illumination reflect this incoming light evenly down onto the sample.) A second ring may be employed near the top of the dome, these LEDs being downward facing and providing direct illumination of the sample.
The use of two lighting sources in this fashion is of use since one (the upwards facing elements) provide diffuse illumination, while the other (the downwards facing LED ring) provide direct illumination. The hemispherical shape of the top dome allows for the diffuse lighting to illuminate from shallow angles, while the direct illumination allows for prevention of shadows and ample illumination of the background.
Furthermore, the use of both direct and diffuse light sources allows the system to cope with both specular and diffusely reflecting samples.
It is within provision of the invention to vary the intensity of these two types of lighting sources independently, to optimize the lighting on a given sample.
Figs. 4C,D (in side and x-ray top views, respectively) show exemplary embodiments having a ring of upward-facing lighting elements 402, which illuminate the diffusely reflective dome from below. Downward facing lighting elements 401 illuminate the sample directly, from above.
One advantage due to use of the dome is that the sample height may be quite large, for instance a dome having radius of 10cm being capable of admitting samples of 5 cm height without any problem.
It is within provision of the invention to employ a sample positioning jig allowing for precise positioning and holding of various objects such as printed circuit boards, petri dishes, mechanical elements, and the like. The use of such positioning jigs allows for determination of characteristics such accuracy as registration, relative position of elements, and the like.
In one embodiment of the invention a jig system is employed as shown in Fig. 5 A. Here the sample 12 is held in place by arms 13 which may be spring loaded so as to firmly grasp the sample and retain it in a fixed position. The background 2 is visible and provides uniform reflectance at a well-defined color value.
Figs. 5B,C show a further embodiment of the invention adapted for holding samples in position. Jigs 502 (in this case taking the form of rectangular rectangular samples of slightly smaller size fit securely. The sample plate 503 itself fits securely into the device by means of protrusions 501, which define a rectangular area into which the various different sample plates fit securely and repeatably.
It is within provision of the invention that many different jigs may be used with the device, the jigs being replaceable. Thus for example one jig adapted for printed circuit boards of a given size and shape may be employed for a time, and a different jig suited for holding a petri dish or other shape may be used at a different time.
A jig used for purposes of determining the homography or rigid body transformation allowing for precise distance measurement is shown in Figs. 5D, E. Here the protrusions 501 hold the homography plate 511, which has several precisely placed marks 510 which allow the system to determine the rigid body transformation relating the sample plane to the orientation and position of the camera (which is not necessarily exactly perpendicular to the sample plane, and whose distance therefrom is not necessarily known before the homography plate is used to determine these parameters).
For purposes of analysis, conditions of temperature, humidity, lighting conditions, and atmosphere are chosen (by the user or by default). Once the chosen environment has been fixed, analysis may begin. The analysis consists of visual analysis by means of the camera 3, and possibly weight measurement by suitable means in the sample holding tray.
The visual analysis allows for inspection of bulk samples (of grains, powders, etc. ) in terms of shape, color, morphology, and other visual characteristics. The analysis provides for measurement of statistics regarding these characteristics, thereby allowing determination of percentage of a sample that is within allowed tolerances (for size, morphology, color, etc.), sample quality, and other statistical measures that will be clear to one skilled in the art.
As mentioned above, the sample environment may be controlled by means of sensors for and control over lighting, temperature, humidity, pressure, atmosphere, and pressure. Vibration means may be employed to vibrate the sample at a given frequency and amplitude, to allow dispersing of a given connected to the vibration such as stiction, angle of repose, and the like. The vibration means may be supplied within a removable plate such as those providing jigs for positioning samples. Furthermore it is within provision of the invention to separately monitor and control the camera temperature and lighting element temperature, to provide even more exact control over the measurement conditions.
Figs. 6A-C shows an example of one possible provision for vibrating a sample. Fig. 6A is a fully shaded figure while Figs. 6B,C are isometric section views. In these figures one sees the base 603 holding a rubber sheet 602. This sheet in turn holds vibration plate 601 which is in mechanical communication with mechanical actuators 604 such as voice coils, piezoelectric actuators or the like. The vibration plate may itself be outfitted with various sample holding means such as jigs (not shown).
It is within provision of the invention to incorporate sample-holding jigs in conjunction with vibration means. Thus for example a sample table may be supported by vibrating means, or may have vibrating means in mechanical communication therewith, and this table may also be outfitted with jigs or other holding means adapted to (for example) hold a set of petri dishes in place, such that the dishes do not travel during vibration but the contents of the dishes are vibrated all the same.
It is within provision of the invention to use a color standard (or 'gain correction standard') somewhere within the field of view of the camera, to allow for feedback and control over lighting conditions and slight variations between cameras. Thus for example a standardized, diffusely reflecting grayscale bar may be used in each system. This grayscale bar may be used to define for example the middle grey value (e.g. a pixel value of 2A15=32768 for a 16-bit per pixel camera.) Since the grayscale bar provides an absolute standard, the output from a given camera may be normalized such that it gives the expected value of 32768 even when the raw value may be somewhat different due to camera sensor variations, slight lighting variations and so on. This method may of course also be employed for the various colors of an RGB camera as well. Lighting corrections may also be made in hardware, by (for instance) changing the current supplied to various lighting elements such lighting intensity (for a given color channel) may be varied until the expected value of intensity is detected by the camera. Target plates may be used for the purposes of color correction and also for correcting for spatial aberrations caused by lens distortion of the camera optics. Thus for example a checkerboard of white and black squares of exact dimensions such as 1cm x 1cm for each square may be used as a target plate, and due to the exact and known spacing of squares, images of this plate may be used for an 'image undistortion' calibration which performs an arbitrary nonlinear transformation between the measured pixel coordinates and real- space coordinates.
The geometric calibrations are as follows: A lens undistortion is applied using the [1] calibration method. The geometric transformation from the Image to the Real World Coordinates is performed using Homography estimation. The homography matrix H3x3 is calculated from N points, fulfilling the equation
WP = W jH■ 7P, where WP is the point in Homogenous representation in [mm], 7P is the same point on image in Homogenous representation in pixels. After the multiplication is done, the point ( i; 2, 3)' has to be extracted from homogenous representation by the following scaling operation
Figure imgf000011_0001
The Brightness calibrations are as follows: (1) The dome lighting, top LED lighting, and the lens, create non uniform lighting pattern in the image. To overcome this, as a calibration procedure, a gray diffuse reflective sheet is placed in the working area rig instead of the working background and the image5/ = { 5i¾} is captured, where v are the grayscale values of the pixels at locations (i,j). Then, the Brightness Normalization image NI = BI/mean({ si¾}) is extracted. In the operation, every image coming from the camera, is corrected as follows: Icorr = I./NI, where ./ means an element wise division.
(2) The changing camera temperature and the LED degradation create a gain effect on the image, which must be compensated for in order to be able to compare brightness information between images of one device taken in different time, or to compare images from different devices. is taken in each captured image. The target plate is situated near the working area. It is attached mechanically to the Top Half of the device, so when the device is open, there is no danger of sullying the target plate. The resulting gain correction works as follows: when defining a reference sample M, the sum of brightness in every channel R, G and B from the pixels belonging to the target plate T is taken, M Bc =∑∑ Mvc \ C=R,G,B, { VC \ Vx, vy) G T}.
When capturing an image I of a sample S, the target plate area brightness is calculated in a similar way, Bc =∑∑ svc \ C=R,G,B - The gain correction coefficient for any channel is found as 5C = -jf^-, Sc G . Finally, the gain corrected image is obtained, lc' = lcl&c-
As will be appreciated by one skilled in the art, the multiple levels of feedback and control over measurement conditions (controlling camera temperature, lighting element temperature, and sample chamber temperature, calibrating for lens distortion, and calibrating for color aberrations) will allow for repeatable and measurements in extremely well -characterized conditions. Thus users of separate instances of the inventive machine will measure precisely the same statistics for a given sample, allowing for direct comparison between (for example) color of textile from a Chinese production line vs. factory output from Bangladesh for the same product.
To deal with bulk samples, the samples may be flatted for instance by knife edge, doctor blade, or a flattening accessory such as that used in preparing espresso shots.
As mentioned above, it is within provision of the device to allow for color analysis of samples. This may take an arbitrarily complex implementation, for example allowing for analysis of patterns in terms of color and spatial variation.
The analysis of color can be used to implement an 'area spectrometer' in the following way. For color control purposes, the color values output by the camera are either measured in or transformed to the 'LAB' palette instead of the more common RGB or CMYK. In this palette, the 'Euclidean distance' between one color value (Li,Ai,Bi) and a second value (L2,A2,B2) may be measured as with the advantage over similar measures in other palettes, that this distance in LAB has physiological import; for instance, it has been found that for colors having a difference D<2, the average human eye cannot distinguish between them. Thus for purposes of quality control in the textile industry, in many cases the rubric D<2 is used as an acceptable maximum variation between product and a master.
In most systems the L,A,B colors are measured at a single point or a small set of points. In contrast the inventive device allows for measurement of such over large areas, allowing for comparison of hundreds or thousands of points. As will be appreciated this allows for significantly better statistics and signal- to-noise ratio than a small set of tens of points.
Image processing means of the invention allow for segmentation of separate objects in an image, and individual measurement of a number of object details such as color, shape, area, perimeter, morphology, curvature, and the like. For example for each visible grain of rice in a sample, the details (color, shape, area, etc) may all be measured and used for statistical analyses, e.g. production of histograms, calculation of averages and variances, etc. Furthermore by means of these details, it is possibly to classify samples or individual sample elements (such as aforementioned individual grains of rice) into various categories such as acceptable vs. not acceptable.
The classification can be accomplished by means of direct input of characteristics (such as minimum/maximum sizes, color ranges, curvatures, etc.) or by means of simply giving examples of 'pass' and 'fail' items. For instance a set of acceptable grains of rice is introduced to the system, analyzed, and stored in software associated with the system as representing acceptable grains. Then a set of unacceptable grains (e.g. discolored, bent, broken, etc) are introduced to the system and analyzed, and then stored in the system as representing unacceptable grains. Based on the statistics of these samples, the definitions of acceptable and unacceptable samples are inferred. This inference may be a simple statistical inference or may employ machine learning techniques such as SVM, neural nets, Bayesian inference, Markov chains, or the like, using one or many samples of any number of categories. a. Particulate samples - a sample that consists of particles, which are a small and separate pieces of material like grains or screws, when the inspection of each particle is important
b. Bulk samples - a sample of a bulk of material. The inspection of the bulk properties is important, but each of the bulk's particles standing alone isn't important for the inspection
c. Powder samples - a sample of a powder, usually having a homogenous color that should be determined more accurately than in a Bulk sample d. Panel samples - a nearly flat panel to be inspected, such as a printed electronic circuit or a keyboard
It is within provision of the invention to use structured light for illumination of the sample, allowing for detailed three-dimensional information to be gathered therefrom. Thus for example a matrix or other collection of points may be projected onto the sample, and their actual positions measured to determine three-dimensional structure. In this regard it may also be useful to vary the position of the sample with respect to the camera. If a known (and preferably small) depth of field is used, the points in focus vs. those not in focus as a function of sample table-camera distance, also allows for production of a three-dimensional map of the sample.
Some exemplary embodiments of a system adapted to provide structured lighting upon the sample plane are shown in Figs. 7A,B,C. Here the camera 702, dome 704, and structured light 705 are shown, the structured light taking the form of a set of lines, grid, points, or other pattern be it regular or irregular. In Fig. 7A the structured light is provided by means of lighting elements 701 which shine through gratings or slits 703, thereby forming pattern 705. Alternatively, Fig. 7B shows an embodiment where a projector 706 is used to directly produce a pattern of structured light 705 of any desired type. As a further example, Fig. 7C shows an embodiment using lasers 710 adapted to produce several beams 711, which together form a structured light pattern 705.
Fig. 8 shows an example of a system of the invention, placed on a table 807 for use by a user 806. The system has top half 801 containing the hemispherical dome 803, bottom half 802 containing target plane 804, a handle 805 adapted to allow user 806 to open the device, and hinges 808 attaching top and bottom halves. consider the diagram of Fig. 9.
First an appropriate background is chosen (appropriate in terms of contrast for example). After placing the background in the lower part of the device, the sample is inserted and the device closed. Then environmental conditions (lighting, temperature, humidity, atmosphere) are set. Brightness normalization and image undistortion are carried out as mentioned above, with use of color, geometry, and other standards in the testing chamber either during analysis or at some other time (e.g. during monthly calibrations of the machine). After normalization and undistortion, background segmentation is done and then the image processing steps of feature calculation and classification. Once classification is finished, results are reported and another sample may be inserted.
As an example of one aspect of results that may be reported by the system consider Fig. 10 wherein a color histogram for one color channel is presented. The percentage exceptional values may be quantified, as can the levels for exceptional values.
Since the system is designed for industrial use, it is produced with an ergonomic design, of high rigidity of design and high ruggedness. This is accomplished for example by use of high-impact plastic and T-slot aluminum profile for the major structural components of the device.
As will be appreciated by one skilled in the art, the image capture of the device may be extremely fast because of the use of an array camera, as opposed to (for example) a linescan camera which may take for example 60 seconds or longer for the formation of a single image.
It will be further appreciated that a wide variety of materials may be used in the device due to the care with which the enclosure, lighting, and vibration means have been designed. For example, large samples of relatively large height (e.g. 10cm) may be accommodated within the dome of the device.
It will be further appreciated that due to the great care with which the color, lighting, and geometry are linearized, normalized, and standardized, that analyses performed by one machine of the invention may be directly compared to results of analyses performed on another machine, in a different location and at a different time, even years apart. This is in contrast to other term changes in output of lighting elements, and input from imaging devices, these long-term changes being inevitable aspects of real systems.
It is within provision of the invention to analyze sample in terms of the information content of various histograms of the sample, such as gray level histograms and the like, taking of the form of histogram entropy and other measures. The foregoing description and illustrations of the embodiments of the invention has been presented for the purposes of illustration. It is not intended to be exhaustive or to limit the invention to the above description in any form. Any term that has been defined above and used in the claims, should be interpreted according to this definition.
The reference numbers in the claims are not a part of the claims, but rather used for facilitating the reading thereof. These reference numbers should not be interpreted as limiting the claims in any form.
References
[1] Heikkila, Janne, and Olli Silven. "A four-step camera calibration procedure with implicit image correction." Computer Vision and Pattern Recognition, 1997. Proceedings., 1997 IEEE Computer Society Conference on. IEEE, 1997.

Claims

1. A sample analysis device comprising:
a. a top half and a bottom half hingeably attached to one another, said top and bottom halves defining a sample analysis volume; b. a sample stage located near the plane dividing said top and bottom halves;
c. an image capture device adapted to capture images of objects on said image plane;
d. a lighting system comprising a plurality of elements with
controllable intensity;
e. a color standard located within the field of view of said image capture device; wherein said sample analysis volume allows for interference-free analysis of a sample, and further wherein gain correction for color may be achieved by use of said color standard in real time or near real time to allows for direct comparison of results between analyses performed on different instances of said device.
2. The device of claim 1 wherein said lighting system comprises both diffuse and direct lighting elements.
3. The device of claim 1 further providing a sample positioning jig
adapted to hold samples at fixed locations with respect to said image capture device.
4. The device of claim 1 wherein said gain correction is accomplished by feedback control over said lighting intensity.
5. The device of claim 1 wherein said gain correction is accomplished by normalization.
6. The device of claim 1 wherein said sample analysis volume is
reversibly sealable and gas-tight.
7. The device of claim 6, providing gas handling means adapted to
control the atmospheric composition of said analysis volume.
8. The device of claim 1 providing temperature sensing and control means adapted to fix a predetermined temperature within said analysis volume. /167566: device of claim 1 providing humidity sensing and conpcT/IL2014/050337 adapted to fix a predetermined humidity within said analysis volume.
10. The device of claim 1, wherein said lighting system comprises a
diffuse light source and dome-shaped scattering diffuser, and an on- axis light adapted to provide uniform and shadow-free illumination.
11. The device of claim 1 wherein said image capture device is a camera
having adjustable positioning, focus, zoom and shutter.
12. The device of claim 1 wherein further providing accurate positioning
elements such as jigs or centering pins adapted to ensure consistent positioning of said top half with respect to said bottom half after opening and closing said device.
13. The device of claim 1 wherein said sample stage includes a plurality of jigs adapted to hold said samples at accurate and repeatable positions.
14. The device of claim 1, wherein said sample stage comprises a
conveyer belt allowing continuous motion of target objects past said imaging capture device.
15. The device of claim 13, further providing automated positioning of the target objects or materials in the target area of the imaging device by means of visual feedback from the imaging device to control said conveyor belt position.
16. The device of claim 1 further provided with a geometry standard
adapted to allow for reversing lens distortion by means of measuring said lens distortion.
17. The device of claim 1 further provided with a homography standard
adapted to allow for determining the rigid body transformation
parameters defining the position of said target plane with respect to said imaging device, allowing determination of absolute positions in images obtained by said imaging device.
18. The device of claim 1 wherein said color standard is used to perform
white balancing of said image capture device.
19. The device of claim 1 implementing area spectroscopy by separating
color intensity values into "pass" and "fail" color regions by means of threshold. /167566 device of claim 1 implementing shape classification bpcT/iL20l4/050337 length, width, and length-to-width ratio, area, and shape similarity information.
21. The device of claim 1 implementing color classification using edge
information, intensity gradients information, and histogram entropy.
22. The device of claim 1 implementing color uniformity-based
classification using the entropy or the variance of the color
histograms.
23. The device of claim 1 further providing structured light apparatus or a
second camera to obtain depth information of the observed objects obtained.
24. The device of claim 1 further providing addition of a weight sensor to
the device can provide the unit mass of the inspected material.
25. The device of claim 1 adapted to indicate color variation in terms of
CIE Lab ΔΕ.
26. The device of claim 1 wherein said lighting system is adapted to
provide controlled intensity of light selected from the group consisting of: IR, Red, Green, Blue, UV, and combinations thereof.
27. A method for sample analysis comprising steps:
a. providing an imaging means;
b. illuminating a sample both with direct and diffuse illumination
means;
c. performing lens undistortion by means of a lens distortion
measurement plate;
d. performing homographic transformation by means of a
homography measurement plate;
e. imaging said sample with said imaging means while
illuminated with said illumination means;
f. automatically or manually analyzing said image in terms of
image parameters, taking into account said lens undistortion and homographic transformation.
28. The method of claim 27 wherein different users of said method are
selected from the group consisting of: a Quality Expert user type that defines master samples of pass and fail categories; and an Operator /167566" type that uses said method for analyzing samples andpcT/iL20l4/050337 them based on the said master sample definitions.
29. The method of claim 27 automatically classifying material samples to
Positive and Negative using Master sample definitions.
PCT/IL2014/050337 2013-04-08 2014-04-07 Apparatus for inspection and quality assurance of material samples WO2014167566A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201361809429P 2013-04-08 2013-04-08
US61/809,429 2013-04-08

Publications (1)

Publication Number Publication Date
WO2014167566A1 true WO2014167566A1 (en) 2014-10-16

Family

ID=51689027

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2014/050337 WO2014167566A1 (en) 2013-04-08 2014-04-07 Apparatus for inspection and quality assurance of material samples

Country Status (1)

Country Link
WO (1) WO2014167566A1 (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150317786A1 (en) * 2014-05-05 2015-11-05 Alcoa Inc. Apparatus and methods for weld measurement
WO2016080824A1 (en) * 2014-11-20 2016-05-26 Universidad Tecnologica De La Mixteca Device for in-line monitoring of fluid colours
EP3147348A1 (en) * 2015-09-24 2017-03-29 Iul, S.A. Image capturing device for capturing images of plate bacterial cultures
US20170316556A1 (en) * 2016-03-25 2017-11-02 Arconic Inc. Resistance Welding Fasteners, Apparatus and Methods for Joining Dissimilar Materials and Assessing Joints Made Thereby
WO2017165814A3 (en) * 2016-03-25 2017-12-14 Arconic Inc. Resistance welding fasteners, joints and methods for joining dissimilar materials
JP2018189420A (en) * 2017-04-28 2018-11-29 株式会社イマジオム Color pattern discrimination probe, and color patten discrimination device
US10293428B2 (en) 2013-06-26 2019-05-21 Arconic Inc. Resistance welding fastener, apparatus and methods
US10384296B2 (en) 2014-12-15 2019-08-20 Arconic Inc. Resistance welding fastener, apparatus and methods for joining similar and dissimilar materials
IT201800004498A1 (en) * 2018-04-13 2019-10-13 Apparatus and method for determining physical and chemical parameters of an inhomogeneous sample by acquiring and processing color images of the sample
US10507514B2 (en) 2015-09-16 2019-12-17 Arconic Inc. Rivet feeding apparatus
US10903587B2 (en) 2014-02-03 2021-01-26 Howmet Aerospace Inc. Resistance welding fastener, apparatus and methods
CN112304896A (en) * 2020-10-29 2021-02-02 南京林业大学 Portable flour multi-quality detector based on near infrared and detection method
EP4083184A1 (en) * 2021-04-26 2022-11-02 Sener Aeroespacial, S.A. Device for obtaining images of petri dishes

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4350442A (en) * 1976-05-19 1982-09-21 Accusort Corporation Light and color detecting scanner for a sorting apparatus
US5533628A (en) * 1992-03-06 1996-07-09 Agri Tech Incorporated Method and apparatus for sorting objects by color including stable color transformation
US20040239919A1 (en) * 2003-04-30 2004-12-02 Byk Gardner Gmbh Device and method for determining the properties of surfaces
WO2009097193A1 (en) * 2008-01-28 2009-08-06 Innovative Imaging, Inc. Table gauge
US20120002957A1 (en) * 2006-09-29 2012-01-05 Microscan Systems, Inc. Methods for providing diffuse light
US20120201448A1 (en) * 2011-02-03 2012-08-09 Seiko Epson Corporation Robotic device, inspection device, inspection method, and inspection program
US8368762B1 (en) * 2010-04-12 2013-02-05 Adobe Systems Incorporated Methods and apparatus for camera calibration based on multiview image geometry

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4350442A (en) * 1976-05-19 1982-09-21 Accusort Corporation Light and color detecting scanner for a sorting apparatus
US5533628A (en) * 1992-03-06 1996-07-09 Agri Tech Incorporated Method and apparatus for sorting objects by color including stable color transformation
US20040239919A1 (en) * 2003-04-30 2004-12-02 Byk Gardner Gmbh Device and method for determining the properties of surfaces
US20120002957A1 (en) * 2006-09-29 2012-01-05 Microscan Systems, Inc. Methods for providing diffuse light
WO2009097193A1 (en) * 2008-01-28 2009-08-06 Innovative Imaging, Inc. Table gauge
US8368762B1 (en) * 2010-04-12 2013-02-05 Adobe Systems Incorporated Methods and apparatus for camera calibration based on multiview image geometry
US20120201448A1 (en) * 2011-02-03 2012-08-09 Seiko Epson Corporation Robotic device, inspection device, inspection method, and inspection program

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10293428B2 (en) 2013-06-26 2019-05-21 Arconic Inc. Resistance welding fastener, apparatus and methods
US10903587B2 (en) 2014-02-03 2021-01-26 Howmet Aerospace Inc. Resistance welding fastener, apparatus and methods
US9927367B2 (en) * 2014-05-05 2018-03-27 Arconic Inc. Apparatus and methods for weld measurement
US20150317786A1 (en) * 2014-05-05 2015-11-05 Alcoa Inc. Apparatus and methods for weld measurement
WO2016080824A1 (en) * 2014-11-20 2016-05-26 Universidad Tecnologica De La Mixteca Device for in-line monitoring of fluid colours
US10384296B2 (en) 2014-12-15 2019-08-20 Arconic Inc. Resistance welding fastener, apparatus and methods for joining similar and dissimilar materials
US10507514B2 (en) 2015-09-16 2019-12-17 Arconic Inc. Rivet feeding apparatus
WO2017051238A1 (en) * 2015-09-24 2017-03-30 Iul, S.A. Device for obtaining images of bacterial cultures in a dish
US10801006B2 (en) 2015-09-24 2020-10-13 Iul, S.A. Device for obtaining images of bacterial cultures in a dish
EP3147348A1 (en) * 2015-09-24 2017-03-29 Iul, S.A. Image capturing device for capturing images of plate bacterial cultures
WO2017165814A3 (en) * 2016-03-25 2017-12-14 Arconic Inc. Resistance welding fasteners, joints and methods for joining dissimilar materials
US20170316556A1 (en) * 2016-03-25 2017-11-02 Arconic Inc. Resistance Welding Fasteners, Apparatus and Methods for Joining Dissimilar Materials and Assessing Joints Made Thereby
US10593034B2 (en) 2016-03-25 2020-03-17 Arconic Inc. Resistance welding fasteners, apparatus and methods for joining dissimilar materials and assessing joints made thereby
JP2018189420A (en) * 2017-04-28 2018-11-29 株式会社イマジオム Color pattern discrimination probe, and color patten discrimination device
IT201800004498A1 (en) * 2018-04-13 2019-10-13 Apparatus and method for determining physical and chemical parameters of an inhomogeneous sample by acquiring and processing color images of the sample
WO2019197952A1 (en) * 2018-04-13 2019-10-17 Universita' Degli Studi Di Modena E Reggio Emilia Apparatus and method for determining physical and chemical parameters of an unhomogeneous sample through acquisition and processing of colour images of the sample
CN112304896A (en) * 2020-10-29 2021-02-02 南京林业大学 Portable flour multi-quality detector based on near infrared and detection method
CN112304896B (en) * 2020-10-29 2022-10-18 南京林业大学 Portable flour multi-quality detector based on near infrared and detection method
EP4083184A1 (en) * 2021-04-26 2022-11-02 Sener Aeroespacial, S.A. Device for obtaining images of petri dishes

Similar Documents

Publication Publication Date Title
WO2014167566A1 (en) Apparatus for inspection and quality assurance of material samples
AU2017344741B2 (en) System and method for performing automated analysis of air samples
JP7048718B2 (en) Stray light compensation method and equipment for evaluating sample characteristics
EP2497823A1 (en) Device for harvesting bacterial colony and method therefor
US12085511B2 (en) Imaging assisted scanning spectroscopy for gem identification
CN106596073A (en) Method and system for detecting image quality of optical system, and testing target plate
JP5922865B2 (en) Method and apparatus for determining the characteristics of a textured surface
US10012584B2 (en) System and method for determining solute concentration in a colored liquid sample
EP3311144A1 (en) Colour measurement of gemstones
US12007332B2 (en) Portable scanning device for ascertaining attributes of sample materials
US12111258B2 (en) Instruments and methods for characterizing the appearance of samples
US20200300782A1 (en) Electronic component handler and electronic component tester
US20010048765A1 (en) Color characterization for inspection of a product having nonuniform color characteristics
CN107389511B (en) Crop seed phenotype measuring method and portable device
RU2638910C1 (en) Method of object express control
CN113252585B (en) Method and device for judging gold surface coating based on hyperspectral image
Szwedziak Artificial neural networks and computer image analysis in the evaluation of selected quality parameters of pea seeds
WO2015004672A1 (en) A method and apparatus for inspection and quality assurance of material samples using qualified user definitions and data derived from images in a controlled environment
JP2021099285A (en) Color unevenness inspection device and color unevenness inspection method
WO2017173501A1 (en) Method and system for validating resolvable detail across a depth of field
WO2017173500A1 (en) Method and test chart for testing operation of an image capture system
Beyaz LabVIEW Based Real-time Color Measurement System
AKSOY et al. Developing a Solution Density Analysis Program with Image Processing Technique
WO2024138150A1 (en) Portable multimodal optical sensing system
JP2020201188A (en) Color unevenness inspection method, color unevenness inspection device, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14782483

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14782483

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 04/05/2016)

122 Ep: pct application non-entry in european phase

Ref document number: 14782483

Country of ref document: EP

Kind code of ref document: A1