EP3622275A1 - Systems and methods for defect detection in additively manufactured bodies - Google Patents
Systems and methods for defect detection in additively manufactured bodiesInfo
- Publication number
- EP3622275A1 EP3622275A1 EP18797772.3A EP18797772A EP3622275A1 EP 3622275 A1 EP3622275 A1 EP 3622275A1 EP 18797772 A EP18797772 A EP 18797772A EP 3622275 A1 EP3622275 A1 EP 3622275A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- thermal digital
- image
- binary image
- thermal
- digital image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 49
- 230000007547 defect Effects 0.000 title claims abstract description 35
- 238000001514 detection method Methods 0.000 title description 2
- 229910052751 metal Inorganic materials 0.000 claims abstract description 47
- 239000002184 metal Substances 0.000 claims abstract description 47
- 238000012545 processing Methods 0.000 claims abstract description 14
- 238000003384 imaging method Methods 0.000 claims description 22
- 230000007935 neutral effect Effects 0.000 claims description 16
- 239000002245 particle Substances 0.000 claims description 13
- 230000000916 dilatatory effect Effects 0.000 claims description 11
- 238000010438 heat treatment Methods 0.000 claims description 11
- 238000012935 Averaging Methods 0.000 claims description 9
- 238000001914 filtration Methods 0.000 claims description 5
- 238000009738 saturating Methods 0.000 claims description 2
- 238000004519 manufacturing process Methods 0.000 abstract description 27
- 239000010410 layer Substances 0.000 description 53
- 239000000654 additive Substances 0.000 description 22
- 230000000996 additive effect Effects 0.000 description 22
- 239000000843 powder Substances 0.000 description 14
- 238000001816 cooling Methods 0.000 description 7
- 230000008569 process Effects 0.000 description 5
- 229910045601 alloy Inorganic materials 0.000 description 4
- 239000000956 alloy Substances 0.000 description 4
- 239000000463 material Substances 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 239000002356 single layer Substances 0.000 description 3
- 229910010293 ceramic material Inorganic materials 0.000 description 2
- 230000001419 dependent effect Effects 0.000 description 2
- 230000010339 dilation Effects 0.000 description 2
- 238000002844 melting Methods 0.000 description 2
- 230000008018 melting Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000000110 selective laser sintering Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 229910000838 Al alloy Inorganic materials 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000000149 argon plasma sintering Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000010894 electron beam technology Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000011065 in-situ storage Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 239000000155 melt Substances 0.000 description 1
- 239000007769 metal material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N25/00—Investigating or analyzing materials by the use of thermal means
- G01N25/72—Investigating presence of flaws
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B33—ADDITIVE MANUFACTURING TECHNOLOGY
- B33Y—ADDITIVE MANUFACTURING, i.e. MANUFACTURING OF THREE-DIMENSIONAL [3-D] OBJECTS BY ADDITIVE DEPOSITION, ADDITIVE AGGLOMERATION OR ADDITIVE LAYERING, e.g. BY 3-D PRINTING, STEREOLITHOGRAPHY OR SELECTIVE LASER SINTERING
- B33Y10/00—Processes of additive manufacturing
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B33—ADDITIVE MANUFACTURING TECHNOLOGY
- B33Y—ADDITIVE MANUFACTURING, i.e. MANUFACTURING OF THREE-DIMENSIONAL [3-D] OBJECTS BY ADDITIVE DEPOSITION, ADDITIVE AGGLOMERATION OR ADDITIVE LAYERING, e.g. BY 3-D PRINTING, STEREOLITHOGRAPHY OR SELECTIVE LASER SINTERING
- B33Y50/00—Data acquisition or data processing for additive manufacturing
- B33Y50/02—Data acquisition or data processing for additive manufacturing for controlling or regulating additive manufacturing processes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/48—Thermography; Techniques using wholly visual means
Definitions
- the present disclosure is directed towards systems and methods of utilizing images obtained during an additive manufacturing (AM) build process and processing the images to extract information indicative of defects detected on the AM part in-situ during the build.
- AM additive manufacturing
- Additive manufacturing may be used to build, via computer control, successive layers of a metal body. Defects in the metal body may occur as a result of the additive manufacturing process.
- a method comprising: heating at least a portion of a first layer of a metal body to form a heated portion of the first layer; capturing a first plurality of thermal digital images of the heated portion of the first layer; stitching the first plurality of thermal digital images into a first stitched thermal digital image of the heated portion of the first layer; heating at least a portion of a second layer of the metal body to form a heated portion of the second layer; capturing a second plurality of thermal digital images of the heated portion of the second layer; stitching the second plurality of thermal digital images into a second stitched thermal digital image of the heated portion of the second layer; applying a local threshold to the first stitched thermal digital image and to the second stitched thermal digital image to generate a respective first binary image and a respective second binary image; multiplying the first binary image by the second binary image to generate a multiplied binary image; and identifying defect areas on the multiplied binary image based on pixel intensity value.
- the method further comprises: prior to multiplying, filtering the first binary image and the second binary image to remove at least a portion of noise in the first binary image and the second binary image.
- the method further comprises: prior to multiplying, dilating the first binary image and the second binary image to generate a dilated first binary image and a dilated second binary image.
- stitching the plurality of thermal digital images into each respective stitched thermal digital image comprises: applying a global threshold to each respective thermal digital image of the plurality of thermal digital images to generate a corresponding respective binary image; multiplying each corresponding respective binary image by the corresponding respective thermal digital image to generate a respective multiplied thermal digital image; and adding each respective multiplied thermal digital image with a following multiplied thermal digital image to generate the stitched thermal digital image.
- the method further comprises: after generating the stitched thermal digital image, one of: replacing a greyscale value of each pixel in the stitched thermal digital image with a global average intensity value when the greyscale value of the pixel is above a global threshold value, or keeping the greyscale value of each pixel in the stitched thermal digital image when the greyscale value of the pixel is below a global threshold value.
- the method further comprises: prior to applying a global threshold to generate a corresponding respective binary image, applying an averaging filter to each respective thermal digital image of the plurality of thermal digital images to remove at least a portion of noise from each respective thermal digital image.
- the method further comprises: prior to multiplying each corresponding respective binary image by the corresponding respective thermal digital image, dilating each corresponding respective binary image.
- the method further comprises: removing particles of a predetermined size from each corresponding respective dilated binary image.
- the method further comprises: prior to applying a local threshold to the first stitched thermal digital image and to the second stitched thermal digital image, eliminating perspective distortion from each respective stitched thermal digital image.
- each of the first plurality of thermal digital images and each of the second plurality of thermal digital images is exposed for a sufficient time to capture each of the first plurality of thermal digital images and each of the second plurality of thermal digital images without saturating the respective thermal digital image.
- each of the first plurality of thermal digital images and each of the second plurality of thermal digital images is captured via a system comprising: an imaging device having a lens; a neutral density filter attached to the imaging device lens; a notch filter attached to the neutral density filter; and a near-infrared band pass filter attached to the notch filter.
- a method comprises: heating at least a portion of a first layer of a metal body to form a heated portion of the first layer; capturing a first plurality of thermal digital images of the heated portion of the first layer; stitching the first plurality of thermal digital images into a first stitched thermal digital image of the heated portion of the first layer; heating at least a portion of a second layer of a metal body to form a heated portion of the second layer; capturing a second plurality of thermal digital images of the heated portion of the second layer; stitching the second plurality of thermal digital images into a second stitched thermal digital image of the heated portion of the second layer; applying a local threshold to the first stitched thermal digital image and to the second stitched thermal digital image to generate a respective first binary image and a respective second binary image; filtering the first binary image and the second binary image to remove at least a portion of noise in each respective binary image to generate a first filtered binary image and a second filtered binary image; dilating the first
- stitching the plurality of thermal digital images into each respective stitched thermal digital image comprises: applying an averaging filter to each respective thermal digital image of the plurality of thermal digital images to remove at least a portion of noise from each respective thermal digital image; applying a global threshold to each respective thermal digital image of the plurality of thermal digital images to generate a corresponding respective binary image; dilating each corresponding respective binary image; removing particles of a predetermined size from each corresponding respective dilated binary image; multiplying each corresponding respective binary image by the corresponding respective thermal digital image to generate a respective multiplied thermal digital image; and adding each respective multiplied thermal digital image with a following multiplied thermal digital image to generate the stitched thermal digital image.
- the method further comprises: after generating the stitched thermal digital image, one of: replacing a greyscale value of each pixel in the stitched thermal digital image with a global average intensity value when the greyscale value of the pixel is above a global threshold value, or keeping the greyscale value of each pixel in the stitched thermal digital image when the greyscale value of the pixel is below a global threshold value.
- a system for detecting defects in an additively manufactured metal part comprises: an imaging device having a lens; and an image processing system configured to: receive, from the imaging device, a first plurality of thermal digital images of a heated portion of a first layer of a metal body, stitch the first plurality of thermal digital images into a first stitched thermal digital image of the heated portion of the first layer, receive, from the imaging device, a second plurality of thermal digital images of a heated portion of a second layer of the metal body, apply a local threshold to the first stitched thermal digital image and to the second stitched thermal digital image to generate a respective first binary image and a respective second binary image, filter the first binary image and the second binary image to remove at least a portion of noise in each respective binary image to generate a first filtered binary image and a second filtered binary image, dilate the first filtered binary image and the second filtered binary image to generate a dilated, filtered first binary image and a dilated, filtered second
- the image processing system is configured to stitch the plurality of thermal digital images into each respective stitched thermal digital image, via: applying an averaging filter to each respective thermal digital image of the plurality of thermal digital images to remove at least a portion of noise from each respective thermal digital image; applying a global threshold to each respective thermal digital image of the plurality of thermal digital images to generate a corresponding respective binary image; dilating each corresponding respective binary image; removing particles of a predetermined size from each corresponding respective dilated binary image; multiplying each corresponding respective binary image by the corresponding respective thermal digital image to generate a respective multiplied thermal digital image; and adding each respective multiplied thermal digital image with a following multiplied thermal digital image to generate the stitched thermal digital image.
- Figure 1 is a flow diagram of an exemplary method for detecting defect areas in a metal body in accordance with some embodiments of the present invention.
- Figure 2 is a flow diagram of an exemplary method for generating a stitched thermal digital image in accordance with some embodiments of the present invention.
- Figures 3A-3H depicts exemplary stages of a method for detecting defect areas in a metal body in accordance with some embodiments of the present invention.
- Figure 4 depicts an exemplary system for detecting defect areas in a metal body in accordance with some embodiments of the present invention.
- Figure 1 is a flow diagram of an exemplary method 100 for detecting defect areas in, for example, an additively manufactured metal body, in accordance with some embodiments of the present invention.
- Figures 3A-3H depict exemplary stages of the method 100 for detecting defect areas in, for example, an additively manufactured metal body in accordance with some embodiments of the present invention.
- additive manufacturing means “a process of joining materials to make objects from 3D model data, usually layer upon layer, as opposed to subtractive manufacturing methodologies", as defined in ASTM F2792-12a entitled “Standard Terminology for Additively Manufacturing Technologies”.
- a method of making an additively manufactured body includes the steps of: (a) selectively heating at least a portion of an additive manufacturing feedstock (e.g., via an energy source or laser) to a temperature above the liquidus temperature of the particular body to be formed, thereby forming a molten pool, and (b) cooling the molten pool thereby forming a solidified mass.
- a method of making an additively manufactured product includes the steps of: (a) dispersing an additive manufacturing feedstock (e.g., a metal powder) in a bed (or other suitable container), (b) selectively heating at least a portion of the additive manufacturing feedstock (e.g., via an energy source or laser) to a temperature above the liquidus temperature of the particular body to be formed, thereby forming a molten pool, and (c) cooling the molten pool thereby forming a solidified mass.
- the cooling comprises cooling at a rate of at least 1000°C per second.
- the cooling rate is at least 10,000°C per second.
- the cooling rate is at least 100,000°C per second.
- the cooling rate is at least 1,000,000°C per second. Steps (a)- (c) may be repeated as necessary until the product is completed, i.e., until the final additively manufactured product is formed / completed.
- the additive manufacturing feedstock is comprised of one or more powders.
- the powder(s) used to create the final additively manufactured product may be of any suitable composition, including any combination of metallic, alloy, grain refiner materials, and non-metallic (e.g., ceramic material) powders.
- any combination of metallic powders, alloy powders, grain refiner materials, and/or non-metallic powders may be used to realize an aluminum alloy composition described above.
- suitable additive manufacturing systems include the EOSINT M 280 Direct Metal Laser Sintering (DMLS) additive manufacturing system, available from EOS GmbH (Robert-Stirling-Ring 1, 82152 Krailling/Munich, Germany).
- DMLS Direct Metal Laser Sintering
- Other suitable additive manufacturing systems include Selective Laser Sintering (SLS) systems, Selective Laser Melting (SLM) systems, and Electron Beam Melting (EBM) systems, among others.
- SLS Selective Laser Sintering
- SLM Selective Laser Melting
- EBM Electron Beam Melting
- applying an averaging filter refers to a digital filtering technique which replaces the intensity value of a center pixel value with the average intensity value of all the pixels in a given kernel (e.g., a matrix of numbers that is used in image convolutions).
- a "binary image” refers to a digital image comprised of binary pixels.
- binary pixels are pixels whose intensity values are limited to one of two possibilities.
- binary pixels may be pixels whose intensity values are limited to 1 and 0.
- binary pixels may be referred to as "on-pixels" and "off-pixels".
- an "on-pixel” is a pixel whose intensity value is 1 (e.g., a white pixel).
- an "off-pixel” is a pixel whose intensity value is 0 (e.g., a black pixel).
- defect areas are areas that can cause an inadequacy or failure (e.g. imperfections, aberrations, or deficiencies) in an object (e.g. a metal body).
- defect areas are areas having a thermal emission that is lower than the thermal emission of an adjacent area on a layer of the metal body.
- dilation means expanding (i.e., switching off-pixels to on-pixels at the edges of) the particles in a binary image.
- An exemplary dilation operation may use a structuring element (e.g., a 3 x3 or 5 by 5 square of pixels) for expanding such particles.
- the term "dynamic range” refers to the tonal difference between the lightest light and darkest dark of an image. The higher the dynamic range, the more potential shades can be represented, although the dynamic range does not automatically correlate to the number of tones reproduced.
- the dynamic range can be represented by the peak greyscale value (i.e. the largest greyscale value) in the image divided by the smallest greyscale value in the image. For example, a raw greyscale image consists of pixels with intensity values from 0 to 255, where 0 is black and 255 is white and wherein the largest greyscale value cannot exceed 255.
- metal body refers to an additively manufactured part.
- the metal body may be of any suitable composition, including any combination of metallic, alloy, grain refiner materials, and non-metallic (e.g., ceramic material).
- non-metallic e.g., ceramic material
- any combination of metallic, alloy, grain refiner, and/or non-metallic materials may be used to realize the metal body described above.
- noise refers to a random variation of brightness or color information in an image.
- saturation refers to the loss of intensity information that occurs when the signal intensity of pixels in an image goes above or below the end of the intensity value scale.
- a raw greyscale image consists of pixels with intensity values from 0 to 255. If the exposure time of the image is too long, the image will be oversaturated resulting in the loss of intensity information. If the exposure time is too short, the image will have too much noise.
- a "particle” is a group of contiguous on-pixels in a binary image.
- the method 100 comprises heating at least a portion of a first layer of a metal body to form a heated portion of the first layer and capturing a first plurality of thermal digital images of the heated portion of the first layer (e.g. Figure 1, 102 and 104). Subsequently, a second plurality of thermal digital images is captured of a heated portion of a second layer of the metal body (e.g. Figure 1, 108 and 110). In some embodiments, the second layer is adjacent the first layer. In some embodiments, the first layer is not the first layer of the metal body formed, for example, by an additive manufacturing process. In some embodiments, the first layer is the beginning layer from which the metal body is examined for defect areas.
- the plurality of thermal digital images is captured by an exemplary system described below.
- Figure 3A depicts an exemplary thermal digital image of a heated portion of a layer of a metal body.
- Figure 3D depicts a plurality of exemplary thermal digital images of at least a heated portion of a single layer.
- the thermal digital image is an image capture of specific wavelengths of thermal emissions from the heated portion of the layer.
- the practical wavelengths of thermal emissions from the heated portion of the layer range from 700nm to 1mm.
- each of the plurality of thermal digital images has a plurality of pixels.
- each pixel has a specific intensity value.
- the plurality of thermal digital images is captured by one or more imaging devices.
- the one or more imaging devices are digital cameras or video cameras.
- the digital camera is a charged coupled device (CCD) camera.
- the digital camera is a complementary metal-oxide semiconductor (CMOS) camera.
- CCD charged coupled device
- CMOS complementary metal-oxide semiconductor
- each of the plurality of thermal digital images is exposed for a sufficient amount of time to capture the thermal emissions from the heated portion of the layer without oversaturating the image. In some embodiments, each of the plurality of thermal digital images is exposed for a sufficient time to obtain a suitable dynamic range and suitable signal to noise ratio without saturation of the image. In some embodiments, the sufficient amount of exposure time can be dependent on factors such as the optical equipment used with the camera (e.g. narrowband filters, neutral density filters), the emissivity of the powders, and the additive manufacturing process parameters (e.g. a high temperature/high energy process can saturate the image).
- the optical equipment used with the camera e.g. narrowband filters, neutral density filters
- the emissivity of the powders e.g. a high temperature/high energy process can saturate the image.
- a sufficient amount of exposure time is 3 to 8 seconds. In some embodiments, a sufficient amount of exposure time is 4 to 8 seconds. In some embodiments, a sufficient amount of exposure time is 5 to 8 seconds. In some embodiments, a sufficient amount of exposure time is 6 to 8 seconds. In some embodiments, a sufficient amount of exposure time is 7 to 8 seconds.
- a sufficient amount of exposure time is 3 to 7 seconds. In some embodiments, a sufficient amount of exposure time is 3 to 6 seconds. In some embodiments, a sufficient amount of exposure time is 3 to 5 seconds. In some embodiments, a sufficient amount of exposure time is 3 to 4 seconds.
- all of the thermal digital images captured can be exposed for the same amount of time for purposes of consistency. In some embodiments, all of the thermal digital images captured in a single layer can be exposed for the same amount of time for purposes of consistency. In some embodiments, all of the thermal digital images captured in a single part build can be exposed for the same amount of time for purposes of consistency. In some embodiments, all of the thermal digital images captured in a single layer can be exposed for the same amount of time, while images in different layers are exposed for different times.
- the first plurality of thermal digital images is stitched into a first stitched thermal digital image of the heated portion of the first layer (e.g. Figure 1, 106).
- the second plurality of thermal digital images is stitched into a second stitched thermal digital image of the heated portion of the second layer (e.g. Figure 1, 112).
- an n th plurality of thermal digital images of a heated portion of an n th layer of the metal body is captured and stitched into an n stitched thermal digital image of the heated portion of the n layer.
- the n th layer is the final layer in the formation of the metal body.
- the n th layer is the final layer examined for the presence of defect areas.
- Figure 3E is an exemplary depiction of a stitched thermal image to show a part build layer 300.
- a local threshold (e.g. a Niblack local thresholding algorithm) is applied to the first stitched thermal digital image to generate a first binary image and the local threshold is applied to the second stitched thermal digital image to generate a second binary image (e.g. Figure 1, 114).
- the local threshold is applied to the n th stitched thermal digital image to generate an n th binary image.
- the local threshold is calculated for each pixel on the stitched thermal digital image based on local statistics such as range, variance or surface fitting parameters of the neighborhood pixels within a local block of pixels on the stitched thermal digital image.
- the first binary image is multiplied by the second binary image to generate a multiplied binary image (e.g. Figure 1, 116).
- Multiplying the first binary image by the second binary image refers to multiplying the intensity value of each pixel in the first binary image with the intensity value of the pixel in the corresponding location in the second binary image, thereby producing a multiplied binary image.
- the multiplied binary image comprises pixels whose intensity values are limited to 1 and 0. Pixels having an intensity value of 1 are identified as defect areas.
- the first binary image and the second binary image are filtered, prior to multiplying, to remove at least a portion of noise in the first binary image and the second binary image. In some embodiments, noise from each respective binary image is reduced or eliminated by applying an averaging filter to each of the respective binary images.
- the first binary image and the second binary image are dilated prior to multiplying the first binary image by the second binary image. In some embodiments, the first binary image and the second binary image are filtered and dilated prior to multiplying the first binary image by the second binary image.
- the n th binary image is filtered prior to multiplying. In some embodiments, the n th binary image is dilated prior to multiplying.
- the defect areas of the metal body are identified from the multiplied binary image (e.g. Figure 1, 118).
- the defect areas are identified as areas having a pixel intensity value of 1 (e.g. "local features") on, for example the multiplied binary image of three consecutive powder build layers as shown in Figure 3F.
- Figure 3G shows potential defect areas (circled areas) detected on a layer based on repeated local features detected in consecutive layers.
- Figure 3H is a detailed view of one detected potential defect on three consecutive layers at the same location on the additively manufactured part.
- a response is generated by an exemplary system for detecting defects in an additively manufactured metal part.
- the exemplary system is additive manufacturing process chamber or a control system of an additive manufacturing process chamber.
- the response is to remove and discard the metal body from the additive manufacturing process chamber if the defect area is uncorrectable.
- the response is to correct the defect area of the metal body.
- perspective distortion from the stitched thermal digital image is eliminated.
- the perspective distortion may be due to the position and view angle of the one or more imaging device relative to the layer.
- the imaging device such as a digital camera, can have perspective distortion as compared to the machine perspective and to each other.
- the imaging device is calibrated to reduce and/or eliminate perspective distortion.
- the stitched thermal digital image is adjusted into a corrected stitched thermal digital image such that the location of each image pixel is related to a respective location in the powder bed.
- a perspective distortion correction algorithm is used to remove perspective distortion.
- Figure 2 depicts an exemplary method 200 of stitching the plurality of thermal digital images (e.g. into a first stitched thermal digital image, second stitched thermal digital image, and n th stitched thermal digital image).
- a global threshold is applied to each respective thermal image of the plurality of thermal images (e.g. first plurality of thermal images, second plurality of thermal images, n th plurality of thermal images) to generate a corresponding respective binary image.
- a global threshold is applied to a first thermal image, second thermal image, and n th thermal image of a first plurality of thermal images to generate a corresponding first binary image, second binary image, and n th binary image.
- Figure 3B depicts an exemplary binary image generated from an exemplary thermal digital image (e.g. Figure 3A) of a heated portion of a layer of a metal body.
- a corresponding binary image is obtained from each of the thermal digital images by comparing each pixel in the thermal digital image to a global threshold in order to binarize each pixel. For example, if the intensity of the pixel is greater than the global threshold value, the intensity of that pixel is replaced by 1. If the intensity of the pixel is not greater than the global threshold value then the intensity of that pixel is replaced by 0.
- the global threshold value is dependent on factors such as the optical equipment used with the camera (e.g. narrowband filters, neutral density filters), the emissivity of the powders, and the additive manufacturing process parameters (e.g. a high temperature/high energy process can saturate the image).
- Each corresponding respective binary image is multiplied by the corresponding respective thermal digital image to generate a respective multiplied thermal digital image.
- Figure 3C depicts an exemplary thermal digital image recovered after thresholding and processing.
- the first binary image is multiplied by the first thermal image
- the second binary image is multiplied by the second thermal image
- the n th binary image is multiplied by the n th thermal image of a first plurality of thermal images to generate a corresponding first multiplied thermal digital image, second multiplied thermal digital image, and n th multiplied thermal digital image.
- multiplying each corresponding respective binary image by the corresponding respective thermal digital image refers to multiplying the intensity value of each pixel in the binary image with the intensity value of the pixel in the corresponding location in the corresponding thermal digital image, thereby producing a multiplied thermal digital image.
- Each respective multiplied thermal digital image is added with a subsequent multiplied thermal digital image to generate a stitched thermal digital image.
- the first multiplied thermal digital image is added with the second multiplied thermal digital image and the n th multiplied thermal digital image to generate the stitched thermal digital image.
- “adding” refers to, for example, adding the pixel intensity at a first location on a first digital image with the pixel intensity at the same location of a second digital image.
- the exemplary method 200 of stitching the plurality of thermal comprises: prior to applying a global threshold to generate a corresponding respective binary image, eliminating noise, or in some embodiments reducing noise, from each respective thermal digital image of the plurality of thermal digital images.
- noise from each respective thermal digital image is reduced or eliminated by applying an averaging filter to each of the plurality of thermal digital images.
- the exemplary method 200 of stitching the plurality of thermal comprises: prior to multiplying each corresponding respective binary image by the corresponding respective thermal digital image, dilating each corresponding respective binary image.
- the corresponding respective binary image can include particles, some of which depict defects areas and some which are a result of noise in the digital image. Particles of a predetermined size representative of noise in the digital image are removed from each corresponding respective dilated binary image. In some embodiments, particles having a particle area below a threshold area are removed from the image.
- a grey scale value of each pixel in the stitched thermal digital image is replaced with a global average intensity value when the greyscale value of the pixel is above a global threshold value. If the greyscale value is below the global threshold value, the greyscale value of the pixel is retained.
- a "global average intensity value" means the average intensity value of all of the pixels of a digital image.
- the global threshold value for converting a greyscale image to a binary image can be tailored depending on the additive manufacturing build parameters, processes or part specifications that are specific to the end use applications of the additively manufactured part. For example, in some embodiments, the global average intensity value is 225 and the global threshold value is 255.
- Figure 4 depicts an exemplary system for detecting defects in an additively manufactured metal part.
- the system is utilized in conjunction with an additive manufacturing process chamber.
- the additive manufacturing process chamber comprises a processing volume wherein the additively manufactured part is produced.
- the system 400 comprises one or more imaging devices 402 for capturing thermal digital images of at least a portion of the powder bed within the processing volume.
- the imaging device 402 is a CCD camera or CMOS camera.
- the system 400 further comprises a neutral density band pass filter 408.
- the neutral density band pass filter 408 is selected to reduce the intensity of visible wavelengths over a broad spectral range via reflection of absorption.
- the neutral density band pass filter 408 is attached to the lens of the imaging device 402.
- the system 400 further comprises a notch filter 404.
- the notch filter 404 is selected to block the wavelength of the additive manufacturing laser to allow the imaging device to capture the thermal emission from the melted powder pool.
- the notch filter 404 is attached to the neutral density band pass filter 408.
- the neutral density band pass filter 408 is between the imaging device and the notch filter.
- the system 400 further comprises a near-infrared band pass filter 406.
- the near-infrared band pass filter 406 is selected to allow transmission of specific predetermined near-infrared (NIR) spectral bands while blocking out-of-band signals at higher and lower wavelengths.
- the near-infrared band pass filter 406 is attached to the notch filter 404.
- the notch filter 404 is between the neutral density band pass filter 408 and the near-infrared band pass filter 406.
- the choice of the near-infrared band pass filter is based on the emission of the powder used and the temperature range of the melt pool in the additive manufacturing process.
- the system 400 further comprises an image processing system.
- the image processing system is configured to perform the method 100 described above.
- the image processing system is an electronic data storage location, where each of the plurality of thermal digital images is saved.
- the image processing system is a computer/control system (processor and/or memory), which includes any such computing device capable of sending and receiving information/messages (e.g. over a network, to and from other computing devices (e.g. servers, etc.).
- computing devices include laptops, personal computers, multiprocessor systems, microprocessor-based systems; network PCs, and/or programmable consumer electronics (e.g. cameras).
- the computer/control system can be configured wirelessly or with wires to enable communication between components and/or other computing devices.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- Chemical & Material Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Health & Medical Sciences (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762503677P | 2017-05-09 | 2017-05-09 | |
PCT/US2018/031669 WO2018208833A1 (en) | 2017-05-09 | 2018-05-08 | Systems and methods for defect detection in additively manufactured bodies |
Publications (1)
Publication Number | Publication Date |
---|---|
EP3622275A1 true EP3622275A1 (en) | 2020-03-18 |
Family
ID=64104910
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18797772.3A Withdrawn EP3622275A1 (en) | 2017-05-09 | 2018-05-08 | Systems and methods for defect detection in additively manufactured bodies |
Country Status (3)
Country | Link |
---|---|
US (1) | US20200064289A1 (en) |
EP (1) | EP3622275A1 (en) |
WO (1) | WO2018208833A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2019028184A1 (en) * | 2017-08-01 | 2019-02-07 | Sigma Labs, Inc. | Systems and methods for measuring radiated thermal energy during an additive manufacturing operation |
US20190062871A1 (en) * | 2017-08-25 | 2019-02-28 | The Boeing Company | Tailoring high strength aluminum alloys for additive manufacturing through the use of grain refiners |
DE102018127678A1 (en) | 2017-11-07 | 2019-05-09 | Sigma Labs, Inc. | Methods and systems for quality feedback and quality control in additive manufacturing processes |
US11260454B2 (en) | 2017-11-07 | 2022-03-01 | Sigma Labs, Inc. | Correction of non-imaging thermal measurement devices |
US10786850B2 (en) | 2018-02-21 | 2020-09-29 | Sigma Labs, Inc. | Photodetector array for additive manufacturing operations |
DE102019217845A1 (en) * | 2019-11-20 | 2021-05-20 | MTU Aero Engines AG | Method and device for controlling an additive layer construction process |
US11867638B2 (en) * | 2020-10-28 | 2024-01-09 | Lawrence Livermore National Security, Llc | System and method for in situ inspection of defects in additively manufactured parts using high speed melt pool pyrometry |
JP7346476B2 (en) * | 2021-03-10 | 2023-09-19 | 日本電子株式会社 | 3D additive manufacturing device and 3D additive manufacturing method |
DE102022117773A1 (en) | 2022-07-15 | 2024-01-18 | Dmg Mori Additive Gmbh | Method for melt pool monitoring and device for the additive manufacturing of components |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102007056984A1 (en) * | 2007-11-27 | 2009-05-28 | Eos Gmbh Electro Optical Systems | Method for producing a three-dimensional object by means of laser sintering |
JP6342912B2 (en) * | 2012-11-08 | 2018-06-13 | ディーディーエム システムズ, インコーポレイテッド | Additive manufacturing and repair of metal components |
US10336007B2 (en) * | 2014-05-09 | 2019-07-02 | United Technologies Corporation | Sensor fusion for powder bed manufacturing process control |
US20160098825A1 (en) * | 2014-10-05 | 2016-04-07 | Sigma Labs, Inc. | Feature extraction method and system for additive manufacturing |
US10353376B2 (en) * | 2015-01-29 | 2019-07-16 | Arconic Inc. | Systems and methods for modelling additively manufactured bodies |
-
2018
- 2018-05-08 EP EP18797772.3A patent/EP3622275A1/en not_active Withdrawn
- 2018-05-08 WO PCT/US2018/031669 patent/WO2018208833A1/en unknown
-
2019
- 2019-10-30 US US16/668,844 patent/US20200064289A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US20200064289A1 (en) | 2020-02-27 |
WO2018208833A1 (en) | 2018-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20200064289A1 (en) | Systems and methods for defect detection in additively manufactured bodies | |
CN109951646B (en) | Image fusion method and device, electronic equipment and computer readable storage medium | |
CN111986129B (en) | HDR image generation method, equipment and storage medium based on multi-shot image fusion | |
CN107438170B (en) | Image fog penetration method and image acquisition equipment for realizing image fog penetration | |
US8855358B2 (en) | Determining whether or not a digital image has been tampered with | |
US7764319B2 (en) | Image processing apparatus, image-taking system, image processing method and image processing program | |
JP4127411B1 (en) | Image processing apparatus and method | |
US7889207B2 (en) | Image apparatus with image noise compensation | |
KR101367637B1 (en) | Monitoring apparatus | |
US20080101716A1 (en) | Image sharpening apparatus and method thereof | |
US7444075B2 (en) | Imaging device, camera, and imaging method | |
US10803559B2 (en) | Fused image optimization systems and methods | |
US20180336664A1 (en) | Image processing apparatus, image processing method, and storage medium | |
US10440339B2 (en) | Image processing apparatus, image processing method, and storage medium for performing correction for a target pixel having high luminance in an image | |
JP6441771B2 (en) | Imaging device | |
US20140168385A1 (en) | Video signal processing apparatus and video signal processing method | |
CN103824258A (en) | Image processing apparatus and image processing method | |
US20230177661A1 (en) | Method for controlling a bitrate of a video stream captured with an image aquisition device | |
JP2010528530A (en) | Static pattern removal from video captured using a digital CCD camera | |
US20240335910A1 (en) | Welding phenomenon behavior measuring method, measuring device, welding system, and program | |
JP2009515467A (en) | Image improvement | |
CN113228046A (en) | System and method for image fusion | |
CN116984628B (en) | Powder spreading defect detection method based on laser feature fusion imaging | |
US8837866B2 (en) | Image processing apparatus and method for controlling image processing apparatus | |
JP2009111947A (en) | Image correction device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
17P | Request for examination filed |
Effective date: 20191108 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
DAV | Request for validation of the european patent (deleted) | ||
DAX | Request for extension of the european patent (deleted) | ||
RIN1 | Information on inventor provided before grant (corrected) |
Inventor name: GLOBIG, MICHAEL Inventor name: HUANG, WEI |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20201201 |