CN110463377B - Mounting apparatus and information processing method - Google Patents
Mounting apparatus and information processing method Download PDFInfo
- Publication number
- CN110463377B CN110463377B CN201780088641.9A CN201780088641A CN110463377B CN 110463377 B CN110463377 B CN 110463377B CN 201780088641 A CN201780088641 A CN 201780088641A CN 110463377 B CN110463377 B CN 110463377B
- Authority
- CN
- China
- Prior art keywords
- measurement gauge
- gauge
- deviation
- accuracy
- accuracy measurement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/02—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness
- G01B11/028—Measuring arrangements characterised by the use of optical techniques for measuring length, width or thickness by measuring lateral position of a boundary of the object
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
- H05K13/00—Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
- H05K13/08—Monitoring manufacture of assemblages
- H05K13/081—Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines
- H05K13/0813—Controlling of single components prior to mounting, e.g. orientation, component geometry
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30148—Semiconductor; IC; Wafer
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Operations Research (AREA)
- Manufacturing & Machinery (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Supply And Installment Of Electrical Components (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The information processing apparatus disclosed in the present specification is used for a mounting apparatus provided with a mounting head that picks up a component and arranges the component on a substrate. The information processing apparatus includes a control unit that performs a detection process of acquiring a captured image of a member having a straight line side, detecting edges of a plurality of points with respect to the straight line side to obtain an approximate straight line of the side, and detecting an outer shape of the member by excluding edge points outside a predetermined range from the approximate straight line on an outer side and an inner side of the member.
Description
Technical Field
The invention disclosed in the present specification relates to an information processing apparatus, a mounting apparatus, and an information processing method.
Background
Conventionally, as a mounting apparatus, there has been proposed, for example, a mounting apparatus which detects a boundary between an upper surface and a side surface of an IC package by using a histogram, detects linearity of a continuous distribution of respective points from a differential value of the boundary point, and detects whether or not a device is chipped based on whether or not four package chip detection windows disposed inside four sides of the IC package cover the respective points (see, for example, patent document 1). In this device, for example, the position can be accurately detected without being affected by the notch on the IC package.
Documents of the prior art
Patent document 1: japanese laid-open patent publication No. 10-213417
Disclosure of Invention
Problems to be solved by the invention
However, in the device of patent document 1, the package notch detection window is disposed only inside the element, and no particular attention is paid to the problems other than the notch of the IC package. Therefore, in the mounting apparatus, the outer shape of the component is required to be detected with higher accuracy.
The present disclosure has been made in view of the above problems, and a main object thereof is to provide an information processing apparatus, a mounting apparatus, and an information processing method capable of detecting the outer shape of a component having a straight side on the outer periphery with higher accuracy.
Means for solving the problems
In order to achieve the above-described main object, an information processing apparatus, a mounting apparatus, and an information processing method disclosed in the present specification adopt the following means.
The information processing apparatus disclosed in the present specification is used for a mounting apparatus provided with a mounting head that picks up a component and arranges it toward a substrate,
the information processing apparatus includes a control unit that executes a detection process, the detection process being: a captured image of a member having a straight line side is acquired, edges of a plurality of points are detected with respect to the straight line side to obtain an approximate straight line of the side, and edge points outside a predetermined range from the approximate straight line are excluded from the outside and the inside of the member to detect the outer shape of the member.
In the apparatus, the following detection processing is performed: a captured image of a member having a straight side is acquired, edges of a plurality of points are detected with respect to the straight side to obtain an approximate straight line of the side, and edge points outside a predetermined range from the approximate straight line are excluded from the outside and inside of the member to detect the outer shape of the member. In this way, since the outline is detected by excluding the inappropriate edge points on the inner and outer sides of the component, the outline of the component having the straight edge on the outer periphery can be detected with higher accuracy.
Drawings
Fig. 1 is a schematic explanatory view showing an example of the mounting system 10.
Fig. 2 is an explanatory diagram showing an example of the gauge 40 for measuring accuracy.
Fig. 3 is a flowchart showing an example of the calibration processing routine.
Fig. 4 is an explanatory diagram of a detection process for detecting the outer shape of the gauge 40 excluding the edge points that are deviated.
Fig. 5 is an explanatory diagram for setting a plurality of allowable ranges to the edge point 54.
Detailed Description
The present embodiment will be described below with reference to the drawings. Fig. 1 is a schematic explanatory view showing an example of the mounting system 10 of the present disclosure. Fig. 2 is an explanatory diagram showing an example of a gauge for measuring accuracy (hereinafter, referred to as a gauge 40). The mounting system 10 is, for example, a system that performs a mounting process related to a process of mounting the components P on the substrate S. The installation system 10 includes an installation device 11 and a management computer (PC) 35. The mounting system 10 is configured as a mounting line in which a plurality of mounting devices 11 are arranged from upstream to downstream. In fig. 1, only one mounting device 11 is shown for convenience of explanation. In the present embodiment, the left-right direction (X axis), the front-rear direction (Y axis), and the up-down direction (Z axis) are as shown in fig. 1.
As shown in fig. 1, the mounting device 11 includes: a substrate processing section 12, a component supply section 14, a component camera 16, a gauge storage section 17, a mounting table 18, a mounting section 20, and a control device 30. The substrate processing unit 12 is a unit that carries in and carries out the substrate S, and fixes and carries out the substrate S at a mounting position. The substrate processing unit 12 includes a pair of conveyors provided at a distance from each other in the front-rear direction in fig. 1 and extending in the left-right direction. The substrate S is conveyed by the conveyor.
The component supply unit 14 includes a plurality of feeders or tray units each having a reel, and is detachably attached to the front side of the mounting device 11. A tape is wound around each tape coil, and a plurality of elements P are held on the surface of the tape along the longitudinal direction of the tape. The tape is unwound backward from the tape reel, and is fed by the feeder unit to the pickup position sucked by the suction nozzle 23 in a state where the component is exposed. The tray unit has a tray on which a plurality of components are arranged and placed, and moves the tray in and out to a predetermined pickup position.
The component camera 16 (first imaging unit) is a device that captures an image, and is a unit that captures an image of one or more components P picked up and held by the mounting head 22. The component camera 16 is disposed between the component supply unit 14 and the substrate processing unit 12. The imaging range of the part camera 16 is above the part camera 16. When the mounting head 22 holding the component P passes above the part camera 16, the part camera 16 captures an image thereof, and outputs the captured image data to the control device 30.
The gauge storage part 17 stores and stores one or more gauges 40. The rule 40 is a member that corrects positional deviation and rotational angle deviation of the component P picked up by the mounting head 22. As shown in fig. 2, the gauge 40 is a rectangular parallelepiped member having straight sides and a very high outer shape compared to a normal element. The gauge 40 is made of a material (e.g., ceramic) that is less likely to change in volume. The mounting table 18 is a table on which the gauge 40 picked up by the mounting unit 20 is placed. In the calibration process, the mounting device 11 detects the pickup deviation (position and rotation angle) based on the captured image in which the gauge 40 is picked up by the suction nozzle 23, detects the arrangement deviation (position and rotation angle) based on the captured image in which the gauge 40 is placed on the mounting table 18, and obtains a correction value for further reducing the deviation.
The mounting section 20 picks up the component P from the component supply section 14 and disposes the component P on the substrate S fixed to the substrate processing section 12. The mounting portion 20 includes: a head moving part 21, a mounting head 22, and a suction nozzle 23. The head moving unit 21 includes a slider guided by the guide rail and moving in the XY direction, and a motor for driving the slider. The mounting head 22 is detachably mounted to the slider and is moved in the XY direction by the head moving unit 21. The mounting head 22 is detachably mounted with one or more suction nozzles 23 (for example, sixteen, eight, four, etc.) on its lower surface side, and is capable of picking up a plurality of components P at a time. The suction nozzle 23 is a pickup part that picks up a component using negative pressure.
A marker camera 24 is disposed on the lower surface side of the mounting head 22 (or the slider). The mark camera 24 is an imaging device capable of imaging the substrate S, the component P, the scale 40, and the like from above, for example. The mark camera 24 moves in the XY direction in accordance with the movement of the mounting head 22. The mark camera 24 takes an image of a reference mark attached to the substrate S for grasping the position of the substrate S, and outputs the image to the control device 30, with the lower side thereof being an imaging area.
As shown in fig. 1, the control device 30 is configured as a microprocessor including a CPU31 as a center, and includes a storage unit 32 and the like that store various data. The control device 30 outputs control signals to the substrate processing unit 12, the component supply unit 14, the component camera 16, and the mounting unit 20, and inputs signals from the mounting unit 20, the component supply unit 14, and the component camera 16. The storage unit 32 stores mounting condition information including the mounting order of the components P on the substrate S, the arrangement position of the components P, and the type of the nozzle 23 capable of picking up the components P.
The management PC35 is a computer that manages information of each device in which the system 10 is installed. The management PC35 includes: control unit, storage unit, display and input device. The control unit is configured as a microprocessor having a CPU as a center. The storage unit is a device such as an HDD that stores various data such as a processing program. The display is a liquid crystal screen displaying various kinds of information. The input device includes a keyboard and a mouse for inputting various commands by a worker. The storage unit stores mounting condition information and the like.
Next, the operation of the mounting system 10 of the present embodiment configured as described above will be described, and first, the mounting process in the mounting device 11 will be described. When the mounting process is started, the CPU31 first reads out the mounting condition information and executes the calibration process. This process will be described later in detail. Next, the CPU31 causes the substrate processing unit 12 to perform the conveyance and fixing process of the substrate S. At this time, the reference mark formed on the substrate S is imaged by the mark camera 24, and the fixed position of the substrate S, the deflection of the substrate S, and the like are detected. Next, the CPU31 performs a process of sucking the components P to the nozzles 23 and arranging them at the set arrangement positions based on the arrangement order set in the mounting condition information. At this time, the CPU31 controls the head moving part 21 so that the mounting head 22 passes above the component camera 16. Further, the CPU31 causes the component camera 16 to photograph the component P sucked by the suction nozzle 23. The CPU31 corrects the deviation of the pickup position and the deviation of the pickup rotation angle of the component P using the picked-up image, and arranges the component P on the substrate S so as to have an appropriate position and orientation. The CPU31 repeats such processing for all the substrates S. In addition, the CPU31 also executes a calibration process in the mounting process according to circumstances, in consideration of thermal expansion of components and the like due to continuous operation.
Next, a calibration process in the mounting apparatus 11 will be described. Fig. 3 is a flowchart showing an example of a calibration processing routine executed by CPU31 of control device 30. This program is stored in the storage unit 32 and executed when a predetermined correction execution timing is reached. The correction execution timing can be set to, for example, when the apparatus is started up, when the apparatus continues to operate for a predetermined time (for example, two hours or four hours, etc.), or the like. When this routine is started, the CPU31 first causes the suction nozzle 23 to be a calibration target to pick up the gauge 40 and move it upward of the part camera 16 (S100), and causes the part camera 16 to photograph the gauge 40 (S110). Next, the CPU31 determines that the outer shape of the gauge 40 has been detected (S120). For example, as shown in fig. 2, the outline detection is a process of determining whether or not the gauge 40 has a notch 41, an attached matter 42, a stain 43, or the like. When the detection of the outer shape of the picked-up gauge 40 is not completed, the CPU31 executes the detection processing of the outer shape of the gauge 40 (S130 to S200).
Fig. 4 is an explanatory diagram showing an example of a detection process for detecting the outer shape of the gauge 40 by excluding the edge points that are deviated. As shown in fig. 4, the gauge image 50 obtained by imaging includes a notch image 51, an attached matter image 52, and the like. When this detection processing is executed, first, the CPU31 detects a plurality of edge points of the gauge image included in the captured image (S130, fig. 4 (a)). The edge points 54 are detected at a plurality of points (several tens of points) on the outer periphery of the gauge image 50. Here, the CPU31 exemplifies a case where twenty dots are detected on the long side of the gauge 40 and ten dots are detected on the short side. It is sufficient to arbitrarily determine how many edge points are detected in such a manner that linearity can be obtained. Next, the CPU31 performs a process of obtaining an approximate straight line 55 based on the detected edge points, and excluding edge points 54 that are outside a predetermined range from the approximate straight line 55 (S140). The CPU31 can obtain the approximate straight line 55 by, for example, the least square method. Further, the deviated edge point 54 may be excluded until the accuracy required for the approximate straight line 55 is achieved by using RANSAC, a median of minimum (LMedS), or the like, for example (fig. 4 (b)). The predetermined range is set based on a distance from an approximate straight line closest to a side of the straight line of the gauge image 50, and is set as a range between the threshold values set for the inner side and the outer side of the gauge image 50. In fig. 4(c), the excluded edge points 54 are indicated by blanks. In this way, the CPU31 finally eliminates the edge points that are abnormally displaced, obtains an approximate straight line, and sets the line as the outer peripheral edge of the gauge 40.
When the excluded edge points are decided, the CPU31 determines whether the number of excluded edge points exceeds a predetermined allowable range (S150). The allowable range can be set to a value that can ensure the accuracy of correction by the gauge 40, for example, one or five. When the number of excluded edge points is out of the allowable range, the CPU31 determines the positions of the excluded edge points with respect to the approximate straight line (S160). When the excluded edge point is outside the approximate straight line 55, the CPU31 determines that there is a possibility of deposit on the outer periphery, and notifies the operator of the possibility of deposit, so as to confirm the presence or absence of deposit on the gauge 40 (S170). The notification to the operator may be performed by displaying a message of the content on a display unit of the operation panel, or by performing voice guidance of the content. On the other hand, when the excluded edge point is located inside the approximate straight line 55 or exists inside and outside, the CPU31 determines that there is a possibility of inner side defect or contamination and attachment on the outer periphery, and notifies the operator of the possibility of these cases to confirm the presence or absence of the attachment on the gauge 40 (S180).
Next, the CPU31 arranges the gauge 40 at a predetermined position (S190), determines whether or not there is an instruction to restart the processing based on an instruction input from an operation panel (not shown) (S200), and waits as it is when there is no instruction to restart the processing. At this time, the CPU31 may place the gauge 40 determined to be inappropriate in the outer shape detection process on the mounting table 18. Unlike the component P, the rule 40 is repeatedly picked up and arranged many times for use, and thus, there are cases where deposits such as dust, contamination, and chipping occur. Here, these conditions are detected by the external shape detection processing and reported to the operator. When the worker confirms the contents of the previous report, the worker confirms the appearance of the gauge 40 mounted on the mounting table 18, removes the removable stain or the deposit, and removes the gauge 40 from the use of the detection process in the case where there is an unusable defect. When a restart of the process is instructed, the CPU31 executes the process of S100 and thereafter. That is, the detection process is performed using the next gauge 40.
On the other hand, when the inspection of the outer shape of the gauge 40 picked up and photographed by the suction nozzle 23 in S120 is completed or the number of edge points excluded in S150 is within the allowable range, the pickup deviation amount (position and rotation angle) of the gauge 40 is obtained based on the photographed image photographed by the part camera 16 (S210). The pickup position deviation amount can be obtained, for example, by how much the center of the gauge 40 deviates in the X-axis direction and the Y-axis direction from the center of the suction nozzle 23. The deviation amount of the pickup rotation angle can be determined by how much the pickup rotation angle is inclined with respect to the ideal posture of the gauge 40. When the pickup deviation amount is obtained, the CPU31 corrects the deviation amount by the correction value and arranges the gauge 40 (S220). The CPU31 may place the gauge 40 on the mounting table 18. Next, the CPU31 causes the mark camera 24 to photograph the gauge 40 in the arranged state from above (S230). Then, the CPU31 obtains the arrangement deviation amount (position and rotation angle) of the gauge 40 based on the captured image captured by the mark camera 24 (S240). The arrangement position deviation amount can be obtained, for example, by how much the center of the gauge 40 deviates from the arrangement target position in the X-axis direction and the Y-axis direction. The deviation amount of the arrangement rotation angle can be obtained by how much the arranged rule 40 is inclined from the ideal posture.
Next, the CPU31 determines whether the arrangement deviation amount is within a predetermined accuracy range (S250). The accuracy range may be a range of a distance and an angle allowed by the arrangement of the elements P and the like. When the arrangement deviation amount is not within the predetermined accuracy range, the CPU31 changes the correction value to make the correction value for correcting the pickup deviation more appropriate, and executes the processing from S100 onward. The correction value may be changed by, for example, increasing the correction amount when the correction amount of the distance or angle is insufficient, and decreasing the correction amount when the correction amount is excessive. Such processing is repeated to set a more appropriate correction value.
In S250, when the arrangement deviation amount is within the predetermined accuracy range, the CPU31 ends the correction process of the deviation amount of the suction nozzle 23, and performs other correction processes such as the correction process of the head moving unit 21 (S270). In this correction processing, the CPU31 performs, for example, the following processing: the mounting head 22 is moved, the moving distance thereof is measured by a counter, and the amount of movement of the mounting head 22 is adjusted so that the mounting head 22 is positioned at an appropriate position based on the length of the moving region (reference distance) and the counter value (measured distance). The CPU31 may perform other correction processing, but the details thereof are omitted. Then, the CPU31 saves the result of the correction processing (S280), and ends the routine as it is. In this way, since the appropriate gauge 40 that performs the outline detection processing is used, more accurate correction processing can be performed.
Here, the correspondence relationship between the components of the present embodiment and the components of the present disclosure is clarified. The control device 30 of the present embodiment corresponds to the information processing device of the present disclosure, the CPU31 corresponds to the control unit, and the gauge 40 corresponds to the component and the gauge for measuring accuracy. The part camera 16 corresponds to a first imaging unit, and the mark camera 24 corresponds to a second imaging unit. In the present embodiment, an example of the information processing method of the present disclosure is also clarified by explaining the operation of the control device 30.
The mounting device 11 of the present embodiment described above executes the following detection processing: an image of a gauge 40 (member) for measuring accuracy having a straight side is acquired, edges of a plurality of points are detected with respect to the straight side to obtain an approximate straight line of the side, and edge points outside a predetermined range from the approximate straight line are excluded on the outer side and the inner side of the gauge 40 to detect the outer shape of the gauge 40. In this device, since the outline is detected by excluding the inappropriate edge point on the inner side or the outer side of the gauge 40, the outline of the member having the straight side on the outer periphery can be detected with higher accuracy. Further, since the control device 30 notifies the operator of the confirmation processing of the rule 40 when the number of edge points to be excluded is out of the predetermined allowable range, the operator can be made to confirm the component state, and the cleaning, replacement, or the like of the rule 40 can be urged.
Further, when the number of edge points excluded outside the gauge 40 is out of the predetermined allowable range, the control device 30 notifies the operator of the confirmation process of the deposit on the gauge 40. In this device, it is possible to report that the attached matter on the outer side of the gauge 40 is checked. When the number of edge points excluded inside the gauge 40 is out of the predetermined allowable range, the control device 30 notifies the operator of the defect of the gauge 40 and/or the confirmation process of the deposit on the gauge 40. In this device, it is possible to report and confirm the defect and the attached matter inside the component.
The control device 30 acquires a captured image obtained by capturing an image of the gauge 40 picked up by the mounting head 22, detects the outer shape of the gauge 40 by performing detection processing, and determines the deviation of the pickup position and/or the deviation of the rotation angle of the gauge 40 on the mounting head 22. In this device, since a more accurate outer shape of the gauge 40 is detected, a more accurate positional and rotational deviation can be obtained. Since the gauge 40 is a gauge for precision measurement and the control device 30 executes the detection process during the calibration process, the accurate outer shape thereof can be detected by using the gauge for precision measurement, and the calibration process can be performed more accurately.
Further, the mounting device 11 includes: a component camera 16 (first imaging unit) capable of imaging the gauge 40 in a state picked up by the mounting head 22; and a mark camera 24 (second imaging unit) capable of imaging the gauge 40 placed at a predetermined position by the mounting head 22, wherein the gauge 40 is a gauge for measuring accuracy, and the control device 30 causes the component camera 16 to image the gauge 40 in a state picked up by the mounting head 22, and performs a detection process using the obtained first captured image to detect the outer shape of the gauge 40. Further, control device 30 executes a calibration process that performs the following process more than once: the deviation of the pickup position and/or the deviation of the rotation angle of the gauge 40 on the mounting head 22 are obtained, the obtained deviation is corrected, the gauge 40 is arranged at the predetermined position, the mark camera 24 is caused to photograph the gauge 40 arranged at the predetermined position, and the deviation of the arrangement position and/or the deviation of the rotation angle of the gauge 40 is obtained using the obtained second photographed image. In this apparatus, since the accurate outer shape is detected using the gauge 40 for precision measurement, the states of the picked-up gauge 40 and the arranged gauge 40 can be confirmed more accurately, and the calibration process can be performed more accurately.
It is to be understood that the management device and the installation-related device disclosed in the present specification are not limited to the above-described embodiments, and can be implemented in various forms as long as they fall within the technical scope of the present invention.
For example, in the above-described embodiment, when the number of excluded edge points is outside the predetermined allowable range, the CPU31 is assumed to notify the operator of the confirmation process of the gauge 40. At this time, the CPU31 may store the rule 40 in which the number of excluded edges exceeds the allowable range, or may output the information to the management PC 35. In this apparatus, the result of the detection processing of the outer shape of the gauge 40 can be used later. Alternatively, the CPU31 may perform a process of excluding the rule 40 whose number of edges to be excluded exceeds the allowable range from the calibration process. In this apparatus, by detecting a more accurate outer shape, an inappropriate gauge 40 can be excluded from the calibration process. The improper gauge 40 may be excluded by, for example, prohibiting the gauge from being picked up from the gauge storage 17, or may be placed on the mounting table 18, or may be dropped into a waste box.
In the above embodiment, the CPU31 notifies the operator of the process of confirming the deposit on the gauge 40 when the number of edge points excluded on the outside of the gauge 40 is outside the predetermined allowable range, but the process is not particularly limited thereto, and the process may be omitted. In the above embodiment, when the number of edge points excluded inside the gauge 40 or inside and outside the gauge 40 is outside the predetermined allowable range, the operator is notified of the defect of the gauge 40 and/or the confirmation process of the deposit on the gauge 40, but the present invention is not limited to this, and the process may be omitted. The notification of whether the excluded edge point is inside or outside the gauge 40 can be omitted, but the notification is preferably performed.
In the above embodiment, the CPU31 performs the process of detecting the outer shape of the gauge 40 using the image obtained by capturing the gauge 40 picked up by the mounting head 22, but is not particularly limited thereto. The process of detecting the outer shape of the gauge 40 may be performed by taking an image of the gauge storage 17 and the gauge 40 placed on the mounting table 18 with the mark camera 24 or the like, for example, to obtain an image. The captured image can be used to detect the outer shape of the gauge 40.
In the above embodiment, the CPU31 determines that the gauge 40 is in an inappropriate state when the number of excluded edge points is outside the predetermined allowable range, but the present invention is not particularly limited thereto, and allowable ranges of a plurality of stages may be provided, and different processing may be executed for each stage. Fig. 5 is an explanatory diagram for setting a plurality of allowable ranges to the edge point 54. In fig. 5(a), a first allowable range a and a second allowable range B that is a range larger than the allowable range a are set. For example, when the predetermined first number of edge points 54 is out of the allowable range a, the CPU31 notifies the operator of the confirmation processing of the gauge 40. Further, when the predetermined second number of edge points 54 is out of the allowable range B, the CPU31 may exclude the gauge 40 from use in the calibration process. Alternatively, as shown in fig. 5(b) and 5(c), the allowable range a may be fixed, and the CPU31 may notify the operator of the confirmation processing of the gauge 40 when the allowable range a is exceeded and the predetermined first number of edge points 54 are excluded, and may exclude the gauge 40 from use in the calibration processing when the allowable range a is exceeded and the second number of edge points 54 greater than the first number are excluded. Alternatively, a combination of a plurality of allowable ranges and a plurality of rules for exclusion may be used.
In the above embodiment, the detection process of the outer shape of the gauge 40 is performed in the mounting device 11, but the detection process is not particularly limited thereto, and may be performed by another device such as the management PC35 as long as a captured image can be acquired. In the above embodiment, the mounting system 10 including the mounting apparatus 11 and the management PC35 has been described, but the mounting apparatus 11 may be used alone or the management PC35 may be used alone.
In the above embodiment, the process of detecting the outer shape of the gauge 40 is performed in the calibration process using the gauge 40 for accuracy measurement, but the invention is not particularly limited thereto, and the process of detecting the outer shape of the component P having a straight side and used in the mounting process may be performed. Even in this case, since the outline is detected by excluding the inappropriate edge points on the inner side or the outer side of the element P (component), the outline of the component having the straight side on the outer periphery can be detected with higher accuracy. Further, although the detection process of the outer shape of the element P may be performed, it is more preferable to use a gauge used for the calibration process in order to further improve the measurement accuracy.
In the above embodiment, the information processing device and the mounting device of the present disclosure have been described as the control device 30 and the mounting device 11, but the present invention is not particularly limited thereto, and an information processing method may be used.
Here, in the information processing device according to the present disclosure, the control unit may notify the operator of the confirmation processing of the component when the number of the edge points to be excluded is outside a predetermined allowable range. In this apparatus, the operator can confirm the state of the component and urge cleaning, replacement, or the like of the component. In the information processing apparatus, the control unit may notify the worker of the confirmation process of the attached matter on the member when the number of the edge points excluded from the outside of the member is out of a predetermined allowable range. In this apparatus, it is possible to report the confirmation of the deposit on the outer side of the component. In the information processing device, the control unit may notify the operator of a defect in the member and/or confirmation of deposits on the member when the number of the edge points excluded from the inside of the member is out of a predetermined allowable range. In this device, it is possible to report the confirmation of the defect or the attached matter inside the component.
In the information processing apparatus, the control unit may acquire a captured image obtained by capturing an image of the component picked up by the mounting head, execute the detection process to detect the outer shape of the component, and obtain a deviation of a pickup position and/or a deviation of a rotation angle of the component on the mounting head. In this device, since a more accurate outer shape of the component is detected, a more accurate positional or rotational deviation can be obtained.
In the information processing apparatus, the member may be a gauge for measuring accuracy, and the control unit may execute the detection process in a calibration process. In this device, since the accurate outer shape is detected by using the gauge for precision measurement, the calibration process can be performed more accurately.
The mounting device disclosed in the present specification includes: a mounting head picking up a component and arranged toward a substrate; and the information processing apparatus according to any one of the above. In this mounting apparatus, as in the case of the information processing apparatus, since the outline is detected by excluding inappropriate edge points on the inside or outside of the component, the outline detection of the component having a straight side on the outer periphery can be performed with higher accuracy. Here, the "member" may be an element used for the mounting process or may be an accuracy measuring gauge used for the calibration process, but the latter is preferable for the necessity of further improving the measurement accuracy.
The control unit may perform a process of excluding the member when the number of the excluded edge points is out of a predetermined allowable range. In this apparatus, it is possible to eliminate an inappropriate member by detecting a more accurate outer shape.
The mounting device may include: a first imaging unit that can image the component picked up by the mounting head; and a second imaging unit that can image the component placed at a predetermined position by the mounting head, wherein the component is a gauge for measuring accuracy, and the control unit executes a calibration process that performs at least one of the following processes: the method includes the steps of causing the first imaging unit to image the component in a state picked up by the mounting head, performing the detection process using the obtained first captured image to detect an outer shape of the component, obtaining a deviation of a pickup position and/or a deviation of a rotation angle of the component on the mounting head, correcting the obtained deviation to dispose the component at a predetermined position, causing the second imaging unit to image the component disposed at the predetermined position, and obtaining a deviation of a disposition position and/or a deviation of a rotation angle of the component using the obtained second captured image. In this apparatus, since the accurate outer shape is detected by using the gauge for measuring accuracy, the state of the picked-up component and the arranged component can be checked more accurately, and the calibration process can be performed more accurately.
The information processing method disclosed in the present specification is used for a mounting device provided with a mounting head that picks up a component and arranges it toward a substrate,
the information processing method includes a step of executing detection processing, the detection processing being processing of: a captured image of a member having a straight line side is acquired, edges of a plurality of points are detected with respect to the straight line side to obtain an approximate straight line of the side, and edge points outside a predetermined range from the approximate straight line are excluded from the outside and the inside of the member to detect the outer shape of the member.
In this method, as in the information processing apparatus described above, since the outline is detected by excluding inappropriate edge points on the inside or outside of the member, the outline detection of the member having a straight side on the outer periphery can be performed with higher accuracy. In the information processing method, various modes of the information processing apparatus may be adopted, and a configuration for realizing each function of the information processing apparatus may be added.
Usefulness in industry
The information processing apparatus and the mounting apparatus of the present disclosure can be used in the technical field of apparatuses that perform processes such as picking up and arranging components.
Description of the reference numerals
10. Installing the system; 11. a mounting device; 12. a substrate processing unit; 14. a component supply section; 16. a part camera; 17. a gauge storage part; 18. a mounting table; 20. an installation part; 21. a head moving section; 22. a mounting head; 23. a suction nozzle; 24. a marking camera; 30. a control unit; 31. a CPU; 32. a storage unit; 35. managing the PC; 40. a gauge; 41. a notch; 42. an adherent; 43. pollution; 50. a gauge image; 51. a notch image; 52. an attachment image; 54. edge points; 55. approximating a straight line; p, element; s, a substrate.
Claims (11)
1. A mounting device is provided with:
a mounting head picking up a component and arranged toward a substrate; and
an information processing device for performing calibration processing using a gauge for precision measurement having a rectangular parallelepiped shape with straight sides,
the information processing apparatus includes a control unit that executes the following detection processing: acquiring a captured image of the accuracy measuring gauge having a straight line side, detecting edges of a plurality of points with respect to the straight line side to obtain an approximate straight line of the side, excluding edge points outside a predetermined range from the approximate straight line on the outer side and the inner side of the accuracy measuring gauge to detect the outer shape of the accuracy measuring gauge,
the control unit determines whether or not the outer shape of the precision measurement gauge is accurate based on whether or not the number of edge points excluded from the outer side and the inner side of the precision measurement gauge exceeds a predetermined allowable range, executes a calibration process for determining a deviation from a target position and/or a deviation of a rotation angle of the precision measurement gauge placed at a predetermined position by the mounting head when the outer shape of the precision measurement gauge is determined to be accurate, and prohibits the execution of the calibration process when the outer shape of the precision measurement gauge is determined to be inaccurate.
2. The mounting device of claim 1,
when the number of the edge points to be excluded is out of a predetermined allowable range, the control unit notifies an operator of a confirmation process of the accuracy measurement gauge.
3. The mounting device of claim 1,
when the number of edge points excluded outside the accuracy measurement gauge is out of a predetermined allowable range, the control unit notifies an operator of a confirmation process of the deposit on the accuracy measurement gauge.
4. The mounting device of claim 2,
when the number of edge points excluded outside the accuracy measurement gauge is out of a predetermined allowable range, the control unit notifies an operator of a confirmation process of the deposit on the accuracy measurement gauge.
5. The mounting device according to any one of claims 1 to 4,
when the number of the edge points excluded from the inside of the precision measurement gauge is out of a predetermined allowable range, the control unit notifies the operator of a confirmation process of a defect of the precision measurement gauge and/or a deposit on the precision measurement gauge.
6. The mounting device according to any one of claims 1 to 4,
the control unit acquires an image of the accuracy measurement gauge picked up by the mounting head, detects the outer shape of the accuracy measurement gauge by performing the detection process, and determines a deviation of a pickup position and/or a deviation of a rotation angle of the accuracy measurement gauge on the mounting head.
7. The mounting device of claim 5,
the control unit acquires an image of the accuracy measurement gauge picked up by the mounting head, detects the outer shape of the accuracy measurement gauge by performing the detection process, and determines a deviation of a pickup position and/or a deviation of a rotation angle of the accuracy measurement gauge on the mounting head.
8. The mounting device of claim 1,
when the number of the edge points to be excluded is out of a predetermined allowable range, the control unit performs a process of excluding the accuracy measurement gauge.
9. The mounting device according to any one of claims 1 to 4 and 8,
the mounting device is provided with:
a first imaging unit that can image the accuracy measurement gauge in a state picked up by the mounting head; and
a second imaging unit capable of imaging the accuracy measurement gauge with the mounting head disposed at a predetermined position,
the control unit performs one or more of the following processes in the calibration process: the method includes the steps of imaging the accuracy measurement gauge in a state picked up by the mounting head by the first imaging unit, detecting an outer shape of the accuracy measurement gauge by performing the detection process using the obtained first imaging image, obtaining a deviation of a pickup position and/or a deviation of a rotation angle of the accuracy measurement gauge on the mounting head, correcting the obtained deviation and disposing the accuracy measurement gauge at a predetermined position, imaging the accuracy measurement gauge disposed at the predetermined position by the second imaging unit, and obtaining a deviation of a disposition position and/or a deviation of a rotation angle of the accuracy measurement gauge using the obtained second imaging image.
10. The mounting device of claim 5,
the mounting device is provided with:
a first imaging unit that can image the accuracy measurement gauge in a state picked up by the mounting head; and
a second imaging unit capable of imaging the accuracy measurement gauge with the mounting head disposed at a predetermined position,
the control unit performs one or more of the following processes in the calibration process: the method includes the steps of imaging the accuracy measurement gauge in a state picked up by the mounting head by the first imaging unit, detecting an outer shape of the accuracy measurement gauge by performing the detection process using the obtained first imaging image, obtaining a deviation of a pickup position and/or a deviation of a rotation angle of the accuracy measurement gauge on the mounting head, correcting the obtained deviation and disposing the accuracy measurement gauge at a predetermined position, imaging the accuracy measurement gauge disposed at the predetermined position by the second imaging unit, and obtaining a deviation of a disposition position and/or a deviation of a rotation angle of the accuracy measurement gauge using the obtained second imaging image.
11. An information processing method used for a mounting device having a mounting head for picking up a component and arranging the component on a substrate, wherein a calibration process is performed by using a precision measurement gauge having a rectangular parallelepiped shape and having a straight side,
the information processing method includes the steps of:
the following detection processing is performed: acquiring a captured image of a precision measurement gauge having a straight line side, detecting edges of a plurality of points with respect to the straight line side to obtain an approximate straight line of the side, and detecting an outer shape of the precision measurement gauge by excluding edge points outside a predetermined range from the approximate straight line on an outer side and an inner side of the precision measurement gauge;
determining whether the outer shape of the accuracy measuring gauge is accurate based on whether the number of edge points excluded from the outside and inside of the accuracy measuring gauge is out of a predetermined allowable range;
when the outer shape of the precision measurement gauge is determined to be accurate, a calibration process is executed to determine a deviation from a target position and/or a deviation of a rotation angle of the precision measurement gauge placed at a predetermined position by the mounting head.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2017/013079 WO2018179187A1 (en) | 2017-03-29 | 2017-03-29 | Information processing device, mounting device, and information processing method |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110463377A CN110463377A (en) | 2019-11-15 |
CN110463377B true CN110463377B (en) | 2021-08-31 |
Family
ID=63674384
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201780088641.9A Active CN110463377B (en) | 2017-03-29 | 2017-03-29 | Mounting apparatus and information processing method |
Country Status (5)
Country | Link |
---|---|
US (1) | US11176657B2 (en) |
EP (1) | EP3606321B1 (en) |
JP (1) | JP6902603B2 (en) |
CN (1) | CN110463377B (en) |
WO (1) | WO2018179187A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP4036853A4 (en) * | 2019-09-25 | 2022-10-05 | Fuji Corporation | Information processing device, mounting device, and information processing method |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3620884B2 (en) * | 1995-03-01 | 2005-02-16 | 富士機械製造株式会社 | Image processing device |
CN101727946A (en) * | 2008-10-10 | 2010-06-09 | 蒂雅克股份有限公司 | Optical disk inspecting apparatus and method |
CN104885125A (en) * | 2012-12-27 | 2015-09-02 | 索尼电脑娱乐公司 | Information processing device, information processing system, and information processing method |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2897747B2 (en) | 1997-01-30 | 1999-05-31 | 日本電気株式会社 | IC package position detection method |
JP5651884B2 (en) | 2010-07-29 | 2015-01-14 | 株式会社アルメディオ | Disk inspection apparatus and disk inspection method |
JP6132512B2 (en) * | 2012-10-26 | 2017-05-24 | 富士機械製造株式会社 | Component mounting device |
JP6378053B2 (en) | 2014-11-12 | 2018-08-22 | 株式会社Fuji | Component mounting machine and component mounting head |
EP3451812B1 (en) * | 2016-04-26 | 2022-11-30 | Fuji Corporation | Substrate work machine |
-
2017
- 2017-03-29 US US16/496,228 patent/US11176657B2/en active Active
- 2017-03-29 WO PCT/JP2017/013079 patent/WO2018179187A1/en unknown
- 2017-03-29 CN CN201780088641.9A patent/CN110463377B/en active Active
- 2017-03-29 JP JP2019508465A patent/JP6902603B2/en active Active
- 2017-03-29 EP EP17902797.4A patent/EP3606321B1/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3620884B2 (en) * | 1995-03-01 | 2005-02-16 | 富士機械製造株式会社 | Image processing device |
CN101727946A (en) * | 2008-10-10 | 2010-06-09 | 蒂雅克股份有限公司 | Optical disk inspecting apparatus and method |
CN104885125A (en) * | 2012-12-27 | 2015-09-02 | 索尼电脑娱乐公司 | Information processing device, information processing system, and information processing method |
Also Published As
Publication number | Publication date |
---|---|
EP3606321A4 (en) | 2020-02-05 |
EP3606321B1 (en) | 2022-05-11 |
JP6902603B2 (en) | 2021-07-14 |
WO2018179187A1 (en) | 2018-10-04 |
JPWO2018179187A1 (en) | 2019-12-12 |
EP3606321A1 (en) | 2020-02-05 |
US11176657B2 (en) | 2021-11-16 |
US20200250809A1 (en) | 2020-08-06 |
CN110463377A (en) | 2019-11-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4912246B2 (en) | Electronic component mounting method and electronic component mounting apparatus | |
CN109076728B (en) | Substrate working machine | |
JP4622912B2 (en) | Method and apparatus for recognizing center position of recognition object | |
CN109076727B (en) | Mounting device and mounting method | |
EP3731615B1 (en) | Pick-and-place device, detection device, and detection method | |
CN110463377B (en) | Mounting apparatus and information processing method | |
CN111869342B (en) | Component mounting apparatus | |
JP5755935B2 (en) | Component pitch measuring apparatus and component pitch measuring method | |
CN113170607B (en) | Component mounting apparatus | |
CN111656884B (en) | Mounting apparatus, information processing apparatus, and mounting method | |
WO2019198220A1 (en) | Maintenance management device, mounting device, and maintenance management method | |
CN111788878B (en) | Component mounting apparatus | |
JP7384916B2 (en) | Information processing equipment and mounting equipment | |
JP6980096B2 (en) | Mounting device | |
CN114982395B (en) | Failure determination device and failure determination method for component mounting machine | |
JPWO2019012576A1 (en) | Imaging device, surface mounter and inspection device | |
JP2022107194A (en) | Imaging apparatus and substrate work device | |
CN117480876A (en) | Component mounting machine and control method of correction process | |
CN116458275A (en) | Mounting system and mounting method | |
JPWO2018173226A1 (en) | Mounting device and mounting method | |
JP2014086508A (en) | Mounting board manufacturing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |