JP2001284408A - Component mounting equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide component mounting capable of performing the position matching of a substrate and a component. SOLUTION: Imaging images from imaging cameras 12a, 12b, 12c are displayed on a monitor 11 when a registration mode is selected by an image processor 10. An operation panel 21 is operated while an operator observes a monitor screen, and a plurality of reference patterns 41, 42,..., 4n corresponding to a mark on a cell and TAB are successively instructed. The reference patterns 41, 42,..., 4n are registered on a reference pattern registration part 14 in regular order. When a recognition mode is selected, the imaging image taken in an image input part 13 is transmitted to an inspected pattern registration part 15, and matching processing is performed between the reference patterns 41, 42,..., 4n taken out from a designated candidate taking-out part 17 and the imaging image transmitted from the inspected pattern registration part 15 in a comparison part 18. In a control part 19, an instruction of the effect for renewing the reference pattern candidate for an instruction renewal part 15 in response to the processed result of the comparison part 18, and the instructed reference patterns 41, 42,..., 4n are taken out from the reference pattern registration part 14 by the designation candidate taking-out part 17.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a component mounting apparatus for manufacturing a liquid crystal panel or the like, and more particularly, to a component mounting apparatus for mounting components on a substrate.

[0002]

2. Description of the Related Art Conventionally, as a component mounting apparatus for manufacturing a liquid crystal panel or the like, a TAB-IC (Tape Automated Bonding-Integ) is mounted on a liquid crystal substrate (hereinafter also referred to as a "cell").
A component mounting apparatus for mounting a rated circuit (hereinafter, also referred to as “TAB”) is known.

In such a component mounting apparatus, it is necessary to accurately recognize the relative positional relationship between the cell and the TAB in order to accurately join the leads formed on the cell and the TAB to each other. For this reason, in the conventional component mounting apparatus, the cell to be mounted and the TAB
The cell lead and the TAB lead formed respectively are picked up by an image pickup device, and the position of the cell and the TAB is detected by performing image processing on the picked-up image. Specifically, for example, a feature portion (for example, a cross-shaped pattern) in a terminal pattern located at both ends of a cell lead group and a TAB lead group taught in advance from a captured image captured by an imaging device is determined by a matching method. The position of the cell and the TAB is detected by detecting by the image recognition processing (matching processing).

Here, as a method of teaching a pattern to be detected in advance, a captured image of a cell lead and a TAB lead is fetched into an image processing apparatus, and then a region including a desired pattern included in the captured image and its area are read. In general, a reference position in an area is manually specified. Specifically, for example, as shown in FIG. 6, the cursor 35 is moved on the monitor screen 30 on which the captured images of the cell lead and the TAB lead are displayed, and the desired pattern 3
The area including 1 is taught by designating the start point 32 and the end point 33. In addition, the reference position (in this case, the center of gravity of the pattern 31) in the area designated in this manner is used as the reference point 34.
Teach by specifying.

[0005]

As described above, in the conventional component mounting apparatus, the area including the pattern 31 on the monitor screen 30 on which the captured images of the cell leads and the TAB leads are displayed, and the reference position in the area. Start point 3
2. A reference pattern is registered by teaching at three points, the end point 33 and the reference point 34, and the reference pattern taught in this way is detected by a matching process from an image captured by the imaging device. By doing so, the positions of the cell and TAB are detected.

However, such a cell and TA
In B, the pattern 31 to be subjected to position detection may be locally chipped due to the influence of the foreign matter 36 (see FIG. 7), or the pattern may be stained or cracked. Further, such cells and TABs may have inherent color unevenness or the like due to differences in manufacturing lots. Furthermore, such cells and TABs may have variations in the color tone and the like of a captured image due to the influence of members for joining them (anisotropic conductive tape (ACF tape) or the like).

For this reason, in the above-described conventional component mounting apparatus, a difference often occurs between the reference pattern and the actual captured image to be recognized. However, there is a problem that the matching rate in the method is lowered, which easily leads to the occurrence of recognition errors. When a recognition error occurs in this way, it is necessary for the operator to cope with the problem by manual intervention or the like, which increases the burden on the operator and lowers the operation rate of the apparatus.

The present invention has been made in view of the above points, and has as its object to provide a component mounting apparatus which can surely and efficiently position a substrate and a component.

[0009]

According to the present invention, there is provided a component mounting apparatus for mounting a component on a substrate, an image capturing apparatus for capturing an area of the substrate or the component including a positioning mark, and an image captured by the image capturing apparatus. Based on the captured image, a plurality of reference patterns corresponding to the mark are taught, and a matching process is performed between the plurality of taught reference patterns and the captured image captured by the imaging device. An image processing device for detecting the position of the mark of the substrate or the component, and a position for performing alignment between the substrate and the component based on the position of the mark detected by the image processing device. Provided is a component mounting apparatus comprising a matching device.

[0010] In the present invention, the image processing apparatus registers a plurality of patterns of different portions in the same mark in the same substrate or component as the plurality of reference patterns, and registers the plurality of registered patterns. Are sequentially taken out, and the matching process is preferably repeated until the matching rate between the taken out pattern and the image picked up by the image pickup device becomes equal to or more than a predetermined allowable value.

Further, in the present invention, the image processing apparatus registers a plurality of patterns of marks of the same type in different types of substrates or components as the plurality of reference patterns, and sequentially extracts the plurality of registered patterns. Preferably, the matching process is repeatedly performed until the matching rate between the extracted pattern and the image captured by the image capturing device is equal to or greater than a predetermined allowable value.

According to the present invention, a plurality of reference patterns are registered in the image processing device in advance, and the matching ratio between the registered reference pattern and the image captured by the imaging device is registered by the image processing device. Since the matching process is repeatedly performed until is equal to or more than a predetermined allowable value, occurrence of a recognition error can be suppressed, and an increase in the burden on the operator due to manual intervention and a decrease in the operation rate of the apparatus can be prevented.

According to the present invention, by registering a plurality of patterns of different portions in the same mark in the same substrate or component, local defects (substrate or component) in each substrate or component can be registered. (In the case where the component pattern is locally chipped due to the influence of foreign matter, or when the pattern of the substrate or the component is stained or cracked).

Further, according to the present invention, by registering a plurality of patterns of the same type of mark in different types of substrates or components, the unique characteristics of the substrate or component (the substrate or component may differ depending on the manufacturing lot). ACF for bonding of circuit boards and components due to inherent color unevenness, etc.
(In the case where the color tone or the like of the captured image varies due to the influence of the tape or the like).

[0015]

Embodiments of the present invention will be described below with reference to the drawings. 1 to 5 are views for explaining an embodiment of a component mounting apparatus according to the present invention.

As shown in FIG. 1, the component mounting apparatus is for mounting a TAB (component) 4 on a cell (substrate) 1, and is used as a positioning apparatus for positioning the cell 1 and the TAB 4. , A first stage 6 for moving the cell 1 in the X, Y and θ directions, a second stage 7 for moving the TAB 4 in the X and Y directions, and an apparatus for controlling the driving of the first stage 6 and the second stage 7. And a controller 20 for controlling the entire operation. Note that cell 1 and TAB4
Are formed with a cell lead 3 and a TAB lead 5, respectively. The cell lead 3 and the TAB lead 5 are joined to each other by an adhesive film 22 via an anisotropic conductive film (not shown) or the like. 1 is provided with TAB4.

Further, the component mounting apparatus includes an imaging camera (imaging device) 12a for sequentially imaging two cell marks 2 on the left and right sides of one side of the cell 1, and a left side of the cell lead group and the TAB lead group of the cell 1 and the TAB 4. And an imaging camera (imaging device) 12 for imaging the right end region, respectively.
b, 12c.

Note that, as shown in FIG.
b denotes a characteristic portion of the left cell lead portion (hereinafter, simply referred to as "left cell lead portion") (first mark) 3L and a corresponding characteristic portion of the left TAB lead portion of TAB 4 (hereinafter, simply referred to as "left TAB lead portion") ( An image of the left end area (imaging area 8) including the second mark (5L) and the imaging camera 12c is taken by the imaging camera 12c (the first mark). 3
Right end region (imaging region 9) including R and a characteristic portion (hereinafter simply referred to as “right TAB lead portion”) (second mark) 5R of the right TAB lead portion of TAB 4 corresponding thereto.
Is imaged.

Here, the imaging cameras 12a, 12b, 12
c, an image processing apparatus 10 is connected, and the position of the cell mark 2 is detected by image processing based on a captured image captured by the imaging camera 12a.
The left cell lead portion 3 of the cell 1 and the TAB 4 is subjected to image processing based on the images picked up by 2b and 12c.
L, the positions of the right cell lead 3R, the left TAB lead 5L, and the right TAB lead 5R are detected. Note that a monitor 11 is connected to the image processing apparatus 10, and images captured by the imaging cameras 12 a, 12 b, and 12 c are displayed on the monitor 11. Further, a controller 20 to which an operation panel 21 is connected is connected to the image processing apparatus 10, and the position of the cell mark 2 detected by the image processing apparatus 10 and the left cell lead portion 3 of the cell 1 and the TAB 4.
L, the right cell lead 3R, the left TAB lead 5L, and the right TAB lead 5R.
The driving of the stage 6 and the second stage 7 is controlled.

Here, based on the images captured by the image capturing cameras 12a, 12b, and 12c, the image processing apparatus 10 performs left and right cell marks 2, a left cell lead 3L,
A plurality of reference patterns corresponding to the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R are taught, and the plurality of taught reference patterns and the images taken by the imaging cameras 12a, 12b, and 12c. By performing matching processing with the image, the positions of the left cell lead portion 3L, the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R of the cell 1 and the TAB 4 are detected.

FIG. 3 is a block diagram showing a main part of the component mounting apparatus shown in FIG. As shown in FIG. 3, the image processing apparatus 10 includes an image input unit 13 that captures images captured by the imaging cameras 12a, 12b, and 12c. Here, the captured image captured by the image input unit 13 is subjected to multi-value processing or binarization processing by the image input unit 13, and based on a command from the control unit 19, the reference pattern registration unit 14 or the received image is processed. The data is selectively sent to one of the inspection pattern registration units 15.

The reference pattern registering section 14 stores the image input section 1
, 4 sent from 3
n is registered. Note that a plurality of reference patterns 4
As shown in FIG. 4, a plurality of patterns of different portions in the same mark in the same cell 1 and TAB 4 can be registered as 1, 42,..., 4n. FIG.
As shown in (a) and (b), a plurality of patterns of marks of the same type in different types of cell 1 and TAB 4 may be registered. In FIG. 4, the reference patterns 41, 4 from the first candidate to the third candidate for the left TAB lead portion 5L are shown.
2 and 43 are shown. FIG.
(a) and (b), the left cell lead portion 3L and the left TAB of each of the two types of cells 1 and TAB4.
The case where reference patterns 41 (41 ') and 42 (42') of the first candidate and the second candidate are registered for the lead portion 5L is shown.

The inspected pattern registration unit 15 stores the image sent from the image input unit 13 and controls the control unit 1.
The stored captured image is sent to the comparison unit 18 based on the instruction from the control unit 9.

The designated candidate updating section 16 sends a designated pattern to the designated candidate extracting section 17 from the reference pattern registering section 14 to the reference patterns 41, 42,.
n is issued from the first candidate in order. When there are no more candidates for the reference patterns 41, 42,..., 4n to be extracted from the reference pattern registration unit 14 (when the n-th candidate has been extracted),
This is returned to the control unit 19.

The designated candidate extracting section 17 extracts the designated reference patterns 41, 42,..., 4n from the reference pattern registering section 14 based on a command from the designated candidate updating section 16.

The comparison unit 18 performs a matching process between the reference patterns 41, 42,..., 4n extracted from the designated candidate extraction unit 17 and the captured image transmitted from the pattern to be inspected registration unit 15. Yes, processing result (matching rate and position information of matched pattern)
Is sent to the control unit 19.

The control section 19 includes an image input section 13, a pattern to be inspected registration section 15, a designated candidate update section 16, and a comparison section 1.
8 and issues a predetermined command to each of these units. An allowable value of the matching ratio (for example, 80%) is set in the control unit 19 in advance, and based on the processing result sent from the comparing unit 18, the obtained matching ratio is equal to or more than a predetermined allowable value. It is determined whether or not there is. If the control unit 19 determines that the obtained matching ratio is smaller than the predetermined allowable value, the control unit 19 issues a command to the designated candidate updating unit 16 to update the reference pattern candidate. It has become.
On the other hand, when it is determined that the obtained matching ratio is equal to or more than the predetermined allowable value, the position information of the obtained pattern is sent to the controller 20.

Next, the operation of the present embodiment having the above configuration will be described.

First, the operator uses the operation panel 21 connected to the controller 20 to operate the image processing apparatus 10.
Or a recognition mode in which the image processing apparatus 10 performs a matching process using the reference pattern.

Here, when the registration mode is selected, a selection signal is sent from the controller 20 to the control unit 19 of the image processing apparatus 10, and the imaging cameras 12a, 12b, 12c
The captured images taken into the image input unit 13 from are sequentially displayed on the monitor 11.

The operator operates the operation panel 21 while looking at the monitor screen displayed on the monitor 11, and operates the left and right cell marks 2, the left cell lead 3L, the right cell lead 3R, the left TAB lead 5L and the right TAB lead. Multiple reference patterns 4 corresponding to each of the portions 5R
, 4n are sequentially taught (see FIGS. 4 and 5).
(See (a) (b)).

At this time, as shown in FIG. 6, the operator places the cell lead 3 and the TAB lead 5 on the monitor 11.
In the state where the captured image is displayed, the cursor 35 is moved on the monitor screen by operating the operation panel 21, and the area including the desired pattern 31 is designated as the start point 32 and the end point 33 in each of the cell lead 3 and the TAB lead 5. Teach by The reference position in the area specified in this way is taught by specifying the reference point 34. The same applies to the cell mark 2.

The image input unit 13 receives such a teaching signal (registration signal) from the controller 20 via the control unit 19, and receives a pattern (image) and a reference point 34 in an area surrounded by the start point 32 and the end point 33. Pattern registration unit 1 using the reference position designated by
Send to 4. The reference pattern registration unit 14 stores the image input unit 13
, 4n as the first, second,..., Nth candidate reference patterns in the order sent from the left and right cell marks 2, the cell lead portions 3L, 3R, and the TAB lead portions 5L, 5R. Register for each.

On the other hand, when the recognition mode is selected, a selection signal is sent from the controller 20 to the control unit 19 of the image processing apparatus 10. In this state, when an image captured by the image capturing cameras 12a, 12b, and 12c is captured by the image input unit 13, the captured image is sent to the pattern to be inspected registration unit 15 and stored.

The captured image sent to the pattern-to-be-inspected registration unit 15 is sent to the comparison unit 18 based on a command from the control unit 19, and the comparison unit 18 takes out the image taken from the designated candidate extraction unit 17. A matching process is performed between the (first candidate) reference pattern 41 and the captured image sent from the pattern to-be-inspected registration unit 15, and the left cell lead portion 3 </ b> L of the cell mark 2, the cell 1, and the TAB 4, respectively, Cell lead 3R, left TAB lead 5L
And the position of the right TAB lead 5R is detected. Then, the processing result (matching rate and position information of the matched pattern) is sent to the control unit 19.

Here, an allowable value (for example, 80%) of the matching ratio is set in the control unit 19 in advance.
Based on the processing result sent from the comparing unit 18, it is determined whether the obtained matching ratio is equal to or more than a predetermined allowable value.

When the control unit 19 determines that the obtained matching ratio is smaller than the predetermined allowable lower limit, the designated candidate updating unit 16 informs the designated candidate updating unit 16 of the detection target unit determined to be smaller. Is issued to update the reference pattern candidate corresponding to. The designated candidate updating unit 16
Based on a command from the control unit 19, the designated candidate extracting unit 1
7 from the reference pattern registration unit 14 to the reference pattern 4
, 4n from the second candidate in order. The designated candidate extracting unit 17 is a designated candidate updating unit 1
, 4n are extracted from the reference pattern registration unit 14 based on the command from the reference pattern register 6. Then, the extracted reference patterns 42,.
The matching process is repeatedly performed until the matching ratio between 4n and the images captured by the imaging cameras 12a, 12b, and 12c is equal to or greater than a predetermined allowable value.

On the other hand, when it is determined that the obtained matching ratio is equal to or larger than the predetermined allowable value, the position information of the obtained pattern is sent to the controller 20. The controller 20 controls the driving of the first stage 6 and the second stage 7 based on the obtained position information of the pattern. Specifically, for example, the component mounting device is a temporary crimping device,
And cell mark 2 on cell 1 as position information of the pattern
When the information on the position of the first stage 6 and the information on the relative position between the cell 1 and the TAB 4 are obtained, the X and Y positions of the first stage 6 and the rotation angle θ are controlled.

It should be noted that the control unit 19 sends the designated candidate update unit 16
., 4n from the reference pattern registration unit 14 (no more than the n-th candidate). Is returned to the control unit 19. The control unit 19 receives this signal, determines that a recognition error has occurred, and sends a recognition error signal to the controller 20. The controller 20
When the recognition error signal is received, the operation of the component mounting apparatus is stopped, and an alarm (monitor display, buzzer, or the like) for urging the operator to recover is issued.

As described above, according to the present embodiment, the plurality of reference patterns 41, 42,.
., 4n by the image processing apparatus 10. The registered reference patterns 41, 42,.
And the matching process is repeatedly performed until the matching rate with the images captured by the imaging cameras 12a, 12b, and 12c is equal to or greater than a predetermined allowable value, so that occurrence of recognition errors is suppressed, and the burden on the operator due to manual intervention or the like. , And a decrease in the operation rate of the apparatus can be prevented.

In particular, according to the present embodiment, by registering a plurality of patterns of different portions in the same mark in the same cell 1 and TAB 4, local patterns in individual cells 1 and TAB 4 are registered. Defects (cell 1 and TAB4
Pattern is locally missing due to foreign matter,
(When the pattern of the cell 1 and the TAB 4 is stained or cracked).

Further, according to the present embodiment, by registering a plurality of patterns of the same type of marks in different types of cells 1 and TAB4, the unique characteristics of cells 1 and TAB4 (cells 1 and TAB4 are (Effects such as the occurrence of unique color unevenness or the like due to the difference between the production lots, or the occurrence of variations in the color tone or the like of the captured image due to the influence of the ACF tape or the like for joining the cell 1 and the TAB 4) Can be handled.

In the embodiment described above, the control unit 19 of the image processing apparatus 10 sets an allowable value (for example, 80%) of the matching rate common to all the reference patterns 41, 42,..., 4n. But not limited to this
For example, the reference pattern registration unit 14 holds an allowable value of the matching rate corresponding to each of the plurality of patterns,
The control unit 19 may repeat the matching process based on the held content. Thereby, the characteristics of the cell 1 and the TAB 4 and the reference patterns 41, 42,
.., 4n, etc., and more flexible matching processing can be realized.

In the above-described embodiment, the left cell lead portion 3L, the right cell lead portion 3R, and the left TAB which are characteristic portions of the cell lead group and the TAB lead group.
Although the positions of the cells 1 and TAB4 are detected using the patterns of the lead portion 5L and the right TAB lead portion 5R, the present invention is not limited to this, and the cells 1 and TAB4 can be detected by using the marks provided exclusively on the cells 1 and TAB4. May be detected.

[0045]

As described above, according to the present invention, a plurality of reference patterns are registered in the image processing apparatus in advance, and the registered reference patterns are imaged by the image processing apparatus. The matching process is repeated until the matching rate with the captured image becomes equal to or greater than the predetermined allowable value, so that occurrence of recognition errors is suppressed, and the burden on the operator due to manual intervention and the like and the decrease in the operation rate of the device are prevented. can do. For this reason, the positioning between the substrate and the component can be performed reliably and efficiently.

[Brief description of the drawings]

FIG. 1 is a diagram showing an overall configuration of an embodiment of a component mounting apparatus according to the present invention.

FIG. 2 is a view for explaining an imaging area of the imaging camera shown in FIG. 1;

FIG. 3 is a block diagram showing a main part of the component mounting apparatus shown in FIG. 1;

FIG. 4 is a view for explaining an example of a method of teaching in advance a pattern to be detected in the component mounting apparatus shown in FIG. 1;

FIG. 5 is a view for explaining another example of a method of teaching a pattern to be detected in advance in the component mounting apparatus shown in FIG. 1;

FIG. 6 is a view for explaining how to teach a desired pattern on a monitor screen.

FIG. 7 is a view showing an example of a pattern to be recognized displayed on a monitor screen (when a recognition error has occurred).

[Explanation of symbols]

 Reference Signs List 1 cell (substrate) 2 cell mark 3 cell lead 3L left cell lead part (first mark) 3R right cell lead part (first mark) 4 TAB (part) 5 TAB lead 5L left TAB lead part (second mark) 5R right TAB lead Unit (second mark) 6 First stage 7 Second stage 10 Image processing device 11 Monitor 12a, 12b, 12c Imaging camera (Imaging device) 13 Image input unit 14 Reference pattern registration unit 15 Inspection pattern registration unit 16 Specification candidate update Unit 17 designated candidate extracting unit 18 comparing unit 19 control unit 20 controller 21 operation panel 22 crimping device 41, 42, ..., 4n reference pattern

Claims (4)

[Claims] 1. A component mounting apparatus for mounting a component on a substrate, comprising: an imaging device for imaging an area of the substrate or the component including a positioning mark; and By teaching a plurality of reference patterns corresponding to the marks and performing a matching process between the taught plurality of reference patterns and an image captured by the imaging device, the substrate or the component has An image processing device that detects the position of the mark, and a positioning device that performs positioning between the substrate and the component based on the position of the mark detected by the image processing device. Characteristic component mounting equipment. 2. The image processing apparatus according to claim 1, wherein a plurality of patterns of different portions in the same mark in the same board or component are registered as the plurality of reference patterns, and the plurality of registered patterns are sequentially taken out. 2. The component mounting apparatus according to claim 1, wherein the matching process is repeated until a matching ratio between the extracted pattern and an image captured by the image capturing apparatus is equal to or greater than a predetermined allowable value. 3. The image processing apparatus registers a plurality of patterns of the same type of mark in different types of substrates or components as the plurality of reference patterns, sequentially retrieves the registered plurality of patterns, and retrieves the retrieved plurality of patterns. Pattern and
2. The component mounting apparatus according to claim 1, wherein the matching process is repeatedly performed until a matching ratio with a captured image captured by the imaging device is equal to or more than a predetermined allowable value. 4. The image processing apparatus according to claim 1, wherein each of the plurality of patterns holds an allowable value of a matching ratio.
The component mounting apparatus according to claim 2, wherein the image processing apparatus repeatedly performs the matching processing based on the held content.