CN107390449A - Lighting device and check device - Google Patents
Lighting device and check device Download PDFInfo
- Publication number
- CN107390449A CN107390449A CN201710348546.XA CN201710348546A CN107390449A CN 107390449 A CN107390449 A CN 107390449A CN 201710348546 A CN201710348546 A CN 201710348546A CN 107390449 A CN107390449 A CN 107390449A
- Authority
- CN
- China
- Prior art keywords
- light
- projector
- pattern
- projection
- illumination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000005286 illumination Methods 0.000 claims abstract description 62
- 238000003384 imaging method Methods 0.000 claims description 48
- 238000007689 inspection Methods 0.000 claims description 35
- 230000003287 optical effect Effects 0.000 claims description 24
- 238000012360 testing method Methods 0.000 claims description 14
- 230000001678 irradiating effect Effects 0.000 abstract description 8
- 239000000758 substrate Substances 0.000 description 33
- 230000006870 function Effects 0.000 description 19
- 238000012545 processing Methods 0.000 description 8
- 238000012546 transfer Methods 0.000 description 7
- 238000005259 measurement Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 229910000679 solder Inorganic materials 0.000 description 5
- 238000000034 method Methods 0.000 description 4
- 230000000052 comparative effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 238000009792 diffusion process Methods 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000003028 elevating effect Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/02—Illuminating scene
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
本发明使照明装置以简易的装置结构具备照明功能和图案投影功能。对拍摄装置(20)的拍摄对象(O)进行照明的照明装置(30)设为下述结构,具有:投影器(35),其照射光;以及分光器(37),其将来自投影器的光引导至拍摄对象,将投影器的光切换为有投影图案的投影光和无投影图案的照明光。通过利用投影器产生投影光,由此能够对投影至拍摄对象的投影图案进行拍摄,通过利用投影器产生照明光,由此能够在利用照明光对拍摄对象进行照明的状态下进行拍摄。
The invention enables the illuminating device to have the illuminating function and the pattern projecting function with a simple device structure. The illuminating device (30) for illuminating the object (O) of the photographing device (20) is configured as follows, and has: a projector (35) for irradiating light; The light from the projector is directed to the subject, and the light from the projector is switched between projected light with a projected pattern and illumination light without a projected pattern. By generating projection light with the projector, it is possible to photograph a projection pattern projected onto the subject, and by generating illumination light with the projector, it is possible to photograph the subject illuminated by the illumination light.
Description
技术领域technical field
本发明涉及对拍摄对象进行照明的照明装置及检查装置。The present invention relates to an illumination device and an inspection device for illuminating an object to be photographed.
背景技术Background technique
当前,作为对拍摄照相机的拍摄对象进行照明的照明装置,已 知从正上方对拍摄对象进行照明的照明装置(例如,参照专利文献 1)。在专利文献1记载的照明装置中,针对拍摄照相机的正下方的 半透半反镜,通过面发光型的光源而从水平方向照射光。来自光源的 光的朝向由半透半反镜向正下方反射,由此从与拍摄照相机的光轴相 同的方向对拍摄对象进行照明。而且,被拍摄对象反射的光透过半透 半反镜而被引导至拍摄照相机,从而通过拍摄照相机而使用同轴落射 照明对拍摄对象的表面进行拍摄。Currently, as an illumination device for illuminating an object to be photographed by a photographing camera, an illumination device for illuminating an object to be photographed from directly above is known (for example, refer to Patent Document 1). In the lighting device described in Patent Document 1, light is irradiated from a horizontal direction by a surface-emission light source to a half mirror directly under an imaging camera. The direction of light from the light source is reflected directly downward by the half mirror, thereby illuminating the subject from the same direction as the optical axis of the photographing camera. And, the light reflected by the subject is guided to the photographing camera through the half mirror, so that the surface of the subject is photographed by the photographing camera using coaxial epi-illumination.
专利文献1:日本特开2014-134525号公报Patent Document 1: Japanese Patent Laid-Open No. 2014-134525
近几年,在如上所述的对拍摄对象的照明中,要求使用了投影 器的图案投影。为了通过照明装置而实现图案投影,需要在与同轴落 射用的光源相同的光路上配置投影器,但难以将这些光源和投影器配 置为相互不干涉。因此,不得不设为分别准备同轴照明用的拍摄装置 和图案投影用的拍摄装置,或者针对照明装置替代同轴落射用的光源 而换装投影器,存在拍摄装置的装置结构变得复杂的问题。In recent years, pattern projection using a projector has been required for illuminating a subject as described above. In order to realize pattern projection by the illuminating device, it is necessary to arrange a projector on the same optical path as the light source for coaxial projection, but it is difficult to arrange these light sources and the projector so that they do not interfere with each other. Therefore, it is necessary to separately prepare an imaging device for coaxial illumination and an imaging device for pattern projection, or replace the light source for coaxial projection with a projector for the illumination device, and the device structure of the imaging device becomes complicated. question.
发明内容Contents of the invention
本发明就是鉴于该问题而提出的,其目的在于提供一种照明装 置及检查装置,其以简易的装置结构具备照明功能和图案投影功能。The present invention has been made in view of this problem, and an object of the present invention is to provide a lighting device and an inspection device that have a lighting function and a pattern projection function with a simple device structure.
本发明的照明装置,其对拍摄装置的拍摄对象进行照明,该照 明装置的特征在于,具有:投影器,其照射光;以及光学系统,其将 来自所述投影器的光引导至所述拍摄对象,能够将所述投影器的光切 换为有投影图案的投影光和无投影图案的照明光。A lighting device according to the present invention, which illuminates an object to be photographed by a photographing device, includes: a projector for irradiating light; and an optical system for guiding the light from the projector to the photographing device. Object, it is possible to switch the light of the projector into projection light with a projected pattern and illumination light without a projected pattern.
根据该结构,通过从投影器照射有投影图案的投影光,从而能 够对经过光学系统而投影至拍摄对象的投影图案进行拍摄。另外,通 过从投影器照射无投影图案的照明光,从而能够在经过光学系统而利 用照明光对拍摄对象进行照明的状态下进行拍摄。如上所述,通过将 投影器作为照明光源使用,从而能够以简易的结构而使照明装置具备 照明功能和图案投影功能。According to this configuration, by irradiating projection light with the projection pattern from the projector, it is possible to capture the projection pattern projected onto the subject through the optical system. In addition, by irradiating illumination light without a projected pattern from the projector, imaging can be performed in a state where the subject is illuminated by the illumination light passing through the optical system. As described above, by using a projector as an illumination light source, it is possible to provide an illumination device with an illumination function and a pattern projection function with a simple structure.
在上述的照明装置中,所述光学系统将来自所述投影器的光从 与所述拍摄装置的光轴同轴的方向引导至所述拍摄对象。根据该结 构,能够使照明装置以简易的结构具备同轴落射照明功能和图案投影 功能。In the lighting device described above, the optical system guides the light from the projector to the subject from a direction coaxial with an optical axis of the imaging device. According to this configuration, the illuminating device can be provided with a coaxial epi-illumination function and a pattern projection function with a simple structure.
在上述的照明装置中,所述投影器投影所述拍摄装置的校准用 的测试图而作为投影图案。根据该结构,使用投影图案进行校准,因 此不需要专用工具,并且能够降低成本。另外,测试图的变更也容易。In the lighting device described above, the projector projects a test chart for calibration of the imaging device as a projection pattern. According to this configuration, calibration is performed using the projected pattern, so that a special tool is not required and cost can be reduced. In addition, it is also easy to change the test pattern.
在上述的照明装置中,所述投影器是DLP(Digital Light Processing)投影器,利用全部DMD(Digital Micromirror Device) 元件一律地使来自光源的光反射,照射无投影图案的照明光。根据该 结构,通过对DMD元件进行控制,从而能够产生无投影图案的照明光,对拍摄对象进行照明。In the lighting device described above, the projector is a DLP (Digital Light Processing) projector that uniformly reflects light from a light source by all DMD (Digital Micromirror Device) elements, and emits illumination light without a projected pattern. According to this configuration, by controlling the DMD element, it is possible to generate illumination light without a projected pattern and illuminate an object to be photographed.
本发明的检查装置,其特征在于,具有:上述的照明装置;拍 摄装置,其对利用所述照明装置照明的拍摄对象进行拍摄;以及控制 装置,其基于利用所述拍摄装置拍摄出的拍摄图像,对拍摄对象进行 检查。根据该结构,能够通过具有照明功能和图案投影功能的照明装 置而将检查装置设为简易的装置结构。The inspection device of the present invention is characterized by comprising: the above-mentioned lighting device; an imaging device for imaging an object illuminated by the lighting device; to check the subject. According to this configuration, the inspection device can be provided with a simple device configuration by using the lighting device having the lighting function and the pattern projection function.
发明的效果The effect of the invention
根据本发明,通过利用投影器对有投影图案的投影光和无投影 图案的照明光进行切换而进行照射,从而能够以简易的结构使照明装 置具备照明功能和图案投影功能。According to the present invention, by switching and irradiating projection light with a projected pattern and illumination light without a projected pattern by a projector, it is possible to provide an illuminating device with an illuminating function and a pattern projecting function with a simple structure.
附图说明Description of drawings
图1是本实施方式的检查装置的斜视图。FIG. 1 is a perspective view of an inspection device according to this embodiment.
图2是对比例的照明装置的示意图。Fig. 2 is a schematic diagram of a lighting device of a comparative example.
图3是本实施方式的拍摄头的斜视图。FIG. 3 is a perspective view of the imaging head of this embodiment.
图4是本实施方式的照明装置的示意图。FIG. 4 is a schematic diagram of the lighting device of the present embodiment.
图5是本实施方式的校准动作及检查动作的说明图。FIG. 5 is an explanatory diagram of a calibration operation and an inspection operation in the present embodiment.
标号的说明Explanation of labels
1 检查装置1 Inspection device
15 拍摄头15 cameras
20 拍摄装置20 filming device
30 照明装置30 lighting fixtures
35 投影器35 projectors
37 分光器(光学系统)37 beam splitter (optical system)
41 光源41 light source
43 DMD元件43 DMD components
44 DMD控制器44 DMD controller
50 控制装置50 Controls
具体实施方式detailed description
下面,参照附图,对本发明的实施方式的检查装置进行说明。 图1是本实施方式的检查装置的斜视图。此外,本实施方式的检查装 置只不过是一个例子,能够适当变更。Next, an inspection device according to an embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a perspective view of an inspection device according to this embodiment. In addition, the inspection device of this embodiment is merely an example and can be changed as appropriate.
如图1所示,检查装置1在生产线中配置在印刷装置(未图示) 或安装装置(未图示)的下游,该检查装置1构成为,对由拍摄头 15拍摄到的拍摄图像实施图像处理,对基板W上的焊料的印刷状态、 部件的安装状态进行检查。检查装置1可以配置在生产线的任何位置,但在下面的说明中设为对针对基板W的回流焊处理后的焊料的 印刷状态、部件的安装状态进行检查的检查装置而进行说明。在检查 装置1中配置有在X轴方向上输送基板W的基板输送装置10,通过 基板输送装置10而使基板W定位于检查位置。As shown in FIG. 1 , an inspection device 1 is disposed downstream of a printing device (not shown) or a mounting device (not shown) in a production line, and the inspection device 1 is configured to perform The image processing inspects the printed state of the solder on the substrate W and the mounted state of components. The inspection device 1 may be installed anywhere in the production line, but in the following description, it will be described as an inspection device for inspecting the printed state of solder and the mounted state of components on the substrate W after the reflow process. In the inspection apparatus 1, a substrate transfer device 10 for transferring the substrate W in the X-axis direction is arranged, and the substrate W is positioned at the inspection position by the substrate transfer device 10.
基板输送装置10利用对基板W进行输送的一对传送带11和沿 各传送带11对基板W的输送进行引导的输送引导部12而形成输送 路径。一对传送带11安装在一对输送引导部12的相对的内侧面,各 输送引导部12通过多个脚部13从下方被支撑。传送带11从X轴方 向的一端侧向检查位置搬入基板W,将检查后的基板W向X轴方向 的另一端侧搬出。另外,一对输送引导部12的上部朝向内侧地弯折, 通过升降机构(未图示)经由传送带11使基板W上下移动,通过基 板W被该弯折部分按压,从而基板W被定位在检查位置。The substrate transfer device 10 forms a transfer path by a pair of conveyor belts 11 for transferring the substrate W and a transfer guide 12 for guiding the transfer of the substrate W along the respective transfer belts 11 . A pair of conveyor belts 11 is mounted on opposite inner surfaces of a pair of conveyance guides 12, and each conveyance guide 12 is supported by a plurality of legs 13 from below. The conveyor belt 11 carries in the substrate W to the inspection position from one end side in the X-axis direction, and carries out the inspected substrate W to the other end side in the X-axis direction. In addition, the upper parts of the pair of conveyance guides 12 are bent inwardly, and the substrate W is moved up and down via the conveyor belt 11 by an elevating mechanism (not shown). Location.
拍摄头15通过移动机构(未图示)而定位在已定位于检查位置 的基板W上的上方,在利用照明装置30对成为拍摄对象的基板W 进行了照明的状态下通过拍摄装置20对基板W的检查面进行拍摄。 拍摄头15的移动机构构成为使拍摄头15在X轴方向及Y轴方向上 水平移动,例如,由滚珠丝杠式的驱动机构或齿轮齿条式的驱动机构 构成。拍摄头15由例如CCD(Charge Coupled Device)传感器、CMOS (Complementary Metal Oxide Semiconductor)传感器等拍摄元件和 透镜等光学系统构成。The imaging head 15 is positioned above the substrate W positioned at the inspection position by a moving mechanism (not shown), and the imaging device 20 illuminates the substrate W to be photographed by the illumination device 30 . W's inspection surface is photographed. The moving mechanism of the imaging head 15 is configured to horizontally move the imaging head 15 in the X-axis direction and the Y-axis direction, and is, for example, a ball screw type driving mechanism or a rack and pinion type driving mechanism. The imaging head 15 is composed of, for example, an imaging element such as a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, and an optical system such as a lens.
照明装置30能够从与拍摄装置20的光轴相同的方向对基板W 进行照明,并且能够从与拍摄装置20的光轴交叉的倾斜方向对基板 W进行照明。在该情况下,在照明装置30设置有圆顶状的遮光部34, 在遮光部34的内侧设置有相对于基板W的检查面的照射角度不同的 3个种类的照明39a-39c(参照图4)。在拍摄头15中,通过与基 板W的检查部位的焊料、部件相对应地,对通过照明装置30实现的 照明方向进行适当切换或组合,由此能够利用拍摄装置20得到对比 度明确的拍摄图像。The illuminating device 30 can illuminate the substrate W from the same direction as the optical axis of the imaging device 20, and can illuminate the substrate W from an oblique direction intersecting the optical axis of the imaging device 20. In this case, the illuminating device 30 is provided with a dome-shaped light-shielding portion 34, and inside the light-shielding portion 34 are provided three types of illuminations 39a-39c (see FIG. 4). In the imaging head 15, by appropriately switching or combining the direction of illumination by the illuminating device 30 corresponding to the solder and components of the inspected portion of the substrate W, the imaging device 20 can obtain a captured image with clear contrast.
在检查装置1中设置有对装置各部进行综合控制的控制装置 50。控制装置50由执行各种处理的处理器、存储器等构成。存储器 是对应于用途而由ROM(Read Only Memory)、RAM(Random Access Memory)等一个或多个存储介质构成的。另外,在存储器中存储有 针对基板W的检查程序、后面记述的拍摄装置20的校准(透镜校正) 用的程序等。在如上所述的检查装置1中,来自拍摄装置20的拍摄 图像输入至控制装置50,利用控制装置50实施图案匹配等各种图像 处理,由此对基板W进行检查。The inspection device 1 is provided with a control device 50 for comprehensively controlling each part of the device. The control device 50 is constituted by a processor, a memory, and the like that execute various processes. The memory is composed of one or more storage media such as ROM (Read Only Memory) and RAM (Random Access Memory) according to the application. In addition, an inspection program for the substrate W, a program for calibration (lens correction) of the imaging device 20 described later, and the like are stored in the memory. In the inspection device 1 as described above, the captured image from the imaging device 20 is input to the control device 50, and the control device 50 performs various image processing such as pattern matching, thereby inspecting the substrate W.
另外,对于照明装置30,作为除了照明以外的功能而要求校准 的测试图、3D测量用的条纹图案等除了照明以外的功能。如图2的 对比例所示,在通常的同轴照明用的照明装置61中,在拍摄装置62 的正下方配置有分光器63,在分光器63的侧方配置有扩散板64及照明基板65。在照明装置61中,来自照明基板65的从水平方向照 射的光被扩散板64扩散而向分光器63射入,光被分光器63向与拍 摄装置62的光轴相同的方向反射,从正上方对拍摄对象O进行照明。In addition, the illumination device 30 requires functions other than illumination, such as a test chart for calibration and a fringe pattern for 3D measurement, as functions other than illumination. As shown in the comparative example of FIG. 2 , in an illumination device 61 for general coaxial illumination, a beam splitter 63 is arranged directly below the imaging device 62 , and a diffusion plate 64 and an illumination substrate are arranged on the side of the beam splitter 63 . 65. In the lighting device 61, the light irradiated from the horizontal direction from the lighting substrate 65 is diffused by the diffuser plate 64 and enters the beam splitter 63. Subject O is illuminated from above.
为了使对比例的照明装置61具备图案投影功能,需要在照明装 置61以经过与照明基板65相同光路的方式安装投影器66,但在照 明基板65的光路上不能配置投影器66。因此,可想到下述结构,即, 在照明基板65形成开口,在照明基板65的背面侧安装投影器66,使来自投影器66的投影光经过照明基板65的开口而射入至分光器 63。但是,如果在照明基板65形成有开口,则不能针对拍摄对象O 均匀地进行照明,存在发生亮度不匀的问题。In order for the lighting device 61 of the comparative example to have a pattern projection function, it is necessary to install a projector 66 on the lighting device 61 through the same optical path as the lighting substrate 65, but the projector 66 cannot be arranged on the optical path of the lighting substrate 65. Therefore, a configuration is conceivable in which an opening is formed in the lighting board 65 , the projector 66 is mounted on the back side of the lighting board 65 , and the projection light from the projector 66 enters the beam splitter 63 through the opening of the lighting board 65 . . However, if the opening is formed in the illumination board 65, the subject O cannot be uniformly illuminated, and there is a problem that uneven brightness occurs.
因此,在本实施方式的照明装置30中,将投影器35的光在有 投影图案的投影光和无投影图案的照明光之间进行切换,不仅将投影 器35的光源41(参照图4)用作图案投影,还用作同轴落射照明用 的光源。由此,通过照射有投影图案的投影光,从而能够对校准用的 测试图、3D测量用的条纹图案进行投影。另外,无需在照明装置30 设置照明基板65、扩散板64,能够利用无投影图案的照明光对拍摄 对象O均匀地进行同轴落射照明。Therefore, in the lighting device 30 of this embodiment, the light of the projector 35 is switched between projection light with a projected pattern and illumination light without a projected pattern, and not only the light source 41 of the projector 35 (see FIG. 4 ) Used for pattern projection and also as a light source for coaxial epi-illumination. Thus, by irradiating the projection light with the projection pattern, it is possible to project a test chart for calibration and a fringe pattern for 3D measurement. In addition, it is not necessary to provide the illumination board 65 and the diffusion plate 64 in the illumination device 30, and it is possible to uniformly perform coaxial epi-illumination on the subject O with illumination light without a projected pattern.
下面,参照图3及图4,对本实施方式的照明装置详细地进行说 明。图3是本实施方式的拍摄头的斜视图。图4是本实施方式的照明 装置的示意图。此外,图3及图4的拍摄头及照明装置只不过是一个 例子,能够适当变更。Next, the lighting device according to this embodiment will be described in detail with reference to Fig. 3 and Fig. 4 . FIG. 3 is a perspective view of the imaging head of this embodiment. Fig. 4 is a schematic diagram of the lighting device of the present embodiment. In addition, the imaging head and the lighting device shown in Fig. 3 and Fig. 4 are merely examples and can be changed as appropriate.
如图3所示,拍摄头15是在可移动地设置于移动机构(未图示) 的可动板17的表面安装拍摄装置20和照明装置30而构成的。照明 装置30的装置壳体是由与拍摄装置20的透镜壳体21抵接的中空的 筒状壳体31、和在筒状壳体31的下方收容分光器37(参照图4)的箱型的分光器壳体32形成的。在分光器壳体32的一侧面抵接投影器 35的透镜壳体36,在分光器壳体32的下方,在可动板17的表面经 由一对托架33而安装有圆顶状的遮光部34。As shown in FIG. 3 , the imaging head 15 is constituted by mounting an imaging device 20 and an illuminating device 30 on the surface of a movable plate 17 movably provided on a moving mechanism (not shown). The device casing of the lighting device 30 is a box-shaped hollow cylindrical casing 31 that is in contact with the lens casing 21 of the imaging device 20, and a beam splitter 37 (see FIG. 4 ) is accommodated under the cylindrical casing 31. The splitter housing 32 is formed. The lens housing 36 of the projector 35 is abutted against one side of the beam splitter housing 32 , and a dome-shaped light shielding device is installed on the surface of the movable plate 17 under the beam splitter housing 32 via a pair of brackets 33 . Section 34.
如图4所示,照明装置30将从投影器35照射的光经过作为光 学系统的分光器37而向拍摄对象O引导,对拍摄对象O进行照明。 投影器35是所谓的DLP(Digital LightProcessing)投影器,将来自 光源41的光利用聚光透镜42进行聚光,被多个DMD(DigitalMicromirror Device)元件43反射,产生投影光、照明光。在投影器 35设置有对多个DMD元件43的驱动进行控制的DMD控制器44, 与输入至DMD控制器44的图像图案相对应地对DMD元件43的驱 动进行控制。As shown in FIG. 4 , the lighting device 30 guides the light irradiated from the projector 35 to the subject O through a beam splitter 37 as an optical system, and illuminates the subject O. The projector 35 is a so-called DLP (Digital Light Processing) projector that condenses light from a light source 41 with a condenser lens 42 and is reflected by a plurality of DMD (Digital Micromirror Device) elements 43 to generate projection light and illumination light. The projector 35 is provided with a DMD controller 44 that controls the driving of a plurality of DMD elements 43, and the driving of the DMD elements 43 is controlled in accordance with an image pattern input to the DMD controller 44.
通过将图像图案读入至DMD控制器44,从而利用多个DMD 元件43形成与图像图案对应的投影图案。具体地说,如果通过DMD 控制器44而将DMD元件43控制为ON,则来自光源41的光朝向投 影透镜45被反射。另外,如果通过DMD控制器44而将DMD元件 43控制为OFF,则来自光源41的光朝向从投影透镜45偏离的光吸 收板(未图示)被反射。通过使该DMD元件43的ON/OFF的切换 速度局部地可变而产生光的浓淡,从而形成投影图案。By reading the image pattern into the DMD controller 44 , a projection pattern corresponding to the image pattern is formed by the plurality of DMD elements 43 . Specifically, when the DMD element 43 is controlled to be ON by the DMD controller 44, the light from the light source 41 is reflected toward the projection lens 45. In addition, when the DMD element 43 is controlled to be OFF by the DMD controller 44, the light from the light source 41 is reflected toward a light absorbing plate (not shown) deviated from the projection lens 45 . By locally varying the ON/OFF switching speed of the DMD element 43, light intensity is generated to form a projected pattern.
例如,如果作为图像图案而将有图案图像输入至DMD控制器 44,则通过将多个DMD元件43的ON/OFF分别进行控制,从而根 据光源41的光形成有投影图案的投影光。另外,如果作为图像图案 而将无图案图像(无图形图像)读入至DMD控制器44,则通过使 全部DMD元件43的ON/OFF的定时一致而同时地进行控制,从而 根据光源41的光形成无投影图案的照明光。此时,通过对ON/OFF 的切换速度进行调节,由此能够对亮度(光量)进行调整。For example, if a patterned image is input to the DMD controller 44 as an image pattern, the ON/OFF of the plurality of DMD elements 43 are individually controlled to form projected light of a projected pattern according to the light from the light source 41. In addition, if a non-pattern image (no graphic image) is read into the DMD controller 44 as an image pattern, the ON/OFF timings of all the DMD elements 43 are controlled simultaneously so that the light from the light source 41 Forms illuminating light without a projected pattern. At this time, by adjusting the switching speed of ON/OFF, it is possible to adjust the luminance (the amount of light).
另外,在投影器35设置有USB存储器、SD卡等外部存储介质 用的插槽46。在投影器35的插槽46装备外部存储介质,将外部存 储介质内的图像图案读入至DMD控制器44,对DMD元件43进行 控制。此外,图像图案并不限定于从外部存储介质读入的结构,也可 以准备于DMD控制器44的内部存储器,也可以通过无线通信或有 线通信而从外部装置输入。另外,也能够通过使来自光源41的光透 过色轮,从而形成带颜色的投影光、照明光。In addition, the projector 35 is provided with a slot 46 for an external storage medium such as a USB memory or an SD card. The slot 46 of the projector 35 is equipped with an external storage medium, and the image pattern in the external storage medium is read into the DMD controller 44 to control the DMD element 43. In addition, the image pattern is not limited to the configuration read from an external storage medium, and may be prepared in the internal memory of the DMD controller 44, or may be input from an external device through wireless communication or wired communication. In addition, it is also possible to form colored projection light and illumination light by passing the light from the light source 41 through the color wheel.
在分光器壳体32内收容有分光器37,将来自投影器35的水平 方向的光利用分光器37朝向拍摄对象O进行反射,并且利用分光器 37使来自拍摄对象O的反射光朝向拍摄装置20透过。此外,在本实 施方式中作为光学系统而例示出分光器37,但只要是将来自投影器 35的光向拍摄对象O引导的结构即可。例如,作为光学系统也可以 使用半透半反镜或棱镜等分光元件而替代分光器37,也可以在分光 元件的基础上使用透镜、反射镜等其他光学部件。A spectroscope 37 is accommodated in the spectroscope housing 32, and the light in the horizontal direction from the projector 35 is reflected toward the object O by the spectroscope 37, and the reflected light from the object O is directed toward the imaging device by the spectroscope 37. 20 through. In addition, although the beam splitter 37 is shown as an example of the optical system in this embodiment, any structure that guides the light from the projector 35 to the subject O may be used. For example, instead of the beam splitter 37, a spectroscopic element such as a half mirror or a prism may be used as an optical system, or other optical components such as a lens or a mirror may be used in addition to the spectroscopic element.
在遮光部34的内侧设置有相对于拍摄对象O而倾斜地照射的上 层照明39a、中层照明39b、下层照明39c。上层照明39a、中层照明 39b、下层照明39c的照明角度各自不同,通过对这些照明39a-照 明39c和由投影器35实现的同轴落射照明适当地进行选择或组合,从而能够得到对比度明确的拍摄图像。照明装置30及拍摄装置20 与控制装置50连接,除了对使用了图案投影的校准等进行控制之外, 还对使用了同轴落射照明的检查处理进行控制。Inside the light-shielding portion 34, there are provided an upper layer lighting 39a, a middle layer lighting 39b, and a lower layer lighting 39c that illuminate obliquely with respect to the object O to be photographed. The lighting angles of the upper lighting 39a, the middle lighting 39b, and the lower lighting 39c are different. By appropriately selecting or combining these lightings 39a-39c and the coaxial epi-illumination realized by the projector 35, it is possible to obtain photographs with clear contrast. image. The illuminating device 30 and the imaging device 20 are connected to the control device 50 , and control the inspection process using the coaxial epi-illumination in addition to the calibration using the pattern projection and the like.
在如上所述地构成的照明装置30中,来自投影器35的光源41 的光被聚光透镜42聚光而照射至多个DMD元件43,通过在多个 DMD元件43处朝向投影透镜45被反射的光而形成投影光、照明光。 此时,在有图案图像被读入至DMD控制器44的情况下,对各个DMD 元件43分别进行控制,将有投影图案的投影光从投影透镜45射出。 另外,在无图案图像被读入至DMD控制器44的情况下,将全部DMD 元件43一律地进行控制,将无投影图案的照明光从投影透镜45射出。In the lighting device 30 configured as described above, the light from the light source 41 of the projector 35 is condensed by the condenser lens 42, irradiated to the plurality of DMD elements 43, and is reflected toward the projection lens 45 by the plurality of DMD elements 43. The light forms projection light and illumination light. At this time, when the image with the pattern is read into the DMD controller 44 , each DMD element 43 is individually controlled, and the projection light with the projection pattern is emitted from the projection lens 45 . In addition, when the non-pattern image is read into the DMD controller 44 , all the DMD elements 43 are uniformly controlled, and the illumination light without the projected pattern is emitted from the projection lens 45 .
另外,透过投影透镜45的投影光、照明光被分光器37向与拍 摄装置20的光轴同轴的方向反射,相对于拍摄对象O从正上方射入。 投影光、照明光被拍摄对象O反射,反射光透过分光器37而射入至 拍摄装置20,由此对拍摄对象O进行拍摄。如上所述,通过利用投 影器35产生有投影图案的投影光和无投影图案的照明光,从而使照 明装置30除了具备同轴落射照明功能之外,同时还具备图案投影功 能。另外,图案投影时的投影光和同轴落射照明时的照明光经过同一 光路,因此能够设为简易的装置结构。The projection light and illumination light transmitted through the projection lens 45 are reflected by the beam splitter 37 in a direction coaxial with the optical axis of the imaging device 20, and are incident on the subject O from directly above. The projected light and the illumination light are reflected by the subject O, and the reflected light passes through the beam splitter 37 and enters the imaging device 20, whereby the subject O is photographed. As mentioned above, by using the projector 35 to generate projected light with a projected pattern and illumination light without a projected pattern, the illuminating device 30 not only has the function of coaxial epi-illumination, but also has the function of pattern projection. In addition, the projection light at the time of pattern projection and the illumination light at the time of coaxial epi-illumination pass through the same optical path, so that a simple device configuration can be achieved.
接着,参照图5,对校准动作及检查动作进行说明。图5是本实 施方式的校准动作及检查动作的说明图。此外,以下所示的校准动作 及检查动作表示一个例子,能够适当变更。另外,在这里对使用了投 影图案的校准进行说明,但也能够使用投影图案而进行3D测量。Next, the calibration operation and the inspection operation will be described with reference to FIG. 5 . Fig. 5 is an explanatory diagram of a calibration operation and an inspection operation in the present embodiment. In addition, the calibration operation and inspection operation shown below are examples and can be changed as appropriate. In addition, the calibration using the projection pattern is described here, but it is also possible to perform 3D measurement using the projection pattern.
如图5A所示,在拍摄装置20的校准时,在拍摄装置20的拍摄 范围内作为拍摄对象O而载置无图形的板P,并且将测试图图像读入 至DMD控制器44。在DMD控制器44中对应于测试图图像而将DMD 元件43的ON/OFF分别进行控制。而且,来自投影器35的光源41 的光经过聚光透镜42而照射至DMD元件43,通过从DMD元件43 朝向投影透镜45反射出的光,形成对校准用的测试图进行投影的投 影光。As shown in FIG. 5A , during calibration of the imaging device 20, a board P without a pattern is placed as an imaging object O within the imaging range of the imaging device 20, and a test chart image is read into the DMD controller 44. In the DMD controller 44, ON/OFF of the DMD element 43 is individually controlled according to the test chart image. Then, the light from the light source 41 of the projector 35 is irradiated to the DMD element 43 through the condenser lens 42, and the light reflected from the DMD element 43 toward the projection lens 45 forms projection light for projecting the test chart for calibration.
从投影器35的投影透镜45射出的投影光被分光器37反射,从 而在作为拍摄对象的板P的表面映出测试图。如果通过拍摄装置20 拍摄板P的表面的测试图,则测试图的拍摄图像被输入至控制装置 50。在控制装置50中基于测试图的拍摄图像实施拍摄装置20的校准, 对拍摄装置20的透镜特性等的失真进行校正。由此,使用投影图案 进行校准,因此不需要专用工具,并且能够降低成本。另外,通过对 图像图案进行切换,从而测试图的变更也容易。The projection light emitted from the projection lens 45 of the projector 35 is reflected by the beam splitter 37, and a test chart is reflected on the surface of the board P to be photographed. When the test chart of the surface of the board P is photographed by the photographing device 20, the photographed image of the test chart is input to the control device 50. Calibration of the imaging device 20 is performed based on the captured image of the test chart in the control device 50 , and distortions such as lens characteristics of the imaging device 20 are corrected. In this way, since calibration is performed using the projected pattern, special tools are not required, and costs can be reduced. In addition, changing the test pattern is also easy by switching the image pattern.
如图5B所示,在基板W的检查时,在拍摄装置20的拍摄范围 内定位作为拍摄对象O的基板W的检查位置,并且将无图案的白色 图像读入至DMD控制器44。在DMD控制器44中对应于白色图像 而将DMD元件43的ON/OFF一律地进行控制。而且,来自投影器 35的光源41的光经过聚光透镜42而照射至DMD元件43,通过从 DMD元件43朝向投影透镜45反射出的光形成不显示投影图案的照 明光。此外,也可以为了提高亮度而将DMD元件43控制为始终为ON。As shown in FIG. 5B , during the inspection of the substrate W, the inspection position of the substrate W as the imaging object O is positioned within the imaging range of the imaging device 20, and a white image without a pattern is read into the DMD controller 44. In the DMD controller 44, ON/OFF of the DMD element 43 is uniformly controlled corresponding to a white image. Then, the light from the light source 41 of the projector 35 is irradiated to the DMD element 43 through the condensing lens 42, and the light reflected from the DMD element 43 toward the projection lens 45 forms illumination light that does not display a projected pattern. In addition, the DMD element 43 may be controlled to always be ON in order to increase brightness.
从投影器35的投影透镜45射出的照明光被分光器37反射,从 而从正上方对作为拍摄对象O的基板W的检查位置进行照明。如果 通过拍摄装置20拍摄基板W的检查位置,则基板W的拍摄图像被 输入至控制装置50。在控制装置50中对基板W的拍摄图像实施图 案匹配等各种图像处理,对基板W上的焊料的印刷状态、部件的安 装状态进行检查。由此,无需另行设置照明光源,能够通过投影器 35产生照明光,利用同轴落射照明对基板W的检查位置进行拍摄。The illumination light emitted from the projection lens 45 of the projector 35 is reflected by the beam splitter 37 to illuminate the inspection position of the substrate W which is the imaging object O from directly above. When the inspection position of the substrate W is captured by the imaging device 20 , the captured image of the substrate W is input to the control device 50 . In the control device 50, various image processing such as pattern matching is performed on the captured image of the board W, and the printing state of the solder on the board W and the mounting state of components are inspected. Thereby, without separately providing an illumination light source, illumination light can be generated by the projector 35, and the inspection position of the substrate W can be photographed by coaxial epi-illumination.
如上所述,在投影器35中除了校准用的测试图之外,还能够对 3D测量用的条纹图案进行投影。在将投影器35在3D测量中使用的 情况下,在遮光部34的内侧等安装拍摄装置,使得从倾斜方向对映 出于拍摄对象O的投影图案进行拍摄。另外,投影器35并不限定于校准、3D测量,还能够用于其他用途。As described above, in addition to the test chart for calibration, the fringe pattern for 3D measurement can also be projected on the projector 35 . When the projector 35 is used for 3D measurement, an imaging device is installed inside the light shielding portion 34, etc., so that the projection pattern reflected on the object O is imaged from an oblique direction. In addition, the projector 35 is not limited to calibration and 3D measurement, and can be used for other purposes.
如以上所述,本实施方式的照明装置30通过从投影器35照射 有投影图案的投影光,从而能够对经过分光器37而投影至板P的投 影图案进行拍摄。另外,通过从投影器35照射无投影图案的照明光, 从而能够在经过分光器37而利用照明光进行照明的状态下对基板W 的检查位置进行拍摄。如上所述,通过将投影器35作为照明光源使 用,从而能够以简易的结构而使照明装置30具备照明功能和图案投 影功能。As described above, the illuminating device 30 of the present embodiment can capture the projection pattern projected onto the panel P through the beam splitter 37 by irradiating the projection light with the projection pattern from the projector 35. In addition, by irradiating the illumination light without the projected pattern from the projector 35 , it is possible to image the inspection position of the substrate W while being illuminated by the illumination light passing through the beam splitter 37 . As described above, by using the projector 35 as an illumination light source, the illumination device 30 can be equipped with an illumination function and a pattern projection function with a simple structure.
此外,本发明并不限定于上述实施方式,能够进行各种变更而 实施。在上述实施方式中,关于在附图中图示出的大小、形状等,并 不限定于此,在发挥本发明的效果的范围内能够进行适当变更。另外, 只要不脱离本发明的目的的范围,则能够适当变更而实施。In addition, the present invention is not limited to the above-described embodiments, and can be implemented with various changes. In the above-described embodiment, the size, shape, etc. shown in the drawings are not limited thereto, and can be appropriately changed within the scope of exerting the effects of the present invention. Moreover, unless it deviates from the scope of the objective of this invention, it can change suitably and implement.
例如,在本实施方式中,设为检查装置1具备有照明装置30的 结构,但并不限定于该结构。照明装置30也可以设置于实施拍摄处 理的加工装置,也可以在例如安装装置、印刷装置等其他加工装置中 具备。For example, in the present embodiment, the inspection device 1 is configured to include the illumination device 30, but it is not limited to this configuration. The illuminating device 30 may be installed in a processing device that performs imaging processing, or may be included in other processing devices such as a mounting device and a printing device.
另外,在本实施方式中,设为投影器35从与拍摄装置20的光 轴相同的方向进行同轴落射照明的结构,但并不限定于该结构。也可 以设为投影器35从与拍摄装置20的光轴交叉的倾斜方向进行照明的 结构。In addition, in this embodiment, the projector 35 is configured to perform coaxial epi-illumination from the same direction as the optical axis of the imaging device 20, but the configuration is not limited to this configuration. A configuration in which the projector 35 illuminates from an oblique direction intersecting the optical axis of the imaging device 20 may also be employed.
另外,在本实施方式中,对投影器35为DLP投影器的结构进 行了说明,但并不限定于该结构。投影器35只要是除了投影光之外 还能形成照明光的投影器即可,也可以是例如LCD(Liquid Crystal Display)投影器、LCOS(Liquid Crystal On Silicon)投影器。In addition, in this embodiment, the configuration in which the projector 35 is a DLP projector has been described, but it is not limited to this configuration. The projector 35 may be a projector as long as it can generate illumination light in addition to projection light, and may be, for example, an LCD (Liquid Crystal Display) projector or an LCOS (Liquid Crystal On Silicon) projector.
另外,在本实施方式中,基板W只要是能够搭载各种部件的构 件即可,并不限定于印刷基板,也可以是载置在工具基板上的柔性基 板。In addition, in the present embodiment, the substrate W is not limited to a printed circuit board as long as it can mount various components, and may be a flexible substrate placed on a tool substrate.
工业实用性Industrial Applicability
如以上说明所述,本发明具有能够以简易的装置结构具备照明 功能和图案投影功能的效果,特别是,对在焊料的印刷状态、部件的 安装状态的检查中所使用的照明装置及检查装置有效。As described above, the present invention has the effect that the lighting function and the pattern projection function can be provided with a simple device structure, especially for the lighting device and the inspection device used in the inspection of the printing state of solder and the mounting state of components. efficient.
Claims (5)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2016098718A JP2017207329A (en) | 2016-05-17 | 2016-05-17 | Illumination device and inspection device |
JP2016-098718 | 2016-05-17 |
Publications (1)
Publication Number | Publication Date |
---|---|
CN107390449A true CN107390449A (en) | 2017-11-24 |
Family
ID=60338985
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710348546.XA Withdrawn CN107390449A (en) | 2016-05-17 | 2017-05-17 | Lighting device and check device |
Country Status (2)
Country | Link |
---|---|
JP (1) | JP2017207329A (en) |
CN (1) | CN107390449A (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111562714A (en) * | 2020-05-22 | 2020-08-21 | 复旦大学 | Multispectral modulation imaging device based on multi-wavelength LED light source |
CN114136975A (en) * | 2021-11-04 | 2022-03-04 | 上海精密计量测试研究所 | Intelligent detection system and method for surface defects of microwave bare chip |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102655029B1 (en) | 2019-01-24 | 2024-04-08 | 주식회사 고영테크놀러지 | Transport mechanism for inspection device, inspection device, and object inspection method using the same |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6788401B1 (en) * | 2001-08-22 | 2004-09-07 | Seiko Epson Corporation | Lens testing device and testing sheet |
JP2005003410A (en) * | 2003-06-10 | 2005-01-06 | Kokan Keisoku Kk | Measuring device and measuring method of three-dimensional curved surface shape |
US20050157920A1 (en) * | 2004-01-21 | 2005-07-21 | John Doherty | Machine vision system and method |
TW200535587A (en) * | 2004-04-30 | 2005-11-01 | Asml Holding Nv | System and method for calculating aerial image of a spatial light modulator |
US20060066842A1 (en) * | 2004-09-30 | 2006-03-30 | Saunders Winston A | Wafer inspection with a customized reflective optical channel component |
CN101285675A (en) * | 2007-04-12 | 2008-10-15 | 三丰株式会社 | Optical measuring machine |
DE102007018048A1 (en) * | 2007-04-13 | 2008-10-16 | Michael Schwertner | Method and arrangement for optical imaging with depth discrimination |
US20090161208A1 (en) * | 2007-11-26 | 2009-06-25 | Michael Kempe | Method and Configuration for Optically Detecting an Illuminated Specimen |
CN101564795A (en) * | 2008-04-22 | 2009-10-28 | 奥林巴斯株式会社 | Correcting unit, correction method and controlling means |
US20100274392A1 (en) * | 2009-04-25 | 2010-10-28 | National Institute Of Advanced Industrial Science And Technology | Illumination apparatus and method for obtaining illuminance with high uniformity |
CN101889197A (en) * | 2007-12-06 | 2010-11-17 | 株式会社尼康 | Inspecting apparatus and inspecting method |
-
2016
- 2016-05-17 JP JP2016098718A patent/JP2017207329A/en active Pending
-
2017
- 2017-05-17 CN CN201710348546.XA patent/CN107390449A/en not_active Withdrawn
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6788401B1 (en) * | 2001-08-22 | 2004-09-07 | Seiko Epson Corporation | Lens testing device and testing sheet |
JP2005003410A (en) * | 2003-06-10 | 2005-01-06 | Kokan Keisoku Kk | Measuring device and measuring method of three-dimensional curved surface shape |
US20050157920A1 (en) * | 2004-01-21 | 2005-07-21 | John Doherty | Machine vision system and method |
TW200535587A (en) * | 2004-04-30 | 2005-11-01 | Asml Holding Nv | System and method for calculating aerial image of a spatial light modulator |
US20060066842A1 (en) * | 2004-09-30 | 2006-03-30 | Saunders Winston A | Wafer inspection with a customized reflective optical channel component |
CN101285675A (en) * | 2007-04-12 | 2008-10-15 | 三丰株式会社 | Optical measuring machine |
DE102007018048A1 (en) * | 2007-04-13 | 2008-10-16 | Michael Schwertner | Method and arrangement for optical imaging with depth discrimination |
US20090161208A1 (en) * | 2007-11-26 | 2009-06-25 | Michael Kempe | Method and Configuration for Optically Detecting an Illuminated Specimen |
CN101889197A (en) * | 2007-12-06 | 2010-11-17 | 株式会社尼康 | Inspecting apparatus and inspecting method |
CN101564795A (en) * | 2008-04-22 | 2009-10-28 | 奥林巴斯株式会社 | Correcting unit, correction method and controlling means |
US20100274392A1 (en) * | 2009-04-25 | 2010-10-28 | National Institute Of Advanced Industrial Science And Technology | Illumination apparatus and method for obtaining illuminance with high uniformity |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111562714A (en) * | 2020-05-22 | 2020-08-21 | 复旦大学 | Multispectral modulation imaging device based on multi-wavelength LED light source |
CN114136975A (en) * | 2021-11-04 | 2022-03-04 | 上海精密计量测试研究所 | Intelligent detection system and method for surface defects of microwave bare chip |
Also Published As
Publication number | Publication date |
---|---|
JP2017207329A (en) | 2017-11-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5086687B2 (en) | Laser processing equipment | |
TWI557434B (en) | Lighting system | |
US20140232850A1 (en) | Vision testing device with enhanced image clarity | |
US20110292362A1 (en) | Exposure apparatus | |
TW201321743A (en) | Automatic visual inspection device | |
KR20110027392A (en) | Vision inspection device | |
JP2005140584A (en) | Three-dimensional measuring device | |
CN106415247A (en) | Illuminating device for inspection, and inspection system | |
CN107390449A (en) | Lighting device and check device | |
KR20160025441A (en) | Lithography apparatus | |
KR20040002495A (en) | Projection exposure device and position alignment device and position alignment method | |
KR20160010364A (en) | Telecentric bright field and annular dark field seamlessly fused illumination | |
JP2018032005A (en) | Autofocus system, method and image inspection device | |
KR101340345B1 (en) | Vision inspection apparatus comprising pattern compensation function | |
KR102741957B1 (en) | Photographing apparatus for recognizing identification code | |
JP2008064656A (en) | Peripheral edge inspecting apparatus | |
JP5930284B2 (en) | Illumination apparatus, imaging apparatus, screen printing apparatus, alignment method, and substrate manufacturing method | |
TWI597474B (en) | Measuring device | |
CN105675617B (en) | Method and apparatus for measuring surface granularity of plate glass | |
TW202307941A (en) | Inspecting apparatus | |
TWI529387B (en) | Optical detection device | |
KR100955815B1 (en) | AOI device | |
KR20110008976A (en) | Vision inspection device | |
KR100576392B1 (en) | Vision inspection device | |
TWI863241B (en) | Drawing apparatus and drawing method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
WW01 | Invention patent application withdrawn after publication |
Application publication date: 20171124 |
|
WW01 | Invention patent application withdrawn after publication |