[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN103455209B - Optical sensing apparatus - Google Patents

Optical sensing apparatus Download PDF

Info

Publication number
CN103455209B
CN103455209B CN201210182994.4A CN201210182994A CN103455209B CN 103455209 B CN103455209 B CN 103455209B CN 201210182994 A CN201210182994 A CN 201210182994A CN 103455209 B CN103455209 B CN 103455209B
Authority
CN
China
Prior art keywords
light source
sensing apparatus
optical sensing
image data
light
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201210182994.4A
Other languages
Chinese (zh)
Other versions
CN103455209A (en
Inventor
陈信嘉
杨恕先
李宜方
高铭璨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pixart Imaging Inc
Original Assignee
Pixart Imaging Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixart Imaging Inc filed Critical Pixart Imaging Inc
Priority to CN201210182994.4A priority Critical patent/CN103455209B/en
Publication of CN103455209A publication Critical patent/CN103455209A/en
Application granted granted Critical
Publication of CN103455209B publication Critical patent/CN103455209B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Image Input (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

The invention discloses a kind of optical sensing apparatus, comprise: a sensing surface, position is on optical jog wheel;One first light source, in order to provide the light on this sensing surface parallel;One image sensor, position is in this optical jog wheel, in order to sense the object close to this sensing surface, to produce an object image;And an object space judgment means, position is in this optical jog wheel, in order to calculate the positional information of this object according to this object image.

Description

Optical sensing apparatus
Technical field
The present invention relates to a kind of optical sensing apparatus, sense particularly to a kind of optics using side light source Device.
Background technology
The optical sensing apparatus (such as one optical touch board) of prior art, is all to utilize a light source, by under Up irradiate the object (such as one finger) on a sensing surface, obtain the positional information of this object.
Figure 1A, 1B depict the optical sensing apparatus 100 of prior art.Figure 1A depicts optics sensing The profile of device 100, and Figure 1B depicts the electricity of optical sensing apparatus 100 its action of internal control Road block chart.Optical sensing apparatus 100 contains sensing surface 103, light source 105, image Sensor 107, lens 109,111, processor 113, storage device 115 and a light source control Unit 117.Light source 105 can be controlled light-emission operation by light source control unit 117 and irradiate position on sensing surface Finger 101 on 103 produces an image.Picture frame in image sensor 107 meeting pick-up image.Place Reason device 113 can calculate the positional information of finger 101 according to the picture frame captured.Additionally, processor 113 Also data access and the action of light source control unit 117 of storage device 115 are controlled.
But, due to be use by light from lower to upper according to mechanism, so may require that bigger component thickness. And, under such mechanism, the light of light source injection typically requires through repeatedly reflecting or reflecting, and needs relatively Complicated light path.And the signal of video signal that finger produces, after repeatedly reflecting reflection, easily make signal Decay, and cause less clear image.
Summary of the invention
Therefore, one object of the present invention is for providing a kind of optical sensing apparatus, and it uses one side light source Irradiate object.
One object of the present invention is for providing a kind of optical sensing apparatus, and it is used as outside the light source of side Light source irradiate object.
One embodiment of the invention discloses a kind of optical sensing apparatus, comprises: a sensing surface, position exists On one optical jog wheel;One first light source, in order to provide the light on this sensing surface parallel;One image sensor, Position is in this optical jog wheel, in order to sense the object close to this sensing surface, to produce an object image Data;And an object space judgment means, position is in this optical jog wheel, in order to according to this object image Data calculate the positional information of this object.
Previous embodiment can further include: a secondary light source, in order to produce a light, with this sensing table incident Face, wherein this light and the angle of this sensing normal to a surface are less than 60 degree;And a light guide plate, have At least some of transmission region, the light from this secondary light source can penetrate this transmission region to irradiate this object.
One embodiment of the invention discloses a kind of optical sensing apparatus, comprises: the casing of an optical jog wheel; One sensing surface, position is in this casing;One first light source, position is at this sensing surface side;One image passes Sensor, position is in this casing, in order to sense the object close to this sensing surface, to produce this object One object image data;And an object space judgment means, position is in this casing, in order to according to this thing Body image data calculates the positional information of this object.
Previous embodiment can further include: a secondary light source, and position is in this casing, and across this sensing surface This object relatively;And a light guide plate, there is at least some of transmission region, from this secondary light source Light can penetrate this transmission region to irradiate this object, wherein the folder of this light and this sensing normal to a surface Angle is less than 60 degree.
According to aforesaid embodiment, an available side light source irradiates object, with reduce component thickness and Object image clearly is provided, more optionally utilize a light guide plate and another light source to provide illumination, Make object image relatively sharp.
Accompanying drawing explanation
Figure 1A, 1B depict the optical sensing apparatus of prior art.
Fig. 2 A, 2B to Fig. 5 depict optical sensing apparatus according to an embodiment of the invention.
Fig. 6 A, 6B depict optical sensing apparatus according to an embodiment of the invention, it comprises Fig. 2 A, 2B Another light source outside the side light source shown in Fig. 5.
Fig. 7 A, 7B depict the component size schematic diagram of optical sensing apparatus according to an embodiment of the invention.
Wherein, description of reference numerals is as follows:
100,200,300,400,500,600 optical sensing apparatus
101,204,605 finger
103,201,401,601 sensing surface
105,203,403,604 light source
107,207 image sensor
109,111 lens
113 processors
115 storage devices
117 light source control units
202 housings
205 lens member
209 prismatic mirrors
301 pinhole device
303 pin holes
602 light guide plates
603 smooth transformational substances
Detailed description of the invention
Some vocabulary is employed to censure specific element in the middle of description and claim above.Institute Genus field has usually intellectual it is to be appreciated that hardware manufacturer may be called with different nouns Same element.This specification and claim above are not used as distinguishing element with the difference of title Mode, but with element difference functionally be used as distinguish criterion.In description in the whole text and front " comprising " mentioned in the middle of the claim in face is an open term, therefore should be construed to " comprise But it is not limited to ".
Fig. 2 A, 2B to Fig. 5 depict and use the optics of side light source to sense according to an embodiment of the invention Device.Please note that Fig. 2 A, 2B to Fig. 5 only depict the part-structure of optical sensing apparatus, know this Those skilled in the art when can according to Fig. 2 A, the description of 2B to Fig. 5 and content thereof, understand its function mode and How with known element interaction.For example, Fig. 2 A, 2B to Fig. 5 embodiment can be in conjunction with Figure 1B In circuit operate, but do not limit.And, Fig. 2 A, 2B to Fig. 5 structure only in order to illustrate, The structure of the unrestricted present invention Fig. 2 A, 2B to Fig. 5 embodiment in.
As shown in Figure 2 A, optical sensing apparatus 200 contain sensing surface 201, housing 202, One light source 203, lens member 205 and an image sensor 207.In this embodiment, sensing table Face 201 is a curved surface.Light source 203 is in housing 202, in order to provide ambient light to finger 204. Light source 203 also can be considered that the light providing parallel sensing surface 201 is to finger 204.In one embodiment, Light source 203 can be a linear light sorurce, and its upper and lower visual angle is within the scope of one, as shown in Figure 2 B, when by X-direction is hoped when light source 203, and visual angle is 90 degree around, and the upper downwards angle of visibility in the range of Y is 10 Degree.Additionally, optical sensing apparatus 200 can further include a prismatic mirror 209, make the light of light source 203 more For concentrating.
Image sensor 207 by lens member 205 according to the reflection light pick-up image from finger 204, And calculate the positional information of finger 204, this positional information by processor (such as 113 in Figure 1B) Can comprise finger static time position, or the motion track of finger.Processor more can be according to positional information Produce a control signal and control the corresponding object of on a display (such as: vernier) or relative Answer action (such as scrolling picture or translation picture).Lens member 205 can be wide-angle lens, fish eye lens Deng, depending on the different demands when design.Lens member 205 is alternatively a pinhole device 301, such as Fig. 3 Shown in.In figure 3, image sensor 207 is comprised in pinhole device 301, and by a pin hole 303 receive the reflection light from finger 204.
It is noted that the purpose of image sensor pick-up image is obtaining object image data, finally use To calculate positional information.And object image data can have many kenels, the most whole image former Beginning data, object (finger in such as embodiment) data, object center of gravity data etc., these data All relevant to the position of object, the mechanism that can will determine that when designing hardware is arranged on image sensor, The mechanism that can also will determine that is arranged on a processor, or the host computer system being connected with processor On.That is, image sensor, processor or the host computer system being connected with processor, Use as an object space judgment means.Object center of gravity data is by the object acquired by image sensor Data Integration, calculates and obtains a center of gravity data, in order to represent whole object.
Fig. 4 depicts optical sensing apparatus 400 according to another embodiment of the present invention.Optics sensing dress The difference putting the optical sensing apparatus 200 shown in 400 and Fig. 2 A is, optical sensing apparatus 400 Sensing surface 401 is plane, and the sensing surface 201 of optical sensing apparatus 200 is curved surface.Additionally, The light source 403 of optical sensing apparatus 400 be position outside housing 202, and the light of optical sensing apparatus 200 Source 203 is that position is in housing 202.Other technical characteristic of the optical sensing apparatus 400 of Fig. 4 and Fig. 2 A Optical sensing apparatus 200 identical, therefore do not repeat them here.Additionally, the optical sensing apparatus 400 of Fig. 4 Lens member 205 also can be by pinhole device 301 replacement, as shown in Figure 5.
As it was previously stated, image sensor is capturing after the image data of finger, processor can be according to these Image data calculates the positional information of finger or object.One of which calculation is, first with light Light source is opened by source control unit (such as 117 in Fig. 1), to obtain light source unlatching object image data, Light source now is opened object image data and is contained the thing under the light sent by ambient light and light source irradiates Body image.Then, utilize light source control unit to be closed by light source, to obtain another light source closedown object shadow As data, light source now is closed object image data and is contained the object image under only being irradiated by ambient light. Difference object image data are obtained, these difference object image data after being subtracted each other by this two articles image data Represent the object image under the light only sent by light source irradiates, the most accurate.The most just may utilize Processor calculates the positional information of finger according to these difference object image data.
In addition to aforesaid lateral light source, another non-side can be further included according to the optical sensing apparatus of the present invention To light source help illumination, make object image become apparent from.Fig. 6 A, 6B depict according to the present invention The optical sensing apparatus 600 of embodiment, it comprises outside the side light source shown in Fig. 2 A, 2B to Fig. 5 Another light source.As shown in Figure 6A, optical sensing apparatus 600 contains sensing surface 601, leaded light Plate 602 and a light source 604.Light guide plate 602 has at least some of transmission region, makes from light source The light of 604 can penetrate transmission region to irradiate finger 605.This transmission region can be by light guide plate 602 Upper painting lighting conversion material 603 is formed.General light guide plate, after light incidence, can make light shape within it Become total reflection.But after being coated with lighting conversion material 603, total reflection can be destroyed and make luminous energy penetrate light guide plate 602. In one embodiment, it is less than from the light of light source 604 and the angle theta of the normal on sensing surface 601 60 degree.Fig. 6 B then depicts light conversion material 603 and is coated on the top view on light guide plate 602.Fig. 6 A And the structure shown in Fig. 6 B can individually be used in optical sensing apparatus, it is possible to combine Fig. 2 A, 2B extremely The embodiment of Fig. 5, its circuit block diagram also can arranged in pairs or groups in Figure 1B operates in addition.
Fig. 7 A, 7B depict the component size signal of optical sensing apparatus according to an embodiment of the invention Figure.In Fig. 7 A, 7B, it is to explain as a example by Fig. 4.As shown in Figure 7 A, sensing surface 401 Having the rectangle of width X and length Y, therefore its catercorner length Z isIn this embodiment In, X is 3 times of Y, but does not limit.Fig. 7 B then depicts sensing surface 401, lens member 205 and image sensor 207 between relation.The maximum sense of image sensor 207 in this embodiment Survey scope is designed to sense catercorner length Z.The value of P, Q, R is then and lens focus, camera lens Position, size and the needed component thickness of Z are relevant.Know this those skilled in the art when may know how root Calculate needed data according to teachings of the present invention according to different demands, therefore do not repeat them here.
In the aforementioned embodiment, the present invention is substituted for idler wheel mechanism common in current mouse product, And use as an optical jog wheel.That is, aforesaid sensing surface, the first light source, image sensor And object space judgment means constitutes an optical jog wheel.When as an optical jog wheel, the present invention In addition to replacing the action of the tradition front rolling of idler wheel mechanism and rear rolling, moreover it is possible to simply press and gesture Detecting, can trigger more order, for user.
It is noted that, although previous embodiment all illustrates with optical touch control apparatus, but the present invention provides Content also can be used on the optical navigator of optical mouse etc.
According to aforesaid embodiment, an available side light source irradiates object, with reduce component thickness and Object image clearly is provided, more optionally utilize a light guide plate and another light source to provide illumination, Make object image relatively sharp.
The foregoing is only the preferred embodiments of the present invention, be not limited to the present invention, for this For the technical staff in field, the present invention can have various modifications and variations.All spirit in the present invention and Within principle, any modification, equivalent substitution and improvement etc. made, should be included in the protection of the present invention Within the scope of.

Claims (29)

1. an optical sensing apparatus, comprises:
Sensing surface, position is on optical jog wheel;
First light source, in order to provide the light on this sensing surface parallel;
Image sensor, position is in this optical jog wheel, in order to sense the object close to this sensing surface, to produce Organism image data;And
Object space judgment means, position is in this optical jog wheel, in order to calculate this according to these object image data The positional information of object.
2. optical sensing apparatus as claimed in claim 1, wherein this first light source is linear light sources.
3. optical sensing apparatus as claimed in claim 1, further includes:
Lens member, for wide-angle lens, fish eye lens, in order to receive the reflection light of this object;
Wherein this image sensor produces this object image data according to this reflection light of this object.
4. optical sensing apparatus as claimed in claim 1, further includes:
Pinhole device, in order to receive the reflection light of this object;
Wherein this image sensor receives this reflection light according to the pin hole in this pinhole device and produces this object image Data.
5. optical sensing apparatus as claimed in claim 1, further includes light source control unit, in order to open or to close Closing this first light source, this image sensor produces light source and opens object image when this first light source is opened Data, produce light source and close object image data, wherein this object space when this first light source is closed This light source is opened object image data by judgment means and this light source is closed object image data and subtracted each other To obtain difference object image data, and calculate being somebody's turn to do of this object according to these difference object image data Positional information.
6. optical sensing apparatus as claimed in claim 1, wherein this object space judgment means is more according to this position Confidence breath produces control signal to the corresponding object controlling on display or corresponding action.
7. optical sensing apparatus as claimed in claim 1, wherein this image sensor is more in order to produce in this sense Survey the object image data of the object that surface is moved, and this object space judgment means is more according to this object Image data calculates the motion track of this object to be come as positional information.
8. optical sensing apparatus as claimed in claim 1, further includes:
Secondary light source, in order to produce light, with this sensing surface incident, wherein this light and this sensing surface The angle of normal is less than 60 degree;And
Light guide plate, has at least some of transmission region, and the light from this secondary light source can penetrate this transmission region To irradiate this object.
9. optical sensing apparatus as claimed in claim 1, wherein this sensing surface is rectangle, wherein this rectangle N times that longer sides is shorter edge, N is positive integer.
10. optical sensing apparatus as claimed in claim 1, this sensing surface is rectangle, and wherein this image passes The maximum magnitude that sensor can sense is the catercorner length on this sensing surface.
11. optical sensing apparatus as claimed in claim 1, wherein this object image packet contains following data At least one: the initial data of whole image, object data, object center of gravity data.
12. optical sensing apparatus as claimed in claim 1, wherein this object space judgment means is incorporated into this In image sensor.
13. optical sensing apparatus as claimed in claim 1, further include processor, and wherein this object space is sentenced Disconnected device is incorporated in this processor;
Or, this object space judgment means is the host computer system connecting this processor.
14. optical sensing apparatus as claimed in claim 1, wherein this first light source is positioned at this optical jog wheel, This sensing surface is a curved surface, and this object is a finger.
15. 1 kinds of optical sensing apparatus, comprise:
The casing of optical jog wheel;
Sensing surface, position is in this casing;
First light source, position is at this sensing surface side;
Image sensor, position is in this casing, in order to sense the object close to this sensing surface, to produce this thing The object image data of body;And
Object space judgment means, position is in this casing, in order to calculate this object according to these object image data Positional information.
16. optical sensing apparatus as claimed in claim 15, wherein this first light source is linear light sources.
17. optical sensing apparatus as claimed in claim 15, further include:
Lens member, for wide-angle lens or fish eye lens, in order to receive the reflection light of this object;
Wherein this image sensor produces this object image data according to this reflection light of this object.
18. optical sensing apparatus as claimed in claim 15, further include:
Pinhole device, in order to receive the reflection light of this object;
Wherein this image sensor receives this reflection light according to the pin hole in this pinhole device and produces this object image Data.
19. optical sensing apparatus as claimed in claim 15, further include light source control unit, in order to opening or Closing this first light source, this image sensor produces light source and opens object shadow when this first light source is opened As data, produce light source when this first light source is closed and close object image data, wherein this object position Put judgment means and this light source is opened object image data and this light source closedown object image data phase Subtract to obtain difference object image data, and calculate this object according to these difference object image data This positional information.
20. optical sensing apparatus as claimed in claim 15, wherein this object space judgment means is more according to being somebody's turn to do Positional information produces control signal to the corresponding object controlling on display or corresponding action.
21. optical sensing apparatus as claimed in claim 15, wherein this first light source position and is somebody's turn to do in this casing Sensing surface is curved surface, and this object is a finger.
22. optical sensing apparatus as claimed in claim 15, wherein this first light source position is outer in this casing and is somebody's turn to do Sensing surface is plane.
23. optical sensing apparatus as claimed in claim 15, wherein this image sensor is more in order to produce at this The object image data of the object that sensing surface is moved, and this object space judgment means is more according to this thing Body image data calculates the motion track of this object to be come as positional information.
24. optical sensing apparatus as claimed in claim 15, further include:
Secondary light source, position is in this casing, and across this sensing surface relative to this object;And
Light guide plate, has at least some of transmission region, and the light from this secondary light source can penetrate this transparent area Territory is to irradiate this object, and wherein this light and the angle of this sensing normal to a surface are less than 60 degree.
25. optical sensing apparatus as claimed in claim 15, wherein this sensing surface is rectangle, wherein this square The longer sides of shape is N times of shorter edge, and N is positive integer.
26. optical sensing apparatus as claimed in claim 15, this sensing surface is rectangle, and wherein this image passes The maximum magnitude that sensor can sense is the catercorner length on this sensing surface.
27. optical sensing apparatus as claimed in claim 15, wherein this object image packet contains following data At least one: the initial data of whole image, object data, object center of gravity data.
28. optical sensing apparatus as claimed in claim 15, wherein this object space judgment means is incorporated into this In image sensor.
29. optical sensing apparatus as claimed in claim 15, further include processor, and wherein this object space is sentenced Disconnected device is incorporated in this processor;Or, this object space judgment means is to connect this processor Host computer system.
CN201210182994.4A 2012-06-04 2012-06-04 Optical sensing apparatus Active CN103455209B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201210182994.4A CN103455209B (en) 2012-06-04 2012-06-04 Optical sensing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201210182994.4A CN103455209B (en) 2012-06-04 2012-06-04 Optical sensing apparatus

Publications (2)

Publication Number Publication Date
CN103455209A CN103455209A (en) 2013-12-18
CN103455209B true CN103455209B (en) 2016-09-28

Family

ID=49737655

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201210182994.4A Active CN103455209B (en) 2012-06-04 2012-06-04 Optical sensing apparatus

Country Status (1)

Country Link
CN (1) CN103455209B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20150092561A (en) * 2014-02-05 2015-08-13 현대자동차주식회사 Control apparatus for vechicle and vehicle
CN104897181B (en) * 2014-03-03 2017-07-07 原相科技股份有限公司 Optical encoder and operating method thereof
TW201743074A (en) 2016-06-01 2017-12-16 原相科技股份有限公司 Measuring device and its operating method
CN107490370B (en) * 2016-06-13 2020-01-10 原相科技股份有限公司 Measuring device and operation method thereof, track sensing system and track sensing method thereof
US11435215B2 (en) * 2019-11-14 2022-09-06 Pixart Imaging Inc. Electric pot and liquid level determining method which can determine liquid level and solid height by light with different wave lengths
US11486893B2 (en) * 2020-10-06 2022-11-01 Pixart Imaging Inc. Optical sensing system and optical navigation system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101582001A (en) * 2009-07-07 2009-11-18 松翰科技股份有限公司 Touch screen, touch module and control method
CN101957691A (en) * 2009-07-20 2011-01-26 瑞鼎科技股份有限公司 Optical touch system and operating method thereof
CN102043539A (en) * 2009-10-09 2011-05-04 大立光电股份有限公司 Device for detecting position of panel display and method thereof
CN102298469A (en) * 2010-06-25 2011-12-28 林宏宇 Portable optical touch system and method for sensing object position

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101859207B (en) * 2009-04-08 2013-08-28 鸿富锦精密工业(深圳)有限公司 Touch panel and electronic device applying same

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101582001A (en) * 2009-07-07 2009-11-18 松翰科技股份有限公司 Touch screen, touch module and control method
CN101957691A (en) * 2009-07-20 2011-01-26 瑞鼎科技股份有限公司 Optical touch system and operating method thereof
CN102043539A (en) * 2009-10-09 2011-05-04 大立光电股份有限公司 Device for detecting position of panel display and method thereof
CN102298469A (en) * 2010-06-25 2011-12-28 林宏宇 Portable optical touch system and method for sensing object position

Also Published As

Publication number Publication date
CN103455209A (en) 2013-12-18

Similar Documents

Publication Publication Date Title
CN103455209B (en) Optical sensing apparatus
JP6078884B2 (en) Camera-type multi-touch interaction system and method
CN101971128B (en) Interaction device for interaction between a screen and a pointer object
KR102335132B1 (en) Multi-modal gesture based interactive system and method using one single sensing system
CN103299259A (en) Detection device, input device, projector, and electronic apparatus
US9251397B2 (en) Fingerprint image capturing device and fingerprint image capturing module thereof
EP0055366B1 (en) System for remotely displaying and sensing information using shadow parallax
TWI635306B (en) Optical apparatus
CN107004130A (en) Optical sensor module under the screen that fingerprint senses on screen
CN104769644A (en) Object detection and tracking with variable-field illumination devices
CN102016713A (en) Projection of images onto tangible user interfaces
CN109564626A (en) Have optical finger print device and hand-held device under the screen of the anti-fake sensing function of three-dimensional fingerprint
TW201108058A (en) Touch system and pointer coordinate detecting method therefor
CN103988142A (en) Portable device
CN109782435B (en) Multi-scene air imaging and interaction system
Maierhöfer et al. Demonstration of an Infrared Pen as an Input Device for Projected Augmented Reality Tabletops
JP2010282463A (en) Touch panel device
CN101650620B (en) Image pick-up type touching detection method and system
CN102184059A (en) Shooting type optical touch device
CN208298198U (en) A kind of optical finger print identification mould group
CN206480001U (en) The inspection of high definition text, fingers and palms line Compare System
TWI484379B (en) Optical detecting device
CN202133982U (en) Optical touch-control display
US20110050652A1 (en) Flexible and portable multiple passive writing instruments detection system
JP2010079818A (en) Position detection device using image sensor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant