US20130293472A1

US20130293472A1 - Optical navigation device and locus smoothing method thereof

Info

Publication number: US20130293472A1
Application number: US13/871,321
Authority: US
Inventors: Yu-Hao HAUNG; Ming-Tsan Kao; Sen-Huang HAUNG
Original assignee: Pixart Imaging Inc
Current assignee: Pixart Imaging Inc
Priority date: 2012-05-01
Filing date: 2013-04-26
Publication date: 2013-11-07
Also published as: US10082883B2; US10496184B2; US20160328027A1; TW201346651A; US20180335854A1; US20200064931A1; US10838514B2

Abstract

There is provided an optical navigation device including an image sensor, a processing unit, a storage unit and an output unit. The image sensor is configured to successively capture images. The processing unit is configured to calculate a current displacement according to the images and to compare the current displacement or an accumulated displacement with a threshold so as to determine an outputted displacement. The storage unit is configured to save the accumulated displacement. The output unit is configured to output the outputted displacement with a report rate.

Description

CROSS REFERENCE TO RELATED APPLICATION

This application claims the priority benefit of Taiwan Patent Application Serial Number 101115438, filed on May 1, 2012, the full disclosure of which is incorporated herein by reference.

BACKGROUND

1. Field of the Disclosure
This disclosure generally relates to a human machine interface device and, more particularly, to an optical navigation device and a locus smoothing method thereof capable of increasing locus smoothness.
2. Description of the Related Art
Traditionally, the optical mouse is one of the peripheral devices for interacting with the computer system having a display screen. An optical mouse generally includes a light source, an image sensor and a processing unit. The light source emits light to a working surface. The image sensor receives reflected light from the working surface and successively outputs image frames. The processing unit calculates a displacement of the optical mouse with respect to the working surface according to the image frames and sends the displacement to a computer system with a report rate for corresponding control.
However, as the image frames captured by the image sensor may contain noise, the noise will reflect in the displacement calculated by the processing unit. Although the displacement will not be obviously affected by a position offset caused by the noise when the displacement is relatively larger than the position offset, when the displacement is very small and is substantially identical to or just a little bit larger than the position offset, the locus can be disturbed to have a zigzag path.
For example referring to FIG. 1, it shows a schematic diagram of the locus outputted by a conventional optical mouse, wherein it is assumed that the optical mouse outputs the detected displacement with report rate of 125 times/second. For example, now a user slowly moves the optical mouse along an X direction. When there is no noise in the image frame, the optical mouse can output the locus of a straight line as shown by the dashed line. However, when there is noise in the image frame, such as +Δy noise existing at 16 ms and 56 ms and −Δy noise existing at 24 ms and 48 ms, the optical mouse will output the locus having a zigzag path. This zigzag locus can significantly affect the operation of a user in fine operation.
Accordingly, the present disclosure further provides an optical navigation device and a locus smoothing method thereof that can effectively eliminate or significantly reduce the zigzag locus outputted by a conventional optical mouse.

SUMMARY

The present disclosure provides an optical navigation device and a locus smoothing method thereof that may output a zero displacement when an accumulated displacement does not exceed a displacement threshold or an accumulated parameter does not exceed a predetermined accumulation value thereby eliminating the noise interference.
The present disclosure provides an optical navigation device including an image sensor, a processing unit, a storage unit and an output unit. The image sensor is configured to successively capture images. The processing unit is configured to calculate a current displacement according to the images and to compare the current displacement or an accumulated displacement with a displacement threshold so as to determine an outputted displacement. The storage unit is configured to save the accumulated displacement. The output unit is configured to output the outputted displacement with a report rate.
The present disclosure further provides a locus smoothing method of an optical navigation device including the steps of: successively capturing images with an image sensor; calculating, using a processing unit, a current displacement according to the images; and comparing, using the processing unit, the current displacement with a displacement threshold thereby determining the current displacement is outputted or accumulated.
The present disclosure further provides a locus smoothing method of an optical navigation device including the steps of: successively capturing images with an image sensor; calculating, using a processing unit, a current displacement according to the images; comparing, using the processing unit, the current displacement with a threshold; outputting the current displacement when the current displacement is larger than or equal to the threshold; and accumulating the current displacement to an accumulated displacement and outputting a zero displacement when the current displacement is smaller than the threshold.
In the optical navigation device and the locus smoothing method according to the embodiment of the present disclosure, when an accumulated parameter counted by a counting unit is larger than or equal to a predetermined accumulation value, the accumulated displacement or an average displacement of the accumulated displacement is outputted so as to avoid accumulating the displacement for a long time.
In the optical navigation device and the locus smoothing method according to the embodiment of the present disclosure, when a current displacement is smaller than the threshold, the processing unit may directly accumulate the obtained next current displacement to the accumulated displacement and does not compare the next current displacement with the threshold. When the accumulated displacement is larger than or equal to the threshold, the accumulated displacement is outputted for one time or an average displacement of the accumulated displacement is outputted for several times, wherein an output time of outputting the average displacement may be determined according to the accumulated parameter, which may be an accumulated number of the current displacement being accumulated or an accumulation interval of accumulating the current displacement. When the accumulated displacement is smaller than the threshold, a zero displacement may be outputted.

BRIEF DESCRIPTION OF THE DRAWINGS

Other objects, advantages, and novel features of the present disclosure will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

FIG. 1 shows a schematic diagram of the locus outputted by a conventional optical mouse.

FIG. 2A shows a schematic diagram of the optical navigation device according to an embodiment of the present disclosure.

FIG. 2B shows a schematic block diagram of the optical navigation device according to an embodiment of the present disclosure.

FIG. 3 shows a flow chart of the locus smoothing method of the optical navigation device according to an embodiment of the present disclosure.

FIG. 4 shows an operational schematic diagram of the locus smoothing method of the optical navigation device according to the embodiment of the present disclosure.

DETAILED DESCRIPTION OF THE EMBODIMENT

It should be noted that, wherever possible, the same reference numbers will be used throughout the drawings to refer to the same or like parts.
Referring to FIGS. 2A and 2B, FIG. 2A shows a schematic diagram of the optical navigation device according to an embodiment of the present disclosure; and FIG. 2B shows a schematic block diagram of the optical navigation device according to an embodiment of the present disclosure.
The optical navigation device 1 includes a housing 10, a light source11, an image sensor 12, a processing unit 13, an output unit 14, a counting unit 15 and a storage unit 16. In one embodiment, the optical navigation device 1 may further include a light control unit 17 configured to control the turning on and the turning off of the light source 11, and the light control unit 17 may be included in the processing unit 13 or separated therefrom. The optical navigation device 1 is configured to be put on a working surface S for being operated by a user.
A bottom surface of the housing 10 has an opening H. The light source 11 may be a light emitting diode, a laser diode or other active light sources and preferably is configured to irradiate red light or invisible light to illuminate the working surface S through the opening H.
The image sensor 12 may be a CCD image sensor, a CMOS image sensor or other sensors capable of detecting light energy. The image sensor 12 receives reflected light reflected from the working surface S and passing through the opening H at a sampling frequency to successively capture and output images.
The processing unit 13 may be a digital signal processor (DSP). After receiving the images sent from the image sensor 12, the processing unit 13 calculates a current displacement according to the images, compares the current displacement or an accumulated displacement with a threshold so as to determine and output an outputted displacement. In one embodiment, when the processing unit 13 identifies that the current displacement is larger than or equal to the threshold, the processing unit 13 controls the output unit 14 to output the current displacement; that is, the outputted displacement is the current displacement.
When the processing unit 13 identifies that the current displacement is smaller than the threshold, the current displacement is accumulated to an accumulated displacement and then stored in the storage unit 16; meanwhile, the processing unit 13 controls the output unit 14 to output a zero displacement (i.e. the outputted displacement is 0) and directly accumulates a next current displacement to the accumulated displacement. At this moment, the processing unit 13 may or may not compare the next current displacement with the threshold. Then, when the processing unit 13 identifies that the accumulated displacement is larger than or equal to the threshold or identifies that an accumulated parameter is larger than or equal to a predetermined accumulation value (described later), the processing unit 13 may further calculate an average displacement of the accumulated displacement and control the output unit 14 to output the accumulated displacement for one time or to output the average displacement for several times; that is, the outputted displacement may be the accumulated displacement or the average displacement. It should be mentioned that if the accumulated displacement is outputted by the processing unit 13, the average displacement may not be calculated. When the processing unit 13 identifies that the accumulated displacement is smaller than the threshold and the accumulated parameter is smaller than the predetermined accumulation value, the processing unit 13 controls the output unit 14 to output a zero displacement; that is, the outputted displacement is 0.
The output unit 14 wired or wirelessly sent the outputted displacement to an electronic device 9 at a fixed report rate, e.g. 120 times/second or 125 times/second so as to perform corresponding control, wherein the method of an optical navigation device controlling an electronic device is well known to the art, e.g. controlling a cursor or an application using an optical mouse, and thus details thereof are not described herein. The present disclosure is to smooth the outputted displacement of the optical navigation device 1. In addition, the report rate mentioned above is only exemplary and is not used to limit the present disclosure.
The counting unit 15 is configured to count an accumulated parameter, e.g. counting an accumulated number of the current displacement being accumulated or an accumulation interval of accumulating the current displacement so as to avoid a long accumulation interval or a high accumulated number of the current displacement that could affect the operation of the user. Therefore in this embodiment, the processing unit 13 may further compare the accumulated parameter with a predetermined accumulation value. When the accumulated parameter is identified to be larger than or equal to the predetermined accumulation value, the processing unit 13 may further calculate an average displacement of the accumulated displacement and control the output unit 14 to output the accumulated displacement for one time or to output the average displacement for several times, wherein an output time of the output unit 14 outputting the average displacement may be determined according to the accumulated parameter, e.g. the output time may be equal to the accumulated number (described later with an example). As mentioned above, if the accumulated displacement is outputted by the processing unit 13, the average displacement may not be calculated.
The storage unit 16 is configured to store the threshold, accumulated displacement, accumulated parameter and/or predetermined accumulation value.
Referring to FIG. 3, it shows a flow chart of the locus smoothing method of an optical navigation device according to an embodiment of the present disclosure including the steps of: successively capturing images (Step S₁₁); calculating a current displacement ΔD according to the images (Step S₁₂); comparing the current displacement ΔD with a threshold TH (Step S₁₃); outputting the current displacement ΔD when the current displacement ΔD is larger than or equal to the threshold TH (Step S₁₄); when the current displacement ΔD is smaller than the threshold TH, accumulating the current displacement ΔD to an accumulated displacement ΣΔD, counting an accumulated parameter C and outputting a zero displacement (Step S₁₅); successively capturing images (Step S₁₁′); calculating a next current displacement ΔD (Step S₁₂′); directly accumulating the next current displacement ΔD to the accumulated displacement ΣΔD and counting the accumulated parameter C (Step S₁₆); comparing the next current displacement ΔD or the accumulated displacement ΣΔD with the threshold TH and comparing the accumulated parameter C with a predetermined accumulation value N (Step S₁₇); when the accumulated displacement ΣΔD or the next current displacement ΔD is larger than or equal to the threshold TH or when the accumulated parameter C is larger than or equal to the predetermined accumulation value N, outputting the accumulated displacement ΣΔD for one time or outputting an average displacement AveΣΔD of the accumulated displacement ΣΔD for several times (Step S₁₈); when the accumulated displacement ΣΔD and the next current displacement ΔD are both smaller than the threshold TH and the accumulated parameter C is smaller than the predetermined accumulation value N, outputting a zero displacement (Step S₁₉).
Referring to FIGS. 3 and 4, the locus smoothing method of the optical navigation device according to an embodiment of the present disclosure will be described hereinafter using an example.

Step S₁₁:

The image sensor 12 successively captures images at a sampling frequency. At this moment, the accumulated displacement ΣΔD saved in the storage unit 16 is equal to zero; i.e. ΣΔD=0.

Step S₁₂:

For example at time t₁, the processing unit 13 receives the images to accordingly calculate a current displacement ΔD.

Step S₁₃:

The processing unit 13 compares the current displacement ΔD with a threshold TH so as to determine the current displacement ΔD is outputted or accumulated.

Step S₁₄:

When the current displacement ΔD is larger than or equal to the threshold TH, the processing unit 13 outputs the current displacement ΔD to the output unit 14 so as to transmit the current displacement ΔD to an external electronic device 9 through the output unit 14. The procedure returns to the Step S₁₁to perform a next detection of displacement.

Step S₁₅:

When the current displacement ΔD (e.g. ΔD₁shown in FIG. 4) is smaller than the threshold TH, the processing unit 13 accumulates the current displacement ΔD₁to the accumulated displacement ΣΔD (i.e. 0+ΔD₁) saved in the storage unit 16; meanwhile, the counting unit 16 counts an accumulated parameter C, which may be an accumulated number of the current displacement being accumulated (e.g. 1 by now) or an accumulation interval of accumulating the current displacement (e.g. 8 ms by now), to be saved in the storage unit 16; meanwhile, the processing unit 13 outputs a zero displacement to the output unit 14 and the output unit 14 sends the zero displacement to the external electronic device 9. The procedure then performs a next detection of displacement.
Next, the image sensor 12 successively captures images at the sampling frequency (Step S₁₁'); the processing unit 13 receives the images to accordingly calculate a next current displacement ΔD (Step S₁₂′), such as ΔD₂shown in FIG. 4.
At this moment, the accumulated displacement ΣΔD stored in the storage unit 16 may not be zero (e.g. ΔD₁by now). It is appreciated that in the steps S₁₁and S₁₁′ the same image sensor 12 is used to capture images; and in the steps S₁₂and S₁₂′ the same processing unit 12 is used to calculate the current displacement; and these steps are separated in FIG. 3 for clearly showing the procedure.

Step S₁₆:

The next current displacement ΔD₂is directly accumulated to the accumulated displacement ΣΔD (e.g. ΔD₁+ΔD₂). The counting unit 15 continuously increases the counting parameter C. In other words, if the accumulated displacement ΣΔD stored in the storage unit 16 is not zero, when the processing unit 13 obtains a new current displacement ΔD, the processing unit 13 may directly accumulate the new current displacement ΔD to the accumulated displacement ΣΔD. The processing unit 13 does not compare the new current displacement ΔD with the threshold TH to determine whether to accumulate the current displacement ΔD or not.

Steps S₁₇˜S₁₈:

The processing unit 13 compares the accumulated displacement ΣΔD with the threshold TH and/or compares the accumulated parameter C with a predetermined accumulation value N. When the accumulated displacement ΣΔD is larger than or equal to the threshold TH and/or the accumulated parameter C is larger than or equal to the predetermined accumulation value N, the processing unit 13 outputs the accumulated displacement ΣΔD or an average displacement AveΣΔD of the accumulated displacement ΣΔD. For example, the processing unit 13 may control the output unit 14 to output the accumulated displacement ΣΔD for one time or to output the average displacement AveΣΔD of the accumulated displacement ΣΔD for several times. In other embodiment, the processing unit 13 may also compare the next current displacement ΔD₂with the threshold TH and output the accumulated displacement ΣΔD or the average displacement AveΣΔD of the accumulated displacement ΣΔD when the next current displacement ΔD₂is larger than or equal to the threshold TH. In this embodiment, the processing unit 13 may determine an output time of outputting the average displacement AveΣΔD according to the accumulated parameter C.
For example in the embodiment shown in FIG. 4, it is assumed that a current displacement ΔD₄or the accumulated displacement ΣΔD=ΔD₁+ΔD₂+ΔD₃+ΔD₄is larger than or equal to the threshold TH and/or the accumulated parameter C at time t₄is larger than or equal to the predetermined accumulation value N (e.g. N=4 or 32 ms). The processing unit 13 controls the output unit 14 to output the accumulated displacement ΣΔD for one time at time t₄or controls the output unit 14 to output an average displacement AveΣΔD of the accumulated displacement ΣΔD (e.g. AveΣΔD=ΣΔD/4) at time t₄, and further output (the average displacement AveΣΔD+ current displacement ΔD_S) at time t₅, and further output (the average displacement AveΣΔD+ current displacement ΔD₆) at time t₆, and further output (the average displacement AveΣΔD+ current displacement ΔD_S) at time t₇. More specifically, the processing unit 13 may output the average displacement AveΣΔD for several times according to the accumulated parameter C, and an accumulated number of the current displacement ΔD being accumulated may be set as an output time of outputting the average displacement AveΣΔD. In other words, in FIG. 4 if the processing unit 13 outputs the accumulated displacement ΣΔD for one time, the procedure is returned to the Step S₁₁at time t₅; however, if the processing unit 13 outputs the average displacement AveΣΔD for several times, the procedure is returned to the Step S₁₁at time t₈. It should be mentioned that when the average displacement AveΣΔD is outputted for several times, within the period outputting the average displacement AveΣΔD, e.g. at time t₅˜t₇of FIG. 4, the locus smoothing method of FIG. 3 may not be performed and a current displacement ΔD obtained may be directly added to the average displacement AveΣΔD and the summation thereof is directly outputted. After the average displacement AveΣΔD is all outputted, e.g. at time t₈of FIG. 4, the locus smoothing method of the present embodiment is performed again. It is appreciated that, the output time of outputting the average displacement is not limited to the accumulated number, and it may be a fixed number of times or a multiple of the accumulated number without any limitation.

Step S₁₉:

When the next current displacement ΔD₂and the accumulated displacement ΣΔD are both smaller than the threshold TH and the accumulated parameter C is smaller than the predetermined accumulation value N, the processing unit 13 outputs a zero displacement to the output unit 14 to be sent to the external electronic device 9 through the output unit 14, and the procedure is returned to the Step S₁₁′ to calculate a next current displacement, e.g. ΔD₃. Next, the Steps S₁₆, S₁₇and S₁₉are performed repeatedly till the current displacement ΔD, the accumulated displacement ΣΔD and/or the accumulated parameter C satisfy the condition in the Step S₁₇(as mentioned above), and then the accumulated displacement ΣΔD is outputted for one time or the average displacement AveΣΔD of the accumulated displacement ΣΔD is outputted for several times.
It should be mentioned that the step S₁₇of FIG. 3 shows that the processing unit 13 may compare the next current displacement ΔD with the threshold TH or compare the accumulated displacement ΣΔD with the threshold TH. It is known that when the next current displacement ΔD is larger than or equal to the threshold TH, the accumulated displacement ΣΔD is naturally larger than or equal to the threshold TH. Therefore in step S₁₇, it is able to only compare the accumulated displacement ΣΔD with the threshold TH and it is not necessary to compare the next current displacement ΔD with the threshold TH.
As mentioned above, conventional optical mouse may output zigzag locus in tiny displacement such that the operation accuracy may be degraded. Therefore, the present disclosure further provides an optical navigation device (FIGS. 2A and 2B) and a locus smoothing method thereof (FIG. 3) that may output a zero displacement when an accumulated displacement does not exceed a displacement threshold and an accumulated parameter does not exceed a predetermined accumulation value. The accumulated displacement is outputted for one time or an average displacement of the accumulated displacement is outputted for several times till the accumulated displacement exceeds the displacement threshold or the accumulated parameter exceeds the predetermined accumulation value. In the present disclosure, as the outputted displacement is relatively larger than the noise, it is able to eliminate the interference from the noise on tiny displacement.
Although the disclosure has been explained in relation to its preferred embodiment, it is not used to limit the disclosure. It is to be understood that many other possible modifications and variations can be made by those skilled in the art without departing from the spirit and scope of the disclosure as hereinafter claimed.

Claims

What is claimed is:

1. An optical navigation device, comprising:

an image sensor configured to successively capture images;

a processing unit configured to calculate a current displacement according to the images and to compare the current displacement or an accumulated displacement with a threshold so as to determine an outputted displacement; and

an output unit configured to output the outputted displacement with a report rate.

2. The optical navigation device as claimed in claim 1, wherein the output unit outputs the current displacement when the current displacement is larger than or equal to the threshold; and the current displacement is accumulated when the current displacement is smaller then the threshold.

3. The optical navigation device as claimed in claim 1, wherein the output unit outputs a zero displacement when the current displacement is smaller then the threshold.

4. The optical navigation device as claimed in claim 2, further comprising a counting unit configured to count an accumulated parameter.

5. The optical navigation device as claimed in claim 4, wherein the processing unit further calculates an average displacement of the accumulated displacement when the accumulated displacement is larger than or equal to the threshold or the accumulated parameter is larger than or equal to a predetermined accumulation value.

6. The optical navigation device as claimed in claim 5, wherein the output unit outputs the average displacement for several times.

7. The optical navigation device as claimed in claim 6, wherein an output time of the output unit outputting the average displacement is determined according to the accumulated parameter.

8. The optical navigation device as claimed in claim 4, wherein the output unit outputs a zero displacement when the accumulated displacement is smaller than the threshold and the accumulated parameter is smaller then a predetermined accumulation value.

9. The optical navigation device as claimed in claim 4, wherein the output unit outputs the accumulated displacement when the accumulated displacement is larger than or equal to the threshold or the accumulated parameter is larger than or equal to a predetermined accumulation value.

10. The optical navigation device as claimed in claim 1, wherein the processing unit directly accumulates a next current displacement to the accumulated displacement when the current displacement is smaller than the threshold.

11. A locus smoothing method of an optical navigation device, comprising:

successively capturing images with an image sensor;

calculating, using a processing unit, a current displacement according to the images; and

comparing, using the processing unit, the current displacement with a threshold thereby determining the current displacement is outputted or accumulated.

12. The locus smoothing method as claimed in claim 11, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises:

calculating, using the processing unit, a next current displacement;

directly accumulating the next current displacement to the accumulated displacement;

comparing, using the processing unit, the accumulated displacement with the threshold; and

outputting the accumulated displacement when the accumulated displacement is larger than or equal to the threshold.

13. The locus smoothing method as claimed in claim 12, further comprising:

outputting a zero displacement when the accumulated displacement is smaller than the threshold.

14. The locus smoothing method as claimed in claim 11, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises:

counting an accumulated parameter with a counting unit; and

outputting the accumulated displacement or an average displacement of the accumulated displacement when the accumulated parameter is larger than or equal to a predetermined accumulation value.

15. The locus smoothing method as claimed in claim 14, wherein the processing unit outputs the average displacement for several times according to the accumulated parameter.

16. A locus smoothing method of an optical navigation device, comprising:

successively capturing images with an image sensor;

calculating, using a processing unit, a current displacement according to the images;

comparing, using the processing unit, the current displacement with a threshold;

outputting the current displacement when the current displacement is larger than or equal to the threshold; and

accumulating the current displacement to an accumulated displacement and outputting a zero displacement when the current displacement is smaller than the threshold.

17. The locus smoothing method as claimed in claim 16, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises:

calculating, using the processing unit, a next current displacement;

outputting the accumulated displacement for one time or outputting an average displacement of the accumulated displacement for several times when the accumulated displacement is larger than or equal to the threshold.

18. The locus smoothing method as claimed in claim 17, further comprising:

19. The locus smoothing method as claimed in claim 16, wherein when the current displacement is smaller than the threshold, the locus smoothing method further comprises:

counting an accumulated parameter with a counting unit; and

outputting the accumulated displacement for one time or outputting an average displacement of the accumulated displacement for several times when the accumulated parameter is larger than or equal to a predetermined accumulation value.

20. The locus smoothing method as claimed in claim 19, wherein an output time of outputting the average displacement is determined according to the accumulated parameter.