EP0352291A4

EP0352291A4 - Motion sensor

Info

Publication number: EP0352291A4
Application number: EP19880903612
Authority: EP
Inventors: Young L. Harvill; Thomas G. Zimmerman; Jean-Jacques G. Grimaus
Original assignee: VPL Research Inc
Current assignee: VPL Research Inc
Priority date: 1987-03-24
Filing date: 1988-03-23
Publication date: 1991-12-04
Also published as: EP0352291A1; WO1988007659A1

Abstract

A motion sensor comprises an optical fiber (46) disposed between a light source (38) and a light sensor (42). An upper portion of the fiber is treated so that transmission loss of light being communicated through the optical fiber is increased only when the fiber bends in one direction. In another embodiment of the invention, a flexible tube (76) is disposed in close proximity to a finger joint and bends in response to bending of the finger. A light source (38) and light sensor (42) are provided on opposite ends of the tube for indicating the extent of bending of the tube. A wedge (80) is disposed between the tube and the finger for setting the tube straight when the finger is hyperextended. In a further embodiment of the invention, bending the finger in the opposite direction causes the source and sensor to move toward each other.

Description

MOTION SENSOR

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to motion sensors and, more particularly, to a motion sensor disposed in close proximity to a physical body and which produces an asymmetrical output signal in response to symmetrical movement of the body.

2. Description of the Relevant Art

Many input devices are used to input data to machines. For example, keyboards, joysticks, mice, track balls, and light pens often are used to input data into a computer, usually so that operations may be selected without the necessity of keying in multiple commands on a keyboard. However, mastering the ope'ra- tion of such input devices is often difficult because the hand movements required to operate the device do not correspond to the visual feedback presented by the display screen of the computer.

One method and apparatus for overcoming the foregoing disadvantage is to use a data processing apparatus for converting gestures and positions of the hand of a physical operator into a virtual operator, such as an animated version of the hand, for manipulating virtual objects defined by a computer. In order to accomplish the translation from the gestures and movements of the physical operator into corresponding gestures and movements of a virtual operator, flex sensors are disposed in close proximity

SUBSTITUTE SHEET to the physical operator for producing an output signal in response to movement of the operator's body. One example of such a flex sensor is disclosed in U.S. Patent No. 4,542,291, issued to Thomas G. Zimmerman and assigned to the present assignee. In the embodiments disclosed, the sensors are placed on a glove for detecting the movements and gestures of the hand of the operator. Each sensor comprises a flexible tube having two ends, a reflective interior wall within the flexible tube, and a light source placed within one end of the flexible tube. A photosensitive detector placed within the other end of the flexible tube measures the amount of direct and reflected light received from the light source as the tube is bent. Another input device used for a somewhat dif¬ ferent purpose is described in U.S. Patent No. 4,414,537, issued November 8, 1983, to G. Grimes, entitled "Digital Data Entry Glove Interface." The Grimes patent discloses a glove with sensors for detecting the flexing of finger joints, sensors for detecting contact between various portions of the hand, and sensors for detecting the orientation of the hand. The Grimes device is used for translating discrete hand positions representing alpha¬ numeric characters into corresponding electrical signals. Although the foregoing devices visually oper¬ ate satisfactorily, the sensors used may give erroneous information in certain circumstances. For example, if sensors are positioned to detect bending at a junction of two members which pivot symmetrically with respect to an axis, but only movement on one side of the axis provides usable data, the computer may be unable to determine if the output produced by the sensors corre¬ spond to movement in the desired direction. That is, the sensors provide the same signal when the two members _are __n symmetrically opposite positions so that the computer may receive and process the data as if the data represented movement in the relevant direction when, in fact, that is not the case. Consequently, the computer is unable to translate the movements of the operator into the proper form, or the translation is performed incorrectly and the results are meaningless.

SUMMARY OF THE INVENTION The present invention is directed to a motion sensor for measuring movement of a physical body which moves symmetrically with respect to a boundary. The motion sensor monitors movement of the body and pro¬ vides an asymmetrical output signal in response to the symmetrical movement of the body. In one embodiment of the present invention, a plurality of motion sensors are placed over the joints of a hand and provide an asymmetrical output signal which indicates the direc¬ tion of movement of the hand. To avoid providing in¬ correct data when a part of the hand, e.g. , a finger, is hyperextended, the motion sensors comprise an opti¬ cal fiber disposed between a light source and a light sensor. An upper portion of the optical fiber is treated, e.g., by abrasion or notching, so that trans¬ mission loss of light being communicated through the optical fiber is increased only when the fiber bends in one direction. In another embodiment of the present inven¬ tion, a flexible tube is disposed in close proximity to a finger joint and bends in response to bending of the finger. A light source and light sensor are provided on opposite ends of the tube for continuously indicat- ing the extent of bending of the tube. A wedge is dis¬ posed between the tube and the finger for setting the tube in a prescribed orientation, e____g_._. straight, when the finger is in a prescribed position, e.g. , hyper¬ extended. In this manner, the symmetry of the output signal which ordinarily would result from bending of the tube on opposite sides of the axis of movement is avoided. In a further embodiment of the invention, a light source and light sensor are positioned in close proximity to a finger joint so that bending of the fin¬ ger toward the palm causes the source and sensor to move away from each other. Bending the finger in the other direction causes the source and sensor to move toward each other. A guide faces the light emitted by the source toward the sensor so that the degree of bending may be determined by the amount of light re- ceived by the sensor.

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is an overall perspective view of a data processing system according to the present inven- tion wherein movements of a part of a body of a physi¬ cal operator are converted into a virtual operator for manipulating a virtual object represented in the data processing system.

Fig. 2 is a view of a finger bent in a normal direction of movement.

Fig. 3 is a view of a finger which illustrates the finger in a hyperextended position.

Fig. 4a is a back view of an instrumented glove assembly according to the present invention. Fig. 4b is a palm-side view .of the instru¬ mented glove assembly of Fig. 4a.

Fig. 4c is a side view of the instrumented glove assembly of Fig. 4a.

Fig. 5 is a sectional detailed view of one finger of the instrumented glove assembly of Figs. 4a, 4b, and 4c with the finger having an extended orienta¬ tion.

Fig. 6 is a sectional detailed view of one finger of the instrumented grove assembly of Figs. 4a, 4b, and 4c with the finger having a bent orientation. Figs. 7a and 7b are straight and bent views, respectively, of an optical fiber having an abraded upper surface.

Figs. 8a and 8b are straight and bent views, respectively, of an optical fiber having a notched up¬ per surface.

Figs. 9a and 9b are straight and bent views, respectively, of a layered multimode step index optical fiber having a portion of the upper layer removed. Fig. 10 is a view of an alternative embodi¬ ment of the invention wherein a retroreflector is fit¬ ted on the end of an optical fiber.

Fig 11 is a graph showing light intensity as a function of movement of the finger of Figs. 5 and 6. Fig. 12a is a back view of an alternative embodiment of an instrumented glove assembly according to the present invention.

Fig. 12b is a palm-side view of the instru¬ mented glove assembly of Fig. 11. Fig. 12c is a side view of the instrumented glove assembly of Fig. 11.

Fig. 13 is a sectional detailed view of an alternative embodiment of the instrumented glove assem¬ bly disposed on a finger in a hyperextended orienta- tion.

Fig. 14 is a sectional detailed view of the instrumented glove assembly of Fig. 13 with the finger having a bent orientation.

Fig. 15 is a sectional detailed view of an alternative embodiment of an instrumented glove assem¬ bly disposed on a finger in a hyperextended orienta¬ tion.

Fig. 16 is a sectional detailed view of the instrumented glove assembly of Fig. 15 with the finger having a bent orientation. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Fig. 1 is an overall perspective view of a data processing system 4 wherein movements of a part of the body 10 of a physical operator 12 are converted into a virtual operator 16 for manipulating a virtual object 18 represented on a display screen of data pro¬ cessing system 4. The movements of physical operator 12 preferably are converted into virtual operator 16 through instrumentation disposed in close proximity to a part of the body 10 of physical operator 12, prefera¬ bly on the clothing of physical operator 12. For pur¬ poses of illustration, the movements of a hand 22 of physical operator 12 are converted into virtual opera¬ tor 16 through a glove 24. It is to be understood, however, that the present invention may be employed along any part of the body of physical operator 12 which may be used for entering data into data processing system 4.

Figs. 2 and 3 are diagrams illustrating a part of the body of physical operator 12, e.g., a fin¬ ger 30, the movement of which is useful for entering data into data processing system 4. As with many parts of the body, finger 30 is capable of moving symmetri¬ cally with respect to a boundary line X. The movement o the lower side of boundary X illustrated in Fig. 2 may be termed the "normal" field of movement, since that is the direction of movement which is normally employed to manipulate an object. The movement on the other side of boundary X, depicted in Fig. 3, may be termed the "null" field of movement, the measurement of which has little or no value in some applications. If a sensor disposed on finger 30 measures only the amount of bend of finger 30 and not its direction, then there is no way of determining whether the data provided by

SUBSTΓΓOTΈ SHEET the sensor represents movement in the normal or null field, and hence whether the data should be processed or disgarded as irrelevant.

Fig.s 4a, 4b, and 4c illustrate one embodi- ment of a glove assembly 24 used to enter data into data processing system 16. Glove assembly 24 contains several sensors 34 disposed next to the finger joints of the hand for responding to gestures of the hand. The software portion of data processing system 4 receives gesture-indicating data from sensors 34 and enters com¬ mands into data processing 4 according to the gestures recognized. These commands relate to the conversion of movements of the hand 22 of physical operator 12 into virtual operator 16. Figs. 5 and 6 illustrate one embodiment of sensor 34 for detecting movement of finger 30 in a pre¬ scribed direction. As shown therein, sensor 34 comprises a light source 38, a source of electromagnetic radiation, preferably a sensor for electromagnetic_^ radiation, pre- ferably a light sensor 42, and an optical fiber 46 for communicating the light emitted by source 38 to sensor 42. To increase the transmission loss of light being communicated through optical fiber 46 when the fiber is bent, the upper surface 50 thereof may be treated as shown in Figs. 7a, 8a, and 9a. As shown in Fig. 7a, upper surface 50 has abrasions 54 disposed therein so that, when the fiber is bent as shown in Fig. 7b, a significant amount of light impinging upon abrasions 54 will be allowed to pass through upper surface 50, and hence never reach sensor 42. As shown in Fig. 8a, an¬ other technique for increasing the transmission loss through optical fiber 46 is to form upper surface 50 having a plurality of notches 58 so that, when the fiber is bent as shown in Fig. 8b, the surfaces of notches 58 substantially increase the angle of incidence of light rays impinging against upper surface 50 above the crit¬ ical angle at which the light would be reflected, and hence a significant amount of light is transmitted through upper surface 50 and never reaches sensor 42. A similar effect may result by appropriate treatment of a layered multiple step index optical fiber 46 having an inner core 62 and an outer core 64 as shown in Fig. 9a. Outer core 64 preferably has a higher index of reflection than air. For increasing the transmission loss through fiber 46, the outer core 64 is removed on upper surface 50 so that air forms a boundary with core 62. Accordingly, the indices of reflection at the boundary of core 62 are brought substantially closer, and a significant amount of light impinging on the mod¬ ified boundary is allowed to pass through and never reaches sensor 42. In all three embodiments, there will be some transmission loss when the fiber is straight, as a result of light impinging on the treated upper surface. This transmission loss increases when optical fiber 46 is bent concavely downward (i.e. , in the normal field of movement) . On the other hand, the transmission loss decreases when optical fiber 46 is bent concavely upward (i.e. , in the null field of movement) because light reflected by the lower surface of optical fiber 46 is reflected at an angle which avoids contact with the treated portion of upper surface 50. The net result is that the output from each sensor 34 resembles the graph of Fig. 10, and the signal symmetry of known sensors is avoided.

To decrease the amount of wiring required by the system, the embodiment of sensor 34 illustrated in . Fig. 11 may be used. In this embodiment, light source 38 and light sensor 42 may be disposed on one side of optical fiber 46, and optical fiber 46 may have a retroreflector 68 disposed on its other end so that light emitted by light source 38 is reflected by retro- reflector 68 and communicated to sensor 42 back through optical fiber 46. Still further simplicity results by using the embodiment of sensor 34 disclosed in Figs. 12a, 12b, and 12c. As shown therein, optical fiber 46 originates and terminates at a control block 72, which contains the associated light sources 38 and light sen- sors 42 (not shown) . Preferably, optical fiber 46 loops around each finger of hand 22, and the upper surface of optical fiber 46 is treated as hereinbefore described in the vicinity of each joint to be monitored.

Figs. 13 and 14 disclose another embodiment of the present invention particularly well suited for a sensor constructed in accordance with U. S. Patent No. 4,542,291. As shown therein, sensor 34 includes a light source 38 and a light sensor 42 disposed on opposite ends of a flexible tube 76 for providing a signal con- tinuously indicative of the extent of the bending of finger 30. To avoid signal symmetry when the finger is bent in the null field, a wedge 80 is disposed between tube 76 and finger 30 for setting the tube in a pre¬ scribed orientation when finger 30 is in a prescribed position. Preferably, wedge 80 sets tube 76 generally straight when finger 30 is positioned at the limit of movement in the null field as shown in Fig. 13. Soft¬ ware within data processing system 4 then may be drafted to calculate the amount of bend in finger 30 in the normal field of movement.

Figs 15 and 16 illustrate another embodiment of the present invention wherein a light source 38 and a light sensor 42 are positioned on finger 30 so that bending of finger 30 causes source 38 and sensor 42 to move relative to each other. Preferably, the light emitted by source 38 should always face sensor 42 when source 38 and sensor 42 move relative to each other to facilitate measurements. This may be accomplished, for example, by connecting an optical fiber 80 to one of source 38 or sensor 42, preferably source 38, so that a free end 84 of optical fiber 80 faces the other source or sensor, preferably sensor 42. The free end 84 of optical fiber 80 then may be disposed within a guide, preferably a flexible tube 88, so that the light emitted by source 38 will face sensor 42 when source 38 and sensor 42 move relative to each other. Tube 88 prefer- ably is connected to the source or sensor located prox¬ imate to the free end 84 of optical fiber 80 to enhance reliability of the guiding function. When this embodi¬ ment is in operation, light emitted by source 38 will be detected by sensor 42 as it is emitted from the free end 84 of optical fiber 80. If finger 30 bends in the normal field of movement, e.g., downward, then free end 84 of optical fiber 80 moves away from sensor 42, and hence the light detected by sensor 42 decreases- in in¬ tensity. On the other hand, when finger 30 moves in the null field, the free end 84 of optical fiber 80 moves closer to sensor 42 until it touches sensor 42 and the intensity of light received by sensor 42 remains the same. As a result, signal symmetry again is elimi¬ nated. While the above is a complete description of a preferred embodiment of the present invention, various modifications are obvious to those skilled in the art. For example, the upper surface of optical fiber 46 in Figs. 5 and 6 may be treated in any way which increases the transmission loss through the upper portion of the fiber, such as by scraping, index matching through paint or other coating, etching with acid, eccentric scoring, and by deformation of the upper surface through laser, heat, or ultrasonic methods. The embodiment of sensor 34 disclosed in Figs. 15 and 16 may be used by encir¬ cling the sensor around the torso of the body to measure expansion and contraction of the torso as a result of inhalation and exhalation. Furthermore, optical fiber 80 in these embodiments may be eliminated, and light source 38 may be disposed on a track which maintains source 38 facing sensor 42. Consequently, the description should not be used to limit the scope of the invention which is properly described in the claims.

Claims

WE CLAIM:

1. A motion sensor comprising: sensor means for sensing movement of a physical body which moves symmetrically with respect to a boundary and for providing an output signal continuously indi¬ cative of the extent of movement of the body; and asymmetrical signal means, associated with the sensor, for causing the sensor to emit an asymmet- rical output signal in response to symmetrical movement of the body.

2. The motion sensor according to claim 1 wherein the sensor means senses electromagnetic radia- tion and further comprising an electromagnetic source for emitting electromagnetic radiation, the source and sensor means being positioned on the body'for movement therewith and the sensor means being connected for re¬ ceiving the electromagnetic radiation emitted by the source.

3. The motion sensor according to claim 2 wherein the electromagnetic radiation emitted by the source and sensed by the sensor means is visible light.

4. The sensor according to claim 3 further comprising: an optical fiber for receiving light emitted by the source and for communicating the light to the sensor; transmission loss means, disposed on the op¬ tical fiber, for increasing transmission loss of light being communicated through the optical fiber when the fiber is bent. 5. The sensor according to claim 4 wherein the optical fiber is disposed between the source and the sensor.

6. The sensor according to claim 4 wherein both the source and the sensor are disposed on one end of the optical fiber and further comprising a reflecting means, disposed on the other end of the optical fiber for reflecting light emitted by the source so that the reflected light is communicated back to the sensor by the optical fiber.

7. The apparatus according to claim 4 wherein the transmission loss means increases the transmission loss of light being communicated through the optical fiber only when the fiber is bent toward one direction.

8. The sensor according to claim 7 wherein the transmission loss means is disposed on an upper surface of the optical fiber.

9. The sensor according to claim 8 wherein the upper surface of the optical fiber is abraded for forming the increasing means. ,

10. The sensor according to claim 8 wherein the upper surface of the optical fiber has a notch for forming the increasing means.

11. A motion sensor according to claim 3 further comprising: a flexible tub disposed in close proximity to a part of the body for bending in response to movement of the body; and means, disposed between the tube and the body, for setting the tube in a prescribed orientation when the body is in a prescribed position.

12. The sensor according to claim 11 wherein the tube is disposed on a pivoting junction between first and second members of the body so that the tube bends when the first and second members pivot relative to each other.

13. The apparatus according to claim 12 wherein the setting means is a wedge disposed between the tube and the junction.

14. The sensor according to claim 13 wherein the first and second members are capable of pivoting symmetrically with respect to a boundary, the pivoting on one side of the boundary being termed the normal field of movement, and the pivoting on the other side of the boundary being termed the null field of movement, and wherein the wedge sets the tube generally straight when the first and second members are positioned in the null field.

15. The sensor according to claim 3 wherein the source and sensor are positioned on the body so that movement of the body causes the source and sensor to move relative to each other and further comprising a guide means for facing the light emitted by the source toward the sensor when the source and sensor move rela¬ tive to each other.

16. The means according to claim 15 wherein the guide means includes an optical fiber connected to one of the source or sensor, the optical fiber having a free end facing the other source or sensor- 17. The apparatus according to claim 16 where¬ in the guide means further comprises a tube disposed between the source and sensor, the free end of the op¬ tical fiber being disposed within the tube.

18. The apparatus according to claim 17 where¬ in the free end of the optical fiber moves away from the facing source or sensor when the body moves in a prescribed direction.

19. The apparatus according to claim 17 where¬ in the optical fiber is connected to the source and the tube is connected to the sensor.

20. The apparatus according to claim 17 where¬ in the optical fiber is connected to the sensor and the tube is connected to the source.

21. The apparatus according to claim 18 where- i the source and sensor are disposed across a pivoting junction between first and second members of the body, the first and second member being capable of pivoting symmetrically with respect to a boundary, the pivoting on one side of the boundary being termed the normal field of movement, and the pivoting on the other side of the boundary being termed the null field of movement, and wherein the source and sensor move away from each other when the first and second members pivot away from the boundary in the normal field of movement.

22. The sensor according to claim 21 wherein the source and sensor move toward each other when the first and second members pivot away from the boundary in the null field of movement.