KR20160129406A - Wearable device - Google Patents
Wearable device Download PDFInfo
- Publication number
- KR20160129406A KR20160129406A KR1020150061522A KR20150061522A KR20160129406A KR 20160129406 A KR20160129406 A KR 20160129406A KR 1020150061522 A KR1020150061522 A KR 1020150061522A KR 20150061522 A KR20150061522 A KR 20150061522A KR 20160129406 A KR20160129406 A KR 20160129406A
- Authority
- KR
- South Korea
- Prior art keywords
- optical signal
- wearable device
- blood vessel
- information
- unit
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
An optical signal transmitting unit for transmitting an optical signal, an optical signal detecting unit for receiving a reflected optical signal generated by reflecting an optical signal to a target object, a data processing unit for processing the received reflected optical signal, A wearable device that includes a key determination unit that detects a key input operation of a user and generates an input value matched with a key input operation.
Description
The present invention relates to a wearable device.
In recent life environments where the use of electronic devices is essential in everyday life, electronic devices include respective input means. However, such general input means have not been greatly improved in a two-dimensional input means such as a keyboard and a mouse. Furthermore, it needs to be improved in terms of portability and convenience.
Accordingly, the emergence of an input means capable of simultaneously satisfying portability and convenience is required. In particular, in the trend of miniaturization of electronic devices, the new input means must be capable of handling various input values in order to fully utilize the functions of electronic devices as well as portability and convenience.
SUMMARY OF THE INVENTION The present invention has been made in order to solve the above problems, and it is an object of the present invention to allow a user to conveniently input data by utilizing portable input means.
Another object of the present invention is to enable various kinds of data input so that the wearable device can replace the input means of the keyboard and the mouse.
Yet another object of the present invention is to maintain the accuracy of input data while maintaining portability which is an advantage of wearable devices.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not intended to limit the invention to the particular form disclosed. ≪ / RTI >
According to an aspect of the present invention, there is provided a wearable device including a light signal transmitter for transmitting an optical signal, a data processor for processing a received optical signal reflected from the optical signal receiver, And a key determiner for detecting a key input operation of the user based on the data obtained by processing the reflected optical signal and generating an input value matched with the key input operation, wherein the optical signal transmitter transmits one or more optical signals, And the data processing unit generates pattern information on the blood vessel of the object based on the at least one reflected optical signal, The key input operation is detected by comparing the information about the blood vessel with the pattern information.
When the optical signal transmitting unit transmits one optical signal, the data processing unit can acquire the blood vessel data by comparing the contrast difference between the blood vessel and the surrounding tissue in the data obtained by processing one reflected optical signal by one optical signal .
The data processing unit can generate the pattern information on the blood vessel using the blood vessel data.
One optical signal may be an optical signal in the near infrared region.
When the optical signal transmitting unit transmits two or more optical signals, the data processing unit can acquire the blood vessel data by comparing the data obtained by processing two or more reflected optical signals by two or more optical signals.
At least two optical signals are optical signals in a near-infrared region or an infrared region, and at least one of a wavelength, a transmission time, a reception time, a frequency, and a polarization state may be different from each other.
A wearable device includes a depth sensor that detects a target object three-dimensionally and generates three-dimensional scan information, and a three-dimensional model generating unit that generates a three-dimensional model of the target based on the three-dimensional scan information, And may further include a video processing unit for adding to the model.
The wearable device can detect a key input operation by comparing information about a blood vessel changing according to a key input operation to a pattern added to the three-dimensional model.
The information on the blood vessel can be obtained by detecting the distribution of at least one of hue, saturation, and brightness due to the blood vessel in the object.
The key determining unit determines a three-dimensional position of the first joint connecting the user's palm and the first node of the finger, the second joint connecting the first node and the second node of the finger, An input value can be generated based on the three-dimensional position of the first joint and the second joint.
The key determining unit determines the three-dimensional position of the first joint and the second joint, and the angle at which the first joint and the second joint are bent, and determines a key input operation based on the three-dimensional position of the two joints and the angle of the two joints. The three-dimensional position of the end of the light beam can be calculated.
The optical signal detection unit can detect the first reflected optical signal and the second reflected optical signal, respectively, by separating the received reflected optical signal according to the wavelength.
The optical signal sensing unit may sense the first reflected optical signal and the second reflected optical signal separately received in the time domain or the frequency domain.
According to another aspect of the present invention, there is provided a wearable device including: an optical signal transmitter for transmitting an optical signal; an optical signal detector for receiving a reflected optical signal generated by reflecting an optical signal on a target object; A data processing unit, a position determining unit for measuring a distance and an angle with respect to the target object based on the data obtained by processing the reflected optical signal, and an image output unit for outputting an image to the outside, wherein the optical signal transmitting unit transmits one or more optical signals , The optical signal sensing unit receives at least one reflected optical signal by at least one optical signal and the data processing unit generates pattern information for the blood vessel of the object based on the at least one reflected optical signal, And the distance and angle with respect to the object are measured in comparison with the blood vessel information, And outputs the image at a fixed size in a fixed position.
The wearable device may further comprise a finger recognition unit for sensing the finger skin line of the user and generating pattern information about the skin line. The image output unit compares the pattern information about the skin line with the pattern information of the previously stored skin line, Can be fixedly output.
According to the embodiments of the present invention, the following effects can be expected.
First, users can input data in improved form through wearable device that can provide both portability and convenience.
Secondly, since the wearable device can replace the keyboard and the mouse, various data can be input only by the wearable device without any additional input means.
Third, the accuracy of data input can be maintained while maintaining the portability of the wearable device, and an improved data input environment can be provided to the user.
The effects obtainable in the embodiments of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be obtained from the description of the embodiments of the present invention described below by those skilled in the art Can be clearly understood and understood. In other words, undesirable effects of implementing the present invention can also be obtained by those skilled in the art from the embodiments of the present invention.
BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. It is to be understood, however, that the technical features of the present invention are not limited to the specific drawings, and the features disclosed in the drawings may be combined with each other to constitute a new embodiment. Reference numerals in the drawings refer to structural elements.
1 is a block diagram showing the configuration of a wearable device according to an embodiment of the present invention.
FIG. 2 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention.
FIG. 3 is a diagram illustrating an operation process of a wearable device according to an embodiment of the present invention.
FIG. 4 is a diagram illustrating an operation process of a wearable device according to an embodiment of the present invention.
5 is a view for explaining the operation of the wearable device according to an embodiment of the present invention.
FIG. 6 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention.
FIG. 7 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention.
FIG. 8 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention.
9 is a view for explaining the operation of the wearable device according to an embodiment of the present invention.
10 is a view showing an embodiment of a wearable device according to another embodiment of the present invention.
While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.
The following embodiments are a combination of elements and features of the present invention in a predetermined form. Each component or characteristic may be considered optional unless otherwise expressly stated. Each component or feature may be implemented in a form that is not combined with other components or features. In addition, some of the elements and / or features may be combined to form an embodiment of the present invention. The order of the operations described in the embodiments of the present invention may be changed. Some configurations or features of certain embodiments may be included in other embodiments, or may be replaced with corresponding configurations or features of other embodiments.
In the description of the drawings, there is no description of procedures or steps that may obscure the gist of the present invention, nor is any description of steps or steps that can be understood by those skilled in the art.
Throughout the specification, when an element is referred to as " comprising " or " including ", it is meant that the element does not exclude other elements, do. In addition, the term " "... Quot ;, " module " and the like refer to a unit for processing at least one function or operation, which may be implemented by hardware, software, or a combination of hardware and software. Also, throughout the specification, when a configuration is referred to as being " connected " to another configuration, this may include not only a physical connection, but also an electrical connection, and furthermore, a logical connection.
Also, the terms " a or ", " one ", " the ", and the like are synonyms in the context of describing the invention (particularly in the context of the following claims) May be used in a sense including both singular and plural, unless the context clearly dictates otherwise.
In this specification, the term " user " may be a wearer of a wearable device, a user, or the like, and may include a technician repairing the wearable device, but the present invention is not limited thereto.
Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The following detailed description, together with the accompanying drawings, is intended to illustrate exemplary embodiments of the invention and is not intended to represent the only embodiments in which the invention may be practiced.
In addition, the specific terminology used in the embodiments of the present invention is provided to help understanding of the present invention, and the use of such specific terminology can be changed into other forms without departing from the technical idea of the present invention.
Before describing embodiments of the present invention, the contents of Korean Patent Application No. 10-2014-0108341 and Korean Patent Application No. 10-2014-0139081 both cited by the same inventors and applicants as here are cited do. In Patent Application No. 10-2014-0108341, an invention has been proposed in which a three-dimensional model is generated by scanning a target object three-dimensionally using a wearable device, and a pattern is added to the three-dimensional model to detect a movement of a user. -0139081, an invention has been proposed in which a user's movement is detected by analyzing a user's blood vessel pattern by transmitting and receiving optical signals of different wavelengths and comparing them.
1 is a block diagram showing the configuration of a wearable device according to an embodiment of the present invention.
1 is a block diagram showing the configuration of a wearable device according to an embodiment of the present invention. The
The
Hereinafter, various configurations of the
The optical
On the other hand, the optical
Also, the optical
As described above, the optical
The optical
As the optical
The
On the other hand, the received data generated by the
As described above, when the optical
The
The
The
Meanwhile, the generated input value is a value indicating a key pressing operation of the user, and can be transmitted to an external device or server connected to the
The
The
In addition, a pulse laser light is launched into the atmosphere, and a rider (LIDAR, LIght Detection And Ranging) method using the reflector or scattering body, a speckle detecting a change in a pattern of coherent light reflected from the surface of the object A speckle interferometry method, an infrared proximity array (IPA) sensing method using two LEDs, an RGB camera, and the like can also be applied to implement the
Meanwhile, when the
In addition, the
Conversely, even if the
The
In addition, after the
In the above description, the object is a hand, which is a part of the user's body, but the present invention is not limited thereto. That is, the object can mean not only a body part but also various objects such as an object, a space, and a structure. For example, when the object is an object such as a cell phone, a notebook, a desk, etc., the
The
In addition, the
Meanwhile, the
The
Alternatively, the
The
Meanwhile, the
Alternatively, the
On the other hand, the
In the above description, the optical
In other words, the optical
The optical
The
Meanwhile, the
That is, the
In addition, the mouse click operation will be described with respect to the mouse input operation. The mouse click operation refers to an input in which a left or right button of a mouse is clicked by touching two or more fingers while a user performs a mouse input operation while wearing the
The
The means by which the
The
The
The
The
The
The
The
Hereinafter, an embodiment in which the
In addition, the
FIG. 2 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention. The graph shown in Fig. 2 shows the output of the optical signal transmitted by the wearable device according to the wavelength band.
As described above, the wearable device can generate and transmit optical signals of various wavelengths. Hereinafter, a process in which a wearable device transmits optical signals of two different wavelengths will be described in connection with an embodiment of the present invention. For convenience of explanation, the wavelengths of the two optical signals are referred to as a first wavelength and a second wavelength, respectively. The first wavelength means a wavelength in the first frequency band BW1. The second wavelength means a wavelength in the second frequency band BW2. The wavelength of the light. For example, the first frequency band BW1 may be a near-infrared frequency band, and the second frequency band BW2 may be a frequency band of visible light. That is, the wearable device can generate and transmit the first optical signal having the first wavelength of the near-infrared light and the second optical signal having the second wavelength of the visible light line. As another example, the first frequency band BW1 and the second frequency band BW2 may both be near-infrared frequency bands. That is, the wearable device may generate and transmit two optical signals having a near-infrared wavelength.
On the other hand, the wearable device may generate an optical signal having a continuous spectral wavelength, or may generate an optical signal having each wavelength or a wavelength band, in order to output the first optical signal and the second optical signal. Specifically, the wearable device can generate the first optical signal and the second optical signal having different wavelengths, respectively, as shown by the solid line in FIG. On the other hand, the wearable device generates an optical signal having a relatively wide continuous spectrum of wavelengths as shown by the dotted line in Fig. 2, and uses a predetermined filter (for example, a band pass filter) And output optical signals having the first wavelength and the second wavelength.
In the former case, the wearable device may include only one optical signal transmitting unit for generating two optical signals, or may include two or more optical signal transmitting units for generating two optical signals of different wavelengths, respectively. In the latter case, the wearable device may include one single optical signal transmitting unit and may be implemented to include two or more optical signal transmitting units.
FIG. 3 is a diagram illustrating an operation process of a wearable device according to an embodiment of the present invention. 3 illustrates a process in which the wearable device transmits an optical signal to a target and detects a reflected optical signal when the target is a part of the body. In FIG. 3, the
First, as described in FIG. 2, the wearable device generates and transmits optical signals having two or more different wavelengths. In the embodiment of Fig. 3, A1 and B1 having a wavelength of
There are skin tissues and blood vessels inside the human body, each of which is composed of different components. Particularly, blood vessels contain red blood cells containing hemoglobin and become red. These hemoglobin are divided into oxyhemoglobin and deoxyhemoglobin. Oxidized hemoglobin is present in many arteries and transports oxygen to body tissues, and deoxidized hemoglobin is present in a number of veins that carry oxygen to body tissues. In other words, arteries and veins have different physical properties due to differences in the types of hemoglobin located in each. In particular, oxidation / deoxygenated hemoglobin contained in the veins varies in absorption rate as the wavelength of light changes. Since the venous vein containing oxidized / de-oxidized hemoglobin has a relatively high absorption rate for the wavelength of the near infrared region (about 700 to 900 nm) as compared with other surrounding tissues, the amount of scattering / reflection of the optical signal in the near- It will be greatly different. On the other hand, the optical signal in the near infrared region has high absorption rate for oxidized hemoglobin and deoxyhemoglobin in blood vessels, but scattering occurs in surrounding tissues rather than in blood vessels. Therefore, when the optical signal of the near infrared region irradiated to the skin is reflected and received, the difference in contrast between the blood vessels and the surrounding tissues due to the difference in absorption rate is confirmed, and the difference in contrast can be treated as information on the vein pattern.
On the other hand, the wearable device can detect the blood vessels of the body using the difference in physical characteristics between the blood vessels (veins) and other surrounding tissues. That is, the first optical signals A1 and B1 and the second optical signal A2 transmitted from the wearable device have different wavelengths, and a part A1 of the first optical signals A1 and B1 is transmitted to the
The wearable device transmits the first optical signal (A1, B1) and the second optical signal (A2) to the target object, and then receives the reflected optical signal reflected from the target object. The reflected optical signal includes both the optical signal A1 + B1 in which the first optical signals A1 and B1 are reflected from the skin and the vein and the optical signal A2 in which the second optical signal A2 is reflected from the skin . For convenience of explanation, it is assumed that a reflected optical signal (A1 + B1) by the first optical signals A1 and B1 is referred to as a first reflected optical signal and a reflected optical signal by the second optical signal A2 is referred to as a second reflected optical signal (A2).
The wearable device generates reception data through a process for the first reflected optical signal (A1 + B1), and the received data includes both information about skin and blood vessels of the object.
Then, the wearable device resends the second optical signal A2, which is an optical signal having a wavelength different from that of the first optical signals A1 and B1, to the target object. That is, the second optical signal A2 to be newly transmitted is an optical signal having a wavelength different from that of the first optical signals A1 and B1 transmitted by the wearable device or a part A1 of the first optical signals A1 and B1, Information about the skin surface, which is information obtained by the user. That is, the second optical signal A2 is reflected by the skin of the object and is received by the wearable device, and the reflected optical signal A2 by the second optical signal is received from the information contained in the first reflected optical signal A1 + B1 Some of which are similar.
The wearable device generates the received data through the process of the second reflected optical signal A2 and the received data is transmitted to the skin of the target object differently from the received data for the first reflected optical signal A1 + Information only.
The wearable device compares the received data generated based on the first reflected optical signal (A1 + B1) with the received data generated based on the second reflected optical signal (A2). This comparison may include subtracting the data of the second reflected optical signal A2 from the data of the first reflected optical signal A1 + B1 by comparing the difference between the two received data. That is, the wearable device removes the influence of the second reflected optical signal A2 from the data of the first reflected light signal (A1 + B1), thereby obtaining the first reflected light signal (A1 + B1) Can only obtain information about In other words, the wearable device removes information about the skin from the first reflected light signal (A1 + B1) and obtains information about the vessel from the part (B1) of the first reflected light signal (A1 + B1) The data generated by subtracting the data of the two reflected optical signals may be blood vessel data.
Specifically, as will be described later, the wearable device senses a key input operation of a user and generates an input value by utilizing information on blood vessels included in the blood vessel data. Accordingly, the wearable device must be able to operate to accurately extract information about the blood vessel. The wearable device transmits optical signals of two different wavelengths as described above, and calculates the difference therebetween, so that only the information on the blood vessel can be acquired efficiently.
In the above description, the wearable device receives the first reflected light signal and the second reflected light signal, respectively. Hereinafter, how the wearable device separates and detects two reflected optical signals of different wavelengths will be described in detail. The wearable device receives the first reflected light signal of the first wavelength and the second reflected light signal of the second wavelength in three ways.
First, the wearable device can separate and detect the received reflected optical signal according to the wavelength. That is, since the wavelengths of the first reflected optical signal and the second reflected optical signal are different from each other, the wearable device receives the two reflected optical signals together and processes the respective reflected optical signals separately. In other words, the wearable device can transmit the optical signals of the two wavelengths together and process the reflected optical signal by wavelength separately, even if the two reflected optical signals are received together. For example, the wearable device may include a photo detector for discriminating and detecting an optical signal for each wavelength.
In the first example, the wearable device can selectively detect reflected optical signals of different wavelengths. Accordingly, the wearable device alternately transmits or simultaneously transmits the first optical signal of the first wavelength and the second optical signal of the second wavelength, or transmits the other optical signal periodically or non-periodically while continuously transmitting one optical signal. It is possible to distinguish and detect the reflected optical signals even if the optical signals are transmitted in various ways such as periodically transmitting.
Second, the wearable device can distinguish and detect the reflected optical signals in the time domain or the frequency domain. That is, the wearable device can send out optical signals having different wavelengths with a time difference, or transmit the optical signals with different intensity for each wavelength. Unlike the first example, even if the received reflected light signal can not be distinguished by wavelength, the wearable device knows beforehand what time the optical signal of the wavelength is to be transmitted, so that the reflected optical signal received is the reflected optical signal of the wavelength You can guess.
In the second example, the wearable device can transmit the first optical signal of the first wavelength and the second optical signal of the second wavelength alternately. In this case, since the wearable device knows in advance which reflected optical signal received sequentially is a reflected optical signal of an optical signal of a certain wavelength, it is possible to reduce the burden for distinguishing the reflected optical signal by wavelength. In this embodiment, the wearable device may use a method of transmitting two optical signals alternately, transmitting one optical signal continuously, and transmitting another optical signal periodically or non-periodically.
Third, a case where the intensity of the optical signals is transmitted in a different manner can be considered. The wearable device can transmit the output intensity of different optical signals differently, and this embodiment can be applied in combination with the first embodiment and the second embodiment described above. In this embodiment, the wearable device is able to detect the reflected optical signal more efficiently by time or frequency domain because the intensity difference of the reflected optical signals is relatively large.
In the above description, the wearable device transmits the first optical signal and the second optical signal and analyzes the reflected optical signals. However, the optical signal generated and received by the wearable device may be influenced by the ambient light and natural light of the surrounding environment in which the wearable device operates. For example, when a wearable device generates a second optical signal having a wavelength of visible light and transmits the second optical signal to a target object, the reflected optical signal of the second optical signal may be mixed with an optical signal generated by reflecting sunlight on a target object, . Therefore, a process for removing such noise may be required.
There may be various embodiments for eliminating the influence of external light. First, the wearable device can operate to exclude external factors such as natural light, indoor light, and light by a beam projector. That is, the wearable device recognizes the light sensed by the optical signal sensing unit as external light before the optical signal transmitting unit transmits the optical signal. Then, the wearable device can obtain only the reflected optical signal by the optical signal transmitted by the wearable device by removing the influence of the external light in the reflected optical signal detected after transmitting the optical signal.
Second, the wearable device may use external light instead of eliminating the influence of external light. That is, when the wearable device utilizes the optical signal of the near-infrared wavelength as the first optical signal and the optical signal of the visible light wavelength as the second optical signal, the wearable device directly generates the first optical signal and the second optical signal, It is possible to selectively receive external light. More specifically, the wavelengths of the first optical signal and the second optical signal to be generated by the wearable device can be generated by external light. In this case, the wearable device can filter the reflected optical signal generated by reflecting the external light to the object and select the reflected optical signal of the predetermined wavelength to receive the reflected optical signal. Accordingly, the wearable device can obtain the same or similar result by utilizing external light even if the wearable device does not directly generate the optical signal. However, when the external light is used, the optical signal of the desired wavelength may not be sufficiently received. Therefore, the wearable device may analyze the external light received to additionally generate and transmit the optical signal of the required wavelength to supplement external light .
As a result, when a wearable device receives a reflected optical signal having a specific wavelength, it can directly generate an optical signal and transmit it to a target object to obtain a desired result, while achieving the same result by selectively receiving external light .
In the foregoing, embodiments of the present invention have been described using terms such as a first optical signal, a second optical signal, a first reflected optical signal, and a second reflected optical signal. However, the names such as 'first', 'second', and the like are merely terms for distinguishing the respective concepts, and the contents of the invention are not limited to these terms.
Meanwhile, the first optical signal and the second optical signal described above may be optical signals of a near-infrared region and a visible light region, respectively. However, the present invention is not limited to this embodiment, and both the first optical signal and the second optical signal may be optical signals of a near-infrared region or an infrared region. That is, if the wavelength band of the two optical signals is different, the wearable device can transmit the two optical signals, receive the reflected optical signal, and obtain information about the blood vessel. Since the absorbance / scattering / reflectance of the skin, the blood vessel, and the surrounding tissue are different depending on the wavelength of the optical signals, the first and second reflected optical signals in the near-infrared region or the infrared region include different biometric information do. Data on blood vessel patterns can be obtained by comparing / analyzing / combining such information. In other words, the wearable device acquires information about the blood vessel by transmitting two or more optical signals, and the frequency band and the kind of the optical signal are not limited. Therefore, even though the near infrared ray region and the visible ray region are exemplified above and hereinafter, such contents may be applied to an embodiment in which optical signals of different frequency bands are used.
According to another embodiment, the wearable device can acquire information on the blood vessel with only one optical signal, instead of using the two optical signals. That is, as described above, the optical signal in the near infrared region (700 nm to 900 nm) has different absorption and scattering in blood vessels and surrounding tissues. As the spectrum and wavelength of the optical signal are different, the reflectance varies depending on the skin tissue layer. The wearable device can compare the contrast, analyze / combine such information, check the contrast difference between the blood vessel and the surrounding tissue, and grasp the pattern of the blood vessel. Of course, a method in which a wearable device transmits and receives three or more optical signals is also applicable. In the process of using two or more optical signals, optical signals have different wavelengths, different spectrums, different transmission times (time points), different reception times (different time points), different frequencies, May be different.
In general, the wearable device transmits a plurality of optical signals having different wavelengths in the visible light region and the infrared region, receives the reflected optical signals, and compares / analyzes / combines the wavelengths of the optical signals to generate image data Can be obtained.
Alternatively, the wearable device may acquire image data of a blood vessel and a surrounding tissue by a method of transmitting and receiving only one optical signal in a single near-infrared region, and may know a pattern of a blood vessel. As a result, the wearable device can transmit and receive one or more optical signals to obtain information about the blood vessel.
As a preferred embodiment, the wearable device transmits and receives two or more optical signals in the process of acquiring blood vessel data for the first time, and then operates to transmit and receive one optical signal in the process of sensing the key input operation of the user It is possible. In contrast, the wearable device may generate pattern information for a blood vessel using only one optical signal in the process of acquiring blood vessel data for the first time, and then may use two or more different optical signals in a driving process of grasping the movement of the user.
4 to 7, a description will be given of a process in which the wearable device acquires information on blood vessels and generates an input value according to the procedure described above. FIG. 4 is a diagram illustrating an operation process of a wearable device according to an embodiment of the present invention. 4 illustrates an embodiment in which the
As described above, the
That is, the optical
The
5 is a view for explaining the operation of the wearable device according to an embodiment of the present invention. FIG. 5 illustrates a process in which a wearable device creates a three-dimensional model of a user's hand.
First, the embodiment shown on the left side of FIG. 5 will be described. The depth sensor of the wearable device senses the hand of the target chain user three-dimensionally and generates three-dimensional scan information. As shown, a wearable device may be mounted on another body part (e.g., the right hand thumb) instead of the left hand thumb to scan the entire user's left hand. The user can move the right hand equipped with the wearable device around the left hand and let the depth sensor scan the left hand in three dimensions.
On the other hand, information about the palm surface is important for the wearable device rather than the user's hand. Accordingly, in order for the wearable device to accurately acquire the three-dimensional scan information on the user's palm surface, the user scans slowly when the detection sensor looks at the palm surface of the left hand, and when the detection sensor looks at the palm surface of the left hand, You can scan at a faster rate than the palm of your hand. Alternatively, if it is not necessary to accurately acquire the three-dimensional information on the back of the hand, the user may omit the three-dimensional scanning process on the back of the hand.
The depth sensor generates three-dimensional scan information for the user's hand and transmits the corresponding information to the image processing unit. The image processor analyzes and processes the three-dimensional scan information to generate a three-
On the other hand, the three-
Accordingly, a process of adding a pattern to the three-
The process of generating the pattern information by sensing the blood vessel by the wearable device may be performed simultaneously with the process of generating the three-dimensional scan information by the depth sensor, or separately. That is, while the depth sensor recognizes the hand of the object in three dimensions and generates three-dimensional scan information, the optical signal sensing unit senses the blood vessel and the data processing unit can generate the pattern information. In this case, the 3D scan information and the pattern information about the blood vessel are transmitted to the image processing unit, and the image processing unit sequentially processes the two information to generate the three-dimensional model. In this embodiment, the three-
Alternatively, when the depth sensor generates the three-dimensional scan information by scanning the hand of the object and the image processing unit generates the three-dimensional model using the three-dimensional scan information, the optical signal sensing unit and the data processing unit A process can be additionally performed. In this case, the wearable device must scan the target chain twice. That is, in the former case, both of the three-dimensional scan information and the pattern information are generated in one scan process, whereas in the latter case, the three-dimensional scan information is generated through the first scan and the pattern information is generated through the second scan . In the latter case, the image processing unit generates the three-dimensional model in advance, and then processes the received pattern information.
The pattern information generated by the data processing unit is transferred to the image processing unit, and the process of applying the
FIGS. 6 and 7 illustrate an embodiment in which the wearable device analyzes the user's operation using the three-dimensional model and the blood vessel pattern. FIG. FIG. 6 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention.
As described with reference to FIG. 5, the image processing unit generates a three-dimensional model of a target object (for example, a left hand of the user) using the three-dimensional scan information and the pattern information. After the initial process of generating the three-dimensional model is performed, the
When the user performs a key input operation (i.e., typing), the position and arrangement of the blood vessels of the hand in the space change according to the movement of the fingers. For example, as the fingers are bent, the angles between the first and second nodes of the finger become smaller, and they are disposed adjacent to each other. Accordingly, the distribution and arrangement of the blood vessels detected by the optical signal sensing unit of the
Meanwhile, the
For example, the
The
In summary, the
FIG. 7 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention. In FIG. 7, the x / y / z axis represents the three-dimensional space, and the line connecting the origin, P1, P2, P3, and P4 represents the skeleton of the user's wrist and finger when the object is the user's hand. P2 is the joint between the first node and the second node, P3 is the joint between the second node and the third node, and P3 is the joint between the second node and the third node. , And P4 indicates the fingertip, respectively.
As described in FIG. 6, the wearable device can calculate the three-dimensional position and bend angle of the joint to which the first and second nodes of the user's finger are connected. That is, the wearable device can calculate an angle? 2 and a three-dimensional position of P2 in FIG. On the other hand, since the wearable device generates and stores a three-dimensional model of the user's hand, calculating the three-dimensional position of P2 means calculating the distance d1 from the center of the wrist to P2.
On the other hand, similarly to the case of P2, the wearable device can calculate θ1 and the three-dimensional position of the joint P1 between the palm and the first node. Alternatively, the wearable device can previously calculate the distance from the center of the wrist to the joint between the palm and the first node in the process of generating the three-dimensional model, that is, the position of P1. In this case, the wearable device can be calculated through comparison of the patterns of blood vessels in a manner similar to? 2 for? 1. That is, the wearable device can calculate the position and bend angle of each joint by comparing the distribution position, size, and appearance change of the blood vessel in each joint with the pre-stored pattern.
On the other hand, assuming that the user's hand is bent according to the natural motion, if the coordinates of P1, the coordinates of P2, θ1, and θ2 are known, all the coordinates of P3, θ3 and P4 can be calculated. This process is an experimental method and can be viewed as an estimation by experience. However, as long as the user does not consciously bend the finger joints at an abnormal angle, the coordinates of P3 and the angle θ3 can be known with high accuracy from the relationship of P1, P2, θ1 and θ2. Similarly, P1, P2, P3, , &thetas; 3, the positional information of P4 can be accurately estimated.
In the above process, the range of? 1,? 2,? 3 may be a problem. That is, θ1, θ2, and θ3 should be measured to be within 180 degrees. When the user lifts his or her finger high, the joint connecting the user's palm and the first node may be measured at 180 degrees or more. However, this angle is far from normal key input operation. Accordingly, the wearable device can acquire only meaningful values that are within 180 degrees of each angle in measuring the angles? 1,? 2,? 3 of the finger joints. The wearable device may be implemented so as to ignore values when the angles? 1,? 2,? 3 are measured to be 180 degrees or more, or conversely, a case where the measured angles are 180 degrees or more may be mapped to a specific operation and processed separately.
On the other hand, there are various methods for improving the accuracy of the estimation process. For example, after the process of generating a three-dimensional model of the hand is first performed, the wearable device can instruct the user to perform an operation for inputting a specific key. When the wearer device senses such an operation and estimates P3, P4, and &thetas; 3, the wearable device can know in advance which value should be compensated. That is, software compensation can be performed in the process of calculating the input value according to the key input operation of the user.
Alternatively, the wearable device may measure the 3-dimensional position of P3 and? 3 directly. That is, the optical signal sensing unit and the data processing unit compares the blood vessel near the joint, which connects the second and third nodes of the finger, with the blood vessel pattern of the three-dimensional model, and measures the three- It is possible. In this case, since the wearable device directly measures P1, P2, P3, θ1, θ2, θ3, and d2, the accuracy in the process of estimating P4 is greatly increased. Alternatively, the above-described software compensation process may be performed in combination with a method of directly measuring P3 and? 3.
As a result, the wearable device senses the key input operation according to the user's typing and generates an input value by determining which key the corresponding key input operation is matched with. Such an input value can be transmitted to an external device or a server connected to the wearable device, and the wearable device operates as an input means.
Hereinabove, an embodiment has been described in which the key input operation for sensing, stopping, ringing, and holding of the user's finger is detected. Meanwhile, the wearable device should also be able to detect the key input operation of the thumb. First, the case where the wearable device is mounted on the thumb will be described. The wearable device can directly measure the position of the thumb, which is a finger attached to the wearable device, or indirectly estimate it.
When the wearable device is mounted on the thumb and directly measures the key input operation of the thumb, the optical signal sensing unit and the data processing unit sense an angle sufficient to recognize the position of the thumb tip. Accordingly, the wearable device can calculate the three-dimensional position information of the thumb tip to which the wearable device is attached. In addition, the wearable device can also calculate how far it is mounted on the thumb from the position of the thumb tip.
Alternatively, when the wearable device indirectly measures the key input operation of the thumb, the wearable device can estimate the position of the thumb mounted by itself from the positions of the joints of the other four fingers. That is, the wearable device can estimate its three-dimensional position from P1, P2 positions of the other four fingers. When the wearable device estimates its position using P1 or P2, it utilizes P1 or P2 of four fingers, that is, four pieces of position information, and when the wearable device estimates its position using P1 and P2 , And estimates its position using eight positional information. That is, since the wearable device has a sufficient number of pieces of information for specifying its position on the three-dimensional space, it can estimate the position of the thumb located on the basis of the position information of other four finger joints. The two ways in which the thumb measures / estimates its position can be similarly applied when the wearable device is mounted on the index finger, the stop finger, the finger grip, and the base. That is, the wearable device can also measure the position of the thumb tip on which the wearable device is mounted.
On the other hand, when the wearable device is mounted on a finger other than the thumb and detects the thumb, the thumb has a different structure from the other four fingers, and therefore another process of measuring the position and angle with respect to the thumb is required.
Unlike the other four fingers, the thumb includes the joint where the palm and the first node are connected, and the joint where the first and second nodes are connected. That is, the wearable device can measure the position of the thumb tip even if only the positions of the two joints of the thumb are acquired. Accordingly, when the wearable device is attached to another finger instead of the thumb, P3 measured from P1, P2,? 1,? 2 with respect to the thumb is the position of the fingertip. Accordingly, the wearable device can measure the position of the thumb tip with higher accuracy than the other four fingers.
In the above description, the wearable device senses the blood vessel of the joint part of the finger, compares it with the previously stored pattern, and detects the key input operation to calculate the three-dimensional position of the fingertip. As described above, the three-dimensional position of the fingertip is matched with a specific input value, and the wearable device confirms which key is pressed by the key input operation from the three-dimensional position of the finger, generates the confirmed key as an input value can do.
Hereinafter, an embodiment in which a wearable device senses a blood vessel near a node of a finger will be described, unlike the above description. That is, the wearable device can grasp not only the finger joint but also the three-dimensional position of the fingertip by detecting the blood vessels of the finger joint. For example, a wearable device can sense the position and angle (P1, θ1) of the joint connecting the palm and the first node of the finger by detecting the arrangement and distribution of the blood vessels of the first node of the palm and fingers, By detecting the blood vessels of the second node, the position and angle (P2, θ2) of the joint connecting the two nodes can be detected. The process of estimating the position of the fingertip by measuring the position of the two joints can be similarly applied to the embodiment described above.
Furthermore, the wearable device can sense the position of the joint even if only one finger node is detected. That is, since the pattern information of the blood vessel added to the three-dimensional model may be three-dimensional information, it can be described that information about the thickness and slope of the blood vessel can be included. Accordingly, the wearable device can recognize the position of another joint by sensing a blood vessel in a single finger node and comparing it with a previously stored pattern. With respect to this embodiment, as the finger joints are bent, not only the arrangement and position of the blood vessels change, but also the brightness and the saturation of the blood vessels change. That is, as the fingers are bent, fingers of the fingers are overlapped and wrinkles are formed. As a result, the wearable device can grasp the position of the fingertip in consideration of transparency, lightness, and saturation of the blood vessel to be sensed.
FIG. 8 is a view for explaining an operation procedure of a wearable device according to an embodiment of the present invention. 8 illustrates an embodiment in which the wearable device detects a mouse input operation and a mouse click operation of a user and generates a cursor value and a click value.
When the
First, an embodiment in which the
On the other hand, the reference position of the cursor value may be the
Next, the mouse click operation will be described. The
Meanwhile, as the
Alternatively, the
Then, the
The
9 is a view for explaining the operation of the wearable device according to an embodiment of the present invention. 9, an embodiment in which the
1, the
Meanwhile, when the
Then, the
In the above-described embodiment, a process of fixedly outputting the
That is, the
Meanwhile, in the process of fixing and outputting images by the
As another example, the
As another example, the
As another example, the
10 is a view showing an embodiment of a wearable device according to another embodiment of the present invention. Although the embodiments in which the
10A, the
In the embodiment of Fig. 10 (b), the
As described above, regardless of the implementation of the
In the foregoing, the
For convenience of explanation, when the
However, in order for the
There are several ways to solve this problem. For example, the
As another example, the
In another example, an external sensor may be present to sense the movement of the
Regardless of the example, the
It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed methods should be considered in an illustrative rather than a restrictive sense. It is intended that the present invention cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.
Claims (15)
An optical signal transmitter for transmitting an optical signal;
An optical signal detection unit receiving the reflected optical signal generated by reflecting the optical signal to a target object;
A data processing unit for processing the received reflected optical signal; And
And a key determiner for detecting a key input operation of the user based on the processed data of the reflected optical signal and generating an input value matched with the key input operation,
Wherein the optical signal transmitting unit transmits one or more optical signals,
Wherein the optical signal sensing unit receives one or more reflected optical signals by the at least one optical signal,
Wherein the data processing unit generates pattern information on the blood vessel of the object based on the at least one reflected optical signal,
Wherein the key determining unit detects the key input operation by comparing information on the blood vessel that changes according to a key input operation of the user with the pattern information.
When the optical signal transmitting unit transmits one optical signal,
Wherein the data processing unit obtains the blood vessel data by comparing light and dark differences between the blood vessel and the surrounding tissue in the data obtained by processing one reflected optical signal by the one optical signal.
Wherein the data processing unit generates pattern information on the blood vessel using the blood vessel data.
Wherein the one optical signal is an optical signal in a near-infrared region.
When the optical signal transmitting unit transmits two or more optical signals,
Wherein the data processing unit obtains the blood vessel data by comparing the processed data of the two or more reflected optical signals by the at least two optical signals.
Wherein the at least two optical signals are optical signals in a near-infrared region or an infrared region, and at least one of a wavelength, a time to be transmitted, a time, a frequency, and a polarization state is different.
The wearable device
A depth sensor for detecting the object in three dimensions and generating three-dimensional scan information; And
Further comprising a video processing unit for generating a three-dimensional model of the object based on the three-dimensional scan information, and adding a pattern representing the blood vessel to the three-dimensional model based on the pattern information.
The wearable device
Wherein the key input operation is detected by comparing information on the blood vessel that changes according to the key input operation to the pattern added to the three-dimensional model.
Wherein the information about the blood vessel is obtained by detecting at least one distribution of hue, saturation, and brightness caused by the blood vessel in the object by the optical signal sensing unit.
Wherein the key determiner comprises: a first joint that connects the first palm of the finger with the palm of the user based on the sensed key input operation; a third joint that connects the first palm of the finger with the second palm of the finger, And generates the input value based on the three-dimensional position of the first joint and the second joint.
Wherein the key determiner determines a three-dimensional position of the first joint and the second joint and an angle at which the first joint and the second joint are bent, and determines a three-dimensional position of the first joint and the second joint according to an angle of the two joints Dimensional position of the end of the finger where the key input operation is sensed.
Wherein the optical signal sensing unit senses the first reflected optical signal and the second reflected optical signal, respectively, by separating the received reflected optical signal according to a wavelength.
Wherein the optical signal sensing unit senses the first reflected optical signal and the second reflected optical signal separately received in a time domain or a frequency domain, respectively.
An optical signal transmitter for transmitting an optical signal;
An optical signal detection unit receiving the reflected optical signal generated by reflecting the optical signal to a target object;
A data processing unit for processing the received reflected optical signal;
A position determiner for measuring a distance and an angle with respect to the object based on the data obtained by processing the reflected optical signal; And
And an image output unit for outputting an image to the outside,
Wherein the optical signal transmitting unit transmits one or more optical signals,
Wherein the optical signal sensing unit receives one or more reflected optical signals by the at least one optical signal,
Wherein the data processing unit generates pattern information on the blood vessel of the object based on the at least one reflected optical signal,
Wherein the positioning unit compares the pattern information with previously stored blood vessel information to measure a distance and an angle with the target object,
Wherein the image output unit outputs the image at a fixed size in a fixed position based on the distance and the angle.
The wearable device,
And a finger recognition unit for generating pattern information on the skin line by sensing the skin line of the user's finger,
Wherein the image output unit fixes and outputs the image by comparing pattern information of the skin line with pattern information of a previously stored skin line.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150061522A KR20160129406A (en) | 2015-04-30 | 2015-04-30 | Wearable device |
US15/517,923 US10474191B2 (en) | 2014-10-15 | 2015-10-14 | Wearable device |
PCT/KR2015/010825 WO2016060461A1 (en) | 2014-10-15 | 2015-10-14 | Wearable device |
US16/601,359 US10908642B2 (en) | 2014-10-15 | 2019-10-14 | Movement-based data input device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150061522A KR20160129406A (en) | 2015-04-30 | 2015-04-30 | Wearable device |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20160129406A true KR20160129406A (en) | 2016-11-09 |
Family
ID=57528980
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150061522A KR20160129406A (en) | 2014-10-15 | 2015-04-30 | Wearable device |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20160129406A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190059443A (en) | 2017-11-23 | 2019-05-31 | 주식회사 라온즈 | Optical sensing module for wearable smart device and portable smart device |
-
2015
- 2015-04-30 KR KR1020150061522A patent/KR20160129406A/en unknown
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20190059443A (en) | 2017-11-23 | 2019-05-31 | 주식회사 라온즈 | Optical sensing module for wearable smart device and portable smart device |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10908642B2 (en) | Movement-based data input device | |
US10747260B2 (en) | Methods, devices, and systems for processing blood vessel data | |
KR101524575B1 (en) | Wearable device | |
US20210011560A1 (en) | Wearable Device | |
US10817594B2 (en) | Wearable electronic device having a light field camera usable to perform bioauthentication from a dorsal side of a forearm near a wrist | |
EP3035164B1 (en) | Wearable sensor for tracking articulated body-parts | |
EP2984541B1 (en) | Near-plane segmentation using pulsed light source | |
US10264998B2 (en) | Blood vessel imaging apparatus and personal authentication system | |
KR101235432B1 (en) | Remote control apparatus and method using virtual touch of electronic device modeled in three dimension | |
US11132057B2 (en) | Use of light transmission through tissue to detect force | |
US20090174578A1 (en) | Operating apparatus and operating system | |
KR102609766B1 (en) | Skin care device | |
KR101552134B1 (en) | Wearable device | |
TWI596378B (en) | Portable virtual reality system | |
KR20200137830A (en) | Electronic device and method for correcting biometric data based on distance between electronic device and user measured using at least one sensor | |
US20190339768A1 (en) | Virtual reality interaction system and method | |
KR20160129406A (en) | Wearable device | |
KR101524576B1 (en) | Wearable device | |
Gonzalez et al. | A 2-D infrared instrumentation for close-range finger position sensing | |
KR20210111619A (en) | Method, system and non-transitory computer-readable recording medium for estimating user's gesture from 2d images | |
JP2016115310A (en) | Electronic apparatus | |
KR20200120467A (en) | Head mounted display apparatus and operating method thereof | |
WO2015160589A1 (en) | Fingerprint based input device |