DE102014119034A1 - Provide tactile feedback for gesture-based input - Google Patents

Abstract

A system and method for providing tactile feedback for gesture-based input is provided herein. The system includes a gesture-based input receiver for receiving a hint from a gesture-based system associated with a specific gesture; a tactile fetcher to retrieve a tactile response based on the specific gesture; and a tactile transmitter to transmit the tactile response to a haptic generator, wherein the haptic generator is configured to provide the tactile response.

Description

Cross-reference to related applications

This patent application claims priority over US Provisional Patent Application No. 61 / 921,001, filed December 26, 2013, entitled "Providing Tactile Feedback for Gesture Based Inputs". This patent application contains the entire detailed description of US Patent Application No. 61 / 921,001.

General state of the art

Various interfaces and machines use gesture-based input. The gesture-based inputs allow movement of a trigger stimulus, such as a body part (usually the hand), to be detected, and a command is triggered based on the detected motion or gesture. The gesture-based inputs do not require the user to contact a touch pad or device.

The gesture is recorded by a video camera or a motion detector. Accordingly, the video camera picks up the motion, equalizes the motion with a stored command center (i.e., a processor and memory device), and translates the motion into action.

Gesture-based input can be implemented in different locations. For example, the gesture-based input may be implemented in a vehicle, thereby allowing the driver of the vehicle to safely operate the vehicle without worrying about making physical contact with an input device.

For example, pointing with a finger may trigger in a direction that the vehicle activates a direction indicator. In another case, flicking a hand may activate a windshield wiper. In all of these cases, the actual association between the motion and the command being activated may be programmable and configurable.

Description of the drawings

The detailed description refers to the following drawings in which like numerals refer to like elements. Show it:

1 a block diagram illustrating an exemplary computer.

2 is an example of a system for providing tactile feedback for a gesture-based input system.

3 FIG. 10 is an example of a method for providing tactile feedback to a gesture-based input system.

Summary

Example embodiments disclosed herein provide a system and method for providing tactile feedback for gesture-based input. The system includes a gesture-based input receiver for receiving a hint from a gesture-based system associated with a specific gesture; a tactile fetcher to retrieve a tactile response based on the specific gesture; and a tactile transmitter to transmit the tactile response to a haptic generator, wherein the haptic generator is configured to provide the tactile response.

Additional features of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention.

It should be understood that both the foregoing general description and the following detailed description are exemplary and explanatory in nature and are intended to provide further explanation of the claimed invention.

Detailed description

The invention will now be described more fully with reference to the accompanying drawings, in which embodiments of the invention are shown. However, this invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Instead, these embodiments are provided so that this disclosure will be thorough and will convey the full scope of the invention to those skilled in the art. It is understood that "at least one of" for the purposes of this disclosure is interpreted as referring to any combination of the elements listed by the corresponding designation, including a combination of several of the listed elements. For example, "at least one of X, Y, and Z" is to be construed as only X, only Y, only Z, or any combination of two or more elements X, Y, and Z (eg, XYZ, XZ, YZ, X) , It should be understood that like drawing reference numerals will be used throughout the drawings and the drawings refer to the same elements, features and structures, unless otherwise described. The relative size and appearance of these elements may be exaggerated for purposes of clarity, illustration, and convenience. Gesture-based input is used in a variety of situations and contexts.

Detailed description

The invention will now be described more fully with reference to the accompanying drawings, in which exemplary embodiments of the invention are shown. However, this invention may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Instead, these exemplary embodiments are provided so that this disclosure will be thorough and will convey the full scope of the invention to those skilled in the art. It is understood that "at least one of" for the purposes of this disclosure is interpreted as referring to any combination of the elements listed by the corresponding designation, including a combination of several of the listed elements. For example, "at least one of X, Y, and Z" is to be construed as only X, only Y, only Z, or any combination of two or more elements X, Y, and Z (eg, XYZ, XZ, YZ, X) , It should be understood that like drawing reference numbers throughout the drawings and the detailed description consistently refer to the same elements, features, and structures, unless otherwise described. The relative size and appearance of these elements may be exaggerated for purposes of clarity, illustration, and convenience.

Gesture-based input is used in a variety of situations and contexts. Gesture-based input allows a user or operator to interact with an input or interface without contacting a user interface. Gesture-based input is aided by a camera or recognition technique that allows a gesture to be taken and a machine or system to be controlled accordingly. The gesture can refer to any part of a body that can be controlled or moved. For example, shaking with one hand or pointing a finger may refer to a gesture.

Interacting with a surface often gives users or operators feedback associated with touch and physical contact. Accordingly, users often experience a haptic perception. Haptic technology or feel is a tactile feedback technology that utilizes the sense of touch by applying forces, vibrations or movements to the user.

Because gesture-based input has no tactile feedback, it often misses the feedback associated with touch-based technologies. This can be unsatisfactory for a user.

There are provided systems and methods for providing tactile feedback for gesture-based inputs. In accordance with the aspects disclosed herein, gesture-based input technology is integrated with tactile feedback technology, thereby enabling a more inclusive and satisfying user experience.

1 is a block diagram illustrating an exemplary computer 100 represents. The computer 100 includes at least one processor 102 that with a chipset 104 is coupled. The chipset 104 includes a memory control node 120 and an input / output (I / O) control node 122 , A store 106 and a graphics adapter 112 are with the memory control node 120 coupled and an ad 118 is with the graphics adapter 112 coupled. A storage device 108 , a keyboard 110 , a pointing device 114 and a network adapter 116 are with the I / O control node 122 coupled. Other embodiments of the computer 100 can have different architectures.

The storage device 108 is a non-volatile, computer-readable storage medium such as a hard disk, CD-ROM, DVD or solid state storage device. The memory 106 contains instructions and data supplied by the processor 102 be used. The pointing device 114 is a mouse, trackball or other type of pointing device and is used in combination with the keyboard 110 used to data in the computer 100 enter. The pointing device 114 may also be a game system controller or any type of device used to control the gaming system. For example, the pointing device 114 be connected to a video or image capture device that uses biometric scans to recognize a specific user. The specific user can use movement and gestures to the pointing device 114 to instruct different aspects of the computer 100 to control.

The graphics adapter 112 shows pictures and other information on the display 118 at. The network adapter 116 couples the computer system 100 with one or more computer network (s).

The computer 100 is adapted to provide computer program modules for providing herein described functionality. The term "module" as used herein refers to computer program logic used to provide the specified functionality. Thus, a module may be implemented in hardware, firmware, and / or software. In one embodiment, program modules are stored in the storage device 108 stored in the memory 106 loaded and through the processor 102 executed.

The types of computers used by the devices and processes disclosed herein may vary depending on the embodiment and processor performance required by the device. The computer 100 may be a mobile device, tablet, smartphone, or any type of computing element with the items listed above. For example, a data storage device, such as a hard disk, a solid state memory, or a storage device, may be stored in a distributed database system that includes a plurality of blade servers that work together to provide the functionality described herein. The computers may lack some of the components described above, such as keyboards 110 , Graphic adapters 112 and ads 118 ,

The computer 100 may act as a server for the content sharing service disclosed herein (not shown). The computer 100 can work with other computer devices 100 in a cluster network to form the server.

2 is an example of a system 200 to provide tactile feedback for a gesture-based input system. The system 200 includes a gesture input receiver 210 , a tactile caller 220 and a tactile transmitter 230 , The system 200 can be implemented on a device, such as the computer 100 ,

The system 200 can be implemented in any environment or situation where a gesture-based input system 250 is used. For example, the gesture-based input system may 250 are located in a vehicle and used to monitor the gestures made by an operator or passenger of the vehicle. Accordingly, while the operator is driving the vehicle, the operator can make gestures in the gesture recognition area 260 To run. Accordingly, the gesture-based input system 250 the in the gesture recognition area 260 detected gesture and a corresponding signal or a note to the system 200 transfer.

The gesture input receiver 210 receives the hint from the gesture-based input system 250 , As shown, the gesture recognition area 260 recognize a hand gesture in the gesture recognition area 260 is performed. For example, if the hand gesture of an operator or driver of a vehicle indicates that the operator or driver of the vehicle is pointing in a particular direction, the gesture-based input system may 250 capture this.

The tactile receiver 220 can have a permanent memory 205 (which is any of the above with reference to storage device 108 listed storage devices can) retrieve a corresponding tactile response. The corresponding tactile response may be a physical stimulus associated with the source of the gesture.

The permanent memory 205 can a lookup table 206 to save. An exemplary implementation of a lookup table 206 is in 5 shown. 5 shows a lookup table 206 That together with an implementation of the system 200 provided. The lookup table 206 is merely exemplary in nature and may be provided in various forms, with various combinations or modifications of the fields illustrated therein.

The lookup table 206 includes a gesture field 501 , a tactile reaction 502 and an "area?" field 503 , Depending on the detection performed and whether or not the detected gesture was executed within a predefined range, the specific tactile response can be retrieved.

If the system 200 For example, if implemented in a vehicle, the physical response may correspond to vibration or irritation in the armrest area. Thus, while the operator of the vehicle is gesturing, a corresponding physical stimulus can be triggered on an armrest area.

The actual physical response may be through an implementer of the system 200 be configurable. In addition, a toggle switch or a change option may be provided to enable or disable this option. The actual physical response and position of the tactile feedback may also be determined by the implementer of the system 200 or an end user configurable.

The tactile transmitter 230 transmits the tactile response to the corresponding control circuit 275 that is associated with reproducing the tactile feedback. If it is determined that the tactile feedback is a physical vibration in an armrest position, the tactile transmitter may 230 thus sending a signal to a control circuit which causes vibration through the armrest of the vehicle triggers. The tactile transmitter 230 transmits the signal to the tactile physical area 270 , Accordingly, the tactile physical area 270 reproduce the tactile response, and when the user touch the physical area 270 touched, the end user may experience a physical reaction (such as a vibration or a small displacement of the area).

In another example, the tactile physical area may be 270 in an area or portable device to make contact with a wrist or part of a body that is substantially close to the wrist or fingers. The tactile physical area 270 can be located in other sections of the environment in which the system 200 is arranged, such as a seat, a padding or any other ergonomic area with which the body of a user may be in contact.

3 shows a method 300 to provide tactile feedback for a gesture-based input system.

In process 310 a gesture-based input signal is received. As explained above, the gesture may correspond to a recorded contactless control or input signal. The gesture can be detected by a motion detection device or a camera.

In process 320 The gesture-based input signal is correlated with a tactile response. The actual tactile response may be selectively configured based on the position of the tactile response, an end user receiving the tactile response, a predetermined configuration, the gesture that triggers the tactile response, or any combination thereof.

In process 330 it is determined if the function is activated and in process 340 The tactile response is communicated to the device as a command signal that triggers the tactile response. Accordingly, a physical area implemented near a gesture-based input area may be used to generate the tactile response. If the procedure 300 For example, if implemented in a vehicle, the tactile response can be reproduced when the elbows of a driver of the vehicle rest on an armrest area.

4 (a) and 4 (b) show an exemplary implementation of the system 200 , In 4 (a) takes a limb 400 a three-dimensional area 260 one with a gesture recognition system 250 is linked. As shown, the various components (wired or wireless, for example) communicate through a system 200 , The system 200 is with a tactile control circuit 275 coupled with a haptic generator 270 is coupled. The limb 400 resting on the haptic generator 270 (For example, as if the limb 400 resting on an armrest). In another example, the haptic generator 270 be implemented by a portable device.

With reference to 4 (b) beckons the limb 400 now on one by the movement 410 illustrated way. According to an example associated with the aspects disclosed herein, a tactile response may be provided by the haptic generator 270 be generated. Accordingly, the haptic generator 270 vibrate as if through the lines of movement 271 shown.

Thus, using the aspects disclosed herein, a contactless gesture-based input system with physical tactile responses can be fully integrated. Accordingly, the end user is provided a more realistic and satisfying user experience.

Certain of these in 1 shown devices include a computer system. The computer system includes a processor (CPU) and a system bus that couples various system components, including a system memory such as read-only memory (ROM) and random access memory (RAM), to the processor. Other system memory may also be available for use. The computing system may include more than one processor or a cluster or cluster of computing systems that are networked together to provide higher processor performance. The system bus may be any of various types of bus structures, including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. A simple ROM stored input / output (BIOS) or the like may provide basic routines that help to transfer information between elements in the computer system, such as during startup. The computer system further includes data stores that can manage a database in accordance with known database management systems. The data stores may be in many forms, such as a hard disk drive, a magnetic disk drive, an optical drive, a tape drive, or other type of computer readable medium that can store data that the processor can access, such as magnetic cassettes, flat memory cards, DVDs , Endless tape cassettes, random access memory (RAM) and read-only memory (ROM). The data memories can be connected via a driver interface with the System bus connected. The data stores provide nonvolatile storage of computer readable instructions, data structures, program modules, and other data for the computer system.

To facilitate interaction with a human user (and in some cases, a machine), the computing device may include an input device such as a voice and audio microphone, a touch screen for gesture or graphic input, a keyboard, a mouse, a motion input, and so on. An output device may include one or more of a plurality of output mechanisms. In some cases, multimodal systems allow a user to provide multiple types of input to communicate with the computer system. A communication interface generally allows the computing device system to communicate with one or more other computing devices using various communications and network protocols.

The above disclosure is directed to a plurality of flowcharts and accompanying descriptions to provide for in 3 represent illustrated embodiments. The disclosed devices, components and systems contemplate the use or implementation of any suitable technique for performing the steps illustrated in these figures. 3 Accordingly, it is for illustrative purposes only and the described or similar steps may be performed at any convenient time, including concurrently, individually or in combination. In addition, many of the steps in these flowcharts may occur concurrently and / or in different orders than shown and described. Further, the disclosed systems may utilize processes and methods with additional, fewer, and / or different steps.

The embodiments disclosed herein may be implemented in digital electronic circuits or in computer software, firmware, or hardware, including the structures and their elements disclosed herein. Some embodiments may be implemented as one or more computer program (s), i. H. one or more modules of computer program instructions encoded on a tangible computer storage medium for execution by one or more processors. A computer storage medium may be or may be included in a computer readable storage device, a computer readable storage substrate, or a random access memory or serial access memory. The computer storage medium may also be or include one or more separate tangible component (s) or media such as multiple CDs, disks, or other storage devices. The computer storage medium contains no transitory signal.

As used herein, the term processor includes all types of devices, devices, and machines for processing data, including, for example, a programmable processor, a computer, a system on a chip or more, or combinations of the foregoing. The processor may include special logic circuits, e.g. As an FPGA (Field Programmable Gate Array) or an ASIC (application-specific integrated circuit). The processor may also include, in addition to hardware, code that generates an execution environment for a particular computer program, e.g. Code constituting processor firmware, a protocol stack, a database management system, an operating system, a cross-platform execution environment, a virtual machine, or a combination of one or more of them.

A computer program (also known as a program, module, engine, software, software application, script or code) may be written in any form of programming language, including compiled or interpreted language, declarative or procedural languages, and the program may be used in any form including as a stand-alone program or as a module, component, subroutine, object or any other device suitable for use in a computing environment. A computer program may correspond to a file in a file system, but this is not mandatory. A computer program may be stored in a portion of a file containing other programs or data (eg, one or more scripts stored in a markup language document) in a single file associated with the particular program or is stored in multiple coordinated files (eg, files that store / store one or more modules, subprograms, or sections of code). A computer program may be used to run on one or more computers that may be located at one site or distributed over multiple sites and through a communications network.

To provide for interaction with a person, the embodiments disclosed herein may be implemented using an interactive display, such as a graphical user interface (GUI). Such GUIs may include interactive functions such as pop-up or drop-down menus or lists, selection items, scannable features, and other features that may receive human input.

The computer system disclosed herein may include clients and servers. A client and server are generally remote from each other and typically interact over a communications network. The relationship between client and server arises because computer systems are running on the respective computers and have a client-server relationship. In some embodiments, a server transmits data (eg, an HTML page) to a client device (eg, for displaying data to a user and receiving user input from a user interacting with the client device). , Data generated in the client device (eg, a result of user interaction) may be received by the client device at the server.

It will be apparent to those skilled in the art that various modifications and variations can be made to the present invention without departing from the spirit or scope of the invention. Accordingly, the present invention is intended to cover the modifications and variations of this invention provided they come within the scope of the appended claims and their equivalents.

Claims (15)

A system for providing tactile feedback for a gesture-based input, comprising: a gesture input receiver for receiving an indication from a gesture-based input system associated with a specific gesture; a tactile fetcher to retrieve a tactile response based on the specific gesture; and a tactile transmitter to transmit the tactile response to a haptic generator, wherein the haptic generator is configured to transmit the tactile response. The system of claim 1, wherein the gesture-based input system is implemented in a vehicle. The system of claim 2, wherein the haptic generator is located in an armrest of the vehicle. The system of claim 1, wherein the gesture input receiver is configured to detect whether the gesture is performed in a predefined area and the tactile response is based on the gesture executed in the predefined area. The system of claim 1, wherein a first tactile response is associated with a first gesture and a second tactile response is associated with a second gesture, wherein the first gesture and the second gesture are different. The system of claim 1, wherein the haptic generator is implemented in a wearable device. A method of providing tactile feedback for a gesture-based input, comprising: Receiving an indication from a gesture-based input system associated with a specific gesture; Retrieving a tactile response based on the specific gesture; and Transmitting the tactile response to a haptic generator, wherein the haptic generator is configured to transmit the tactile response. The method of claim 7, wherein the gesture-based input system is implemented in a vehicle. The method of claim 7, wherein the haptic generator is located in an armrest of the vehicle. The method of claim 7, wherein the receiving further comprises detecting whether a gesture is performed in a predefined area and retrieving the tactile response based on the recognizing. The method of claim 7, wherein a first tactile response is associated with a first gesture and a second tactile response is associated with a second gesture, wherein the first gesture and the second gesture are different. The method of claim 7, wherein the haptic generator is implemented in a wearable device. Haptic generator device, comprising: a receiver for receiving a signal associated with the tactile response; and a haptic generator mechanism to generate the tactile response, wherein the tactile response is associated with recognition of a gesture-based input. The device of claim 13, wherein the haptic generator is located in an armrest of a vehicle. The device of claim 13, wherein the haptic generator device is in a wearable device.

Images