WO2013116940A1

WO2013116940A1 - Sectional touch sensor frame for adaptation of touch-insensitive display

Info

Publication number: WO2013116940A1
Application number: PCT/CA2013/050087
Authority: WO
Inventors: Kevin John TAYLOR; Alan Mangaroo
Original assignee: Taylor Kevin John; Alan Mangaroo
Priority date: 2012-02-06
Filing date: 2013-02-05
Publication date: 2013-08-15

Abstract

A touch sensor device is provided comprising one more sections, that when connected, form a frame. There are multiple light emitters positioned around the inner perimeter of the frame. Multiple sensors are positioned around the inner perimeter of the frame, and the sensors are configured to detect light signals generated from the light emitters. A controller is also positioned within the frame, and it controls the activation of the light emitters. It also determines the positions of objects interacting with the device based on which of the sensors have detected the light signals. There is also a data communication module attached to or located within the frame, and it transmits the computed position data.

Description

SECTIONAL TOUCH SENSOR FRAME FOR ADAPTATION OF TOUCH-INSENSITIVE DISPLAY

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority from United States Provisional Application No. 61/595,520, filed on February 6, 2012, the entire contents of which are hereby incorporated by reference.

TECHNICAL FIELD

[0002] The following relates generally to touch screens. DESCRIPTION OF THE RELATED ART

[0003] Touch screen devices typically involve a physical surface which a user needs to touch with a finger or a stylus. The position at which the finger or surface touches the screen is an input for interacting with software on the touch screen display.

[0004] Conventional touch screen devices include resistive touch screen panels. Such panels include several layers, including two thin layers that are transparent electrically- resistive layers separated by a thin space. These layers face each other, with a thin gap between. One resistive layer is a coating on the underside of the top surface of the screen. Just beneath it is a similar resistive layer on top of its substrate. One layer has conductive connections along its sides, the other along the top and bottom. When an object, such as a fingertip or stylus tip, presses down on the outer surface, the two layers touch to become connected at that point.

[0005] Another touch screen technology is called surface acoustic wave, which uses ultrasonic waves that pass over the touch screen panel. When the panel is touched, a portion of the wave is absorbed. This change in the ultrasonic waves registers the position of the touch event.

[0006] Another conventional touch screen technology relies on capacitance. A capacitive touch screen panel consists of an insulator such as glass, coated with a transparent conductor such as indium tin oxide (ITO). As the human body is also an electrical conductor, touching the surface of the screen results in a distortion of the screen's electrostatic field, measurable as a change in capacitance. Different capacitive touch technologies include: surface capacitance, projected capacitive touch technology, mutual capacitive sensors, and self capacitance sensors.

[0007] Many conventional touch screen technologies involve a panel, which requires a user to physically touch or press against the panel. [0008] The discussion above is merely provided for general background information and is not intended to be used as an aid in determining the scope of the claimed subject matter.

SUMMARY

[0009] In an example aspect, a touch sensor device is provided comprising: a frame comprising mechanical attachments configured to secure the device to another object; multiple light emitters positioned around the inner perimeter of the frame; multiple sensors positioned around the inner perimeter of the frame, the sensors configured to detect light signals generated from the light emitters; and a controller configured to control activation of the light emitters, and determine a position of an object interacting with the device based on which of the sensors have detected the light signals.

[0010] In another example aspect, a touch sensor device is provided comprising: one more sections connected to form a frame; multiple light emitters positioned around the inner perimeter of the frame; multiple sensors positioned around the inner perimeter of the frame, the sensors configured to detect light signals generated from the light emitters; and a controller configured to control activation of the light emitters, and determine a position of an object interacting with the device based on which of the sensors have detected the light signals.

[0011] In another example aspect, a kit of parts is provided that, when assembled, forms a touch sensor device. The kit of parts comprises: one more sections configured to be connected to form a frame; each of the sections comprising at least two data connectors for transmitting data between connected sections; at least two of the sections each comprising a light emitter; at least two of the sections each comprising multiple sensors, the sensors configured to detect light signals generated from the light emitters; at least one of the sections comprising a controller; the controller configured to control activation of the light emitters, and determine a position of an object interacting with the device based on which of the sensors have detected the light signals.

[0012] This Summary is provided to introduce a selection of concepts in a simplified form, examples of which are described in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.

BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Embodiments will now be described by way of example only with reference to the appended drawings wherein: [0014] Fig. 1 is a perspective view of a touch screen device attached to a display device.

[0015] Fig. 2 is a perspective view of the touch screen device separated from the display device, shown in Fig. 1.

[0016] Fig. 3 is a schematic diagram of example components of the touch screen device interacting with the display device.

[0017] Fig. 4 is a schematic diagram of example components of a touch screen device.

[0018] Fig. 5a, Fig. 5b, Fig. 5c and Fig. 5d are example diagrams showing different light emitters on the touch screen device generating light rays, and three objects casting shadows.

[0019] Fig. 6 is an example diagram showing the light rays of Fig. 5a, Fig. 5b, Fig. 5c and Fig. 5d compiled together illustrating three breaks in a light hull.

[0020] Fig. 7a is a diagram showing ten fingers positioned within the touch screen device.

[0021] Fig. 7b is a diagram illustrating ten breaks in a light hull, corresponding to the ten fingers of Fig. 7a.

[0022] Fig. 8a is a diagram showing two arms positioned with the touch screen device.

[0023] Fig. 8b is a diagram illustrating two breaks in a light hull, corresponding to the two arms of Fig. 8a.

[0024] Fig. 9 is a flow diagram illustrating example computer or processor executable instructions for determining the location or locations of interaction with the touch screen device.

[0025] Fig. 10 is a schematic diagram of example components of another example embodiment of a touch screen device.

[0026] Fig. 11 is a schematic diagram of example components of another example embodiment of a touch screen device.

[0027] Fig. 12 is a perspective view of an example embodiment of a touch screen device.

[0028] Fig. 13a is a bottom view of the touch screen device of Fig. 12.

[0029] Fig. 13b is a side profile view of the touch screen device of Fig. 12.

[0030] Fig. 13c is another side profile view of the touch screen device of Fig. 12. [0031] Fig. 14 is a top view of the touch screen device of Fig. 12.

[0032] Fig. 15 is a perspective view of another section of a touch screen device that can be used in the touch screen device shown in Fig. 12.

[0033] Fig.

[0034] Fig.

[0035] Fig.

[0036] Fig

[0037] Fig

[0038] Fig

isolation.

[0039] Fig

device connected and assembled together.

[0040] Fig. 19 is a schematic diagram showing multiple sections of the touch screen device of Fig. 18, which have been separated from each other.

[0041] Fig. 20 is a schematic diagram showing one of the sections of the touch screen device in isolation, including its example components.

[0042] Fig. 21 is a schematic diagram showing another one of the sections of the touch screen device in isolation, including its example components.

[0043] Fig. 22 is a schematic diagram showing multiple sections of the touch screen device in another example configuration.

[0044] Fig. 23 is a schematic diagram showing another example configuration of multiple sections of a touch screen device connected and assembled together.

[0045] Fig. 24 is a schematic diagram showing another example configuration of multiple sections of a touch screen device, similar to Fig. 23.

[0046] Fig. 25 is a schematic diagram showing another example configuration of multiple sections of a touch screen device connected and assembled together.

[0047] Fig. 26 is a schematic diagram showing another example configuration of multiple sections of a touch screen device, similar to Fig. 25.

[0048] Fig. 27 is a side profile view of a display device and a touch screen device attached thereon, having two layers of light hulls. [0049] Fig. 28a is a side profile view of a display device and a touch screen device attached thereon, showing a finger breaking one of two light hulls.

[0050] Fig. 28b is a side profile view of the display device and the touch screen device of Fig. 28a, showing a finger breaking both of the two light hulls.

[0051] Fig. 29 is a flow diagram illustrating example computer or processor executable instructions for using the device shown in Fig. 27.

[0052] Fig. 30 is a schematic diagram of another example embodiment of a touch screen device.

[0053] Fig. 31 is a schematic diagram of the touch screen device of Fig. 30, shown with its sections disassembled.

[0054] Fig. 32 is a schematic diagram of the touch screen device of Fig. 30, including expansion sections.

[0055] Fig. 33 is a schematic diagram of the touch screen device of Fig. 32 showing its sections, including the expansion sections, disassembled.

DETAILED DESCRIPTION

[0056] It will be appreciated that for simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth in order to provide a thorough understanding of the example embodiments described herein. However, it will be understood by those of ordinary skill in the art that the example embodiments described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the example embodiments described herein. Also, the description is not to be considered as limiting the scope of the example embodiments described herein.

[0057] Touch screen devices have become popular for a number of applications, including for mobile devices, tablets, laptops, and desktop computers. Conventional touch screen devices are integrated with the display screen, such as in capacitive, acoustic, and resistive touch screens.

[0058] It is recognized that many conventional display devices do not have touch screen capabilities. For example, many television sets or computer monitors do not have touch screen capabilities. As described herein, such display devices can be integrated with a touch screen device, thereby adding touch screen capabilities. For example, a touch screen device, as described herein can be integrated with a LCD television, a LCD projector display surface, and a computer monitor.

[0059] A touch screen device as described herein surrounds at least a portion of a display device. In an example embodiment, the touch screen device frames the perimeter of the display device.

[0060] It is also recognized that many conventional display devices can be large.

Building and transporting a touch screen display device suited to match the size of a display device can be difficult. Larger items are expensive to transport or ship, and they can be susceptible to damage during transport. Therefore, in an example embodiment of the touch screen device described herein, the touch screen device is formed from multiple sections which can be transported disassembled in a more compact size. The sections can be assembled to form the touch screen device. This greatly reduces transportation costs and difficulty, as well as reduces risk of damage.

[0061] Turning to Fig. 1 , a display device 6, such as a flat-screen television, is shown displaying three widgets or icons 8. A touch screen device 2 is attached to the display device 6 using, for example, hooks 4. In another example embodiment, the touch screen device 2 is attached to the display device 6 using any one of, or combination of, hooks, grooves, magnets, Velcro™, screws, fasteners, adhesives, etc. Other means for mechanically attaching the touch screen device 2 to the display device 6 can be used.

[0062] A user can interact with the combined display device 6 and touch screen device 2, which together form a touch screen display. For example, when a user touches a widget or icon 8 that is displayed on the screen 6, the "touch" location is measured by the touch screen device 2 and is processed to generate a user input with respect to the selected graphical widget or icon 8. In this way, a graphical user interface (GUI) is provided on the display device 6, which a user can interact with using the touch screen device 2.

[0063] Turning to Fig. 2, it can be appreciated that the touch screen device 2 can be attached to the display device 6. The touch screen device 2, for example, is in the form of a frame which "frames" the display device 6. The touch screen device 2 does not display anything and the space 10 defined by the frame is empty space. A user can see through this space 10 to view the display device 6 behind. A user can also pass an object, for example fingers and a stylus, through the space 10.

[0064] Turning to Fig. 3, the touch screen device 2 is also herein referred to as a sensor device. It senses the position of one or more objects within the space 10 using a combination of light emitters and light sensors. In an example embodiment, the light is infrared light or other light which is not visible to the human eye.

[0065] The touch screen device 2 is in communication with a computing device 14, and it outputs one or more locations to the computing device 14. It can be appreciated that the touch screen device 2 is considered to be an input device to the computing device 14. The computing device 14 processes these input locations and updates the display device 16 accordingly.

[0066] In an example embodiment, the computing device 14 and the display device 16 are integrated into a single device. In an example embodiment, the touch screen device 2 is in communication with the computing device 14 through wired data communication means. Non-limiting examples of wired data communication include: FireWire, USB, parallel ports, serial ports, LAN and WAN cables, etc. In another example embodiment, the touch screen device 2 is in communication with the computing device 14 through wireless data communication means. Non-limiting examples include WiFi™, infrared transmission, Bluetooth™, radio waves, 3G, 4G, CDMA, GPRS, cell-tower transmissions, radio waves, etc.

[0067] The touch screen device 2 can output the detected location or locations through a TUIO protocol, and can be routed to a native Windows 7™ multitouch driver, or a host of TUIO capable applications. By way of background, TUIO is an open framework that defines a common protocol and Application Programming Interface (API) for tangible multitouch surfaces. As described herein, the touch screen device 2 can be enabled to use the TUIO protocol. The TUIO protocol allows the transmission of an abstract description of interactive surfaces, including touch events and tangible object states. This protocol encodes control data from a tracker application (e.g. based on computer vision) and sends it to any client application that is capable of decoding the protocol. There exists a growing number of TUIO enabled tracker applications and TUIO client libraries for various programming

environments, as well as applications that support the protocol. This combination of TUIO trackers, protocol and client implementations allows the rapid development of table based tangible multitouch interfaces. TUIO has been mainly designed as an abstraction for interactive surfaces, but also has been used in many other related application areas. TUIO is based on Open Sound Control (OSC) - an emerging standard for interactive environments not only limited to musical instrument control - and can be therefore implemented on any platform that supports OSC.

[0068] Non-limiting examples of the display device 16 include a television screen, an LCD monitor, a computer monitor, a CRT monitor, an LCD projector, an LED screen, and an LED bill board. [0069] It can be appreciated that the sensor device 2 can be configured to frame different display surfaces.

[0070] In an example embodiment of an LCD projector, the touch screen device 2 frames the surface on which the visual graphic or image is displayed or projected (e.g. a wall, a white screen, a textile surface). The inputs received through the touch screen device 2 are used by the computing device 2 to generate new images, which are then sent to the LCD projector to display or project.

[0071] In another example embodiment, the touch screen device 2 can also be used to frame a static display surface. Non-limiting examples of static display surfaces include a poster board, a white board, a black board, a billboard, and a paper chart. In this way, a user can interact with a static display surface and can provide dynamic user inputs associated with the static display surface. The user inputs can be recorded on to digital media (e.g. a memory device).

[0072] In an example embodiment, the one or more microphones 12 are embedded within the touch screen device 2. The audio data collected by the microphones 12 can also be transmitted to the computing device 14.

[0073] The touch screen device 2 can also include other input devices, such as a camera 13, also connected to the computing device 14. The camera 13 can be used for video conferencing sessions.

[0074] The touch screen device 2, and the other example embodiments of a touch screen device as described herein, be used with currently known and future known user interface algorithms and gesture algorithms for touch screens. Gestures or actions include, for example, "clicking", selecting an object, swiping, expanding an image, shrinking an image, dragging an object, and rotating an object. In general, many different gestures or actions can be tracked and recognized using the example embodiments of the touch screen devices described herein.

[0075] Turning to Fig. 4 an example schematic diagram of the touch screen device 2 is shown in the shape of a rectangular frame. The perimeter of the frame includes multiple light emitters 20 and multiple light sensors 18. The sensors 18 are more closely spaced together around the perimeter, which defines the shape of the empty space 10. The emitters 20 are spaced further apart around the perimeter, and are positioned amongst the sensors 20. It can be appreciated that the more closely space the sensors 18 and emitters 20, the more accurately the touch screen device 2 is able to compute the position of an object interacting with the touch screen device 2. [0076] In an example embodiment, the sensors 18 are all substantially located on the same plane. The emitters 20 are all substantially located on another plane, which is positioned closely before or behind the plane of sensors 18. Such a configuration can be used, for example, if the sensors 18 are closely spaced together leaving no room to position an emitter 18. The emitters 20 transmit light rays at many angles, for example, like a cone, which can be detected by the sensors 18 positioned in another plane.

[0077] In another example embodiment, the sensors 18 are all substantially located on the same plane. The emitters 20 are also substantially located on the same plane as the sensors 18. Such a configuration is desirable, for example, when the light emitted by the emitters 20 is confined within a certain plane. This configuration can also be used where the emitters 20 are LASERS.

[0078] In an example embodiment, the emitters 20 are infrared LEDs and the sensors 18 are infrared light sensors. Infrared light is not visible to the human eye, which allows the images from the display device 16 to be viewed without obstruction or hindrance. Other sources of light that are not visible to the human eye can be used in conjunction with a suitable light sensor.

[0079] The touch screen device 2 also includes other components 22. Non-limiting examples include a controller 24 (e.g. a processor), memory 26, a data communication module 28, and a power module 30. The controller 24 controls the activation of the emitters 20. The controller 24 also receives the signals from the sensors 18, and uses the data from the sensors 18 to compute the one or more positions of the object(s) interacting with the touch screen device 2. The positions, and corresponding time stamps, can be saved in memory 26. The algorithms for computing the position or positions are also stored in memory 26. The data communication module 28 can provide wired or wireless data communication, or both. It transmits the position data to the computing device 14. A power module 30 is also provided to supply power to the various components of the touch screen device 2. In an example embodiment, the power module 30 receives power through a USB connection. In another example embodiment, the power module 30 receives power through a power plug (e.g. AC or DC power). In another example embodiment, the power module is a battery module, which improves the portability or mobility of the touch screen device 2.

[0080] In an example embodiment, the controller 24 activates the emitters 20 at a particular frequency or using a particular strobe pattern. This allows the light signals received by the sensors 18 to be identified as light signals generated by the emitters 20, and distinguished over ambient infrared light or infrared light from other sources ancillary to the touch screen device 2. [0081] In another example embodiment, the emitters 20 do not pulse, and instead generally emit a steady stream of light.

[0082] Turning to Fig.s 5a, 5b, 5c, and 5d, an example sequence of activating the emitters 20 is provided. One emitter is activated at a time to determine the path for a light ray from a single light source to each sensor 18. The emitters are generally referred to by numeral 20, and the different emitters of the present example are referenced with numerals 20a, 20b, 20c, and 20d. It can be appreciated that the touch screen device 2 includes the emitters 20a, 20b, 20c, and 20d and these are activated one at a time.

[0083] Referring to Fig. 5a, the emitter 20a is activated. It shines light rays in many different directions and some of these light rays are detected by the sensors 18. There are three objects 40, 42, 44 positioned within the touch screen device 2 and they prevent certain light rays projected by the emitter 20a from reaching certain sensors 32. The objects 40, 42, 44 cast a shadow. In an example embodiment, the objects 40, 42, 44 are fingers, or pointers (e.g. a stylus), or a combination thereof. A light ray from the emitter 20a is known to reach a sensor 18, if the sensor 18 detects a certain light signal. For example, the emitter 20a pulses light, such as infrared light, at a certain frequency or according to a certain pattern. If a sensor 18 detects the pulsing light at the same frequency or according to the same certain pattern, then it is determined that the sensor 18 had detected the light ray originating from the emitter 20a. Otherwise, if it does not detect the same frequency or the same certain pattern of light, then the sensor 18 has not received the light ray originating from the emitter 20a. From Fig. 5a, a set of rays or ray paths are computed, each ray defined by one point coinciding with the emitter 20a and another point coinciding with a sensor 18, which has detected the light signal of the emitter 20a.

[0084] Referring to Fig. 5b, the emitter 20a is deactivated and another emitter 20b is activated. In an example embodiment, the emitter 20b pulses at a different frequency or pattern compared to the emitter 20a or, in another example embodiment, it pulses at the same frequency or pattern as the emitter 20a. If a sensor 18 detects the light signal from the emitter 20b, then a ray or ray path is generated. The objects 40, 42, 44 cast shadows and prevent light rays from the emitter 20b from reaching certain sensors 34. Therefore, no rays are defined between the emitter 20b and the sensors 34.

[0085] Referring to Fig. 5c, similar to the process in Fig.s 5a and 5b, the emitter 20b is deactivated and the emitter 20c is activated. The set of rays corresponding to the emitter 20c is determined. Each ray, in this set corresponding to emitter 20c, is defined by a point coinciding with the location of the emitter 20c and another point coinciding with the location of a sensor that has received the light signal generated by emitter 20c. The objects 40, 42, 44 cast a shadow, which prevents the sensors 36 from receiving the light signal generated by emitter 20c.

[0086] Similarly, in Fig. 5d, the emitter 20c is deactivated and emitter 20d is activated. A set of rays or ray paths are computed. Each ray is defined by a point coinciding with the location of the emitter 20d and another point coinciding with the location of a sensor that has received the light signal generated by the emitter 20d. The objects 40, 42, 44 cast a shadow and prevent the sensors 38 from receiving or detecting the light signal generated by the emitter 20d.

[0087] It can be appreciated that the sequence of activation of each emitter (e.g. 20a, 20b, 20c, 20d), and the corresponding data collection from the sensors 18, occurs one at a time. The entire sequence of activating the emitters 20 occurs very quickly. A detection cycle herein refers to activating a number of emitters 20, one at a time, and collecting data from the sensors 18. In an example embodiment, where a touch screen device 2 includes thirty-two emitters 20, a detection cycle has period of approximately 10 milliseconds. In other words, the touch screen device 2 completes each detection cycle at a frequency of 100 Hz. Other time periods or frequencies of the detection cycle can be used to determine the operation settings of the touch screen device 2. In general, the shorter the time period of a detection cycle, the more quickly and accurately the touch screen device 2 will be able to detect the position of an object, and detect the change in position of an object.

[0088] As described above, each of the emitters 20a, 20b, 20c, 20d can be pulsed at unique frequencies or patterns with respect to each other. In an example embodiment, the different pulsing frequencies or patterns are used by the sensors 18 to determine the identity of the emitter generating the light signal. In other words, the detected light signal is collected data from a sensor 20 that can be tagged with the identity of the emitter 20. In this way, a ray can be represented by data comprising: an identity of a sensor and an identity of an emitter. The position of the ray (e.g. a line defined by two points) can then be abstracted from this data.

[0089] In another example embodiment, the emitters 20a, 20b, 20c, 20d are pulsed at the same frequency or pattern. In corresponding example embodiment, when a certain emitter is activated, all sensors 18 that receive a corresponding light signal are identified. In other words, the controller 24 already knows the identity of a given emitter when it is activating the given emitter the sensors detect the light from the given emitter. A data abstract representing a ray is then created, comprising the identity of the emitter and the identity of the sensor that detected the light signal. In this way, a ray can be redrawn or computed from the data abstract. [0090] In another example embodiment, the data abstracts for each set of rays can be represented in a more condensed data format comprising: set of rays for a certain emitter = {the identity of a certain emitter, the identity of a first sensor that detected the light signal, ... , the identity of an nth sensor that detected the light signal}.

[0091] The set of rays from each emitter 20 are then compiled to form a light hull. If there are objects (e.g. objects 40, 42, 44) that are in the touch screen device 2, then these objects will be detected or represented as breaks in the light hull.

[0092] Turning to Fig. 6, the set of rays corresponding to a number of emitters 20 are compiled together in an overlapping fashion to form the light hull. When compiled together, the sets of rays look like a web of lines, each line defined by a point positioned at a certain emitter and another point positioned at a sensor that has received the light signal from the certain emitter. The light hull in Fig. 6 reveals that there are breaks or empty spaces defined by the rays. These empty breaks or empty spaces are used to identify the positions of the objects 40, 42, 44.

[0093] In an example embodiment, the positions or locations of the objects 40, 42, 44 are represented as Cartesian coordinates (e.g. x,y coordinates). In another example embodiment, the positions are represented as pixel coordinates or pixel indices

corresponding to the display device 16.

[0094] Turning to Fig. 7a, a photograph shows a user placing two hands 46 through the touch screen device 2. The user's ten fingers are interacting with the light hull, which is not visible to the human eye.

[0095] Turning to Fig. 7b, a diagram shows the lights rays overlapping one another to form the light hull. The breaks or voids 48 in the light hull are clearly shown and these correspond to the user's ten fingers.

[0096] It can be appreciated that the touch screen device 2 described herein can detect multiple points simultaneously. For example, two users can interact simultaneously with the touch screen device 2 using all hands (e.g. twenty fingers), and the positions of all their fingers will be simultaneously tracked.

[0097] Similarly, turning to Fig. 8a, a user is shown placing two arms 50 through the touch screen device 2. Turning to Fig. 8b, the light hull is shown, including two large breaks or voids 52. These breaks 52 correspond to the two arms 50 of the user.

[0098] Turning to Fig. 9, example computer or processor executable instructions are provided for determining the location of one or more objects interacting with the touch screen device 2. At block 56, the controller 24 activates a first emitter. At block 58, the controller determines which sensors have detected a light signal corresponding to the first emitter. At block 60, the controller computes a first set of rays extending between the first emitter and each of the sensors that have detected the signal. This process repeats for each emitter.

[0099] For example, turning to block 62, an nth emitter is activated. The controller 24 then determines which sensors have detected a light signal corresponding to the nth emitter (block 64). The controller then computes the nth set of rays extending between the nth emitter and the sensors that have detected the signal.

[00100] The process for completing such a detection cycle, from the first emitter to the nth emitter, is collectively represented as block 54.

[00101] After collecting the sets of rays corresponding to each emitter, the sets of rays are compiled and overlapped to form a light hull (block 68). The controller 24 computes the location or locations of where the light hull is broken (e.g. the locations of the voids) (block 70). At block 72, the location or locations are transmitted or stored in memory 26, or both. For example, the locations are transmitted from the touch screen device 2 to a computing device 14.

[00102] The process is repeated (block 74) by performing the detection cycle 54 again.

[00103] Turning to Fig. 10, another example embodiment of a touch screen device 78 is provided. The configuration of the sensors 18 and the emitters 20 are arranged in an "L" shape. For example, two adjacent sides are lined with a series of sensors 18 and another two adjacent sides are lined with a series of emitters 20, opposite of the sensors 18.

[00104] The touch screen device 78 may also be equipped with attachment means to be attached to a display surface or display device. The touch screen device 78 also includes components 22, for example, a controller 24, memory 26, a data communication module 28, and a power module 30.

[00105] Turning to Fig. 11 , another example embodiment of a touch screen device 80 is provided. It is similar to the touch screen devices 2 and 78. However the configuration of the sensors 18 and emitters 20 in the touch screen device 80 alternate.

[00106] It also includes components 22. It can also include attachment components to attach to a display surface or a display device.

[00107] Turning to Fig. 12, an example embodiment of a touch screen device 200 is provided. This shows the back-side of the device 200, which can be placed against a display device 16 (e.g. a monitor or television screen), and attached thereon using arms 210. The arms 210 extend around the back of the display device 16 to hold the device 200 in place. The arms also include slots 218 to adjust a clamping mechanism that clamps the device 200 against a television screen, or other type of display device 16. In the example shown, each slot 218 is elongate. It can be appreciated that television screens and monitors have different widths, and thus, the clamping mechanism can be adjusted by sliding it along the length of the slot 218. Although not shown, in an example embodiment, the clamping mechanism comprises an L-shaped piece that can be secured to the slot 218 using a nut and bolt. When the L-shaped piece is connected to the arm 210, it forms a hook, which is similar in shape and function to the hook 4 shown in Fig. 1 and Fig. 2.

[00108] Continuing with Fig. 12, in this embodiment, this device 200 is assembled for several sections 202, 204, 206. There are two comer pieces 202 which connect a "height" section 206 and a "width" section 204 together at an angle to each other (e.g. a right angle). The height sections 206 are identical to each other and include the arms 210. The width sections 204 are shorter in length than the length pieces 206. It can be appreciated that the sections 202, 204 and 206 can be shipped to a user as a kit, and then assembled to form the touch screen device 200.

[00109] A corresponding back side view of the touch screen device 200 is shown in Fig. 13a. A corresponding side profile view is shown in Fig. 13b, and a top profile view is shown in Fig. 13c. As shown more clearly in Fig. 13a, protrusions 208 which are also used to secure the printed circuit boards (PCBs) 209. It is noted that the sensors and emitters, for example, are attached to a PCB 209.

[00110] Fig. 14 shows the front side view of the touch screen device 200. In an example embodiment, the surface of the device 200 appears well integrated and smooth and, from visual inspection, it is difficult to distinguish the different sections 202, 204 and 206.

[00111] Fig. 15 shows an example embodiment of an L-shaped section 207, which combines sections 202, 204 and 206. It is also includes an arm 210 used to secure the touch screen device to display device 16. The arm 210 includes a slot. The slots are used so that clamps can slide along the length of arms. The slot for example allows the arm 210 to accommodate varying televisions of varying thickness. The openings 212 are positioned in a row along the inner perimeter of the section 204. Positioned at each of these openings 212 is a sensor 18. These opening 212 allow light to be received by the sensor 18. Placed amongst the openings 212 are another set of openings 214. At each opening 214 is an emitter 20, which projects light through the opening 214. [00112] The section 204 also includes bezel snaps 216 for connecting to another section, such as section 206. A bezel snap 216 can be considered a male connector that is able to be inserted into a corresponding female connector. Such a female connector is opening 220 shown in Fig. 16a.

[00113] In an example embodiment, the bezel snap 216 has one or two angled protrusions at its head, which can flex inwards. For example, when such a bezel snap is inserted into a female connector, or opening, the angled protrusions flex inward to provide sufficient clearance for the bezel snap to enter the female connector. After being fully inserted, the angled protrusions return to an opened position to lock the bezel snap in the female connector.

[00114] Continuing with Fig. 15, the data connector 222 is also shown. For example, the data connector 222 is a USB connector. Other types of data connectors can be used in other example embodiments.

[00115] A side view, a top view, and another side view of the section 204, shown in Fig. 15, are shown in Fig.s 16a, 16b, and 16c respectively. The arm 210 which defines a slot 218 can be more clearly seen in Fig. 16a. The row of openings 212 for the sensors 18 and the row of openings 214 for the emitters 20 are more clearly shown in Fig. 16a. Openings 220 are configured to receive the bezel snaps 216. When the bezel snaps 216 are inserted into the openings 220, the sections of the frame are mechanically attached to each other. The component 222 is a data connector for transferring data (e.g. sensor data, control data for the emitters, etc.) between sections. An example of a data connector is a USB connector. Other types of data connectors can also be used with the principles described herein.

[00116] In an example embodiment, the sections of the various touch screen devices described herein each have two data connectors to connect with other sections. In another example embodiment, two data connectors include a male data connector and a female data connector. However, other arrangements are possible, such as two male data connectors or two female data connectors.

[00117] Turning to Fig.s 17a, 17b, 17c, a side view, bottom-side view and a front view, respectively, of section 204 are shown. In Fig. 17b, the protrusions 208 can be more clearly seen. Bezel snaps 216 protrude from section 206 and can be used to connection section 206 to another section, such as section 204, or another section 206. As seen more clearly in Fig. 17c, the openings 212 for the sensors 18 are in a slight offset row compared to the row of openings 214 for the emitters 20. Such an arrangement for openings 212 and 214 can carry out through the entire inner perimeter of the device 200. Thus, such openings 212 and 214 are on other sections 204, 207.

[00118] Turning to Fig. 18 , another example embodiment of a touch screen device 82 is provided, which includes several sections or modules that can be assembled (e.g. attached and detached) to form the touch screen device 82. The touch screen device 82 shows the sections or components 84, 86 in an assembled form.

[00119] The sections 84, 86 include emitters 20 and sensors 18. The sections 86 are "L" shaped and extend along the "height" of the touch screen device 82. The sections 84 are shaped as a straight bar and they can be connected to extend along the "length" of the touch screen device 82.

[00120] The sections 84 are identical to each other to reduce manufacturing costs. The sections 86 are identical to each other to also reduce manufacturing costs. In other words, by reducing the number of different sections or components, few unique parts need to be generated. This reduces manufacturing costs.

[00121] The different example embodiments described herein preferably, although not necessarily, have two or more sections that are substantially identical in shape to each other. In an example embodiment, two or more sections of the frame are identical in shape to each other. The substantially identical shape or identical shape helps to reduce manufacturing costs.

[00122] It is also appreciated that the sections 84, 86 can be transported more easily in smaller-sized packaging. For example, the sections can be arranged into a long box when being shipped. This is much more compact in size and results in a lower shipping cost compared to shipping an assembled touch screen device 82.

[00123] Turning to Fig. 19, an exploded view of the touch screen device 82 is shown. The components 84, 86 are separated from each other. It can be appreciated that the components 84, 86 have mechanical means for attaching to each other and also include data communication means to transfer data and electrical power throughout the entire device 82.

[00124] In an example embodiment, each component 84, 86 has a male USB connector 90 and a female USB connector 88, which can receive a male USB connector 90. For example, the section 84 has at one end a male USB connector 88 and, at another end, a female USB connector 88. The male USB connector 88 can connect to a female USB connector 90 of another section (e.g. another section 84, or a different section 86). 100125] The USB connectors 88, 90 provide a mechanical connection between the sections, and facilitate the transfer of power and communication of data between sections. In another example embodiment, the USB connectors can be used in combination with bezel snaps 216 to mechanically connect sections together.

[00126] It can be appreciated that the mechanical connection means can be separate from the power and data transfer means. For example, the sections can include tongue and groove connectors, slots, snaps, magnets, adhesives, etc. for connecting one section to another section.

[00127] Turning to Fig. 20, the section 86 is shown in isolation. The section 86 includes components 94, including for example: a power module 30, a controller 24, memory 26, a data communication module 28, sensors 18, emitters 20, and a microphone 12. The section 86 also includes a power connector 92 which can be used to receive electrical power for the touch screen device 82. In an example embodiment, the power connector 92 is a female USB connector. Other types of power connectors can be used.

[00128] Turning to Fig. 21 , the section 84 is shown in isolation and, in an example embodiment, it includes fewer components 96. It includes sensors 18 and emitters 20. It does not include other components in order to reduce costs. The section 84 can be considered an expansion component, where multiple of such sections can be included into the touch screen device 82 in order to extend the length of the touch screen device 82.

[00129] Turning to Fig. 22, the touch screen device 82 can have a variable length depending on the number sections 84 that are included.

[00130] It can be appreciated that the touch screen device 82 can have many configurations, and can be conveniently adjusted to suit a user. The "heights" of the sections 86 can also be manufactured to have different lengths. This also allows a user to vary the combination of sections 86 and 84 to form various sized rectangular-shaped devices 82.

[00131] Turning to Fig. 23, another example configuration of a touch screen device 98 is provided. The device 98 is the assembled form of the sections 102, 100. It includes two long side sections 102 which extend along the "height" of the device 98 and a series of shorter sections 100 which, when connected, extend along the "length" of the device 98. The mechanical connections 104 are shown, which, for example, includes a male USB connector 90 connected to a female USB connector 88 and bezel snaps.

[00132] Turning to Fig. 24, the sections 100 and 102 are shown separated from each other. It can be appreciated that the number of sections 100 can be variable, which allows a user to form different sizes of the touch screen device 98. As shown more clearly in Fig. 24, the section 102 has the connectors located on the same side 103 of the section's housing, though at opposite ends. In a particular example, the male data connector 90 and the female data connector 88 are located on the same side 103 of the section's housing, though at opposite ends. In an example embodiment, section 102 includes the components 94.

[00133] The section 100 has two data connectors, each one located at opposite sides of the section's housing. In particular, the male data connector 90 and the female data connector 88 are located at opposite sides of the section's housing.

[00134] Turning to Fig. 25 and Fig. 26, another example embodiment of a touch screen device 106 is provided. Referring to Fig. 25, the device 106 is shown as an assembled form of sections 108 and 110. As seen more clearly in Fig. 26, section 1 0 can includes a male connector 90 at one end and a female connector 88 at another end. Section 108 is considered a "corner section" and, for example, has a square-shaped profile. Section 108 has two data connectors, which are positioned at adjacent sides. In another example embodiment, the two data connectors are positioned to be substantially perpendicular to each other. In the example illustrated in Fig. 25 and Fig. 26, section 108 has a female connector 88 positioned substantially perpendicular to a male connector 90.

[00135] As shown by Fig. 26, the dimensions of the touch screen device 106 can vary and can be controlled by a user by connecting a different number of sections 110.

[00136] Turning to Fig. 30 and Fig. 31 , an example embodiment of a touch screen 140 is provided. It includes sections 144 and 142. The connection points 104 are shown, which include the male data connectors 90 inserted into the female data connectors 88. The sections 144 include two male data connectors 90, while the end sections 142 include two female data connectors 88. In another example embodiment, not shown, section 144 has two female data connectors and section 142 has two male data connectors. More generally, section 142 has two data connectors positioned on the same side of the housing of section 142. Section 144 has two data connectors positioned on opposite sides of the housing of section 144.

[00137] Another example embodiment of a touch screen device is shown in Fig. 32 and Fig. 33, which includes additional expansion sections 146. Numerous expansion sections 146 can be added to the device 140 to extend the device's length. The expansion components 146 each include a female connector 88 on one end and a male connector 90 on another end. [00138] It can be appreciated that there are various shapes and sizes for different sections, and that the sections can be connected to vary the dimensions of an assembled touch screen device.

[00139] Turning to Fig. 27, a side profile view of the touch screen device 112 is shown, which is attached to a display device or display surface 6. The example embodiment of the touch screen device 112 includes two layers 114, 116 of emitters and sensors. For example, a first perimeter of emitters and sensors forms a first layer 1 14 of detection. The emitters and sensors in the first layer 114 also define a first plane. A second set of emitters and sensors form a second perimeter, thereby forming a second layer 116 of detection. The second set of emitters and sensors, and the second layer 116, define a second plane. In an example embodiment, the first plane and the second plane are substantially parallel to each other. In an example embodiment, the surface of the display device 6, the second layer 116, and the first layer 114 define three substantially parallel planes. The second layer 116 is represented by a dotted line, which represents the light rays in the second plane. The second layer 116 is located very close to the surface of the display device 6. The first layer 114 is also represented by a dotted line, which represented the light rays in the first plane. The first layer 114 is located further away from the surface of the display device 6.

[00140] Turning to Fig. 28a and Fig. 28b, a finger 118 is shown breaking the light hull of the first layer 1 14, and breaking the light hull of the second layer 116, respectively. If the first layer 1 14 is only broken, in an example embodiment, this input can be considered as tracking the position of a pointer (block 120). This is akin to moving a pointer mouse around a screen. If the finger 1 18 also breaks the second layer 116 (e.g. when touching the display device 6), this can be interpreted receiving an action input, or input selection (block 122). This is akin to "clicking" a pointer on a screen. However, it can be appreciated that the response to the two different layers 14, 1 6 can be configured in many other ways. In general, the touch screen device 112 increases the number of ways which a user can interact with the device 112. In other words, different types of inputs can be received by the touch screen device 112 based on the two layers.

[00141] Turning to Fig. 29, example computer or processor executable instructions are provided for responding to the touch screen device 112 having two layers. At block 124, it is determined if the light hull of the first layer 114 is broken. If not, no action is taken (block 126). If so, the controller 24 then determines if the light hull of the second layer 116 is broken (block 128). If the second layer 116 is not broken, then at block 130, the controller computes the location or locations of where the first light hull is broken. The controller 24 sends the location or locations, along with a tag that identifies the location data is associated with the first light hull, to a computing device 14.

[00142] Continuing with Fig. 29, if the second light hull is broken, at block 134, the controller 24 computes the location or locations of where the second light hull is broken. The location data is sent, along with a tag that identifies the location data is associated with the second light hull, to a computing device 14.

[00143] The following is a listing of general example embodiments of the touch sensor device and associated example aspects.

[00144] In a general example embodiment, a touch sensor device is provided. The touch sensor device includes a frame with a mechanical attachment configured to secure the device to another object. It also includes multiple light emitters positioned around the inner perimeter of the frame. There are multiple sensors positioned around the inner perimeter of the frame, the sensors configured to detect light signals generated from the light emitters. The touch sensor device also includes a controller configured to control activation of the light emitters, and to determine one or more positions of objects interacting with the device based on which of the sensors have detected the light signals.

[00145] In an aspect, the mechanical attachment comprises at least one arm defining a slot therein, the slot configured to receive a clamping component. In another aspect, the slot is elongate and is configured to have the clamping component positioned at different positions within the length of the slot.

[00146] In another aspect, the mechanical attachment comprises at least one hook.

[00147] In another aspect, the touch sensor device further includes a data communication module attached to or within the frame, the data communication module configured to transmit the one or more positions.

[00148] In another aspect, the light emitters and the sensors are positioned to form a first layer of light emitters and sensors, defining a first plane, and a second layer of light emitters and sensors, defining a second place; and the first and the second planes are substantially parallel.

[00149] In another aspect, the frame comprises multiple sections, each section configured to be connected to form the frame.

[00150] In another aspect, the touch sensor device includes a microphone.

[00151] In another aspect, the touch sensor device includes a camera. [00152] In a general example embodiment, a touch sensor device is provided. The touch sensors device includes one more sections connected to form a frame. It also includes multiple light emitters positioned around the inner perimeter of the frame. There are multiple sensors positioned around the inner perimeter of the frame, the sensors configured to detect light signals generated from the light emitters. The touch sensor device also includes a controller configured to control activation of the light emitters, and determine one or more positions of objects interacting with the device based on which of the sensors have detected the light signals.

[00153] In an aspect, the mechanical attachment comprises at least one arm defining a slot therein, the slot configured to receive a clamping component.

[00154] In another aspect, the slot is elongate and is configured to have the clamping component positioned at different positions within the length of the slot.

[00155] In another aspect, the mechanical attachment includes at least one hook.

[00156] In another aspect, each section includes a connector to connect with another section, the connector including at least one of: a tongue and groove connector, a slot, a snap, a magnet, and an adhesive.

[00157] In another aspect, each section includes at least two data connectors to connect with at least two other sections.

[00158] In another aspect, each of the at least two data connectors include a male data connector and a female data connector.

[00159] In another aspect, at least one of the sections includes a housing and two data connectors both located on a same side of the housing.

[00160] In another aspect, at least one of the sections includes a housing and two data connectors each located on opposite sides of the housing.

[00161] In another aspect, at least one of the sections includes two data connectors positioned substantially perpendicular to each other.

[00162] In another aspect, at least one of the sections is L-shaped.

[00163] In another aspect, a data communication module is attached to or is located within the frame, the data communication module configured to transmit the one or more positions. In another aspect, at least one of the sections includes the data communication module. [00164J In another aspect, the light emitters and the sensors are positioned to form a first layer of light emitters and sensors, defining a first plane, and a second layer of light emitters and sensors, defining a second place; and the first and the second planes are substantially parallel.

[00165] In a general example embodiment, a kit of parts is provided that when assembled forms a touch sensor device. The kit of parts includes two or more sections configured to be connected to form a frame. Each of the sections includes at least one data connector for transmitting data between connected sections. At least one of the sections includes at least one light emitter. At least one of the sections includes multiple sensors, the sensors configured to detect light signals generated from the at least one light emitter. At least one of the sections includes a controller. The controller is configured to control activation of the light emitters, and to determine one or more positions of objects interacting with the device based on which of the sensors have detected the light signals.

[00166] In an aspect, at least one of the sections comprises a mechanical attachment configured to secure the device to another object.

[00167] In another aspect, the mechanical attachment includes at least one arm defining an elongate slot therein, the slot configured to receive a clamping component at different positions within the length of the slot.

[00168] In another aspect, each section includes a connector to connect with another section, the connector includes at least one of: a tongue and groove connector, a slot, a snap, a magnet, and an adhesive.

[00169] In another aspect, at least one of the sections includes a male data connector and a female data connector.

[00170] In another aspect, at least one of the sections includes a housing and two data connectors are both located on a same side of the housing.

[00171] In another aspect, at least one of the sections includes a housing and two data connectors are each located on opposite sides of the housing.

[00172] In another aspect, at least one of the sections is configured with two data connectors positioned substantially perpendicular to each other.

[00173] In another aspect, at least one of the sections is L-shaped.

[00174] In another aspect, at least one of the sections includes a data communication module, the data communication module configured to transmit the one or more positions. [00175] In another aspect, the light emitters and the sensors are positioned to form a first layer of light emitters and sensors, defining a first plane, and a second layer of light emitters and sensors, defining a second place; and the first and the second planes are substantially parallel.

[00176] It will be appreciated that any module or component exemplified herein that executes instructions or operations may include or otherwise have access to computer readable media such as storage media, computer storage media, or data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Computer storage media may include volatile and non-volatile, removable and nonremovable media implemented in any method or technology for storage of information, such as computer or processor readable instructions, data structures, program modules, or other data, except transitory propagating signals per se. Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by an application, module, or both. Any such computer storage media may be part of the controller 24, memory 26, computing device 14, display device 16, etc. or accessible or connectable thereto. Any application or module herein described may be implemented using computer or processor

readable/executable instructions or operations that may be stored or otherwise held by such computer readable media.

[00177] Although the above has been described with reference to certain specific example embodiments, various modifications thereof will be apparent to those skilled in the art as outlined in the appended claims.

Claims

Claims:

1. A touch sensor device comprising:

a frame comprising a mechanical attachment configured to secure the device to another object;

multiple light emitters positioned around the inner perimeter of the frame;

multiple sensors positioned around the inner perimeter of the frame, the sensors configured to detect light signals generated from the light emitters; and

a controller configured to control activation of the light emitters, and determine a position of an object interacting with the device based on which of the sensors have detected the light signals.

2. The touch sensor device of claim 1 wherein the mechanical attachment comprises at least one arm defining a slot therein, the slot configured to receive a clamping component.

3. The touch sensor device of claim 2 wherein the slot is elongate and is configured to have the clamping component positioned at different positions within the length of the slot.

4. The touch sensor device of claim 1 wherein the mechanical attachment comprises at least one hook,

5. The touch sensor device of claim 1 further comprising a data communication module attached to or within the frame, the data communication module configured to transmit the one or more positions.

6. The touch sensor device of claim 1 wherein the light emitters and the sensors are positioned to form a first layer of light emitters and sensors, defining a first plane, and a second layer of light emitters and sensors, defining a second place; and the first and the second planes are substantially parallel.

7. The touch sensor device of claim 1 wherein the frame comprises multiple sections, each section configured to be connected to form the frame.

8. A touch sensor device comprising:

one more sections connected to form a frame;

multiple light emitters positioned around the inner perimeter of the frame; multiple sensors positioned around the inner perimeter of the frame, the sensors configured to detect light signals generated from the light emitters; and

9. The touch sensor device of claim 8 wherein the mechanical attachment comprises at least one arm defining a slot therein, the slot configured to receive a clamping component.

10. The touch sensor device of claim 9 wherein the slot is elongate and is configured to have the clamping component positioned at different positions within the length of the slot.

11. The touch sensor device of claim 8 wherein the mechanical attachment comprises at least one hook.

12. The touch sensor device of claim 8 wherein each section includes a connector to connect with another section, the connector comprising at least one of: a tongue and groove connector, a slot, a snap, a magnet, and an adhesive.

13. The touch sensor device of claim 8 wherein each section comprise at least two data connectors to connect with at least two other sections.

14. The touch sensor device of claim 13 wherein the at least two data connectors comprise a male data connector and a female data connector.

15. The touch sensor device of claim 8 wherein at least one of the sections comprises a housing and two data connectors both located on a same side of the housing.

16. The touch sensor device of claim 8 wherein at least one of the sections comprises a housing and two data connectors each located on opposite sides of the housing.

17. The touch sensor device of claim 8 wherein at least one of the sections comprises two data connectors positioned substantially perpendicular to each other.

18. The touch sensor device of claim 8 wherein at least one of the sections is L-shaped.

19. A kit of parts when assembled forms a touch sensor device, the kit of parts comprising: two or more sections configured to be connected to form a frame;

each of the sections comprising at least one data connector for transmitting data between connected sections;

at least one of the sections comprising a light emitter;

at least one of the sections comprising multiple sensors, the sensors configured to detect light signals generated from the light emitters;

at least one of the sections comprising a controller; and

the controller configured to control activation of the light emitters, and determine a position of an object interacting with the device based on which of the sensors have detected the light signals.

20. The kit of parts of claim 19 wherein at least one of the sections comprises a mechanical attachment configured to secure the device to another object.

21. The kit of parts of claim 20 wherein the mechanical attachment comprises at least one arm defining an elongate slot therein, the slot configured to receive a clamping component at different positions within the length of the slot.

22. The kit of parts of claim 19 wherein each section includes a connector to connect with another section, the connector comprising at least one of: a tongue and groove connector, a slot, a snap, a magnet, and an adhesive.

23. The kit of parts of claim 19 wherein at least one of the sections comprises a male data connector and a female data connector.

24. The kit of parts of claim 19 wherein at least one of the sections comprises a housing and two data connectors are both located on a same side of the housing.

25. The kit of parts of claim 19 wherein at least one of the sections comprises a housing and two data connectors are each located on opposite sides of the housing.

26. The kit of parts of claim 19 wherein at least one of the sections is configured with two data connectors positioned substantially perpendicular to each other.

27. The kit of parts of claim 19 wherein at least one of the sections is L-shaped.