RU2659592C2 - Mouse - personal computer pointing device - Google Patents

Abstract

FIELD: data processing.

SUBSTANCE: invention relates to the field of digital data processing. Device contains an uncontaminated body, a fully functional one-board universal personal computer (PC), a top camera, a pair of propellers, a rotation mechanism and sensors for the presence/absence of a supporting surface, allowing the mouse – PC to independently, contactlessly and safely follow the user's hand movements, front and two side cameras that track the finger movements of the user's hand and allow him to interact with the mouse – PC, pressure sensors, temperature, smoke and moisture triggered in the event of a catastrophic situation, a power system with a module for wireless power or recharging the mouse batteries – PC, and a chipset that controls the operation of the mouse – PC.

EFFECT: technical result is to provide a mouse – PC pointing device.

1 cl, 1 dwg

Description

The invention relates to the field of digital data processing using electrical devices, in particular, to designs of digital computers, as well as to designs of pointing devices that can be moved or installed by the user (2D - “mice”, trackballs, light “feathers”, pressure rollers), and to the designs of their accessories, can be used in the production of digital computers and peripherals for them.

The microcomputer Intel Compute Stick (the first analogue) is known, containing in its design: a compact flat case (104 * 38 * 12.5 mm), bearing on itself and containing all other structural elements; printed (system, motherboard) circuit board with electrical and electronic structural components; system on a chip (single-chip system) Intel Atom Z3735F (64-bit and quad-core) with a frequency of 0.5-1.83 GHz, with forced cooling by a fan, powered by a microUSB port (via a separate power supply) and with an integrated graphic Intel HD Graphics controller; online (2 GB) and read-only (32 GB, solid-state flash drive) storage devices, and the read-only memory device is expanded with a microSDXC memory card; one USB 2.0 port (for connecting peripherals - keyboards, “mice”, etc.), wireless Bluetooth 4.0 and Wi-Fi interfaces (according to IEEE 802.11b / g / n standards), as well as interfaces for wireless connection of additional displays and HDMI (for connecting the main monitor) with a maximum resolution of FullHD (1920 by 1080 pixels), which also outputs sound; thirty-two-bit operating system Microsoft Windows 8.1. The microcomputer is positioned by the manufacturer as the base office personal computer, thin client, for working with multimedia, for video advertising (http://www.ixbt.com/cpu/intel-computute-stick.shtml).

The disadvantages of this analogue microcomputer include: the lack of built-in (hardware and / or software) keyboards, a mouse, a document scanner, and so on. peripherals, and the presence of only USB, Wi-Fi, Bluetooth, HDMI interfaces, since the compact flat case of the microcomputer is non-separable and it does not have the ability to change the hardware configuration, which requires the user to independently purchase and / or connect the appropriate equipment; so much heat is emitted by the system installed on it on the chip that forced air cooling of the microcomputer is required, which inevitably clogs it with dust, and design features and / or special hardware for protecting and / or self-cleaning from dust and so on. pollution is not provided; the lack of built-in batteries or a wireless power system, which, despite the small size of this microcomputer, deprives it of mobility and turns it, in fact, into a stationary device.

Also known is the optical “mouse” Mouse - Box (the second analogue), which contains: a standard (that is, gripped and moved by the entire user's hand) body with two buttons and a scroll wheel; a printed (system, motherboard) board installed inside the case, with all the electrical and electronic components, including the mouse tracking unit; a quad-core ARM Cortex processor (with a frequency of 1.4 GHz) and the corresponding chipset powered by the battery built-in to the mouse or wirelessly (from the induction carpet); wireless charging of the battery is probably possible if it is built-in; operational and permanent (128 GB flash - memory) storage devices (the latter is supplemented by an external "cloud" storage); two USB 3.0 ports, a Wi-Fi interface (IEEE 802.11b / g / n standards) and an additional interface for wireless image transmission to the monitor, as well as a microHDMI port; accelerometer, gyroscope (probably to give "mouse" gesture commands). Developers recommend using Mouse - Box when a full-sized system unit or laptop may be inappropriate, but access to personal data and applications is still necessary (http://www.ixbt.com/news/2015/01/22/?show=tape )

The disadvantages of this “mouse” - computer - analogue include: giving the body, buttons and scroll wheel a standard shape, size and close to normal weight with the entire user's hand acting on them, which inevitably pollutes them, wears out their surface coatings and causes (when prolonged work) decent fatigue of the hand; lack of design features and / or special hardware for protection and / or self-cleaning from dust and so on. pollution and protection from damage to the surface coatings of the mouse; there is no built-in (hardware and / or software) keyboard, document scanner and other peripherals (and there are only USB, Wi-Fi and HDMI interfaces), because of which the user of this “mouse” will have to purchase all this additionally and connect on his own.

As a prototype, an optical non-contaminated buttonless pointing device “mouse” was chosen, having: a small-sized case, contactlessly located under the user's hand, covering it from above during operation (which ensures it is non-contaminated), with a special trihedral prismatic geometric shape, with a special dust and / or a dirt-repellent surface coating, with an optimally selected angle of inclination of the side faces of this body relative to the horizontal (which should lead to natural slippage vaniyu precipitating dust from the air) and mounted on / in it intensifiers (boosters, enhancers) self-cleaning process (vibrators, wiper, washer), whose role can perform, including propulsion and "mouse"; a printed circuit board installed inside the case with internal electrical and electronic components of the mouse structure located on it, including its chipset components; a pair of eccentric (unbalanced) propulsors and a rotation mechanism, completely located inside the case and allowing the mouse to independently (and contactlessly) move and rotate after the user's moving palm; sensors of the presence / absence of the supporting surface under the "mouse", ensuring its safety during all its movements; front, two side, and possibly upper cameras, tracking the team movements of the fingers covering the "mouse" from above the user's hand and the shift of his palm relative to the "mouse", which allows the "mouse" to move non-contact following the user's hand on the supporting surface; a chipset with a microcontroller that ensures the overall performance of the mouse, including its parking when it is completed, and scanning documents with it, and combining from three to five optical sensors in one chip, which can be included the structure of the tracking block for moving the "mouse" (LED or laser), the front, two side, and possibly the upper cameras; wired (PS / 2, for example, or USB), having the same surface coating as the mouse body, or wireless (working, for example, in the standard 2.4-GHz radio frequency band) interface through which ( or from batteries installed inside the mouse housing, power is supplied to the components of the mouse design (Russian patent for invention 2601832 "Non-contaminated buttonless pointing device" mouse ").

The disadvantages of this “mouse” prototype include: the lack of a built-in personal computer capable of ensuring the operation of at least office, network, and small and uncomplicated game programs, that is, the absence of a central processor with a set of system logic chips (chipset) or a system integrating them on a chip, operational and permanent storage devices, graphic and sound subsystems, interfaces for installing devices for expanding functionality, possibly network interfaces, input / output ports yes GOVERNMENTAL etc .; power supply of the “mouse” chipset only from built-in batteries or via a wired interface (through which batteries can be recharged at the same time), and powering the “mouse” wirelessly (from an induction “rug”, for example) or recharging its batteries in the same way not provided by mouse design; the absence of a “mouse” in the chipset or microcontroller of a hardware and / or software-implemented neural network used for pattern recognition and pre-trained to recognize the necessary (command) movements of the fingers, hands or the whole hand of the user or to detect identification signals and / or images of “parking” in the surrounding space "storages or niches, in order to perceive the user's gestural commands or to perform the" parking "of the" mouse "when the session with it is over; the mouse has no built-in sensors for pressure, temperature, smoke and moisture, as well as the corresponding software built into its chipset or microcontroller to back up user data to a remote storage of information in the event of an explosion, fire, flood, etc. catastrophic situations in which both the "mouse" itself and the important data contained in it can be damaged.

The objective of the proposed invention is: replacing the printed circuit board placed inside the mouse housing with the electrical and electronic components located on it, including the components of the mouse chipset, with a system (motherboard) with an additional fully-functional single-board personal computer installed on it, including central processor, RAM, information storage devices, video and audio subsystems, interfaces of expansion devices, possibly network interfaces, vv interfaces an ode - output, as well as a chipset of system logic or a system on a chip with the chipset of the mouse itself connected to them (or integrated into them); the inclusion in the design of the "mouse" of a device that would provide it with power not only by wire, but also wirelessly, and also would allow wireless recharging of its own batteries; adding a hardware and / or software implemented neural network to the hardware component and / or firmware of the chipset or microcontroller of the mouse, capable of both recognizing the presence or absence and displacement of the user's palm above the mouse and its command movements with fingers, as well as identifying signals and / or images of the “parking” storage or niche in order to then perform the “parking” of the “mouse” when the session with it is over; installation of pressure, temperature, smoke and moisture sensors on / in the mouse housing and embedding in its chipset the appropriate software that could automatically save important user data by backing it up to a remote information storage in case of any catastrophic situations, in which might happen to be a "mouse."

The problem is solved due to the fact that in the optical non-contaminated buttonless pointing device "mouse", containing: a small-sized case, contactlessly located under the wrist of the user’s hand, covering it from above during operation, with a tri- or pentahedral prismatic geometric shape, with dust- and / or a dirt-repellent surface coating, with an optimally selected angle of inclination of the side faces relative to the horizontal and with self-cleaning intensifiers placed on / in it, which can be, in m including propellers and "mouse"; a printed circuit board with internal electrical and electronic components located on it, including the components of the mouse chipset; a pair of movers and a rotation mechanism that allows the "mouse" to independently and contactlessly move and rotate after the user's moving palm; sensors of the presence / absence of the supporting surface under the "mouse", ensuring its safety during all its movements; front, two side, and possibly upper cameras, tracking the command movements of the fingers of the user's hand and the shift of his palm relative to the "mouse", which allows it to move non-contact following the user's hand; a chipset with a microcontroller that ensures the overall performance of the mouse, including its parking and scanning documents with it, and combines three to five optical sensors in one chip that can be part of the mouse tracking unit and front, two side, and possibly upper cameras; a wired or wireless interface for connecting to a computer through which power can be supplied to the components of the mouse structure: instead of the printed circuit board located inside the mouse with the electrical and electronic components of its structure located on it, including components of the mouse chipset, a system (motherboard) board with an additionally installed full-featured single-board computer for personal use, which includes a central processor, random access memory, information storage devices, video and audio subsystems, interfaces of functionality expansion devices, possibly network interfaces, input-output interfaces, and, of course, system logic chips or a system on a chip that combines these chips and a central processor with or connected to them (or mounted in them) the chipset of the mouse itself; in addition to the structural elements installed in the "mouse" that provide it with a power supply in a wire-based manner - the inclusion in it of a device that allows washing the "mouse" or recharging its batteries also wirelessly; such changes in the design of the hardware component and / or in the firmware of the chipset or the microcontroller of the mouse, so that they are able to ensure the functioning of the hardware and / or software neural network trained to recognize the presence or absence and amount of displacement located above the mouse during the user's palm and his team movements with his fingers, as well as find identification signals and / or images of the “parking” storage or niche in the surrounding space, so that later you olnit "parking" "click" when the work is finished with it; additional installation on / in the "mouse" body of pressure, temperature, smoke and moisture sensors and integration into its chipset, etc. appropriate software capable of automatically saving important user data by backing it up in the event of catastrophic situations in which the mouse may accidentally end up. In the hub architecture chipsets, the peripheral devices are always controlled by the south bridge chip, therefore the chipset or the mouse microcontroller via the PS / 2 interface can be connected to the SuperI / O (SIO) chip or BusI / O Controller, which, in turn, using a bus, for example, a Low Pin Count (LPC) can be connected to the south bridge microcircuit of the system logic chipset installed on the mouse motherboard - a personal computer (PC), or can be connected to the south bridge via the USB interface since USB bus controllers are usually built-in are placed in the "south bridges" of modern chipsets, or the chipset or the microcontroller of the mouse can be directly integrated into the "south bridge" or even into some kind of a single chip that combines the entire chipset of the system logic of the system board - System Controller Hub (SCH) , sometimes even including a central processor - a system on a chip. With this connection, the power of the “mouse” chipset or microcontroller is either via the PS / 2 or USB interfaces, or directly from the “south bridge”, or from the microcircuit of which it is included, and the drive drives of the movers and the rotation mechanism of the “mouse” - A PC can be run (due to their relatively high power), including directly from the power source built into the mouse (a wired interface for connecting peripherals, a wireless power device, or from batteries installed in the mouse). A device that allows you to supply the mouse with energy and periodically recharge its batteries wirelessly can be a power supply system based on the phenomenon of electromagnetic induction and consisting of an external transmitter (induction "carpet") and an inductive power receiver integrated into the mouse. An induction "mat" (tablet) is connected to a source of electricity (for example, an electric network), and a transmitter induction coil (with alternating current) built into it, a power controller (which controls the supply of power to the transmitter coil circuit), etc. create an alternating magnetic field surrounding the mouse located on the "mat". Induced currents appear in the receiving coil installed in the mouse, which, accordingly, feed the electromechanics and electronics of the mouse, as well as recharge its batteries, if necessary. Neural networks, as you know, are not programmed, but are "trained" on how to correctly implement a specific task, and have proven to be very useful in solving pattern recognition problems. To recognize the user's palm located above the “mouse”, his command finger movements and identification signals and / or images that help to perform “parking”, either a powerful (multi-core) processor of classical architecture (and, accordingly, can be integrated into the chipset or microcontroller of the “mouse”) , with the usual software simulating the behavior of a neural network), or a specially developed neuromorphic processor that implements electronic analogues of live neurons (processing elements of a neural network), Connections to each other in a network with a certain algorithm. Although these nodes (neurons) have very limited computational capabilities, the entire network as a whole, combining a large number of such elements, is able to perform rather complex tasks, for the solution of which, it is often simply not possible to write a suitable program, or the neural network is able to solve them better. Using a classic architecture processor for pattern recognition will probably not be the best solution, since these processors are bulky, consume a lot of energy and, in general, less efficient than high-performance, much more energy-efficient specialized neuromorphic circuits that perform processing in parallel and are also capable of accumulate "experience" and reprogram yourself to "learn" new opportunities. An explosion in a confined space is accompanied, as is known, by an increase in pressure, temperature, etc., therefore, pressure and temperature sensors can be used as indicators of an explosion by installing them on / in the "mouse" body. Exposure to high pressure causes a change, for example, resistance of strain gauges in a pressure sensor, and high temperature - a change, for example, resistance of thermistors in a temperature sensor, signals about which are transmitted first to the controllers of these sensors, and then to the chipset of the “mouse” - PC, for example "south bridge", on the appropriate interface. Thus, the “mouse” - PC software can monitor this type of threat both for the “mouse” itself and for the user data contained in it and automatically save this data (by copying it) to a remote storage of information. Another type of threat to user data may be a fire in which, as a rule, a significant amount of smoke is released. An optoelectronic smoke sensor based on the effect of smoke refracting a light stream emanating from a light source in the direction of the light receiver can be installed on / in the “mouse” housing - a PC and connected to its chipset to transmit the corresponding smoke smoke signal. Since the presence of only smoke in the air does not mean a fire, the smoke detector must work together with the temperature sensor. The principle of operation of the moisture sensor (to be precise, water leakage) is based on the fact that when water enters its contacts, the electrical resistance between them falls, and a signal is received on the sensor controller about the sensor entering the water environment. The presence of such a sensor in the mouse design allows saving user data in case of flooding of the room in which the mouse is operated, saving them in a timely (and, of course, well-protected) information store.

The technical essence and principle of operation of the proposed pointing device "mouse" - a personal computer are illustrated by a drawing on which it is depicted on a supporting surface (left view) with the hand of a human user located above it, that is, in its normal, working position.

The proposed pointing device "mouse" - PC (personal computer) consists of a housing 1, a system (motherboard) board fixed inside it, on which, in addition to the mouse chipset, and so on.  of electrical and electronic components of its design, a fully-functional single-board personal computer, pairs of movers with their drives and a rotation mechanism, sensors for the presence / absence of a supporting surface 2 under the mouse, front (main) video camera 3, two side (additional) video cameras 4 are additionally installed , top camcorder 5, and wired or wireless interface 6.  The small mouse case 1, like the prototype device, can take the form of a triangular or pentagonal prism (cross-section is an isosceles triangle or a house), on the lower side of which there should be a mouse tracking unit (LED or laser) .  To ensure self-cleaning from dust settling from the air, the housing 1 must have a surface coating that is similar, for example, to the coating of polymer eyeglass lenses (i.e. dust and / or dirt-repellent), obtained, for example, by vacuum spraying, and the optimum angle of inclination of the side the faces of the housing 1 relative to the horizontal should provide easy sliding of the deposited dust under the influence of gravity.  The intensifiers of the self-cleaning process of the housing 1 (vibrators, for example) can be mouse drives (rotating eccentrics) and their drives, which create quite sufficient vibration during their operation, or other means described in the Russian patent for invention 2555208 "Non-contaminated pointing device" mouse"".  The motherboard located inside the mouse housing 1 is completely similar in functionality to the motherboard of a single-board universal personal computer and may contain a central processor (including multi-core), a system logic chipset, RAM, information storage devices (solid-state drive, memory cards e.g. microSD, USB drives, etc. P. ), video and audio subsystems (graphic and sound controllers), interfaces of functionality expansion devices (if the design of case 1 and the motherboard allows), network interfaces and data input-output interfaces (USB, Wi-Fi, Wi-Gig, Bluetooth, HDMI etc. P. ) and so on.  Several chips of system logic, for compactness and cheapening their design, can be combined into one chip - System Controller Hub (SCH), or they can be combined with a central processor into a single chip - a system on a chip (single-chip system), including multi-core taking up quite a bit of space on the system board.  For example, a TAG Heuer Connected smart watch uses a motherboard with a microcomputer, on which, in addition to the chipset, an Intel dual-core processor for ultra-mobile devices (with a frequency of 0.5-1.6 GHz) is installed, as well as: RAM - 1 GB read-only memory - 4 GB (flash type); built-in interfaces - USB, Wi-Fi, Bluetooth; display - round, touch; built-in sensors - accelerometer and gyroscope; operating system - Android Wear.  With a further reduction in the size of similar microcomputers and a decrease in their energy consumption (for example, as a result of the transition to finer crystal manufacturing processes), as well as an increase in productivity (for example, due to multicore and internal optimization), it will become quite possible to use them as an integrated personal computer proposed mouse.  The chipset or microcontroller of the mouse can either be a separate structure located on the motherboard, included in the chipset of the system logic of the mouse - a PC and connected to the south bridge of the set, or it can be fully integrated into the south bridge of this set or in the microcircuit, which this bridge is part of.  The chipset or microcontroller "mouse", consisting of hardware and firmware, receiving data from the block tracking the movement of the "mouse", sensors for the presence / absence of the supporting surface 2 under the "mouse" and video cameras 3, 4 and 5 and processing them, produces the corresponding control actions and transmits them, except for the propulsors and the rotation mechanism, through, for example, PS / 2, USB interfaces or in another way to the "south bridge" of the chipset of the system logic, etc.  t P. connected to or integrated into, and through the same interfaces, directly from the "south bridge", etc. P.  and / or from another energy source (wired interface 6 for connecting peripherals, a wireless (inductive) power module or built-in batteries) receives power for its operation and, possibly, for powering the remaining (dependent on it) components of the mouse structure.  If the design uses a wired interface 6 for connecting a peripheral, such as a monitor, then the cable included in it should obviously have the same surface coating as the mouse housing 1 (that is, dust and / or dirt-repellent).  The microcontroller that is part of the mouse chipset, in addition to the control controller itself, can combine at least three (more precisely, from three to five) optical sensors in one chip that monitor the change in appearance as a supporting surface that covers the mouse on the user's palm and located in front of the “mouse” of human fingers, and possibly fingers of the human hand, located on the sides of the “mouse” (being part of the movement tracking unit, cameras 5, 3 and 4), and can be, for example, cubic design with optical sensors on all sides except the back.  For the operation of video cameras (motion tracking unit, 3, 4, and 5), which may include optical sensors of the mouse microcontroller, lenses, optical fibers, possibly LEDs or lasers, etc. are also needed. that can be installed on the chip itself (or, conversely, the chip itself can be installed in them) and / or on the system board and / or on the surface of the mouse case 1.  Such a combination of a controller and several optical sensors in one chip allows you to reduce the space occupied by the chipset in the already small volume of the mouse 1 housing, simplify its design, and reduce weight and cost.  The front (main) video camera 3 can either be a separate video camera mounted on the front end of the mouse housing 1 and connected to its chipset or microcontroller, or it can be based on the optical sensor of the mouse microcontroller facing forward and monitors command (i.e. horizontal and vertical) finger movements of the user's hand.  If the user simultaneously with the index and middle fingers makes a movement in which the ends of these fingers first slide along the supporting surface towards the “mouse” and then are transferred through the air from the “mouse” to the previous place (“rowing with your fingers to yourself”), or on the contrary ("rowing with your fingers away from you"), then the front video camera 3 interprets these movements as the commands "impact on the wheel, sensor, etc. P.  scroll "to scroll (open electronic document, for example), respectively, in one or, conversely, in the other direction.  The front video camera 3 interprets the separation from the support surface and returning the index or middle fingers back to it (“finger click”) as the “left click” or “right click” mouse buttons, respectively, which signal is then transmitted to it chipset or microcontroller.  Side (additional) video cameras 4 or can be two separate video cameras installed, possibly (according to the manufacturer), on the sides of the mouse housing 1 and connected to its chipset or microcontroller, or can be based on the left and right optical sensors of the microcontroller “mice” and are engaged in tracking team movements of the thumb and ring finger (as well as the little finger) of the same user's hand.  The parameters of these command movements should be set, obviously, by the manufacturer of the mouse and / or its software, and the movements themselves (more precisely, reactions to them) can increase the number of functions built into the mouse.  You can associate a certain movement, for example, of the thumb and / or ring finger (and little finger) of a human hand with the execution of some pre-programmed macro (macro command - a complex command consisting of a number of simple commands), launching any installed in the operating system “mice” - a PC program, a change in the resolution of the optical sensor of the mouse tracking unit, etc. P.  The front and two side video cameras 3 and 4, if they had optical sensors of a sufficiently high resolution, high-quality optics and the necessary software, could also function as built-in “mouse” - a virtual (software-implemented) PC keyboard in the “mouse” , interpreting certain movements of the fingers, hands, or the entire user's hand as commands to start / end the keyboard and select the necessary “buttons” on it (more precisely, the corresponding numbers, letters, and so on. ) and providing (through a chipset or microcontroller, of course) the input of this data into a "mouse" - a PC.  And since the “mouse” - the PC has built-in movers and a rotation mechanism, its movement tracking unit, which is based on the downward-facing optical sensor of the “mouse” microcontroller and, with a sufficiently high resolution of this sensor, high-quality optics and the required software, can also work (under the control of the chipset or microcontroller and the chipset of the system logic of the "mouse" - PC and with the appropriate use of propulsion and rotation mechanism) and as a document scanner, producing automatic The typed input of printed texts and / or images into a computer built into the mouse.  The upper video camera 5 is located at the top of the mouse housing 1 and, either as a separate video camera connected to its chipset or microcontroller, or based on the optical sensor of the mouse microcontroller facing up, monitors the movement of the user's palm located above the mouse during operation.  Responding to the displacement of the image formed by the folds of the skin and so on.  on the side of the user's palm facing the “mouse”, the upper video camera 5 (by means of a chipset or microcontroller and using movers and a rotation mechanism) forces the “mouse” to move with (or rather, under) the user's hand without direct contact with it, constantly supporting empty airspace around the “mouse”, and thus ensuring its non-pollution, and, ultimately, movement of the “mouse” cursor on the monitor screen.  So that the chipset or microcontroller of the “mouse” can detect “parking” storage or a niche with the help of video cameras 3 and 4 in the surrounding space, and then move the “mouse” into them without user intervention, it is obvious that you mark them with some identification signals and / or images.  This can be done using, for example, LEDs or images illuminated by them, clearly distinguishable both in bright daylight and in dark conditions.  The software of the chipset or the microcontroller of the mouse will only need to detect these same identification signals and / or images (when the user's hand has already been removed from the mouse), turning, if necessary, the housing 1 together with the video cameras 3 and 4 left and right, and then, after waiting a while, move the "mouse" in their direction until they just get out of the field of view of the camera 3, that is, until the case 1 simply rests against them.  Moving the “mouse” to the “parking” storage (special box, etc.) P. ) or a niche (in the monitor stand, for example) is required not only in order to free up space on the desktop and block outsiders from accessing the “mouse” - PC, but also, for example, to charge the “mouse” batteries, if the wired or wireless (inductive) charging function is built into the storage or niche.  The output of the mouse back to the working area of the supporting surface could be achieved if it was reversed in the same direction and approximately the same distance that should be stored in the memory of the chipset or microcontroller of the mouse.  In order to use the video cameras 5, 3 and 4, the chipset or microcontroller “mice” can effectively monitor the presence or absence and displacement of the user's mouse above the “mouse” during operation, command movements of his fingers and find the required “mice” in the surrounding area signals and / or images of the "parking" storage or niche, to then perform the "parking" when the current session with the "mouse" is over, the hardware component and / or the firmware of the chipset or the microcontroller of the "mouse" must include hardware (in the form of a neuromorphic circuit) and / or software implemented neural network.  Software that simulates the operation of a neural network on a processor with a classical architecture or operating on a specialized neuromorphic microcircuit can simulate some cognitive processes of the human brain, including pattern recognition.  Neural networks are parallel computing devices consisting of many simple processors (nodes) interacting with each other.  Each processor deals only with the signals that it periodically receives and the signals that it periodically sends to other processors, and, being connected to a fairly large network with controlled interaction, such simple processors are able to perform rather complex tasks together.  Although a solution based on a neural network can look and behave like ordinary software, implementations based on neural networks are "trained" rather than programmed, that is, the network "learns" to perform its task, rather than being programmed directly.  The "training" of the network consists in changing the values of the weights of the links between the processing elements, which will need to be set up by the manufacturer of the "mouse" and / or its software.  A solution based on a neural network will be more flexible, since the corresponding hardware-software system will be able to further, if its design allows, to increase the accuracy of pattern recognition with the accumulation of "experience" and adapt to possible changes.  A neuromorphic processor should be small in size, have a sufficiently low power consumption, and at the same time provide acceptable performance, as well as interaction with several built-in optical sensors or video cameras that can be connected to it at the same time.  Movers, their drives and the mechanism of rotation of the "mouse" - PC (including, for example, electric motors, gears, rotating eccentrics (unbalances), angle sensors, electromagnets, etc.  t P. ) can be arranged, can be powered by electricity, operate and controlled in the same way as described in the Russian patent for invention 2530333 "Mouse pointing device with lightweight grip".  This allows you to provide “mice” - the PC moves forward, backward, left, right, diagonally, as well as turns and turns in place, because of which it can accurately follow the user's palm moving relative to the supporting surface without direct contact with it.  Sensors of the presence / absence of the supporting surface 2 under the "mouse" (ultrasonic rangefinders, pressure sensors, etc. P. ) there must obviously be at least four pieces, they must be installed in the corners and / or perimeter of the case 1 (on its lower side) or they can be mounted directly in the supports 7 of the mouse case 1, can be connected to the chipset or microcontroller " mice "and, powered by energy from it, monitor the increase in the distance between itself and the supporting surface, the decrease in pressure on itself or something like that, to which the chipset or microcontroller of the" mouse "(its hardware component and firmware) should respond accordingly in a creative way, that is, stop the movement of the “mouse”, turn on the reverse motion, etc. d.  If the design of the “mouse” uses a wired interface 6 to connect peripherals, such as a monitor, similar, for example, VGA, HDMI, etc. P. , then the power supply for the “mouse” motherboard - the PC and other electrical and electronic components of the structure can be performed using the same interface.  Then the peripheral device, being connected to the electric network, provides the “mouse” with power by means of the built-in power supply unit with the corresponding output characteristics.  If the mouse design uses a wireless interface (or interfaces) 6 to connect peripherals, for example, Wi-Fi and Wi-Gig radio interfaces (IEEE 802 standards. 11b / g / n and IEEE 802. 11ad), etc. P. , then the components of the mouse structure can be powered from the built-in electric power source — batteries or a wireless (inductive) power supply module.  In the latter case, the paired (transmitting) inductive power device must be mounted in the supporting surface on which the "mouse" - PC (induction "rug", desktop, storage or a niche, works and / or parks). P. )  Using the wireless power module integrated into the mouse, the mouse batteries can also be recharged, and when the batteries are charged, the wireless power device installed in the supporting surface should automatically (in order to save energy) go into sleep mode (that is, partially disconnect) either by a signal from the "mouse", or after detecting its absence on itself.  Pressure, temperature, smoke and moisture sensors can be installed on / in the mouse housing 1 (including, possibly, in the leaky supports 7 of the housing 1), on its motherboard or can be integrated into the components of the system logic chipset are connected to the “mouse” chipset - a PC and, powered by it, monitor the pressure, temperature and transparency of the air in the room where the “mouse” is used, and the appearance of moisture on the supporting surface near the “mouse”.  If suddenly a sharp jump in pressure occurs in the room, the temperature rises significantly and air transparency decreases (which is usually characteristic of an explosion and / or fire), and also a layer of water appears on the supporting surface near the “mouse” (which may indicate flooding of the room), “mouse” chipset - a PC, having received signals from the above-described sensors, starts the process of saving important user data located in the “mouse” read-only memory by copying it wired or wirelessly to the remote information storage (network drive, for example).  Since the remote storage of information, theoretically, should be at a considerable distance and should be well protected, the transfer of data to this storage located in another room, on another floor of the building, or in another building in general, must guarantee that user data is removed from the risk of destruction inevitably arising in the event of catastrophic situations.

The above-described pointing device "mouse" personal computer is used as follows.

Immediately after turning on the power to the peripheral device from which the mouse is powered, the PC through its wired interface 6 (monitor, for example), or turning on the power to the wireless power supply device mounted in the supporting surface (induction "carpet"), or turning on the built-in a “mouse” of batteries (using, for example, a switch located on the back or bottom of the housing 1), if the design uses a wireless interface 6, which means turning on the “mouse” itself, its chipset or microcontroller ( of hardware component and embedded software) leads movers in a position which corresponds to the start of work. After loading a personal computer (from a solid-state drive contained, for example) into the built-in mouse, and so on. a person needs the software — the user puts his palm over the “mouse” located at this time, most likely in the “parking” storage or niche. In response to this, the chipset or microcontroller, having determined with the help of the upper video camera 5 the presence of a human hand above the “mouse” and controlling the drives of the movers and the rotation mechanism, automatically displays the “mouse” - the PC from the storage or niche on the working area of the supporting surface. If, after turning on and loading the "mouse" - the PC, the human hand did not appear above it, then its chipset or microcontroller, having detected the absence of a palm, waits for a predetermined time to make sure that this session does not take place, and then puts it into "sleep" mode (that is, partially turns it off) to save power (and then, if the "mouse" has not been in use for quite a long time, turns it off completely). To use the mouse to start moving the mouse cursor on the screen of the monitor to which it was connected, and thus start interacting with the software operating in the mouse, the user must first put his hand on the support surface and cover it with his hand on top is the “mouse” case 1, the dimensions of which are such that the entire “mouse” will completely fit under the hand, without contacting it, and then the user should begin to move the hand relative to the supporting surface. The upper video camera 5, tracking the shift and / or rotation of the user's palm, using the chipset or microcontroller of the mouse will form the necessary control actions on the drives of the movers and / or the rotation mechanism, as a result of which the mouse, moving and / or turning after the human palm (and, accordingly, moving the "mouse" cursor on the monitor screen), will always remain in the empty (more precisely, filled with air) space formed under the moving hand of the user's hand, but without contact with the skin. The empty space constantly maintained in this way around the mouse housing 1 guarantees its non-pollution, and the intensification of the self-cleaning process (due to vibration of the movers and their drives, for example, or by other means) can be ensured in the same way as described in the Russian patent on Invention 2555208 "Non-contaminated mouse pointing device." In order to use the “mouse” to give its software such commands as “pressing a button” and “influencing a wheel, a sensor, etc. of a scroll”, the user needs to perform the corresponding movements with his fingers (index and middle, and, possibly, big, nameless and little finger). Tracking these movements with the front and possibly side video cameras 3 and 4, just aimed at the fingers of the user's hand, also allows you to interact with the “mouse” non-contact, providing it with no pollution (and without tiring the brush). As a result, moving the wrist relative to the supporting surface and / or performing certain command movements with the fingers of the wrist, interact with the software working in the personal computer built into the mouse, just as if it were a standard, long-used, captured and hand-driven "mouse" connected, for example, to the system unit of a regular desktop computer. In the case when the user finishes his work with the "mouse" - the PC, he must remove his hand from it. The upper video camera 5, which monitors the presence of the user's palm, sends the corresponding signals to the chipset or microcontroller of the mouse, in response to which he, after waiting a while to make sure that this session is completed, performs the “parking” of the “mouse” - the PC, first having detected storage or niche, and then moving the mouse in them and putting it there into sleep mode. The parking of the mouse should obviously be done immediately after the operation of the operating system (but, of course, before turning off the power), unless the use of the mouse is provided for by the program logic of the system board of the mouse - PC (its BIOS, etc. by programs). Further, the “parked” “mouse” in one way or another can start the process of recharging its batteries by means of, for example, a wireless power device mounted in the supporting surface on which it rests, provided, of course, the batteries are present in its design and require recharging, so that he can prepare himself for the next session of the user’s work with himself, and then can continue to be in “sleep” mode or, if not used for a sufficiently long time, he can automatically turn off I do.

The invention allows by replacing the printed circuit board located inside the "mouse" with the electrical and electronic components located on it, including the "mouse" chipset or microcontroller, by a system board with an additional fully-functional single-board personal computer installed on it, complementing the ones available in the "mouse" "of structural elements that allow it to be fed by wire, equipment of wireless (inductive) power supply or recharging batteries, changes Chipset or microcontroller "mouse" in such a way that they are able to provide the functioning of the built-in hardware and / or software neural network that recognizes images and is used to control the "mouse", as well as embed pressure, temperature, smoke and moisture and related software that automatically backs up user data to a remote storage of information in case of catastrophic situations, turn the "mouse" into a very compact (that how the volume of its body can be reduced indefinitely), a universal office-household personal computer, the capabilities of which are enough for most ordinary users, able to work in a completely wireless mode, hygienic to use, less complicated and expensive than ordinary ones, and more convenient and safe in the process operation.

Claims (1)

The pointing device "mouse" is a personal computer (PC) containing a small-sized case with a triangular or pentahedral prismatic geometric shape, which ensures, due to the optimally selected angle of inclination of the side faces relative to the horizontal, the dust deposited from the air under the influence of gravity easily slip with dust and / or a dirt-repellent surface coating, with self-cleaning intensifiers installed on / in it - vibrators, the role of which can be performed, among other things, by the “mouse” propulsors and their drives, screeds and washers, structurally designed and able to move so that completely, constantly and without contact with human skin, be under the moving hand of the user’s hand, covering the “mouse” from above during operation, and thereby ensure that it is not contaminated, mounted on / in the housing and / or on a printed circuit board located in it, a pair of movers, their drives and a rotation mechanism that allow the "mouse" to independently move and / or rotate relative to the supporting surface on which it is operated, d sensors of the presence / absence of a supporting surface under the mouse, providing it with protection against falls during all its independent movements, the front and two side video cameras that track the command movements of the fingers, hands, or the entire user's hand interacting with the mouse, and interpret these movements in the quality of control commands given to the “mouse” and / or inputted to the computer to which the “mouse” is connected, commands and / or data, an upper video camera that tracks the presence or absence and offset and / or rotation of the middle of the inner the palm of the user's hand, located above the "mouse" during operation, and thus forcing the "mouse" to function and move synchronously with the user's hand without contact with human skin and thereby ensure non-contamination, an optical block for tracking the movement of the "mouse" relative to the supporting surface, which is a part of its chipset or microcontroller, as well as a chipset located on a printed circuit board that controls the operation of the mouse, interacts with a computer and contains a microcontroller, a cat A rd can combine in one chip both a controller that ensures the operability of the mouse and at least three optical sensors and is capable of using the built-in software to “park” the “mouse” when the user’s session with it is completed, and then again bring it to the working area of the supporting surface when the user’s work with it starts again, scan documents and enter them into the computer, as well as ensure the operation of the virtual (software-implemented) “keyboard” and input using n it into a computer of commands and / or data, characterized in that in / on its case and / or on its printed, namely system (motherboard) board, a fully-functional universal single-board computer for personal use is placed, capable of connecting to peripheral devices using wired and / or wireless interfaces, moreover, the chipset or microcontroller "mouse" is part of the chipset system logic, including single-chip, or a system on a chip (single-chip system), which plays the role of this set, this computer As well as pressure, temperature, smoke and moisture sensors are installed, a power supply or recharging device for its battery or batteries is built-in in its wireless power system, namely inductive, and its chipset system logic or system on a chip is capable / capable of functioning hardware and / or software implemented neural network or networks for pattern recognition used / used to control the “mouse” - PC, as well as by signals from pressure, temperature, smoke or air sensors w to start up the software that stores user data using their backup wired and / or wirelessly to a remote data store.

Images