RU2127019C1 - Remote-control console for domestic appliances and computer systems - Google Patents

Abstract

FIELD: remote monitoring and control of several simultaneously operating entities. SUBSTANCE: control console has transceiver, microprocessor unit with data bus, graphics display, push-button, keyboard, and keyer. EFFECT: enlarged functional capabilities. 15 cl, 15 dwg

Description

 The invention relates to remote monitoring and control, mainly appliances, household appliances: audio, video systems, telephones, systems for protecting rooms from unauthorized access, refrigerators, microwave ovens, washing machines, microclimate devices, fans, tools, etc., and also computer systems, and can be used to control many units of simultaneously operating devices.

 Currently, most modern electronic devices intended for use at home have special remote controls that allow you to control the most important functions of these devices from a distance. The most important control functions of various electronic devices can vary significantly. Therefore, each such electronic device is equipped with its own special control panel. Typically, such remote controls have many mechanical specialized control buttons. The disadvantage of using most of these remote controls is the inconvenience caused by the need to use different remote controls at the same time, and the user is overly complex because of the need to remember the functional purpose of many specialized buttons on different remote controls. The number of electronic devices with various remote controls is constantly growing. Therefore, there is a real need to combine the control functions of various electronic devices in one universal remote control and create a control system for many simultaneously operating electronic and other household devices. Moreover, the user should be able to complete for himself a set of these devices.

 A remote control device for simultaneously controlling many units of working electronic devices is known, comprising a remote control, a relay of control commands from the control panel to the end user electronic devices, a display for displaying menu items, a means for switching and entering a menu item, a transmitter (US patent N5631652A, IPC HO4B3 / 00, publ. 1997).

 The disadvantages of this device are the following factors. By its functional features, the device is limited to using a fixed set of mechanical buttons on the body of the remote control. In addition, the device is not intended to enter character information and cannot be used to control computer systems.

 These shortcomings were partially eliminated in the device of the Sony company, known as the Remote Master 1000, designed for remote control of household electronic equipment (TVs, VCRs, music centers) of the main manufacturers (advertising descriptions of the Sony devices Remote Master 110 "and" Remote Master 1000 "). The device contains buttons and a disk manipulator located in the housing and has a programming function, thanks to which it stores control codes in the form of signals in the infrared range for any audio and video equipment. It is possible to simultaneously support several similar devices from different companies (for example, three televisions and four video recorders). The remote controls teletext and text.

 This universal remote control also has its drawbacks and limitations when it is used as a universal remote control. Its disadvantages are the functional limitation of the above set of keys: the use of a fixed set of mechanical buttons on the body of the remote control; formation of control information only in the form of commands for pressing, holding and pressing keys (no other type of manipulators is provided); the device is not designed to work with a word processor and therefore it cannot be used to control computer systems.

 At the same time, the prior art is widely represented by devices for working with symbolic information and controlling computer systems without using a hardware keyboard.

 Thus, a computer system is known having a flat-screen display and a sensor element. The system uses simulated keyboards that are displayed on the display screen and, in response to a touch of the simulated keys, generate corresponding control signals (US patent N 4725694, IPC G 08 C 21/00; G 02 F 1/13; G 06 K 15/18, publ. . 1986).

 The basis of this solution is the combination of the image of the virtual keyboard on the touch screen with the active positions that coincide with the positions of the displayed keys on the background of the main working screen. This allows the user to physically click on the virtual buttons as if using a regular keyboard. On the same display with a flat screen, you can also display the output of the computer, and / or the results of calculations, and / or the results of information search queries.

 Also known is a data input system using a touch screen panel connected to a personal computer and display. The input system adapts the forms of the tools used to the user's goals - it automatically displays a specific tool such as a keyboard, menu, calculator, etc., to facilitate the input of information in the corresponding field of the form or chart. This system implements the idea of using a touch screen panel and virtual keyboards of various shapes and contents (US patent N 4763356, IPC H 04 M 1/23, G 06 F 15/18, G 08 C 21/00, publ. 1986).

 It should be noted that contextual filling of screen forms has been used for a long time. For example, Windows has standard tools: a word processor appears in the text box; in the window for choosing alternatives a menu with alternatives appears; only numeric keys are active in the numeric field, etc.

 Another embodiment of data entry is a system based on emulating interaction with a three-dimensional object that is displayed on a touch screen. The control touches of such an image on the touch screen in appropriate positions constitute the essence of the strategy of such an interface. For example, a card is displayed on the screen. If you touch the image of the corner of the card on the screen, the image of the card will turn over (US patent N 4649499, IPC G 08 C 9/00, G 06 F 15/62, publ. 1984).

 The listed patents protect technical solutions regarding the use of touch screens and virtual keyboards for the user interface. However, the known methods of using virtual keyboards mentioned above have certain limitations: firstly, in the listed inventions, a touch screen is required; secondly, they are not intended to control various external devices of household appliances. In addition, it is obvious that the ability of the user to physically click on the virtual buttons of the virtual keyboard on the touch screen, as during normal work on a real keyboard, is not the main goal of the stand-alone control panel and does not solve the whole complex of problems of creating a universal control panel for various external devices.

 A known method of inputting symbolic information into computer systems, which eliminates the need for mandatory use of a touch screen. The essence of the method lies in the fact that the working position of the input associated with the manipulator, and the virtual keyboard form a single interface object. In the process of entering character information, the image of the character set is positioned on the display screen relative to the output position and their relative position is fixed, the set is moved across the display screen to the specified positions, the specified character is entered into the computer system after the image of the specified set is captured. After positioning the image of the character set relative to the position of the output, they are subsequently moved synchronously while maintaining a mutual spatial arrangement. The method allows to significantly accelerate the input of text information by reducing the time for switching the user's attention between the position for entering text information and the virtual keyboard.

 Using this input method for working with textual information, as well as in other interface situations when operating an autonomous control panel, allows to obtain a significant effect. The remote control with such a control interface can work in a single style: as a remote control panel for external devices of household appliances; as a remote control device for external computer systems that performs the functions of a text keyboard; as a remote control device for external computer systems that performs the functions of a universal manipulator (RF patent N 2032212 IPC 6 G06 F 3/033, 1996).

 However, the application of the above method of inputting symbolic information is limited to using it in computer systems to solve problems associated with the processing of symbolic information. Thus, this method solves only part of the tasks for remote control of household appliances and computer systems.

 Closest to the proposed invention by its technical nature and the result achieved when using it is a multifunctional remote control device for simultaneous control of many units of working technical devices using a graphic display and electrically designated user-selectable control keys. This multifunctional portable remote control device with an autonomous power supply can control and control many electronic devices: CD player, VCR, TV, satellite receiver and integrated receiver / decoder. A graphic display, a plurality of electrically designated user-selectable control keys, as well as special buttons "Help", "Start", "Mode" are built into the device case. The use of user-select buttons and the visual designations of these buttons are set depending on the control mode of one or another external electronic device. At the same time, prompt messages and other useful information are displayed on the graphic display. The images on the electrically designated user selection control keys correspond to the purpose of the keys used. The use of such keys greatly simplifies their marking and makes it possible to use this remote control device to control a wide range of various external devices of electronic equipment, and subsequently expand this set (US patent N 5450079A, IPC 6 H 03 K 17/94, publ. 1995).

 This device has the following disadvantages that limit its use as a universal control tool: in terms of its functional features, it is limited to using a fixed set of mechanical buttons on the remote control case and is not intended for entering symbolic information and for controlling computer systems.

 SUMMARY OF THE INVENTION

 The basis of this invention is the creation of a remote control device for household appliances and computer systems, which allows to improve user characteristics and ergonomic indicators, as well as expand the scope of multifunctional remote control devices using a microprocessor, memory, graphic display built into a portable and standalone control panel , for simultaneous management of many units of external devices and work with various types and platforms moms of computer systems.

 The indicated technical result is achieved through the use of an interface system based on the concept of a virtual dialog object for keyboardless input of symbolic and, in particular, textual information and the use of a multifunctional manipulator with more than two degrees of freedom. At the same time, a virtual keyboard is shared in the remote control, with the help of which all the basic functions of the user interface are implemented, and a manipulator with a button, through which at least two degrees of freedom of plane movements and button presses are recorded.

 In addition, the joint use of virtual keyboards and the specified manipulator in the control panel allows you to implement a unified user interface in a single style and standard for a wide variety of applications, which fully implements all the possibilities of hierarchical positional menus and at the same time provides the ability to enter and edit text information using any national alphabet .

The problem is achieved with the achievement of the above technical result is solved by the fact that in the remote control of household appliances and computer systems, containing placed in the housing and connected to a power source, a transmitter-receiver, a microprocessor with a data bus, memory and operating system, a graphic display, a button, a keyboard system, including many keyboard positions with virtual symbols, controlled by external devices displayed on the screen of the graphic display, when The transmitter-receiver, graphic display, memory are functionally connected and via a data bus with a microprocessor, a manipulator connected to a power source and connected to a processor via a data bus is inserted into the remote control, and the key system contains a virtual keyboard, active position, element position indicator a virtual keyboard controlled by the manipulator, a button connected via a data bus with a microprocessor, activating the keyboard position, marked with a pointer, displayed on the screen one display, while the virtual keyboard and an active position and a position is logically linked in the operation;
- as well as the fact that the virtual keyboard includes a plurality of keyboard positions of the interface for communicating with external devices and controlling the general functions of the remote control, including a keyboard position that sets the character input mode, while the active position shows the switching mode between external devices, and the remote remote control is in the switching mode between external devices;
- as well as the fact that the key positions of the virtual keyboard of any level and purpose contain a key position of the output related to the general functions of controlling the remote control;
- as well as the fact that the key positions of the virtual keyboard are made in the form of icons indicating the corresponding external controlled devices and the corresponding control functions of the remote control;
- as well as the fact that the virtual keyboard includes a plurality of keyboard positions of the interface for controlling the corresponding external device and controlling the general functions of the remote control, the active position indicates the corresponding external controlled device, and the virtual keyboard contains the keyboard positions of the set of control functions of this external device and remote control functions, and as a result of activating the exit key position on the virtual keyboard with the pointer, the remote control ion control enters the state of the switching mode between external devices;
- as well as the fact that the active position is a symbolic position, and its position on the graphic display screen is controlled by the manipulator, while pressing a button on the graphic display screen displays a virtual text processor keyboard in a fixed position relative to the active position, containing a set of keyboard positions with printed characters and a set of keyboard positions of the interface containing the position of removal of the virtual keyboard of the word processor from the screen of the graphic display;
- as well as the fact that the virtual keyboard includes a plurality of key positions with printed characters and key positions of the interface for controlling the input character mode, and as a result of activating the key position of the printed character by the pointer on the virtual keyboard, the corresponding printed character is printed at the location of the active text position and move the active position and virtual keyboard on the screen of the graphic display to the location of the subsequent printed text symbol, and as a result of activation the pointer on the virtual keyboard of the word processor of the delete position is deleted from the screen of the graphic display;
- as well as the fact that the graphic display screen is made in the form of a touch screen;
- as well as the fact that the touch screen of the graphic display is used as a manipulator;
- and also the fact that the remote control further comprises a reader connected to a power source, and its output is connected to the microprocessor via a data bus;
- as well as the fact that the reader is made in the form of either a micro-camera, or in the form of an optical scanner, or in the form of a microphone;
- as well as the fact that a touch screen is used as a button;
- as well as the fact that a button is used as a manipulator, which performs the functions of pressing, pressing and moving.

 In other words, the task is solved by forming a set of virtual general-purpose keyboards: to switch control between external devices; to include in the interface of the control system a new external device and disconnect from the system interface one of the already connected external devices. Virtual keyboards are also formed for using various national alphabets and language systems when working with text information.

 The general principle of an interface system based on virtual keyboards is as follows. The virtual keyboard at any time is logically and positionally connected with the active position on the graphic display of the control panel. The logical connection between the virtual keyboard and the state of the control system allows you to set the appearance of the virtual keyboard and the purpose of the external device and the consistency in their functioning. The positional relationship between the virtual keyboard and the active position on the graphic display allows the user to easily associate the contents of the controls located on the virtual keyboard with an external device that can currently be controlled. And as a result, it makes it easy to understand and work with the control panel, always in the context of the functional state of the entire system. The virtual keyboard itself is a single graphic object displayed on the display screen of the remote control in the form of a holistic image, which is formed taking into account the psychology of human perception and the ergonomics of its use as a management tool. The virtual keyboard contains a specially organized set of interface elements that are easily distinguishable in form, color and functional characteristics. At any time, one of these elements of the virtual keyboard interface is in an active state, always highlighted visually and responds to a button click. Using the manipulator and the button, the user can easily switch control to one or another element of the virtual keyboard interface to transmit a signal to press the button. If as a result of the response of the control system to the control action, the interface situation on the display screen changes and the active position moves to another place on the display screen, then the virtual keyboard itself occupies a coordinated position with respect to the active position that the user is used to. These coordinated movements solve two problems: the active position is not obscured by the virtual keyboard and the user association between them is not broken, that is, the user does not need to switch his attention between them each time.

 Using the input of textual information, the indicated advantage and effectiveness of the proposed interface are clearly demonstrated. The virtual keyboard for entering textual information contains the required character set of the selected alphabet. The user simultaneously sees the character entry position in the selected text context, located under the virtual keyboard, and sees the highlighted active character on the virtual keyboard itself. When a button is pressed, the indicated character is entered into the input position, and the input position, as is customary in printing devices, moves to the next position after the entered character while moving the virtual keyboard. Selecting the necessary characters with the manipulator and pressing the button, the user enters a sequence of characters without losing the position of input moved in the text from his observation area. Using special control characters-commands on the virtual keyboard, the user can easily and quickly change the position of character input, select, delete and insert characters and fragments into the text, that is, perform the full functions of a word processor, using one universal button and a simple manipulator.

 When working with any external device, thanks to the positional coordination of the active position and the virtual keyboard, the user always knows exactly which external device he is working with, in what phase of interaction the control panel is and this external device. Thanks to this implementation of the interface, he always knows what he can and should do at any given time.

 To work with a specific external device, specialized virtual keyboards are formed in which the specific features of controlling this external device are displayed. Using the ability to expand the collection of sets of virtual keyboards stored in the control panel memory by additionally including information about new external devices in the form of new virtual keyboards, the user can include new external devices in the control system, thereby expanding the functionality of the stand-alone control panel. Obviously, using this approach, it is quite simple to modify and develop the considered control system of external devices. At the same time, it is enough to supplement the information in the console's operating system about new virtual keyboards.

 Another very important application of the invention is the ability to use such a control panel as a keyboard when working with external computer systems that have their own graphic displays. At the same time, all the advantages of remote access are used, in particular access to personal computers, laptops, large flat-panel wall displays and any other systems developed from microcomputers. The software creates the same virtual keyboards that are used in the control panel, on the displays of these computer systems and transmit from the control panel information about changes on the display screen of the control panel and codes generated by the user using the virtual keyboard to external computer systems from an external computer system. The feedback between the user's control actions and the response to these control signals of the external computer system is carried out in the same visual way using a person’s gaze on the screen of the external display instead of using the display screen on the control panel. Coordinating information is necessary for the formation and management of virtual keyboards on external displays, and character codes are transmitted using infrared or radio transmitters and receivers, which is currently not difficult.

 In addition, in the present invention, the effect of increasing the number of available degrees of freedom of movement of the manipulating control element of the manipulator due to the formation and use of various topologies of virtual keyboards is achieved. As a result, the proposed remote control has the opportunity to quickly manage virtual reality objects having three degrees of freedom or more, instead of using expensive specialized joysticks and manipulators with six degrees of freedom. For example, to control arbitrary movements and accurate positioning of an object in a virtual reality environment, using the invention, it is enough to form a special type of virtual keyboard. Other options for the operation of the manipulator of the control panel using the present invention are also possible. For example, it is possible to use the invention in multimedia computer games, simulators and virtual reality tools.

In addition to the above functions, a very important application of the invention is the ability to use such a control panel to identify a person. Placing the reader inside the control panel will allow you to use it:
- as an access device to various databases and computer networks, protected from unauthorized access;
- as a means of protection and access to a personal financial account through specialized ATMs and computer networks;
- as a means of access to premises and protected areas closed from unauthorized access;
- as an access key for driving vehicles or other important industrial or strategic objects.

 The combination of the possibilities of working with symbolic information with the capabilities of a reader made, for example, in the form of a miniature video camera or other scanning device, gives a new quality to increase the reliability of the protection system, as it allows you to combine the capabilities of symbolic encoding and identification of the person, for example, by fingerprints or analysis three-dimensional image of fingers, using for this a personal portable remote control.

The invention is illustrated by a description of specific, but not limiting the present invention, embodiments of a control panel of the accompanying diagrams and drawings, in which:
figure 1 shows a General view of the remote control with a graphic display screen and a manipulator, with which control various external devices;
figure 2 shows the display screen of the control panel with the image of the virtual keyboard and the active position, which show the user that is currently set to switch between various external devices;
figure 3 shows the display screen of the control panel with an example image of a virtual keyboard that allows you to control an external device - a television receiver, and an active position, showing the user that is currently set to control the television receiver;
figure 4 shows an example of the state of the image of the display screen of the control panel in two variants of the state of the control system: option A - the screen shows the position for entering text without an image of the virtual keyboard and option B - position for entering text with the image of the virtual keyboard;
figure 5 shows an example of the transition from the screen state (figure 4, option B) of the display of the control panel to a new screen state when there has been a change in the position on the screen of the input position and the associated position of the virtual keyboard after entering several text characters;
in FIG. 6, 7, 8 show examples of three options for a virtual keyboard for entering textual information - character layout options for the Latin alphabet, numbers with special characters, and character layout options for the Cyrillic alphabet;
Figures 9, 10, 11 show designations of special control positions for textual virtual keyboards of the Latin alphabet, numbers with special characters and Cyrillic;
in FIG. 12 shows a functional diagram in the form of a Petri net that defines the algorithm of the console in the mode of working with text and symbolic information;
on Fig depicts a functional diagram in the form of a Petri net, which is a model and formally describes the algorithm of the user with the control panel in the process of controlling various external devices;
on Fig depicts an example of the use of the control panel, when it is used to control external computer systems and enter into them text and character information using displays of computer systems;
on Fig shows a block diagram of a remote control.

 The remote control 1 (Fig. 1) consists of a housing 2, in which a graphic display screen 3, a manipulator 4, a button 5 are integrated. The remote control 1 also includes: a system unit 6 (including a microprocessor with a data bus and memory) for controlling the operation the manipulator 4, the screen 3 and the transmitter-receiver 7, designed for remote communication of the remote control 1 with external devices of household appliances 8 and external computer systems 9. The system unit 6 stores in its memory the operating system, and together they form a system 1 st remote control.

 Figure 2 shows an example image of the screen 3, with a possible version of the virtual keyboard 10, positionally associated with the active position 11 of the screen 3. The virtual keyboard 10 includes a set of 12 interface elements made in the form of icons that indicate external devices 8 (figure 1 ) and 9, as well as a set of 13 (Fig. 2) interface elements made in the form of pictograms, with the help of which it is possible to perform general functions for controlling the remote control 1 (Fig. 1). The icons of any virtual keyboard and any active position for any screen images are stored in the information form in the memory of the system unit 6 (Fig. 1) and are formed on the screen 3 using the operating system.

 The composition of any virtual keyboard includes a pointer 14 (figure 2) of the activated element for the icons from sets 12 (figure 2) and 13. The position of the pointer 14 can be controlled using the manipulator 4 (figure 1). The pointer 14 (figure 2) is always only within the area of the virtual keyboard 10 and never goes beyond it. He always points to one or another element of the virtual keyboard interface, activating it. The activated element of the virtual keyboard is launched by pressing the button 5 (Fig. 1).

 In FIG. 2 shows one example of the position of the activated element 15 - on the icon of the TV. For example, the TV control mode is activated by starting the activated element 15 on which the pointer 14 is mounted. Figure 3 shows an example of a screen 3 image, with a variant of the virtual keyboard 10, which corresponds to the particular selected external device - a television receiver and is intended for its control.

 If you start item 16 from set 13 (Fig. 2), then the state of the control system of the console 1 (Fig. 1) will transition to a lower system level - the editing mode of the list of objects of set 12 (Fig. 2). At this system level, the user can add or remove elements of set 12 interface. This means connecting or disconnecting the corresponding external device from the control system.

 In the case of the launch of element 17 from set 13, a special virtual keyboard is displayed on screen 3, working with prompts and instructions for the user to use the remote control 1 (Fig. 1).

 Element 18 (Fig. 2) of set 13, when launched, calls up a screen processor 3 (Fig. 4, option A) with a special cursor - input position 19, which is the active position of screen 3. The word processor is part of the operating system and allows display various textual information on the screen 3 and position the input position 19 (FIG. 4 option A) at any position of the text using the manipulator 4 (FIG. 1).

 The output image of the virtual keyboard 10 (figure 4 option B) for working with text information is carried out by pressing the button 5 (figure 1). The position of the virtual keyboard 10 (Fig. 4 option B) on the screen 3 is always consistent and connected with the input position 19 and forms a single whole with it - a single interface object.

 The example of FIG. 5 shows the state of the image of the screen 3 after entering one word from the state and position of the virtual keyboard 10 (Fig. 4 option B). As you can see, the virtual keyboard 10 retained relative positioning to input position 19, although together they shifted to a new position relative to the entered word.

 The example in FIG. 6 shows a virtual keyboard 10 with an input position 19 for inputting text information in embodiment 20 of the character layout for the Latin alphabet.

 The example in Fig. 7 shows a virtual keyboard 10 with an input position 19 for entering text information in a variant 21 of the character layout for numbers and special characters.

 The example of FIG. 8 shows a virtual keyboard with input position 19 for entering text information in embodiment 22 of the character layout for the Cyrillic alphabet.

 It is not difficult for the user to switch virtual keyboards 10 (Figs. 6, 7, 8) from one character layout to another, since the functionality of all of the listed character layouts is identical and largely familiar from the usual practice of using typewriter keyboards and personal computers. This statement is explained by the layouts of the symbols of the virtual keyboards: in Fig. 9 for the Latin alphabet, in Fig. 10 for numbers and special characters, in Fig. 11 for the Cyrillic alphabet.

 Figure 9 shows a detailed plan of the virtual keyboard 10, which contains the following interface elements. In the area 23 of the virtual keyboard 10 are the characters of the Latin alphabet along with the usual punctuation marks. Functional symbol 24 is intended to remove the virtual keyboard image 10 from the screen 3 (Fig. 6). Functional symbol 25 (Fig. 9) of the "baskspase" operation, which indicates the operation of deleting the symbol image in the previous position of the text from the output position 19 (Fig. 6) ) while moving the position of the output 19 and the associated position of the virtual keyboard 10 to the previous position of the screen 3 while maintaining their relative position. Functional symbol 26 (Fig. 9) of the "Enter" operation (an analogue of the same name on the computer keyboard), which translates the output position 19 (Fig. 6) to the initial position of the next line synchronously and moves the virtual keyboard 10 while maintaining their relative position. Functional symbol 27 (FIG. 9) of the “Caps Lock” operation, which switches the virtual keyboard 10 (FIG. 6) to the capitalization input state. Functional symbol 28 (Fig. 9), replacing the virtual keyboard 10 (Fig.6) image of variant 20 of the character layout for the Latin alphabet by the image of option 21 (Fig. 7) character layout for numbers and special characters. Functional symbol 29 (Fig. 9), which replaces the image of option 20 (Fig. 6) of the character layout for the Latin alphabet on the virtual keyboard 10 with the image of option 22 (Fig. 8) of the character layout for the Cyrillic alphabet. The pointer 14 (Fig.9) shows the activated interface element of the virtual keyboard 10.

 The virtual keyboard 10 (FIG. 10) has a character layout for numbers and other special characters. There are no functional symbols 27 (Fig. 9) and 29 on it. Functional symbol 30 (Fig. 10) replaces the image of option 21 (Fig. 7) of the character layout for numbers and special characters with the image of option 20 (Fig. 6) on the virtual keyboard 10 ) character layouts for the Latin alphabet.

 The virtual keyboard 10 (Fig.11) has a character layout for the Cyrillic alphabet. Functional symbol 31 replaces the image of option 22 (FIG. 8) for character layout for Cyrillic with the image of option 20 (FIG. 6) for character layout for the Latin alphabet in virtual keyboard 10.

 In FIG. 12 is a diagram of a Petri net, which is a functional model and formally describes the algorithm of user operation while working with a virtual keyboard and a word processor.

 Petri net can be performed. Network performance is controlled by the number and distribution of chips in positions. The transition from position to position is triggered by the removal of chips from its input positions and the formation of new chips placed in its output positions (see, for example, Peterson J., Petri net theory and modeling of sistems. Prentis-Hall, Inc., Englewood Cliffts, NJ, 1981).

The diagram of the Petri net consists of positions depicted in the form of circles, which mean:
P0 (Fig. 12) is the state of the remote control 1 (Fig. 1), when the position of terminal 19 is shown on the screen 3 (Fig. 4, option A), and the virtual keyboard is not shown. In this state, character entry is not possible. The output position 19, the user can set at any position of the text on the screen 3 using the manipulator 4 (figure 1).

 P1 (Fig. 12) is the state of the control panel 1 (Fig. 1) when on the screen 3 (Fig. 4, option B) the image of the virtual keyboard 10 is formed in a fixed position relative to the output position 19. In this state of the virtual keyboard 10, the pointer 14 installed on the functional symbol 24 (Fig.9) to delete the image of the virtual keyboard.

 P2 (Fig. 12) is the state of the control panel 1 (Fig. 1), when on the screen 3 (Fig. 4, option B) the output position 19 is shown together with the virtual keyboard 10. In this state, characters can be entered, since the pointer 14 installed on one character: letter, number or additional print character area 23 (Fig.9) virtual keyboard.

 P3 (Fig. 12) is the state of the control system of the remote control 1 (Fig. 1), when on the screen 3 (Fig. 4, option B) the output position 19 is shown together with the virtual keyboard 10. In this state, the pointer 14 is installed on one functional symbol : 25-29 (FIG. 9), 30 (FIG. 10), 31 (FIG. 11).

In addition to positions, the Petri net diagram consists of transitions depicted in the form of rectangles, which mean:
t0 (Fig. 12) - the operation of moving around the screen 3 (Fig. 4, option A) of the output position 19 using the manipulator 4 (Fig. 1),
t1 (Fig. 12) - operation of pressing a button 5 (Fig. 1),
t2 (Fig. 12) is the operation of moving the position of the pointer 14 (Fig. 4, option B) from the position of the functional symbol 24 (Fig. 9) to delete the image of the virtual keyboard in one of the positions of the printed characters - area 23 of the virtual keyboard,
t3 (Fig. 12) is the operation of moving the position of the pointer 14 (Fig. 4, option B) from the virtual keyboard area 23 (Fig. 9) to the position of the function symbol 24 to delete the image of the virtual keyboard 10 (Fig. 4, option B),
t4 (Fig. 12) is the operation of moving the position of the pointer 14 (Fig. 4, option B) over region 23 (Fig. 9) of the virtual keyboard,
t5 (Fig. 12) is the operation of pressing the button 5 (Fig. 1) when positioning the pointer 14 (Fig. 4, option B) on a specific printed symbol of the virtual keyboard area 23 (Fig. 9). In this case, the image of the corresponding printed symbol is output to the output position 19 (FIG. 4, option B) on the screen 3, and the output position 19 itself moves to the next position on the screen 3 together with the virtual keyboard 10,
t6 (Fig. 12) - the operation of moving the position of the pointer 14 (Fig. 4, option B) from the virtual keyboard region 23 (Fig. 9) to one of the positions of the set of functional symbols: 25-29 (Fig. 9), 30 (Fig. .10), 31 (Fig. 11),
t7 (Fig. 12) is the operation of moving the position of the pointer 14 (Fig. 4, option B) from the position of the functional symbol 24 (Fig. 9) to one of the positions of the printed characters of the area 23 of the virtual keyboard 10 (Fig. 4, option B),
t8 (Fig. 12) is the operation of moving the position of the pointer 14 (Fig. 4) within the set of functional symbols: 25-29 (Fig. 9), 30 (Fig. 10), 31 (Fig. 11),
t9 (Fig. 12) is the operation of pressing the button 5 (Fig. 1) when positioning the pointer 14 (Fig. 4, option B) on one of the functional symbols: 25-29 (Fig. 9), 30 (Fig. 10), 31 (FIG. 11),
t10 (Fig. 12) is the operation of pressing the button 5 (Fig. 1) when positioning the pointer 14 (Fig. 4, option B) to the position of the functional symbol 24 (Fig. 9) to delete the image of the virtual keyboard 10 (Fig. 4, option B) from screen 3,
In the initial state, the position P0 (Fig. 12) contains a control chip 32. On the diagram of the Petri net, this state is indicated by a black ball inside the position P0.

 In FIG. 13 is a diagram of a Petri net, which is a functional model and formally describes the algorithm of the user with remote control 1 (Fig. 1) in the process of controlling various external devices.

The Petri net diagram consists of positions that mean:
Q1 (Fig. 13) is the state of the control panel 1 (Fig. 1) when the image of the virtual keyboard 10 is formed on the screen 3 (Fig. 2) in a fixed position relative to the active position 11. In this state of the virtual keyboard 10, the pointer 14 is set to functional symbol 16 to go to a lower system level - editing mode of the list of objects of set 12, where the user can add or remove elements of the set 12 interface. This means connecting or disconnecting the corresponding external device from the system management.

 Q2 (Fig. 13) is the state of the control panel 1 (Fig. 1) when the active position 11 is displayed on the screen 3 (Fig. 2) together with the virtual keyboard 10. In this state, the pointer 14 is mounted on one of the interface elements of the set 12 made in the form of pictograms and denoting external devices 8 (1) and 9.

 Q3 (Fig. 13) is the state of the control panel 1 (Fig. 1) when the active position 11 is displayed on the screen 3 (Fig. 2) together with the virtual keyboard 10. In this state, the pointer 14 is installed on one of the elements of the set 13 interface, made in the form of pictograms, with which you can perform common functions for controlling the control panel 1 (figure 1).

In addition to positions, the Petri net diagram consists of transitions depicted as rectangles, which mean:
s1 (Fig.13) - the operation of moving the position of the pointer 14 (Fig.2) from the position of the functional symbol 16 to one of the positions of the interface elements of the set 12, made in the form of pictograms and indicating external devices 8 (Fig. 1) and 9.

 s2 (Fig.13) - the operation of moving the position of the pointer 14 (Fig.2) from the positions of the interface elements of the set 12, made in the form of pictograms and indicating external devices 8 (Fig.1) and 9 to the position of the functional symbol 16.

 s3 (Fig.13) - the operation of moving the position of the pointer 14 (Fig.2) along the positions of the interface elements of the set 12, made in the form of pictograms and indicating external devices 8 (Fig.1) and 9 of the virtual keyboard 10 (Fig. 13).

 s4 (Fig. 12) is the operation of pressing the button 5 (Fig. 1) when positioning the pointer 14 (Fig. 2) on a specific interface element of the set 12, made in the form of pictograms and indicating external devices 8 (Fig. 1) and 9 on the virtual the keyboard 10 (Fig.13). In this case, the activated element, for example, element 15 (Fig. 2) of the virtual keyboard 10, on which the pointer 14 is mounted, starts up. As a result, the state of the control system of the console 1 (Fig. 1) is transferred to a higher system level. In the demo, the previous virtual keyboard 10 (FIG. 2) and the active position 11 of the screen 3 are replaced with the new virtual keyboard 10 (FIG. 3) and the active position 11.

 s5 (Fig. 13) is the operation of moving the position of the pointer 14 (Fig.2) from the positions of the elements of the interface set 12, to the position of the elements of the interface of the functional set 13.

 s6 (Fig.13) - the operation of moving the position of the pointer 14 (Fig.2) from the positions of the interface elements of the functional set 13, in the position of the interface elements of the set 12.

 s7 (Fig.13) - the operation of moving the position of the pointer 14 (Fig.2) within the positions of the interface elements of the functional set 13.

 s8 (Fig. 13) is the operation of pressing the button 5 (Fig. 1) when positioning the pointer 14 (Fig. 2) on one of the interface elements of the functional set 13.

 In the initial state, position Q1 (Fig. 13) contains a control chip 33. In the diagram of the Petri net, this state is indicated by a black ball inside position Q1.

 On Fig shows an example of the use of the remote control 1 in the room 34, when it is used to control external computer systems - a personal computer 35 with a screen 36 of the monitor and a computer system 37 with a wall screen 38.

 In the case of working with a personal computer 35 on its screen 36, images of the input position 39 and the virtual keyboard 40 with the indicator 41 of the activated element are generated. During operation in this configuration, the user visually observes the interface situation on the screen 36, but uses the manipulator 4 and button 5.

 Similarly, in the case of working with a computer system 37, images of an input position 42 and a virtual keyboard 43 with an activated element pointer 44 are generated on its wall screen 38.

 Thus, there is a complete correspondence between the interface situation on the screen 3 of the console 1 and the interface situations on the screen 36 of the monitor of the personal computer 35 and the interface situation on the screen 38 of the computer system 37, but the user visually monitors only the screen of the external device with which he is working.

 Using the transmitter-receiver 7 of the console 1 and the transmitter-receiver 45 or 46 of the external computer systems 35 or 37, control information is exchanged between the operating systems of the console 1 and the specified external computer systems.

 In FIG. 15 shows a block diagram of a control panel. The remote control 1 includes a microprocessor 47 with a memory 48, which stores the operating system of the remote control 1. The operating system controls the operation of the display screen 3 with the virtual keyboard 10 and the receiver-transmitter unit 7, and also processes control signals from the manipulator 4 and button 5. To power the electronics of the stand-alone remote control 1, a power source 49 is used. The receiver-transmitter unit 7 of the remote control 1 serves to ensure the transfer of control information flow between the remote control 1 and external computer systems 9. Each external I computer system 50 includes a transmitter-receiver unit 51.

 The possible inclusion of a reader 52 in the control panel will make it possible to use such a control panel as a means of identification for the operator to access systems protected from unauthorized access.

 To ensure communication between the remote control 1 and external computer systems 9 does not require an information communication channel of high speed and a large amount of transmitted data. In the process of working with the remote control 1 in the control mode of external devices 8 and 9, it is necessary to transfer only position codes - the active position of the screen, input position, position of the virtual keyboard and its pointer, codes for switching between system levels of the remote control system, as well as character codes of text information, which are edited using the virtual keyboard, and configuration information to identify the user of the remote control 1 and select an external device to connect.

 The remote control operates as follows. Consider in detail one of the possible applications of the present invention to use the remote control 1 (Fig.1) control as a keyboard.

 In FIG. 12 is a diagram of a Petri net in an initial state when the control chip 32 is in position P0. In this state, execution options are possible: transition t0, or transition t1. Moreover, the implementation of the transition t0 does not remove the control chip 32 from the position P0, as can be seen in the diagram.

 In practice, this means that the user sees on screen 3 (Fig. 4, option A) the output position of 19 characters of text, and the virtual keyboard is not shown. In this state, character entry is not possible. Using the manipulator 4 (Fig. 1), the user sets the output position 19 (Fig. 4, option A) to a specific position of the screen 3. In order to display the virtual keyboard on screen 3, press the button 5 (Fig. 1). After that, on the screen 3 (Fig. 4, option B), next to the position of the output 19, a virtual keyboard 10 appears, and the pointer 14 indicates a functional symbol 24 (Fig. 9) for deleting the image of the virtual keyboard 10 (Fig. 4, option B). This on the diagram of the Petri net (Fig. 5) corresponds to the transition t1. Chip 32 is removed from position P0 and placed at position P1.

 In the new state, only two transitions t2 and t10 are possible. Transition t10 returns chip 32 back to position P0, and transition t2 moves chip 32 to position P2. For the user, this means choosing the following options. He can press the button 5 (Fig. 1) and delete the image of the virtual keyboard 10 (Fig. 4, option B) from screen 3. On screen 3 (Fig. 4, option A) there will again be one output position 19, which can be reset if desired in another position of the screen 3. In another embodiment, the user can move the pointer 14 into the area 23 (Fig.9) of the virtual keyboard on a set of printed characters.

 When the chip 32 (Fig.12) is in position P2, transitions t3, t4, t5 and t6 become available for execution. The transition t3 moves the position of the pointer 14 (Fig. 4 option B) from the virtual keyboard area 23 (Fig. 9) to the position of the function symbol 24 to delete the image of the virtual keyboard 10 (Fig. 4 option B).

 Transition t4 is performed — the operation of moving the position of the pointer over the positions of printed characters in the virtual keyboard area 23 (Fig. 9) (Fig. 4, option B) allows the user to select the desired printed character for input. This operation can be performed multiple times. On the diagram of the Petri net (Fig), it is seen that the control chip 32 always remains in position P2. Transition t5 is executed - the user presses the button 5 (Fig. 1) while positioning the pointer 14 (Fig. 4, option B) on the selected printed character from the area 23 (Fig. 9) of the virtual keyboard 10 (Fig. 4, option B). In this case, the image of the selected printed symbol is output to the output position 19 on the screen 3, and the output position 19 itself moves to the next position of the screen 3. At the same time, the image of the virtual keyboard 10 also moves to a new position on the screen 3, while maintaining its position unchanged relative to the position of the output 19. This operation can be performed repeatedly, leaving the control chip 32 (Fig.12) in position P2. That is, the system operates in the typewriter mode, when there is repeated input of printed characters with their output to screen 3 (Fig. 4 option B).

 Performing t6 (Fig. 12) means that the user decided to use some functional symbol from the set: 25-29 (Fig. 9), 30 (Fig. 10), 31 (Fig. 11). He moved the pointer 14 (Fig. 4, option B) from the position of region 23 (Fig. 9) of the virtual keyboard 10 (Fig. 4, option B) to one of the positions of the set of functional symbols designated 25-29 (Fig. 9), 30 ( figure 10), 31 (figure 11). In the Petri net diagram, transition t6 (Fig. 12) moves the control chip 32 to position P3.

 When chip 32 is at position P3, only three transitions t7, t8 and t9 become available for execution.

 Performing t7 moves control chip 32 to position P2. This is the inverse of transition t7. For the user, this means moving the pointer 14 (FIG. 4, Option B) from the position of the set of functional symbols designated 25-29 (FIG. 9), 30 (FIG. 10), 31 (FIG. 11) in the position of region 23 (FIG. 9) virtual keyboard 10 (figure 4 option B).

 Performing t8 means moving the position of the pointer 14 (Fig. 4B) within the set of functional symbols indicated 25-29 (Fig. 9), 30 (Fig. 10), 31 (Fig. 11). This operation can be performed multiple times, leaving the control chip 32 (Fig.12) in position P3.

 Performing t9 means pressing button 5 (Fig. 1) when the pointer 14 (Fig. 4, option B) indicates a specific functional symbol from the set of functional symbols designated 25-29 (Fig. 9), 30 (Fig. 10), 31 (Fig. .eleven).

 In the description of the invention provides one of the specific options for operating a remote autonomous control panel for various external devices of household appliances and computer systems using the invention. It will be apparent to those skilled in the art that various variations of the Petri net diagram shown in FIG. 12 are possible. The algorithm defined by the diagram can be partially changed without essentially changing the proposed remote control. For example, an arc exiting transition t1 can be directed to position P2. This will mean that the pointer 14 (Fig. 4 option B) will be installed on a certain character from the virtual keyboard area 23 (Fig. 9) when the virtual keyboard 10 (Fig. 5) is called up on screen 3. Similarly, an arc exiting from transition t1 (Fig. 12), direct to position P3. Possible changes to the set of functional symbols in the composition of the virtual keyboard 10 (figure 5). There are various options for connecting the reading device 52 (Fig. 15) to the control panel 1. For example, the basic configuration of the control panel 1 may not include a reading device 52, but be included in it at the request of the user.

 Various embodiments of the present invention have been described above, in which, as is obvious to those skilled in the art, various modifications and changes can be made within the scope of the claims. For example, it is quite obvious that many variants of images of various character sets can be stored in computer memory depending on national alphabets, types of writing, and application areas. On the other hand, the image of the virtual keyboard 10 (Fig. 5) can be presented in the form of various tables similarly to Figs. 6, 7, 8 either in the form of a pie chart, or in the form of a tight packing of polygons, or in the form of an image of a regular keyboard of a printing device. It is also possible to present a virtual keyboard 10 (FIG. 5) or a virtual keyboard 10 (FIG. 2) in the form of an artistic image, photograph or three-dimensional image. Additional convenience to the user is given the opportunity to resize the image of the virtual keyboard 10 (Fig. 5) or virtual keyboard 10 (Fig. 2) by scaling on the screen 3, as well as changing its brightness and color.

 Another option for modifying the remote control 1 (FIG. 1) within the scope of the claims is to use the touch screen as the screen 3 and the remote 4. The touch screen can fully fulfill its functions as the screen 3 and the remote 4 at the same time. At the same time, the images of virtual keyboards and other interface elements remain the same as in the previous version. The role of the manipulator - registration of two degrees of freedom of plane movements and button presses - is performed by the sensitive element of the touch screen. Using the capabilities of the touch screen has both its advantages and its disadvantages. Advantages are the ability to reduce the size of the remote control 1, the ability of the user to directly interact with virtual keyboards through a touch screen. The disadvantages are the high cost of the touch screen, some problems in the interface with movable virtual keyboards on the touch screen in the form of synchronization of user control actions and the dynamics of virtual keyboards.

 One of the important advantages of the present invention is the ability for the user to quickly and very simply switch the operating modes of the control panel from state P0 (Fig. 12) to state P1 and vice versa using simple control actions on the manipulator 4 (Fig. 1).

As noted above, the most common type of work with textual information is the editing mode of existing text when the user sees this text on the display screen. In editing mode, two procedures are typical:
- viewing and reading; paging text on screen 3 (figure 4, option A) using the manipulator; setting the text cursor to the desired text position, or rather, the output position 19 on screen 3;
- directly the input of symbolic information. These procedures are performed by the user in the states P0 (FIG. 12) and P1, respectively.

 To implement the specified switching of the operating mode, it is convenient when using the virtual keyboard 10 (Fig. 4, option B), including the symbol 24 (Fig. 9) to delete the image of the virtual keyboard 10 (Fig. 4, option B) from screen 3. However, it’s completely it is obvious that switching the operation mode from the state P0 (Fig. 12) to the state P1 can be done in a variety of ways. For example, by pressing an additional button instead of the main button on the control panel, you can enable or disable the image of the virtual keyboard.

 Thus, the implementation of an interface system based on the concept of a dipole “active screen position and virtual keypad” allows us to provide the following.

 The active position of the screen is depicted as a simple graphic object or icon and is inextricably linked with the positioning of the virtual keyboard, forming a single whole with it. The active position of the screen is designed to hold the user's attention in the context of this dialog state if the virtual keyboard is activated at that moment. In the operational state of the virtual keyboard, control from the manipulator is transferred only to the pointer of the activated element of the virtual keyboard. In cases when the virtual keyboard is turned off, control from the manipulator is transferred to the active position of the screen. This scheme of the user interface of the control panel allows the user to implement quite complex tasks of management and control of technical systems with minimal "consumption" of memory and user attention.

As noted above, the virtual keyboard can be used in various control situations using a single remote control in a single interface style, namely:
- switching the control mode between various external devices from household appliances to computer systems and managing the settings of these systems;
- input, editing and processing of textual and symbolic information when managing external devices running computer systems;
- remote monitoring and control of external devices running computer systems using external screens of wide-spectrum personal computer displays, portable personal communicators, computer systems with large wall-mounted screens, etc.

- work as a means of access and work in the global information network Internet and any information highway;
- Work as a device for personal identification for access to controlled information systems, facilities and vehicles.

 In general, the remote control made in accordance with the present invention has significantly improved characteristics and ergonomic indicators. For such a remote control, the field of application extends to all currently existing household appliances and computer systems when equipping them with appropriate receiver-transmitter units. For such a remote control, modification will not be required when incorporating into its control system both serial commercial appliances, computer systems and other devices for various purposes, as well as new types.

Claims (15)

 1. A remote control device for household appliances and computer systems, comprising a receiver-transmitter, a microprocessor with a data bus, memory and operating system, a graphic display, a button, a key system, and a transmitter-receiver, graphic located in the case and connected to a power source the display, memory and button are connected functionally via a data bus with a microprocessor, characterized in that a manipulator connected to a power source is inserted into it, and connected to a microprocess via a data bus quarrel, while the key system is made in the form of a virtual keyboard, including many key positions with virtual symbols of controlled external devices displayed on the graphic display screen, the active position and position indicator of the virtual keyboard elements controlled by the manipulator, the button is configured to activate the key position marked a pointer to the position of the elements of the virtual keyboard, and the virtual keyboard and the active position are logically and positionally interconnected in Processes functioning.  2. The remote control according to claim 1, characterized in that the virtual keyboard contains many keyboard positions of the interface for communication with external devices and for controlling the general functions of the remote control, including a keyboard position that sets the character input mode.  3. The remote control according to claim 1 or 2, characterized in that the virtual keyboard of any level and purpose contains a key output position related to the general control functions of the remote control.  4. The remote control according to claim 1 or 2, characterized in that the key positions of the virtual keyboard are made in the form of icons indicating the corresponding external controlled devices and the corresponding control functions of the remote control.  5. The remote control according to claim 1 or 2, characterized in that the virtual keyboard includes a plurality of keyboard positions of the interface for controlling the corresponding external device and controlling the general functions of the remote control.  6. The remote control according to claim 1 or 2, characterized in that the active position is the position of the character input, and its position on the screen of the graphic display is controlled by the manipulator.  7. The remote control according to claim 6, characterized in that the virtual keyboard includes a plurality of key positions with printed characters and key positions of the interface for controlling the character input mode.  8. The remote control according to claim 1, characterized in that it further comprises a reader connected to a power source, and its output is connected to the microprocessor via a data bus.  9. The remote control according to claim 8, characterized in that the reader is made in the form of a micro-camera.  10. The remote control according to claim 8, characterized in that the reader is made in the form of an optical scanner.  11. The remote control according to claim 8, characterized in that the reader is made in the form of a microphone.  12. The remote control according to claim 1, characterized in that the graphic display screen is made in the form of a touch screen.  13. The remote control according to item 12, characterized in that the touch screen of the graphic display is used as a manipulator.  14. The remote control according to item 12, wherein the touch screen is used as a button.  15. The remote control according to claim 1, characterized in that as a manipulator uses a button that performs the functions of pressing, pressing and moving.

Images