EP2671146A1

EP2671146A1 - Three-dimensional man/machine interface

Info

Publication number: EP2671146A1
Application number: EP12708880.5A
Authority: EP
Inventors: Didier Roziere
Original assignee: Nanotec Solution SAS
Current assignee: Quickstep Technologies LLC
Priority date: 2011-01-31
Filing date: 2012-01-30
Publication date: 2013-12-11
Also published as: CN103460175B; US20190361539A1; US11175749B2; CN103460175A; WO2012104529A1; CN109240587A; FR2971066B1; CN109240587B; US10303266B2; US20130307776A1; FR2971066A1

Abstract

A method is provided for selecting controls, which implements a control interface, a display, and at least one sensor capable of detecting at least one control object, including a step (i) of obtaining information on the distance between the control object(s) and the control interface using the sensor(s), and a step (ii) of displaying, on the display, at least one symbol representing a control or set of controls according to a display mode, wherein the method further includes a step of using the distance information to determine the display mode of the symbol(s). A device is also provided for implementing the method and to an apparatus.

Description

"Three-dimensional man-machine interface"

Technical area

The present invention relates to a method for selecting commands that can be implemented in a three-dimensional man-machine interface. It also relates to a device implementing the method.

The field of the invention is more particularly but in a nonlimiting manner that of contactless machine man interfaces.

State of the art

Touch interfaces, or touch screens, are currently widely used for controlling devices as varied as computers, mobile phones, ....

In general, they comprise a display screen and sensors that make it possible to determine the point (s) of contact between the surface of the screen and one or more control objects such as fingers or a stylus.

These touch interfaces frequently use capacitive measurement technologies to detect the position of control objects. The screen may be for example covered with a mesh of capacitive electrodes, and the position of the object is detected from its interactions, in the form of capacitive couplings, with the electrodes.

The touch interfaces also include a software part for interpreting the user's commands. The display is modified according to the position of the detected control object (s), which allows the user to have a visual control of his actions and to select commands.

Gesture interfaces, or 3D interfaces, are also known in which a third dimension is added with the possibility of detecting objects at a distance before they touch the surface of the screen. These interfaces are equipped with sensors for measuring the position in the space, relative to the interface, of one or more control objects.

Capacitive measurement technologies are also well suited to the realization of this type of interfaces. For example, Rozière document FR 2 844 349 discloses a capacitive proximity sensor comprising a plurality of independent electrodes, which makes it possible to measure the capacitance and the distance between the electrodes and an object in proximity to distances. several tens, even hundreds of millimeters. The electrodes can be made transparently using, for example, ΙΊΤΟ (indium tin oxide) and deposited on the display screen.

These interfaces with measurement capabilities in the space open up new possibilities of interaction between the user and the machine, and make it possible to imagine new modes of control of human machine interface (HMI) in which the information of distance or depth would be fully exploited to "navigate" in the software interface.

Document US 2008/0307360 to Chaudhri et al. which discloses a software human-machine interface with a three-dimensional component. However, the three-dimensional aspect is limited to a representation in a three-dimensional environment of computer objects (icons, files, ...). The mode of control of the interface, in particular for the selection of the objects, remains strictly two-dimensional since based on the detection of events such as the displacement of a pointer of mouse in the plane of the interface.

The object of the present invention is to propose a method for selecting commands (or computer objects) in a human machine interface (HMI) with three-dimensional measurement capabilities, which makes full use of the three-dimensional dimension of the software interface. measurements.

Presentation of the invention

This objective is achieved with a method for selecting commands, implementing a control interface, a display and at least one sensor capable of detecting at least one control object, comprising steps:

obtaining distance information between said one or more control objects and said control interface by means of said sensor (s),

displaying on said display at least one symbol representing a command or a set of commands according to a display mode, characterized in that it further comprises a step of using said distance information to determine said display mode of the symbol (s).

The method according to the invention may furthermore comprise steps of: obtaining position information of at least one control object with respect to the control interface by means of the sensor (s),

- Use of said position information to determine the display mode of the symbol (s) displayed (s).

The display mode of a symbol may comprise differentiated graphic representations of this symbol making it possible to visualize a state such as highlighting with a view to a selection, a selection, the execution of a command, a displacement , a rotation, a modification .... The display mode may correspond, for example, to a highlighting, a graphical differentiation with respect to other symbols displayed by means of a change of color or size, or a re-display of the symbol differently and shifted to be visible for example beyond a control object.

The method according to the invention may further comprise a step of using at least one of the following sets of information: distance information, distance and position information, to determine the symbol (s) displayed (s).

The determination of the displayed symbol may include a selection of the symbols displayed on the display, thus commands and / or groups of commands accessible on the interface, depending on the distance and / or position information.

Distance and position information can include:

- distance and / or position measurements;

the information provided by the sensors (for example the physical quantities measured by these sensors) and dependent (preferably monotonically) on the distance and / or the position of the control object (s) relative to the interface control ;

quantities representative of speeds and / or accelerations of the control object, corresponding to quantities derived from distances and / or positions; information relating to trajectories, that is to say to time sequences of distances and / or trajectories.

According to embodiments, the method according to the invention can implement at least one of the following types of measurements:

capacitive interaction measurements between a control object and the sensor (s),

- measurements of light intensity variations due to the presence of a control object.

These measurements may in particular make it possible to obtain distance and / or position information.

The measured capacitive interactions can include:

a direct capacitive coupling between a control object and capacitive sensor electrodes, in which case the electrical capacitances between the object and the electrodes are measured, or

the disturbance of a capacitive coupling between sensor electrodes due to the presence of the control object, in which case variations of these coupling capacitors are measured.

The variations in measured light intensities can be generated for example by the interruption of light beams by control objects, or shadow effects due to the presence of control objects.

The method according to the invention may further comprise steps:

displaying a first symbol representing a first set of commands,

- Display, when the distance of a control object is less than a threshold distance, at least a second symbol representing a command or a set of commands included (s) in said first set of commands.

This inclusion can be defined logically, such as in a tree of hierarchical commands, or a stack of commands or sets of commands.

The second symbols may be displayed at positions substantially different from that of the first symbol on the display, for example so as not to mask the first symbol.

The method according to the invention may further comprise steps: displaying a first symbol representing a first command or a first set of commands,

- Display, when the distance of a control object is less than a threshold distance, a second symbol representing a second command or a second set of commands.

The second symbol may be displayed at a position substantially identical to that of the first symbol on the display, as for example to illustrate a movement in the direction of the depth in a stack of symbols from which elements would be removed as and when moving the command object.

The method according to the invention may further comprise a step of selecting a command comprising a step of verifying at least one selection condition based on a set of information among: distance information, distance information and position.

It may further comprise a step of verifying at least one selection condition among the following selection conditions:

the distance of the control object is less than a predetermined selection distance,

the distance of the control object is less than a predetermined selection distance for a predetermined minimum duration,

the control object is in contact with the surface of the control interface,

the control object makes a fast return trip, that is to say for example a round trip over a distance less than a predetermined distance for a duration shorter than a predetermined duration,

- At least two control objects perform a convergent movement in position to a predetermined position, such as a gripping or pinching motion (or any other relative motion).

The selection of a command can take place when the command object or objects are in the neighborhood or converge to a position defined for this command.

The method according to the invention may furthermore comprise a step of executing a command (previously selected) of one of the following types: execution of a computer program, execution of an application, display of the content of a file stored on a means of computer storage, displaying an image, playing a sound, playing multimedia content, or any other command.

The method according to the invention may further comprise a step of executing a command for moving a symbol, which comprises:

a step of displaying said symbol in a position representative of a position of a control object or of a set of control objects,

a step of validating the movement of said symbol comprising a step of verifying at least one validation condition based on a set of information among: distance information, distance and position information.

The method according to the invention may furthermore comprise a step of verifying at least one validation condition among the following validation conditions:

the control object is in contact with the surface of the control interface,

- the command object makes a fast return trip,

at least two command objects perform a divergent movement in position around a predetermined position (or any other relative movement).

According to embodiments, the method according to the invention may further comprise steps:

- displaying symbols in the form of icons;

- Activation of the display when the distance of the control object is less than a predetermined activation distance, for example to turn off the screen when not in use and save energy.

In another aspect, there is provided a device for selecting commands, comprising:

a control interface,

- a display, at least one sensor capable of detecting a control object,

electronic and calculation means able to produce, by means of said sensor (s), distance information between at least one control object and said control interface,

display management means capable of producing a display of at least one symbol representing a command or a set of commands,

which device further comprises calculation means able to process said distance information to determine the symbol (s) displayed (s).

The display may be a display screen, or any other display means, for example in relief (3D display).

The control interface, the sensors and the display can be in any arrangement, such as for example:

- superimposed, with a display integrated in a control interface comprising the sensors arranged on its surface or its periphery;

- Separate, with on the one hand a control interface provided with sensors and on the other hand a display. The control interface may include a pad connected to a computer, and display may be the computer screen, separate from the pad.

The device according to the invention may furthermore comprise:

electronic and calculation means able to produce, by means of the sensor (s), position information of at least one control object with respect to said control interface,

calculation means able to process said position information to determine the symbol (s) displayed.

According to embodiments, the device according to the invention may further comprise sensors of at least one of the following types:

- capacitive sensors,

- optical sensors.

The optical sensors may comprise, for example, optical barriers with light sources emitting light beams and photodetectors arranged so as to be illuminated by these light beams when they are not interrupted by control objects. They may also include photodetectors sensitive to illumination variations such as shadow or reflection effects due to the presence of control objects, for example integrated in a screen based on TFT or OLED technology.

According to embodiments, the device according to the invention may further comprise all types of sensors capable of producing distance and / or position information. It may include ultrasound acoustic sensors, arranged for example so as to allow a localization of the control objects by echo measurements and triangulation.

In yet another aspect, there is provided a device of one of the following types: computer, telephone, smartphone, tablet, display screen, terminal, characterized in that it comprises a device for selecting commands implementing the process according to the invention.

Description of the Figures and Embodiments

Other advantages and particularities of the invention will appear on reading the detailed description of implementations and non-limiting embodiments, and the following appended drawings:

FIG. 1 shows a diagram of a three-dimensional human-machine interface according to the invention,

FIG. 2 presents a convention of designation of positions on the detection surface,

FIG. 3 presents a command set structure with the position and distance conditions for accessing it, and an example of a route in this structure,

FIGS. 4 (a) to (d) illustrate a temporal sequence of command symbols or set of commands as they are displayed on the display screen when the structure of FIG. 3 is traversed,

FIGS. 5 (a), 5 (b) and 5 (c) illustrate a first time sequence variant of command symbols or set of commands as they are displayed when traversing a stack, while FIGS. 5 (a), 5 (b), 5 (d) and 5 (e) illustrate a second variant of this time sequence,

FIG. 6 presents a stack of controls or sets of controls with the position and distance conditions allowing access to the elements, according to a first variant illustrated in FIG. 6 (a) and corresponding to FIG. 5 (a). , 5 (b) and 5 (c), and according to a second variant it is lustrous in Fig. 6 (b) and corresponding to Figs. 5 (a), 5 (b), 5 (d) and 5 (e), respectively,

Fig. 7 shows a motion control sequence, with Fig. 7 (a) control selection, Fig. 7 (b) control enable, and Fig. 7 (c) rotation of the symbol.

A mode of realization of the invention is described implementing a human-machine interface (IH M) which includes capacitive sensors. Of course, this mode of real isation is a non-limiting example of implementation of the invention. Such an interface is for example well suited to the realization of a human machine interface (IH M) for a host system such as a mobile phone, a smartphone, a tablet or a computer.

With reference to FIG. 1, the interface comprises:

a display screen 2, based, in a non-limiting manner, on a liquid crystal, LCD, TFT (Thin-film transistor) or OLED (Organic Light-Emitting Diode) technology; in English or organic electroluminescent iodine);

a control interface 1 comprising a substantially transparent detection surface equipped with capacitive sensors 6 which are also substantially transparent and able to detect the presence of at least one control object 3 such as a hand, a finger or a stylet.

The sensors 6 provide information relating to the distance 4 along the Z axis between the object 3 and the detection surface of the interface 1, and information relating to the position 5 in the plane (X, Y 3) on the control interface 1. They are also able to detect a contact between the control object 3 and the detection surface of the interface 1. .

The information relating to section 4 and position 5 includes equivalent distance and position measurements. These measures, not necessarily expressed in units of length, are trad uctions of capacity measurements or capacity variations. In particular, physical characteristics of the control object 3 may affect the measured capacitances and hence their translation in terms of distance and / or equivalent positions. The information relating to the distance 4 and to the position 5 may also comprise trajectories, defined as time sequences of distances 4 and / or of positions 5, and derived quantities such as speeds and accelerations.

The sensors 6 comprise capacitive electrodes based on ITO

(Indium tin oxide). Depending on the applications, they can be of a number and a varied arrangement, the figure 1 having only an illustrative vocation.

The capacitive electrodes of the sensors 6 are connected to a measurement electronics 7 which makes it possible to calculate the distance 4 and the position 5. There are several possible embodiments for the capacitive sensors 6 and the measurement electronics 7.

Advantageously, the sensors 6 and the electronics 7 are made according to a mode described in FR 2,844,349 to Rozière. They comprise a plurality of independent electrodes 6 distributed on the surface of the interface 1. These electrodes 6 are connected to a floating detection electronics 7 or in other words referenced to a floating electrical potential. A guard electrode, also at the floating reference potential, is placed along the rear face of the measurement electrodes 6, between them and the display screen 2, so as to eliminate any parasitic capacitance. All the electrodes are at the same potential and there is thus no coupling capacity between the electrodes likely to degrade the measurement of the capacitance. This detection electronics 7 and its modes of implementation that can be used in the context of the present invention are also described in detail in document FR 2756048 of Rozière, to which the reader is invited to refer.

Scanners make it possible to measure sequentially the capacitance and therefore the distance between the electrodes 6 and the control object 3. The electrodes 6 that are not "interrogated" are also kept at the potential of the guard, again to eliminate parasitic capacitances.

Whether it is a computer, a mobile phone, a tablet or any other system, the host system also comprises computing means 8. These calculation means 8 usually include a microprocessor (CPU "Central Processing Unit" in English) associated with components such as random access memory (RAM), means of mass storage (hard disk, flash memory, ...), and allow to execute one (or a plurality) of computer program (s) or software.

Part of this software, also called software interface, is dedicated to tâches management tasks. This software interface contributes to carrying out the steps of the method according to the invention, which comprise:

steps of obtaining information (or measurement) of distance 4 and of position 5 provided by the sensors 6 and their measurement electronics 7,

- Steps to update the display 2 from the information of the sensors 6 and information of the host system (the phone, the computer, ...), - steps of transmission of the user's commands to the host system.

The human machine software interface (software IH M) corresponds to what the user sees on the display 2. It interacts with this software HMI by using one or more control objects 3 such as his fingers, a stylus, .. ..

In a conventional manner, the software comprises a graphical representation, symbolic, of the host system and / or possible actions:

- executions of software, applications, tasks interacting with the hardware and / or software components of the host system,

- visualization, reproduction, copy, displacement, manipulation of data represented in graphical form or by means of symbols, ...

It is possible to call without loss of generality all the actions that a user can perform via the control object 3 and the software command.

These commands are graphically represented on the display 2 by symbols such as icons with which the user can interact by means of the control object 3.

An important issue in the design of the HMI is the organization and structuring of the representation of the commands so that the user can easily find and select them, by moving or "navigating" in the interface.

The commands can be organized according to hierarchical structures of three-dimensional nature, which represent sets of commands and among which we distinguish in particular: - tree structures or folder trees in which each folder includes a set of commands and / or subfolders,

stacked structures or stacks in which commands and / or sets of commands are represented by symbols (or icons) which give the appearance of being stacked.

The prior art HMIs are essentially based on a two-dimensional type of navigation, which only takes into account the position 5 of the control object 3 to select the commands, whether it is the cursor of a mouse (flyover or click), a physical contact between an object 3 and the detection surface of the interface 1 (tapping) or even an overflight of the detection surface of the interface 1. Thus, even the navigation in structures of three-dimensional nature is actually reduced to a series of actions in the plane: For example, you have to tap an icon to open a folder and view the contents or view stacked commands, that is to say access a different hierarchical (or topological) level.

Advantageously, the method according to the invention makes it possible to navigate in a truly three-dimensional manner in an HMI by exploiting the distance measurements 4. In particular, it makes it possible to access the different hierarchical (or topological) layers of a set of commands arranged according to a structure of three-dimensional nature by varying the distance 4 between the control object 3 and the detection surface of the interface 1. This "access" is displayed on the display 2 by displaying the symbols (or icons) representing a command or a set of hierarchical (or topological) level commands selected based on distance 4.

Navigation is said to be three-dimensional insofar as it is possible by using the distance information 4 to browse hierarchical or topological levels of a command structure and / or command group for which levels can be represented on the display 2 by one or a plurality of symbols.

It is also possible to navigate in a particular command hierarchy structure among a plurality of such command structures displayed on the display, without affecting the others, by exploiting the position measurement 5. Indeed, it is expected that only one structure of commands whose graphic symbol is overflown by the command object 3 (therefore for which the position 5 is in the neighborhood or on its graphic symbol) "sees" its modified display according to the hierarchical level corresponding to the distance 4.

Once displayed, a command can be selected by selecting its representative symbol on ΙΊΗΜ. This selection can be made especially for its execution, or to move the representative symbol on the display 2 (in which case the command in question comprises moving the symbol on the display).

The selection of a command includes the verification of at least one selection condition, or in other words, the selection of a command is validated when one or more selection conditions (or time sequences of selection conditions) are satisfied. Various selection conditions can be implemented, including within the same HMI.

Different selection conditions can be implemented to allow the execution of different commands possibly attached or represented by the same symbol on the display 2. These commands may for example relate to the execution of an application represented by an icon, and the moving this icon.

Among the selection conditions applicable in the context of the invention, there are in particular the following selection conditions:

the distance 4 of the control object 3 is less than a predetermined selection distance,

the control object 3 is in contact with the surface of the control interface 1.

These selection conditions based on a distance detection 4 minimum or less than a threshold can be used without generating ambiguity with respect to the command selection tasks because a command has no lower hierarchical or topological level (at least in the application in which this command is selected). To further limit the risk of ambiguity, it is possible to display the corresponding symbol so that it does not cover symbols corresponding to groups of commands of the same hierarchical structure (at least), and to use the position measurement 5 to determine the selected command. These selection conditions can be implemented by adding a condition on the urea (a predetermined minimum amount) to limit the risk of false orders.

We can also implement selection conditions based on trajectories, such as:

the control object 3 performs a fast reverse-feed in phase 4, that is to say for example a round trip in a range (or a difference) of distances 4 less than a predetermined distance. during a urea less than a predetermined urea.

A condition of this type corresponds to a virtual "click", since it is done without contact. As before, the position measurement 5 is used to determine the selected command.

Finally, we can implement selection conditions based on trajectories of several command objects, such as:

at least two command objects perform a convergent movement in position towards a position corresponding to the symbol of the command, according to a gripping or gripping movement.

A selection condition can also be used as a deselection or validation condition, in particular for "releasing" an object when the command concerns a manipulation or movement of a symbol on the display 2.

It is also possible to provide specific validation or deselection conditions such as, for example, an ivergent movement, an opening, several control objects 3. Thus, the displacement of a symbol on the display 2 Using two or more control objects as two fingers can be obtained by selecting a se- quence (selection), moving (the selected symbol follows the fingers), and opening the fingers (deselecting).

To assist the user in his navigation, the position 5 and the distance 4 of the control object 3 can be visualized on the display screen 2 by means of a circular pattern centered on the position 5 and of a dameter dependent on step 4, or any other reason.

An implementation of the method according to the invention will be described for browsing control structures of the folder tree type. This tree includes groups of commands or folders represented by the symbol or icon 10, and commands represented by the symbol or icon 11 on the display screen 2.

With reference to FIG. 2, to simplify the explanations four zones P1, P2, P3, P4 corresponding to four positions 5 are defined on the detection surface of the interface 1 and on the display screen 2 placed below. The control object 3 is also likened to the finger 3 of a user.

With reference to FIG. 3, for the example, four control structures are defined whose first hierarchical level, namely the command sets DU, D12, D13 and D14 respectively, is accessible when the control object 3 is located at the same time. distances 4 between H1 and H2.

Command sets D21, D22, D23 and control C24 are also defined which are included in D12 and belong to a second hierarchical level accessible when control object 3 is at distances 4 between H2 and H3.

Arrows 12 illustrate the path of finger 3 in the space of distances 4 (H1, H2, H3) and positions 5 (P1, ... P4) corresponding to the example below.

With reference to FIG. 4, the selection process of the command C24 on the display 2 will be illustrated.

In a first step, as illustrated in FIG. 4 (a), the finger 3 is at a distance 4 greater than H1 and no control unit is selected on the display screen 2.

The user then lowers his finger 3 at a distance 4 between H1 and H2. When his finger flies over the position P2, the set of commands D12 is highlighted. For this purpose, the symbol or the corresponding icon is for example highlighted, or differentiated graphically from the others by means of a change of color or size, or re-displayed differently and shifted to be visible beyond the finger 3. The situation is illustrated in Figure 4 (b).

By lowering his finger 3 above the position P2 at a distance 4 between H2 and H3, the user accesses the content of D12. The corresponding command sets D21, D22, D23 and command C24 are displayed in accordance with Figure 4 (c). The user can then move his finger 3 at P4 to highlight the control C24 as shown in FIG. 4 (d) and, by performing a maneuver such as lowering his finger at a distance 4 less than H3, or tap the detection surface of the interface 1, or to make a virtual click (a fast return of the finger 3 to the surface of the interface 1), select the command C24 to be executed.

The display of a new hierarchical level can replace that of the previous level to maintain a good readability, for example on a small screen 2. It is also possible to display the contents of a lower hierarchical level near the symbol of the group of higher hierarchical level commands selected.

According to an implementation mode, the representative symbol of a command group (or its icon) may comprise a representation of the symbols of the elements or commands that it includes (thus a representation of their reduced icons), and the display of content icons can be made in such a way that the user has the impression of zooming in the content when he / she accesses the hierarchical level of this content.

An implementation of the method according to the invention will now be described for traversing stack structures of commands or piles.

With reference to FIGS. 5 and 6, commands can be gathered on the display screen 2 in the form of a stack 21 which groups together commands 11 and / or sets of commands 10. For the sake of clarity, FIG. 5 illustrates a case where there is only one stack 21 of controls 11 initially visible on the display 2.

In a first step, as illustrated in FIG. 5 (a), the finger 3 is at a distance 4 greater than a distance H1 and no command or control unit is selected.

The user then lowers his finger 3 at a distance 4 between distances H1 and H2 as illustrated in Figures 6 (a) and 6 (b). When his finger passes near the position PI, the stack 21 is highlighted (for example highlighted or in the other modes described above). The situation is illustrated in Figure 5 (b).

Then two variants are possible. According to a first variant illustrated in FIG. 5 (c) and in FIG. 6 (a), by lowering its finger 3 above the position PI at a distance 4 lying between H2 and H3, the user visualizes the first command Cl of the stack, whose symbol is substantially superimposed on this stack 21.

Then, by lowering his finger 3 above the PI position at a distance

4 between H3 and H4, it displays the second command C2 of the stack, and so on.

The arrows 22 in FIG. 6 (a) illustrate the path of the finger 3 in the space of the distances 4 (H 1,... H 4) and the positions 5 (PI, P2) corresponding to this variant.

This variant is well suited for example to the visualization of images, in which case the symbol is the image and simply controls its visualization.

According to a second variant illustrated in FIGS. 5 (d), 5 (e) and 6 (b), by lowering its finger 3 above the position PI at a distance 4 between H2 and H3, the user views the first command Cl of the stack, whose symbol is displayed at a position different from PI, for example P2. The display of FIG. 5 (d) is thus obtained.

If the user continues to lower his finger 3 above the position PI at a distance 4 between H3 and H4, it displays at P2 the second command C2 of the stack, and so on.

In this variant, the user can highlight a displayed command for the purpose of selecting it by moving his finger 3 in position P2. The situation is illustrated in Figure 5 (e) with the selection of C2.

The arrows 23 in FIG. 6 (b) illustrate the path of the finger 3 in the space of the distances 4 (H 1,... H 4) and the positions 5 (PI, P2) corresponding to this variant.

As mentioned above, the stack 21 can comprise commands 11 and / or sets of commands 10. Once a command 11 or a command set 10 is highlighted, it can be selected or navigated. its tree in the same manner as previously described in connection with Figures 3 and 4.

The distance thresholds 4 can be managed in the following manner, it being understood that several management modes of these thresholds can be implemented according to the command structures considered, and / or choices that the user can make via a configuration menu:

a first distance threshold H1 making it possible to select a particular control structure is defined as corresponding to a predetermined distance 4,

when a control structure or a stack 21 is selected, the distance intervals between successive thresholds H1, H2, H3,... are calculated taking into account the number of hierarchical levels of the structure or the number of elements 10, 11 of the stack 21, so as to allow all to explore by varying the height 4 of the finger 3 to the contact with the detection surface of the interface 1,

- The selection of a command is performed by a finger contact 3 with the detection surface of the interface 1.

With reference to FIG. 7, an implementation of the method according to the invention will now be described to execute a command to move a command symbol 11 or a command group symbol 10, 21.

A particular command symbol 11 may represent several possibilities of commands (execution of an application for example), or only a movement command (for example if the symbol represents a piece of a game displayed on the screen of the game). display 2.

In the case of a plurality of possible commands, it suffices to define different selection conditions for each of them to avoid any ambiguity.

At first, the user approaches two fingers 3 (or more) of the surface of the interface 2, up to a distance at which the sensors 6 are able to "distinguish" the fingers. When the fingers 3 are detected, and if their positions 5 substantially correspond to that of the symbol 11 on the display 2, the symbol 11 is highlighted (for example highlighted). Depending on the devices, it may be necessary for the fingers 3 to come into contact with the surface of the interface 2.

Alternatively, the user can also browse a structure or stack of commands for as explained above to reach the step of highlighting the symbol 11. Next, the user selects the command symbol movement command 11 by effecting a pinching movement 30 or bringing the fingers 3 together as shown in FIG. 3 (a). This movement corresponds, from the point of view of the measurement, to a reconciliation of the positions 5 which is the selection condition chosen.

The symbol 11 can be moved by moving the fingers 3, whose position it follows.

The validation of the command, and therefore the positioning of the symbol 11 at an arrival position, is performed by moving the fingers 3 apart as shown in FIG. 7 (b). This spacing movement 31 corresponds, from the point of view of the measurement, to a distance from the positions 5 which is the chosen validation condition.

It is also possible, as illustrated in FIG. 7 (c), to rotate the symbol 11 by rotating 32 with the fingers 3.

If the distance 4 of the fingers 3 is increased beyond a certain limit during the movement, it can be provided according to the applications, that the symbol 11 freezes, changes appearance, disappears or returns to its starting position. Increasing the distance 4 beyond a certain limit can also be used as a deselecting condition of the motion control without validating it, with a return of the symbol 11 to its starting position.

This mode of control of displacement commands can allow for example to implement playful games of checkerboard (chess, checkers, ...).

According to variant embodiments:

- Capacitive sensors and their associated detection electronics can be made according to all arrangements. In particular, they may comprise crossed electrodes (for example arranged in rows and columns), and allow direct capacitance measurements (ie capacitance measurements between the electrodes 6 and the object 3), and / or coupling capacitance measurements (i.e. capacitance measurements between transmitting electrodes and receiving electrodes disturbed by the presence of the object 3). Such embodiments are, for example, well suited to large interfaces 1 covering computer display screens 2;

The method according to the invention is applicable to the selection of commands in all command or command group structures for which it is possible by using the distance information to traverse hierarchical or topological levels, and to represent these levels. on the display 2 by means of one or more symbols or icons;

The navigation in the hierarchical or topological levels of the control structures may depend on distance (s) 4 and / or position (s) 5, as well as any information relating to these quantities such as speeds and accelerations. For example, the distance movement speed 4 of a control object 3 can be taken into account to browse more quickly a stack or other control structure, viewing only one element on n;

- The intervals between the threshold distances 4 (H1, ...) can be determined anyway. In particular, they can be fixed, predefined, adjusted according to the number of levels of a command structure displayed so that the totality of a structure can always be traversed in the same overall range of distances 4, variable in a limited range, etc. ;

- In order to save energy, especially for nomadic devices, a delay can be provided which turns off screen 2 after a period of inactivity. The screen 2 is then reactivated for example when a control object 3 appears at a distance 4 less than an activation distance, or simply when an object is detected by the sensors 6.

Of course, the invention is not limited to the examples that have just been described and many adjustments can be made to these examples without departing from the scope of the invention.

Claims

A method for selecting commands, implementing a control interface (1), a display (2) and at least one sensor (6) adapted to detect at least one control object (3), comprising steps:

- obtaining distance information (4) between said one or more control objects (3) and said control interface (1) by means of said one or more sensors (6),

displaying on said display (2) at least one symbol (10, 11, 21) representing a command or a set of commands according to a display mode,

characterized in that it further comprises a step of using said distance information (4) to determine said display mode of the at least one symbol (10, 11, 21).

2. Method according to claim 1, characterized in that it further comprises steps:

obtaining position information (5) of at least one control object (3) with respect to the control interface (1) by means of the sensor (s) (6),

- using said position information (5) to determine the display mode of the symbol (s) (10, 11, 21) displayed (s).

3. Method according to one of the preceding claims, characterized in that it further comprises a step of using at least one of the following sets of information: distance information (4), distance information ( 4) and position (5) to determine the displayed symbol (s) (10, 11, 21).

4. Method according to one of the preceding claims, characterized in that it implements at least one of the following types of measurements:

capacitive interaction measurements between a control object (3) and the sensor (s) (6), - measurements of light intensity variations due to the presence of a control object (3).

5. Method according to one of the preceding claims, characterized in that it further comprises steps:

displaying a first symbol (10, 21) representing a first set of commands,

- display, when the distance of a control object (3) is less than a threshold distance (H2, H3, ...), at least a second symbol (10, 11) representing a command or a set of commands included in said first set of commands (10, 21).

6. Method according to one of the preceding claims, characterized in that it further comprises steps:

displaying a first symbol (10, 11) representing a first command or a first set of commands,

- display, when the distance of a control object is less than a threshold distance (H2, H3, ...), a second symbol (10, 11) representing a second command or a second set of orders.

7. Method according to one of the preceding claims, characterized in that it further comprises a step of selecting a command, comprising a step of verifying at least one selection condition based on a set of information among : distance information (4), distance (4) and position (5) information.

8. Method according to claim 7, characterized in that it further comprises a step of verifying at least one selection condition from among the following selection conditions:

the distance (4) of the control object (3) is less than a predetermined selection distance,

the distance (4) of the control object (3) is less than a predetermined selection distance for a predetermined minimum duration,

the control object (3) is in contact with the surface (1) of the control interface, the control object makes a fast return trip (4),

- At least two control objects perform a convergent movement in position (5) to a predetermined position (5).

9. Method according to one of claims 7 or 8, characterized in that it further comprises a step of executing a command of one of the following types: execution of a computer program, execution of an application, displaying the contents of a folder stored on a computer storage medium, displaying an image, executing a sound, playing a multimedia content.

10. Method according to one of claims 7 or 8, characterized in that it further comprises a step of executing a movement control of a symbol (10, 11, 21), which comprises:

a step of displaying said symbol (10, 11, 21) in a position representative of a position (5) of a control object (3) or of a set of control objects (3),

a step of validating the movement of said symbol (10, 11, 21) comprising a step of verifying at least one validation condition based on a set of information among: distance information (4), distance information (4) and position (5).

11. Method according to claim 10, characterized in that it further comprises a step of verifying at least one validation condition among the following validation conditions:

the control object (3) is in contact with the surface (1) of the control interface,

the control object makes a fast return trip (4),

- At least two control objects perform a divergent movement in position (5) around a predetermined position (5).

12. Method according to one of the preceding claims, characterized in that it further comprises a symbol display step (10, 11, 21) in the form of icons.

13. Method according to one of the preceding claims, characterized in that it further comprises a step of activating the display (2) when the distance (4) of the control object (3) is less than a predetermined activation distance.

14. Device for selecting commands, comprising:

a control interface (1),

a display (2),

at least one sensor (6) capable of detecting a control object (3),

- Electronic and calculation means (7) able to produce, by means of the at least one sensor (s) (6), distance information (4) between at least one control object (3) and said control interface (1) ,

means (8) for managing the display (2) capable of producing a display of at least one symbol (10, 11, 21) representing a command or a set of commands,

characterized in that it further comprises calculating means (8) adapted to process said distance information (4) to determine the displayed symbol (s) (10, 11, 21).

15. Device according to claim 14, characterized in that it further comprises:

means (7) for producing, by means of the sensor (s) (6), position information (5) of at least one control object (3) with respect to said control interface (1),

means (8) for processing said position information (5) to determine the displayed symbol (s) (10, 11, 21).

16. Device according to one of claims 14 or 15, characterized in that it further comprises sensors of at least one of the following types:

capacitive sensors (6),

- optical sensors.

17. Apparatus of one of the following types: computer, telephone, smartphone, tablet, display screen, terminal, characterized in that it comprises a device for selecting commands according to one of claims 14 to 16 and in it implements the method according to any one of claims 1 to 13.