TWI566162B - Smart icon selecting method for graphical user interface - Google Patents

Description

Graphical user interface smart icon selection method

The present invention relates to a graphical user interface, and more particularly to a smart graphical selection method for a graphical user interface.

With the popularity of smart phones and tablets and the popularity of the general public, the current software engineers' experience in improving the user experience of electronic devices is almost for small-sized portable electronic devices. Dimensional electronic devices refer to tablets and smart phones with a viewing area of about 10 inches or less. However, no related improvement schemes have been found for the operation of non-small-sized electronic devices.

For example, the screen size and resolution used by personal computers are getting bigger and bigger. Users who use more than 24 inches of screens are everywhere, and even more and more people choose 27-inch screens so that they can be displayed on the screen. Show more files at the same time. However, when the screen and the resolution become larger at the same time, when the user wants to click on the icon to execute a specific application, it is often necessary to move the mouse over a long distance to move the cursor to the top of the drawing, resulting in use. Inconvenient.

In addition, if the user executes an application (such as game software) at a high frequency for a certain period of time, under the existing graphical user interface, the user still needs to open the application each time. The cursor must be repeatedly moved to the icon corresponding to the application to enable the click action. The traditional graphical user interface fails to predict the user's desired picture according to the user's usage habits. Show.

In summary, the prior art does not have any graphical selection method that allows the user to accurately select points without moving to the top of the figure.

In view of the above, the present invention provides a smart graphical selection method for a graphical user interface, which is applicable to an electronic device. The electronic device can display a plurality of icons on a display screen, and each of the icons can be selected separately. Corresponding execution of an application. The smart icon selection method of the graphical user interface includes: detecting a movement of a cursor, the position of the cursor is not located on any of the icons; selecting at least one of the icons by an algorithm And generate a prominent prompt on the selected icon. In the step of selecting at least one of the icons by the algorithm, the number of execution times of the application by the user according to the application corresponding to each icon, and the distance between the positions of the illustrated distance cursors, The movement of the cursor, or an application preset by the user, is selected to select the plurality of icons displayed on the display screen.

In an embodiment, in the step of generating the eye-catching prompt, a path is generated on the display screen, one end of the path is connected to the position of the cursor, and the other end of the path is connected to the selected icon.

In an embodiment, in the step of generating the eye-catching prompt, the background color of the selected icon is changed to be different from the background colors of the other icons that are not selected.

In an embodiment, in the step of generating the eye-catching prompt, the selected icon is flashed.

In an embodiment, in the step of generating the eye-catching prompt, the brightness of the other icons that are not selected is darkened.

In one embodiment, the selected image is enlarged in the step of generating the eye-catching prompt.

In an embodiment, the smart icon selection method of the graphical user interface further includes the following steps: after generating the eye-catching prompt on the selected icon, detecting a selection signal according to the selection The signal executes the application corresponding to the selected icon.

In an embodiment, when the algorithm selects the icons according to the number of times the application is executed according to the range of the display area in which the cursor is located, the execution time is compared. More applications will be selected.

In an embodiment, when the algorithm selects the icons according to the distance from the position of the cursor in the range of the display area where the cursor is located, the algorithm is closest to the position of the cursor. The icon will be selected.

In an embodiment, when the algorithm selects the icons according to the moving tendency of the cursor in the range of the display area in which the cursor is located, the vector formed by the coordinates before and after the cursor movement refers to The application closest to the cursor in the direction of the line will be selected.

In an embodiment, the smart icon selection method of the graphical user interface further includes the steps of: distinguishing the display screen as a plurality of display areas; detecting the display area where the cursor is located; wherein the algorithm And the number of times the application is executed according to each of the icons in the range of the display area where the cursor is located, and the position of the cursor in the range of the display area where the cursor is located The proximity of the cursor, or the movement trend of the cursor within the range of the display area in which it is located, selects the icons.

The detailed features and advantages of the present invention are described in detail in the embodiments of the present invention. The objects and advantages associated with the present invention can be readily understood by those skilled in the art.

Please refer to FIG. 1 , which is a flowchart of a method according to a first embodiment of the present invention. The embodiment is applicable to an electronic device. The electronic device is operated by a user through a graphical user interface, and can display multiple icons. On the display screen, each icon corresponds to a different application. The display screen is a large-scale high-resolution display screen, for example, a screen of at least 24 inches and having a resolution of at least a Full HD level. The display screen may also be a center console screen for a vehicle, which usually has a size of no more than 8 inches. The operation mode is to move the cursor on the display screen through a touch panel located near the armrest. The invention can be used for reducing the operation time of the user when applied to various display screens, but the effect is particularly remarkable when applied to the above two kinds of display screens.

The steps of the present embodiment are described below, and the sequence of description of each step does not necessarily represent the sequence in which the execution is performed on the electronic device.

Step S11: detecting the movement of the cursor.

This step is mainly to detect whether the cursor has moved due to the user's action. For a graphical user interface that passes through a small-sized display screen, the cursor is usually not displayed because the user can easily perform the one-hand and close-point operation, and even the entire display screen may be full of icons. The display screen is not the object of improvement as claimed in this embodiment. The object to be improved in this embodiment is to use a large-size high-resolution screen or a center console screen for the user to move the cursor to display the icon displayed on the display screen. A graphical user interface.

In addition to the common mouse, keyboard and touchpad, the way to control cursor movement can also be trackball, TV stick (smart stick), joystick, aerial mouse, somatosensory gesture mouse, gesture control and so on.

Step 12: Select one of the icons by an algorithm.

This step selects one of the icons on the display screen through an algorithm. The so-called algorithm is based on the following parameters, when the cursor moves, and has not moved to any of the icons, it analyzes the icon that the user may want to click.

One of the parameters on which the algorithm is based is the number of times the application corresponding to each icon has been executed by the user in the past, such as the most recent month, or the number of times the user has executed since the first use. It is considered to be the icon that the user is most likely to want to click.

Another parameter on which the algorithm is based is the distance from each of the illustrated distance cursors, and the closest distance is considered to be the graphical representation that the user most likely wants to click. That is to say, during the cursor movement process, the algorithm will calculate which icon is the closest to the downstream target distance, and then the icon closest to the current cursor position will be regarded as the icon that the user is most likely to want to click.

Another parameter that the algorithm is based on is the movement trend of the cursor, that is, the displacement vector of the cursor is calculated according to the position change of the cursor, and the icon pointed to by the displacement vector of the cursor is regarded as the most likely to be clicked by the user. Show.

Another parameter according to the algorithm is based on the user preset. For example, the user can directly preset a preset icon when the cursor moves. For example, when the user starts the vehicle and turns on the screen of the vehicle center console, as long as the user moves the cursor through the touchpad located on the armrest, the algorithm directly selects the icon corresponding to the application preset by the user, for example, for example, for example, The icon corresponding to the navigation program or music player.

Step S13: Generate a prominent prompt on the selected icon.

This step is to enable the selected icon to be highlighted on the display screen so that the user can immediately see what is being selected, and then immediately determine whether the icon selected by the algorithm is what he wants. Selected illustration.

As shown in Fig. 2, the way to generate a prominent prompt may be to create a path 19 on the display screen 10, one end of the path 19 is connected to the position of the cursor 11, and the other end of the path 19 is connected to the selected graphic 12a, the rest Figure 12 remains the same. In this way, the user can easily check the icon 12a selected by the algorithm, and then decide whether to execute the application corresponding to the icon 12a selected by the algorithm.

Another way to generate eye-catching cues is to change the background color of the icon 12a selected by the algorithm to a different background color than the other unselected remaining graphics 12. Thereby, the user can easily check the icon 12a selected by the algorithm, and then decide whether to execute the application corresponding to the icon 12a selected by the algorithm.

Another way to generate eye-catching cues is to flash the icon 12a selected by the algorithm. It also allows the user to easily check the icon 12a selected by the algorithm, and then decide whether to execute the icon 12a selected by the algorithm. The corresponding application.

Another way to produce eye-catching cues is to dim the brightness of other unselected icons 12, and the brightness of the selected graphic 12a remains the same or brighter, that is, the brightness of the unselected graphic 12. It is darker than the selected icon 12a. In this way, the user can easily check the icon 12a selected by the algorithm, and then decide whether to execute the application corresponding to the icon 12a selected by the algorithm.

In addition, another way to generate eye-catching cues is to enlarge the icon 12a selected by the algorithm. It also allows the user to easily check the icon 12a selected by the algorithm at a glance, and then decide whether to perform the calculation. The application corresponding to the icon 12a selected by the method.

Step S14: Execute the application corresponding to the selected icon.

The foregoing steps S11 to S13 illustrate how the present embodiment first determines the icon that the user may want to click when the user has not moved the cursor over the icon. After determining the icon selected by the user and giving a prominent prompt, the next step is to allow the user to conveniently execute the application corresponding to the selected icon.

After selecting the icon and giving the eye-catching prompt, since the cursor is not yet placed on the icon that the user wants to click, the application must be executed in a manner different from the traditional point of view on the icon.

One way to execute the application corresponding to the selected icon is to detect whether the selected signal is selected after the eye-catching prompt is generated. The source of the selected signal may be a mouse or a touchpad. For example, the user can generate a click signal by pressing the left button of the mouse or by clicking on the touchpad.

Another way of executing the application corresponding to the selected graphic 12a is to detect whether the position of the cursor 11 is changed after generating the eye-catching prompt on the selected graphic 12a, when the position of the cursor 11 continues for a preset time. When it is not changed, the application corresponding to the selected icon 12a is executed. The length of the preset time can be defined by the user or built into the system. That is to say, during the movement of the cursor 11 , when the user finds that the icon 12a selected by the algorithm is correct, the user can stop moving the cursor 11 and after a preset time (for example, 1 second or 2 seconds), is selected. The application corresponding to the icon 12a will be executed. However, when the user moves the cursor and then stops, in some cases, the user does not want to execute the icon 12a selected by the algorithm. It may be that the user simply does not want to continue using the electronic device, and may also temporarily The other things happened so that the electronic device was stopped. Therefore, the method for executing the application can also be switched by software or hardware, that is, the method for executing the application can be turned on or off according to the user's needs, so as to prevent the electronic device from simply not wanting to operate the electronic device. The behavior of the device is misinterpreted as the user wants to execute an application.

In addition, the above two methods of executing the application can be integrated, that is, when a little selection signal is detected, the application corresponding to the selected icon is executed immediately; when no selection signal is detected However, the cursor corresponds to the application corresponding to the selected icon after it has been moved for the first time without being changed.

Please refer to FIG. 3, which is a flowchart of a method according to a second embodiment of the present invention. The embodiment is applicable to an electronic device, and the electronic device is operated by a user through a graphical user interface, and can display multiple images. Displayed on the display screen, each icon corresponds to a different application. The display screen is a large-scale high-resolution display screen, for example, a screen with a resolution of at least 24 吋, and a resolution of at least a Full HD level, and a screen with a higher resolution (for example, an increasingly popular 2K or 4K panel). This embodiment is more capable of having significant effects. In addition, the display screen can also be a center console screen for the car, which usually does not exceed 8 inches in size, but is operated by moving the cursor on the display screen through a touchpad located near the armrest. Although the embodiment is applicable to various display screens, the effect of reducing the operation time of the user can be achieved, but the effects when applied to the above two display screens are particularly remarkable.

The various steps of the embodiment are described below, and the order of description of each step does not necessarily represent the order of specific execution on the electronic device.

Step S21: detecting the movement of the cursor.

As in step S11, this step mainly detects whether the cursor has moved due to the action of the user. For a graphical user interface that passes through a small-sized display screen, the cursor is usually not displayed because the user can easily perform the one-hand and close-point operation, and even the entire display screen may be full of icons. The display screen is not the object of improvement as claimed in this embodiment. The object to be improved in this embodiment is to use a large-size high-resolution screen or a center console screen for the user to move the cursor to display the icon displayed on the display screen. A graphical user interface.

Step S22: distinguishing the display screen from a plurality of display areas.

As shown in FIG. 4, this step divides the display screen 20 into four display areas 20a, 20b, 20c, and 20d. For example, the display screen 20 is divided into four quadrants according to the Cartesian coordinates, and each quadrant corresponds to one. Display area. Distinguishing the four display areas can be processed only by the program, and does not necessarily display the X-axis 28 and the Y-axis 29 visible to the naked eye on the display screen 20, but can also display the X-axis 28 visible to the naked eye on the display screen. Y axis 29.

As shown in Fig. 5, the above four display areas 20a, 20b, 20c, 20d may be distributed from top to bottom to distinguish three X-axis 38a, 38b, 38c of the four display areas 20a, 20b, 20c, 20d. It can be processed only by the program rather than the naked eye, but it can also be visible to the naked eye.

As shown in FIG. 6, the above four display areas 20a, 20b, 20c, 20d may be distributed from left to right or from right to left, and are used to distinguish three Ys of the four display areas 20a, 20b, 20c, 20d. The axes 39a, 39b, 39c may be processed only by the program rather than the naked eye, but may also be lines visible to the naked eye.

In addition, the display areas do not have to be equal in area, and the user can adjust the size of each display area according to the user's habits or according to the distribution of the plurality of icons 22 on the display screen 20.

In the present embodiment, the area of each display area is the same, and in FIG. 4, the cursor 21 is initially positioned in the display area 20a as an example.

Step S23: detecting the display area where the cursor is located.

This step is to detect which display area the cursor 21 is in. As shown in FIG. 4, FIG. 5 or FIG. 6, the cursor 21 is now in the display area 20a.

Step S24: Select one of the icons by an algorithm.

Different from the step S12 of the first embodiment, the step 24 of the embodiment selects one of the icons in the display area 20a where the cursor 21 is located through an algorithm. The illustrations in the display areas 20b, 20c, 20d where the non-cursor 21 is located are directly excluded by the algorithm and are not selected. The so-called algorithm analyzes the icon that the user may want to click when the cursor 21 moves and does not move to any of the icons in the display area 20a according to the following parameters.

One of the parameters on which the algorithm is based is the number of times the application corresponding to each icon has been executed by the user in the past, such as the most recent month, or the number of times the user has executed since the first use. It is considered to be the icon that the user is most likely to want to click.

Another parameter on which the algorithm is based is the distance from each of the illustrated distance cursors, and the closest distance is considered to be the graphical representation that the user most likely wants to click. That is to say, during the cursor movement process, the algorithm will continuously calculate which icon is the closest to the downstream target distance, and then the icon closest to the current cursor position will be regarded as the icon that the user is most likely to want to click.

Another parameter that the algorithm is based on is the movement trend of the cursor, that is, the displacement vector of the cursor is calculated according to the position change of the cursor, and the icon pointed to by the displacement vector of the cursor is regarded as the most likely to be clicked by the user. Show.

Another parameter according to the algorithm is based on user presets. For example, the user can directly define an application to be executed when the cursor is in a certain display area, and different display areas can execute different applications by default. However, the icons corresponding to the pre-executed application must be located in the display area to which they belong. In this way, when the cursor moves in a certain display area, the algorithm directly selects the icon corresponding to the preset execution application. For example, when the user starts the vehicle and turns on the screen of the vehicle center console, as long as the user moves the cursor through the touchpad located on the armrest, the algorithm directly selects the icon corresponding to the application preset by the user, such as navigation. The icon corresponding to the program or music player.

Step S25: Generate a prominent prompt on the selected icon.

This step is to enable the selected icon to be highlighted on the display screen so that the user can immediately see what is being selected, and then immediately determine whether the icon selected by the algorithm is what he wants. Selected illustration.

As shown in Figures 4 through 6, the method of generating a prominent prompt can produce a path 29 in the display area 20a of the display screen 20, one end of the path 29 is connected to the position of the cursor 29, and the other end of the path is connected to the selected one. In the illustration 22a, the remaining icons 22 in the display area 20a remain the original. In this way, the user can easily check the icon 22a selected by the algorithm, and then decide whether to execute the application corresponding to the icon 22a selected by the algorithm.

Another way to generate eye-catching cues is to change the background color of the icon 22a selected by the algorithm to be different from the background color of the remaining icons 22 of the display area 20a that are not selected. Thereby, the user can easily check the icon 22a selected by the algorithm, and then decide whether to execute the application corresponding to the icon 22a selected by the algorithm.

Another way to generate eye-catching cues is to flash the icon 22a selected by the algorithm. It also allows the user to easily check the icon 22a selected by the algorithm, and then decide whether to execute the icon 22a selected by the algorithm. The corresponding application.

Another way to generate eye-catching cues is to darken the brightness of other unselected icons 22 in the display area 20a where the cursor is located, and the brightness of the selected icon 22a remains the same or brightens, that is, in the cursor The brightness of the unselected icon 22 in the display area 20a where 21 is located is darker than the selected icon 22a. In this way, the user can also easily check the icon 22a selected by the algorithm, and then decide whether to execute the application corresponding to the icon 22a selected by the algorithm.

In addition, another way to generate eye-catching cues is to enlarge the icon 22a selected by the algorithm. It also allows the user to easily check the icon 22a selected by the algorithm at a glance, and then decide whether to perform the calculation. The application corresponding to the icon 22a selected by the method.

Step S26: Execute the application corresponding to the selected icon.

After the icon is selected and the eye-catching prompt is given, since the cursor 21 is not yet placed on the icon 22a that the user wants to click, the application must be executed by directly clicking on the icon in the drawing. .

One way to execute the application corresponding to the selected icon 22a is to detect whether the selected signal is selected after the eye-catching prompt 22a is selected. The source of the selected signal may be a mouse or a touch. The board, for example, the user can generate a click signal by pressing the left button of the mouse or by clicking on the touchpad.

Another way of executing the application corresponding to the selected icon 22a is to detect whether the position of the cursor 21 is changed after generating the eye-catching prompt on the selected icon 22a, when the position of the cursor 21 continues for a preset time. When it is not changed, the application corresponding to the selected icon 22a is executed. The length of the preset time can be defined by the user or built into the system. That is to say, during the movement of the cursor 21, when the user finds that the icon 22a selected by the algorithm is correct, the user can stop moving the cursor 21, and after a preset time (for example, 1 second or 2 seconds), is selected. The application corresponding to the icon 22a will be executed. However, when the user moves the cursor 21 and then stops, in some cases, the user does not want to execute the icon 22a selected by the algorithm. It may be that the user simply does not want to continue using the electronic device, and may also be temporary. There are other things happening that stop operating the electronic device. Therefore, the method for executing the application can also be switched by software or hardware, that is, the method for executing the application can be turned on or off according to the user's needs, so as to prevent the electronic device from simply not wanting to operate the electronic device. The behavior of the device is misinterpreted as the user wants to execute an application.

In addition, the above two methods of executing the application can be integrated, that is, when a little selection signal is detected, the application corresponding to the selected icon 22a is executed immediately; when no selection is detected The signal, but the position of the cursor 21 has been executed by the selected icon 22a since the previous time it has been moved for a predetermined period of time.

The smart icon selection method of the graphical user interface disclosed in the above embodiment allows the user to pre-determine through the algorithm that the user may want to click when the cursor has not been moved to the icon to be selected. Why and give a prominent reminder. Through the above embodiment, the user can quickly execute the application he wants to execute without having to move the cursor to the top of the icon.

The technical content of the present invention has been disclosed in the preferred embodiments as described above, but it is not intended to limit the present invention. Any person skilled in the art should make some modifications and refinements without departing from the spirit of the present invention. The scope of the invention is therefore defined by the scope of the appended claims.

10 Display screen 11 Cursor 12, 12a Figure 19 Path 20 Display screen 20a, 20b, 20c, 20d Display area 21 Cursor 22 Diagram 22a Diagram 28, 38a, 38b, 38c X-axis 29, 39a, 39b, 39c Y-axis Step S11: detecting the movement of the cursor step S12: selecting one of the icons by an algorithm, step S13: generating an eye-catching prompt on the selected icon step S14: executing the application step S21 corresponding to the selected icon : detecting the moving step of the cursor S22: distinguishing the display screen into a plurality of display areas, step S23: detecting the display area of the cursor S24: to select the icon of one of which algorithm a step S25: generating the illustrated steps are highlighted to the selected S26: the selected application execution icon corresponding

[Fig. 1] is a flow chart of a method of the first embodiment of the present invention. [Fig. 2] is a schematic view (1) of the state of use of the present invention. [Fig. 3] is a flow chart of the method of the second embodiment of the present invention. [Fig. 4] is a schematic view showing the state of use of the present invention (2). [Fig. 5] is a schematic view (3) of the state of use of the present invention. [Fig. 6] is a schematic view showing the state of use of the present invention (4).

Step S11: detecting the movement of the cursor. Step S12: selecting one of the icons by an algorithm. Step S13: generating an eye-catching prompt on the selected icon. Step S14: executing the application corresponding to the selected icon.

Claims (10)

A smart graphical selection method for a graphical user interface is applicable to an electronic device that displays a plurality of icons on a display screen, each of the icons corresponding to an application, the graphical user interface The smart icon selection method includes: detecting a movement of a cursor, the position of the cursor is not located on any of the icons; selecting one of the icons by an algorithm; and generating a prominent prompt to be selected The algorithm is configured to select the icons according to the number of times the application is executed or the one of the applications corresponding to the preset execution. . The smart icon selection method of the graphical user interface of claim 1, further comprising: distinguishing the display screen as a plurality of display areas; and detecting the display area where the cursor is located; wherein the algorithm is based on the a number of times the application is executed corresponding to each of the icons in the range of the display area in which the cursor is located, and a distance from the range of the cursor in the range of the display area where the cursor is located, The cursor is selected in the range of the display area in which the cursor is located, or the icon corresponding to one of the applications is preset when the cursor is located in the display area. The smart icon selection method of the graphical user interface according to claim 1 or 2, wherein in the step of generating the eye-catching prompt, a path is generated, one end of the path is connected to the position of the cursor, and the other end of the path is Connect to the icon selected. The smart icon selection method of the graphical user interface according to claim 1 or 2, wherein the step of generating the eye-catching prompt is selected from: changing the background color of the selected icon to be different from the others. The background colors of the icons are selected, the icon selected is flashed, the icon selected is enlarged, or the brightness of the other icons that are not selected is darker than the selected icon. The method for selecting a smart icon of the graphical user interface as claimed in claim 1 or 2, further comprising: detecting the point of the selected signal after generating the eye-catching prompt; and selecting the signal according to the selected signal Execute the application corresponding to the selected icon. The method for selecting a smart icon of the graphical user interface according to claim 1 or 2, further comprising: detecting whether the position of the cursor changes after the icon is generated by the eye-catching prompt; and when When the position of the cursor continues for a preset time without being changed, the application corresponding to the selected icon is executed. The smart icon selection method of the graphical user interface according to claim 1 or 2, wherein the algorithm is based on the application corresponding to each icon in the range of the display area where the cursor is located When the number of executions is selected and the icons are selected, the application that executes a large number of times will be selected. The smart icon selection method of the graphical user interface according to claim 1 or 2, wherein the algorithm is based on each of the maps within the range of the display area in which the cursor is located When the icons are selected from a distance from the position of the cursor, the icon closest to the position of the cursor will be selected. The smart icon selection method of the graphical user interface according to claim 1 or 2, wherein the algorithm is based on the movement trend of the cursor in the range of the display area in which the cursor is located When making a selection, the application closest to the cursor in the direction of the line indicated by the vector formed by the coordinates before and after the movement of the cursor will be selected. A smart graphical selection method for a graphical user interface is applicable to an electronic device that displays a plurality of icons on a display screen, each of the icons corresponding to an application, the graphical user interface The smart icon selection method includes: detecting a movement of a cursor, the position of the cursor is not located on any of the icons; selecting one of the icons by an algorithm; and generating a prominent prompt to be selected The algorithm is based on the number of times the application is executed according to each of the icons, the distance from the position of the cursor to the position of the cursor, the movement trend of the cursor, or preset execution. One of the icons corresponding to the application, and selecting the icons; wherein, after generating the eye-catching prompt on the selected icon, detecting whether the position of the cursor changes, when the cursor is located When the preset time is not changed, the application corresponding to the selected icon is executed.