JP4769947B2 - Pointing system and pointing method - Google Patents

Description

  The present invention relates to a pointing system and a pointing method for moving a point position on a display.

  When a GUI such as an icon is displayed on the display, a pointing system is indispensable because various operations are performed using the pointer. As a pointing system, a trackball, an optical mouse, a joystick, etc. are common.

  In recent years, attention has been focused on wearable computing in which a computer is worn like clothes (see, for example, Patent Document 1). In wearable computing, it is often used while walking or being used while working.

JP 2001-166253 A

  However, any of the above-described pointing systems is operated with the user holding it, and there is a problem that the user cannot perform a pointing operation in parallel with other work. Therefore, a pointing system that allows a user to perform a pointing operation in a hands-free state is desired.

  Therefore, a main object of the present invention is to provide a pointing system and a pointing method that allow a user to appropriately perform a pointing operation in a hands-free state.

Means for Solving the Problems and Effects of the Invention

  The pointing system of the present invention includes a first acceleration sensor mounted on the user's body, a second acceleration sensor mounted on the user's body, and a control unit that controls display content displayed on the screen. The control means displays a first line rotatable around the first fulcrum and a second line rotatable around the second fulcrum, and is detected by the first acceleration sensor. The first line is moved to rotate around the first fulcrum based on the result, and the second fulcrum is rotated based on the detection result of the second acceleration sensor. The second line is moved, and the position of the point corresponding to the intersection of the first line and the second line with the movement of the first line and the second line is It is characterized by moving

  The pointing method of the present invention moves the first line displayed on the screen so as to rotate around the first fulcrum based on the detection result of the first acceleration sensor mounted on the user's body. By moving the second line displayed on the screen so as to rotate around the second fulcrum based on the detection result of the second acceleration sensor attached to the user's body, The point position corresponding to the intersection of the first line and the second line is moved.

  According to this configuration, the first line is moved so as to rotate around the first fulcrum based on the detection result of the first acceleration sensor attached to the user's body, and the first line is attached to the user's body. The point corresponding to the intersection of the first line and the second line by moving the second line so as to rotate around the second fulcrum based on the detection result of the second acceleration sensor The position can be easily moved. Therefore, since the user does not need to hold the trackball or the like with the hand as in the prior art, the user can appropriately perform the pointing operation in a hands-free state (a state where the user's hand or finger can be used for work other than the pointing operation). it can.

  In the pointing system of the present invention, the control means may display a pointer indicating a point position corresponding to an intersection of the first line and the second line.

  According to this configuration, since the pointer indicating the point position is displayed on the screen, the movement of the point position can be easily confirmed.

  In the pointing system of the present invention, the first fulcrum is disposed to the left of the center position in the left-right direction of the screen, and the second fulcrum is disposed to the right of the center position in the left-right direction of the screen. Also good.

  According to this configuration, the first acceleration sensor and the second acceleration sensor are respectively displayed on the left side of the screen by disposing the first acceleration sensor and the second acceleration sensor at positions (for example, both hands, both elbows, and both feet) that are substantially symmetrical. The first line is moved based on the left acceleration sensor, and the second line displayed on the right side of the screen is moved based on the right acceleration sensor. Therefore, the operability for moving the first line and the second line is improved.

  In the pointing system of the present invention, the first fulcrum may be disposed at a position corresponding to the lower left of the screen, and the second fulcrum may be disposed at a position corresponding to the lower right of the screen.

  According to this configuration, for example, when the acceleration sensor is attached to both hands, when the user performs a pointing operation by moving both hands with both elbows as fulcrums, the movement direction of both hands and the first line displayed on the screen and Since the moving direction of the second line is substantially the same, the operability for moving the first line and the second line is improved.

  In the pointing system of the present invention, at least one of the first fulcrum and the second fulcrum may be arranged outside the screen.

  According to this configuration, for example, when the first fulcrum is arranged outside the screen, the moving distance of the acceleration sensor when moving the point position over the entire screen is reduced. Therefore, the point position can be moved quickly. In this case, the pointing operation can be easily performed on the entire screen.

  In the pointing system of the present invention, each of the first line and the second line may be a straight line.

  According to this configuration, the operability for moving the point position is improved.

  In the pointing system of the present invention, the first acceleration sensor and the second acceleration sensor may be respectively mounted on both elbows of the user.

  According to this configuration, since the user can perform a pointing operation by moving both elbows with both shoulders as fulcrums, the operability for moving the point position is improved.

  In the pointing system of the present invention, the first acceleration sensor and the second acceleration sensor may be mounted on both hands of the user.

  According to this configuration, since the user can perform a pointing operation by moving both hands using both elbows as fulcrums, the operability for moving the point position is improved.

  Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a configuration of a pointing system according to the first embodiment of the present invention. FIG. 2 is a diagram illustrating a state where the acceleration sensor is mounted on the user. FIG. 3 shows an example of a display screen displayed on the display.

  The pointing system 1 shown in FIG. 1 includes two acceleration sensors 5 and 6, a display 7, and a control device 8. The acceleration sensors 5 and 6 detect vertical acceleration (gravity acceleration). The acceleration sensors 5 and 6 can transmit and receive signals to and from the control device 8 by wireless communication. The display 7 displays icons such as icons and images corresponding to various data stored in the control device 8. The control device 8 mainly controls display contents displayed on the display 7.

  When the pointing system 1 is used by a user, as shown in FIG. 2, the acceleration sensors 5 and 6 are respectively mounted near both elbows of the user. In FIG. 2, the acceleration sensor 5 is mounted in the vicinity of the user's left elbow (right side in FIG. 2), and the acceleration sensor 6 is mounted in the vicinity of the user's right elbow (left side in FIG. 2).

  On the display screen 10 of the display 7, a plurality of icons 11, two straight lines 20 and 30 used for performing a pointing operation, and a pointer 40 indicating a point position are displayed. Here, the straight line 20 extends from a fulcrum 21 arranged at the lower left corner of the display screen 10, and the straight line 30 extends from a fulcrum 31 arranged at the lower right corner of the display screen 10. The straight line 20 is movable to rotate around the fulcrum 21 based on the detection result of the acceleration sensor 5 attached to the user's left elbow, and the straight line 30 is attached to the user's right elbow. Based on the detection result of the acceleration sensor 6, it can move so as to rotate around the fulcrum 31. The pointer 40 is an arrow-shaped image indicating a point position corresponding to the intersection of the straight line 20 and the straight line 30. When the point position is moved by moving at least one of the straight line 20 and the straight line 30, the pointer 40 is moved accordingly.

  Next, point positions determined based on the straight lines 20 and 30 will be described with reference to FIG. FIG. 4 is a diagram for explaining point positions determined based on the straight line 20 and the straight line 30.

  In FIG. 4, the display screen 10 is illustrated by a bold line, and is illustrated by a vertical length L and a horizontal length W. Hereinafter, the point A at the position corresponding to the lower left corner of the display screen 10 will be described as the origin. Therefore, the display screen 10 is a range surrounded by connecting four points of the point A (0, 0), the point B (W, 0), the point C (W, L), and the point D (0, L). expressed. In addition, an angle between the straight line 20 and the base AB of the display screen 10 is an angle θ, and an angle between the straight line 20 and the base AB of the display screen 10 is an angle φ.

Here, in FIG. 4, the intersection of the straight line 30 and the straight line CD is the point E, the intersection of the straight line 20 and the straight line CD is the point F, the intersection of the straight line 20 and the straight line BC is the point G, and the straight line 30 and the side AD are If the intersection is a point H, the coordinates are as follows.
Point E: (x ₁ , L)
Point F: (x ₂ , L)
Point G: (W, y ₁ )
Point H: (0, y ₂ )

_{Further, x 1, x 2, y} 1, y 2 described above may be expressed as follows.

In FIG. 4, the coordinates of the start point and end point of the straight line 20 and the straight line 30 are as follows.
Line 20 Start point: Point A (0, 0)
End point: Point F (x ₂ , L)
Line 30 Start point: Point B (W, 0)
End point: Point H (0, y ₂ )

Then, the intersection P (Px, Py) between the straight line 20 and the straight line 30 as the point position is as follows when considered using the similarity ratio of the triangle.

  Then, the angle θ related to the straight line 20 and the angle φ related to the straight line 30 change based on the acceleration values detected by the acceleration sensors 5 and 6 mounted on both elbows of the user, thereby changing the point position P (Px , Py) changes, the pointer 40 moves accordingly. Therefore, the relationship between the detection result of the acceleration sensor 5 and the angle θ related to the straight line 20 is set, and the relationship between the detection result of the acceleration sensor 6 and the angle φ related to the straight line 30 is set, thereby The point position P moves corresponding to the movement.

Here, in the present embodiment, as described above, the acceleration sensors 5 and 6 are for detecting the acceleration in the vertical direction, and have 256 levels (0 to 0) corresponding to the magnitude of the acceleration in the vertical direction. 255) is output. When the user actually moves both elbows with the acceleration sensors 5 and 6 mounted on both elbows of the user, the maximum value output from the acceleration sensors 5 and 6 is Nmax (where Nmax is 1 to 255), and the minimum value is Nmin (where Nmin is a value smaller than Nmax). In this case, the range between the maximum value π radians and the minimum value 0 radians of the values of angles θ and φ is divided into N (where N is a value obtained by subtracting Nmin from Nmax). θ and φ are expressed by the following equations.

  Next, an operation of the user for moving the point position will be described with reference to FIGS. FIG. 5 is a diagram showing how the point position moves. FIG. 6 is a diagram illustrating a user operation for moving the point position. Here, as shown in FIG. 5A, a case will be described in which the point position is moved to the upper left icon 11 a of the display screen 10 from a state where the point position is substantially in the center on the right side of the display screen 10.

  First, in order to move the acceleration sensor 6 attached to the right elbow downward, as shown in FIG. 6 (b) from the state of FIG. 6 (a), when the user lowers the right elbow, the operation is synchronized. Thus, as shown in FIG. 5B, the straight line 30 moves counterclockwise around the fulcrum 31. At this time, the pointer 40 moves in the lower right direction along the straight line 20. Then, when the straight line 30 is placed on the icon 11a, the user stops the operation of the right elbow. At this time, the angle φ related to the straight line 30 becomes an angle φ2 smaller than the angle φ1.

  Thereafter, in order to move the acceleration sensor 5 mounted on the left elbow upward, as shown in FIG. 6C from the state of FIG. 6B, when the user raises the left elbow, the operation is synchronized. Thus, the straight line 20 moves around the fulcrum 21 counterclockwise. At this time, the pointer 40 moves in the upper left direction along the straight line 30 as shown in FIG. Then, when the pointer 40 is placed on the icon 11a, the user stops the operation of the left elbow. At this time, the angle θ related to the straight line 20 becomes an angle θ2 larger than the angle θ1. In this way, when the pointer 40 reaches the icon 11a, a pointing operation is performed.

  In the above description, the pointer 40 is moved onto the icon 11a by moving the straight line 20 after moving the straight line 30, but the pointer 40 is moved by moving the straight line 30 after moving the straight line 20. The pointer 40 may be moved on the icon 11a by moving the straight line 20 and the straight line 30 simultaneously.

  As described above, in the pointing system 1 according to the present embodiment, by attaching the acceleration sensors 5 and 6 to both elbows of the user, the user can appropriately perform a pointing operation in a hands-free state. become. In addition, by placing a pointer at the intersection of two straight lines that move in synchronization with the user's movement, it is possible to operate independent axes on the left and right sides, and to perform an accurate and quick pointing operation. Moreover, since the pointer is operated by a simple gesture input of moving both elbows of the user, the movement of the pointer is intuitive and easy to understand. Since the acceleration sensor is small and can be easily attached to the user's body, it can be always worn in daily life, and a pointing operation can be performed in parallel with other work. In addition, a conventional pointing system such as a trackball, an optical mouse, or a joystick moves a point position based on a relative amount, but the pointing system 1 moves a point position based on an absolute amount. Therefore, the operability for performing the pointing operation is good.

  Next, a pointing system according to a second embodiment of the present invention will be described with reference to FIGS. FIG. 7 shows an example of a display screen displayed on the display. FIG. 8 is a diagram showing how the point position moves.

  The pointing system of the present embodiment differs greatly from the pointing system 1 of the first embodiment in that in the pointing system 1, the straight line 20 rotates around a fulcrum 21 arranged at the lower left corner of the display screen 10. The straight line 30 is movable so as to rotate around a fulcrum 31 disposed at the lower right corner of the display screen 10, whereas in the pointing system of the present embodiment, the straight line 120 is movable. Is movable so as to rotate around a fulcrum 121 arranged outside the display screen 10, and the straight line 130 is movable so as to rotate around a fulcrum 131 arranged outside the display screen 10. It is. Since the other configuration of the pointing system of the present embodiment is the same as that of the pointing system 1, the same reference numerals are given and detailed description thereof is omitted.

  In the present embodiment, the display screen 10 displays a plurality of icons 11, two straight lines 120 and 130 used for performing a pointing operation, and a pointer 140 indicating a point position. Here, the straight line 120 extends from a fulcrum 121 arranged outside the display screen 10, and the straight line 130 extends from a fulcrum 131 arranged outside the display screen 10. In addition, on the display screen 10, the portion outside the display screen 10 (the broken line portion in FIG. 7) of the straight lines 120 and 130 is not displayed. The straight line 120 is movable so as to rotate around the fulcrum 121 based on the detection result of the acceleration sensor 5 attached to the user's left elbow, and the straight line 130 is attached to the user's right elbow. Based on the detection result of the acceleration sensor 6, it can move so as to rotate around the fulcrum 131. The pointer 140 is an arrow-shaped image indicating a point position corresponding to the intersection of the straight line 120 and the straight line 130. When the point position is moved by moving at least one of the straight line 120 and the straight line 130, the pointer 140 is moved accordingly.

  Next, a user operation for moving the point position will be described with reference to FIG. FIG. 8 is a diagram showing how the point position moves. Here, as shown in FIG. 8A, a case will be described in which the point position is moved onto the upper left icon 11 a of the display screen 10 from a state where the point position is substantially in the center on the right side of the display screen 10.

  First, in order to move the acceleration sensor 6 mounted on the right elbow downward, the user lowers the right elbow (see FIGS. 6A and 6B). As shown in (b), the straight line 130 moves counterclockwise around the fulcrum 131. At this time, the pointer 140 moves in the lower right direction along the straight line 120. Then, when the straight line 130 is arranged on the icon 11a, the user stops the operation of the right elbow. At this time, the angle φ related to the straight line 130 becomes an angle φ4 smaller than the angle φ3.

  Thereafter, when the user raises the left elbow to move the acceleration sensor 5 attached to the left elbow upward (see FIGS. 6B and 6C), the straight line 120 is synchronized with the operation. Moves around the fulcrum 121 counterclockwise. At this time, the pointer 140 moves in the upper left direction along the straight line 130 as shown in FIG. Then, when the pointer 140 is placed on the icon 11a, the user stops the operation of the left elbow. At this time, the angle θ related to the straight line 120 becomes an angle θ4 larger than the angle θ3. Thus, when the pointer 140 reaches the icon 11a, a pointing operation is performed.

  As described above, in the pointing system 1 according to the present embodiment, as in the first embodiment, the user can appropriately perform a pointing operation in a hands-free state.

  Further, the straight line 120 is movable so as to rotate around a fulcrum 121 arranged outside the display screen 10, and the straight line 130 is moved so as to rotate around a fulcrum 131 arranged outside the display screen 10. Since it is possible, since the moving distance of the acceleration sensor when moving the point position becomes small, the point position can be moved quickly. Regarding this point, in the present embodiment and the first embodiment, the point position is moved to the upper left icon 11a of the display screen 10 from the state where the point position is substantially in the center of the right side of the display screen 10. FIG. 5 and FIG. 8 showing the display screen of FIG. That is, in the first embodiment, the angle θ related to the straight line 20 changes from the angle θ1 to the angle θ2, and the angle φ related to the straight line 30 changes from the angle φ1 to the angle φ2. On the other hand, in the present embodiment, the angle θ related to the straight line 120 changes from the angle θ3 to the angle θ4, and the angle φ related to the straight line 130 changes from the angle φ3 to the angle φ4. Here, in the first embodiment and the present embodiment, when the change in the angle θ is compared, it can be seen that the difference between the angle θ3 and the angle θ4 is smaller than the difference between the angle θ1 and the angle θ2. Similarly, when the change of the angle φ is compared, it can be seen that the difference between the angle φ3 and the angle φ4 is smaller than the difference between the angle φ1 and the angle φ2. This indicates that the movement distance of the acceleration sensors 5 and 6 is small, that is, the movement distance of both elbows of the user is small.

  In this embodiment, a pointing operation can be easily performed on the entire screen. In this regard, in the first embodiment, the straight line 20 rotates around the fulcrum 21 arranged at the lower left corner of the display screen 10, and the straight line 30 is the fulcrum arranged at the lower right corner of the display screen 10. Since it rotates around 31, the pointing operation on the area near the lower end of the display screen 10 may be relatively difficult. On the other hand, in the present embodiment, the straight line 120 rotates around the fulcrum 121 arranged outside the display screen 10 and the straight line 130 rotates around the fulcrum 131 arranged outside the display screen 10. A pointing operation on the area near the lower end of the screen 10 is facilitated.

  The preferred embodiments of the present invention have been described above. However, the present invention is not limited to the above-described embodiments, and various design changes can be made as long as they are described in the claims. For example, in the first and second embodiments described above, the two acceleration sensors are mounted in the vicinity of the user's elbows, but the two acceleration sensors can be mounted at any position on the user's body. Therefore, the acceleration sensors 5 and 6 may be worn, for example, on both hands of the user (see FIG. 9), may be worn on the fingers of both hands of the user, or may be worn on both legs of the user.

  In the first and second embodiments described above, the two fulcrums of the two straight lines are arranged at positions corresponding to the lower left and lower right of the display screen, but the positions of the two fulcrums are Can be changed arbitrarily. Therefore, for example, two fulcrums may be arranged inside the display screen, two fulcrums may be arranged at positions corresponding to the upper left and upper right of the display screen, and the two fulcrums are in the vertical direction of the display screen. You may arrange | position in the position corresponding to the left side and the right side of a center part, and both two fulcrum may be arrange | positioned to the left or the right side from the horizontal center direction position of a display screen. Further, the two fulcrums need not be arranged at the same height on the display screen, and may be arranged at different heights. Further, the two lines for determining the point position are not limited to two straight lines, but may be any one that intersects at one intersection on the display screen. Therefore, for example, the intersection of two curves may be the point position.

  In the first and second embodiments described above, the acceleration sensors 5 and 6 detect acceleration in the vertical direction (gravity acceleration), but detect acceleration in other directions. Two straight lines displayed on the display screen may move based on the acceleration detection result in that direction. Further, the acceleration sensor can transmit and receive signals to and from the control device by wireless communication, but the acceleration sensor may be capable of transmitting and receiving signals to and from the control device by wired communication.

It is a figure which shows the structure of the pointing system which concerns on the 1st Embodiment of this invention. It is a figure which shows the state with which the acceleration sensor was mounted | worn by the user. An example of a display screen displayed on the display is shown. It is a figure explaining the point position determined based on the straight line 20 and the straight line 30. FIG. It is a figure which shows a mode that a point position moves. It is a figure which shows a user's operation | movement for moving a point position. An example of a display screen displayed on the display is shown. It is a figure which shows a mode that a point position moves. It is a figure which shows another state with which the acceleration sensor was mounted | worn by the user.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Pointing system 5, 6 Acceleration sensor 7 Display 8 Control apparatus 20, 30, 120, 130 Straight line 21, 31, 121, 131 Support point 40, 140 Pointer

Claims (9)

A first acceleration sensor mounted on the user's body;
A second acceleration sensor mounted on the user's body;
Control means for controlling the display content displayed on the screen,
The control means includes
A first line capable of rotating around the first fulcrum and a second line capable of rotating around the second fulcrum are displayed, and the first line is displayed based on the detection result of the first acceleration sensor. The first line is moved so as to rotate around the first fulcrum, and the second line is rotated so as to rotate around the second fulcrum based on the detection result of the second acceleration sensor. To move,
A pointing system in which a point position corresponding to an intersection of the first line and the second line moves with the movement of the first line and the second line.   2. The pointing system according to claim 1, wherein the control means displays a pointer indicating a point position corresponding to an intersection of the first line and the second line.   The first fulcrum is disposed to the left of the center position in the left-right direction of the screen, and the second fulcrum is disposed to the right of the center position in the left-right direction of the screen. 3. The pointing system according to 1 or 2.   The said 1st fulcrum is arrange | positioned in the position corresponding to the lower left of the said screen, and the said 2nd fulcrum is arrange | positioned in the position corresponding to the lower right of the said screen. Pointing system.   The pointing system according to any one of claims 1 to 4, wherein at least one of the first fulcrum and the second fulcrum is disposed outside the screen.   The pointing system according to claim 1, wherein the first line and the second line are both straight lines.   The pointing system according to claim 1, wherein the first acceleration sensor and the second acceleration sensor are respectively attached to both elbows of a user.   The pointing system according to claim 1, wherein the first acceleration sensor and the second acceleration sensor are respectively attached to both hands of the user.   The first line displayed on the screen is moved so as to rotate around the first fulcrum based on the detection result of the first acceleration sensor attached to the user's body, and is attached to the user's body. By moving the second line displayed on the screen so as to rotate around the second fulcrum based on the detection result of the second acceleration sensor, the first line A pointing method, wherein a point position corresponding to an intersection with the second line is moved.

Images