JP5813543B2 - User interface device capable of scroll control by maximum pressing force value, image scroll method, and program - Google Patents

Description

  The present invention relates to a user interface device including a display for displaying an image and a touch panel as a user interface.

  2. Description of the Related Art Conventionally, user interface devices equipped with a touch panel that perform an input operation by touching a screen with a finger, a stylus, or the like have been widely used. In particular, in recent years, in a user interface device such as a smartphone, a tablet computer, an electronic book, a PDA (Personal Digital Assistant), or a so-called portable information device, a touch panel has been actively adopted as a user interface that accepts a finger operation. .

  Portable information devices need to be miniaturized in order to improve portability. For this reason, when physical input keys are employed as the user interface, the sizes of the input keys themselves must be reduced, and there is a concern that the operability may deteriorate. On the other hand, when the touch panel is adopted, the size of the virtual button can be appropriately changed according to the function of the application, and the operability can be improved.

  In the input to the touch panel with a finger, how to perform an operation of moving the entire image displayed on the display is one point for improving operability. In particular, in portable information devices, since the screen size of the display is limited, information such as documents and images cannot often be displayed on a single screen. Therefore, an operation for moving the entire image and displaying an information portion that cannot be displayed is important.

  Conventionally, scrolling is known as a method for displaying a desired portion of information that does not fit on one screen. Scrolling is an operation method in which the entire image is moved in the vertical direction or the horizontal direction on the screen, and the information portion hidden (taken) outside the screen is extracted and displayed. In general, in a personal computer, the entire image is displayed by moving a scroll bar provided at the edge of the screen up and down or left and right, rotating a mouse wheel, or moving the mouse while pressing this wheel. You can scroll.

  The car navigation apparatus employs so-called one-touch scrolling in which the map point immediately below the finger contact position is scrolled to the center of the screen. In this one-touch scroll, a technique has been proposed in which the screen is zoomed out together with the scroll when the touch time interval is equal to or less than a threshold (see Patent Document 1). In this technique, it is possible to scroll a position far from the displayed screen to the center of the display. There is also a technique that can reduce input mistakes even when an operator performs a scroll operation with a finger placed on a touch panel or touches instantaneously in a very short time (see Patent Document 2). .

  On the other hand, even in many portable information devices, the entire image can be scrolled by a so-called drag operation in which a finger is moved while being in contact with the touch panel. In addition, a technique has been proposed in which the tilt of the device is detected, and scrolling is performed under a predetermined touch operation while changing the speed according to the magnitude of the tilt (see Patent Document 3).

JP 2009-265835 A JP 2007-10645 A JP 2011-76349 A

  However, when scrolling by a drag operation with a finger on a portable information device, if an attempt is made to display a distant portion of information that cannot be displayed on the screen, the drag operation must be performed many times. Don't be.

  Here, the “far” position means a position farther away in the information space. For example, consider a case where the width of an image of a certain content is considerably larger than the width of the screen. The portion of the content that is not displayed is closer to the end of the content in the width direction, and is located farther from the screen.

  Actually, when the entire image is moved by a single drag operation, the amount of movement is limited to the movable range of the finger, that is, the distance between two points on the screen. For this reason, as the part to be displayed is at a “distant” position, the drag operation is required more times.

  This problem is difficult to solve even by applying conventional techniques such as those disclosed in Patent Documents 1 to 3. For example, even with one-touch scrolling as disclosed in Patent Documents 1 and 2, the finger touch position in the screen only moves to the center, and basically the amount of movement of the entire image in one operation is limited. ing. It is also difficult to adjust the scroll speed in order to make it easier to find a desired portion. Further, in the technique of Patent Document 1, the entire image is zoomed out together with scrolling to widen the display range. This is effective in the scrolling of map information. However, for example, when searching for a desired part in the contents of a document and an image with a portable information device, there are many harmful effects such as characters becoming smaller and difficult to confirm.

  In addition, as in Patent Document 3, an operation in which a portable information device is tilted under a predetermined touch operation and scrolled at a speed corresponding to the magnitude of the tilt has an advantage that the scroll speed can be adjusted. It is never easy. In addition, it is necessary to check an image that is scrolled while the screen is tilted, and inconvenience remains in finding a desired portion.

  Accordingly, the present invention provides a user interface device, an image scrolling method, and a program that can display a portion of a distant position that is not displayed in information that cannot be displayed on a screen in a short time with a simple operation. With the goal.

According to the present invention, an image display unit that displays an image on a screen, a touch panel that sequentially outputs a contact position of a finger over time, and a pressing force detection that detects a pressing force applied to the touch panel by the finger. A user interface device that scrolls the entire image by a drag operation with the finger,
An operation determination means for determining whether or not the drag operation by the finger is completed;
A scroll speed determining means for sequentially determining a post-drag speed, which is a scroll speed after the drag operation, according to the maximum value of the pressing force after the drag operation when the operation determination means makes a true determination;
There is provided a user interface device having scroll control means for further scrolling the entire image at the determined post-drag speed after scrolling by a drag operation.

  As one embodiment of the user interface device according to the present invention, the operation determination means sequentially determines whether or not the finger is in contact with the touch panel after making a true determination by itself, and the scroll speed determination means When it is determined that the finger is not touching, it is also preferable that the post-drag speed is determined to be zero regardless of the maximum value of the pressing force.

  Further, as another embodiment of the user interface device according to the present invention, the operation determination unit sequentially determines whether or not the finger is in contact with the touch panel after performing the true determination itself, and the scroll control unit includes: It is also preferable to further scroll the entire image at the determined post-drag speed when it is determined that the finger is in contact.

  Furthermore, as another embodiment of the user interface device according to the present invention, the scroll control means holds the scroll direction information at the time of the drag operation, and after this drag operation, the entire image is displayed in the scroll direction at the time of the drag operation. It is also preferable to scroll further.

Further, as another embodiment of the user interface device according to the present invention, a tactile response mechanism unit that gives a tactile response to the finger touching the touch panel,
It is also preferable to further include tactile response control means for controlling the tactile response mechanism unit to give a tactile response corresponding to the scrolling speed to the finger via the touch panel. In this case, it is also preferable that the tactile response control means controls the tactile response mechanism unit so as to apply a stronger vibration to the finger as the scroll speed increases.

  In addition, according to the user interface device of the present invention, when the finger is pressed with a predetermined pressing force on the touch panel immediately after the drag operation is performed, the scroll control means is released when the user presses the finger with a predetermined pressing force. It is also preferable to increase the scroll speed to a post-drag speed determined according to a predetermined pressing force, and then maintain the post-drag speed.

According to the present invention, an image display unit that displays an image on a screen, a touch panel that sequentially outputs a contact position of a finger as time passes, and a pressing force that detects a pressing force applied to the touch panel by the finger. A program installed in a user interface device that scrolls the entire image by a drag operation with the finger,
An operation determination means for determining whether or not the drag operation by the finger is completed;
A scroll speed determining means for sequentially determining a post-drag speed, which is a scroll speed after the drag operation, according to the maximum value of the pressing force after the drag operation when the operation determination means makes a true determination;
There is provided a program for a user interface device that causes a computer to function as scroll control means for further scrolling the entire image at the determined post-drag speed after scrolling by a drag operation.

Further, according to the present invention, an image display unit that displays an image on a screen, a touch panel that sequentially outputs a contact position of a finger as time elapses, and a pressing force applied to the touch panel by the finger are detected. A method of scrolling an image in a user interface device, wherein the entire image is scrolled by a drag operation with the finger,
A first step of determining whether or not the drag operation with the finger has ended;
A second step of sequentially determining a post-drag speed, which is a scroll speed after the drag operation, in accordance with the maximum value of the pressing force after the drag operation when a true determination is made in the first step;
And a third step of further scrolling the entire image at the determined post-drag speed after scrolling by the drag operation.

  According to the user interface device, the image scrolling method, and the program of the present invention, it is possible to display a portion at a distant position that is not displayed in information that cannot be displayed on the screen in a short time with a simple operation.

FIG. 4 is a front view of a portable information device and a schematic diagram of an operation with a finger for explaining a “drag click” operation. FIG. 6 is a graph showing various aspects of “post-drag” velocity v _AD as a function of maximum pressing force value p _MAX . FIG. In "drag click" operation is a graph illustrating one embodiment of a time change of the scroll speed corresponding to the time variation of the pressing force p _C with a finger. 1 is a perspective view schematically showing a configuration of a portable information device according to the present invention, and a flowchart showing an embodiment of an image scrolling method according to the present invention. It is a functional block diagram which shows one Embodiment of the portable information device by this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  The user interface device according to the present invention is characterized in that after the entire image displayed on the display is scrolled by a drag operation, the image is further scrolled at a speed determined according to the maximum value of the pressing force applied to the touch panel by the finger. Have Hereinafter, the drag operation and the subsequent pressing on the touch panel by the finger are collectively referred to as a “drag click” operation.

  Here, the “entire image” is a part to be scrolled among all the images displayed on the display screen. Of course, it can also be the entire displayed image. For example, a displayed portion of information that does not fit on one screen is a scroll target.

  In the user interface device targeted by the present invention, information is input when the user's finger contacts the touch panel. Therefore, most of the devices are portable information devices such as smartphones and tablet computers that can be carried and operated by hand. Therefore, hereinafter, a portable information device will be described as an embodiment of the present invention.

  FIG. 1 is a front view of a portable information device and a schematic diagram of an operation with a finger for explaining a “drag click” operation. For the sake of easy understanding, the case where the search result is displayed as an image will be described below, but the present invention is naturally applied to the scrolling of an image representing other information.

  FIGS. 1A, 1 </ b> B, and 1 </ b> C <b> 1 are front views of the portable information device 1 showing a series of “drag click” operations. Moreover, FIG. 1 (C2) is a schematic diagram showing pushing with a finger. First, according to FIG. 1 (A), an image including a result of search using a search engine is displayed on the screen of the display 101. In the present embodiment, of the 50 search results 104, only the first to fifth cases are displayed on the screen.

  The user moves (slides) his / her finger upward while maintaining contact with the touch panel 100. That is, a so-called drag operation is performed. As a result, as shown in FIG. 1B, the image including the search result 104 is also scrolled upward in accordance with the movement of the finger. As a result, for example, the fourth to eighth search results 104 are displayed.

  Immediately after the drag operation, the user pushes the finger into the touch panel 100 at the contact position of the finger after the drag operation is completed. A series of simple operations including these drag operations and subsequent pressing with a finger is a “drag click” operation. By this operation, as shown in FIG. 1 (C1), the image including the search result 104 is further scrolled at a higher speed corresponding to the pressing of the finger, following the scroll by the drag operation.

  At this time, the user can adjust the scrolling speed while adjusting the strength of pushing the finger. As a result, for example, the forty-second to forty-sixth cases where the search result 104 is not displayed are displayed in a short time. Thereafter, for example, the user can find and select the desired 45th item and activate it.

Here, according to FIG. 1 (C 2), the pushing of the finger after the drag operation exerts a pressing force p _C on the touch panel 100. The scrolling speed at this time is determined to be a value corresponding to the maximum value p _MAX of the pressing force p _C after the drag operation. Specifically, the scroll speed determination unit 122 (FIG. 6) described later determines the scroll speed after the drag operation in accordance with the maximum pressing force value p _MAX . Hereinafter, this speed is referred to as “after drag” speed.

As an example, a case is considered in which immediately after a user performs a drag operation, a finger is pressed against the touch panel 100 with a pressing force p _C (= p _MAX ) and then the pressing is released. In this case, the scrolling speed increases to a “post-drag” speed value determined according to the pressing force p _C (= p _MAX ), and is then maintained at this speed value.

  Note that the image movement amount (scroll amount) during the drag operation may coincide with the finger movement amount, or may be an appropriate function value of the finger movement amount, such as a constant multiple of the finger movement amount. Good. Of course, the direction of movement of the finger is not limited to the upper side. For example, the finger can be moved in any direction on the surface of the touch panel 100, and the image can be moved in any of the upper, lower, left, right, and diagonal directions corresponding to the direction of the finger movement. It can be.

  Furthermore, the scroll direction after the drag operation is preferably matched with the scroll direction at the time of the drag operation. Thereby, the user can further continue scrolling in the intended direction by the drag operation. At this time, it is also preferable that the scroll control unit 123 (FIG. 6), which will be described later, inputs and holds information on the scroll direction at the time of the drag operation from the operation determination unit 121 (FIG. 4). After the drag operation, the scroll control unit 123 further scrolls the entire image in the scroll direction at the time of the drag operation.

  As described above, according to the present invention, an information portion at a distant position that is not displayed can be displayed in a short time by a “drag click” operation without using a number of drag operations.

In addition, since the scrolling speed can be adjusted by the maximum value p _MAX of the pressing force by the finger, many information parts not displayed on the screen can be browsed and confirmed at a pace desired by the user himself / herself in a short time. be able to. Furthermore, once the scrolling speed is determined with the maximum value p _MAX of the pressing force, the scrolling is performed at the determined speed even if the pressing by the finger is subsequently released. Therefore, finger fatigue is avoided, and the operation burden when scrolling is suppressed.

  A tactile response mechanism 102 (FIG. 5), which will be described later, can give a finger a tactile response corresponding to the scrolling speed. For example, when the user presses the finger more strongly, the “after drag” speed is determined to be a larger value, and as a result, the higher the scroll speed, the stronger vibration v is given to the finger. Thereby, the user can experience increase / decrease in the speed of scrolling from a finger | toe, and can obtain realistic operation feeling.

  It is also preferable to display the speed vector 105 on the screen according to the scroll speed at the time of the drag operation and the pressing of the finger. The speed vector 105 is, for example, an arrow vector that has a length proportional to the scroll speed and faces the scroll direction. The user can adjust the operation while confirming the scroll state by visually recognizing the velocity vector 105.

FIG. 2 is a graph showing various aspects of the “post-drag” velocity v _AD as a function of the maximum pressing force value p _MAX . Here, the maximum pressing force value p _MAX is the maximum value of the pressing force p _C from the time immediately after the drag operation to the time when the “post-drag” speed v _AD is determined.

FIG. 2 shows five types 2a, 2b, 2c, 2d, and 2e as the relationship between the maximum pressing force value p _MAX and the “post-drag” speed v _AD . In relation 2a, when the maximum pressing force value p _MAX is within the section of p _TH0 ≦ p _C <p _TH1 , the “after dragging” speed v _AD is set to v _AD1 and the maximum pressing force value p _MAX is set to p _TH1 ≦ When in the interval of p _C <p _TH2 , the “post-drag” velocity v _AD is v _AD2 (> v _AD1 ), and when in the interval of p _TH2 ≦ p _C , v _AD3 (> v _AD2 ) Is set. In this case, as the finger is pushed, the scroll speed after the drag operation increases stepwise. Thereafter, even if the finger is released, the scroll speed is maintained at the “after dragging” speed v _AD corresponding to the pressing force p _C value (the pressing force maximum value p _MAX ) immediately before the finger is released.

In relation 2b, the “post-drag” speed v _AD is linearly related to the maximum pressing force value p _MAX and has a positive slope, and the higher the maximum pressing force value p _MAX is, the higher the value is continuously set. Is done. In this case, as the finger is pushed in, the scrolling speed after the drag operation increases in proportion to the push. Thereafter, even if the finger is released, the scroll speed is maintained at the “after dragging” speed v _AD corresponding to the pressing force p _C value (the pressing force maximum value p _MAX ) immediately before the finger is released.

Further, in the relationship 2c, the “post-drag” speed v _AD is not so high while the maximum pressing force value p _MAX is small, but rapidly increases as the pressing force maximum value p _MAX increases. In this case, the scroll speed after the drag operation gradually increases when the finger is pushed in, but suddenly increases as the finger is pushed more strongly. In relation 2d, the “post-drag” speed v _AD initially increases rapidly as the maximum pressing force value p _MAX increases, and then becomes substantially constant even when the maximum pressing force value p _MAX increases. Converge. In this case, the scrolling speed after the drag operation suddenly increases from the beginning when the finger is pressed, but is almost constant from the vicinity where the finger is pressed to some extent. In relations 2c and 2d, when the finger is released, the scrolling speed is maintained at the “after dragging” speed v _AD corresponding to the pressing force p _C value (maximum pressing force value p _MAX ) immediately before releasing. Is done.

Furthermore, in the relationship 2e, if the maximum pressing force value p _MAX is equal to or greater than _pTH0 (p _C ≧ p _TH0 ), the “after dragging” speed v _AD is a constant value (v _AD4 ) regardless of the pressing force p _C. Set to In this case, if the finger is pushed with a certain strength or more, scrolling after the drag operation is performed at a certain speed (v _AD4 ). After that, even if the finger is released, the scroll speed is maintained at this speed _vAD4 .

In addition, aspects other than the relationship mentioned above are also possible. However, in any case, the “post-drag” speed v _AD is preferably a monotonically increasing function of the maximum pressing force value p _MAX . That is, it is preferable that the “after dragging” speed v _AD is not set to be lower even if the maximum pressing force value p _MAX is increased. Thereby, the user can maintain the feeling that pushing more strongly results in faster scrolling.

In any of the above-described relationships, the “after dragging” speed v _AD is set to 0 (zero) when the maximum pressing force value p _MAX is less than the threshold value p _TH0 . Here, it is preferable that the threshold value p _TH0 is normally set to a value larger than the pressing force value applied to the touch panel 100 while the finger is performing a drag operation. Thus, after the drag operation, that is, after the finger stops, the entire image is scrolled again (or continuously) only after the finger performs a pressing operation in which the pressing force p _C is _{equal to} or greater than the threshold value p _TH0. can do. In other words, it is assumed that the “drag click” operation is performed only when the pressing force p _C (that is, the maximum pressing force value p _MAX at that time) becomes equal to or greater than the threshold value p _TH0 . The threshold value p _TH0 can be set to a value in the range of 0.5N (Newton) to _2.0N , for example.

Furthermore, as another aspect, it is also possible to adopt a graph passing through the origin as this relationship without providing the threshold value p _TH0 in the relationship between the maximum pressing force value p _MAX and the “post-drag” speed v _AD . However, in this case, the entire image is scrolled at a “post-drag” speed v _AD corresponding to the pressing force p _C (pressing force maximum value p _MAX ) due to the contact of the finger even if the pressing operation by the finger is not performed after the drag operation. Is done.

FIG. 3 is a graph showing one embodiment of the temporal change in the scroll speed corresponding to the temporal change of the pressing force p _C by the finger in the “drag click” operation.

In the embodiment shown in FIG. 3, it is assumed that the maximum pressing force value p _MAX and the “post-drag” speed v _AD have the relationship 2b in FIG. However, by adopting a relationship 2a in FIG. 2 that has a sufficiently large number of steps (a large number of threshold values _pTH are provided) and a sufficiently small interval between discrete values of the “post-drag” velocity v _AD is obtained. It is possible to obtain substantially the same results as in the following example.

According to FIG. 3, the drag operation is performed from time t = 0 to t = _{t 1.} Scrolling speed at that time corresponds to the moving speed of the finger, a v _D. Next, simultaneously with the end of the drag operation (t = t ₁ ), pushing into the touch panel 100 by the finger is started, and the pressing force p _C increases to _PCA . Here, the pressing force maximum value p _MAX during this period is the pressing force p _C (t) value at that time (time t). Depending on this maximum pressing force value p _MAX , the scroll speed increases to a “post-drag” speed v _ADA (> v _D ).

The length of the acceleration period 3a between the scroll speed increases from v _D to v _ADA goal is to determine the scrolling response to "click drag" operation. Therefore, it is preferable that the length of the acceleration period 3a can be adjusted to give a good operational feeling. Further, the pressing force value p _CA is a value equal to or _larger than the threshold value p _TH0 (FIG. 2) (p _CA ≧ p _TH0 ), and is a value sufficient to start scrolling after the drag operation. Furthermore, when there is a time between the end of the drag operation and the start of pressing with a finger, scrolling may be temporarily stopped and then resumed by pressing.

Next, after the pressing force p _C is maintained until time t = t ₂ , the user starts pushing the finger more strongly in an attempt to display information on a distant position that is not yet displayed. As a result, the finger pressing force p _C continues to increase from time t = t ₂ to t = t ₃ and changes from p _CA to p _CB (> p _CA ). Here, the pressing force maximum value p _MAX during this time also becomes the pressing force p _C (t) value at that time (time t). Therefore, the “post-drag” speed v _AD that is sequentially determined according to the change in the maximum pressing force value p _MAX also increases with time from v _ADA to v _ADB (> v _ADA ). As a result, the scrolling speed increases after being maintained at the “post-drag” speed v _ADA at least until time t = t ₂ and reaches the “post-drag” speed v _ADB after time t = t ₃ .

Next, the user who recognizes that the desired scroll speed has been reached gradually weakens the pressing of the finger. As a result, the pressing force p _C decreases to p _CC at time t = t ₄ . Here, the pressing force maximum value p _MAX during this period is a peak value (maximum value) p _CB of the pressing force p _C and is constant. According to this constant pressing force maximum value p _MAX , the “after drag” speed v _AD also continues to take a value corresponding to this maximum value, and as a result, the scroll speed also maintains this “after drag” speed v _AD . Will do.

When the pressing force p _C value at each time point in FIG. 3 is larger than the pressing force maximum value p _MAX so far, the pressing force p _C value is stored in the memory 122m of the scroll speed determination unit 122 (FIG. 6) described later. It is stored as the maximum pressure value p _MAX . Based on this maximum pressing force value p _MAX , the “after drag” speed v _AD is determined. The stored pressing force maximum value p _MAX is rewritten to a measured value exceeding itself only when a pressing force p _C value exceeding itself is measured. Therefore, the values stored in the memory 122m always the maximum value of the pressing force p _C at each time point after the drag operation.

Next, the user finds a desired information portion in the screen with the pressing force p _C = p _CC , and releases the finger from the touch panel 100 at time t = t ₅ . In response to this, the scroll speed, after maintaining at least a time t = t "after drug" to ₅ speed v _ADB, leading to zero (scroll ends). That is, the “after dragging” speed v _AD is set to zero in response to the end of finger contact.

As described above, according to the present invention, the scrolling speed can be controlled by a simple “drag click” operation of pushing a finger after the drag operation. As a result, the user's desired information portion can be displayed in a short time. Further, by adjusting the maximum value of the pressing force p _c with the finger, the scroll speed is controllable. Therefore, it is not necessary to keep pushing the finger strongly in order to continue scrolling at an appropriate speed. As a result, it is possible to perform scrolling with a reduced operational burden.

  FIG. 4 is a perspective view schematically showing the configuration of the portable information device 1 according to the present invention, and a flowchart showing an embodiment of the image scrolling method according to the present invention. FIG. 5 is a functional configuration diagram showing an embodiment of a portable information device according to the present invention.

  According to FIG. 4, the portable information device 1 includes a touch panel 100, a display 101, a tactile response mechanism unit 102, a pressing force detection unit 103, and a processor memory. Here, the processor memory realizes its function by executing a program.

  The display 101 displays an image on the screen. Moreover, the touch panel 100 is arrange | positioned on the screen of the display 100, and outputs the contact position of a user's finger | toe sequentially according to progress of time. As this touch panel 100, a projected capacitive touch panel, a surface capacitive touch panel, a resistive touch panel, an ultrasonic surface acoustic wave touch panel, an infrared scanning touch panel, or the like can be employed.

The tactile response mechanism unit 102 gives a tactile response to the finger touching the touch panel 100 by vibrating the touch panel 100. For example, when the finger is pushed into the touch panel 100 after the drag operation, vibration v (FIG. 1 (C1) and (C2)) corresponding to the scroll speed controlled by the pressing force p _C is applied to the finger. The tactile response mechanism 102 can be a piezoelectric actuator formed using a piezoelectric material such as PZT (lead zirconate titanate).

The pressing force detection unit 103 detects a pressing force p _{C applied} to the touch panel 100 by a finger. The pressing force detection unit 103 is installed, for example, under the four corners of the touch panel 100, and detects the total pressure exerted on the touch panel 100 that is bent by pressing a finger as the pressing force p _C. The pressing force signal output by the pressing force detection unit 103 is input to a scroll speed determination unit 122 described later. The pressing force detection unit 103 can be, for example, a piezoelectric sensor formed using a piezoelectric material such as PZT. In addition to or in addition to providing the tactile response mechanism unit 102 formed of a piezoelectric actuator, the pressing force detection unit 103 can be used as a tactile response mechanism unit.

  The processor memory inputs a finger contact position signal output from the touch panel 100 and a pressing force signal output from the pressing force detection unit 103, and performs a “drag click” operation by the user's finger based on these signals. And scroll the entire image according to the content of the operation. Here, the functional configuration of the processor memory will be described with reference to FIG.

  According to FIG. 5, the processor memory includes an operation determination unit 121, a scroll speed determination unit 122, a scroll control unit 123, a tactile response control unit 124, a display control unit 111, and an application processing unit 112. doing.

  The operation determination unit 121 inputs a finger contact position signal output from the touch panel 100, and whether or not the finger contact position has moved immediately after the finger touches the touch panel 100, that is, whether or not a drag operation has started. And the determination result is output to the scroll control unit 123. Further, after that, it is determined whether or not the movement of the contact position is completed, that is, whether or not the drag operation is completed, and this determination result is also output to the scroll control unit 123.

The scroll speed determination unit 122 inputs the pressing force signal output from the pressing force detection unit 103, and “after dragging” according to the maximum value of the pressing force p _C after the drag operation (maximum pressing force value p _MAX ). Determine the velocity v _AD . At this time, the scroll speed determination unit 122 stores the maximum value of the pressing force p _C after the drag operation (the pressing force maximum value p _MAX ) in the memory 122m, and sets the “after dragging” speed v _AD to the maximum value p. A value corresponding to _MAX is determined. Further, when the pressing force p _C value exceeding the stored maximum value p _MAX is measured, the stored value (the pressing force maximum value p _MAX ) in the memory 122m is rewritten to the measured pressing force p _C value.

Furthermore, the scroll speed determination unit 122 holds a predetermined relationship between the maximum pressing force value p _MAX and the “post-drag” speed v _AD as shown in FIG. 2 in the memory 122m. Using this held relationship, the scroll speed determination unit 122 uses the post-drag speed v corresponding to the maximum value of the pressing force p _C received from the pressing force detection unit 103 (stored pressing force maximum value p _MAX ). _AD is sequentially calculated and sequentially output to the scroll control unit 123.

  When the determination result that the drag operation has been started is input from the operation determination unit 121, the scroll control unit 123 instructs the display control unit 111 to scroll the entire image. The scroll control unit 123 further determines the scroll direction and the scroll amount based on the movement direction and the movement amount of the finger contact position in the drag operation input from the operation determination unit 121, Instruct.

Further, when the determination result that the drag operation is finished is input from the operation determination unit 121, the scroll control unit 123 further scrolls the entire image at the “post-drag” speed v _AD output from the scroll speed determination unit 122. Thus, the display control unit 111 is instructed. Here, the direction of the further scroll is preferably the same as the direction of the scroll by the drag operation.

The tactile response control unit 124 receives further scroll instruction information output from the scroll control unit 123, and outputs a tactile response (for example, vibration v (FIG. 1 (C1) and (C2))) according to the scroll speed. The tactile response mechanism 102 is controlled to be applied to the finger. At this time, for example, when the maximum pressing force value p _MAX suddenly increases from p _C1 to p _C2 , the “post-drag” speed set correspondingly also suddenly changes from v _AD1 to v _AD2 . However, at the actual scroll speed, the change from v _AD1 to v _AD2 can be performed continuously and smoothly instead of stepwise. In this case, the haptic response control unit 124 can change the strength of the haptic response (vibration v) so as to be linked to the actual smoothly changing scroll speed.

  The display control unit 111 inputs the application processing information from the application processing unit 112 and causes the display 101 to display an image corresponding to the execution of the application. Further, the display control unit 111 inputs instruction information output from the scroll control unit 123 to scroll the entire image, and causes the display 101 to display the entire image according to the specified scroll condition.

  Next, an embodiment of the image scrolling method implemented in the processor memory will be described using the flowchart shown in FIG.

(S401) First, the touch panel 100 measures the presence or absence of finger contact.
(S402) Next, the operation determination unit 121 determines whether a drag operation has been started.
(S403) When it is determined in step S402 that the drag operation has started, the scroll control unit 123 scrolls the entire image in accordance with the drag operation. When it is determined that the drag operation has not been started, the contact measurement is repeated (step S401).

(S404) Next, the operation determination unit 121 determines whether or not the drag operation has ended. Here, when it is determined that the drag operation has not ended, the scrolling is continued (step S403).

(S411) On the other hand, when it is determined that the drag operation has been completed, the process proceeds from the stage of scrolling by the drag operation to the stage of preparation for scrolling by the push-in operation. Here, the parameter p _MAX is initially set to a predetermined threshold value p _TH0 (p _MAX = p _TH0 ).

(S412) The operation determination unit 121 further determines whether or not the finger is in contact with the touch panel 100. Here, when it is determined that the finger is not in contact with the touch panel 100 (the finger has left the touch panel 100), the “drag click” operation is not performed and the scrolling is terminated.
(S413) On the other hand, when it is determined that the finger is in contact with the touch panel 100, the pressing force detection unit 103 measures the pressing force p _C by the finger.

(S414) It is determined whether or not the measured value of the pressing force p _C is larger than the parameter p _MAX .
(S415) When it is determined that the measured value of the pressing force p _C is larger than the parameter p _MAX (p _C > p _MAX ), the parameter p _MAX is rewritten to the measured pressing force p _C. On the other hand, when it is determined that p _C ≦ p _MAX , the process directly proceeds to step S416.

(S416) The scroll speed determination unit 122 determines the “after drag” speed v _AD of the scroll according to the value of the parameter p _MAX (the maximum pressing force value p _MAX after the drag operation). Here, if p _MAX = p _TH0 , it is also preferred that the “after drag” speed v _AD is determined to be zero.

(S417) Next, the scroll control unit 123 further scrolls the entire image at the determined “post-drag” speed v _AD . Here, the steps from step S412 to S417 described above are repeated while it is determined in step S412 that the finger is in contact.

As described above in detail, in the user interface device, the image scrolling method, and the program of the present invention, after the drag operation at the “after drag” speed v _AD determined according to the maximum value of the finger pressing force p _C. The entire image is further scrolled. As a result, a portion of a distant position that is not displayed in information that cannot be displayed on the screen can be displayed in a short time with a simple operation.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

1 Portable information device (user interface device)
DESCRIPTION OF SYMBOLS 100 Touch panel 101 Display 102 Tactile response mechanism part 103 Pressing force detection part 104 Search result 105 Speed vector 111 Display control part 112 Application processing part 121 Operation determination part 122 Scroll speed determination part 122m Memory 123 Scroll control part 124 Tactile response control part

Claims (9)

An image display unit that displays an image on a screen, a touch panel that sequentially outputs a contact position of a finger as time elapses, and a pressing force detection unit that detects a pressing force applied to the touch panel by the finger A user interface device that scrolls the entire image by a drag operation with the finger,
An operation determination means for determining whether or not the drag operation by the finger is completed;
A scroll speed determining means for sequentially determining a post-drag speed, which is a scroll speed after the drag operation, according to the maximum value of the pressing force after the drag operation when the operation determination means makes a true determination;
A user interface device comprising scroll control means for further scrolling the entire image at the determined post-drag speed after scrolling by a drag operation.   The operation determining means sequentially determines whether or not the finger is in contact with the touch panel after making a true determination, and the scroll speed determining means is determined to be not in contact with the finger. The user interface device according to claim 1, wherein the post-drag speed is determined to be zero regardless of the maximum value of the pressing force.   The operation determination means sequentially determines whether or not the finger is in contact with the touch panel after making a true determination by itself, and the scroll control means determines that the finger is in contact The user interface device according to claim 1, wherein the entire image is further scrolled at the determined post-drag speed.   The scroll control means holds scroll direction information at the time of the drag operation, and further scrolls the entire image in the scroll direction at the time of the drag operation after the drag operation. 4. The user interface device according to any one of 3 above. A tactile response mechanism that gives a tactile response to the finger touching the touch panel;
5. The tactile response control means for controlling the tactile response mechanism unit to give a tactile response corresponding to a scrolling speed to the finger via the touch panel. The user interface device according to claim 1.   The user interface device according to claim 5, wherein the tactile response control unit controls the tactile response mechanism unit so as to give a strong vibration to the finger as the scroll speed increases.   When the finger is pressed against the touch panel with a predetermined pressing force immediately after performing the drag operation as viewed from the user's operation, the scroll control means reduces the scroll speed to the predetermined pressing force. 7. The user interface device according to claim 1, wherein the speed is increased to a post-drag speed determined according to the pressure, and then maintained at the post-drag speed. 8. An image display unit that displays an image on a screen, a touch panel that sequentially outputs a contact position of a finger as time elapses, and a pressing force detection unit that detects a pressing force applied to the touch panel by the finger , A program installed in a user interface device that scrolls the entire image by a drag operation with the finger,
An operation determination means for determining whether or not the drag operation by the finger is completed;
A scroll speed determining means for sequentially determining a post-drag speed, which is a scroll speed after the drag operation, according to the maximum value of the pressing force after the drag operation when the operation determination means makes a true determination;
A program for a user interface device, which causes a computer to function as scroll control means for further scrolling an entire image at a determined post-drag speed after scrolling by a drag operation. An image display unit that displays an image on a screen, a touch panel that sequentially outputs a contact position of a finger as time elapses, and a pressing force detection unit that detects a pressing force applied to the touch panel by the finger An image scrolling method in a user interface device that scrolls the entire image by a drag operation with the finger,
A first step of determining whether or not the drag operation with the finger has ended;
A second step of sequentially determining a post-drag speed, which is a scroll speed after the drag operation, in accordance with the maximum value of the pressing force after the drag operation when a true determination is made in the first step;
And a third step of further scrolling the entire image at the determined post-drag speed after scrolling by the drag operation.

Images